2024-05-10T03:16:35.940 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-10T03:16:35.940 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/fs/norstats}} --name pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi --owner scheduled_pdonnell@teuthology --verbose --archive /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700479 -- /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700479/orig.config.yaml 2024-05-10T03:16:35.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-10T03:16:36.092 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700479 branch: wip-pdonnell-testing-20240509.171335-reef-debug description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/fs/norstats}} email: pdonnell@redhat.com first_in_suite: false job_id: '7700479' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-pdonnell-testing-20240509.171335-reef-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 50174015a7e79f951b988949abe236791f52d4da subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: 50174015a7e79f951b988949abe236791f52d4da kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync rbytes: false syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240509.171335-reef-debug sha1: 50174015a7e79f951b988949abe236791f52d4da owner: scheduled_pdonnell@teuthology priority: 65 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 4933 sha1: 50174015a7e79f951b988949abe236791f52d4da sleep_before_teardown: 0 subset: 420/512 suite: fs suite_branch: wip-pdonnell-testing-20240509.171335-reef-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_50174015a7e79f951b988949abe236791f52d4da/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 50174015a7e79f951b988949abe236791f52d4da syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi045.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG2AgYlDW7A/G7pMbhalwf1ehlyoUBnhodp/TdgmS1qj41qmuXYu+2+/yHdZoATmhE+TXS6q4FQYgSlAQCX0V84= smithi106.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFb6sGf02ORuUqeubTCjeKf2xiloTNqFxf5x2MwkXcmyT5HQpP4X6mitOm4u1LzDMWnnrrH7aC0zNnKbGM8pqPY= smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH7QzYZusAcim8zWagTxGGvCMFIO7Xr9lnYRBylEasnDHc1cE7qTbDJBCaMcXqbhyve4dV78qoEuMRErNhFEf2E= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-10_02:33:39 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-10T03:16:36.093 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_50174015a7e79f951b988949abe236791f52d4da/qa; will attempt to use it 2024-05-10T03:16:36.093 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_50174015a7e79f951b988949abe236791f52d4da/qa/tasks 2024-05-10T03:16:36.093 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-10T03:16:36.095 INFO:teuthology.task.internal:Checking packages... 2024-05-10T03:16:36.117 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '50174015a7e79f951b988949abe236791f52d4da' 2024-05-10T03:16:36.117 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-10T03:16:36.117 INFO:teuthology.packaging:ref: None 2024-05-10T03:16:36.118 INFO:teuthology.packaging:tag: None 2024-05-10T03:16:36.118 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240509.171335-reef-debug 2024-05-10T03:16:36.118 INFO:teuthology.packaging:sha1: 50174015a7e79f951b988949abe236791f52d4da 2024-05-10T03:16:36.118 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20240509.171335-reef-debug 2024-05-10T03:16:36.442 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1330.g50174015 2024-05-10T03:16:36.443 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-10T03:16:36.451 INFO:teuthology.task.internal:no buildpackages task found 2024-05-10T03:16:36.451 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-10T03:16:36.471 INFO:teuthology.task.internal:Saving configuration 2024-05-10T03:16:36.491 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-10T03:16:36.497 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-10T03:16:36.522 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700479', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 03:11:03.577369', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG2AgYlDW7A/G7pMbhalwf1ehlyoUBnhodp/TdgmS1qj41qmuXYu+2+/yHdZoATmhE+TXS6q4FQYgSlAQCX0V84='} 2024-05-10T03:16:36.546 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi106.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700479', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 03:11:03.580650', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFb6sGf02ORuUqeubTCjeKf2xiloTNqFxf5x2MwkXcmyT5HQpP4X6mitOm4u1LzDMWnnrrH7aC0zNnKbGM8pqPY='} 2024-05-10T03:16:36.569 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700479', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 03:11:03.579098', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH7QzYZusAcim8zWagTxGGvCMFIO7Xr9lnYRBylEasnDHc1cE7qTbDJBCaMcXqbhyve4dV78qoEuMRErNhFEf2E='} 2024-05-10T03:16:36.570 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-10T03:16:36.576 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-05-10T03:16:36.576 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-05-10T03:16:36.576 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-05-10T03:16:36.576 INFO:teuthology.run_tasks:Running task console_log... 2024-05-10T03:16:36.677 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f80c9ebc0d0>, signals=[15]) 2024-05-10T03:16:36.678 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-10T03:16:36.684 INFO:teuthology.task.internal:Opening connections... 2024-05-10T03:16:36.684 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi045.front.sepia.ceph.com 2024-05-10T03:16:36.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T03:16:36.765 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi106.front.sepia.ceph.com 2024-05-10T03:16:36.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T03:16:36.839 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2024-05-10T03:16:36.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T03:16:36.912 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-10T03:16:36.918 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2024-05-10T03:16:36.940 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2024-05-10T03:16:36.941 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2024-05-10T03:16:37.001 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="Red Hat Enterprise Linux" 2024-05-10T03:16:37.001 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8.6 (Ootpa)" 2024-05-10T03:16:37.001 INFO:teuthology.orchestra.run.smithi045.stdout:ID="rhel" 2024-05-10T03:16:37.001 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="fedora" 2024-05-10T03:16:37.001 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8.6" 2024-05-10T03:16:37.001 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8" 2024-05-10T03:16:37.001 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-05-10T03:16:37.002 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2024-05-10T03:16:37.002 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-05-10T03:16:37.002 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://www.redhat.com/" 2024-05-10T03:16:37.002 INFO:teuthology.orchestra.run.smithi045.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-05-10T03:16:37.002 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-10T03:16:37.002 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:16:37.002 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-10T03:16:37.002 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-05-10T03:16:37.002 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-05-10T03:16:37.002 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-05-10T03:16:37.003 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2024-05-10T03:16:37.020 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2024-05-10T03:16:37.041 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2024-05-10T03:16:37.041 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2024-05-10T03:16:37.102 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="Red Hat Enterprise Linux" 2024-05-10T03:16:37.102 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="8.6 (Ootpa)" 2024-05-10T03:16:37.102 INFO:teuthology.orchestra.run.smithi106.stdout:ID="rhel" 2024-05-10T03:16:37.102 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="fedora" 2024-05-10T03:16:37.102 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="8.6" 2024-05-10T03:16:37.102 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el8" 2024-05-10T03:16:37.102 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-05-10T03:16:37.103 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31" 2024-05-10T03:16:37.103 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-05-10T03:16:37.103 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://www.redhat.com/" 2024-05-10T03:16:37.103 INFO:teuthology.orchestra.run.smithi106.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-05-10T03:16:37.103 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-10T03:16:37.103 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T03:16:37.103 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-10T03:16:37.103 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-05-10T03:16:37.103 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-05-10T03:16:37.103 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-05-10T03:16:37.103 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2024-05-10T03:16:37.128 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-05-10T03:16:37.148 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-05-10T03:16:37.149 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-05-10T03:16:37.207 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Red Hat Enterprise Linux" 2024-05-10T03:16:37.207 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8.6 (Ootpa)" 2024-05-10T03:16:37.207 INFO:teuthology.orchestra.run.smithi154.stdout:ID="rhel" 2024-05-10T03:16:37.207 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="fedora" 2024-05-10T03:16:37.207 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8.6" 2024-05-10T03:16:37.207 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8" 2024-05-10T03:16:37.207 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-05-10T03:16:37.207 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2024-05-10T03:16:37.207 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-05-10T03:16:37.207 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.redhat.com/" 2024-05-10T03:16:37.207 INFO:teuthology.orchestra.run.smithi154.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-05-10T03:16:37.207 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-10T03:16:37.208 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-10T03:16:37.208 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-10T03:16:37.208 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-05-10T03:16:37.208 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-05-10T03:16:37.208 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-05-10T03:16:37.208 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-05-10T03:16:37.228 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-10T03:16:37.238 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-10T03:16:37.246 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-10T03:16:37.247 DEBUG:teuthology.orchestra.run.smithi045:> test '!' -e /home/ubuntu/cephtest 2024-05-10T03:16:37.249 DEBUG:teuthology.orchestra.run.smithi106:> test '!' -e /home/ubuntu/cephtest 2024-05-10T03:16:37.251 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2024-05-10T03:16:37.269 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-10T03:16:37.275 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-10T03:16:37.275 DEBUG:teuthology.orchestra.run.smithi045:> test -z $(ls -A /var/lib/ceph) 2024-05-10T03:16:37.310 DEBUG:teuthology.orchestra.run.smithi106:> test -z $(ls -A /var/lib/ceph) 2024-05-10T03:16:37.312 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2024-05-10T03:16:37.341 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-10T03:16:37.414 INFO:teuthology.run_tasks:Running task kernel... 2024-05-10T03:16:37.430 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-05-10T03:16:37.430 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-05-10T03:16:37.430 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-05-10T03:16:37.430 DEBUG:teuthology.orchestra.run.smithi045:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-10T03:16:37.450 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:16:37.451 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2024-05-10T03:16:37.512 INFO:teuthology.orchestra.run.smithi045.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-05-10T03:16:37.512 INFO:teuthology.task.kernel:Running kernel on smithi045: 4.18.0-513.9.1.el8_9.x86_64 2024-05-10T03:16:37.512 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum install -y kernel 2024-05-10T03:16:39.159 INFO:teuthology.orchestra.run.smithi045.stdout:Updating Subscription Management repositories. 2024-05-10T03:16:39.159 INFO:teuthology.orchestra.run.smithi045.stdout:Unable to read consumer identity 2024-05-10T03:16:39.483 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:16:39.483 INFO:teuthology.orchestra.run.smithi045.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-10T03:16:39.483 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:16:41.310 INFO:teuthology.orchestra.run.smithi045.stdout:Copr repo for python3-asyncssh owned by ceph 12 kB/s | 3.5 kB 00:00 2024-05-10T03:16:42.502 INFO:teuthology.orchestra.run.smithi045.stdout:Extra Packages for Enterprise Linux 12 MB/s | 14 MB 00:01 2024-05-10T03:16:46.219 INFO:teuthology.orchestra.run.smithi045.stdout:lab-extras 386 kB/s | 24 kB 00:00 2024-05-10T03:16:47.031 INFO:teuthology.orchestra.run.smithi045.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-05-10T03:16:47.031 INFO:teuthology.orchestra.run.smithi045.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-05-10T03:16:47.121 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-10T03:16:47.123 INFO:teuthology.orchestra.run.smithi045.stdout:Nothing to do. 2024-05-10T03:16:47.123 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-10T03:16:47.316 DEBUG:teuthology.orchestra.run.smithi045:> echo no | sudo yum reinstall kernel || true 2024-05-10T03:16:47.703 INFO:teuthology.orchestra.run.smithi045.stdout:Updating Subscription Management repositories. 2024-05-10T03:16:47.703 INFO:teuthology.orchestra.run.smithi045.stdout:Unable to read consumer identity 2024-05-10T03:16:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:16:47.897 INFO:teuthology.orchestra.run.smithi045.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-10T03:16:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:16:48.258 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:00:02 ago on Fri 10 May 2024 03:16:46 AM UTC. 2024-05-10T03:16:48.352 INFO:teuthology.orchestra.run.smithi045.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-05-10T03:16:48.362 INFO:teuthology.orchestra.run.smithi045.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-05-10T03:16:48.423 INFO:teuthology.orchestra.run.smithi045.stderr:Error: No packages marked for reinstall. 2024-05-10T03:16:48.480 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum reinstall -y kernel || true 2024-05-10T03:16:48.864 INFO:teuthology.orchestra.run.smithi045.stdout:Updating Subscription Management repositories. 2024-05-10T03:16:48.864 INFO:teuthology.orchestra.run.smithi045.stdout:Unable to read consumer identity 2024-05-10T03:16:49.101 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:16:49.101 INFO:teuthology.orchestra.run.smithi045.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-10T03:16:49.101 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:16:49.454 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:00:03 ago on Fri 10 May 2024 03:16:46 AM UTC. 2024-05-10T03:16:49.530 INFO:teuthology.orchestra.run.smithi045.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-05-10T03:16:49.531 INFO:teuthology.orchestra.run.smithi045.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-05-10T03:16:49.580 INFO:teuthology.orchestra.run.smithi045.stderr:Error: No packages marked for reinstall. 2024-05-10T03:16:49.635 DEBUG:teuthology.orchestra.run.smithi045:> rpm -q kernel | sort -rV | head -n 1 2024-05-10T03:16:49.803 INFO:teuthology.orchestra.run.smithi045.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-05-10T03:16:49.804 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-05-10T03:16:49.804 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-05-10T03:16:49.804 DEBUG:teuthology.parallel:result is None 2024-05-10T03:16:49.804 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-10T03:16:49.811 INFO:teuthology.task.internal:Creating test directory... 2024-05-10T03:16:49.811 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-10T03:16:49.814 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-10T03:16:49.816 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-10T03:16:49.837 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-10T03:16:49.844 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-10T03:16:49.851 INFO:teuthology.task.internal:Creating archive directory... 2024-05-10T03:16:49.851 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-10T03:16:49.873 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-10T03:16:49.877 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-10T03:16:49.911 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-10T03:16:49.920 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-10T03:16:49.920 DEBUG:teuthology.orchestra.run.smithi106:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-10T03:16:49.959 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:16:49.960 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-10T03:16:49.978 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:16:49.978 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-10T03:16:49.981 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-10T03:16:50.002 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-10T03:16:50.023 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T03:16:50.042 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T03:16:50.046 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T03:16:50.064 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T03:16:50.067 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T03:16:50.080 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T03:16:50.082 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-10T03:16:50.088 INFO:teuthology.task.internal:Configuring sudo... 2024-05-10T03:16:50.089 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-10T03:16:50.092 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-10T03:16:50.094 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-10T03:16:50.124 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-10T03:16:50.132 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-10T03:16:50.133 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-10T03:16:50.167 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-10T03:16:50.169 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-10T03:16:50.187 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T03:16:50.276 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T03:16:50.329 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T03:16:50.420 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T03:16:50.467 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-10T03:16:50.467 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-10T03:16:50.541 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T03:16:50.587 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T03:16:50.642 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T03:16:50.728 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T03:16:50.771 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T03:16:50.771 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-10T03:16:50.839 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T03:16:50.885 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T03:16:50.954 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T03:16:50.999 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T03:16:51.043 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-10T03:16:51.043 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-10T03:16:51.112 DEBUG:teuthology.orchestra.run.smithi045:> sudo service rsyslog restart 2024-05-10T03:16:51.114 DEBUG:teuthology.orchestra.run.smithi106:> sudo service rsyslog restart 2024-05-10T03:16:51.116 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2024-05-10T03:16:51.163 INFO:teuthology.orchestra.run.smithi045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T03:16:51.170 INFO:teuthology.orchestra.run.smithi106.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T03:16:51.210 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T03:16:51.550 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-10T03:16:51.557 INFO:teuthology.task.internal:Starting timer... 2024-05-10T03:16:51.557 INFO:teuthology.run_tasks:Running task pcp... 2024-05-10T03:16:51.617 INFO:teuthology.run_tasks:Running task selinux... 2024-05-10T03:16:51.716 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2024-05-10T03:16:51.716 DEBUG:teuthology.orchestra.run.smithi045:> sudo service auditd rotate 2024-05-10T03:16:51.797 INFO:teuthology.orchestra.run.smithi045.stdout:Rotating logs: 2024-05-10T03:16:51.800 DEBUG:teuthology.orchestra.run.smithi106:> sudo service auditd rotate 2024-05-10T03:16:51.866 INFO:teuthology.orchestra.run.smithi106.stdout:Rotating logs: 2024-05-10T03:16:51.868 DEBUG:teuthology.orchestra.run.smithi154:> sudo service auditd rotate 2024-05-10T03:16:51.921 INFO:teuthology.orchestra.run.smithi154.stdout:Rotating logs: 2024-05-10T03:16:51.923 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-10T03:16:51.923 DEBUG:teuthology.orchestra.run.smithi045:> /usr/sbin/getenforce 2024-05-10T03:16:51.948 INFO:teuthology.orchestra.run.smithi045.stdout:Permissive 2024-05-10T03:16:51.949 DEBUG:teuthology.orchestra.run.smithi106:> /usr/sbin/getenforce 2024-05-10T03:16:51.981 INFO:teuthology.orchestra.run.smithi106.stdout:Permissive 2024-05-10T03:16:51.982 DEBUG:teuthology.orchestra.run.smithi154:> /usr/sbin/getenforce 2024-05-10T03:16:52.021 INFO:teuthology.orchestra.run.smithi154.stdout:Permissive 2024-05-10T03:16:52.021 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi045.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi106.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi154.front.sepia.ceph.com': 'permissive'} 2024-05-10T03:16:52.021 DEBUG:teuthology.orchestra.run.smithi045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-10T03:16:52.053 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:16:52.053 DEBUG:teuthology.orchestra.run.smithi106:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-10T03:16:52.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:16:52.081 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-10T03:16:52.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:16:52.109 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-10T03:16:52.109 DEBUG:teuthology.orchestra.run.smithi045:> sudo /usr/sbin/setenforce permissive 2024-05-10T03:16:52.140 DEBUG:teuthology.orchestra.run.smithi106:> sudo /usr/sbin/setenforce permissive 2024-05-10T03:16:52.167 DEBUG:teuthology.orchestra.run.smithi154:> sudo /usr/sbin/setenforce permissive 2024-05-10T03:16:52.194 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-10T03:16:52.204 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-10T03:16:52.210 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-10T03:16:52.365 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-10T03:16:52.379 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-10T03:16:52.380 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi045.front.sepia.ceph.com,smithi106.front.sepia.ceph.com,smithi154.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-10T03:27:51.593 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi045.front.sepia.ceph.com'), Remote(name='ubuntu@smithi106.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com')] 2024-05-10T03:27:51.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-05-10T03:27:51.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T03:27:51.675 DEBUG:teuthology.orchestra.run.smithi045:> true 2024-05-10T03:27:51.748 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-05-10T03:27:51.748 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-05-10T03:27:51.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T03:27:51.823 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-05-10T03:27:51.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-05-10T03:27:51.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-05-10T03:27:51.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T03:27:51.972 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-05-10T03:27:52.045 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-05-10T03:27:52.046 INFO:teuthology.run_tasks:Running task clock... 2024-05-10T03:27:52.059 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-10T03:27:52.059 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-10T03:27:52.060 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T03:27:52.062 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-10T03:27:52.062 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T03:27:52.064 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-10T03:27:52.064 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T03:27:52.095 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-10T03:27:52.101 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-10T03:27:52.110 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-10T03:27:52.119 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-10T03:27:52.120 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-10T03:27:52.135 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-10T03:27:52.179 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: ntpd: command not found 2024-05-10T03:27:52.191 INFO:teuthology.orchestra.run.smithi106.stdout:506 Cannot talk to daemon 2024-05-10T03:27:52.197 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: ntpd: command not found 2024-05-10T03:27:52.198 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: ntpd: command not found 2024-05-10T03:27:52.205 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-10T03:27:52.209 INFO:teuthology.orchestra.run.smithi154.stdout:506 Cannot talk to daemon 2024-05-10T03:27:52.212 INFO:teuthology.orchestra.run.smithi045.stdout:506 Cannot talk to daemon 2024-05-10T03:27:52.219 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-10T03:27:52.224 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-10T03:27:52.230 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-10T03:27:52.239 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-10T03:27:52.247 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-10T03:27:52.286 INFO:teuthology.orchestra.run.smithi106.stderr:bash: ntpq: command not found 2024-05-10T03:27:52.290 INFO:teuthology.orchestra.run.smithi106.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T03:27:52.290 INFO:teuthology.orchestra.run.smithi106.stdout:=============================================================================== 2024-05-10T03:27:52.290 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T03:27:52.290 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T03:27:52.290 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T03:27:52.290 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T03:27:52.315 INFO:teuthology.orchestra.run.smithi154.stderr:bash: ntpq: command not found 2024-05-10T03:27:52.319 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T03:27:52.320 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-05-10T03:27:52.320 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T03:27:52.320 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T03:27:52.320 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T03:27:52.320 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T03:27:52.325 INFO:teuthology.orchestra.run.smithi045.stderr:bash: ntpq: command not found 2024-05-10T03:27:52.329 INFO:teuthology.orchestra.run.smithi045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T03:27:52.330 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================== 2024-05-10T03:27:52.330 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T03:27:52.330 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T03:27:52.330 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T03:27:52.330 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T03:27:52.330 INFO:teuthology.run_tasks:Running task pexec... 2024-05-10T03:27:52.340 INFO:teuthology.task.pexec:Executing custom commands... 2024-05-10T03:27:52.341 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi045.front.sepia.ceph.com 2024-05-10T03:27:52.341 DEBUG:teuthology.orchestra.run.smithi045:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-05-10T03:27:52.341 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi106.front.sepia.ceph.com 2024-05-10T03:27:52.341 DEBUG:teuthology.orchestra.run.smithi106:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-05-10T03:27:52.342 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi154.front.sepia.ceph.com 2024-05-10T03:27:52.342 DEBUG:teuthology.orchestra.run.smithi154:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-05-10T03:27:52.718 INFO:teuthology.orchestra.run.smithi106.stdout:Updating Subscription Management repositories. 2024-05-10T03:27:52.739 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2024-05-10T03:27:52.804 INFO:teuthology.orchestra.run.smithi045.stdout:Updating Subscription Management repositories. 2024-05-10T03:27:54.487 INFO:teuthology.orchestra.run.smithi154.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 35 kB/s | 4.5 kB 00:00 2024-05-10T03:27:54.514 INFO:teuthology.orchestra.run.smithi106.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 29 kB/s | 4.1 kB 00:00 2024-05-10T03:27:54.776 INFO:teuthology.orchestra.run.smithi045.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 33 kB/s | 4.1 kB 00:00 2024-05-10T03:27:54.821 INFO:teuthology.orchestra.run.smithi106.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 50 kB/s | 4.5 kB 00:00 2024-05-10T03:27:55.125 INFO:teuthology.orchestra.run.smithi045.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 43 kB/s | 4.5 kB 00:00 2024-05-10T03:27:55.159 INFO:teuthology.orchestra.run.smithi154.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 32 kB/s | 4.1 kB 00:00 2024-05-10T03:27:57.756 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-10T03:27:57.757 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-10T03:27:57.757 INFO:teuthology.orchestra.run.smithi106.stdout: Package Architecture Version Repository Size 2024-05-10T03:27:57.757 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-10T03:27:57.757 INFO:teuthology.orchestra.run.smithi106.stdout:Resetting modules: 2024-05-10T03:27:57.757 INFO:teuthology.orchestra.run.smithi106.stdout: container-tools 2024-05-10T03:27:57.757 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T03:27:57.757 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-05-10T03:27:57.757 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-05-10T03:27:57.757 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T03:27:58.003 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-10T03:27:58.004 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-10T03:27:58.004 INFO:teuthology.orchestra.run.smithi154.stdout: Package Architecture Version Repository Size 2024-05-10T03:27:58.004 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-10T03:27:58.004 INFO:teuthology.orchestra.run.smithi154.stdout:Resetting modules: 2024-05-10T03:27:58.004 INFO:teuthology.orchestra.run.smithi154.stdout: container-tools 2024-05-10T03:27:58.004 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-10T03:27:58.004 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-05-10T03:27:58.004 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-05-10T03:27:58.004 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-10T03:27:58.839 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-10T03:27:58.840 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-10T03:27:58.840 INFO:teuthology.orchestra.run.smithi045.stdout: Package Architecture Version Repository Size 2024-05-10T03:27:58.840 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-10T03:27:58.840 INFO:teuthology.orchestra.run.smithi045.stdout:Resetting modules: 2024-05-10T03:27:58.841 INFO:teuthology.orchestra.run.smithi045.stdout: container-tools 2024-05-10T03:27:58.841 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:27:58.841 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-05-10T03:27:58.841 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-10T03:27:58.841 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:28:08.994 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-10T03:28:09.243 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-10T03:28:09.494 INFO:teuthology.orchestra.run.smithi106.stdout:Updating Subscription Management repositories. 2024-05-10T03:28:09.797 INFO:teuthology.orchestra.run.smithi045.stdout:Updating Subscription Management repositories. 2024-05-10T03:28:11.363 INFO:teuthology.orchestra.run.smithi106.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 50 kB/s | 4.1 kB 00:00 2024-05-10T03:28:11.714 INFO:teuthology.orchestra.run.smithi106.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 30 kB/s | 4.5 kB 00:00 2024-05-10T03:28:11.791 INFO:teuthology.orchestra.run.smithi045.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 24 kB/s | 4.1 kB 00:00 2024-05-10T03:28:11.865 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-10T03:28:12.197 INFO:teuthology.orchestra.run.smithi045.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 28 kB/s | 4.5 kB 00:00 2024-05-10T03:28:12.350 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2024-05-10T03:28:14.346 INFO:teuthology.orchestra.run.smithi154.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 29 kB/s | 4.5 kB 00:00 2024-05-10T03:28:14.622 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-10T03:28:14.789 INFO:teuthology.orchestra.run.smithi106.stdout:========================================================================================================== 2024-05-10T03:28:14.789 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2024-05-10T03:28:14.790 INFO:teuthology.orchestra.run.smithi106.stdout:========================================================================================================== 2024-05-10T03:28:14.790 INFO:teuthology.orchestra.run.smithi106.stdout:Installing group/module packages: 2024-05-10T03:28:14.790 INFO:teuthology.orchestra.run.smithi106.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 1.0 M 2024-05-10T03:28:14.790 INFO:teuthology.orchestra.run.smithi106.stdout: buildah x86_64 1:1.31.5-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.8 M 2024-05-10T03:28:14.790 INFO:teuthology.orchestra.run.smithi106.stdout: cockpit-podman noarch 75-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 739 k 2024-05-10T03:28:14.790 INFO:teuthology.orchestra.run.smithi106.stdout: crun x86_64 1.8.7-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 239 k 2024-05-10T03:28:14.790 INFO:teuthology.orchestra.run.smithi106.stdout: netavark x86_64 2:1.7.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-10T03:28:14.791 INFO:teuthology.orchestra.run.smithi106.stdout: python3-podman noarch 4.6.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 154 k 2024-05-10T03:28:14.791 INFO:teuthology.orchestra.run.smithi106.stdout: skopeo x86_64 2:1.13.3-3.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.1 M 2024-05-10T03:28:14.791 INFO:teuthology.orchestra.run.smithi106.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 2.5 M 2024-05-10T03:28:14.791 INFO:teuthology.orchestra.run.smithi106.stdout: udica noarch 0.2.6-20.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 49 k 2024-05-10T03:28:14.791 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2024-05-10T03:28:14.791 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2024-05-10T03:28:14.791 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2024-05-10T03:28:14.791 INFO:teuthology.orchestra.run.smithi106.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2024-05-10T03:28:14.791 INFO:teuthology.orchestra.run.smithi106.stdout:Installing weak dependencies: 2024-05-10T03:28:14.791 INFO:teuthology.orchestra.run.smithi106.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-10T03:28:14.791 INFO:teuthology.orchestra.run.smithi106.stdout:Installing module profiles: 2024-05-10T03:28:14.791 INFO:teuthology.orchestra.run.smithi106.stdout: container-tools/common 2024-05-10T03:28:14.791 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T03:28:14.792 INFO:teuthology.orchestra.run.smithi106.stdout:Enabling module streams: 2024-05-10T03:28:14.792 INFO:teuthology.orchestra.run.smithi106.stdout: container-tools rhel8 2024-05-10T03:28:14.792 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T03:28:14.792 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-05-10T03:28:14.792 INFO:teuthology.orchestra.run.smithi106.stdout:========================================================================================================== 2024-05-10T03:28:14.792 INFO:teuthology.orchestra.run.smithi106.stdout:Install 13 Packages 2024-05-10T03:28:14.792 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T03:28:14.793 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 26 M 2024-05-10T03:28:14.793 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 87 M 2024-05-10T03:28:14.793 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-05-10T03:28:14.931 INFO:teuthology.orchestra.run.smithi106.stdout:(1/13): python3-pytoml-0.1.14-5.git7dea353.el8. 179 kB/s | 25 kB 00:00 2024-05-10T03:28:14.964 INFO:teuthology.orchestra.run.smithi106.stdout:(2/13): criu-libs-3.18-4.module+el8.9.0+20326+3 229 kB/s | 39 kB 00:00 2024-05-10T03:28:14.990 INFO:teuthology.orchestra.run.smithi106.stdout:(3/13): python3-pyxdg-0.25-16.el8.noarch.rpm 476 kB/s | 94 kB 00:00 2024-05-10T03:28:15.004 INFO:teuthology.orchestra.run.smithi154.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 36 kB/s | 4.1 kB 00:00 2024-05-10T03:28:15.107 INFO:teuthology.orchestra.run.smithi106.stdout:(4/13): aardvark-dns-1.7.0-1.module+el8.9.0+216 7.1 MB/s | 1.0 MB 00:00 2024-05-10T03:28:15.174 INFO:teuthology.orchestra.run.smithi106.stdout:(5/13): yajl-2.1.0-12.el8.x86_64.rpm 169 kB/s | 41 kB 00:00 2024-05-10T03:28:15.207 INFO:teuthology.orchestra.run.smithi106.stdout:(6/13): cockpit-podman-75-1.module+el8.9.0+2169 7.2 MB/s | 739 kB 00:00 2024-05-10T03:28:15.386 INFO:teuthology.orchestra.run.smithi106.stdout:(7/13): buildah-1.31.5-1.module+el8.9.0+21697+6 22 MB/s | 8.8 MB 00:00 2024-05-10T03:28:15.424 INFO:teuthology.orchestra.run.smithi106.stdout:(8/13): crun-1.8.7-1.module+el8.9.0+21697+6a5e9 956 kB/s | 239 kB 00:00 2024-05-10T03:28:15.508 INFO:teuthology.orchestra.run.smithi106.stdout:(9/13): netavark-1.7.0-2.module+el8.9.0+21697+6 12 MB/s | 3.7 MB 00:00 2024-05-10T03:28:15.567 INFO:teuthology.orchestra.run.smithi106.stdout:(10/13): python3-podman-4.6.0-2.module+el8.9.0+ 853 kB/s | 154 kB 00:00 2024-05-10T03:28:15.717 INFO:teuthology.orchestra.run.smithi106.stdout:(11/13): skopeo-1.13.3-3.module+el8.9.0+21697+6 28 MB/s | 8.1 MB 00:00 2024-05-10T03:28:15.742 INFO:teuthology.orchestra.run.smithi106.stdout:(12/13): udica-0.2.6-20.module+el8.9.0+21697+6a 282 kB/s | 49 kB 00:00 2024-05-10T03:28:15.792 INFO:teuthology.orchestra.run.smithi106.stdout:(13/13): toolbox-0.0.99.4-5.module+el8.9.0+2169 8.9 MB/s | 2.5 MB 00:00 2024-05-10T03:28:15.793 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-05-10T03:28:15.793 INFO:teuthology.orchestra.run.smithi106.stdout:Total 26 MB/s | 26 MB 00:01 2024-05-10T03:28:15.834 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-10T03:28:16.022 INFO:teuthology.orchestra.run.smithi045.stdout:========================================================================================================== 2024-05-10T03:28:16.023 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2024-05-10T03:28:16.023 INFO:teuthology.orchestra.run.smithi045.stdout:========================================================================================================== 2024-05-10T03:28:16.023 INFO:teuthology.orchestra.run.smithi045.stdout:Installing group/module packages: 2024-05-10T03:28:16.023 INFO:teuthology.orchestra.run.smithi045.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 1.0 M 2024-05-10T03:28:16.023 INFO:teuthology.orchestra.run.smithi045.stdout: buildah x86_64 1:1.31.5-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.8 M 2024-05-10T03:28:16.023 INFO:teuthology.orchestra.run.smithi045.stdout: cockpit-podman noarch 75-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 739 k 2024-05-10T03:28:16.023 INFO:teuthology.orchestra.run.smithi045.stdout: crun x86_64 1.8.7-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 239 k 2024-05-10T03:28:16.023 INFO:teuthology.orchestra.run.smithi045.stdout: netavark x86_64 2:1.7.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-10T03:28:16.023 INFO:teuthology.orchestra.run.smithi045.stdout: python3-podman noarch 4.6.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 154 k 2024-05-10T03:28:16.023 INFO:teuthology.orchestra.run.smithi045.stdout: skopeo x86_64 2:1.13.3-3.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.1 M 2024-05-10T03:28:16.023 INFO:teuthology.orchestra.run.smithi045.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 2.5 M 2024-05-10T03:28:16.023 INFO:teuthology.orchestra.run.smithi045.stdout: udica noarch 0.2.6-20.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 49 k 2024-05-10T03:28:16.023 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-05-10T03:28:16.023 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2024-05-10T03:28:16.024 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2024-05-10T03:28:16.024 INFO:teuthology.orchestra.run.smithi045.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2024-05-10T03:28:16.024 INFO:teuthology.orchestra.run.smithi045.stdout:Installing weak dependencies: 2024-05-10T03:28:16.024 INFO:teuthology.orchestra.run.smithi045.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-10T03:28:16.024 INFO:teuthology.orchestra.run.smithi045.stdout:Installing module profiles: 2024-05-10T03:28:16.024 INFO:teuthology.orchestra.run.smithi045.stdout: container-tools/common 2024-05-10T03:28:16.024 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:28:16.024 INFO:teuthology.orchestra.run.smithi045.stdout:Enabling module streams: 2024-05-10T03:28:16.024 INFO:teuthology.orchestra.run.smithi045.stdout: container-tools rhel8 2024-05-10T03:28:16.024 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:28:16.024 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-05-10T03:28:16.024 INFO:teuthology.orchestra.run.smithi045.stdout:========================================================================================================== 2024-05-10T03:28:16.024 INFO:teuthology.orchestra.run.smithi045.stdout:Install 13 Packages 2024-05-10T03:28:16.024 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:28:16.025 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 26 M 2024-05-10T03:28:16.025 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 87 M 2024-05-10T03:28:16.025 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-05-10T03:28:16.071 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-05-10T03:28:16.092 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-05-10T03:28:16.092 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-05-10T03:28:16.170 INFO:teuthology.orchestra.run.smithi045.stdout:(1/13): python3-pytoml-0.1.14-5.git7dea353.el8. 172 kB/s | 25 kB 00:00 2024-05-10T03:28:16.195 INFO:teuthology.orchestra.run.smithi045.stdout:(2/13): python3-pyxdg-0.25-16.el8.noarch.rpm 556 kB/s | 94 kB 00:00 2024-05-10T03:28:16.212 INFO:teuthology.orchestra.run.smithi045.stdout:(3/13): criu-libs-3.18-4.module+el8.9.0+20326+3 212 kB/s | 39 kB 00:00 2024-05-10T03:28:16.279 INFO:teuthology.orchestra.run.smithi045.stdout:(4/13): yajl-2.1.0-12.el8.x86_64.rpm 377 kB/s | 41 kB 00:00 2024-05-10T03:28:16.319 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-05-10T03:28:16.328 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-05-10T03:28:16.454 INFO:teuthology.orchestra.run.smithi045.stdout:(5/13): cockpit-podman-75-1.module+el8.9.0+2169 4.1 MB/s | 739 kB 00:00 2024-05-10T03:28:16.497 INFO:teuthology.orchestra.run.smithi045.stdout:(6/13): aardvark-dns-1.7.0-1.module+el8.9.0+216 3.4 MB/s | 1.0 MB 00:00 2024-05-10T03:28:16.613 INFO:teuthology.orchestra.run.smithi045.stdout:(7/13): crun-1.8.7-1.module+el8.9.0+21697+6a5e9 1.5 MB/s | 239 kB 00:00 2024-05-10T03:28:16.738 INFO:teuthology.orchestra.run.smithi045.stdout:(8/13): buildah-1.31.5-1.module+el8.9.0+21697+6 17 MB/s | 8.8 MB 00:00 2024-05-10T03:28:16.764 INFO:teuthology.orchestra.run.smithi045.stdout:(9/13): python3-podman-4.6.0-2.module+el8.9.0+2 1.0 MB/s | 154 kB 00:00 2024-05-10T03:28:16.856 INFO:teuthology.orchestra.run.smithi045.stdout:(10/13): netavark-1.7.0-2.module+el8.9.0+21697+ 10 MB/s | 3.7 MB 00:00 2024-05-10T03:28:16.948 INFO:teuthology.orchestra.run.smithi045.stdout:(11/13): toolbox-0.0.99.4-5.module+el8.9.0+2169 14 MB/s | 2.5 MB 00:00 2024-05-10T03:28:17.023 INFO:teuthology.orchestra.run.smithi045.stdout:(12/13): udica-0.2.6-20.module+el8.9.0+21697+6a 296 kB/s | 49 kB 00:00 2024-05-10T03:28:17.123 INFO:teuthology.orchestra.run.smithi045.stdout:(13/13): skopeo-1.13.3-3.module+el8.9.0+21697+6 21 MB/s | 8.1 MB 00:00 2024-05-10T03:28:17.124 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-05-10T03:28:17.124 INFO:teuthology.orchestra.run.smithi045.stdout:Total 23 MB/s | 26 MB 00:01 2024-05-10T03:28:17.126 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-05-10T03:28:17.431 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-05-10T03:28:17.455 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-05-10T03:28:17.455 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-05-10T03:28:17.665 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 1/13 2024-05-10T03:28:17.712 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-05-10T03:28:17.721 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-05-10T03:28:17.811 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-10T03:28:17.866 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 2/13 2024-05-10T03:28:17.978 INFO:teuthology.orchestra.run.smithi154.stdout:========================================================================================================== 2024-05-10T03:28:17.978 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2024-05-10T03:28:17.978 INFO:teuthology.orchestra.run.smithi154.stdout:========================================================================================================== 2024-05-10T03:28:17.979 INFO:teuthology.orchestra.run.smithi154.stdout:Installing group/module packages: 2024-05-10T03:28:17.979 INFO:teuthology.orchestra.run.smithi154.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 1.0 M 2024-05-10T03:28:17.979 INFO:teuthology.orchestra.run.smithi154.stdout: buildah x86_64 1:1.31.5-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.8 M 2024-05-10T03:28:17.979 INFO:teuthology.orchestra.run.smithi154.stdout: cockpit-podman noarch 75-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 739 k 2024-05-10T03:28:17.979 INFO:teuthology.orchestra.run.smithi154.stdout: crun x86_64 1.8.7-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 239 k 2024-05-10T03:28:17.979 INFO:teuthology.orchestra.run.smithi154.stdout: netavark x86_64 2:1.7.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-10T03:28:17.979 INFO:teuthology.orchestra.run.smithi154.stdout: python3-podman noarch 4.6.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 154 k 2024-05-10T03:28:17.979 INFO:teuthology.orchestra.run.smithi154.stdout: skopeo x86_64 2:1.13.3-3.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.1 M 2024-05-10T03:28:17.979 INFO:teuthology.orchestra.run.smithi154.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 2.5 M 2024-05-10T03:28:17.979 INFO:teuthology.orchestra.run.smithi154.stdout: udica noarch 0.2.6-20.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 49 k 2024-05-10T03:28:17.979 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-05-10T03:28:17.979 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2024-05-10T03:28:17.979 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2024-05-10T03:28:17.979 INFO:teuthology.orchestra.run.smithi154.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2024-05-10T03:28:17.980 INFO:teuthology.orchestra.run.smithi154.stdout:Installing weak dependencies: 2024-05-10T03:28:17.980 INFO:teuthology.orchestra.run.smithi154.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-10T03:28:17.980 INFO:teuthology.orchestra.run.smithi154.stdout:Installing module profiles: 2024-05-10T03:28:17.980 INFO:teuthology.orchestra.run.smithi154.stdout: container-tools/common 2024-05-10T03:28:17.980 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-10T03:28:17.980 INFO:teuthology.orchestra.run.smithi154.stdout:Enabling module streams: 2024-05-10T03:28:17.980 INFO:teuthology.orchestra.run.smithi154.stdout: container-tools rhel8 2024-05-10T03:28:17.980 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-10T03:28:17.980 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-05-10T03:28:17.980 INFO:teuthology.orchestra.run.smithi154.stdout:========================================================================================================== 2024-05-10T03:28:17.980 INFO:teuthology.orchestra.run.smithi154.stdout:Install 13 Packages 2024-05-10T03:28:17.980 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-10T03:28:17.981 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 26 M 2024-05-10T03:28:17.981 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 87 M 2024-05-10T03:28:17.981 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-05-10T03:28:18.047 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : yajl-2.1.0-12.el8.x86_64 3/13 2024-05-10T03:28:18.132 INFO:teuthology.orchestra.run.smithi154.stdout:(1/13): python3-pytoml-0.1.14-5.git7dea353.el8. 165 kB/s | 25 kB 00:00 2024-05-10T03:28:18.148 INFO:teuthology.orchestra.run.smithi154.stdout:(2/13): criu-libs-3.18-4.module+el8.9.0+20326+3 235 kB/s | 39 kB 00:00 2024-05-10T03:28:18.174 INFO:teuthology.orchestra.run.smithi154.stdout:(3/13): python3-pyxdg-0.25-16.el8.noarch.rpm 487 kB/s | 94 kB 00:00 2024-05-10T03:28:18.241 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 4/13 2024-05-10T03:28:18.294 INFO:teuthology.orchestra.run.smithi154.stdout:(4/13): aardvark-dns-1.7.0-1.module+el8.9.0+216 7.0 MB/s | 1.0 MB 00:00 2024-05-10T03:28:18.325 INFO:teuthology.orchestra.run.smithi154.stdout:(5/13): yajl-2.1.0-12.el8.x86_64.rpm 212 kB/s | 41 kB 00:00 2024-05-10T03:28:18.411 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2024-05-10T03:28:18.500 INFO:teuthology.orchestra.run.smithi154.stdout:(6/13): buildah-1.31.5-1.module+el8.9.0+21697+6 27 MB/s | 8.8 MB 00:00 2024-05-10T03:28:18.517 INFO:teuthology.orchestra.run.smithi154.stdout:(7/13): crun-1.8.7-1.module+el8.9.0+21697+6a5e9 1.2 MB/s | 239 kB 00:00 2024-05-10T03:28:18.580 INFO:teuthology.orchestra.run.smithi154.stdout:(8/13): cockpit-podman-75-1.module+el8.9.0+2169 2.5 MB/s | 739 kB 00:00 2024-05-10T03:28:18.626 INFO:teuthology.orchestra.run.smithi154.stdout:(9/13): python3-podman-4.6.0-2.module+el8.9.0+2 1.4 MB/s | 154 kB 00:00 2024-05-10T03:28:18.665 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2024-05-10T03:28:18.668 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-05-10T03:28:18.709 INFO:teuthology.orchestra.run.smithi154.stdout:(10/13): netavark-1.7.0-2.module+el8.9.0+21697+ 18 MB/s | 3.7 MB 00:00 2024-05-10T03:28:18.785 INFO:teuthology.orchestra.run.smithi154.stdout:(11/13): toolbox-0.0.99.4-5.module+el8.9.0+2169 16 MB/s | 2.5 MB 00:00 2024-05-10T03:28:18.868 INFO:teuthology.orchestra.run.smithi154.stdout:(12/13): udica-0.2.6-20.module+el8.9.0+21697+6a 312 kB/s | 49 kB 00:00 2024-05-10T03:28:18.897 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 7/13 2024-05-10T03:28:18.977 INFO:teuthology.orchestra.run.smithi154.stdout:(13/13): skopeo-1.13.3-3.module+el8.9.0+21697+6 21 MB/s | 8.1 MB 00:00 2024-05-10T03:28:18.977 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-05-10T03:28:18.977 INFO:teuthology.orchestra.run.smithi154.stdout:Total 26 MB/s | 26 MB 00:00 2024-05-10T03:28:19.209 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 1/13 2024-05-10T03:28:19.259 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-05-10T03:28:19.281 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-05-10T03:28:19.281 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-05-10T03:28:19.381 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 2/13 2024-05-10T03:28:19.510 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-05-10T03:28:19.519 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-05-10T03:28:19.548 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : yajl-2.1.0-12.el8.x86_64 3/13 2024-05-10T03:28:19.695 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 4/13 2024-05-10T03:28:19.804 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-05-10T03:28:19.896 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2024-05-10T03:28:20.071 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-05-10T03:28:20.080 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2024-05-10T03:28:20.308 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 7/13 2024-05-10T03:28:20.321 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-05-10T03:28:20.440 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 10/13 2024-05-10T03:28:20.863 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 1/13 2024-05-10T03:28:21.048 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 2/13 2024-05-10T03:28:21.244 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : yajl-2.1.0-12.el8.x86_64 3/13 2024-05-10T03:28:21.291 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-05-10T03:28:21.369 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 11/13 2024-05-10T03:28:21.471 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 4/13 2024-05-10T03:28:21.522 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-05-10T03:28:21.618 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 12/13 2024-05-10T03:28:21.692 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2024-05-10T03:28:21.792 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-05-10T03:28:21.904 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2024-05-10T03:28:21.913 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 10/13 2024-05-10T03:28:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 7/13 2024-05-10T03:28:22.226 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-05-10T03:28:22.226 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2024-05-10T03:28:22.226 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-05-10T03:28:22.226 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 3/13 2024-05-10T03:28:22.226 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 4/13 2024-05-10T03:28:22.226 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 5/13 2024-05-10T03:28:22.227 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 6/13 2024-05-10T03:28:22.227 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 7/13 2024-05-10T03:28:22.227 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-05-10T03:28:22.227 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-05-10T03:28:22.227 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 10/13 2024-05-10T03:28:22.227 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 11/13 2024-05-10T03:28:22.228 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 12/13 2024-05-10T03:28:22.875 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 11/13 2024-05-10T03:28:23.048 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-05-10T03:28:23.055 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 12/13 2024-05-10T03:28:23.260 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-05-10T03:28:23.328 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-05-10T03:28:23.720 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 10/13 2024-05-10T03:28:23.739 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-05-10T03:28:23.739 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2024-05-10T03:28:23.739 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-05-10T03:28:23.739 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 3/13 2024-05-10T03:28:23.739 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 4/13 2024-05-10T03:28:23.739 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 5/13 2024-05-10T03:28:23.739 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 6/13 2024-05-10T03:28:23.739 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 7/13 2024-05-10T03:28:23.739 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-05-10T03:28:23.739 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-05-10T03:28:23.739 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 10/13 2024-05-10T03:28:23.739 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 11/13 2024-05-10T03:28:23.740 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 12/13 2024-05-10T03:28:24.636 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 11/13 2024-05-10T03:28:24.848 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 12/13 2024-05-10T03:28:25.064 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-05-10T03:28:25.475 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-05-10T03:28:25.475 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2024-05-10T03:28:25.475 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-05-10T03:28:25.475 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 3/13 2024-05-10T03:28:25.476 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 4/13 2024-05-10T03:28:25.476 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 5/13 2024-05-10T03:28:25.476 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 6/13 2024-05-10T03:28:25.476 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 7/13 2024-05-10T03:28:25.476 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-05-10T03:28:25.476 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-05-10T03:28:25.476 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 10/13 2024-05-10T03:28:25.476 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 11/13 2024-05-10T03:28:25.476 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 12/13 2024-05-10T03:28:34.894 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 13/13 2024-05-10T03:28:34.894 INFO:teuthology.orchestra.run.smithi106.stdout:Installed products updated. 2024-05-10T03:28:35.468 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T03:28:35.468 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2024-05-10T03:28:35.468 INFO:teuthology.orchestra.run.smithi106.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-10T03:28:35.468 INFO:teuthology.orchestra.run.smithi106.stdout: buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-10T03:28:35.468 INFO:teuthology.orchestra.run.smithi106.stdout: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-10T03:28:35.468 INFO:teuthology.orchestra.run.smithi106.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2024-05-10T03:28:35.468 INFO:teuthology.orchestra.run.smithi106.stdout: crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-10T03:28:35.468 INFO:teuthology.orchestra.run.smithi106.stdout: netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-10T03:28:35.468 INFO:teuthology.orchestra.run.smithi106.stdout: python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-10T03:28:35.468 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-05-10T03:28:35.468 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-05-10T03:28:35.469 INFO:teuthology.orchestra.run.smithi106.stdout: skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-10T03:28:35.469 INFO:teuthology.orchestra.run.smithi106.stdout: toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-10T03:28:35.469 INFO:teuthology.orchestra.run.smithi106.stdout: udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-10T03:28:35.469 INFO:teuthology.orchestra.run.smithi106.stdout: yajl-2.1.0-12.el8.x86_64 2024-05-10T03:28:35.469 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T03:28:35.469 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-10T03:28:35.672 DEBUG:teuthology.parallel:result is None 2024-05-10T03:28:36.780 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 13/13 2024-05-10T03:28:36.780 INFO:teuthology.orchestra.run.smithi045.stdout:Installed products updated. 2024-05-10T03:28:37.417 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:28:37.417 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-05-10T03:28:37.417 INFO:teuthology.orchestra.run.smithi045.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-10T03:28:37.417 INFO:teuthology.orchestra.run.smithi045.stdout: buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-10T03:28:37.417 INFO:teuthology.orchestra.run.smithi045.stdout: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-10T03:28:37.417 INFO:teuthology.orchestra.run.smithi045.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2024-05-10T03:28:37.418 INFO:teuthology.orchestra.run.smithi045.stdout: crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-10T03:28:37.418 INFO:teuthology.orchestra.run.smithi045.stdout: netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-10T03:28:37.418 INFO:teuthology.orchestra.run.smithi045.stdout: python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-10T03:28:37.418 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-05-10T03:28:37.418 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-05-10T03:28:37.418 INFO:teuthology.orchestra.run.smithi045.stdout: skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-10T03:28:37.418 INFO:teuthology.orchestra.run.smithi045.stdout: toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-10T03:28:37.418 INFO:teuthology.orchestra.run.smithi045.stdout: udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-10T03:28:37.418 INFO:teuthology.orchestra.run.smithi045.stdout: yajl-2.1.0-12.el8.x86_64 2024-05-10T03:28:37.418 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:28:37.418 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-10T03:28:37.619 DEBUG:teuthology.parallel:result is None 2024-05-10T03:28:39.481 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 13/13 2024-05-10T03:28:39.482 INFO:teuthology.orchestra.run.smithi154.stdout:Installed products updated. 2024-05-10T03:28:40.080 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-10T03:28:40.080 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-05-10T03:28:40.080 INFO:teuthology.orchestra.run.smithi154.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-10T03:28:40.080 INFO:teuthology.orchestra.run.smithi154.stdout: buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-10T03:28:40.080 INFO:teuthology.orchestra.run.smithi154.stdout: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-10T03:28:40.080 INFO:teuthology.orchestra.run.smithi154.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2024-05-10T03:28:40.080 INFO:teuthology.orchestra.run.smithi154.stdout: crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-10T03:28:40.081 INFO:teuthology.orchestra.run.smithi154.stdout: netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-10T03:28:40.081 INFO:teuthology.orchestra.run.smithi154.stdout: python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-10T03:28:40.081 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-05-10T03:28:40.081 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-05-10T03:28:40.081 INFO:teuthology.orchestra.run.smithi154.stdout: skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-10T03:28:40.081 INFO:teuthology.orchestra.run.smithi154.stdout: toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-10T03:28:40.081 INFO:teuthology.orchestra.run.smithi154.stdout: udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-10T03:28:40.081 INFO:teuthology.orchestra.run.smithi154.stdout: yajl-2.1.0-12.el8.x86_64 2024-05-10T03:28:40.081 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-10T03:28:40.081 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-10T03:28:40.271 DEBUG:teuthology.parallel:result is None 2024-05-10T03:28:40.272 INFO:teuthology.run_tasks:Running task install... 2024-05-10T03:28:40.281 DEBUG:teuthology.task.install:project ceph 2024-05-10T03:28:40.281 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '50174015a7e79f951b988949abe236791f52d4da'}} 2024-05-10T03:28:40.281 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '50174015a7e79f951b988949abe236791f52d4da'} 2024-05-10T03:28:40.282 INFO:teuthology.task.install:Using flavor: default 2024-05-10T03:28:40.289 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-10T03:28:40.289 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-05-10T03:28:40.289 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '50174015a7e79f951b988949abe236791f52d4da', 'tag': None, 'wait_for_package': False} 2024-05-10T03:28:40.290 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=50174015a7e79f951b988949abe236791f52d4da 2024-05-10T03:28:40.292 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '50174015a7e79f951b988949abe236791f52d4da', 'tag': None, 'wait_for_package': False} 2024-05-10T03:28:40.292 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=50174015a7e79f951b988949abe236791f52d4da 2024-05-10T03:28:40.293 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '50174015a7e79f951b988949abe236791f52d4da', 'tag': None, 'wait_for_package': False} 2024-05-10T03:28:40.293 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=50174015a7e79f951b988949abe236791f52d4da 2024-05-10T03:28:40.444 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/ 2024-05-10T03:28:40.444 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1330.g50174015 2024-05-10T03:28:40.456 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/ 2024-05-10T03:28:40.456 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1330.g50174015 2024-05-10T03:28:40.530 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/ 2024-05-10T03:28:40.531 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1330.g50174015 2024-05-10T03:28:40.552 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-10T03:28:40.552 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-10T03:28:40.552 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-10T03:28:40.565 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-10T03:28:40.565 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-10T03:28:40.566 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-10T03:28:40.588 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-10T03:28:40.588 DEBUG:teuthology.orchestra.run.smithi045:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/50174015a7e79f951b988949abe236791f52d4da/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-10T03:28:40.594 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-10T03:28:40.594 DEBUG:teuthology.orchestra.run.smithi154:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/50174015a7e79f951b988949abe236791f52d4da/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-10T03:28:40.639 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-10T03:28:40.639 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T03:28:40.639 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-10T03:28:40.662 DEBUG:teuthology.orchestra.run.smithi154:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-10T03:28:40.664 DEBUG:teuthology.orchestra.run.smithi045:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-10T03:28:40.673 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-10T03:28:40.674 DEBUG:teuthology.orchestra.run.smithi106:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/50174015a7e79f951b988949abe236791f52d4da/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-10T03:28:40.740 DEBUG:teuthology.orchestra.run.smithi154:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-10T03:28:40.748 DEBUG:teuthology.orchestra.run.smithi106:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-10T03:28:40.753 DEBUG:teuthology.orchestra.run.smithi045:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-10T03:28:40.785 INFO:teuthology.orchestra.run.smithi045.stdout:check_obsoletes = 1 2024-05-10T03:28:40.787 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum clean all 2024-05-10T03:28:40.806 INFO:teuthology.orchestra.run.smithi154.stdout:check_obsoletes = 1 2024-05-10T03:28:40.807 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum clean all 2024-05-10T03:28:40.833 DEBUG:teuthology.orchestra.run.smithi106:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-10T03:28:40.862 INFO:teuthology.orchestra.run.smithi106.stdout:check_obsoletes = 1 2024-05-10T03:28:40.863 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum clean all 2024-05-10T03:28:41.186 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2024-05-10T03:28:41.224 INFO:teuthology.orchestra.run.smithi045.stdout:Updating Subscription Management repositories. 2024-05-10T03:28:41.242 INFO:teuthology.orchestra.run.smithi106.stdout:Updating Subscription Management repositories. 2024-05-10T03:28:42.687 INFO:teuthology.orchestra.run.smithi154.stdout:61 files removed 2024-05-10T03:28:42.730 INFO:teuthology.orchestra.run.smithi045.stdout:61 files removed 2024-05-10T03:28:42.745 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-10T03:28:42.791 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-10T03:28:42.801 INFO:teuthology.orchestra.run.smithi106.stdout:61 files removed 2024-05-10T03:28:42.851 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-10T03:28:43.086 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2024-05-10T03:28:43.178 INFO:teuthology.orchestra.run.smithi045.stdout:Updating Subscription Management repositories. 2024-05-10T03:28:43.190 INFO:teuthology.orchestra.run.smithi106.stdout:Updating Subscription Management repositories. 2024-05-10T03:28:44.932 INFO:teuthology.orchestra.run.smithi154.stdout:ceph packages for x86_64 196 kB/s | 80 kB 00:00 2024-05-10T03:28:45.013 INFO:teuthology.orchestra.run.smithi045.stdout:ceph packages for x86_64 202 kB/s | 80 kB 00:00 2024-05-10T03:28:45.091 INFO:teuthology.orchestra.run.smithi106.stdout:ceph packages for x86_64 217 kB/s | 80 kB 00:00 2024-05-10T03:28:45.232 INFO:teuthology.orchestra.run.smithi154.stdout:ceph noarch packages 43 kB/s | 11 kB 00:00 2024-05-10T03:28:45.363 INFO:teuthology.orchestra.run.smithi045.stdout:ceph noarch packages 37 kB/s | 11 kB 00:00 2024-05-10T03:28:45.520 INFO:teuthology.orchestra.run.smithi106.stdout:ceph noarch packages 29 kB/s | 11 kB 00:00 2024-05-10T03:28:45.575 INFO:teuthology.orchestra.run.smithi154.stdout:ceph source packages 4.7 kB/s | 1.5 kB 00:00 2024-05-10T03:28:45.792 INFO:teuthology.orchestra.run.smithi154.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2024-05-10T03:28:45.837 INFO:teuthology.orchestra.run.smithi045.stdout:ceph source packages 3.4 kB/s | 1.5 kB 00:00 2024-05-10T03:28:45.877 INFO:teuthology.orchestra.run.smithi106.stdout:ceph source packages 4.5 kB/s | 1.5 kB 00:00 2024-05-10T03:28:46.006 INFO:teuthology.orchestra.run.smithi045.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2024-05-10T03:28:46.102 INFO:teuthology.orchestra.run.smithi106.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2024-05-10T03:28:46.935 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 12 MB/s | 14 MB 00:01 2024-05-10T03:28:47.178 INFO:teuthology.orchestra.run.smithi106.stdout:Extra Packages for Enterprise Linux 13 MB/s | 14 MB 00:01 2024-05-10T03:28:47.323 INFO:teuthology.orchestra.run.smithi045.stdout:Extra Packages for Enterprise Linux 11 MB/s | 14 MB 00:01 2024-05-10T03:28:50.293 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 281 kB/s | 24 kB 00:00 2024-05-10T03:28:50.486 INFO:teuthology.orchestra.run.smithi106.stdout:lab-extras 403 kB/s | 24 kB 00:00 2024-05-10T03:28:51.107 INFO:teuthology.orchestra.run.smithi045.stdout:lab-extras 318 kB/s | 24 kB 00:00 2024-05-10T03:28:51.880 INFO:teuthology.orchestra.run.smithi154.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 40 MB/s | 61 MB 00:01 2024-05-10T03:28:51.914 INFO:teuthology.orchestra.run.smithi106.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 6.5 MB/s | 8.8 MB 00:01 2024-05-10T03:28:53.085 INFO:teuthology.orchestra.run.smithi045.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 36 MB/s | 67 MB 00:01 2024-05-10T03:28:54.758 INFO:teuthology.orchestra.run.smithi106.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 51 MB/s | 67 MB 00:01 2024-05-10T03:29:02.688 INFO:teuthology.orchestra.run.smithi154.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 16 MB/s | 8.8 MB 00:00 2024-05-10T03:29:05.160 INFO:teuthology.orchestra.run.smithi045.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 42 MB/s | 61 MB 00:01 2024-05-10T03:29:05.631 INFO:teuthology.orchestra.run.smithi154.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 51 MB/s | 67 MB 00:01 2024-05-10T03:29:05.716 INFO:teuthology.orchestra.run.smithi106.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 45 MB/s | 61 MB 00:01 2024-05-10T03:29:17.161 INFO:teuthology.orchestra.run.smithi045.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 13 MB/s | 8.8 MB 00:00 2024-05-10T03:29:20.687 INFO:teuthology.orchestra.run.smithi154.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-10T03:29:20.689 INFO:teuthology.orchestra.run.smithi154.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-10T03:29:20.708 INFO:teuthology.orchestra.run.smithi154.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-05-10T03:29:20.709 INFO:teuthology.orchestra.run.smithi154.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-05-10T03:29:20.711 INFO:teuthology.orchestra.run.smithi154.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-05-10T03:29:20.712 INFO:teuthology.orchestra.run.smithi154.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-10T03:29:20.715 INFO:teuthology.orchestra.run.smithi154.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-10T03:29:20.720 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-10T03:29:20.721 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-10T03:29:20.940 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-05-10T03:29:20.954 INFO:teuthology.orchestra.run.smithi154.stdout:=================================================================================================================================== 2024-05-10T03:29:20.954 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2024-05-10T03:29:20.954 INFO:teuthology.orchestra.run.smithi154.stdout:=================================================================================================================================== 2024-05-10T03:29:20.954 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-05-10T03:29:20.954 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-05-10T03:29:20.954 INFO:teuthology.orchestra.run.smithi154.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-05-10T03:29:20.954 INFO:teuthology.orchestra.run.smithi154.stdout: ceph x86_64 2:18.2.2-1330.g50174015.el8 ceph 6.4 k 2024-05-10T03:29:20.955 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base x86_64 2:18.2.2-1330.g50174015.el8 ceph 5.7 M 2024-05-10T03:29:20.955 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse x86_64 2:18.2.2-1330.g50174015.el8 ceph 829 k 2024-05-10T03:29:20.955 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1330.g50174015.el8 ceph 157 k 2024-05-10T03:29:20.955 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr x86_64 2:18.2.2-1330.g50174015.el8 ceph 1.5 M 2024-05-10T03:29:20.955 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 138 k 2024-05-10T03:29:20.955 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 3.5 M 2024-05-10T03:29:20.955 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 7.4 M 2024-05-10T03:29:20.955 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 49 k 2024-05-10T03:29:20.955 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw x86_64 2:18.2.2-1330.g50174015.el8 ceph 14 M 2024-05-10T03:29:20.955 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test x86_64 2:18.2.2-1330.g50174015.el8 ceph 49 M 2024-05-10T03:29:20.956 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 263 k 2024-05-10T03:29:20.956 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 173 k 2024-05-10T03:29:20.956 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror x86_64 2:18.2.2-1330.g50174015.el8 ceph 246 k 2024-05-10T03:29:20.956 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 18 k 2024-05-10T03:29:20.956 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-05-10T03:29:20.956 INFO:teuthology.orchestra.run.smithi154.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-05-10T03:29:20.956 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-05-10T03:29:20.956 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel x86_64 2:18.2.2-1330.g50174015.el8 ceph 31 k 2024-05-10T03:29:20.956 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 756 k 2024-05-10T03:29:20.956 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel x86_64 2:18.2.2-1330.g50174015.el8 ceph 139 k 2024-05-10T03:29:20.956 INFO:teuthology.orchestra.run.smithi154.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-05-10T03:29:20.956 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-05-10T03:29:20.957 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-05-10T03:29:20.957 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-05-10T03:29:20.957 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-05-10T03:29:20.957 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-05-10T03:29:20.957 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs x86_64 2:18.2.2-1330.g50174015.el8 ceph 197 k 2024-05-10T03:29:20.957 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados x86_64 2:18.2.2-1330.g50174015.el8 ceph 371 k 2024-05-10T03:29:20.957 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd x86_64 2:18.2.2-1330.g50174015.el8 ceph 364 k 2024-05-10T03:29:20.957 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw x86_64 2:18.2.2-1330.g50174015.el8 ceph 107 k 2024-05-10T03:29:20.957 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse x86_64 2:18.2.2-1330.g50174015.el8 ceph 91 k 2024-05-10T03:29:20.957 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.3 M 2024-05-10T03:29:20.957 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd x86_64 2:18.2.2-1330.g50174015.el8 ceph 179 k 2024-05-10T03:29:20.957 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-05-10T03:29:20.957 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrading: 2024-05-10T03:29:20.957 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-05-10T03:29:20.958 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-05-10T03:29:20.958 INFO:teuthology.orchestra.run.smithi154.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-05-10T03:29:20.958 INFO:teuthology.orchestra.run.smithi154.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-05-10T03:29:20.958 INFO:teuthology.orchestra.run.smithi154.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-05-10T03:29:20.958 INFO:teuthology.orchestra.run.smithi154.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-05-10T03:29:20.958 INFO:teuthology.orchestra.run.smithi154.stdout: librados2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.5 M 2024-05-10T03:29:20.958 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1 x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.5 M 2024-05-10T03:29:20.958 INFO:teuthology.orchestra.run.smithi154.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-05-10T03:29:20.958 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-05-10T03:29:20.958 INFO:teuthology.orchestra.run.smithi154.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-05-10T03:29:20.958 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-05-10T03:29:20.959 INFO:teuthology.orchestra.run.smithi154.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-05-10T03:29:20.959 INFO:teuthology.orchestra.run.smithi154.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-05-10T03:29:20.959 INFO:teuthology.orchestra.run.smithi154.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-05-10T03:29:20.959 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-05-10T03:29:20.959 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-05-10T03:29:20.959 INFO:teuthology.orchestra.run.smithi154.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-05-10T03:29:20.959 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common x86_64 2:18.2.2-1330.g50174015.el8 ceph 23 M 2024-05-10T03:29:20.959 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 24 k 2024-05-10T03:29:20.959 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds x86_64 2:18.2.2-1330.g50174015.el8 ceph 2.2 M 2024-05-10T03:29:20.959 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 246 k 2024-05-10T03:29:20.959 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon x86_64 2:18.2.2-1330.g50174015.el8 ceph 5.1 M 2024-05-10T03:29:20.959 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd x86_64 2:18.2.2-1330.g50174015.el8 ceph 19 M 2024-05-10T03:29:20.959 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 16 k 2024-05-10T03:29:20.960 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux x86_64 2:18.2.2-1330.g50174015.el8 ceph 24 k 2024-05-10T03:29:20.960 INFO:teuthology.orchestra.run.smithi154.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-05-10T03:29:20.960 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-10T03:29:20.960 INFO:teuthology.orchestra.run.smithi154.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-05-10T03:29:20.960 INFO:teuthology.orchestra.run.smithi154.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-05-10T03:29:20.960 INFO:teuthology.orchestra.run.smithi154.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-05-10T03:29:20.960 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite x86_64 2:18.2.2-1330.g50174015.el8 ceph 139 k 2024-05-10T03:29:20.960 INFO:teuthology.orchestra.run.smithi154.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-05-10T03:29:20.960 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-05-10T03:29:20.960 INFO:teuthology.orchestra.run.smithi154.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-10T03:29:20.961 INFO:teuthology.orchestra.run.smithi154.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-05-10T03:29:20.961 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-05-10T03:29:20.961 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-05-10T03:29:20.961 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 x86_64 2:18.2.2-1330.g50174015.el8 ceph 461 k 2024-05-10T03:29:20.961 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-05-10T03:29:20.961 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 7.2 M 2024-05-10T03:29:20.961 INFO:teuthology.orchestra.run.smithi154.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-05-10T03:29:20.961 INFO:teuthology.orchestra.run.smithi154.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-05-10T03:29:20.962 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-10T03:29:20.962 INFO:teuthology.orchestra.run.smithi154.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-05-10T03:29:20.962 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-05-10T03:29:20.962 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-05-10T03:29:20.963 INFO:teuthology.orchestra.run.smithi154.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-05-10T03:29:20.963 INFO:teuthology.orchestra.run.smithi154.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-05-10T03:29:20.963 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-05-10T03:29:20.963 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-05-10T03:29:20.963 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-05-10T03:29:20.963 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-05-10T03:29:20.963 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-10T03:29:20.963 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-05-10T03:29:20.963 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-10T03:29:20.963 INFO:teuthology.orchestra.run.smithi154.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-10T03:29:20.963 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-10T03:29:20.963 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse x86_64 2:18.2.2-1330.g50174015.el8 ceph 45 k 2024-05-10T03:29:20.963 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common x86_64 2:18.2.2-1330.g50174015.el8 ceph 129 k 2024-05-10T03:29:20.964 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-10T03:29:20.964 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-05-10T03:29:20.964 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-10T03:29:20.964 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-10T03:29:20.964 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-05-10T03:29:20.964 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-10T03:29:20.964 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-10T03:29:20.964 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-10T03:29:20.964 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-05-10T03:29:20.964 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-05-10T03:29:20.964 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-05-10T03:29:20.964 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-10T03:29:20.964 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-10T03:29:20.965 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-10T03:29:20.965 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-05-10T03:29:20.965 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-10T03:29:20.965 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-10T03:29:20.965 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-10T03:29:20.965 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-10T03:29:20.965 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-05-10T03:29:20.965 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-05-10T03:29:20.965 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-05-10T03:29:20.965 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-10T03:29:20.965 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-10T03:29:20.965 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-05-10T03:29:20.965 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-05-10T03:29:20.965 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-05-10T03:29:20.966 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-05-10T03:29:20.966 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-05-10T03:29:20.966 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-05-10T03:29:20.966 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-10T03:29:20.966 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-10T03:29:20.966 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-10T03:29:20.966 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-10T03:29:20.966 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-05-10T03:29:20.966 INFO:teuthology.orchestra.run.smithi154.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-10T03:29:20.966 INFO:teuthology.orchestra.run.smithi154.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-10T03:29:20.966 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-10T03:29:20.966 INFO:teuthology.orchestra.run.smithi154.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-10T03:29:20.966 INFO:teuthology.orchestra.run.smithi154.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-10T03:29:20.966 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-10T03:29:20.966 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-10T03:29:20.967 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-10T03:29:20.967 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-05-10T03:29:20.967 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-10T03:29:20.967 INFO:teuthology.orchestra.run.smithi154.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-05-10T03:29:20.967 INFO:teuthology.orchestra.run.smithi154.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-10T03:29:20.967 INFO:teuthology.orchestra.run.smithi154.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-05-10T03:29:20.967 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-05-10T03:29:20.967 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-05-10T03:29:20.967 INFO:teuthology.orchestra.run.smithi154.stdout:Enabling module streams: 2024-05-10T03:29:20.967 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql 10 2024-05-10T03:29:20.967 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-10T03:29:20.967 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-05-10T03:29:20.967 INFO:teuthology.orchestra.run.smithi154.stdout:=================================================================================================================================== 2024-05-10T03:29:20.967 INFO:teuthology.orchestra.run.smithi154.stdout:Install 130 Packages 2024-05-10T03:29:20.967 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrade 16 Packages 2024-05-10T03:29:20.968 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-10T03:29:20.968 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 221 M 2024-05-10T03:29:20.968 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-05-10T03:29:21.102 INFO:teuthology.orchestra.run.smithi106.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-10T03:29:21.103 INFO:teuthology.orchestra.run.smithi106.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-10T03:29:21.120 INFO:teuthology.orchestra.run.smithi106.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-05-10T03:29:21.122 INFO:teuthology.orchestra.run.smithi106.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-05-10T03:29:21.123 INFO:teuthology.orchestra.run.smithi106.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-05-10T03:29:21.124 INFO:teuthology.orchestra.run.smithi106.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-10T03:29:21.127 INFO:teuthology.orchestra.run.smithi106.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-10T03:29:21.131 INFO:teuthology.orchestra.run.smithi106.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-10T03:29:21.132 INFO:teuthology.orchestra.run.smithi106.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-10T03:29:21.357 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-05-10T03:29:21.371 INFO:teuthology.orchestra.run.smithi106.stdout:=================================================================================================================================== 2024-05-10T03:29:21.371 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2024-05-10T03:29:21.372 INFO:teuthology.orchestra.run.smithi106.stdout:=================================================================================================================================== 2024-05-10T03:29:21.372 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2024-05-10T03:29:21.372 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-05-10T03:29:21.372 INFO:teuthology.orchestra.run.smithi106.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-05-10T03:29:21.372 INFO:teuthology.orchestra.run.smithi106.stdout: ceph x86_64 2:18.2.2-1330.g50174015.el8 ceph 6.4 k 2024-05-10T03:29:21.372 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base x86_64 2:18.2.2-1330.g50174015.el8 ceph 5.7 M 2024-05-10T03:29:21.372 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-fuse x86_64 2:18.2.2-1330.g50174015.el8 ceph 829 k 2024-05-10T03:29:21.372 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1330.g50174015.el8 ceph 157 k 2024-05-10T03:29:21.372 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr x86_64 2:18.2.2-1330.g50174015.el8 ceph 1.5 M 2024-05-10T03:29:21.372 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 138 k 2024-05-10T03:29:21.372 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 3.5 M 2024-05-10T03:29:21.372 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 7.4 M 2024-05-10T03:29:21.372 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-rook noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 49 k 2024-05-10T03:29:21.373 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-radosgw x86_64 2:18.2.2-1330.g50174015.el8 ceph 14 M 2024-05-10T03:29:21.373 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-test x86_64 2:18.2.2-1330.g50174015.el8 ceph 49 M 2024-05-10T03:29:21.373 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-volume noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 263 k 2024-05-10T03:29:21.373 INFO:teuthology.orchestra.run.smithi106.stdout: cephadm noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 173 k 2024-05-10T03:29:21.373 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-mirror x86_64 2:18.2.2-1330.g50174015.el8 ceph 246 k 2024-05-10T03:29:21.373 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-top noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 18 k 2024-05-10T03:29:21.373 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-05-10T03:29:21.373 INFO:teuthology.orchestra.run.smithi106.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-05-10T03:29:21.373 INFO:teuthology.orchestra.run.smithi106.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-05-10T03:29:21.373 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs-devel x86_64 2:18.2.2-1330.g50174015.el8 ceph 31 k 2024-05-10T03:29:21.373 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 756 k 2024-05-10T03:29:21.374 INFO:teuthology.orchestra.run.smithi106.stdout: librados-devel x86_64 2:18.2.2-1330.g50174015.el8 ceph 139 k 2024-05-10T03:29:21.374 INFO:teuthology.orchestra.run.smithi106.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-05-10T03:29:21.374 INFO:teuthology.orchestra.run.smithi106.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-05-10T03:29:21.374 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-05-10T03:29:21.374 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-05-10T03:29:21.374 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-05-10T03:29:21.374 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-05-10T03:29:21.374 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cephfs x86_64 2:18.2.2-1330.g50174015.el8 ceph 197 k 2024-05-10T03:29:21.374 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados x86_64 2:18.2.2-1330.g50174015.el8 ceph 371 k 2024-05-10T03:29:21.374 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rbd x86_64 2:18.2.2-1330.g50174015.el8 ceph 364 k 2024-05-10T03:29:21.374 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rgw x86_64 2:18.2.2-1330.g50174015.el8 ceph 107 k 2024-05-10T03:29:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-fuse x86_64 2:18.2.2-1330.g50174015.el8 ceph 91 k 2024-05-10T03:29:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-mirror x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.3 M 2024-05-10T03:29:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-nbd x86_64 2:18.2.2-1330.g50174015.el8 ceph 179 k 2024-05-10T03:29:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-05-10T03:29:21.375 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrading: 2024-05-10T03:29:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-05-10T03:29:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-05-10T03:29:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-05-10T03:29:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-05-10T03:29:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-05-10T03:29:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-05-10T03:29:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: librados2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.5 M 2024-05-10T03:29:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: librbd1 x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.5 M 2024-05-10T03:29:21.376 INFO:teuthology.orchestra.run.smithi106.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-05-10T03:29:21.376 INFO:teuthology.orchestra.run.smithi106.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-05-10T03:29:21.376 INFO:teuthology.orchestra.run.smithi106.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-05-10T03:29:21.376 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-05-10T03:29:21.376 INFO:teuthology.orchestra.run.smithi106.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-05-10T03:29:21.376 INFO:teuthology.orchestra.run.smithi106.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-05-10T03:29:21.376 INFO:teuthology.orchestra.run.smithi106.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-05-10T03:29:21.376 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-05-10T03:29:21.376 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2024-05-10T03:29:21.376 INFO:teuthology.orchestra.run.smithi106.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-05-10T03:29:21.376 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-common x86_64 2:18.2.2-1330.g50174015.el8 ceph 23 M 2024-05-10T03:29:21.376 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 24 k 2024-05-10T03:29:21.376 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mds x86_64 2:18.2.2-1330.g50174015.el8 ceph 2.2 M 2024-05-10T03:29:21.376 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 246 k 2024-05-10T03:29:21.377 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mon x86_64 2:18.2.2-1330.g50174015.el8 ceph 5.1 M 2024-05-10T03:29:21.377 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-osd x86_64 2:18.2.2-1330.g50174015.el8 ceph 19 M 2024-05-10T03:29:21.377 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 16 k 2024-05-10T03:29:21.377 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-selinux x86_64 2:18.2.2-1330.g50174015.el8 ceph 24 k 2024-05-10T03:29:21.377 INFO:teuthology.orchestra.run.smithi106.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-05-10T03:29:21.377 INFO:teuthology.orchestra.run.smithi106.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-10T03:29:21.377 INFO:teuthology.orchestra.run.smithi106.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-05-10T03:29:21.377 INFO:teuthology.orchestra.run.smithi106.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-05-10T03:29:21.377 INFO:teuthology.orchestra.run.smithi106.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-05-10T03:29:21.377 INFO:teuthology.orchestra.run.smithi106.stdout: libcephsqlite x86_64 2:18.2.2-1330.g50174015.el8 ceph 139 k 2024-05-10T03:29:21.377 INFO:teuthology.orchestra.run.smithi106.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-05-10T03:29:21.377 INFO:teuthology.orchestra.run.smithi106.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-05-10T03:29:21.378 INFO:teuthology.orchestra.run.smithi106.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-10T03:29:21.378 INFO:teuthology.orchestra.run.smithi106.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-05-10T03:29:21.378 INFO:teuthology.orchestra.run.smithi106.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-05-10T03:29:21.378 INFO:teuthology.orchestra.run.smithi106.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-05-10T03:29:21.378 INFO:teuthology.orchestra.run.smithi106.stdout: libradosstriper1 x86_64 2:18.2.2-1330.g50174015.el8 ceph 461 k 2024-05-10T03:29:21.378 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-05-10T03:29:21.378 INFO:teuthology.orchestra.run.smithi106.stdout: librgw2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 7.2 M 2024-05-10T03:29:21.378 INFO:teuthology.orchestra.run.smithi106.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-05-10T03:29:21.378 INFO:teuthology.orchestra.run.smithi106.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-05-10T03:29:21.378 INFO:teuthology.orchestra.run.smithi106.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-10T03:29:21.378 INFO:teuthology.orchestra.run.smithi106.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-05-10T03:29:21.378 INFO:teuthology.orchestra.run.smithi106.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-05-10T03:29:21.378 INFO:teuthology.orchestra.run.smithi106.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-05-10T03:29:21.379 INFO:teuthology.orchestra.run.smithi106.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-05-10T03:29:21.379 INFO:teuthology.orchestra.run.smithi106.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-05-10T03:29:21.379 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-05-10T03:29:21.379 INFO:teuthology.orchestra.run.smithi106.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-05-10T03:29:21.379 INFO:teuthology.orchestra.run.smithi106.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-05-10T03:29:21.379 INFO:teuthology.orchestra.run.smithi106.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-05-10T03:29:21.379 INFO:teuthology.orchestra.run.smithi106.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-10T03:29:21.379 INFO:teuthology.orchestra.run.smithi106.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-05-10T03:29:21.379 INFO:teuthology.orchestra.run.smithi106.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-10T03:29:21.379 INFO:teuthology.orchestra.run.smithi106.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-10T03:29:21.379 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-10T03:29:21.379 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse x86_64 2:18.2.2-1330.g50174015.el8 ceph 45 k 2024-05-10T03:29:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common x86_64 2:18.2.2-1330.g50174015.el8 ceph 129 k 2024-05-10T03:29:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-10T03:29:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-05-10T03:29:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-10T03:29:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-10T03:29:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-05-10T03:29:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-10T03:29:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-10T03:29:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-10T03:29:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-05-10T03:29:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-05-10T03:29:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-05-10T03:29:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-10T03:29:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-10T03:29:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-10T03:29:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-05-10T03:29:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-10T03:29:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-10T03:29:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-10T03:29:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-10T03:29:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-05-10T03:29:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-05-10T03:29:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-05-10T03:29:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-10T03:29:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-10T03:29:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-05-10T03:29:21.382 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-05-10T03:29:21.382 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-05-10T03:29:21.382 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-05-10T03:29:21.382 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-05-10T03:29:21.382 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-05-10T03:29:21.382 INFO:teuthology.orchestra.run.smithi106.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-10T03:29:21.382 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-10T03:29:21.382 INFO:teuthology.orchestra.run.smithi106.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-10T03:29:21.382 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-10T03:29:21.382 INFO:teuthology.orchestra.run.smithi106.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-05-10T03:29:21.382 INFO:teuthology.orchestra.run.smithi106.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-10T03:29:21.382 INFO:teuthology.orchestra.run.smithi106.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-10T03:29:21.383 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-10T03:29:21.383 INFO:teuthology.orchestra.run.smithi106.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-10T03:29:21.383 INFO:teuthology.orchestra.run.smithi106.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-10T03:29:21.383 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-10T03:29:21.383 INFO:teuthology.orchestra.run.smithi106.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-10T03:29:21.383 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-10T03:29:21.383 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-05-10T03:29:21.383 INFO:teuthology.orchestra.run.smithi106.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-10T03:29:21.383 INFO:teuthology.orchestra.run.smithi106.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-05-10T03:29:21.383 INFO:teuthology.orchestra.run.smithi106.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-10T03:29:21.383 INFO:teuthology.orchestra.run.smithi106.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-05-10T03:29:21.383 INFO:teuthology.orchestra.run.smithi106.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-05-10T03:29:21.383 INFO:teuthology.orchestra.run.smithi106.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-05-10T03:29:21.384 INFO:teuthology.orchestra.run.smithi106.stdout:Enabling module streams: 2024-05-10T03:29:21.384 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql 10 2024-05-10T03:29:21.384 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T03:29:21.384 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-05-10T03:29:21.384 INFO:teuthology.orchestra.run.smithi106.stdout:=================================================================================================================================== 2024-05-10T03:29:21.384 INFO:teuthology.orchestra.run.smithi106.stdout:Install 130 Packages 2024-05-10T03:29:21.384 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrade 16 Packages 2024-05-10T03:29:21.384 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T03:29:21.385 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 221 M 2024-05-10T03:29:21.385 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-05-10T03:29:21.463 INFO:teuthology.orchestra.run.smithi154.stdout:(1/146): ceph-18.2.2-1330.g50174015.el8.x86_64. 54 kB/s | 6.4 kB 00:00 2024-05-10T03:29:21.524 INFO:teuthology.orchestra.run.smithi106.stdout:(1/146): ceph-18.2.2-1330.g50174015.el8.x86_64. 55 kB/s | 6.4 kB 00:00 2024-05-10T03:29:21.680 INFO:teuthology.orchestra.run.smithi154.stdout:(2/146): ceph-fuse-18.2.2-1330.g50174015.el8.x8 3.7 MB/s | 829 kB 00:00 2024-05-10T03:29:21.747 INFO:teuthology.orchestra.run.smithi154.stdout:(3/146): ceph-immutable-object-cache-18.2.2-133 2.3 MB/s | 157 kB 00:00 2024-05-10T03:29:21.906 INFO:teuthology.orchestra.run.smithi154.stdout:(4/146): ceph-base-18.2.2-1330.g50174015.el8.x8 10 MB/s | 5.7 MB 00:00 2024-05-10T03:29:21.916 INFO:teuthology.orchestra.run.smithi106.stdout:(2/146): ceph-fuse-18.2.2-1330.g50174015.el8.x8 2.1 MB/s | 829 kB 00:00 2024-05-10T03:29:22.023 INFO:teuthology.orchestra.run.smithi154.stdout:(5/146): ceph-mds-18.2.2-1330.g50174015.el8.x86 7.9 MB/s | 2.2 MB 00:00 2024-05-10T03:29:22.042 INFO:teuthology.orchestra.run.smithi106.stdout:(3/146): ceph-immutable-object-cache-18.2.2-133 1.2 MB/s | 157 kB 00:00 2024-05-10T03:29:22.090 INFO:teuthology.orchestra.run.smithi154.stdout:(6/146): ceph-mgr-18.2.2-1330.g50174015.el8.x86 8.2 MB/s | 1.5 MB 00:00 2024-05-10T03:29:22.665 INFO:teuthology.orchestra.run.smithi154.stdout:(7/146): ceph-mon-18.2.2-1330.g50174015.el8.x86 8.0 MB/s | 5.1 MB 00:00 2024-05-10T03:29:22.942 INFO:teuthology.orchestra.run.smithi106.stdout:(4/146): ceph-mds-18.2.2-1330.g50174015.el8.x86 2.4 MB/s | 2.2 MB 00:00 2024-05-10T03:29:23.434 INFO:teuthology.orchestra.run.smithi106.stdout:(5/146): ceph-mgr-18.2.2-1330.g50174015.el8.x86 3.1 MB/s | 1.5 MB 00:00 2024-05-10T03:29:23.899 INFO:teuthology.orchestra.run.smithi154.stdout:(8/146): ceph-osd-18.2.2-1330.g50174015.el8.x86 10 MB/s | 19 MB 00:01 2024-05-10T03:29:23.974 INFO:teuthology.orchestra.run.smithi154.stdout:(9/146): ceph-selinux-18.2.2-1330.g50174015.el8 326 kB/s | 24 kB 00:00 2024-05-10T03:29:24.134 INFO:teuthology.orchestra.run.smithi106.stdout:(6/146): ceph-mon-18.2.2-1330.g50174015.el8.x86 7.3 MB/s | 5.1 MB 00:00 2024-05-10T03:29:24.301 INFO:teuthology.orchestra.run.smithi106.stdout:(7/146): ceph-base-18.2.2-1330.g50174015.el8.x8 2.0 MB/s | 5.7 MB 00:02 2024-05-10T03:29:24.582 INFO:teuthology.orchestra.run.smithi154.stdout:(10/146): ceph-radosgw-18.2.2-1330.g50174015.el 7.5 MB/s | 14 MB 00:01 2024-05-10T03:29:24.708 INFO:teuthology.orchestra.run.smithi154.stdout:(11/146): cephfs-mirror-18.2.2-1330.g50174015.e 1.9 MB/s | 246 kB 00:00 2024-05-10T03:29:24.783 INFO:teuthology.orchestra.run.smithi154.stdout:(12/146): libcephfs-devel-18.2.2-1330.g50174015 414 kB/s | 31 kB 00:00 2024-05-10T03:29:25.033 INFO:teuthology.orchestra.run.smithi154.stdout:(13/146): libcephfs2-18.2.2-1330.g50174015.el8. 3.0 MB/s | 756 kB 00:00 2024-05-10T03:29:25.056 INFO:teuthology.orchestra.run.smithi045.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-10T03:29:25.058 INFO:teuthology.orchestra.run.smithi045.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-10T03:29:25.079 INFO:teuthology.orchestra.run.smithi045.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-05-10T03:29:25.081 INFO:teuthology.orchestra.run.smithi045.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-05-10T03:29:25.083 INFO:teuthology.orchestra.run.smithi045.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-05-10T03:29:25.084 INFO:teuthology.orchestra.run.smithi045.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-10T03:29:25.087 INFO:teuthology.orchestra.run.smithi045.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-10T03:29:25.093 INFO:teuthology.orchestra.run.smithi045.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-10T03:29:25.094 INFO:teuthology.orchestra.run.smithi045.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-10T03:29:25.125 INFO:teuthology.orchestra.run.smithi154.stdout:(14/146): libcephsqlite-18.2.2-1330.g50174015.e 1.5 MB/s | 139 kB 00:00 2024-05-10T03:29:25.231 INFO:teuthology.orchestra.run.smithi154.stdout:(15/146): librados-devel-18.2.2-1330.g50174015. 1.3 MB/s | 139 kB 00:00 2024-05-10T03:29:25.339 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-10T03:29:25.356 INFO:teuthology.orchestra.run.smithi045.stdout:=================================================================================================================================== 2024-05-10T03:29:25.356 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2024-05-10T03:29:25.356 INFO:teuthology.orchestra.run.smithi045.stdout:=================================================================================================================================== 2024-05-10T03:29:25.356 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-05-10T03:29:25.356 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-05-10T03:29:25.356 INFO:teuthology.orchestra.run.smithi045.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-05-10T03:29:25.357 INFO:teuthology.orchestra.run.smithi045.stdout: ceph x86_64 2:18.2.2-1330.g50174015.el8 ceph 6.4 k 2024-05-10T03:29:25.357 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base x86_64 2:18.2.2-1330.g50174015.el8 ceph 5.7 M 2024-05-10T03:29:25.357 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse x86_64 2:18.2.2-1330.g50174015.el8 ceph 829 k 2024-05-10T03:29:25.357 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1330.g50174015.el8 ceph 157 k 2024-05-10T03:29:25.357 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr x86_64 2:18.2.2-1330.g50174015.el8 ceph 1.5 M 2024-05-10T03:29:25.357 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 138 k 2024-05-10T03:29:25.357 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 3.5 M 2024-05-10T03:29:25.357 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 7.4 M 2024-05-10T03:29:25.357 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 49 k 2024-05-10T03:29:25.357 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw x86_64 2:18.2.2-1330.g50174015.el8 ceph 14 M 2024-05-10T03:29:25.357 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test x86_64 2:18.2.2-1330.g50174015.el8 ceph 49 M 2024-05-10T03:29:25.357 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-volume noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 263 k 2024-05-10T03:29:25.357 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 173 k 2024-05-10T03:29:25.357 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-mirror x86_64 2:18.2.2-1330.g50174015.el8 ceph 246 k 2024-05-10T03:29:25.358 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-top noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 18 k 2024-05-10T03:29:25.358 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-05-10T03:29:25.358 INFO:teuthology.orchestra.run.smithi045.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-05-10T03:29:25.358 INFO:teuthology.orchestra.run.smithi045.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-05-10T03:29:25.358 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel x86_64 2:18.2.2-1330.g50174015.el8 ceph 31 k 2024-05-10T03:29:25.358 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 756 k 2024-05-10T03:29:25.358 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel x86_64 2:18.2.2-1330.g50174015.el8 ceph 139 k 2024-05-10T03:29:25.358 INFO:teuthology.orchestra.run.smithi045.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-05-10T03:29:25.358 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-05-10T03:29:25.358 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-05-10T03:29:25.358 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-05-10T03:29:25.358 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-05-10T03:29:25.359 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-05-10T03:29:25.359 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs x86_64 2:18.2.2-1330.g50174015.el8 ceph 197 k 2024-05-10T03:29:25.359 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados x86_64 2:18.2.2-1330.g50174015.el8 ceph 371 k 2024-05-10T03:29:25.359 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd x86_64 2:18.2.2-1330.g50174015.el8 ceph 364 k 2024-05-10T03:29:25.359 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw x86_64 2:18.2.2-1330.g50174015.el8 ceph 107 k 2024-05-10T03:29:25.359 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse x86_64 2:18.2.2-1330.g50174015.el8 ceph 91 k 2024-05-10T03:29:25.359 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.3 M 2024-05-10T03:29:25.359 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd x86_64 2:18.2.2-1330.g50174015.el8 ceph 179 k 2024-05-10T03:29:25.359 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-05-10T03:29:25.359 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrading: 2024-05-10T03:29:25.359 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-05-10T03:29:25.359 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-05-10T03:29:25.359 INFO:teuthology.orchestra.run.smithi045.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-05-10T03:29:25.359 INFO:teuthology.orchestra.run.smithi045.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-05-10T03:29:25.360 INFO:teuthology.orchestra.run.smithi045.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-05-10T03:29:25.360 INFO:teuthology.orchestra.run.smithi045.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-05-10T03:29:25.360 INFO:teuthology.orchestra.run.smithi045.stdout: librados2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.5 M 2024-05-10T03:29:25.360 INFO:teuthology.orchestra.run.smithi045.stdout: librbd1 x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.5 M 2024-05-10T03:29:25.360 INFO:teuthology.orchestra.run.smithi045.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-05-10T03:29:25.360 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-05-10T03:29:25.360 INFO:teuthology.orchestra.run.smithi045.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-05-10T03:29:25.360 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-05-10T03:29:25.360 INFO:teuthology.orchestra.run.smithi045.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-05-10T03:29:25.360 INFO:teuthology.orchestra.run.smithi045.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-05-10T03:29:25.360 INFO:teuthology.orchestra.run.smithi045.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-05-10T03:29:25.360 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-05-10T03:29:25.360 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-05-10T03:29:25.360 INFO:teuthology.orchestra.run.smithi045.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-05-10T03:29:25.361 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common x86_64 2:18.2.2-1330.g50174015.el8 ceph 23 M 2024-05-10T03:29:25.361 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 24 k 2024-05-10T03:29:25.361 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds x86_64 2:18.2.2-1330.g50174015.el8 ceph 2.2 M 2024-05-10T03:29:25.361 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 246 k 2024-05-10T03:29:25.361 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon x86_64 2:18.2.2-1330.g50174015.el8 ceph 5.1 M 2024-05-10T03:29:25.361 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd x86_64 2:18.2.2-1330.g50174015.el8 ceph 19 M 2024-05-10T03:29:25.361 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 16 k 2024-05-10T03:29:25.361 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux x86_64 2:18.2.2-1330.g50174015.el8 ceph 24 k 2024-05-10T03:29:25.361 INFO:teuthology.orchestra.run.smithi045.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-05-10T03:29:25.361 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-10T03:29:25.361 INFO:teuthology.orchestra.run.smithi045.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-05-10T03:29:25.361 INFO:teuthology.orchestra.run.smithi045.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-05-10T03:29:25.361 INFO:teuthology.orchestra.run.smithi045.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-05-10T03:29:25.361 INFO:teuthology.orchestra.run.smithi045.stdout: libcephsqlite x86_64 2:18.2.2-1330.g50174015.el8 ceph 139 k 2024-05-10T03:29:25.362 INFO:teuthology.orchestra.run.smithi045.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-05-10T03:29:25.362 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-05-10T03:29:25.362 INFO:teuthology.orchestra.run.smithi045.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-10T03:29:25.362 INFO:teuthology.orchestra.run.smithi045.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-05-10T03:29:25.362 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-05-10T03:29:25.362 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-05-10T03:29:25.362 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1 x86_64 2:18.2.2-1330.g50174015.el8 ceph 461 k 2024-05-10T03:29:25.362 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-05-10T03:29:25.362 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 7.2 M 2024-05-10T03:29:25.362 INFO:teuthology.orchestra.run.smithi045.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-05-10T03:29:25.362 INFO:teuthology.orchestra.run.smithi045.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-05-10T03:29:25.362 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-10T03:29:25.362 INFO:teuthology.orchestra.run.smithi045.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-05-10T03:29:25.362 INFO:teuthology.orchestra.run.smithi045.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-05-10T03:29:25.363 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-05-10T03:29:25.363 INFO:teuthology.orchestra.run.smithi045.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-05-10T03:29:25.363 INFO:teuthology.orchestra.run.smithi045.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-05-10T03:29:25.363 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-05-10T03:29:25.363 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-05-10T03:29:25.363 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-05-10T03:29:25.363 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-05-10T03:29:25.363 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-10T03:29:25.363 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-05-10T03:29:25.363 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-10T03:29:25.363 INFO:teuthology.orchestra.run.smithi045.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-10T03:29:25.363 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-10T03:29:25.363 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse x86_64 2:18.2.2-1330.g50174015.el8 ceph 45 k 2024-05-10T03:29:25.364 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common x86_64 2:18.2.2-1330.g50174015.el8 ceph 129 k 2024-05-10T03:29:25.364 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-10T03:29:25.364 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-05-10T03:29:25.364 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-10T03:29:25.364 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-10T03:29:25.364 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-05-10T03:29:25.364 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-10T03:29:25.364 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-10T03:29:25.364 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-10T03:29:25.364 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-05-10T03:29:25.364 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-05-10T03:29:25.364 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-05-10T03:29:25.364 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-10T03:29:25.364 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-10T03:29:25.365 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-10T03:29:25.365 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-05-10T03:29:25.365 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-10T03:29:25.365 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-10T03:29:25.365 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-10T03:29:25.365 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-10T03:29:25.365 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-05-10T03:29:25.365 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-05-10T03:29:25.365 INFO:teuthology.orchestra.run.smithi045.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-05-10T03:29:25.365 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-10T03:29:25.365 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-10T03:29:25.365 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-05-10T03:29:25.365 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-05-10T03:29:25.366 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-05-10T03:29:25.366 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-05-10T03:29:25.366 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-05-10T03:29:25.366 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-05-10T03:29:25.366 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-10T03:29:25.366 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-10T03:29:25.366 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-10T03:29:25.366 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-10T03:29:25.366 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-05-10T03:29:25.366 INFO:teuthology.orchestra.run.smithi045.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-10T03:29:25.366 INFO:teuthology.orchestra.run.smithi045.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-10T03:29:25.366 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-10T03:29:25.366 INFO:teuthology.orchestra.run.smithi045.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-10T03:29:25.366 INFO:teuthology.orchestra.run.smithi045.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-10T03:29:25.367 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-10T03:29:25.367 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-10T03:29:25.367 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-10T03:29:25.367 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-05-10T03:29:25.367 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-10T03:29:25.367 INFO:teuthology.orchestra.run.smithi045.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-05-10T03:29:25.367 INFO:teuthology.orchestra.run.smithi045.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-10T03:29:25.367 INFO:teuthology.orchestra.run.smithi045.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-05-10T03:29:25.367 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-05-10T03:29:25.367 INFO:teuthology.orchestra.run.smithi045.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-05-10T03:29:25.367 INFO:teuthology.orchestra.run.smithi045.stdout:Enabling module streams: 2024-05-10T03:29:25.367 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql 10 2024-05-10T03:29:25.367 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:29:25.367 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-05-10T03:29:25.368 INFO:teuthology.orchestra.run.smithi045.stdout:=================================================================================================================================== 2024-05-10T03:29:25.368 INFO:teuthology.orchestra.run.smithi045.stdout:Install 130 Packages 2024-05-10T03:29:25.368 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrade 16 Packages 2024-05-10T03:29:25.368 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:29:25.368 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 221 M 2024-05-10T03:29:25.368 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-05-10T03:29:25.392 INFO:teuthology.orchestra.run.smithi154.stdout:(16/146): libradosstriper1-18.2.2-1330.g5017401 2.8 MB/s | 461 kB 00:00 2024-05-10T03:29:25.853 INFO:teuthology.orchestra.run.smithi045.stdout:(1/146): ceph-18.2.2-1330.g50174015.el8.x86_64. 21 kB/s | 6.4 kB 00:00 2024-05-10T03:29:25.943 INFO:teuthology.orchestra.run.smithi106.stdout:(8/146): ceph-osd-18.2.2-1330.g50174015.el8.x86 10 MB/s | 19 MB 00:01 2024-05-10T03:29:26.027 INFO:teuthology.orchestra.run.smithi106.stdout:(9/146): ceph-selinux-18.2.2-1330.g50174015.el8 293 kB/s | 24 kB 00:00 2024-05-10T03:29:26.662 INFO:teuthology.orchestra.run.smithi045.stdout:(2/146): ceph-fuse-18.2.2-1330.g50174015.el8.x8 1.0 MB/s | 829 kB 00:00 2024-05-10T03:29:26.837 INFO:teuthology.orchestra.run.smithi045.stdout:(3/146): ceph-immutable-object-cache-18.2.2-133 898 kB/s | 157 kB 00:00 2024-05-10T03:29:27.067 INFO:teuthology.orchestra.run.smithi154.stdout:(17/146): librgw2-18.2.2-1330.g50174015.el8.x86 4.3 MB/s | 7.2 MB 00:01 2024-05-10T03:29:27.176 INFO:teuthology.orchestra.run.smithi154.stdout:(18/146): python3-ceph-argparse-18.2.2-1330.g50 412 kB/s | 45 kB 00:00 2024-05-10T03:29:27.276 INFO:teuthology.orchestra.run.smithi154.stdout:(19/146): python3-ceph-common-18.2.2-1330.g5017 1.3 MB/s | 129 kB 00:00 2024-05-10T03:29:27.376 INFO:teuthology.orchestra.run.smithi154.stdout:(20/146): python3-cephfs-18.2.2-1330.g50174015. 1.9 MB/s | 197 kB 00:00 2024-05-10T03:29:27.560 INFO:teuthology.orchestra.run.smithi154.stdout:(21/146): python3-rados-18.2.2-1330.g50174015.e 2.0 MB/s | 371 kB 00:00 2024-05-10T03:29:27.760 INFO:teuthology.orchestra.run.smithi154.stdout:(22/146): python3-rbd-18.2.2-1330.g50174015.el8 1.8 MB/s | 364 kB 00:00 2024-05-10T03:29:27.860 INFO:teuthology.orchestra.run.smithi154.stdout:(23/146): python3-rgw-18.2.2-1330.g50174015.el8 1.0 MB/s | 107 kB 00:00 2024-05-10T03:29:27.978 INFO:teuthology.orchestra.run.smithi154.stdout:(24/146): rbd-fuse-18.2.2-1330.g50174015.el8.x8 784 kB/s | 91 kB 00:00 2024-05-10T03:29:28.178 INFO:teuthology.orchestra.run.smithi045.stdout:(4/146): ceph-base-18.2.2-1330.g50174015.el8.x8 2.2 MB/s | 5.7 MB 00:02 2024-05-10T03:29:28.470 INFO:teuthology.orchestra.run.smithi045.stdout:(5/146): ceph-mds-18.2.2-1330.g50174015.el8.x86 1.3 MB/s | 2.2 MB 00:01 2024-05-10T03:29:28.787 INFO:teuthology.orchestra.run.smithi045.stdout:(6/146): ceph-mgr-18.2.2-1330.g50174015.el8.x86 2.5 MB/s | 1.5 MB 00:00 2024-05-10T03:29:28.878 INFO:teuthology.orchestra.run.smithi154.stdout:(25/146): rbd-mirror-18.2.2-1330.g50174015.el8. 3.7 MB/s | 3.3 MB 00:00 2024-05-10T03:29:28.978 INFO:teuthology.orchestra.run.smithi154.stdout:(26/146): rbd-nbd-18.2.2-1330.g50174015.el8.x86 1.8 MB/s | 179 kB 00:00 2024-05-10T03:29:29.070 INFO:teuthology.orchestra.run.smithi154.stdout:(27/146): ceph-grafana-dashboards-18.2.2-1330.g 265 kB/s | 24 kB 00:00 2024-05-10T03:29:29.154 INFO:teuthology.orchestra.run.smithi154.stdout:(28/146): ceph-mgr-cephadm-18.2.2-1330.g5017401 1.6 MB/s | 138 kB 00:00 2024-05-10T03:29:29.821 INFO:teuthology.orchestra.run.smithi154.stdout:(29/146): ceph-common-18.2.2-1330.g50174015.el8 2.7 MB/s | 23 MB 00:08 2024-05-10T03:29:30.214 INFO:teuthology.orchestra.run.smithi154.stdout:(30/146): ceph-mgr-dashboard-18.2.2-1330.g50174 3.3 MB/s | 3.5 MB 00:01 2024-05-10T03:29:30.321 INFO:teuthology.orchestra.run.smithi154.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1330.g50 2.2 MB/s | 246 kB 00:00 2024-05-10T03:29:30.422 INFO:teuthology.orchestra.run.smithi154.stdout:(32/146): ceph-mgr-rook-18.2.2-1330.g50174015.e 492 kB/s | 49 kB 00:00 2024-05-10T03:29:30.460 INFO:teuthology.orchestra.run.smithi106.stdout:(10/146): ceph-radosgw-18.2.2-1330.g50174015.el 2.3 MB/s | 14 MB 00:06 2024-05-10T03:29:30.480 INFO:teuthology.orchestra.run.smithi154.stdout:(33/146): ceph-prometheus-alerts-18.2.2-1330.g5 281 kB/s | 16 kB 00:00 2024-05-10T03:29:30.597 INFO:teuthology.orchestra.run.smithi154.stdout:(34/146): ceph-volume-18.2.2-1330.g50174015.el8 2.2 MB/s | 263 kB 00:00 2024-05-10T03:29:30.660 INFO:teuthology.orchestra.run.smithi106.stdout:(11/146): cephfs-mirror-18.2.2-1330.g50174015.e 1.2 MB/s | 246 kB 00:00 2024-05-10T03:29:30.714 INFO:teuthology.orchestra.run.smithi154.stdout:(35/146): cephadm-18.2.2-1330.g50174015.el8.noa 1.4 MB/s | 173 kB 00:00 2024-05-10T03:29:30.768 INFO:teuthology.orchestra.run.smithi106.stdout:(12/146): libcephfs-devel-18.2.2-1330.g50174015 286 kB/s | 31 kB 00:00 2024-05-10T03:29:30.806 INFO:teuthology.orchestra.run.smithi154.stdout:(36/146): cephfs-top-18.2.2-1330.g50174015.el8. 198 kB/s | 18 kB 00:00 2024-05-10T03:29:31.040 INFO:teuthology.orchestra.run.smithi154.stdout:(37/146): gperftools-libs-2.7-9.el8.x86_64.rpm 1.3 MB/s | 306 kB 00:00 2024-05-10T03:29:31.098 INFO:teuthology.orchestra.run.smithi154.stdout:(38/146): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2024-05-10T03:29:31.144 INFO:teuthology.orchestra.run.smithi106.stdout:(13/146): libcephfs2-18.2.2-1330.g50174015.el8. 2.0 MB/s | 756 kB 00:00 2024-05-10T03:29:31.157 INFO:teuthology.orchestra.run.smithi154.stdout:(39/146): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2024-05-10T03:29:31.244 INFO:teuthology.orchestra.run.smithi106.stdout:(14/146): libcephsqlite-18.2.2-1330.g50174015.e 1.4 MB/s | 139 kB 00:00 2024-05-10T03:29:31.257 INFO:teuthology.orchestra.run.smithi154.stdout:(40/146): python3-asyncssh-2.7.0-2.el8.noarch.r 4.6 MB/s | 476 kB 00:00 2024-05-10T03:29:31.307 INFO:teuthology.orchestra.run.smithi154.stdout:(41/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 877 kB/s | 44 kB 00:00 2024-05-10T03:29:31.336 INFO:teuthology.orchestra.run.smithi106.stdout:(15/146): librados-devel-18.2.2-1330.g50174015. 1.5 MB/s | 139 kB 00:00 2024-05-10T03:29:31.366 INFO:teuthology.orchestra.run.smithi154.stdout:(42/146): python3-beautifulsoup4-4.6.3-2.el8.1. 3.1 MB/s | 185 kB 00:00 2024-05-10T03:29:31.416 INFO:teuthology.orchestra.run.smithi154.stdout:(43/146): python3-cachetools-3.1.1-4.el8.noarch 663 kB/s | 33 kB 00:00 2024-05-10T03:29:31.563 INFO:teuthology.orchestra.run.smithi045.stdout:(7/146): ceph-mon-18.2.2-1330.g50174015.el8.x86 1.7 MB/s | 5.1 MB 00:03 2024-05-10T03:29:31.570 INFO:teuthology.orchestra.run.smithi106.stdout:(16/146): libradosstriper1-18.2.2-1330.g5017401 1.9 MB/s | 461 kB 00:00 2024-05-10T03:29:31.925 INFO:teuthology.orchestra.run.smithi154.stdout:(44/146): ceph-test-18.2.2-1330.g50174015.el8.x 6.2 MB/s | 49 MB 00:07 2024-05-10T03:29:31.951 INFO:teuthology.orchestra.run.smithi154.stdout:(45/146): python3-certifi-2018.10.15-7.el8.noar 31 kB/s | 16 kB 00:00 2024-05-10T03:29:32.017 INFO:teuthology.orchestra.run.smithi154.stdout:(46/146): python3-cherrypy-18.4.0-1.el8.noarch. 5.7 MB/s | 384 kB 00:00 2024-05-10T03:29:32.076 INFO:teuthology.orchestra.run.smithi154.stdout:(47/146): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2024-05-10T03:29:32.161 INFO:teuthology.orchestra.run.smithi154.stdout:(48/146): python3-cheroot-8.5.2-1.el8.noarch.rp 733 kB/s | 173 kB 00:00 2024-05-10T03:29:32.193 INFO:teuthology.orchestra.run.smithi154.stdout:(49/146): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2024-05-10T03:29:32.218 INFO:teuthology.orchestra.run.smithi154.stdout:(50/146): python3-jaraco-functools-2.0-4.el8.no 310 kB/s | 18 kB 00:00 2024-05-10T03:29:32.269 INFO:teuthology.orchestra.run.smithi154.stdout:(51/146): python3-logutils-0.3.5-11.el8.noarch. 974 kB/s | 49 kB 00:00 2024-05-10T03:29:32.327 INFO:teuthology.orchestra.run.smithi154.stdout:(52/146): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2024-05-10T03:29:32.361 INFO:teuthology.orchestra.run.smithi154.stdout:(53/146): python3-kubernetes-11.0.0-6.el8.noarc 7.0 MB/s | 1.2 MB 00:00 2024-05-10T03:29:32.386 INFO:teuthology.orchestra.run.smithi154.stdout:(54/146): python3-natsort-7.1.1-2.el8.noarch.rp 1.0 MB/s | 60 kB 00:00 2024-05-10T03:29:32.445 INFO:teuthology.orchestra.run.smithi154.stdout:(55/146): python3-pecan-1.3.2-9.el8.noarch.rpm 3.3 MB/s | 283 kB 00:00 2024-05-10T03:29:32.470 INFO:teuthology.orchestra.run.smithi154.stdout:(56/146): python3-portend-2.6-1.el8.noarch.rpm 187 kB/s | 16 kB 00:00 2024-05-10T03:29:32.495 INFO:teuthology.orchestra.run.smithi154.stdout:(57/146): python3-repoze-lru-0.7-6.el8.noarch.r 673 kB/s | 34 kB 00:00 2024-05-10T03:29:32.529 INFO:teuthology.orchestra.run.smithi154.stdout:(58/146): python3-routes-2.4.1-12.el8.noarch.rp 3.3 MB/s | 196 kB 00:00 2024-05-10T03:29:32.546 INFO:teuthology.orchestra.run.smithi154.stdout:(59/146): python3-rsa-4.9-2.el8.noarch.rpm 1.2 MB/s | 64 kB 00:00 2024-05-10T03:29:32.580 INFO:teuthology.orchestra.run.smithi154.stdout:(60/146): python3-simplegeneric-0.8.1-17.el8.no 373 kB/s | 19 kB 00:00 2024-05-10T03:29:32.605 INFO:teuthology.orchestra.run.smithi154.stdout:(61/146): python3-singledispatch-3.4.0.3-18.el8 409 kB/s | 24 kB 00:00 2024-05-10T03:29:32.631 INFO:teuthology.orchestra.run.smithi154.stdout:(62/146): python3-tempora-1.14.1-5.el8.noarch.r 582 kB/s | 29 kB 00:00 2024-05-10T03:29:32.656 INFO:teuthology.orchestra.run.smithi154.stdout:(63/146): python3-trustme-0.6.0-4.el8.noarch.rp 550 kB/s | 27 kB 00:00 2024-05-10T03:29:32.722 INFO:teuthology.orchestra.run.smithi154.stdout:(64/146): python3-waitress-1.4.3-1.el8.noarch.r 2.7 MB/s | 255 kB 00:00 2024-05-10T03:29:32.748 INFO:teuthology.orchestra.run.smithi154.stdout:(65/146): python3-webob-1.8.5-1.el8.1.noarch.rp 2.7 MB/s | 251 kB 00:00 2024-05-10T03:29:32.773 INFO:teuthology.orchestra.run.smithi154.stdout:(66/146): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2024-05-10T03:29:32.807 INFO:teuthology.orchestra.run.smithi154.stdout:(67/146): python3-webtest-2.0.33-1.el8.noarch.r 1.4 MB/s | 85 kB 00:00 2024-05-10T03:29:32.812 INFO:teuthology.orchestra.run.smithi106.stdout:(17/146): ceph-test-18.2.2-1330.g50174015.el8.x 7.2 MB/s | 49 MB 00:06 2024-05-10T03:29:32.832 INFO:teuthology.orchestra.run.smithi154.stdout:(68/146): python3-zc-lockfile-2.0-2.el8.noarch. 391 kB/s | 23 kB 00:00 2024-05-10T03:29:32.857 INFO:teuthology.orchestra.run.smithi154.stdout:(69/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 70 kB 00:00 2024-05-10T03:29:32.862 INFO:teuthology.orchestra.run.smithi106.stdout:(18/146): python3-ceph-argparse-18.2.2-1330.g50 902 kB/s | 45 kB 00:00 2024-05-10T03:29:32.912 INFO:teuthology.orchestra.run.smithi106.stdout:(19/146): python3-ceph-common-18.2.2-1330.g5017 2.5 MB/s | 129 kB 00:00 2024-05-10T03:29:32.933 INFO:teuthology.orchestra.run.smithi154.stdout:(70/146): thrift-0.13.0-2.el8.x86_64.rpm 14 MB/s | 1.7 MB 00:00 2024-05-10T03:29:32.971 INFO:teuthology.orchestra.run.smithi106.stdout:(20/146): python3-cephfs-18.2.2-1330.g50174015. 3.3 MB/s | 197 kB 00:00 2024-05-10T03:29:32.988 INFO:teuthology.orchestra.run.smithi045.stdout:(8/146): ceph-common-18.2.2-1330.g50174015.el8. 3.1 MB/s | 23 MB 00:07 2024-05-10T03:29:33.025 INFO:teuthology.orchestra.run.smithi154.stdout:(71/146): python3-jsonpointer-1.10-11.el8.noarc 120 kB/s | 20 kB 00:00 2024-05-10T03:29:33.063 INFO:teuthology.orchestra.run.smithi106.stdout:(21/146): python3-rados-18.2.2-1330.g50174015.e 4.0 MB/s | 371 kB 00:00 2024-05-10T03:29:33.080 INFO:teuthology.orchestra.run.smithi045.stdout:(9/146): ceph-selinux-18.2.2-1330.g50174015.el8 266 kB/s | 24 kB 00:00 2024-05-10T03:29:33.092 INFO:teuthology.orchestra.run.smithi154.stdout:(72/146): python3-prettytable-0.7.2-14.el8.noar 277 kB/s | 44 kB 00:00 2024-05-10T03:29:33.125 INFO:teuthology.orchestra.run.smithi154.stdout:(73/146): python3-pyasn1-modules-0.3.7-6.el8.no 1.1 MB/s | 110 kB 00:00 2024-05-10T03:29:33.129 INFO:teuthology.orchestra.run.smithi106.stdout:(22/146): python3-rbd-18.2.2-1330.g50174015.el8 5.4 MB/s | 364 kB 00:00 2024-05-10T03:29:33.180 INFO:teuthology.orchestra.run.smithi106.stdout:(23/146): python3-rgw-18.2.2-1330.g50174015.el8 2.1 MB/s | 107 kB 00:00 2024-05-10T03:29:33.239 INFO:teuthology.orchestra.run.smithi106.stdout:(24/146): rbd-fuse-18.2.2-1330.g50174015.el8.x8 1.5 MB/s | 91 kB 00:00 2024-05-10T03:29:33.300 INFO:teuthology.orchestra.run.smithi154.stdout:(74/146): ceph-mgr-diskprediction-local-18.2.2- 2.1 MB/s | 7.4 MB 00:03 2024-05-10T03:29:33.326 INFO:teuthology.orchestra.run.smithi154.stdout:(75/146): python3-jsonpatch-1.21-2.el8.noarch.r 113 kB/s | 27 kB 00:00 2024-05-10T03:29:33.359 INFO:teuthology.orchestra.run.smithi154.stdout:(76/146): python3-pyasn1-0.3.7-6.el8.noarch.rpm 540 kB/s | 126 kB 00:00 2024-05-10T03:29:33.451 INFO:teuthology.orchestra.run.smithi154.stdout:(77/146): flex-2.6.1-9.el8.x86_64.rpm 3.4 MB/s | 320 kB 00:00 2024-05-10T03:29:33.476 INFO:teuthology.orchestra.run.smithi154.stdout:(78/146): python3-werkzeug-0.12.2-4.el8.noarch. 2.5 MB/s | 457 kB 00:00 2024-05-10T03:29:33.510 INFO:teuthology.orchestra.run.smithi154.stdout:(79/146): bison-3.0.4-10.el8.x86_64.rpm 3.8 MB/s | 688 kB 00:00 2024-05-10T03:29:33.538 INFO:teuthology.orchestra.run.smithi045.stdout:(10/146): ceph-osd-18.2.2-1330.g50174015.el8.x8 3.9 MB/s | 19 MB 00:04 2024-05-10T03:29:33.577 INFO:teuthology.orchestra.run.smithi154.stdout:(80/146): libtool-2.4.6-25.el8.x86_64.rpm 5.5 MB/s | 709 kB 00:00 2024-05-10T03:29:33.602 INFO:teuthology.orchestra.run.smithi154.stdout:(81/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.8 MB/s | 259 kB 00:00 2024-05-10T03:29:33.627 INFO:teuthology.orchestra.run.smithi154.stdout:(82/146): python3-markupsafe-0.23-19.el8.x86_64 257 kB/s | 39 kB 00:00 2024-05-10T03:29:33.705 INFO:teuthology.orchestra.run.smithi045.stdout:(11/146): cephfs-mirror-18.2.2-1330.g50174015.e 1.4 MB/s | 246 kB 00:00 2024-05-10T03:29:33.747 INFO:teuthology.orchestra.run.smithi045.stdout:(12/146): libcephfs-devel-18.2.2-1330.g50174015 747 kB/s | 31 kB 00:00 2024-05-10T03:29:33.814 INFO:teuthology.orchestra.run.smithi106.stdout:(25/146): rbd-mirror-18.2.2-1330.g50174015.el8. 5.8 MB/s | 3.3 MB 00:00 2024-05-10T03:29:33.886 INFO:teuthology.orchestra.run.smithi154.stdout:(83/146): uuid-1.6.2-43.el8.x86_64.rpm 207 kB/s | 64 kB 00:00 2024-05-10T03:29:33.889 INFO:teuthology.orchestra.run.smithi045.stdout:(13/146): libcephfs2-18.2.2-1330.g50174015.el8. 5.2 MB/s | 756 kB 00:00 2024-05-10T03:29:33.939 INFO:teuthology.orchestra.run.smithi106.stdout:(26/146): librgw2-18.2.2-1330.g50174015.el8.x86 3.1 MB/s | 7.2 MB 00:02 2024-05-10T03:29:33.956 INFO:teuthology.orchestra.run.smithi106.stdout:(27/146): rbd-nbd-18.2.2-1330.g50174015.el8.x86 1.2 MB/s | 179 kB 00:00 2024-05-10T03:29:34.007 INFO:teuthology.orchestra.run.smithi106.stdout:(28/146): ceph-mgr-cephadm-18.2.2-1330.g5017401 2.7 MB/s | 138 kB 00:00 2024-05-10T03:29:34.032 INFO:teuthology.orchestra.run.smithi106.stdout:(29/146): ceph-grafana-dashboards-18.2.2-1330.g 264 kB/s | 24 kB 00:00 2024-05-10T03:29:34.064 INFO:teuthology.orchestra.run.smithi045.stdout:(14/146): libcephsqlite-18.2.2-1330.g50174015.e 797 kB/s | 139 kB 00:00 2024-05-10T03:29:34.131 INFO:teuthology.orchestra.run.smithi045.stdout:(15/146): librados-devel-18.2.2-1330.g50174015. 2.0 MB/s | 139 kB 00:00 2024-05-10T03:29:34.136 INFO:teuthology.orchestra.run.smithi154.stdout:(84/146): python3-pyOpenSSL-19.0.0-1.el8.noarch 194 kB/s | 103 kB 00:00 2024-05-10T03:29:34.214 INFO:teuthology.orchestra.run.smithi154.stdout:(85/146): python3-jinja2-2.10.1-3.el8.noarch.rp 1.6 MB/s | 538 kB 00:00 2024-05-10T03:29:34.248 INFO:teuthology.orchestra.run.smithi045.stdout:(16/146): libradosstriper1-18.2.2-1330.g5017401 3.9 MB/s | 461 kB 00:00 2024-05-10T03:29:34.320 INFO:teuthology.orchestra.run.smithi154.stdout:(86/146): python3-babel-2.5.1-7.el8.noarch.rpm 6.9 MB/s | 4.8 MB 00:00 2024-05-10T03:29:34.346 INFO:teuthology.orchestra.run.smithi154.stdout:(87/146): socat-1.7.4.1-1.el8.x86_64.rpm 2.4 MB/s | 323 kB 00:00 2024-05-10T03:29:34.349 INFO:teuthology.orchestra.run.smithi106.stdout:(30/146): ceph-common-18.2.2-1330.g50174015.el8 1.8 MB/s | 23 MB 00:12 2024-05-10T03:29:34.446 INFO:teuthology.orchestra.run.smithi154.stdout:(88/146): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.8 MB/s | 225 kB 00:00 2024-05-10T03:29:34.457 INFO:teuthology.orchestra.run.smithi106.stdout:(31/146): ceph-mgr-dashboard-18.2.2-1330.g50174 7.8 MB/s | 3.5 MB 00:00 2024-05-10T03:29:34.508 INFO:teuthology.orchestra.run.smithi106.stdout:(32/146): ceph-mgr-modules-core-18.2.2-1330.g50 1.5 MB/s | 246 kB 00:00 2024-05-10T03:29:34.531 INFO:teuthology.orchestra.run.smithi154.stdout:(89/146): python3-numpy-1.14.3-10.el8.x86_64.rp 9.5 MB/s | 3.7 MB 00:00 2024-05-10T03:29:34.533 INFO:teuthology.orchestra.run.smithi106.stdout:(33/146): ceph-mgr-rook-18.2.2-1330.g50174015.e 656 kB/s | 49 kB 00:00 2024-05-10T03:29:34.564 INFO:teuthology.orchestra.run.smithi154.stdout:(90/146): librdkafka-0.11.4-3.el8.x86_64.rpm 1.6 MB/s | 354 kB 00:00 2024-05-10T03:29:34.575 INFO:teuthology.orchestra.run.smithi106.stdout:(34/146): ceph-prometheus-alerts-18.2.2-1330.g5 245 kB/s | 16 kB 00:00 2024-05-10T03:29:34.601 INFO:teuthology.orchestra.run.smithi106.stdout:(35/146): ceph-volume-18.2.2-1330.g50174015.el8 3.8 MB/s | 263 kB 00:00 2024-05-10T03:29:34.684 INFO:teuthology.orchestra.run.smithi106.stdout:(36/146): cephfs-top-18.2.2-1330.g50174015.el8. 217 kB/s | 18 kB 00:00 2024-05-10T03:29:34.689 INFO:teuthology.orchestra.run.smithi154.stdout:(91/146): openblas-threads-0.3.15-6.el8.x86_64. 22 MB/s | 5.2 MB 00:00 2024-05-10T03:29:34.709 INFO:teuthology.orchestra.run.smithi106.stdout:(37/146): cephadm-18.2.2-1330.g50174015.el8.noa 1.3 MB/s | 173 kB 00:00 2024-05-10T03:29:34.714 INFO:teuthology.orchestra.run.smithi154.stdout:(92/146): python3-mako-1.0.6-14.el8.noarch.rpm 854 kB/s | 157 kB 00:00 2024-05-10T03:29:34.818 INFO:teuthology.orchestra.run.smithi106.stdout:(38/146): liboath-2.6.2-3.el8.x86_64.rpm 543 kB/s | 59 kB 00:00 2024-05-10T03:29:34.831 INFO:teuthology.orchestra.run.smithi154.stdout:(93/146): openblas-0.3.15-6.el8.x86_64.rpm 19 MB/s | 5.0 MB 00:00 2024-05-10T03:29:34.859 INFO:teuthology.orchestra.run.smithi106.stdout:(39/146): gperftools-libs-2.7-9.el8.x86_64.rpm 1.7 MB/s | 306 kB 00:00 2024-05-10T03:29:34.864 INFO:teuthology.orchestra.run.smithi154.stdout:(94/146): automake-1.16.1-8.el8.noarch.rpm 4.0 MB/s | 714 kB 00:00 2024-05-10T03:29:34.890 INFO:teuthology.orchestra.run.smithi154.stdout:(95/146): libpq-13.11-1.el8.x86_64.rpm 1.1 MB/s | 198 kB 00:00 2024-05-10T03:29:34.927 INFO:teuthology.orchestra.run.smithi106.stdout:(40/146): libunwind-1.3.1-3.el8.x86_64.rpm 684 kB/s | 75 kB 00:00 2024-05-10T03:29:34.960 INFO:teuthology.orchestra.run.smithi106.stdout:(41/146): python3-asyncssh-2.7.0-2.el8.noarch.r 4.6 MB/s | 476 kB 00:00 2024-05-10T03:29:34.977 INFO:teuthology.orchestra.run.smithi106.stdout:(42/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 891 kB/s | 44 kB 00:00 2024-05-10T03:29:34.998 INFO:teuthology.orchestra.run.smithi154.stdout:(96/146): python3-pytz-2017.2-11.el8.noarch.rpm 406 kB/s | 54 kB 00:00 2024-05-10T03:29:35.011 INFO:teuthology.orchestra.run.smithi106.stdout:(43/146): python3-beautifulsoup4-4.6.3-2.el8.1. 3.6 MB/s | 185 kB 00:00 2024-05-10T03:29:35.028 INFO:teuthology.orchestra.run.smithi106.stdout:(44/146): python3-cachetools-3.1.1-4.el8.noarch 653 kB/s | 33 kB 00:00 2024-05-10T03:29:35.045 INFO:teuthology.orchestra.run.smithi106.stdout:(45/146): python3-certifi-2018.10.15-7.el8.noar 489 kB/s | 16 kB 00:00 2024-05-10T03:29:35.057 INFO:teuthology.orchestra.run.smithi154.stdout:(97/146): jq-1.6-7.el8.x86_64.rpm 898 kB/s | 202 kB 00:00 2024-05-10T03:29:35.095 INFO:teuthology.orchestra.run.smithi106.stdout:(46/146): python3-cherrypy-18.4.0-1.el8.noarch. 7.5 MB/s | 384 kB 00:00 2024-05-10T03:29:35.099 INFO:teuthology.orchestra.run.smithi154.stdout:(98/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-05-10T03:29:35.120 INFO:teuthology.orchestra.run.smithi106.stdout:(47/146): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2024-05-10T03:29:35.123 INFO:teuthology.orchestra.run.smithi045.stdout:(17/146): ceph-radosgw-18.2.2-1330.g50174015.el 4.1 MB/s | 14 MB 00:03 2024-05-10T03:29:35.137 INFO:teuthology.orchestra.run.smithi106.stdout:(48/146): python3-google-auth-1.1.1-10.el8.noar 1.9 MB/s | 81 kB 00:00 2024-05-10T03:29:35.182 INFO:teuthology.orchestra.run.smithi045.stdout:(18/146): python3-ceph-argparse-18.2.2-1330.g50 772 kB/s | 45 kB 00:00 2024-05-10T03:29:35.196 INFO:teuthology.orchestra.run.smithi106.stdout:(49/146): python3-jaraco-6.2-6.el8.noarch.rpm 148 kB/s | 11 kB 00:00 2024-05-10T03:29:35.213 INFO:teuthology.orchestra.run.smithi106.stdout:(50/146): python3-jaraco-functools-2.0-4.el8.no 233 kB/s | 18 kB 00:00 2024-05-10T03:29:35.216 INFO:teuthology.orchestra.run.smithi154.stdout:(99/146): postgresql-10.23-4.module+el8.9.0+213 9.5 MB/s | 1.5 MB 00:00 2024-05-10T03:29:35.249 INFO:teuthology.orchestra.run.smithi154.stdout:(100/146): postgresql-contrib-10.23-4.module+el 5.3 MB/s | 812 kB 00:00 2024-05-10T03:29:35.255 INFO:teuthology.orchestra.run.smithi106.stdout:(51/146): python3-logutils-0.3.5-11.el8.noarch. 1.2 MB/s | 49 kB 00:00 2024-05-10T03:29:35.297 INFO:teuthology.orchestra.run.smithi106.stdout:(52/146): python3-more-itertools-7.2.0-3.el8.no 1.4 MB/s | 59 kB 00:00 2024-05-10T03:29:35.324 INFO:teuthology.orchestra.run.smithi045.stdout:(19/146): librgw2-18.2.2-1330.g50174015.el8.x86 6.7 MB/s | 7.2 MB 00:01 2024-05-10T03:29:35.330 INFO:teuthology.orchestra.run.smithi106.stdout:(53/146): python3-kubernetes-11.0.0-6.el8.noarc 8.7 MB/s | 1.2 MB 00:00 2024-05-10T03:29:35.349 INFO:teuthology.orchestra.run.smithi045.stdout:(20/146): python3-ceph-common-18.2.2-1330.g5017 773 kB/s | 129 kB 00:00 2024-05-10T03:29:35.356 INFO:teuthology.orchestra.run.smithi106.stdout:(54/146): python3-natsort-7.1.1-2.el8.noarch.rp 1.0 MB/s | 60 kB 00:00 2024-05-10T03:29:35.374 INFO:teuthology.orchestra.run.smithi045.stdout:(21/146): python3-cephfs-18.2.2-1330.g50174015. 3.8 MB/s | 197 kB 00:00 2024-05-10T03:29:35.381 INFO:teuthology.orchestra.run.smithi106.stdout:(55/146): python3-pecan-1.3.2-9.el8.noarch.rpm 5.5 MB/s | 283 kB 00:00 2024-05-10T03:29:35.425 INFO:teuthology.orchestra.run.smithi045.stdout:(22/146): python3-rados-18.2.2-1330.g50174015.e 4.8 MB/s | 371 kB 00:00 2024-05-10T03:29:35.435 INFO:teuthology.orchestra.run.smithi106.stdout:(56/146): python3-portend-2.6-1.el8.noarch.rpm 198 kB/s | 16 kB 00:00 2024-05-10T03:29:35.465 INFO:teuthology.orchestra.run.smithi106.stdout:(57/146): python3-repoze-lru-0.7-6.el8.noarch.r 404 kB/s | 34 kB 00:00 2024-05-10T03:29:35.466 INFO:teuthology.orchestra.run.smithi154.stdout:(101/146): python3-scipy-1.0.0-21.module+el8.9. 24 MB/s | 14 MB 00:00 2024-05-10T03:29:35.475 INFO:teuthology.orchestra.run.smithi045.stdout:(23/146): python3-rbd-18.2.2-1330.g50174015.el8 3.6 MB/s | 364 kB 00:00 2024-05-10T03:29:35.490 INFO:teuthology.orchestra.run.smithi106.stdout:(58/146): python3-routes-2.4.1-12.el8.noarch.rp 3.5 MB/s | 196 kB 00:00 2024-05-10T03:29:35.491 INFO:teuthology.orchestra.run.smithi154.stdout:(102/146): python3-packaging-16.8-9.el8.noarch. 199 kB/s | 48 kB 00:00 2024-05-10T03:29:35.500 INFO:teuthology.orchestra.run.smithi045.stdout:(24/146): python3-rgw-18.2.2-1330.g50174015.el8 1.4 MB/s | 107 kB 00:00 2024-05-10T03:29:35.526 INFO:teuthology.orchestra.run.smithi045.stdout:(25/146): rbd-fuse-18.2.2-1330.g50174015.el8.x8 1.8 MB/s | 91 kB 00:00 2024-05-10T03:29:35.534 INFO:teuthology.orchestra.run.smithi106.stdout:(59/146): python3-simplegeneric-0.8.1-17.el8.no 451 kB/s | 19 kB 00:00 2024-05-10T03:29:35.574 INFO:teuthology.orchestra.run.smithi106.stdout:(60/146): python3-singledispatch-3.4.0.3-18.el8 577 kB/s | 24 kB 00:00 2024-05-10T03:29:35.590 INFO:teuthology.orchestra.run.smithi154.stdout:(103/146): libverto-devel-0.3.0-5.el8.x86_64.rp 145 kB/s | 18 kB 00:00 2024-05-10T03:29:35.616 INFO:teuthology.orchestra.run.smithi106.stdout:(61/146): python3-tempora-1.14.1-5.el8.noarch.r 703 kB/s | 29 kB 00:00 2024-05-10T03:29:35.617 INFO:teuthology.orchestra.run.smithi045.stdout:(26/146): rbd-nbd-18.2.2-1330.g50174015.el8.x86 1.9 MB/s | 179 kB 00:00 2024-05-10T03:29:35.626 INFO:teuthology.orchestra.run.smithi154.stdout:(104/146): python3-jwt-1.6.1-2.el8.noarch.rpm 319 kB/s | 43 kB 00:00 2024-05-10T03:29:35.658 INFO:teuthology.orchestra.run.smithi106.stdout:(62/146): python3-trustme-0.6.0-4.el8.noarch.rp 663 kB/s | 27 kB 00:00 2024-05-10T03:29:35.659 INFO:teuthology.orchestra.run.smithi045.stdout:(27/146): ceph-grafana-dashboards-18.2.2-1330.g 584 kB/s | 24 kB 00:00 2024-05-10T03:29:35.701 INFO:teuthology.orchestra.run.smithi154.stdout:(105/146): postgresql-server-10.23-4.module+el8 10 MB/s | 5.1 MB 00:00 2024-05-10T03:29:35.717 INFO:teuthology.orchestra.run.smithi106.stdout:(63/146): python3-waitress-1.4.3-1.el8.noarch.r 4.3 MB/s | 255 kB 00:00 2024-05-10T03:29:35.726 INFO:teuthology.orchestra.run.smithi154.stdout:(106/146): python3-oauthlib-2.1.0-1.el8.noarch. 1.1 MB/s | 155 kB 00:00 2024-05-10T03:29:35.727 INFO:teuthology.orchestra.run.smithi045.stdout:(28/146): ceph-mgr-cephadm-18.2.2-1330.g5017401 2.0 MB/s | 138 kB 00:00 2024-05-10T03:29:35.751 INFO:teuthology.orchestra.run.smithi154.stdout:(107/146): python3-pycparser-2.14-14.el8.noarch 869 kB/s | 109 kB 00:00 2024-05-10T03:29:35.759 INFO:teuthology.orchestra.run.smithi106.stdout:(64/146): python3-rsa-4.9-2.el8.noarch.rpm 219 kB/s | 64 kB 00:00 2024-05-10T03:29:35.776 INFO:teuthology.orchestra.run.smithi106.stdout:(65/146): python3-webob-1.8.5-1.el8.1.noarch.rp 4.2 MB/s | 251 kB 00:00 2024-05-10T03:29:35.785 INFO:teuthology.orchestra.run.smithi154.stdout:(108/146): python3-requests-oauthlib-1.0.0-1.el 509 kB/s | 43 kB 00:00 2024-05-10T03:29:35.801 INFO:teuthology.orchestra.run.smithi106.stdout:(66/146): python3-websocket-client-0.56.0-5.el8 1.4 MB/s | 61 kB 00:00 2024-05-10T03:29:35.818 INFO:teuthology.orchestra.run.smithi106.stdout:(67/146): python3-webtest-2.0.33-1.el8.noarch.r 2.0 MB/s | 85 kB 00:00 2024-05-10T03:29:35.894 INFO:teuthology.orchestra.run.smithi154.stdout:(109/146): libaio-devel-0.3.112-1.el8.x86_64.rp 112 kB/s | 19 kB 00:00 2024-05-10T03:29:35.901 INFO:teuthology.orchestra.run.smithi106.stdout:(68/146): ceph-mgr-diskprediction-local-18.2.2- 3.9 MB/s | 7.4 MB 00:01 2024-05-10T03:29:35.919 INFO:teuthology.orchestra.run.smithi154.stdout:(110/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 262 kB/s | 44 kB 00:00 2024-05-10T03:29:35.951 INFO:teuthology.orchestra.run.smithi106.stdout:(69/146): python3-zc-lockfile-2.0-2.el8.noarch. 153 kB/s | 23 kB 00:00 2024-05-10T03:29:35.969 INFO:teuthology.orchestra.run.smithi154.stdout:(111/146): pcre2-devel-10.32-2.el8.x86_64.rpm 3.2 MB/s | 605 kB 00:00 2024-05-10T03:29:35.986 INFO:teuthology.orchestra.run.smithi106.stdout:(70/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 834 kB/s | 70 kB 00:00 2024-05-10T03:29:36.003 INFO:teuthology.orchestra.run.smithi154.stdout:(112/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.1 MB/s | 229 kB 00:00 2024-05-10T03:29:36.052 INFO:teuthology.orchestra.run.smithi045.stdout:(29/146): rbd-mirror-18.2.2-1330.g50174015.el8. 6.0 MB/s | 3.3 MB 00:00 2024-05-10T03:29:36.052 INFO:teuthology.orchestra.run.smithi106.stdout:(71/146): thrift-0.13.0-2.el8.x86_64.rpm 7.4 MB/s | 1.7 MB 00:00 2024-05-10T03:29:36.053 INFO:teuthology.orchestra.run.smithi154.stdout:(113/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.6 MB/s | 220 kB 00:00 2024-05-10T03:29:36.078 INFO:teuthology.orchestra.run.smithi106.stdout:(72/146): python3-packaging-16.8-9.el8.noarch.r 380 kB/s | 48 kB 00:00 2024-05-10T03:29:36.103 INFO:teuthology.orchestra.run.smithi106.stdout:(73/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 160 kB/s | 18 kB 00:00 2024-05-10T03:29:36.146 INFO:teuthology.orchestra.run.smithi154.stdout:(114/146): keyutils-libs-devel-1.5.10-9.el8.x86 345 kB/s | 48 kB 00:00 2024-05-10T03:29:36.169 INFO:teuthology.orchestra.run.smithi045.stdout:(30/146): ceph-mgr-dashboard-18.2.2-1330.g50174 8.0 MB/s | 3.5 MB 00:00 2024-05-10T03:29:36.178 INFO:teuthology.orchestra.run.smithi154.stdout:(115/146): libsepol-devel-2.9-3.el8.x86_64.rpm 695 kB/s | 87 kB 00:00 2024-05-10T03:29:36.204 INFO:teuthology.orchestra.run.smithi154.stdout:(116/146): libselinux-devel-2.9-5.el8.x86_64.rp 853 kB/s | 200 kB 00:00 2024-05-10T03:29:36.219 INFO:teuthology.orchestra.run.smithi045.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1330.g50 4.8 MB/s | 246 kB 00:00 2024-05-10T03:29:36.237 INFO:teuthology.orchestra.run.smithi106.stdout:(74/146): python3-oauthlib-2.1.0-1.el8.noarch.r 1.0 MB/s | 155 kB 00:00 2024-05-10T03:29:36.254 INFO:teuthology.orchestra.run.smithi106.stdout:(75/146): python3-jwt-1.6.1-2.el8.noarch.rpm 212 kB/s | 43 kB 00:00 2024-05-10T03:29:36.254 INFO:teuthology.orchestra.run.smithi154.stdout:(117/146): zlib-devel-1.2.11-18.el8_5.x86_64.rp 518 kB/s | 58 kB 00:00 2024-05-10T03:29:36.260 INFO:teuthology.orchestra.run.smithi045.stdout:(32/146): ceph-mgr-rook-18.2.2-1330.g50174015.e 1.2 MB/s | 49 kB 00:00 2024-05-10T03:29:36.270 INFO:teuthology.orchestra.run.smithi106.stdout:(76/146): python3-pycparser-2.14-14.el8.noarch. 653 kB/s | 109 kB 00:00 2024-05-10T03:29:36.288 INFO:teuthology.orchestra.run.smithi154.stdout:(118/146): libcom_err-devel-1.45.6-4.el8.x86_64 353 kB/s | 39 kB 00:00 2024-05-10T03:29:36.302 INFO:teuthology.orchestra.run.smithi045.stdout:(33/146): ceph-prometheus-alerts-18.2.2-1330.g5 393 kB/s | 16 kB 00:00 2024-05-10T03:29:36.313 INFO:teuthology.orchestra.run.smithi154.stdout:(119/146): fuse-2.9.7-17.el8.x86_64.rpm 760 kB/s | 83 kB 00:00 2024-05-10T03:29:36.361 INFO:teuthology.orchestra.run.smithi045.stdout:(34/146): ceph-volume-18.2.2-1330.g50174015.el8 4.4 MB/s | 263 kB 00:00 2024-05-10T03:29:36.371 INFO:teuthology.orchestra.run.smithi106.stdout:(77/146): python3-requests-oauthlib-1.0.0-1.el8 319 kB/s | 43 kB 00:00 2024-05-10T03:29:36.388 INFO:teuthology.orchestra.run.smithi106.stdout:(78/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 140 kB/s | 19 kB 00:00 2024-05-10T03:29:36.405 INFO:teuthology.orchestra.run.smithi106.stdout:(79/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 328 kB/s | 44 kB 00:00 2024-05-10T03:29:36.428 INFO:teuthology.orchestra.run.smithi045.stdout:(35/146): cephadm-18.2.2-1330.g50174015.el8.noa 2.5 MB/s | 173 kB 00:00 2024-05-10T03:29:36.455 INFO:teuthology.orchestra.run.smithi154.stdout:(120/146): libgfortran-8.5.0-20.el8.x86_64.rpm 3.1 MB/s | 645 kB 00:00 2024-05-10T03:29:36.479 INFO:teuthology.orchestra.run.smithi045.stdout:(36/146): cephfs-top-18.2.2-1330.g50174015.el8. 362 kB/s | 18 kB 00:00 2024-05-10T03:29:36.480 INFO:teuthology.orchestra.run.smithi154.stdout:(121/146): libquadmath-8.5.0-20.el8.x86_64.rpm 898 kB/s | 172 kB 00:00 2024-05-10T03:29:36.488 INFO:teuthology.orchestra.run.smithi106.stdout:(80/146): pcre2-devel-10.32-2.el8.x86_64.rpm 5.0 MB/s | 605 kB 00:00 2024-05-10T03:29:36.514 INFO:teuthology.orchestra.run.smithi106.stdout:(81/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2024-05-10T03:29:36.547 INFO:teuthology.orchestra.run.smithi106.stdout:(82/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.4 MB/s | 229 kB 00:00 2024-05-10T03:29:36.564 INFO:teuthology.orchestra.run.smithi154.stdout:(122/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 950 kB/s | 238 kB 00:00 2024-05-10T03:29:36.606 INFO:teuthology.orchestra.run.smithi154.stdout:(123/146): elfutils-libelf-devel-0.189-3.el8.x8 492 kB/s | 62 kB 00:00 2024-05-10T03:29:36.639 INFO:teuthology.orchestra.run.smithi154.stdout:(124/146): xfsprogs-devel-5.0.0-12.el8.x86_64.r 394 kB/s | 73 kB 00:00 2024-05-10T03:29:36.672 INFO:teuthology.orchestra.run.smithi106.stdout:(83/146): keyutils-libs-devel-1.5.10-9.el8.x86_ 303 kB/s | 48 kB 00:00 2024-05-10T03:29:36.722 INFO:teuthology.orchestra.run.smithi106.stdout:(84/146): libselinux-devel-2.9-5.el8.x86_64.rpm 858 kB/s | 200 kB 00:00 2024-05-10T03:29:36.748 INFO:teuthology.orchestra.run.smithi154.stdout:(125/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 435 kB/s | 47 kB 00:00 2024-05-10T03:29:36.756 INFO:teuthology.orchestra.run.smithi106.stdout:(85/146): libsepol-devel-2.9-3.el8.x86_64.rpm 417 kB/s | 87 kB 00:00 2024-05-10T03:29:36.782 INFO:teuthology.orchestra.run.smithi106.stdout:(86/146): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 530 kB/s | 58 kB 00:00 2024-05-10T03:29:36.798 INFO:teuthology.orchestra.run.smithi154.stdout:(126/146): krb5-devel-1.18.2-26.el8_9.x86_64.rp 2.3 MB/s | 562 kB 00:00 2024-05-10T03:29:36.865 INFO:teuthology.orchestra.run.smithi154.stdout:(127/146): python3-cryptography-3.2.1-7.el8_9.x 4.7 MB/s | 559 kB 00:00 2024-05-10T03:29:36.921 INFO:teuthology.orchestra.run.smithi045.stdout:(37/146): gperftools-libs-2.7-9.el8.x86_64.rpm 694 kB/s | 306 kB 00:00 2024-05-10T03:29:36.932 INFO:teuthology.orchestra.run.smithi106.stdout:(87/146): libgfortran-8.5.0-20.el8.x86_64.rpm 4.2 MB/s | 645 kB 00:00 2024-05-10T03:29:36.955 INFO:teuthology.orchestra.run.smithi154.stdout:(128/146): openssl-devel-1.1.1k-12.el8_9.x86_64 6.7 MB/s | 2.3 MB 00:00 2024-05-10T03:29:36.991 INFO:teuthology.orchestra.run.smithi154.stdout:(129/146): libuuid-devel-2.32.1-44.el8_9.1.x86_ 797 kB/s | 100 kB 00:00 2024-05-10T03:29:37.010 INFO:teuthology.orchestra.run.smithi106.stdout:(88/146): libcom_err-devel-1.45.6-4.el8.x86_64. 134 kB/s | 39 kB 00:00 2024-05-10T03:29:37.016 INFO:teuthology.orchestra.run.smithi154.stdout:(130/146): NetworkManager-initscripts-updown-1. 664 kB/s | 144 kB 00:00 2024-05-10T03:29:37.029 INFO:teuthology.orchestra.run.smithi045.stdout:(38/146): ceph-mgr-diskprediction-local-18.2.2- 7.6 MB/s | 7.4 MB 00:00 2024-05-10T03:29:37.041 INFO:teuthology.orchestra.run.smithi106.stdout:(89/146): fuse-2.9.7-17.el8.x86_64.rpm 292 kB/s | 83 kB 00:00 2024-05-10T03:29:37.055 INFO:teuthology.orchestra.run.smithi045.stdout:(39/146): liboath-2.6.2-3.el8.x86_64.rpm 441 kB/s | 59 kB 00:00 2024-05-10T03:29:37.066 INFO:teuthology.orchestra.run.smithi106.stdout:(90/146): libquadmath-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2024-05-10T03:29:37.149 INFO:teuthology.orchestra.run.smithi154.stdout:(131/146): elfutils-libelf-0.189-3.el8.x86_64.r 1.7 MB/s | 232 kB 00:00 2024-05-10T03:29:37.175 INFO:teuthology.orchestra.run.smithi106.stdout:(91/146): elfutils-libelf-devel-0.189-3.el8.x86 570 kB/s | 62 kB 00:00 2024-05-10T03:29:37.200 INFO:teuthology.orchestra.run.smithi106.stdout:(92/146): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 458 kB/s | 73 kB 00:00 2024-05-10T03:29:37.225 INFO:teuthology.orchestra.run.smithi106.stdout:(93/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.1 MB/s | 238 kB 00:00 2024-05-10T03:29:37.253 INFO:teuthology.orchestra.run.smithi045.stdout:(40/146): python3-asyncssh-2.7.0-2.el8.noarch.r 2.4 MB/s | 476 kB 00:00 2024-05-10T03:29:37.283 INFO:teuthology.orchestra.run.smithi154.stdout:(132/146): elfutils-libs-0.189-3.el8.x86_64.rpm 2.2 MB/s | 303 kB 00:00 2024-05-10T03:29:37.330 INFO:teuthology.orchestra.run.smithi045.stdout:(41/146): libunwind-1.3.1-3.el8.x86_64.rpm 250 kB/s | 75 kB 00:00 2024-05-10T03:29:37.333 INFO:teuthology.orchestra.run.smithi106.stdout:(94/146): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 3.5 MB/s | 562 kB 00:00 2024-05-10T03:29:37.355 INFO:teuthology.orchestra.run.smithi045.stdout:(42/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 426 kB/s | 44 kB 00:00 2024-05-10T03:29:37.384 INFO:teuthology.orchestra.run.smithi106.stdout:(95/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 297 kB/s | 47 kB 00:00 2024-05-10T03:29:37.417 INFO:teuthology.orchestra.run.smithi154.stdout:(133/146): librbd1-18.2.2-1330.g50174015.el8.x8 8.3 MB/s | 3.5 MB 00:00 2024-05-10T03:29:37.434 INFO:teuthology.orchestra.run.smithi106.stdout:(96/146): openssl-devel-1.1.1k-12.el8_9.x86_64. 9.9 MB/s | 2.3 MB 00:00 2024-05-10T03:29:37.456 INFO:teuthology.orchestra.run.smithi045.stdout:(43/146): python3-cachetools-3.1.1-4.el8.noarch 330 kB/s | 33 kB 00:00 2024-05-10T03:29:37.459 INFO:teuthology.orchestra.run.smithi154.stdout:(134/146): iproute-6.2.0-5.el8_9.x86_64.rpm 4.8 MB/s | 854 kB 00:00 2024-05-10T03:29:37.476 INFO:teuthology.orchestra.run.smithi106.stdout:(97/146): python3-cryptography-3.2.1-7.el8_9.x8 3.8 MB/s | 559 kB 00:00 2024-05-10T03:29:37.489 INFO:teuthology.orchestra.run.smithi045.stdout:(44/146): python3-beautifulsoup4-4.6.3-2.el8.1. 1.1 MB/s | 185 kB 00:00 2024-05-10T03:29:37.542 INFO:teuthology.orchestra.run.smithi154.stdout:(135/146): librados2-18.2.2-1330.g50174015.el8. 6.0 MB/s | 3.5 MB 00:00 2024-05-10T03:29:37.551 INFO:teuthology.orchestra.run.smithi106.stdout:(98/146): libuuid-devel-2.32.1-44.el8_9.1.x86_6 854 kB/s | 100 kB 00:00 2024-05-10T03:29:37.556 INFO:teuthology.orchestra.run.smithi045.stdout:(45/146): python3-certifi-2018.10.15-7.el8.noar 163 kB/s | 16 kB 00:00 2024-05-10T03:29:37.576 INFO:teuthology.orchestra.run.smithi154.stdout:(136/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 4.4 MB/s | 711 kB 00:00 2024-05-10T03:29:37.577 INFO:teuthology.orchestra.run.smithi106.stdout:(99/146): python3-jsonpointer-1.10-11.el8.noarc 199 kB/s | 20 kB 00:00 2024-05-10T03:29:37.581 INFO:teuthology.orchestra.run.smithi045.stdout:(46/146): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2024-05-10T03:29:37.602 INFO:teuthology.orchestra.run.smithi106.stdout:(100/146): NetworkManager-initscripts-updown-1. 663 kB/s | 144 kB 00:00 2024-05-10T03:29:37.644 INFO:teuthology.orchestra.run.smithi106.stdout:(101/146): python3-prettytable-0.7.2-14.el8.noa 477 kB/s | 44 kB 00:00 2024-05-10T03:29:37.657 INFO:teuthology.orchestra.run.smithi045.stdout:(47/146): python3-cherrypy-18.4.0-1.el8.noarch. 3.7 MB/s | 384 kB 00:00 2024-05-10T03:29:37.682 INFO:teuthology.orchestra.run.smithi045.stdout:(48/146): python3-google-auth-1.1.1-10.el8.noar 811 kB/s | 81 kB 00:00 2024-05-10T03:29:37.694 INFO:teuthology.orchestra.run.smithi106.stdout:(102/146): python3-pyasn1-modules-0.3.7-6.el8.n 939 kB/s | 110 kB 00:00 2024-05-10T03:29:37.709 INFO:teuthology.orchestra.run.smithi154.stdout:(137/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 2.0 MB/s | 333 kB 00:00 2024-05-10T03:29:37.749 INFO:teuthology.orchestra.run.smithi045.stdout:(49/146): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2024-05-10T03:29:37.774 INFO:teuthology.orchestra.run.smithi045.stdout:(50/146): python3-jaraco-functools-2.0-4.el8.no 191 kB/s | 18 kB 00:00 2024-05-10T03:29:37.777 INFO:teuthology.orchestra.run.smithi154.stdout:(138/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 5.3 MB/s | 1.1 MB 00:00 2024-05-10T03:29:37.795 INFO:teuthology.orchestra.run.smithi106.stdout:(103/146): python3-jsonpatch-1.21-2.el8.noarch. 138 kB/s | 27 kB 00:00 2024-05-10T03:29:37.818 INFO:teuthology.orchestra.run.smithi154.stdout:(139/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 4.1 MB/s | 1.5 MB 00:00 2024-05-10T03:29:37.820 INFO:teuthology.orchestra.run.smithi106.stdout:(104/146): python3-pyasn1-0.3.7-6.el8.noarch.rp 719 kB/s | 126 kB 00:00 2024-05-10T03:29:37.854 INFO:teuthology.orchestra.run.smithi106.stdout:(105/146): python3-werkzeug-0.12.2-4.el8.noarch 2.8 MB/s | 457 kB 00:00 2024-05-10T03:29:37.875 INFO:teuthology.orchestra.run.smithi045.stdout:(51/146): python3-logutils-0.3.5-11.el8.noarch. 487 kB/s | 49 kB 00:00 2024-05-10T03:29:37.893 INFO:teuthology.orchestra.run.smithi154.stdout:(140/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.2 MB/s | 221 kB 00:00 2024-05-10T03:29:37.925 INFO:teuthology.orchestra.run.smithi045.stdout:(52/146): python3-kubernetes-11.0.0-6.el8.noarc 6.6 MB/s | 1.2 MB 00:00 2024-05-10T03:29:37.927 INFO:teuthology.orchestra.run.smithi154.stdout:(141/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 1.7 MB/s | 254 kB 00:00 2024-05-10T03:29:37.954 INFO:teuthology.orchestra.run.smithi106.stdout:(106/146): bison-3.0.4-10.el8.x86_64.rpm 4.2 MB/s | 688 kB 00:00 2024-05-10T03:29:37.967 INFO:teuthology.orchestra.run.smithi045.stdout:(53/146): python3-more-itertools-7.2.0-3.el8.no 639 kB/s | 59 kB 00:00 2024-05-10T03:29:37.977 INFO:teuthology.orchestra.run.smithi154.stdout:(142/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 1.5 MB/s | 237 kB 00:00 2024-05-10T03:29:37.991 INFO:teuthology.orchestra.run.smithi106.stdout:(107/146): libtool-2.4.6-25.el8.x86_64.rpm 5.2 MB/s | 709 kB 00:00 2024-05-10T03:29:38.018 INFO:teuthology.orchestra.run.smithi045.stdout:(54/146): python3-natsort-7.1.1-2.el8.noarch.rp 655 kB/s | 60 kB 00:00 2024-05-10T03:29:38.046 INFO:teuthology.orchestra.run.smithi106.stdout:(108/146): flex-2.6.1-9.el8.x86_64.rpm 1.4 MB/s | 320 kB 00:00 2024-05-10T03:29:38.078 INFO:teuthology.orchestra.run.smithi154.stdout:(143/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 978 kB/s | 180 kB 00:00 2024-05-10T03:29:38.088 INFO:teuthology.orchestra.run.smithi106.stdout:(109/146): python3-markupsafe-0.23-19.el8.x86_6 291 kB/s | 39 kB 00:00 2024-05-10T03:29:38.090 INFO:teuthology.orchestra.run.smithi045.stdout:(55/146): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2024-05-10T03:29:38.103 INFO:teuthology.orchestra.run.smithi154.stdout:(144/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 564 kB/s | 99 kB 00:00 2024-05-10T03:29:38.126 INFO:teuthology.orchestra.run.smithi045.stdout:(56/146): python3-portend-2.6-1.el8.noarch.rpm 143 kB/s | 16 kB 00:00 2024-05-10T03:29:38.147 INFO:teuthology.orchestra.run.smithi106.stdout:(110/146): uuid-1.6.2-43.el8.x86_64.rpm 638 kB/s | 64 kB 00:00 2024-05-10T03:29:38.170 INFO:teuthology.orchestra.run.smithi154.stdout:(145/146): util-linux-2.32.1-44.el8_9.1.x86_64. 13 MB/s | 2.5 MB 00:00 2024-05-10T03:29:38.185 INFO:teuthology.orchestra.run.smithi045.stdout:(57/146): python3-repoze-lru-0.7-6.el8.noarch.r 357 kB/s | 34 kB 00:00 2024-05-10T03:29:38.197 INFO:teuthology.orchestra.run.smithi106.stdout:(111/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.2 MB/s | 259 kB 00:00 2024-05-10T03:29:38.218 INFO:teuthology.orchestra.run.smithi045.stdout:(58/146): python3-routes-2.4.1-12.el8.noarch.rp 2.1 MB/s | 196 kB 00:00 2024-05-10T03:29:38.222 INFO:teuthology.orchestra.run.smithi106.stdout:(112/146): python3-pyOpenSSL-19.0.0-1.el8.noarc 773 kB/s | 103 kB 00:00 2024-05-10T03:29:38.253 INFO:teuthology.orchestra.run.smithi154.stdout:(146/146): util-linux-user-2.32.1-44.el8_9.1.x8 587 kB/s | 103 kB 00:00 2024-05-10T03:29:38.256 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-05-10T03:29:38.256 INFO:teuthology.orchestra.run.smithi154.stdout:Total 13 MB/s | 221 MB 00:17 2024-05-10T03:29:38.277 INFO:teuthology.orchestra.run.smithi045.stdout:(59/146): python3-rsa-4.9-2.el8.noarch.rpm 699 kB/s | 64 kB 00:00 2024-05-10T03:29:38.311 INFO:teuthology.orchestra.run.smithi045.stdout:(60/146): python3-simplegeneric-0.8.1-17.el8.no 203 kB/s | 19 kB 00:00 2024-05-10T03:29:38.347 INFO:teuthology.orchestra.run.smithi106.stdout:(113/146): python3-babel-2.5.1-7.el8.noarch.rpm 24 MB/s | 4.8 MB 00:00 2024-05-10T03:29:38.381 INFO:teuthology.orchestra.run.smithi106.stdout:(114/146): python3-jinja2-2.10.1-3.el8.noarch.r 2.9 MB/s | 538 kB 00:00 2024-05-10T03:29:38.394 INFO:teuthology.orchestra.run.smithi045.stdout:(61/146): python3-singledispatch-3.4.0.3-18.el8 204 kB/s | 24 kB 00:00 2024-05-10T03:29:38.420 INFO:teuthology.orchestra.run.smithi045.stdout:(62/146): python3-tempora-1.14.1-5.el8.noarch.r 269 kB/s | 29 kB 00:00 2024-05-10T03:29:38.473 INFO:teuthology.orchestra.run.smithi106.stdout:(115/146): python3-numpy-1.14.3-10.el8.x86_64.r 15 MB/s | 3.7 MB 00:00 2024-05-10T03:29:38.487 INFO:teuthology.orchestra.run.smithi045.stdout:(63/146): python3-trustme-0.6.0-4.el8.noarch.rp 298 kB/s | 27 kB 00:00 2024-05-10T03:29:38.498 INFO:teuthology.orchestra.run.smithi106.stdout:(116/146): python3-numpy-f2py-1.14.3-10.el8.x86 1.9 MB/s | 225 kB 00:00 2024-05-10T03:29:38.557 INFO:teuthology.orchestra.run.smithi106.stdout:(117/146): socat-1.7.4.1-1.el8.x86_64.rpm 1.5 MB/s | 323 kB 00:00 2024-05-10T03:29:38.632 INFO:teuthology.orchestra.run.smithi106.stdout:(118/146): librdkafka-0.11.4-3.el8.x86_64.rpm 2.2 MB/s | 354 kB 00:00 2024-05-10T03:29:38.732 INFO:teuthology.orchestra.run.smithi106.stdout:(119/146): openblas-threads-0.3.15-6.el8.x86_64 22 MB/s | 5.2 MB 00:00 2024-05-10T03:29:38.758 INFO:teuthology.orchestra.run.smithi106.stdout:(120/146): python3-mako-1.0.6-14.el8.noarch.rpm 783 kB/s | 157 kB 00:00 2024-05-10T03:29:38.908 INFO:teuthology.orchestra.run.smithi106.stdout:(121/146): openblas-0.3.15-6.el8.x86_64.rpm 18 MB/s | 5.0 MB 00:00 2024-05-10T03:29:38.942 INFO:teuthology.orchestra.run.smithi106.stdout:(122/146): automake-1.16.1-8.el8.noarch.rpm 3.3 MB/s | 714 kB 00:00 2024-05-10T03:29:38.967 INFO:teuthology.orchestra.run.smithi106.stdout:(123/146): libpq-13.11-1.el8.x86_64.rpm 948 kB/s | 198 kB 00:00 2024-05-10T03:29:39.004 INFO:teuthology.orchestra.run.smithi045.stdout:(64/146): ceph-test-18.2.2-1330.g50174015.el8.x 8.3 MB/s | 49 MB 00:05 2024-05-10T03:29:39.029 INFO:teuthology.orchestra.run.smithi045.stdout:(65/146): python3-waitress-1.4.3-1.el8.noarch.r 419 kB/s | 255 kB 00:00 2024-05-10T03:29:39.054 INFO:teuthology.orchestra.run.smithi045.stdout:(66/146): python3-webob-1.8.5-1.el8.1.noarch.rp 443 kB/s | 251 kB 00:00 2024-05-10T03:29:39.056 INFO:teuthology.orchestra.run.smithi106.stdout:(124/146): jq-1.6-7.el8.x86_64.rpm 1.3 MB/s | 202 kB 00:00 2024-05-10T03:29:39.177 INFO:teuthology.orchestra.run.smithi106.stdout:(125/146): python3-pytz-2017.2-11.el8.noarch.rp 230 kB/s | 54 kB 00:00 2024-05-10T03:29:39.188 INFO:teuthology.orchestra.run.smithi045.stdout:(67/146): python3-webtest-2.0.33-1.el8.noarch.r 539 kB/s | 85 kB 00:00 2024-05-10T03:29:39.213 INFO:teuthology.orchestra.run.smithi045.stdout:(68/146): python3-zc-lockfile-2.0-2.el8.noarch. 144 kB/s | 23 kB 00:00 2024-05-10T03:29:39.234 INFO:teuthology.orchestra.run.smithi106.stdout:(126/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.0 MB/s | 188 kB 00:00 2024-05-10T03:29:39.264 INFO:teuthology.orchestra.run.smithi045.stdout:(69/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2024-05-10T03:29:39.314 INFO:teuthology.orchestra.run.smithi045.stdout:(70/146): python3-websocket-client-0.56.0-5.el8 198 kB/s | 61 kB 00:00 2024-05-10T03:29:39.316 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-05-10T03:29:39.351 INFO:teuthology.orchestra.run.smithi106.stdout:(127/146): postgresql-10.23-4.module+el8.9.0+21 8.7 MB/s | 1.5 MB 00:00 2024-05-10T03:29:39.393 INFO:teuthology.orchestra.run.smithi106.stdout:(128/146): postgresql-contrib-10.23-4.module+el 5.0 MB/s | 812 kB 00:00 2024-05-10T03:29:39.414 INFO:teuthology.orchestra.run.smithi045.stdout:(71/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 119 kB/s | 18 kB 00:00 2024-05-10T03:29:39.448 INFO:teuthology.orchestra.run.smithi045.stdout:(72/146): python3-jwt-1.6.1-2.el8.noarch.rpm 319 kB/s | 43 kB 00:00 2024-05-10T03:29:39.556 INFO:teuthology.orchestra.run.smithi045.stdout:(73/146): thrift-0.13.0-2.el8.x86_64.rpm 4.7 MB/s | 1.7 MB 00:00 2024-05-10T03:29:39.574 INFO:teuthology.orchestra.run.smithi045.stdout:(74/146): python3-oauthlib-2.1.0-1.el8.noarch.r 975 kB/s | 155 kB 00:00 2024-05-10T03:29:39.599 INFO:teuthology.orchestra.run.smithi045.stdout:(75/146): python3-pycparser-2.14-14.el8.noarch. 724 kB/s | 109 kB 00:00 2024-05-10T03:29:39.635 INFO:teuthology.orchestra.run.smithi106.stdout:(129/146): python3-scipy-1.0.0-21.module+el8.9. 21 MB/s | 14 MB 00:00 2024-05-10T03:29:39.691 INFO:teuthology.orchestra.run.smithi045.stdout:(76/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 160 kB/s | 19 kB 00:00 2024-05-10T03:29:39.714 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-05-10T03:29:39.714 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-05-10T03:29:39.752 INFO:teuthology.orchestra.run.smithi106.stdout:(130/146): postgresql-server-10.23-4.module+el8 13 MB/s | 5.1 MB 00:00 2024-05-10T03:29:39.758 INFO:teuthology.orchestra.run.smithi045.stdout:(77/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 292 kB/s | 44 kB 00:00 2024-05-10T03:29:39.825 INFO:teuthology.orchestra.run.smithi045.stdout:(78/146): python3-requests-oauthlib-1.0.0-1.el8 159 kB/s | 43 kB 00:00 2024-05-10T03:29:39.858 INFO:teuthology.orchestra.run.smithi045.stdout:(79/146): pcre2-devel-10.32-2.el8.x86_64.rpm 3.5 MB/s | 605 kB 00:00 2024-05-10T03:29:39.869 INFO:teuthology.orchestra.run.smithi106.stdout:(131/146): librados2-18.2.2-1330.g50174015.el8. 7.5 MB/s | 3.5 MB 00:00 2024-05-10T03:29:39.903 INFO:teuthology.orchestra.run.smithi106.stdout:(132/146): elfutils-libelf-0.189-3.el8.x86_64.r 1.5 MB/s | 232 kB 00:00 2024-05-10T03:29:39.942 INFO:teuthology.orchestra.run.smithi045.stdout:(80/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.2 MB/s | 229 kB 00:00 2024-05-10T03:29:39.978 INFO:teuthology.orchestra.run.smithi106.stdout:(133/146): elfutils-libs-0.189-3.el8.x86_64.rpm 2.7 MB/s | 303 kB 00:00 2024-05-10T03:29:39.984 INFO:teuthology.orchestra.run.smithi045.stdout:(81/146): libselinux-devel-2.9-5.el8.x86_64.rpm 1.6 MB/s | 200 kB 00:00 2024-05-10T03:29:40.017 INFO:teuthology.orchestra.run.smithi045.stdout:(82/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.1 MB/s | 220 kB 00:00 2024-05-10T03:29:40.037 INFO:teuthology.orchestra.run.smithi106.stdout:(134/146): iproute-6.2.0-5.el8_9.x86_64.rpm 6.2 MB/s | 854 kB 00:00 2024-05-10T03:29:40.042 INFO:teuthology.orchestra.run.smithi045.stdout:(83/146): libsepol-devel-2.9-3.el8.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2024-05-10T03:29:40.118 INFO:teuthology.orchestra.run.smithi045.stdout:(84/146): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 576 kB/s | 58 kB 00:00 2024-05-10T03:29:40.143 INFO:teuthology.orchestra.run.smithi045.stdout:(85/146): keyutils-libs-devel-1.5.10-9.el8.x86_ 239 kB/s | 48 kB 00:00 2024-05-10T03:29:40.168 INFO:teuthology.orchestra.run.smithi045.stdout:(86/146): libcom_err-devel-1.45.6-4.el8.x86_64. 307 kB/s | 39 kB 00:00 2024-05-10T03:29:40.187 INFO:teuthology.orchestra.run.smithi106.stdout:(135/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 3.3 MB/s | 711 kB 00:00 2024-05-10T03:29:40.221 INFO:teuthology.orchestra.run.smithi106.stdout:(136/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 8.0 MB/s | 1.5 MB 00:00 2024-05-10T03:29:40.244 INFO:teuthology.orchestra.run.smithi045.stdout:(87/146): fuse-2.9.7-17.el8.x86_64.rpm 663 kB/s | 83 kB 00:00 2024-05-10T03:29:40.311 INFO:teuthology.orchestra.run.smithi045.stdout:(88/146): libquadmath-8.5.0-20.el8.x86_64.rpm 1.2 MB/s | 172 kB 00:00 2024-05-10T03:29:40.321 INFO:teuthology.orchestra.run.smithi106.stdout:(137/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 2.4 MB/s | 333 kB 00:00 2024-05-10T03:29:40.385 INFO:teuthology.orchestra.run.smithi106.stdout:(138/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 6.5 MB/s | 1.1 MB 00:00 2024-05-10T03:29:40.386 INFO:teuthology.orchestra.run.smithi045.stdout:(89/146): libgfortran-8.5.0-20.el8.x86_64.rpm 2.6 MB/s | 645 kB 00:00 2024-05-10T03:29:40.411 INFO:teuthology.orchestra.run.smithi045.stdout:(90/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.4 MB/s | 238 kB 00:00 2024-05-10T03:29:40.436 INFO:teuthology.orchestra.run.smithi045.stdout:(91/146): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 578 kB/s | 73 kB 00:00 2024-05-10T03:29:40.446 INFO:teuthology.orchestra.run.smithi106.stdout:(139/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.7 MB/s | 221 kB 00:00 2024-05-10T03:29:40.497 INFO:teuthology.orchestra.run.smithi106.stdout:(140/146): librbd1-18.2.2-1330.g50174015.el8.x8 4.1 MB/s | 3.5 MB 00:00 2024-05-10T03:29:40.522 INFO:teuthology.orchestra.run.smithi106.stdout:(141/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 1.8 MB/s | 254 kB 00:00 2024-05-10T03:29:40.562 INFO:teuthology.orchestra.run.smithi045.stdout:(92/146): elfutils-libelf-devel-0.189-3.el8.x86 351 kB/s | 62 kB 00:00 2024-05-10T03:29:40.572 INFO:teuthology.orchestra.run.smithi106.stdout:(142/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 2.3 MB/s | 180 kB 00:00 2024-05-10T03:29:40.589 INFO:teuthology.orchestra.run.smithi106.stdout:(143/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 1.5 MB/s | 99 kB 00:00 2024-05-10T03:29:40.595 INFO:teuthology.orchestra.run.smithi045.stdout:(93/146): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 3.0 MB/s | 562 kB 00:00 2024-05-10T03:29:40.614 INFO:teuthology.orchestra.run.smithi106.stdout:(144/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 1.4 MB/s | 237 kB 00:00 2024-05-10T03:29:40.688 INFO:teuthology.orchestra.run.smithi045.stdout:(94/146): openssl-devel-1.1.1k-12.el8_9.x86_64. 9.3 MB/s | 2.3 MB 00:00 2024-05-10T03:29:40.713 INFO:teuthology.orchestra.run.smithi045.stdout:(95/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 313 kB/s | 47 kB 00:00 2024-05-10T03:29:40.715 INFO:teuthology.orchestra.run.smithi106.stdout:(145/146): util-linux-user-2.32.1-44.el8_9.1.x8 820 kB/s | 103 kB 00:00 2024-05-10T03:29:40.763 INFO:teuthology.orchestra.run.smithi045.stdout:(96/146): python3-cryptography-3.2.1-7.el8_9.x8 3.3 MB/s | 559 kB 00:00 2024-05-10T03:29:40.773 INFO:teuthology.orchestra.run.smithi106.stdout:(146/146): util-linux-2.32.1-44.el8_9.1.x86_64. 12 MB/s | 2.5 MB 00:00 2024-05-10T03:29:40.776 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-05-10T03:29:40.776 INFO:teuthology.orchestra.run.smithi106.stdout:Total 11 MB/s | 221 MB 00:19 2024-05-10T03:29:40.788 INFO:teuthology.orchestra.run.smithi045.stdout:(97/146): NetworkManager-initscripts-updown-1.4 1.4 MB/s | 144 kB 00:00 2024-05-10T03:29:40.855 INFO:teuthology.orchestra.run.smithi045.stdout:(98/146): libuuid-devel-2.32.1-44.el8_9.1.x86_6 703 kB/s | 100 kB 00:00 2024-05-10T03:29:40.939 INFO:teuthology.orchestra.run.smithi045.stdout:(99/146): python3-jsonpointer-1.10-11.el8.noarc 114 kB/s | 20 kB 00:00 2024-05-10T03:29:40.944 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-05-10T03:29:40.955 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-05-10T03:29:40.964 INFO:teuthology.orchestra.run.smithi045.stdout:(100/146): python3-prettytable-0.7.2-14.el8.noa 250 kB/s | 44 kB 00:00 2024-05-10T03:29:40.989 INFO:teuthology.orchestra.run.smithi045.stdout:(101/146): python3-pyasn1-modules-0.3.7-6.el8.n 822 kB/s | 110 kB 00:00 2024-05-10T03:29:41.056 INFO:teuthology.orchestra.run.smithi045.stdout:(102/146): python3-jsonpatch-1.21-2.el8.noarch. 226 kB/s | 27 kB 00:00 2024-05-10T03:29:41.081 INFO:teuthology.orchestra.run.smithi045.stdout:(103/146): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.1 MB/s | 126 kB 00:00 2024-05-10T03:29:41.132 INFO:teuthology.orchestra.run.smithi045.stdout:(104/146): python3-werkzeug-0.12.2-4.el8.noarch 3.1 MB/s | 457 kB 00:00 2024-05-10T03:29:41.215 INFO:teuthology.orchestra.run.smithi045.stdout:(105/146): bison-3.0.4-10.el8.x86_64.rpm 4.2 MB/s | 688 kB 00:00 2024-05-10T03:29:41.249 INFO:teuthology.orchestra.run.smithi045.stdout:(106/146): flex-2.6.1-9.el8.x86_64.rpm 1.9 MB/s | 320 kB 00:00 2024-05-10T03:29:41.299 INFO:teuthology.orchestra.run.smithi045.stdout:(107/146): libtool-2.4.6-25.el8.x86_64.rpm 4.1 MB/s | 709 kB 00:00 2024-05-10T03:29:41.324 INFO:teuthology.orchestra.run.smithi045.stdout:(108/146): python3-markupsafe-0.23-19.el8.x86_6 356 kB/s | 39 kB 00:00 2024-05-10T03:29:41.391 INFO:teuthology.orchestra.run.smithi045.stdout:(109/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.8 MB/s | 259 kB 00:00 2024-05-10T03:29:41.417 INFO:teuthology.orchestra.run.smithi045.stdout:(110/146): python3-pyOpenSSL-19.0.0-1.el8.noarc 1.1 MB/s | 103 kB 00:00 2024-05-10T03:29:41.477 INFO:teuthology.orchestra.run.smithi045.stdout:(111/146): uuid-1.6.2-43.el8.x86_64.rpm 360 kB/s | 64 kB 00:00 2024-05-10T03:29:41.551 INFO:teuthology.orchestra.run.smithi045.stdout:(112/146): python3-jinja2-2.10.1-3.el8.noarch.r 3.9 MB/s | 538 kB 00:00 2024-05-10T03:29:41.676 INFO:teuthology.orchestra.run.smithi045.stdout:(113/146): python3-numpy-1.14.3-10.el8.x86_64.r 19 MB/s | 3.7 MB 00:00 2024-05-10T03:29:41.776 INFO:teuthology.orchestra.run.smithi045.stdout:(114/146): python3-babel-2.5.1-7.el8.noarch.rpm 12 MB/s | 4.8 MB 00:00 2024-05-10T03:29:41.801 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-05-10T03:29:41.810 INFO:teuthology.orchestra.run.smithi045.stdout:(115/146): socat-1.7.4.1-1.el8.x86_64.rpm 1.2 MB/s | 323 kB 00:00 2024-05-10T03:29:41.835 INFO:teuthology.orchestra.run.smithi045.stdout:(116/146): python3-numpy-f2py-1.14.3-10.el8.x86 1.4 MB/s | 225 kB 00:00 2024-05-10T03:29:41.868 INFO:teuthology.orchestra.run.smithi045.stdout:(117/146): librdkafka-0.11.4-3.el8.x86_64.rpm 3.8 MB/s | 354 kB 00:00 2024-05-10T03:29:42.086 INFO:teuthology.orchestra.run.smithi045.stdout:(118/146): openblas-threads-0.3.15-6.el8.x86_64 19 MB/s | 5.2 MB 00:00 2024-05-10T03:29:42.103 INFO:teuthology.orchestra.run.smithi045.stdout:(119/146): python3-mako-1.0.6-14.el8.noarch.rpm 588 kB/s | 157 kB 00:00 2024-05-10T03:29:42.197 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-05-10T03:29:42.197 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-05-10T03:29:42.203 INFO:teuthology.orchestra.run.smithi045.stdout:(120/146): openblas-0.3.15-6.el8.x86_64.rpm 15 MB/s | 5.0 MB 00:00 2024-05-10T03:29:42.237 INFO:teuthology.orchestra.run.smithi045.stdout:(121/146): automake-1.16.1-8.el8.noarch.rpm 4.6 MB/s | 714 kB 00:00 2024-05-10T03:29:42.253 INFO:teuthology.orchestra.run.smithi045.stdout:(122/146): libpq-13.11-1.el8.x86_64.rpm 1.3 MB/s | 198 kB 00:00 2024-05-10T03:29:42.296 INFO:teuthology.orchestra.run.smithi045.stdout:(123/146): jq-1.6-7.el8.x86_64.rpm 2.1 MB/s | 202 kB 00:00 2024-05-10T03:29:42.438 INFO:teuthology.orchestra.run.smithi045.stdout:(124/146): python3-pytz-2017.2-11.el8.noarch.rp 270 kB/s | 54 kB 00:00 2024-05-10T03:29:42.463 INFO:teuthology.orchestra.run.smithi045.stdout:(125/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-05-10T03:29:42.671 INFO:teuthology.orchestra.run.smithi045.stdout:(126/146): python3-scipy-1.0.0-21.module+el8.9. 33 MB/s | 14 MB 00:00 2024-05-10T03:29:42.713 INFO:teuthology.orchestra.run.smithi045.stdout:(127/146): postgresql-contrib-10.23-4.module+el 3.2 MB/s | 812 kB 00:00 2024-05-10T03:29:42.764 INFO:teuthology.orchestra.run.smithi045.stdout:(128/146): postgresql-10.23-4.module+el8.9.0+21 4.6 MB/s | 1.5 MB 00:00 2024-05-10T03:29:42.864 INFO:teuthology.orchestra.run.smithi045.stdout:(129/146): python3-packaging-16.8-9.el8.noarch. 321 kB/s | 48 kB 00:00 2024-05-10T03:29:43.023 INFO:teuthology.orchestra.run.smithi045.stdout:(130/146): postgresql-server-10.23-4.module+el8 14 MB/s | 5.1 MB 00:00 2024-05-10T03:29:43.139 INFO:teuthology.orchestra.run.smithi045.stdout:(131/146): elfutils-libelf-0.189-3.el8.x86_64.r 1.9 MB/s | 232 kB 00:00 2024-05-10T03:29:43.281 INFO:teuthology.orchestra.run.smithi045.stdout:(132/146): librados2-18.2.2-1330.g50174015.el8. 6.9 MB/s | 3.5 MB 00:00 2024-05-10T03:29:43.315 INFO:teuthology.orchestra.run.smithi045.stdout:(133/146): elfutils-libs-0.189-3.el8.x86_64.rpm 1.7 MB/s | 303 kB 00:00 2024-05-10T03:29:43.365 INFO:teuthology.orchestra.run.smithi045.stdout:(134/146): librbd1-18.2.2-1330.g50174015.el8.x8 7.1 MB/s | 3.5 MB 00:00 2024-05-10T03:29:43.429 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-05-10T03:29:43.439 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-05-10T03:29:43.441 INFO:teuthology.orchestra.run.smithi045.stdout:(135/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 5.5 MB/s | 711 kB 00:00 2024-05-10T03:29:43.516 INFO:teuthology.orchestra.run.smithi045.stdout:(136/146): iproute-6.2.0-5.el8_9.x86_64.rpm 3.6 MB/s | 854 kB 00:00 2024-05-10T03:29:43.574 INFO:teuthology.orchestra.run.smithi045.stdout:(137/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 7.0 MB/s | 1.5 MB 00:00 2024-05-10T03:29:43.608 INFO:teuthology.orchestra.run.smithi045.stdout:(138/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 1.9 MB/s | 333 kB 00:00 2024-05-10T03:29:43.658 INFO:teuthology.orchestra.run.smithi045.stdout:(139/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 7.5 MB/s | 1.1 MB 00:00 2024-05-10T03:29:43.700 INFO:teuthology.orchestra.run.smithi045.stdout:(140/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.7 MB/s | 221 kB 00:00 2024-05-10T03:29:43.761 INFO:teuthology.orchestra.run.smithi045.stdout:(141/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 1.6 MB/s | 254 kB 00:00 2024-05-10T03:29:43.801 INFO:teuthology.orchestra.run.smithi045.stdout:(142/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 1.6 MB/s | 237 kB 00:00 2024-05-10T03:29:43.826 INFO:teuthology.orchestra.run.smithi045.stdout:(143/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 1.5 MB/s | 99 kB 00:00 2024-05-10T03:29:43.851 INFO:teuthology.orchestra.run.smithi045.stdout:(144/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.2 MB/s | 180 kB 00:00 2024-05-10T03:29:43.952 INFO:teuthology.orchestra.run.smithi045.stdout:(145/146): util-linux-user-2.32.1-44.el8_9.1.x8 821 kB/s | 103 kB 00:00 2024-05-10T03:29:44.040 INFO:teuthology.orchestra.run.smithi045.stdout:(146/146): util-linux-2.32.1-44.el8_9.1.x86_64. 10 MB/s | 2.5 MB 00:00 2024-05-10T03:29:44.043 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-05-10T03:29:44.043 INFO:teuthology.orchestra.run.smithi045.stdout:Total 12 MB/s | 221 MB 00:18 2024-05-10T03:29:45.217 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-05-10T03:29:45.666 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-05-10T03:29:45.666 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-05-10T03:29:47.002 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-05-10T03:29:47.014 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-05-10T03:29:47.113 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-05-10T03:29:47.247 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-05-10T03:29:47.501 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-10T03:29:47.718 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-10T03:29:47.921 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-05-10T03:29:48.142 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-10T03:29:48.221 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-10T03:29:48.426 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-10T03:29:48.499 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-10T03:29:48.749 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-05-10T03:29:48.967 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 6/162 2024-05-10T03:29:49.016 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 6/162 2024-05-10T03:29:49.253 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 7/162 2024-05-10T03:29:49.467 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-10T03:29:49.642 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-05-10T03:29:49.777 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-05-10T03:29:49.882 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-10T03:29:50.097 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-10T03:29:50.125 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librados2-2:18.2.2-1330.g50174015.el8.x86_64 9/162 2024-05-10T03:29:50.314 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-10T03:29:50.477 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-05-10T03:29:50.540 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:18.2.2-1330.g50174015.el8.x86_64 9/162 2024-05-10T03:29:50.673 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-10T03:29:50.709 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librbd1-2:18.2.2-1330.g50174015.el8.x86_64 10/162 2024-05-10T03:29:50.750 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-10T03:29:50.861 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:18.2.2-1330.g50174015.el8.x86_64 10/162 2024-05-10T03:29:50.956 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-10T03:29:51.011 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-10T03:29:51.042 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 11/162 2024-05-10T03:29:51.169 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 11/162 2024-05-10T03:29:51.236 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-05-10T03:29:51.446 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/162 2024-05-10T03:29:51.527 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 12/162 2024-05-10T03:29:51.648 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-10T03:29:51.727 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-10T03:29:51.808 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-10T03:29:51.886 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-10T03:29:51.931 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-10T03:29:52.239 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-05-10T03:29:52.341 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-10T03:29:52.546 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-05-10T03:29:52.564 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : librados2-2:18.2.2-1330.g50174015.el8.x86_64 9/162 2024-05-10T03:29:52.712 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-05-10T03:29:52.978 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librados2-2:18.2.2-1330.g50174015.el8.x86_64 9/162 2024-05-10T03:29:53.105 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-05-10T03:29:53.189 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : librbd1-2:18.2.2-1330.g50174015.el8.x86_64 10/162 2024-05-10T03:29:53.200 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-05-10T03:29:53.303 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librbd1-2:18.2.2-1330.g50174015.el8.x86_64 10/162 2024-05-10T03:29:53.349 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-05-10T03:29:53.374 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-05-10T03:29:53.523 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 11/162 2024-05-10T03:29:53.578 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 19/162 2024-05-10T03:29:53.624 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 11/162 2024-05-10T03:29:53.625 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-10T03:29:53.672 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 19/162 2024-05-10T03:29:53.841 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 20/162 2024-05-10T03:29:53.859 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-10T03:29:53.917 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 20/162 2024-05-10T03:29:53.967 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 12/162 2024-05-10T03:29:54.067 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-05-10T03:29:54.125 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/162 2024-05-10T03:29:54.255 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/162 2024-05-10T03:29:54.262 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-10T03:29:54.297 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-10T03:29:54.347 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-10T03:29:54.365 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-10T03:29:54.433 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/162 2024-05-10T03:29:54.512 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-10T03:29:54.583 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-10T03:29:54.595 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-05-10T03:29:54.784 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-05-10T03:29:54.884 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-05-10T03:29:54.956 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/162 2024-05-10T03:29:55.061 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/162 2024-05-10T03:29:55.146 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-10T03:29:55.244 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-10T03:29:55.392 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-05-10T03:29:55.437 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-10T03:29:55.614 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 23/162 2024-05-10T03:29:55.768 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-05-10T03:29:55.892 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-10T03:29:56.051 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-05-10T03:29:56.087 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librados2-2:18.2.2-1330.g50174015.el8.x86_64 9/162 2024-05-10T03:29:56.218 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 23/162 2024-05-10T03:29:56.272 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 19/162 2024-05-10T03:29:56.376 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 19/162 2024-05-10T03:29:56.442 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-0.3.15-6.el8.x86_64 24/162 2024-05-10T03:29:56.530 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 20/162 2024-05-10T03:29:56.566 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-2:18.2.2-1330.g50174015.el8.x86_64 9/162 2024-05-10T03:29:56.589 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 20/162 2024-05-10T03:29:56.746 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librbd1-2:18.2.2-1330.g50174015.el8.x86_64 10/162 2024-05-10T03:29:56.776 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/162 2024-05-10T03:29:56.889 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-2:18.2.2-1330.g50174015.el8.x86_64 10/162 2024-05-10T03:29:57.073 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/162 2024-05-10T03:29:57.087 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 11/162 2024-05-10T03:29:57.124 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 24/162 2024-05-10T03:29:57.191 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 11/162 2024-05-10T03:29:57.310 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/162 2024-05-10T03:29:57.405 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/162 2024-05-10T03:29:57.497 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-10T03:29:57.513 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 12/162 2024-05-10T03:29:57.596 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 26/162 2024-05-10T03:29:57.634 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-10T03:29:57.752 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/162 2024-05-10T03:29:57.795 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-10T03:29:57.805 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-10T03:29:58.031 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-10T03:29:58.033 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/162 2024-05-10T03:29:58.222 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-05-10T03:29:58.330 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 29/162 2024-05-10T03:29:58.419 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-10T03:29:58.527 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-05-10T03:29:58.600 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-05-10T03:29:58.678 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-10T03:29:58.751 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-05-10T03:29:58.772 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-common-2:18.2.2-1330.g50174015.el8. 31/162 2024-05-10T03:29:58.942 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-argparse-2:18.2.2-1330.g50174015.el 32/162 2024-05-10T03:29:59.189 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-05-10T03:29:59.234 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_6 33/162 2024-05-10T03:29:59.316 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-10T03:29:59.429 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-05-10T03:29:59.530 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/162 2024-05-10T03:29:59.601 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 19/162 2024-05-10T03:29:59.702 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 19/162 2024-05-10T03:29:59.853 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 20/162 2024-05-10T03:29:59.938 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 20/162 2024-05-10T03:30:00.151 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/162 2024-05-10T03:30:00.209 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 34/162 2024-05-10T03:30:00.213 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/162 2024-05-10T03:30:00.476 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/162 2024-05-10T03:30:00.494 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/162 2024-05-10T03:30:00.588 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 35/162 2024-05-10T03:30:00.719 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/162 2024-05-10T03:30:00.719 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/162 2024-05-10T03:30:00.836 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 36/162 2024-05-10T03:30:00.903 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-10T03:30:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-05-10T03:30:01.028 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/162 2024-05-10T03:30:01.052 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-10T03:30:01.211 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-ceph-common-2:18.2.2-1330.g50174015.el8. 31/162 2024-05-10T03:30:01.219 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-10T03:30:01.349 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-ceph-argparse-2:18.2.2-1330.g50174015.el 32/162 2024-05-10T03:30:01.653 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_6 33/162 2024-05-10T03:30:01.854 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-10T03:30:01.893 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-10T03:30:02.049 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-10T03:30:02.714 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-10T03:30:02.777 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/162 2024-05-10T03:30:02.869 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/162 2024-05-10T03:30:03.115 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 38/162 2024-05-10T03:30:03.359 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-05-10T03:30:03.616 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-10T03:30:03.627 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-05-10T03:30:03.643 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/162 2024-05-10T03:30:03.828 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 41/162 2024-05-10T03:30:03.918 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/162 2024-05-10T03:30:03.948 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 35/162 2024-05-10T03:30:04.022 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librados-devel-2:18.2.2-1330.g50174015.el8.x86_6 42/162 2024-05-10T03:30:04.127 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/162 2024-05-10T03:30:04.231 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-10T03:30:04.318 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-10T03:30:04.514 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-05-10T03:30:04.548 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-10T03:30:04.619 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-10T03:30:04.702 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-common-2:18.2.2-1330.g50174015.el8. 31/162 2024-05-10T03:30:04.833 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-argparse-2:18.2.2-1330.g50174015.el 32/162 2024-05-10T03:30:04.860 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-05-10T03:30:04.898 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/162 2024-05-10T03:30:05.116 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-05-10T03:30:05.119 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_6 33/162 2024-05-10T03:30:05.286 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/162 2024-05-10T03:30:05.348 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-10T03:30:05.350 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-10T03:30:05.547 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/162 2024-05-10T03:30:05.757 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-05-10T03:30:05.797 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-10T03:30:06.015 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-05-10T03:30:06.165 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-10T03:30:06.181 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-10T03:30:06.218 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 41/162 2024-05-10T03:30:06.351 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fuse-2.9.7-17.el8.x86_64 49/162 2024-05-10T03:30:06.429 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librados-devel-2:18.2.2-1330.g50174015.el8.x86_6 42/162 2024-05-10T03:30:06.594 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 50/162 2024-05-10T03:30:06.654 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-10T03:30:06.731 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-10T03:30:06.801 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 51/162 2024-05-10T03:30:06.962 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-10T03:30:06.975 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 52/162 2024-05-10T03:30:07.016 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-10T03:30:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 53/162 2024-05-10T03:30:07.275 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-05-10T03:30:07.313 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-10T03:30:07.515 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-05-10T03:30:07.536 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 54/162 2024-05-10T03:30:07.676 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 35/162 2024-05-10T03:30:07.754 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-10T03:30:07.828 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 55/162 2024-05-10T03:30:08.036 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 56/162 2024-05-10T03:30:08.221 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-10T03:30:08.227 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 57/162 2024-05-10T03:30:08.458 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 58/162 2024-05-10T03:30:08.563 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-10T03:30:08.591 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-10T03:30:08.730 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/162 2024-05-10T03:30:08.794 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 59/162 2024-05-10T03:30:08.829 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-05-10T03:30:08.955 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-05-10T03:30:09.083 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 60/162 2024-05-10T03:30:09.104 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/162 2024-05-10T03:30:09.238 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : jq-1.6-7.el8.x86_64 50/162 2024-05-10T03:30:09.317 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/162 2024-05-10T03:30:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 61/162 2024-05-10T03:30:09.504 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : automake-1.16.1-8.el8.noarch 51/162 2024-05-10T03:30:09.572 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-05-10T03:30:09.646 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 62/162 2024-05-10T03:30:09.737 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : uuid-1.6.2-43.el8.x86_64 52/162 2024-05-10T03:30:09.790 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 52/162 2024-05-10T03:30:09.869 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/162 2024-05-10T03:30:09.948 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-05-10T03:30:10.005 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/162 2024-05-10T03:30:10.102 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 64/162 2024-05-10T03:30:10.160 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 54/162 2024-05-10T03:30:10.168 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 41/162 2024-05-10T03:30:10.351 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 65/162 2024-05-10T03:30:10.370 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librados-devel-2:18.2.2-1330.g50174015.el8.x86_6 42/162 2024-05-10T03:30:10.379 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 55/162 2024-05-10T03:30:10.560 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-10T03:30:10.616 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : fuse-2.9.7-17.el8.x86_64 56/162 2024-05-10T03:30:10.630 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 66/162 2024-05-10T03:30:10.637 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-10T03:30:10.866 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 67/162 2024-05-10T03:30:10.876 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-10T03:30:10.893 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 57/162 2024-05-10T03:30:10.932 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-10T03:30:11.117 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/162 2024-05-10T03:30:11.148 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 68/162 2024-05-10T03:30:11.186 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-05-10T03:30:11.332 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/162 2024-05-10T03:30:11.356 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-05-10T03:30:11.434 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 69/162 2024-05-10T03:30:11.551 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-10T03:30:11.574 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/162 2024-05-10T03:30:11.651 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-packaging-16.8-9.el8.noarch 70/162 2024-05-10T03:30:11.880 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 71/162 2024-05-10T03:30:11.907 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 61/162 2024-05-10T03:30:11.946 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 71/162 2024-05-10T03:30:12.043 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-10T03:30:12.183 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 62/162 2024-05-10T03:30:12.257 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : jq-1.6-7.el8.x86_64 72/162 2024-05-10T03:30:12.344 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-10T03:30:12.376 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-10T03:30:12.425 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 63/162 2024-05-10T03:30:12.539 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : automake-1.16.1-8.el8.noarch 73/162 2024-05-10T03:30:12.599 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-packaging-16.8-9.el8.noarch 49/162 2024-05-10T03:30:12.615 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 64/162 2024-05-10T03:30:12.755 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : uuid-1.6.2-43.el8.x86_64 74/162 2024-05-10T03:30:12.793 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 50/162 2024-05-10T03:30:12.831 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 65/162 2024-05-10T03:30:12.832 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 74/162 2024-05-10T03:30:12.879 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 50/162 2024-05-10T03:30:13.071 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 75/162 2024-05-10T03:30:13.112 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : jq-1.6-7.el8.x86_64 51/162 2024-05-10T03:30:13.203 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 66/162 2024-05-10T03:30:13.304 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 76/162 2024-05-10T03:30:13.371 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : automake-1.16.1-8.el8.noarch 52/162 2024-05-10T03:30:13.498 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 77/162 2024-05-10T03:30:13.506 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 67/162 2024-05-10T03:30:13.526 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : uuid-1.6.2-43.el8.x86_64 53/162 2024-05-10T03:30:13.627 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 53/162 2024-05-10T03:30:13.697 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-05-10T03:30:13.811 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 68/162 2024-05-10T03:30:13.854 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 54/162 2024-05-10T03:30:13.902 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-05-10T03:30:14.036 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 69/162 2024-05-10T03:30:14.060 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 55/162 2024-05-10T03:30:14.236 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-05-10T03:30:14.248 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 70/162 2024-05-10T03:30:14.254 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 56/162 2024-05-10T03:30:14.415 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : fuse-2.9.7-17.el8.x86_64 57/162 2024-05-10T03:30:14.486 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-05-10T03:30:14.498 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 71/162 2024-05-10T03:30:14.644 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 58/162 2024-05-10T03:30:14.709 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-05-10T03:30:14.766 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 72/162 2024-05-10T03:30:14.841 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 59/162 2024-05-10T03:30:14.874 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-05-10T03:30:14.998 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 60/162 2024-05-10T03:30:15.012 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 73/162 2024-05-10T03:30:15.132 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-05-10T03:30:15.207 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 61/162 2024-05-10T03:30:15.264 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 74/162 2024-05-10T03:30:15.384 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-05-10T03:30:15.459 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 75/162 2024-05-10T03:30:15.520 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 62/162 2024-05-10T03:30:15.640 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-05-10T03:30:15.746 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 76/162 2024-05-10T03:30:15.822 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 63/162 2024-05-10T03:30:15.857 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-05-10T03:30:15.921 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/162 2024-05-10T03:30:16.018 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-05-10T03:30:16.040 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 64/162 2024-05-10T03:30:16.136 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-05-10T03:30:16.245 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 65/162 2024-05-10T03:30:16.275 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-05-10T03:30:16.365 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-05-10T03:30:16.445 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 66/162 2024-05-10T03:30:16.533 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-05-10T03:30:16.666 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-05-10T03:30:16.718 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-05-10T03:30:16.811 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 67/162 2024-05-10T03:30:16.926 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-05-10T03:30:16.967 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-05-10T03:30:17.109 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 68/162 2024-05-10T03:30:17.124 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-05-10T03:30:17.262 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-05-10T03:30:17.322 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-05-10T03:30:17.388 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 69/162 2024-05-10T03:30:17.445 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-05-10T03:30:17.509 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-05-10T03:30:17.611 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 70/162 2024-05-10T03:30:17.712 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-05-10T03:30:17.749 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-05-10T03:30:17.801 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 71/162 2024-05-10T03:30:18.005 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-05-10T03:30:18.068 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 72/162 2024-05-10T03:30:18.214 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-05-10T03:30:18.336 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 73/162 2024-05-10T03:30:18.400 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-05-10T03:30:18.570 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 74/162 2024-05-10T03:30:18.656 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-05-10T03:30:18.782 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 75/162 2024-05-10T03:30:18.839 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-05-10T03:30:18.882 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-05-10T03:30:18.974 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 76/162 2024-05-10T03:30:19.033 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-05-10T03:30:19.190 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-05-10T03:30:19.254 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 77/162 2024-05-10T03:30:19.315 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-05-10T03:30:19.427 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-05-10T03:30:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-05-10T03:30:19.600 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-05-10T03:30:19.602 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-05-10T03:30:19.696 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-05-10T03:30:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-05-10T03:30:19.898 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-05-10T03:30:19.971 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-05-10T03:30:20.060 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-05-10T03:30:20.178 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-05-10T03:30:20.184 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-05-10T03:30:20.330 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-05-10T03:30:20.505 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-05-10T03:30:21.121 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-05-10T03:30:21.153 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-05-10T03:30:21.164 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-05-10T03:30:21.349 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-05-10T03:30:21.482 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-05-10T03:30:21.579 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-05-10T03:30:21.669 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-05-10T03:30:21.770 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-05-10T03:30:21.887 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librgw2-2:18.2.2-1330.g50174015.el8.x86_64 103/162 2024-05-10T03:30:21.948 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-05-10T03:30:21.954 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librgw2-2:18.2.2-1330.g50174015.el8.x86_64 103/162 2024-05-10T03:30:21.970 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-05-10T03:30:22.154 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 104/162 2024-05-10T03:30:22.185 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-05-10T03:30:22.244 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-05-10T03:30:22.397 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-05-10T03:30:22.477 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-05-10T03:30:22.581 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-05-10T03:30:22.880 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-05-10T03:30:23.117 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-05-10T03:30:23.284 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-05-10T03:30:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-05-10T03:30:23.537 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-05-10T03:30:23.619 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librgw2-2:18.2.2-1330.g50174015.el8.x86_64 103/162 2024-05-10T03:30:23.674 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librgw2-2:18.2.2-1330.g50174015.el8.x86_64 103/162 2024-05-10T03:30:23.886 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 104/162 2024-05-10T03:30:24.774 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-05-10T03:30:25.128 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-05-10T03:30:25.355 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-05-10T03:30:25.632 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-05-10T03:30:25.902 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-05-10T03:30:26.096 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-05-10T03:30:26.238 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/162 2024-05-10T03:30:26.503 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/162 2024-05-10T03:30:27.151 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/162 2024-05-10T03:30:27.553 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-05-10T03:30:27.699 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librgw2-2:18.2.2-1330.g50174015.el8.x86_64 103/162 2024-05-10T03:30:27.773 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librgw2-2:18.2.2-1330.g50174015.el8.x86_64 103/162 2024-05-10T03:30:27.863 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/162 2024-05-10T03:30:27.958 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 104/162 2024-05-10T03:30:28.160 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/162 2024-05-10T03:30:28.702 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 106/162 2024-05-10T03:30:28.786 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/162 2024-05-10T03:30:28.794 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 106/162 2024-05-10T03:30:28.952 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 107/162 2024-05-10T03:30:29.150 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 106/162 2024-05-10T03:30:29.235 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 106/162 2024-05-10T03:30:29.376 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 107/162 2024-05-10T03:30:32.480 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/162 2024-05-10T03:30:32.732 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/162 2024-05-10T03:30:33.430 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/162 2024-05-10T03:30:33.711 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 106/162 2024-05-10T03:30:33.838 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 106/162 2024-05-10T03:30:33.956 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 107/162 2024-05-10T03:30:48.481 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 107/162 2024-05-10T03:30:48.481 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /sys 2024-05-10T03:30:48.481 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /proc 2024-05-10T03:30:48.481 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /dev 2024-05-10T03:30:48.481 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /run 2024-05-10T03:30:48.481 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /mnt 2024-05-10T03:30:48.481 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /var/tmp 2024-05-10T03:30:48.481 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /home 2024-05-10T03:30:48.481 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /tmp 2024-05-10T03:30:48.482 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /dev 2024-05-10T03:30:48.482 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-10T03:30:48.873 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 108/162 2024-05-10T03:30:49.033 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 107/162 2024-05-10T03:30:49.034 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /sys 2024-05-10T03:30:49.034 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /proc 2024-05-10T03:30:49.034 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /dev 2024-05-10T03:30:49.034 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /run 2024-05-10T03:30:49.034 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /mnt 2024-05-10T03:30:49.034 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /var/tmp 2024-05-10T03:30:49.034 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /home 2024-05-10T03:30:49.034 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /tmp 2024-05-10T03:30:49.034 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /dev 2024-05-10T03:30:49.034 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T03:30:49.416 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 108/162 2024-05-10T03:30:50.600 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 108/162 2024-05-10T03:30:50.823 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 109/162 2024-05-10T03:30:51.043 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 109/162 2024-05-10T03:30:51.142 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 108/162 2024-05-10T03:30:51.215 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 110/162 2024-05-10T03:30:51.380 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 109/162 2024-05-10T03:30:51.599 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 109/162 2024-05-10T03:30:51.735 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 110/162 2024-05-10T03:30:51.790 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 110/162 2024-05-10T03:30:51.931 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 111/162 2024-05-10T03:30:51.948 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 111/162 2024-05-10T03:30:52.309 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 110/162 2024-05-10T03:30:52.507 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 111/162 2024-05-10T03:30:52.524 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 111/162 2024-05-10T03:30:53.747 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephadm-2:18.2.2-1330.g50174015.el8.noarch 112/162 2024-05-10T03:30:53.900 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephadm-2:18.2.2-1330.g50174015.el8.noarch 112/162 2024-05-10T03:30:54.062 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1330.g50174015.e 113/162 2024-05-10T03:30:54.254 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: cephadm-2:18.2.2-1330.g50174015.el8.noarch 112/162 2024-05-10T03:30:54.264 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1330.g50174015. 114/162 2024-05-10T03:30:54.433 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephadm-2:18.2.2-1330.g50174015.el8.noarch 112/162 2024-05-10T03:30:54.514 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 115/162 2024-05-10T03:30:54.587 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1330.g50174015.e 113/162 2024-05-10T03:30:54.783 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1330.g50174015. 114/162 2024-05-10T03:30:55.031 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 115/162 2024-05-10T03:30:55.545 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 115/162 2024-05-10T03:30:55.814 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 116/162 2024-05-10T03:30:56.061 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 115/162 2024-05-10T03:30:56.313 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 116/162 2024-05-10T03:30:56.455 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 107/162 2024-05-10T03:30:56.455 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /sys 2024-05-10T03:30:56.456 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /proc 2024-05-10T03:30:56.456 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /dev 2024-05-10T03:30:56.456 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /run 2024-05-10T03:30:56.456 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /mnt 2024-05-10T03:30:56.456 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /var/tmp 2024-05-10T03:30:56.456 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /home 2024-05-10T03:30:56.456 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /tmp 2024-05-10T03:30:56.456 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /dev 2024-05-10T03:30:56.456 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:30:56.782 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 116/162 2024-05-10T03:30:56.803 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 108/162 2024-05-10T03:30:56.947 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 117/162 2024-05-10T03:30:57.040 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 117/162 2024-05-10T03:30:57.280 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 116/162 2024-05-10T03:30:57.413 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el 118/162 2024-05-10T03:30:57.497 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 117/162 2024-05-10T03:30:57.564 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 119/162 2024-05-10T03:30:57.591 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 117/162 2024-05-10T03:30:57.602 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 119/162 2024-05-10T03:30:57.747 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 120/162 2024-05-10T03:30:57.758 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 120/162 2024-05-10T03:30:57.978 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el 118/162 2024-05-10T03:30:58.196 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 119/162 2024-05-10T03:30:58.235 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 119/162 2024-05-10T03:30:58.389 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 120/162 2024-05-10T03:30:58.401 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 120/162 2024-05-10T03:30:58.718 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 108/162 2024-05-10T03:30:58.915 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 109/162 2024-05-10T03:30:59.160 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 109/162 2024-05-10T03:30:59.278 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-2:18.2.2-1330.g50174015.el8.x86_64 121/162 2024-05-10T03:30:59.294 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 110/162 2024-05-10T03:30:59.472 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 122/162 2024-05-10T03:30:59.506 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 122/162 2024-05-10T03:30:59.688 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1330.g50174 123/162 2024-05-10T03:30:59.731 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1330.g50174 123/162 2024-05-10T03:30:59.870 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 110/162 2024-05-10T03:30:59.922 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 124/162 2024-05-10T03:31:00.044 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 111/162 2024-05-10T03:31:00.067 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 111/162 2024-05-10T03:31:00.108 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-2:18.2.2-1330.g50174015.el8.x86_64 121/162 2024-05-10T03:31:00.274 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 124/162 2024-05-10T03:31:00.354 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 122/162 2024-05-10T03:31:00.389 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 122/162 2024-05-10T03:31:00.488 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 125/162 2024-05-10T03:31:00.614 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1330.g50174 123/162 2024-05-10T03:31:00.657 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1330.g50174 123/162 2024-05-10T03:31:00.872 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 124/162 2024-05-10T03:31:01.225 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 124/162 2024-05-10T03:31:01.430 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 125/162 2024-05-10T03:31:02.254 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cephadm-2:18.2.2-1330.g50174015.el8.noarch 112/162 2024-05-10T03:31:02.393 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephadm-2:18.2.2-1330.g50174015.el8.noarch 112/162 2024-05-10T03:31:02.568 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1330.g50174015.e 113/162 2024-05-10T03:31:02.799 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1330.g50174015. 114/162 2024-05-10T03:31:03.043 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 115/162 2024-05-10T03:31:04.192 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 115/162 2024-05-10T03:31:04.389 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 116/162 2024-05-10T03:31:05.393 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 125/162 2024-05-10T03:31:05.465 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 116/162 2024-05-10T03:31:05.676 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 117/162 2024-05-10T03:31:05.786 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 117/162 2024-05-10T03:31:05.897 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 126/162 2024-05-10T03:31:06.187 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el 118/162 2024-05-10T03:31:06.247 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 127/162 2024-05-10T03:31:06.323 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 125/162 2024-05-10T03:31:06.331 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 119/162 2024-05-10T03:31:06.376 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 119/162 2024-05-10T03:31:06.470 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libtool-2.4.6-25.el8.x86_64 128/162 2024-05-10T03:31:06.526 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 120/162 2024-05-10T03:31:06.542 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 120/162 2024-05-10T03:31:07.153 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 128/162 2024-05-10T03:31:07.369 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 126/162 2024-05-10T03:31:07.500 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 129/162 2024-05-10T03:31:07.692 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 127/162 2024-05-10T03:31:07.779 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 130/162 2024-05-10T03:31:07.981 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 128/162 2024-05-10T03:31:08.050 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 131/162 2024-05-10T03:31:08.216 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-2:18.2.2-1330.g50174015.el8.x86_64 121/162 2024-05-10T03:31:08.255 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-05-10T03:31:08.366 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 129/162 2024-05-10T03:31:08.422 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 122/162 2024-05-10T03:31:08.463 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 122/162 2024-05-10T03:31:08.499 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-05-10T03:31:08.651 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1330.g50174 123/162 2024-05-10T03:31:08.701 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1330.g50174 123/162 2024-05-10T03:31:08.706 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 130/162 2024-05-10T03:31:08.713 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_ 134/162 2024-05-10T03:31:08.860 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 124/162 2024-05-10T03:31:08.954 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libtool-2.4.6-25.el8.x86_64 131/162 2024-05-10T03:31:08.968 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 131/162 2024-05-10T03:31:09.206 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-05-10T03:31:09.253 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 124/162 2024-05-10T03:31:09.418 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 125/162 2024-05-10T03:31:09.419 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-05-10T03:31:09.622 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_ 134/162 2024-05-10T03:31:11.000 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-10T03:31:11.311 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-10T03:31:11.351 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-10T03:31:11.800 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-05-10T03:31:11.885 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-10T03:31:12.213 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-10T03:31:12.252 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-10T03:31:12.263 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-05-10T03:31:12.489 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-05-10T03:31:12.658 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-05-10T03:31:12.678 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 139/162 2024-05-10T03:31:12.936 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 140/162 2024-05-10T03:31:13.083 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-05-10T03:31:13.241 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 141/162 2024-05-10T03:31:13.374 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-05-10T03:31:13.538 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-05-10T03:31:13.596 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 139/162 2024-05-10T03:31:13.735 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 143/162 2024-05-10T03:31:13.746 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 143/162 2024-05-10T03:31:13.845 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 140/162 2024-05-10T03:31:13.965 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 144/162 2024-05-10T03:31:14.148 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 141/162 2024-05-10T03:31:14.210 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flex-2.6.1-9.el8.x86_64 145/162 2024-05-10T03:31:14.292 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 145/162 2024-05-10T03:31:14.474 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-05-10T03:31:14.536 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : bison-3.0.4-10.el8.x86_64 146/162 2024-05-10T03:31:14.549 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 146/162 2024-05-10T03:31:14.720 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/162 2024-05-10T03:31:14.765 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-05-10T03:31:14.800 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/162 2024-05-10T03:31:14.850 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 125/162 2024-05-10T03:31:14.938 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-05-10T03:31:15.037 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/162 2024-05-10T03:31:15.051 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/162 2024-05-10T03:31:15.124 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-05-10T03:31:15.124 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-10T03:31:15.237 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-10T03:31:15.246 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-10T03:31:15.389 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-10T03:31:15.389 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-10T03:31:15.439 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 146/162 2024-05-10T03:31:15.648 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-05-10T03:31:15.656 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-10T03:31:15.656 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-10T03:31:15.880 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-05-10T03:31:15.959 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-10T03:31:15.968 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 126/162 2024-05-10T03:31:16.057 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-05-10T03:31:16.057 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-10T03:31:16.195 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-05-10T03:31:16.273 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 127/162 2024-05-10T03:31:16.355 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-05-10T03:31:16.423 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-10T03:31:16.423 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-10T03:31:16.576 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 128/162 2024-05-10T03:31:16.604 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-05-10T03:31:16.604 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-10T03:31:16.682 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-10T03:31:16.682 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-10T03:31:16.863 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-10T03:31:16.863 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-05-10T03:31:16.959 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-10T03:31:17.034 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 129/162 2024-05-10T03:31:17.121 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-05-10T03:31:17.121 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-10T03:31:17.222 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-05-10T03:31:17.360 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 130/162 2024-05-10T03:31:17.388 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-10T03:31:17.388 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-10T03:31:17.396 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-05-10T03:31:17.608 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libtool-2.4.6-25.el8.x86_64 131/162 2024-05-10T03:31:17.626 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 131/162 2024-05-10T03:31:17.637 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-10T03:31:17.637 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-10T03:31:17.646 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-05-10T03:31:17.646 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-10T03:31:17.822 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-05-10T03:31:17.897 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-10T03:31:17.897 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-05-10T03:31:17.912 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-10T03:31:18.036 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-05-10T03:31:18.164 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-05-10T03:31:18.164 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-10T03:31:18.226 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_ 134/162 2024-05-10T03:31:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-05-10T03:31:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-10T03:31:18.481 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-10T03:31:18.481 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-10T03:31:18.738 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-10T03:31:18.739 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-10T03:31:19.228 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-10T03:31:19.228 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-2:18.2.2-1330.g50174015.el8.x86_64 1/162 2024-05-10T03:31:19.228 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 2/162 2024-05-10T03:31:19.228 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 3/162 2024-05-10T03:31:19.228 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 4/162 2024-05-10T03:31:19.228 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1330.g50174 5/162 2024-05-10T03:31:19.228 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 6/162 2024-05-10T03:31:19.228 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 7/162 2024-05-10T03:31:19.229 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 8/162 2024-05-10T03:31:19.229 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 9/162 2024-05-10T03:31:19.229 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 10/162 2024-05-10T03:31:19.229 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 11/162 2024-05-10T03:31:19.229 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 12/162 2024-05-10T03:31:19.229 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 13/162 2024-05-10T03:31:19.229 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_ 14/162 2024-05-10T03:31:19.229 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 15/162 2024-05-10T03:31:19.229 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 16/162 2024-05-10T03:31:19.229 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados-devel-2:18.2.2-1330.g50174015.el8.x86_6 17/162 2024-05-10T03:31:19.229 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 18/162 2024-05-10T03:31:19.229 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librgw2-2:18.2.2-1330.g50174015.el8.x86_64 19/162 2024-05-10T03:31:19.229 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1330.g50174015.el 20/162 2024-05-10T03:31:19.230 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-common-2:18.2.2-1330.g50174015.el8. 21/162 2024-05-10T03:31:19.230 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_6 22/162 2024-05-10T03:31:19.230 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 23/162 2024-05-10T03:31:19.230 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 24/162 2024-05-10T03:31:19.230 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 25/162 2024-05-10T03:31:19.230 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 26/162 2024-05-10T03:31:19.230 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 27/162 2024-05-10T03:31:19.230 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 28/162 2024-05-10T03:31:19.230 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1330.g50174015. 29/162 2024-05-10T03:31:19.230 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 30/162 2024-05-10T03:31:19.230 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 31/162 2024-05-10T03:31:19.230 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 32/162 2024-05-10T03:31:19.246 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-10T03:31:19.246 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el 33/162 2024-05-10T03:31:19.246 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 34/162 2024-05-10T03:31:19.246 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1330.g50174015.e 35/162 2024-05-10T03:31:19.246 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 36/162 2024-05-10T03:31:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephadm-2:18.2.2-1330.g50174015.el8.noarch 37/162 2024-05-10T03:31:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 38/162 2024-05-10T03:31:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-05-10T03:31:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-05-10T03:31:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-05-10T03:31:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-05-10T03:31:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-05-10T03:31:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-05-10T03:31:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-05-10T03:31:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-05-10T03:31:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-05-10T03:31:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-05-10T03:31:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-05-10T03:31:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-05-10T03:31:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-05-10T03:31:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-05-10T03:31:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-05-10T03:31:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-05-10T03:31:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-05-10T03:31:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-05-10T03:31:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-05-10T03:31:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-05-10T03:31:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-05-10T03:31:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-05-10T03:31:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-05-10T03:31:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-05-10T03:31:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-05-10T03:31:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-05-10T03:31:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-05-10T03:31:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-05-10T03:31:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-05-10T03:31:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-05-10T03:31:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-05-10T03:31:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-05-10T03:31:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-05-10T03:31:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 72/162 2024-05-10T03:31:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/162 2024-05-10T03:31:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 74/162 2024-05-10T03:31:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 75/162 2024-05-10T03:31:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 76/162 2024-05-10T03:31:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/162 2024-05-10T03:31:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/162 2024-05-10T03:31:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flex-2.6.1-9.el8.x86_64 79/162 2024-05-10T03:31:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 80/162 2024-05-10T03:31:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 81/162 2024-05-10T03:31:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 82/162 2024-05-10T03:31:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 83/162 2024-05-10T03:31:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 84/162 2024-05-10T03:31:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 85/162 2024-05-10T03:31:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 86/162 2024-05-10T03:31:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/162 2024-05-10T03:31:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 88/162 2024-05-10T03:31:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/162 2024-05-10T03:31:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 90/162 2024-05-10T03:31:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 91/162 2024-05-10T03:31:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 92/162 2024-05-10T03:31:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 93/162 2024-05-10T03:31:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : automake-1.16.1-8.el8.noarch 94/162 2024-05-10T03:31:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libpq-13.11-1.el8.x86_64 95/162 2024-05-10T03:31:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : jq-1.6-7.el8.x86_64 96/162 2024-05-10T03:31:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 97/162 2024-05-10T03:31:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 98/162 2024-05-10T03:31:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 99/162 2024-05-10T03:31:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 100/162 2024-05-10T03:31:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 101/162 2024-05-10T03:31:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 102/162 2024-05-10T03:31:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 103/162 2024-05-10T03:31:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 104/162 2024-05-10T03:31:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/162 2024-05-10T03:31:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 106/162 2024-05-10T03:31:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 107/162 2024-05-10T03:31:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 108/162 2024-05-10T03:31:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 109/162 2024-05-10T03:31:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 110/162 2024-05-10T03:31:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 111/162 2024-05-10T03:31:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 112/162 2024-05-10T03:31:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 113/162 2024-05-10T03:31:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 114/162 2024-05-10T03:31:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 115/162 2024-05-10T03:31:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 116/162 2024-05-10T03:31:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 117/162 2024-05-10T03:31:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 118/162 2024-05-10T03:31:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 119/162 2024-05-10T03:31:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 120/162 2024-05-10T03:31:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 121/162 2024-05-10T03:31:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 122/162 2024-05-10T03:31:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 123/162 2024-05-10T03:31:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 124/162 2024-05-10T03:31:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 125/162 2024-05-10T03:31:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 126/162 2024-05-10T03:31:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 127/162 2024-05-10T03:31:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 128/162 2024-05-10T03:31:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 129/162 2024-05-10T03:31:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 130/162 2024-05-10T03:31:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:18.2.2-1330.g50174015.el8.x86_64 131/162 2024-05-10T03:31:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-05-10T03:31:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:18.2.2-1330.g50174015.el8.x86_64 133/162 2024-05-10T03:31:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-05-10T03:31:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-05-10T03:31:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-05-10T03:31:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-05-10T03:31:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-05-10T03:31:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-05-10T03:31:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-05-10T03:31:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-05-10T03:31:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-05-10T03:31:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-05-10T03:31:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-05-10T03:31:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-05-10T03:31:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-05-10T03:31:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-05-10T03:31:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-05-10T03:31:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-05-10T03:31:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-05-10T03:31:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-05-10T03:31:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-05-10T03:31:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-05-10T03:31:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-05-10T03:31:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-05-10T03:31:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-05-10T03:31:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-05-10T03:31:19.256 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-05-10T03:31:19.256 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-05-10T03:31:19.256 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-05-10T03:31:19.256 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-05-10T03:31:19.447 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-05-10T03:31:19.447 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-10T03:31:20.408 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-10T03:31:20.408 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-2:18.2.2-1330.g50174015.el8.x86_64 1/162 2024-05-10T03:31:20.408 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 2/162 2024-05-10T03:31:20.408 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 3/162 2024-05-10T03:31:20.408 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 4/162 2024-05-10T03:31:20.408 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1330.g50174 5/162 2024-05-10T03:31:20.408 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 6/162 2024-05-10T03:31:20.408 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 7/162 2024-05-10T03:31:20.408 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 8/162 2024-05-10T03:31:20.409 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 9/162 2024-05-10T03:31:20.409 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 10/162 2024-05-10T03:31:20.409 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 11/162 2024-05-10T03:31:20.409 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 12/162 2024-05-10T03:31:20.409 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 13/162 2024-05-10T03:31:20.409 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_ 14/162 2024-05-10T03:31:20.409 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 15/162 2024-05-10T03:31:20.409 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 16/162 2024-05-10T03:31:20.409 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados-devel-2:18.2.2-1330.g50174015.el8.x86_6 17/162 2024-05-10T03:31:20.409 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 18/162 2024-05-10T03:31:20.409 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librgw2-2:18.2.2-1330.g50174015.el8.x86_64 19/162 2024-05-10T03:31:20.409 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1330.g50174015.el 20/162 2024-05-10T03:31:20.409 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-ceph-common-2:18.2.2-1330.g50174015.el8. 21/162 2024-05-10T03:31:20.409 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_6 22/162 2024-05-10T03:31:20.410 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 23/162 2024-05-10T03:31:20.410 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 24/162 2024-05-10T03:31:20.410 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 25/162 2024-05-10T03:31:20.410 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 26/162 2024-05-10T03:31:20.410 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 27/162 2024-05-10T03:31:20.410 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 28/162 2024-05-10T03:31:20.422 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1330.g50174015. 29/162 2024-05-10T03:31:20.422 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 30/162 2024-05-10T03:31:20.423 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 31/162 2024-05-10T03:31:20.423 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 32/162 2024-05-10T03:31:20.423 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el 33/162 2024-05-10T03:31:20.423 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 34/162 2024-05-10T03:31:20.423 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1330.g50174015.e 35/162 2024-05-10T03:31:20.423 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 36/162 2024-05-10T03:31:20.423 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephadm-2:18.2.2-1330.g50174015.el8.noarch 37/162 2024-05-10T03:31:20.423 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 38/162 2024-05-10T03:31:20.423 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-05-10T03:31:20.423 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-05-10T03:31:20.423 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-05-10T03:31:20.423 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-05-10T03:31:20.424 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-05-10T03:31:20.424 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-05-10T03:31:20.424 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-05-10T03:31:20.424 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-05-10T03:31:20.424 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-05-10T03:31:20.424 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-05-10T03:31:20.424 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-05-10T03:31:20.424 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-05-10T03:31:20.424 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-05-10T03:31:20.424 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-05-10T03:31:20.424 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-05-10T03:31:20.424 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-05-10T03:31:20.424 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-05-10T03:31:20.425 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-05-10T03:31:20.425 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-05-10T03:31:20.425 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-05-10T03:31:20.425 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-05-10T03:31:20.425 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-05-10T03:31:20.425 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-05-10T03:31:20.425 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-05-10T03:31:20.425 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-05-10T03:31:20.425 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-05-10T03:31:20.425 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-05-10T03:31:20.425 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-05-10T03:31:20.425 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-05-10T03:31:20.425 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-05-10T03:31:20.425 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-05-10T03:31:20.426 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-05-10T03:31:20.426 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-05-10T03:31:20.426 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 72/162 2024-05-10T03:31:20.426 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 73/162 2024-05-10T03:31:20.426 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/162 2024-05-10T03:31:20.426 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/162 2024-05-10T03:31:20.426 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/162 2024-05-10T03:31:20.426 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/162 2024-05-10T03:31:20.426 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/162 2024-05-10T03:31:20.426 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/162 2024-05-10T03:31:20.426 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 80/162 2024-05-10T03:31:20.426 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 81/162 2024-05-10T03:31:20.426 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 82/162 2024-05-10T03:31:20.427 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 83/162 2024-05-10T03:31:20.427 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 84/162 2024-05-10T03:31:20.427 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 85/162 2024-05-10T03:31:20.427 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 86/162 2024-05-10T03:31:20.427 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 87/162 2024-05-10T03:31:20.427 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 88/162 2024-05-10T03:31:20.427 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 89/162 2024-05-10T03:31:20.427 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 90/162 2024-05-10T03:31:20.427 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 91/162 2024-05-10T03:31:20.427 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 92/162 2024-05-10T03:31:20.427 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 93/162 2024-05-10T03:31:20.427 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 94/162 2024-05-10T03:31:20.427 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 95/162 2024-05-10T03:31:20.427 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 96/162 2024-05-10T03:31:20.428 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 97/162 2024-05-10T03:31:20.428 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 98/162 2024-05-10T03:31:20.428 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 99/162 2024-05-10T03:31:20.428 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 100/162 2024-05-10T03:31:20.428 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 101/162 2024-05-10T03:31:20.428 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 102/162 2024-05-10T03:31:20.428 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 103/162 2024-05-10T03:31:20.428 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 104/162 2024-05-10T03:31:20.428 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 105/162 2024-05-10T03:31:20.428 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : bison-3.0.4-10.el8.x86_64 106/162 2024-05-10T03:31:20.428 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : flex-2.6.1-9.el8.x86_64 107/162 2024-05-10T03:31:20.428 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 108/162 2024-05-10T03:31:20.428 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 109/162 2024-05-10T03:31:20.428 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 110/162 2024-05-10T03:31:20.429 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 111/162 2024-05-10T03:31:20.429 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 112/162 2024-05-10T03:31:20.429 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 113/162 2024-05-10T03:31:20.429 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 114/162 2024-05-10T03:31:20.429 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 115/162 2024-05-10T03:31:20.429 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 116/162 2024-05-10T03:31:20.429 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 117/162 2024-05-10T03:31:20.429 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 118/162 2024-05-10T03:31:20.429 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 119/162 2024-05-10T03:31:20.429 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 120/162 2024-05-10T03:31:20.429 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 121/162 2024-05-10T03:31:20.429 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : automake-1.16.1-8.el8.noarch 122/162 2024-05-10T03:31:20.429 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libpq-13.11-1.el8.x86_64 123/162 2024-05-10T03:31:20.429 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : jq-1.6-7.el8.x86_64 124/162 2024-05-10T03:31:20.429 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 125/162 2024-05-10T03:31:20.430 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 126/162 2024-05-10T03:31:20.430 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 127/162 2024-05-10T03:31:20.430 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 128/162 2024-05-10T03:31:20.430 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 129/162 2024-05-10T03:31:20.430 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 130/162 2024-05-10T03:31:20.430 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados2-2:18.2.2-1330.g50174015.el8.x86_64 131/162 2024-05-10T03:31:20.430 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-05-10T03:31:20.430 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librbd1-2:18.2.2-1330.g50174015.el8.x86_64 133/162 2024-05-10T03:31:20.430 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-05-10T03:31:20.430 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-05-10T03:31:20.430 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-05-10T03:31:20.430 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-05-10T03:31:20.431 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-05-10T03:31:20.431 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-05-10T03:31:20.431 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-05-10T03:31:20.431 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-05-10T03:31:20.431 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-05-10T03:31:20.431 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-05-10T03:31:20.431 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-05-10T03:31:20.431 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-05-10T03:31:20.431 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-05-10T03:31:20.431 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-05-10T03:31:20.431 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-05-10T03:31:20.431 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-05-10T03:31:20.431 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-05-10T03:31:20.431 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-05-10T03:31:20.432 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-05-10T03:31:20.432 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-05-10T03:31:20.432 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-05-10T03:31:20.432 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-05-10T03:31:20.432 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-05-10T03:31:20.432 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-05-10T03:31:20.432 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-05-10T03:31:20.432 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-05-10T03:31:20.432 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-05-10T03:31:20.432 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-05-10T03:31:20.817 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-10T03:31:21.091 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-10T03:31:21.133 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-10T03:31:21.631 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-05-10T03:31:22.044 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-05-10T03:31:22.264 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-05-10T03:31:22.459 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 139/162 2024-05-10T03:31:22.685 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 140/162 2024-05-10T03:31:22.990 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 141/162 2024-05-10T03:31:23.299 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-05-10T03:31:23.507 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/162 2024-05-10T03:31:23.594 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/162 2024-05-10T03:31:23.799 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/162 2024-05-10T03:31:23.815 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/162 2024-05-10T03:31:23.957 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-10T03:31:23.969 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-10T03:31:24.143 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 146/162 2024-05-10T03:31:24.325 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-05-10T03:31:24.484 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-05-10T03:31:24.653 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-05-10T03:31:24.653 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-10T03:31:24.944 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-10T03:31:24.944 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-10T03:31:25.186 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-10T03:31:25.186 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-10T03:31:25.456 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-10T03:31:25.651 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-05-10T03:31:25.828 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-05-10T03:31:26.067 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-05-10T03:31:26.067 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-10T03:31:26.443 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-10T03:31:26.443 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-05-10T03:31:26.718 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-05-10T03:31:26.718 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-10T03:31:26.984 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-10T03:31:26.985 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-10T03:31:27.243 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-10T03:31:27.243 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-10T03:31:27.493 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-10T03:31:27.643 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-05-10T03:31:27.643 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-10T03:31:28.614 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-10T03:31:28.614 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-2:18.2.2-1330.g50174015.el8.x86_64 1/162 2024-05-10T03:31:28.615 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 2/162 2024-05-10T03:31:28.615 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 3/162 2024-05-10T03:31:28.615 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 4/162 2024-05-10T03:31:28.615 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1330.g50174 5/162 2024-05-10T03:31:28.615 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 6/162 2024-05-10T03:31:28.615 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 7/162 2024-05-10T03:31:28.615 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 8/162 2024-05-10T03:31:28.615 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 9/162 2024-05-10T03:31:28.615 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 10/162 2024-05-10T03:31:28.615 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 11/162 2024-05-10T03:31:28.615 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 12/162 2024-05-10T03:31:28.615 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 13/162 2024-05-10T03:31:28.615 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_ 14/162 2024-05-10T03:31:28.616 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 15/162 2024-05-10T03:31:28.616 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 16/162 2024-05-10T03:31:28.616 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados-devel-2:18.2.2-1330.g50174015.el8.x86_6 17/162 2024-05-10T03:31:28.616 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 18/162 2024-05-10T03:31:28.616 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librgw2-2:18.2.2-1330.g50174015.el8.x86_64 19/162 2024-05-10T03:31:28.616 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1330.g50174015.el 20/162 2024-05-10T03:31:28.616 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-common-2:18.2.2-1330.g50174015.el8. 21/162 2024-05-10T03:31:28.616 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_6 22/162 2024-05-10T03:31:28.616 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 23/162 2024-05-10T03:31:28.616 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 24/162 2024-05-10T03:31:28.616 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 25/162 2024-05-10T03:31:28.616 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 26/162 2024-05-10T03:31:28.616 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 27/162 2024-05-10T03:31:28.617 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 28/162 2024-05-10T03:31:28.617 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1330.g50174015. 29/162 2024-05-10T03:31:28.617 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 30/162 2024-05-10T03:31:28.629 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 31/162 2024-05-10T03:31:28.629 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 32/162 2024-05-10T03:31:28.629 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el 33/162 2024-05-10T03:31:28.629 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 34/162 2024-05-10T03:31:28.629 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1330.g50174015.e 35/162 2024-05-10T03:31:28.629 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 36/162 2024-05-10T03:31:28.630 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephadm-2:18.2.2-1330.g50174015.el8.noarch 37/162 2024-05-10T03:31:28.630 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 38/162 2024-05-10T03:31:28.630 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-05-10T03:31:28.630 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-05-10T03:31:28.630 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-05-10T03:31:28.630 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-05-10T03:31:28.630 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-05-10T03:31:28.630 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-05-10T03:31:28.630 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-05-10T03:31:28.630 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-05-10T03:31:28.630 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-05-10T03:31:28.630 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-05-10T03:31:28.630 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-05-10T03:31:28.631 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-05-10T03:31:28.631 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-05-10T03:31:28.631 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-05-10T03:31:28.631 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-05-10T03:31:28.631 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-05-10T03:31:28.631 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-05-10T03:31:28.631 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-05-10T03:31:28.631 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-05-10T03:31:28.631 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-05-10T03:31:28.631 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-05-10T03:31:28.631 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-05-10T03:31:28.631 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-05-10T03:31:28.631 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-05-10T03:31:28.632 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-05-10T03:31:28.632 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-05-10T03:31:28.632 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-05-10T03:31:28.632 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-05-10T03:31:28.632 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-05-10T03:31:28.632 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-05-10T03:31:28.632 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-05-10T03:31:28.632 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-05-10T03:31:28.632 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-05-10T03:31:28.632 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 72/162 2024-05-10T03:31:28.632 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/162 2024-05-10T03:31:28.632 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/162 2024-05-10T03:31:28.632 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 75/162 2024-05-10T03:31:28.632 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/162 2024-05-10T03:31:28.633 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 77/162 2024-05-10T03:31:28.633 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 78/162 2024-05-10T03:31:28.633 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 79/162 2024-05-10T03:31:28.633 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/162 2024-05-10T03:31:28.633 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 81/162 2024-05-10T03:31:28.633 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 82/162 2024-05-10T03:31:28.633 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 83/162 2024-05-10T03:31:28.633 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 84/162 2024-05-10T03:31:28.633 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 85/162 2024-05-10T03:31:28.633 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 86/162 2024-05-10T03:31:28.633 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 87/162 2024-05-10T03:31:28.633 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 88/162 2024-05-10T03:31:28.633 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 89/162 2024-05-10T03:31:28.633 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 90/162 2024-05-10T03:31:28.634 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 91/162 2024-05-10T03:31:28.634 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 92/162 2024-05-10T03:31:28.634 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 93/162 2024-05-10T03:31:28.634 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 94/162 2024-05-10T03:31:28.634 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 95/162 2024-05-10T03:31:28.634 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 96/162 2024-05-10T03:31:28.634 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 97/162 2024-05-10T03:31:28.634 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 98/162 2024-05-10T03:31:28.634 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 99/162 2024-05-10T03:31:28.634 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 100/162 2024-05-10T03:31:28.634 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 101/162 2024-05-10T03:31:28.634 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 102/162 2024-05-10T03:31:28.634 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 103/162 2024-05-10T03:31:28.635 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 104/162 2024-05-10T03:31:28.635 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : bison-3.0.4-10.el8.x86_64 105/162 2024-05-10T03:31:28.635 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flex-2.6.1-9.el8.x86_64 106/162 2024-05-10T03:31:28.635 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 107/162 2024-05-10T03:31:28.635 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 108/162 2024-05-10T03:31:28.635 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 109/162 2024-05-10T03:31:28.635 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 110/162 2024-05-10T03:31:28.635 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 111/162 2024-05-10T03:31:28.635 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 112/162 2024-05-10T03:31:28.635 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 113/162 2024-05-10T03:31:28.635 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 114/162 2024-05-10T03:31:28.635 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 115/162 2024-05-10T03:31:28.635 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 116/162 2024-05-10T03:31:28.635 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 117/162 2024-05-10T03:31:28.636 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 118/162 2024-05-10T03:31:28.636 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 119/162 2024-05-10T03:31:28.636 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 120/162 2024-05-10T03:31:28.636 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : automake-1.16.1-8.el8.noarch 121/162 2024-05-10T03:31:28.636 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libpq-13.11-1.el8.x86_64 122/162 2024-05-10T03:31:28.636 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : jq-1.6-7.el8.x86_64 123/162 2024-05-10T03:31:28.636 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 124/162 2024-05-10T03:31:28.636 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 125/162 2024-05-10T03:31:28.636 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 126/162 2024-05-10T03:31:28.636 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 127/162 2024-05-10T03:31:28.636 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 128/162 2024-05-10T03:31:28.636 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 129/162 2024-05-10T03:31:28.636 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 130/162 2024-05-10T03:31:28.636 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-2:18.2.2-1330.g50174015.el8.x86_64 131/162 2024-05-10T03:31:28.637 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-05-10T03:31:28.637 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-2:18.2.2-1330.g50174015.el8.x86_64 133/162 2024-05-10T03:31:28.637 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-05-10T03:31:28.637 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-05-10T03:31:28.637 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-05-10T03:31:28.637 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-05-10T03:31:28.637 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-05-10T03:31:28.637 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-05-10T03:31:28.637 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-05-10T03:31:28.637 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-05-10T03:31:28.637 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-05-10T03:31:28.637 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-05-10T03:31:28.637 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-05-10T03:31:28.638 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-05-10T03:31:28.638 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-05-10T03:31:28.638 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-05-10T03:31:28.638 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-05-10T03:31:28.638 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-05-10T03:31:28.638 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-05-10T03:31:28.638 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-05-10T03:31:28.638 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-05-10T03:31:28.638 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-05-10T03:31:28.638 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-05-10T03:31:28.638 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-05-10T03:31:28.638 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-05-10T03:31:28.638 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-05-10T03:31:28.638 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-05-10T03:31:28.639 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-05-10T03:31:28.639 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-05-10T03:31:28.639 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-05-10T03:31:36.864 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-05-10T03:31:36.864 INFO:teuthology.orchestra.run.smithi154.stdout:Installed products updated. 2024-05-10T03:31:38.020 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-10T03:31:38.021 INFO:teuthology.orchestra.run.smithi154.stdout:Upgraded: 2024-05-10T03:31:38.021 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-05-10T03:31:38.021 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-05-10T03:31:38.021 INFO:teuthology.orchestra.run.smithi154.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-05-10T03:31:38.021 INFO:teuthology.orchestra.run.smithi154.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-05-10T03:31:38.021 INFO:teuthology.orchestra.run.smithi154.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-05-10T03:31:38.021 INFO:teuthology.orchestra.run.smithi154.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-05-10T03:31:38.021 INFO:teuthology.orchestra.run.smithi154.stdout: librados2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.021 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.021 INFO:teuthology.orchestra.run.smithi154.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-05-10T03:31:38.021 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-05-10T03:31:38.021 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-05-10T03:31:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-05-10T03:31:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-05-10T03:31:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-05-10T03:31:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-05-10T03:31:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-10T03:31:38.022 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-05-10T03:31:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-05-10T03:31:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: automake-1.16.1-8.el8.noarch 2024-05-10T03:31:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: bison-3.0.4-10.el8.x86_64 2024-05-10T03:31:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-05-10T03:31:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: flex-2.6.1-9.el8.x86_64 2024-05-10T03:31:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: fuse-2.9.7-17.el8.x86_64 2024-05-10T03:31:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-10T03:31:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: jq-1.6-7.el8.x86_64 2024-05-10T03:31:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-10T03:31:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-05-10T03:31:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-10T03:31:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-05-10T03:31:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-05-10T03:31:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-10T03:31:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: libpq-13.11-1.el8.x86_64 2024-05-10T03:31:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-05-10T03:31:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-05-10T03:31:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-05-10T03:31:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-05-10T03:31:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-10T03:31:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-10T03:31:38.026 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-10T03:31:38.026 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-05-10T03:31:38.026 INFO:teuthology.orchestra.run.smithi154.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-05-10T03:31:38.026 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-10T03:31:38.026 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-10T03:31:38.026 INFO:teuthology.orchestra.run.smithi154.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-05-10T03:31:38.026 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-0.3.15-6.el8.x86_64 2024-05-10T03:31:38.026 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-05-10T03:31:38.026 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-05-10T03:31:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-05-10T03:31:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-05-10T03:31:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-05-10T03:31:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-10T03:31:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-10T03:31:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-10T03:31:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-10T03:31:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-10T03:31:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-10T03:31:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-10T03:31:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-10T03:31:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-10T03:31:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-10T03:31:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-10T03:31:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-10T03:31:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-05-10T03:31:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-10T03:31:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-10T03:31:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-10T03:31:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-05-10T03:31:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-10T03:31:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-10T03:31:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-10T03:31:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-10T03:31:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-10T03:31:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-10T03:31:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-10T03:31:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-10T03:31:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-10T03:31:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-10T03:31:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-10T03:31:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-10T03:31:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-10T03:31:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-10T03:31:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend-2.6-1.el8.noarch 2024-05-10T03:31:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-10T03:31:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-10T03:31:38.030 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-10T03:31:38.030 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-10T03:31:38.030 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-10T03:31:38.030 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-10T03:31:38.030 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.030 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.030 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-10T03:31:38.030 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-10T03:31:38.030 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.030 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-10T03:31:38.030 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-10T03:31:38.030 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-05-10T03:31:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-10T03:31:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-10T03:31:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-10T03:31:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-10T03:31:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-10T03:31:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-10T03:31:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-10T03:31:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-10T03:31:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-10T03:31:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-10T03:31:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-10T03:31:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-10T03:31:38.032 INFO:teuthology.orchestra.run.smithi154.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-10T03:31:38.032 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-10T03:31:38.032 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-10T03:31:38.032 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-05-10T03:31:38.032 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-10T03:31:38.032 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-05-10T03:31:38.109 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-05-10T03:31:38.109 INFO:teuthology.orchestra.run.smithi106.stdout:Installed products updated. 2024-05-10T03:31:38.727 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T03:31:38.727 INFO:teuthology.orchestra.run.smithi106.stdout:Upgraded: 2024-05-10T03:31:38.727 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-05-10T03:31:38.728 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-05-10T03:31:38.728 INFO:teuthology.orchestra.run.smithi106.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-05-10T03:31:38.728 INFO:teuthology.orchestra.run.smithi106.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-05-10T03:31:38.728 INFO:teuthology.orchestra.run.smithi106.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-05-10T03:31:38.728 INFO:teuthology.orchestra.run.smithi106.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-05-10T03:31:38.728 INFO:teuthology.orchestra.run.smithi106.stdout: librados2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.728 INFO:teuthology.orchestra.run.smithi106.stdout: librbd1-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.728 INFO:teuthology.orchestra.run.smithi106.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-05-10T03:31:38.728 INFO:teuthology.orchestra.run.smithi106.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-05-10T03:31:38.728 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-05-10T03:31:38.728 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-05-10T03:31:38.728 INFO:teuthology.orchestra.run.smithi106.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-05-10T03:31:38.728 INFO:teuthology.orchestra.run.smithi106.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-05-10T03:31:38.729 INFO:teuthology.orchestra.run.smithi106.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-05-10T03:31:38.729 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-10T03:31:38.729 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2024-05-10T03:31:38.729 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-05-10T03:31:38.729 INFO:teuthology.orchestra.run.smithi106.stdout: automake-1.16.1-8.el8.noarch 2024-05-10T03:31:38.729 INFO:teuthology.orchestra.run.smithi106.stdout: bison-3.0.4-10.el8.x86_64 2024-05-10T03:31:38.729 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.729 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.729 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.729 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.729 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-grafana-dashboards-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:38.729 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-immutable-object-cache-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.729 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.729 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.730 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:38.730 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:38.730 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:38.730 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:38.730 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:38.730 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.730 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.730 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-prometheus-alerts-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:38.730 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.730 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.730 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.730 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:38.730 INFO:teuthology.orchestra.run.smithi106.stdout: cephadm-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:38.731 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.731 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:38.731 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-05-10T03:31:38.731 INFO:teuthology.orchestra.run.smithi106.stdout: flex-2.6.1-9.el8.x86_64 2024-05-10T03:31:38.731 INFO:teuthology.orchestra.run.smithi106.stdout: fuse-2.9.7-17.el8.x86_64 2024-05-10T03:31:38.731 INFO:teuthology.orchestra.run.smithi106.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-10T03:31:38.731 INFO:teuthology.orchestra.run.smithi106.stdout: jq-1.6-7.el8.x86_64 2024-05-10T03:31:38.731 INFO:teuthology.orchestra.run.smithi106.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-10T03:31:38.731 INFO:teuthology.orchestra.run.smithi106.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-05-10T03:31:38.731 INFO:teuthology.orchestra.run.smithi106.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-10T03:31:38.731 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.731 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.731 INFO:teuthology.orchestra.run.smithi106.stdout: libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.732 INFO:teuthology.orchestra.run.smithi106.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-05-10T03:31:38.732 INFO:teuthology.orchestra.run.smithi106.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-05-10T03:31:38.732 INFO:teuthology.orchestra.run.smithi106.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-10T03:31:38.732 INFO:teuthology.orchestra.run.smithi106.stdout: libpq-13.11-1.el8.x86_64 2024-05-10T03:31:38.732 INFO:teuthology.orchestra.run.smithi106.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-05-10T03:31:38.732 INFO:teuthology.orchestra.run.smithi106.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-05-10T03:31:38.732 INFO:teuthology.orchestra.run.smithi106.stdout: librados-devel-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.732 INFO:teuthology.orchestra.run.smithi106.stdout: libradosstriper1-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.732 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-05-10T03:31:38.732 INFO:teuthology.orchestra.run.smithi106.stdout: librgw2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.732 INFO:teuthology.orchestra.run.smithi106.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-05-10T03:31:38.732 INFO:teuthology.orchestra.run.smithi106.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-10T03:31:38.732 INFO:teuthology.orchestra.run.smithi106.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-10T03:31:38.732 INFO:teuthology.orchestra.run.smithi106.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-10T03:31:38.733 INFO:teuthology.orchestra.run.smithi106.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-05-10T03:31:38.733 INFO:teuthology.orchestra.run.smithi106.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-05-10T03:31:38.733 INFO:teuthology.orchestra.run.smithi106.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-10T03:31:38.733 INFO:teuthology.orchestra.run.smithi106.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-10T03:31:38.733 INFO:teuthology.orchestra.run.smithi106.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-05-10T03:31:38.733 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-0.3.15-6.el8.x86_64 2024-05-10T03:31:38.733 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-05-10T03:31:38.733 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-05-10T03:31:38.733 INFO:teuthology.orchestra.run.smithi106.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-05-10T03:31:38.733 INFO:teuthology.orchestra.run.smithi106.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-05-10T03:31:38.733 INFO:teuthology.orchestra.run.smithi106.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-05-10T03:31:38.733 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-10T03:31:38.734 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-10T03:31:38.734 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-10T03:31:38.734 INFO:teuthology.orchestra.run.smithi106.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-10T03:31:38.734 INFO:teuthology.orchestra.run.smithi106.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-10T03:31:38.734 INFO:teuthology.orchestra.run.smithi106.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-10T03:31:38.734 INFO:teuthology.orchestra.run.smithi106.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-10T03:31:38.734 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-10T03:31:38.734 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.734 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.734 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.734 INFO:teuthology.orchestra.run.smithi106.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-10T03:31:38.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-10T03:31:38.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-10T03:31:38.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-10T03:31:38.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-05-10T03:31:38.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-10T03:31:38.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-10T03:31:38.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-10T03:31:38.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-05-10T03:31:38.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-10T03:31:38.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-10T03:31:38.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-10T03:31:38.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-10T03:31:38.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-10T03:31:38.735 INFO:teuthology.orchestra.run.smithi106.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-10T03:31:38.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-10T03:31:38.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-10T03:31:38.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-10T03:31:38.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-10T03:31:38.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-10T03:31:38.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-10T03:31:38.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-10T03:31:38.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-10T03:31:38.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-portend-2.6-1.el8.noarch 2024-05-10T03:31:38.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-10T03:31:38.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-10T03:31:38.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-10T03:31:38.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-10T03:31:38.736 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-10T03:31:38.737 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-10T03:31:38.737 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.737 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.737 INFO:teuthology.orchestra.run.smithi106.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-10T03:31:38.737 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-10T03:31:38.737 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.737 INFO:teuthology.orchestra.run.smithi106.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-10T03:31:38.737 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-10T03:31:38.737 INFO:teuthology.orchestra.run.smithi106.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-05-10T03:31:38.737 INFO:teuthology.orchestra.run.smithi106.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-10T03:31:38.737 INFO:teuthology.orchestra.run.smithi106.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-10T03:31:38.737 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-10T03:31:38.737 INFO:teuthology.orchestra.run.smithi106.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-10T03:31:38.737 INFO:teuthology.orchestra.run.smithi106.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-10T03:31:38.737 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-10T03:31:38.738 INFO:teuthology.orchestra.run.smithi106.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-10T03:31:38.738 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-10T03:31:38.738 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-10T03:31:38.738 INFO:teuthology.orchestra.run.smithi106.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-10T03:31:38.738 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.738 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.738 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:38.738 INFO:teuthology.orchestra.run.smithi106.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-10T03:31:38.738 INFO:teuthology.orchestra.run.smithi106.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-10T03:31:38.738 INFO:teuthology.orchestra.run.smithi106.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-10T03:31:38.738 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-10T03:31:38.738 INFO:teuthology.orchestra.run.smithi106.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-10T03:31:38.739 INFO:teuthology.orchestra.run.smithi106.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-05-10T03:31:38.739 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-10T03:31:38.739 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-05-10T03:31:38.963 DEBUG:teuthology.parallel:result is None 2024-05-10T03:31:39.873 DEBUG:teuthology.parallel:result is None 2024-05-10T03:31:41.230 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-05-10T03:31:41.230 INFO:teuthology.orchestra.run.smithi045.stdout:Installed products updated. 2024-05-10T03:31:41.918 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:31:41.918 INFO:teuthology.orchestra.run.smithi045.stdout:Upgraded: 2024-05-10T03:31:41.918 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-05-10T03:31:41.918 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-05-10T03:31:41.918 INFO:teuthology.orchestra.run.smithi045.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-05-10T03:31:41.918 INFO:teuthology.orchestra.run.smithi045.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-05-10T03:31:41.918 INFO:teuthology.orchestra.run.smithi045.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-05-10T03:31:41.918 INFO:teuthology.orchestra.run.smithi045.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-05-10T03:31:41.918 INFO:teuthology.orchestra.run.smithi045.stdout: librados2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.919 INFO:teuthology.orchestra.run.smithi045.stdout: librbd1-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.919 INFO:teuthology.orchestra.run.smithi045.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-05-10T03:31:41.919 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-05-10T03:31:41.919 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-05-10T03:31:41.919 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-05-10T03:31:41.919 INFO:teuthology.orchestra.run.smithi045.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-05-10T03:31:41.919 INFO:teuthology.orchestra.run.smithi045.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-05-10T03:31:41.919 INFO:teuthology.orchestra.run.smithi045.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-05-10T03:31:41.919 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-10T03:31:41.919 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-05-10T03:31:41.919 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-05-10T03:31:41.919 INFO:teuthology.orchestra.run.smithi045.stdout: automake-1.16.1-8.el8.noarch 2024-05-10T03:31:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: bison-3.0.4-10.el8.x86_64 2024-05-10T03:31:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T03:31:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-05-10T03:31:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: flex-2.6.1-9.el8.x86_64 2024-05-10T03:31:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: fuse-2.9.7-17.el8.x86_64 2024-05-10T03:31:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-10T03:31:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: jq-1.6-7.el8.x86_64 2024-05-10T03:31:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-10T03:31:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-05-10T03:31:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-10T03:31:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-05-10T03:31:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-05-10T03:31:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-10T03:31:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: libpq-13.11-1.el8.x86_64 2024-05-10T03:31:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-05-10T03:31:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-05-10T03:31:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-05-10T03:31:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-05-10T03:31:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-10T03:31:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-10T03:31:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-10T03:31:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-05-10T03:31:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-05-10T03:31:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-10T03:31:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-10T03:31:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-05-10T03:31:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-0.3.15-6.el8.x86_64 2024-05-10T03:31:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-05-10T03:31:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-05-10T03:31:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-05-10T03:31:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-05-10T03:31:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-05-10T03:31:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-10T03:31:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-10T03:31:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-10T03:31:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-10T03:31:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-10T03:31:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-10T03:31:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-10T03:31:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-10T03:31:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-10T03:31:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-10T03:31:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-10T03:31:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-10T03:31:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-05-10T03:31:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-10T03:31:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-10T03:31:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-10T03:31:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-05-10T03:31:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-10T03:31:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-10T03:31:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-10T03:31:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-10T03:31:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-10T03:31:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-10T03:31:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-10T03:31:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-10T03:31:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-10T03:31:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-10T03:31:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-10T03:31:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-10T03:31:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-10T03:31:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-10T03:31:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend-2.6-1.el8.noarch 2024-05-10T03:31:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-10T03:31:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-10T03:31:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-10T03:31:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-10T03:31:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-10T03:31:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-10T03:31:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-10T03:31:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-10T03:31:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-10T03:31:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-10T03:31:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-05-10T03:31:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-10T03:31:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-10T03:31:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-10T03:31:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-10T03:31:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-10T03:31:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-10T03:31:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-10T03:31:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-10T03:31:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-10T03:31:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-10T03:31:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.928 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T03:31:41.928 INFO:teuthology.orchestra.run.smithi045.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-10T03:31:41.928 INFO:teuthology.orchestra.run.smithi045.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-10T03:31:41.928 INFO:teuthology.orchestra.run.smithi045.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-10T03:31:41.928 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-10T03:31:41.928 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-10T03:31:41.928 INFO:teuthology.orchestra.run.smithi045.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-05-10T03:31:41.928 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:31:41.928 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-10T03:31:42.169 DEBUG:teuthology.parallel:result is None 2024-05-10T03:31:42.169 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=50174015a7e79f951b988949abe236791f52d4da 2024-05-10T03:31:42.317 DEBUG:teuthology.orchestra.run.smithi045:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-10T03:31:42.347 INFO:teuthology.orchestra.run.smithi045.stdout:18.2.2-1330.g50174015.el8 2024-05-10T03:31:42.348 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1330.g50174015.el8 2024-05-10T03:31:42.348 INFO:teuthology.task.install:The correct ceph version 18.2.2-1330.g50174015 is installed. 2024-05-10T03:31:42.349 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=50174015a7e79f951b988949abe236791f52d4da 2024-05-10T03:31:42.504 DEBUG:teuthology.orchestra.run.smithi106:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-10T03:31:42.534 INFO:teuthology.orchestra.run.smithi106.stdout:18.2.2-1330.g50174015.el8 2024-05-10T03:31:42.534 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1330.g50174015.el8 2024-05-10T03:31:42.534 INFO:teuthology.task.install:The correct ceph version 18.2.2-1330.g50174015 is installed. 2024-05-10T03:31:42.536 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=50174015a7e79f951b988949abe236791f52d4da 2024-05-10T03:31:42.681 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-10T03:31:42.710 INFO:teuthology.orchestra.run.smithi154.stdout:18.2.2-1330.g50174015.el8 2024-05-10T03:31:42.710 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1330.g50174015.el8 2024-05-10T03:31:42.710 INFO:teuthology.task.install:The correct ceph version 18.2.2-1330.g50174015 is installed. 2024-05-10T03:31:42.713 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-10T03:31:42.713 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-10T03:31:42.713 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-10T03:31:42.767 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T03:31:42.767 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-10T03:31:42.817 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-10T03:31:42.817 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-10T03:31:42.868 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-10T03:31:42.869 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-10T03:31:42.869 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/daemon-helper 2024-05-10T03:31:42.904 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-10T03:31:42.979 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T03:31:42.980 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/daemon-helper 2024-05-10T03:31:43.011 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-10T03:31:43.082 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-10T03:31:43.082 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2024-05-10T03:31:43.115 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-10T03:31:43.186 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-10T03:31:43.186 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-10T03:31:43.186 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-10T03:31:43.220 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-10T03:31:43.295 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T03:31:43.295 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-10T03:31:43.328 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-10T03:31:43.401 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-10T03:31:43.401 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-10T03:31:43.433 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-10T03:31:43.503 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-10T03:31:43.504 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-10T03:31:43.504 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/stdin-killer 2024-05-10T03:31:43.539 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-10T03:31:43.614 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T03:31:43.615 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/stdin-killer 2024-05-10T03:31:43.648 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-10T03:31:43.721 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-10T03:31:43.721 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2024-05-10T03:31:43.752 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-10T03:31:43.822 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-10T03:31:43.921 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '50174015a7e79f951b988949abe236791f52d4da', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-05-10T03:31:43.922 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da 2024-05-10T03:31:43.922 INFO:tasks.cephadm:Cluster fsid is d2a0bafa-0e7d-11ef-bc98-c7b262605968 2024-05-10T03:31:43.922 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-10T03:31:43.922 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.45', 'mon.b': '172.21.15.106', 'mon.c': '172.21.15.154'} 2024-05-10T03:31:43.923 INFO:tasks.cephadm:First mon is mon.a on smithi045 2024-05-10T03:31:43.923 INFO:tasks.cephadm:First mgr is x 2024-05-10T03:31:43.923 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-10T03:31:43.923 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname $(hostname -s) 2024-05-10T03:31:43.959 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname $(hostname -s) 2024-05-10T03:31:43.992 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname $(hostname -s) 2024-05-10T03:31:44.023 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-05-10T03:31:44.024 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=50174015a7e79f951b988949abe236791f52d4da 2024-05-10T03:31:44.165 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '50174015a7e79f951b988949abe236791f52d4da', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/79270/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.2-1330-g50174015', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.2-1330.g50174015'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2024-05-10 02:06:05.327930', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240509.171335-reef-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-05-10T03:31:44.304 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-pdonnell-testing-20240509.171335-reef-debug, sha1 50174015a7e79f951b988949abe236791f52d4da from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=50174015a7e79f951b988949abe236791f52d4da 2024-05-10T03:31:44.306 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/x86_64/flavors/default/cephadm 2024-05-10T03:31:44.306 DEBUG:teuthology.orchestra.run.smithi045:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-10T03:31:44.805 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r--. 1 ubuntu ubuntu 703022 May 10 03:31 /home/ubuntu/cephtest/cephadm 2024-05-10T03:31:44.805 DEBUG:teuthology.orchestra.run.smithi106:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-10T03:31:45.152 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-rw-r--. 1 ubuntu ubuntu 703022 May 10 03:31 /home/ubuntu/cephtest/cephadm 2024-05-10T03:31:45.152 DEBUG:teuthology.orchestra.run.smithi154:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-10T03:31:45.520 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-rw-r--. 1 ubuntu ubuntu 703022 May 10 03:31 /home/ubuntu/cephtest/cephadm 2024-05-10T03:31:45.520 DEBUG:teuthology.orchestra.run.smithi045:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-10T03:31:45.543 DEBUG:teuthology.orchestra.run.smithi106:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-10T03:31:45.565 DEBUG:teuthology.orchestra.run.smithi154:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-10T03:31:45.604 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da on all hosts... 2024-05-10T03:31:45.604 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da pull 2024-05-10T03:31:45.606 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da pull 2024-05-10T03:31:45.608 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da pull 2024-05-10T03:31:46.610 INFO:teuthology.orchestra.run.smithi154.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da... 2024-05-10T03:31:47.168 INFO:teuthology.orchestra.run.smithi106.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da... 2024-05-10T03:31:48.554 INFO:teuthology.orchestra.run.smithi045.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da... 2024-05-10T03:32:24.697 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-05-10T03:32:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_version": "ceph version 18.2.2-1330-g50174015 (50174015a7e79f951b988949abe236791f52d4da) reef (stable)", 2024-05-10T03:32:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: "image_id": "0e8066d08b37ba491bbdc3407be474324b50b47fdf56caf5acbacae7a4a8fb9b", 2024-05-10T03:32:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: "repo_digests": [ 2024-05-10T03:32:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:042b1f8e1a7496c1ea8ed86a601031b3e73743a9905239589edc685eef0b229c" 2024-05-10T03:32:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-05-10T03:32:24.698 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-05-10T03:32:29.233 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:32:29.233 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.2.2-1330-g50174015 (50174015a7e79f951b988949abe236791f52d4da) reef (stable)", 2024-05-10T03:32:29.233 INFO:teuthology.orchestra.run.smithi045.stdout: "image_id": "0e8066d08b37ba491bbdc3407be474324b50b47fdf56caf5acbacae7a4a8fb9b", 2024-05-10T03:32:29.233 INFO:teuthology.orchestra.run.smithi045.stdout: "repo_digests": [ 2024-05-10T03:32:29.233 INFO:teuthology.orchestra.run.smithi045.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:042b1f8e1a7496c1ea8ed86a601031b3e73743a9905239589edc685eef0b229c" 2024-05-10T03:32:29.234 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-05-10T03:32:29.234 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:32:29.423 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-10T03:32:29.423 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_version": "ceph version 18.2.2-1330-g50174015 (50174015a7e79f951b988949abe236791f52d4da) reef (stable)", 2024-05-10T03:32:29.423 INFO:teuthology.orchestra.run.smithi106.stdout: "image_id": "0e8066d08b37ba491bbdc3407be474324b50b47fdf56caf5acbacae7a4a8fb9b", 2024-05-10T03:32:29.423 INFO:teuthology.orchestra.run.smithi106.stdout: "repo_digests": [ 2024-05-10T03:32:29.423 INFO:teuthology.orchestra.run.smithi106.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:042b1f8e1a7496c1ea8ed86a601031b3e73743a9905239589edc685eef0b229c" 2024-05-10T03:32:29.423 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-10T03:32:29.424 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-10T03:32:29.443 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph 2024-05-10T03:32:29.485 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /etc/ceph 2024-05-10T03:32:29.516 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph 2024-05-10T03:32:29.553 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 777 /etc/ceph 2024-05-10T03:32:29.589 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 777 /etc/ceph 2024-05-10T03:32:29.615 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /etc/ceph 2024-05-10T03:32:29.644 INFO:tasks.cephadm:Writing seed config... 2024-05-10T03:32:29.645 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-05-10T03:32:29.646 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-05-10T03:32:29.646 INFO:tasks.cephadm: override: [client] debug client = 20 2024-05-10T03:32:29.646 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-10T03:32:29.646 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-05-10T03:32:29.646 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-05-10T03:32:29.646 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-05-10T03:32:29.646 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-05-10T03:32:29.646 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-05-10T03:32:29.646 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-05-10T03:32:29.646 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-05-10T03:32:29.646 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-05-10T03:32:29.647 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-05-10T03:32:29.647 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-05-10T03:32:29.647 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-05-10T03:32:29.647 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-05-10T03:32:29.647 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-05-10T03:32:29.647 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-05-10T03:32:29.647 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-05-10T03:32:29.647 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-05-10T03:32:29.647 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-05-10T03:32:29.647 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-05-10T03:32:29.647 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-05-10T03:32:29.647 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-05-10T03:32:29.647 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-10T03:32:29.647 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-10T03:32:29.647 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-10T03:32:29.648 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-10T03:32:29.648 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-10T03:32:29.648 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-05-10T03:32:29.648 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-05-10T03:32:29.648 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-05-10T03:32:29.648 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-05-10T03:32:29.648 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-05-10T03:32:29.648 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-10T03:32:29.648 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-10T03:32:29.648 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-05-10T03:32:29.648 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-05-10T03:32:29.648 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-05-10T03:32:29.648 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-05-10T03:32:29.648 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-05-10T03:32:29.649 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-05-10T03:32:29.649 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-05-10T03:32:29.649 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-05-10T03:32:29.649 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-05-10T03:32:29.650 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-10T03:32:29.650 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-10T03:32:29.709 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = d2a0bafa-0e7d-11ef-bc98-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-05-10T03:32:29.710 DEBUG:teuthology.orchestra.run.smithi045:mon.a> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mon.a.service 2024-05-10T03:32:29.752 DEBUG:teuthology.orchestra.run.smithi045:mgr.x> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mgr.x.service 2024-05-10T03:32:29.787 INFO:journalctl@ceph.mon.a.smithi045.stdout:-- Logs begin at Fri 2024-05-10 03:15:08 UTC. -- 2024-05-10T03:32:29.788 INFO:tasks.cephadm:Bootstrapping... 2024-05-10T03:32:29.788 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da -v bootstrap --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.45 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-10T03:32:29.819 INFO:journalctl@ceph.mgr.x.smithi045.stdout:-- Logs begin at Fri 2024-05-10 03:15:08 UTC. -- 2024-05-10T03:32:29.975 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-05-10T03:32:29.975 INFO:teuthology.orchestra.run.smithi045.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da', '-v', 'bootstrap', '--fsid', 'd2a0bafa-0e7d-11ef-bc98-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.45', '--skip-admin-label'] 2024-05-10T03:32:30.007 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stdout 4.6.1 2024-05-10T03:32:30.007 INFO:teuthology.orchestra.run.smithi045.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-05-10T03:32:30.007 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying podman|docker is present... 2024-05-10T03:32:30.041 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stdout 4.6.1 2024-05-10T03:32:30.041 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying lvm2 is present... 2024-05-10T03:32:30.041 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying time synchronization is in place... 2024-05-10T03:32:30.049 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-10T03:32:30.049 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-10T03:32:30.055 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-10T03:32:30.055 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout inactive 2024-05-10T03:32:30.062 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout enabled 2024-05-10T03:32:30.068 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout active 2024-05-10T03:32:30.069 INFO:teuthology.orchestra.run.smithi045.stdout:Unit chronyd.service is enabled and running 2024-05-10T03:32:30.069 INFO:teuthology.orchestra.run.smithi045.stdout:Repeating the final host check... 2024-05-10T03:32:30.101 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stdout 4.6.1 2024-05-10T03:32:30.101 INFO:teuthology.orchestra.run.smithi045.stdout:podman (/bin/podman) version 4.6.1 is present 2024-05-10T03:32:30.101 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl is present 2024-05-10T03:32:30.101 INFO:teuthology.orchestra.run.smithi045.stdout:lvcreate is present 2024-05-10T03:32:30.108 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-10T03:32:30.108 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-10T03:32:30.114 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-10T03:32:30.114 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout inactive 2024-05-10T03:32:30.121 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout enabled 2024-05-10T03:32:30.127 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout active 2024-05-10T03:32:30.128 INFO:teuthology.orchestra.run.smithi045.stdout:Unit chronyd.service is enabled and running 2024-05-10T03:32:30.128 INFO:teuthology.orchestra.run.smithi045.stdout:Host looks OK 2024-05-10T03:32:30.128 INFO:teuthology.orchestra.run.smithi045.stdout:Cluster fsid: d2a0bafa-0e7d-11ef-bc98-c7b262605968 2024-05-10T03:32:30.128 INFO:teuthology.orchestra.run.smithi045.stdout:Acquiring lock 140445352311272 on /run/cephadm/d2a0bafa-0e7d-11ef-bc98-c7b262605968.lock 2024-05-10T03:32:30.128 INFO:teuthology.orchestra.run.smithi045.stdout:Lock 140445352311272 acquired on /run/cephadm/d2a0bafa-0e7d-11ef-bc98-c7b262605968.lock 2024-05-10T03:32:30.128 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying IP 172.21.15.45 port 3300 ... 2024-05-10T03:32:30.129 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying IP 172.21.15.45 port 6789 ... 2024-05-10T03:32:30.129 INFO:teuthology.orchestra.run.smithi045.stdout:Base mon IP(s) is [172.21.15.45:3300, 172.21.15.45:6789], mon addrv is [v2:172.21.15.45:3300,v1:172.21.15.45:6789] 2024-05-10T03:32:30.133 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp metric 100 2024-05-10T03:32:30.133 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.45 metric 100 2024-05-10T03:32:30.136 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-05-10T03:32:30.136 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-05-10T03:32:30.136 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1780sec hoplimit 64 pref medium 2024-05-10T03:32:30.139 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-10T03:32:30.139 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-05-10T03:32:30.139 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-10T03:32:30.139 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-05-10T03:32:30.140 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:12be/64 scope link 2024-05-10T03:32:30.140 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-10T03:32:30.140 INFO:teuthology.orchestra.run.smithi045.stdout:Mon IP `172.21.15.45` is in CIDR network `172.21.0.0/20` 2024-05-10T03:32:30.140 INFO:teuthology.orchestra.run.smithi045.stdout:Mon IP `172.21.15.45` is in CIDR network `172.21.0.0/20` 2024-05-10T03:32:30.140 INFO:teuthology.orchestra.run.smithi045.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-05-10T03:32:30.141 INFO:teuthology.orchestra.run.smithi045.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-10T03:32:30.142 INFO:teuthology.orchestra.run.smithi045.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da... 2024-05-10T03:32:30.574 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stdout 0e8066d08b37ba491bbdc3407be474324b50b47fdf56caf5acbacae7a4a8fb9b 2024-05-10T03:32:30.574 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da... 2024-05-10T03:32:30.574 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stderr Getting image source signatures 2024-05-10T03:32:30.574 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stderr Copying blob sha256:5889b1d3c79fb904da685578f1acb24d7c4091d50b19c3ba92279423a786328a 2024-05-10T03:32:30.574 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stderr Copying blob sha256:bf5b95bd68251da39c6cd2eb96c6ba4138bb37a62bdc39287908b25e92047d7e 2024-05-10T03:32:30.574 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stderr Copying config sha256:0e8066d08b37ba491bbdc3407be474324b50b47fdf56caf5acbacae7a4a8fb9b 2024-05-10T03:32:30.574 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stderr Writing manifest to image destination 2024-05-10T03:32:31.458 INFO:teuthology.orchestra.run.smithi045.stdout:ceph: stdout ceph version 18.2.2-1330-g50174015 (50174015a7e79f951b988949abe236791f52d4da) reef (stable) 2024-05-10T03:32:31.458 INFO:teuthology.orchestra.run.smithi045.stdout:Ceph version: ceph version 18.2.2-1330-g50174015 (50174015a7e79f951b988949abe236791f52d4da) reef (stable) 2024-05-10T03:32:31.458 INFO:teuthology.orchestra.run.smithi045.stdout:Extracting ceph user uid/gid from container image... 2024-05-10T03:32:32.119 INFO:teuthology.orchestra.run.smithi045.stdout:stat: stdout 167 167 2024-05-10T03:32:32.119 INFO:teuthology.orchestra.run.smithi045.stdout:Creating initial keys... 2024-05-10T03:32:32.755 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph-authtool: stdout AQBQlT1myJsoGRAANa6T2tnfC5WnW+K7ZfQWcA== 2024-05-10T03:32:33.381 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph-authtool: stdout AQBRlT1mhANIAhAAtafxYhUkpSKzNXmVZzw/Yg== 2024-05-10T03:32:34.056 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph-authtool: stdout AQBRlT1m7r2SKBAAQWumYxzhdx0bNPeLO3EfVg== 2024-05-10T03:32:34.057 INFO:teuthology.orchestra.run.smithi045.stdout:Creating initial monmap... 2024-05-10T03:32:34.706 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-10T03:32:34.706 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-05-10T03:32:34.706 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to d2a0bafa-0e7d-11ef-bc98-c7b262605968 2024-05-10T03:32:34.706 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-10T03:32:34.706 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool for a [v2:172.21.15.45:3300,v1:172.21.15.45:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-10T03:32:34.706 INFO:teuthology.orchestra.run.smithi045.stdout:setting min_mon_release = pacific 2024-05-10T03:32:34.706 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/monmaptool: set fsid to d2a0bafa-0e7d-11ef-bc98-c7b262605968 2024-05-10T03:32:34.706 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-10T03:32:34.706 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:32:34.706 INFO:teuthology.orchestra.run.smithi045.stdout:Creating mon... 2024-05-10T03:32:35.691 INFO:teuthology.orchestra.run.smithi045.stdout:create mon.a on 2024-05-10T03:32:35.830 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-05-10T03:32:35.929 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-10T03:32:36.066 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968.target → /etc/systemd/system/ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968.target. 2024-05-10T03:32:36.066 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968.target → /etc/systemd/system/ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968.target. 2024-05-10T03:32:36.263 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mon.a 2024-05-10T03:32:36.263 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mon.a.service: Unit ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mon.a.service not loaded. 2024-05-10T03:32:36.365 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968.target.wants/ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mon.a.service → /etc/systemd/system/ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@.service. 2024-05-10T03:32:36.789 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-10T03:32:36.789 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout disabled 2024-05-10T03:32:36.799 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-10T03:32:36.799 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout inactive 2024-05-10T03:32:36.799 INFO:teuthology.orchestra.run.smithi045.stdout:firewalld.service is not enabled 2024-05-10T03:32:36.799 INFO:teuthology.orchestra.run.smithi045.stdout:Not possible to enable service . firewalld.service is not available 2024-05-10T03:32:36.799 INFO:teuthology.orchestra.run.smithi045.stdout:Waiting for mon to start... 2024-05-10T03:32:36.799 INFO:teuthology.orchestra.run.smithi045.stdout:Waiting for mon... 2024-05-10T03:32:37.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:36 smithi045 ceph-mon[42034]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-10T03:32:37.723 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout cluster: 2024-05-10T03:32:37.723 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout id: d2a0bafa-0e7d-11ef-bc98-c7b262605968 2024-05-10T03:32:37.724 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-05-10T03:32:37.724 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-05-10T03:32:37.724 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout services: 2024-05-10T03:32:37.724 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.488389s) 2024-05-10T03:32:37.724 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-05-10T03:32:37.724 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-05-10T03:32:37.724 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-05-10T03:32:37.724 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout data: 2024-05-10T03:32:37.724 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-05-10T03:32:37.724 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-05-10T03:32:37.724 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-05-10T03:32:37.724 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout pgs: 2024-05-10T03:32:37.724 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-05-10T03:32:37.724 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.241+0000 7f4123047700 1 Processor -- start 2024-05-10T03:32:37.724 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.241+0000 7f4123047700 1 -- start start 2024-05-10T03:32:37.725 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.241+0000 7f4123047700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f411c107ff0 0x7f411c10a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:37.725 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.241+0000 7f4123047700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c07ad60 con 0x7f411c107ff0 2024-05-10T03:32:37.725 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.242+0000 7f4120de3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f411c107ff0 0x7f411c10a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:32:37.725 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.242+0000 7f4120de3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f411c107ff0 0x7f411c10a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58508/0 (socket says 172.21.15.45:58508) 2024-05-10T03:32:37.725 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.242+0000 7f4120de3700 1 -- 172.21.15.45:0/1640220356 learned_addr learned my addr 172.21.15.45:0/1640220356 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:32:37.725 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.243+0000 7f4120de3700 1 -- 172.21.15.45:0/1640220356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c07aea0 con 0x7f411c107ff0 2024-05-10T03:32:37.725 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.243+0000 7f4120de3700 1 --2- 172.21.15.45:0/1640220356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f411c107ff0 0x7f411c10a410 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f410c0098a0 tx=0x7f410c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1e2edc66b62ad9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:32:37.725 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.243+0000 7f411b7fe700 1 -- 172.21.15.45:0/1640220356 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f410c004160 con 0x7f411c107ff0 2024-05-10T03:32:37.725 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.243+0000 7f411b7fe700 1 -- 172.21.15.45:0/1640220356 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410c0042c0 con 0x7f411c107ff0 2024-05-10T03:32:37.725 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.243+0000 7f411b7fe700 1 -- 172.21.15.45:0/1640220356 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f410c0045a0 con 0x7f411c107ff0 2024-05-10T03:32:37.725 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.244+0000 7f4123047700 1 -- 172.21.15.45:0/1640220356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f411c107ff0 msgr2=0x7f411c10a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:32:37.725 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.244+0000 7f4123047700 1 --2- 172.21.15.45:0/1640220356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f411c107ff0 0x7f411c10a410 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f410c0098a0 tx=0x7f410c009bb0 comp rx=0 tx=0).stop 2024-05-10T03:32:37.725 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.244+0000 7f4123047700 1 -- 172.21.15.45:0/1640220356 shutdown_connections 2024-05-10T03:32:37.725 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.244+0000 7f4123047700 1 --2- 172.21.15.45:0/1640220356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f411c107ff0 0x7f411c10a410 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:37.726 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.244+0000 7f4123047700 1 -- 172.21.15.45:0/1640220356 >> 172.21.15.45:0/1640220356 conn(0x7f411c101a30 msgr2=0x7f411c103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:32:37.726 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.244+0000 7f4123047700 1 -- 172.21.15.45:0/1640220356 shutdown_connections 2024-05-10T03:32:37.726 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.244+0000 7f4123047700 1 -- 172.21.15.45:0/1640220356 wait complete. 2024-05-10T03:32:37.726 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.245+0000 7f4123047700 1 Processor -- start 2024-05-10T03:32:37.726 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.245+0000 7f4123047700 1 -- start start 2024-05-10T03:32:37.726 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.245+0000 7f4123047700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f411c107ff0 0x7f411c198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:37.726 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.245+0000 7f4123047700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c198f90 con 0x7f411c107ff0 2024-05-10T03:32:37.726 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.245+0000 7f4120de3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f411c107ff0 0x7f411c198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:32:37.726 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.245+0000 7f4120de3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f411c107ff0 0x7f411c198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58514/0 (socket says 172.21.15.45:58514) 2024-05-10T03:32:37.726 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.245+0000 7f4120de3700 1 -- 172.21.15.45:0/21858982 learned_addr learned my addr 172.21.15.45:0/21858982 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:32:37.726 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.246+0000 7f4120de3700 1 -- 172.21.15.45:0/21858982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410c009550 con 0x7f411c107ff0 2024-05-10T03:32:37.726 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.246+0000 7f4120de3700 1 --2- 172.21.15.45:0/21858982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f411c107ff0 0x7f411c198a50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f410c004000 tx=0x7f410c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:32:37.726 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.246+0000 7f4119ffb700 1 -- 172.21.15.45:0/21858982 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f410c011630 con 0x7f411c107ff0 2024-05-10T03:32:37.727 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.246+0000 7f4119ffb700 1 -- 172.21.15.45:0/21858982 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410c011790 con 0x7f411c107ff0 2024-05-10T03:32:37.727 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.246+0000 7f4123047700 1 -- 172.21.15.45:0/21858982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411c199190 con 0x7f411c107ff0 2024-05-10T03:32:37.727 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.246+0000 7f4119ffb700 1 -- 172.21.15.45:0/21858982 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f410c011a30 con 0x7f411c107ff0 2024-05-10T03:32:37.727 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.246+0000 7f4123047700 1 -- 172.21.15.45:0/21858982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f411c199630 con 0x7f411c107ff0 2024-05-10T03:32:37.727 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.246+0000 7f4119ffb700 1 -- 172.21.15.45:0/21858982 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f410c022070 con 0x7f411c107ff0 2024-05-10T03:32:37.727 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.246+0000 7f4119ffb700 1 -- 172.21.15.45:0/21858982 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f410c01c450 con 0x7f411c107ff0 2024-05-10T03:32:37.727 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.247+0000 7f4123047700 1 -- 172.21.15.45:0/21858982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f411c192700 con 0x7f411c107ff0 2024-05-10T03:32:37.727 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.250+0000 7f4119ffb700 1 -- 172.21.15.45:0/21858982 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f410c01b450 con 0x7f411c107ff0 2024-05-10T03:32:37.727 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.326+0000 7f4123047700 1 -- 172.21.15.45:0/21858982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f411c105fe0 con 0x7f411c107ff0 2024-05-10T03:32:37.727 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.326+0000 7f4119ffb700 1 -- 172.21.15.45:0/21858982 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f410c01b5f0 con 0x7f411c107ff0 2024-05-10T03:32:37.727 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.327+0000 7f4123047700 1 -- 172.21.15.45:0/21858982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f411c107ff0 msgr2=0x7f411c198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:32:37.727 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.327+0000 7f4123047700 1 --2- 172.21.15.45:0/21858982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f411c107ff0 0x7f411c198a50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f410c004000 tx=0x7f410c004750 comp rx=0 tx=0).stop 2024-05-10T03:32:37.727 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.327+0000 7f4123047700 1 -- 172.21.15.45:0/21858982 shutdown_connections 2024-05-10T03:32:37.727 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.327+0000 7f4123047700 1 --2- 172.21.15.45:0/21858982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f411c107ff0 0x7f411c198a50 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:37.727 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.327+0000 7f4123047700 1 -- 172.21.15.45:0/21858982 >> 172.21.15.45:0/21858982 conn(0x7f411c101a30 msgr2=0x7f411c18f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:32:37.728 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.328+0000 7f4123047700 1 -- 172.21.15.45:0/21858982 shutdown_connections 2024-05-10T03:32:37.728 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:37.328+0000 7f4123047700 1 -- 172.21.15.45:0/21858982 wait complete. 2024-05-10T03:32:37.728 INFO:teuthology.orchestra.run.smithi045.stdout:mon is available 2024-05-10T03:32:37.728 INFO:teuthology.orchestra.run.smithi045.stdout:Assimilating anything we can from ceph.conf... 2024-05-10T03:32:38.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:37 smithi045 ceph-mon[42034]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-10T03:32:38.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:37 smithi045 ceph-mon[42034]: monmap e1: 1 mons at {a=[v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-10T03:32:38.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:37 smithi045 ceph-mon[42034]: fsmap 2024-05-10T03:32:38.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:37 smithi045 ceph-mon[42034]: osdmap e1: 0 total, 0 up, 0 in 2024-05-10T03:32:38.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:37 smithi045 ceph-mon[42034]: mgrmap e1: no daemons active 2024-05-10T03:32:38.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:37 smithi045 ceph-mon[42034]: from='client.? 172.21.15.45:0/21858982' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-10T03:32:38.611 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-05-10T03:32:38.612 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout [global] 2024-05-10T03:32:38.612 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout fsid = d2a0bafa-0e7d-11ef-bc98-c7b262605968 2024-05-10T03:32:38.612 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.45:3300,v1:172.21.15.45:6789] 2024-05-10T03:32:38.612 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-10T03:32:38.612 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-10T03:32:38.612 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-10T03:32:38.612 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-10T03:32:38.612 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-05-10T03:32:38.612 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-10T03:32:38.612 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-10T03:32:38.612 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-05-10T03:32:38.612 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout [osd] 2024-05-10T03:32:38.612 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-10T03:32:38.613 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-10T03:32:38.613 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-10T03:32:38.613 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-10T03:32:38.613 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-10T03:32:38.613 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.140+0000 7f0adfa80700 1 Processor -- start 2024-05-10T03:32:38.613 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.140+0000 7f0adfa80700 1 -- start start 2024-05-10T03:32:38.613 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.141+0000 7f0adfa80700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad807ac50 0x7f0ad810a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:38.613 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.141+0000 7f0adfa80700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad810a640 con 0x7f0ad807ac50 2024-05-10T03:32:38.613 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.141+0000 7f0add81c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad807ac50 0x7f0ad810a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:32:38.613 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.141+0000 7f0add81c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad807ac50 0x7f0ad810a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52140/0 (socket says 172.21.15.45:52140) 2024-05-10T03:32:38.613 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.141+0000 7f0add81c700 1 -- 172.21.15.45:0/3931347798 learned_addr learned my addr 172.21.15.45:0/3931347798 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:32:38.613 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.141+0000 7f0add81c700 1 -- 172.21.15.45:0/3931347798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad810a780 con 0x7f0ad807ac50 2024-05-10T03:32:38.613 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.141+0000 7f0add81c700 1 --2- 172.21.15.45:0/3931347798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad807ac50 0x7f0ad810a030 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40098a0 tx=0x7f0ad4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7982f23522048cf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:32:38.613 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.142+0000 7f0adc81a700 1 -- 172.21.15.45:0/3931347798 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ad4004160 con 0x7f0ad807ac50 2024-05-10T03:32:38.614 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.142+0000 7f0adc81a700 1 -- 172.21.15.45:0/3931347798 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad40042c0 con 0x7f0ad807ac50 2024-05-10T03:32:38.614 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.142+0000 7f0adc81a700 1 -- 172.21.15.45:0/3931347798 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ad40045a0 con 0x7f0ad807ac50 2024-05-10T03:32:38.614 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.142+0000 7f0adfa80700 1 -- 172.21.15.45:0/3931347798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad807ac50 msgr2=0x7f0ad810a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:32:38.614 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.142+0000 7f0adfa80700 1 --2- 172.21.15.45:0/3931347798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad807ac50 0x7f0ad810a030 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40098a0 tx=0x7f0ad4009bb0 comp rx=0 tx=0).stop 2024-05-10T03:32:38.614 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.142+0000 7f0adfa80700 1 -- 172.21.15.45:0/3931347798 shutdown_connections 2024-05-10T03:32:38.614 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.142+0000 7f0adfa80700 1 --2- 172.21.15.45:0/3931347798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad807ac50 0x7f0ad810a030 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:38.614 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.142+0000 7f0adfa80700 1 -- 172.21.15.45:0/3931347798 >> 172.21.15.45:0/3931347798 conn(0x7f0ad8101a60 msgr2=0x7f0ad8103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:32:38.614 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.143+0000 7f0adfa80700 1 -- 172.21.15.45:0/3931347798 shutdown_connections 2024-05-10T03:32:38.614 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.143+0000 7f0adfa80700 1 -- 172.21.15.45:0/3931347798 wait complete. 2024-05-10T03:32:38.614 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.143+0000 7f0adfa80700 1 Processor -- start 2024-05-10T03:32:38.614 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.143+0000 7f0adfa80700 1 -- start start 2024-05-10T03:32:38.614 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.143+0000 7f0adfa80700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad807ac50 0x7f0ad819acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:38.614 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.144+0000 7f0adfa80700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad819b1f0 con 0x7f0ad807ac50 2024-05-10T03:32:38.614 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.144+0000 7f0add81c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad807ac50 0x7f0ad819acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:32:38.615 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.144+0000 7f0add81c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad807ac50 0x7f0ad819acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52156/0 (socket says 172.21.15.45:52156) 2024-05-10T03:32:38.615 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.144+0000 7f0add81c700 1 -- 172.21.15.45:0/2699098884 learned_addr learned my addr 172.21.15.45:0/2699098884 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:32:38.615 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.144+0000 7f0add81c700 1 -- 172.21.15.45:0/2699098884 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad4009550 con 0x7f0ad807ac50 2024-05-10T03:32:38.615 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.144+0000 7f0add81c700 1 --2- 172.21.15.45:0/2699098884 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad807ac50 0x7f0ad819acb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4004000 tx=0x7f0ad4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:32:38.615 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.144+0000 7f0acaffd700 1 -- 172.21.15.45:0/2699098884 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ad4011630 con 0x7f0ad807ac50 2024-05-10T03:32:38.615 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.144+0000 7f0acaffd700 1 -- 172.21.15.45:0/2699098884 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad4011790 con 0x7f0ad807ac50 2024-05-10T03:32:38.615 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.144+0000 7f0adfa80700 1 -- 172.21.15.45:0/2699098884 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad819b3f0 con 0x7f0ad807ac50 2024-05-10T03:32:38.615 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.144+0000 7f0acaffd700 1 -- 172.21.15.45:0/2699098884 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ad4011a30 con 0x7f0ad807ac50 2024-05-10T03:32:38.615 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.144+0000 7f0adfa80700 1 -- 172.21.15.45:0/2699098884 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad819b890 con 0x7f0ad807ac50 2024-05-10T03:32:38.615 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.145+0000 7f0acaffd700 1 -- 172.21.15.45:0/2699098884 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f0ad4021070 con 0x7f0ad807ac50 2024-05-10T03:32:38.615 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.145+0000 7f0acaffd700 1 -- 172.21.15.45:0/2699098884 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0ad401b780 con 0x7f0ad807ac50 2024-05-10T03:32:38.615 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.146+0000 7f0adfa80700 1 -- 172.21.15.45:0/2699098884 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad81947d0 con 0x7f0ad807ac50 2024-05-10T03:32:38.615 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.148+0000 7f0acaffd700 1 -- 172.21.15.45:0/2699098884 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f0ad401ad00 con 0x7f0ad807ac50 2024-05-10T03:32:38.615 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.220+0000 7f0adfa80700 1 -- 172.21.15.45:0/2699098884 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f0ad810aaf0 con 0x7f0ad807ac50 2024-05-10T03:32:38.615 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.225+0000 7f0acaffd700 1 -- 172.21.15.45:0/2699098884 <== mon.0 v2:172.21.15.45:3300/0 7 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f0ad401b990 con 0x7f0ad807ac50 2024-05-10T03:32:38.616 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.225+0000 7f0acaffd700 1 -- 172.21.15.45:0/2699098884 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f0ad402c7c0 con 0x7f0ad807ac50 2024-05-10T03:32:38.616 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.226+0000 7f0adfa80700 1 -- 172.21.15.45:0/2699098884 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad807ac50 msgr2=0x7f0ad819acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:32:38.616 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.226+0000 7f0adfa80700 1 --2- 172.21.15.45:0/2699098884 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad807ac50 0x7f0ad819acb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4004000 tx=0x7f0ad4004750 comp rx=0 tx=0).stop 2024-05-10T03:32:38.616 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.226+0000 7f0adfa80700 1 -- 172.21.15.45:0/2699098884 shutdown_connections 2024-05-10T03:32:38.616 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.226+0000 7f0adfa80700 1 --2- 172.21.15.45:0/2699098884 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad807ac50 0x7f0ad819acb0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:38.616 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.226+0000 7f0adfa80700 1 -- 172.21.15.45:0/2699098884 >> 172.21.15.45:0/2699098884 conn(0x7f0ad8101a60 msgr2=0x7f0ad8102790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:32:38.616 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.226+0000 7f0adfa80700 1 -- 172.21.15.45:0/2699098884 shutdown_connections 2024-05-10T03:32:38.616 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:38.226+0000 7f0adfa80700 1 -- 172.21.15.45:0/2699098884 wait complete. 2024-05-10T03:32:38.616 INFO:teuthology.orchestra.run.smithi045.stdout:Generating new minimal ceph.conf... 2024-05-10T03:32:39.145 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:38 smithi045 ceph-mon[42034]: from='client.? 172.21.15.45:0/2699098884' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-10T03:32:39.145 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:38 smithi045 ceph-mon[42034]: from='client.? 172.21.15.45:0/2699098884' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-10T03:32:39.484 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.029+0000 7f0921125700 1 Processor -- start 2024-05-10T03:32:39.485 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.029+0000 7f0921125700 1 -- start start 2024-05-10T03:32:39.485 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.029+0000 7f0921125700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091c107ff0 0x7f091c10a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:39.485 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.029+0000 7f0921125700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091c07ad60 con 0x7f091c107ff0 2024-05-10T03:32:39.485 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.029+0000 7f091ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091c107ff0 0x7f091c10a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:32:39.485 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.029+0000 7f091ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091c107ff0 0x7f091c10a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52162/0 (socket says 172.21.15.45:52162) 2024-05-10T03:32:39.485 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.029+0000 7f091ad9d700 1 -- 172.21.15.45:0/1400456781 learned_addr learned my addr 172.21.15.45:0/1400456781 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:32:39.485 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.029+0000 7f091ad9d700 1 -- 172.21.15.45:0/1400456781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091c07aea0 con 0x7f091c107ff0 2024-05-10T03:32:39.485 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.030+0000 7f091ad9d700 1 --2- 172.21.15.45:0/1400456781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091c107ff0 0x7f091c10a410 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f09100098a0 tx=0x7f0910009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e250b2b0b6c7b2cc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:32:39.485 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.030+0000 7f0919d9b700 1 -- 172.21.15.45:0/1400456781 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0910004160 con 0x7f091c107ff0 2024-05-10T03:32:39.485 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.030+0000 7f0919d9b700 1 -- 172.21.15.45:0/1400456781 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f09100042c0 con 0x7f091c107ff0 2024-05-10T03:32:39.485 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.030+0000 7f0919d9b700 1 -- 172.21.15.45:0/1400456781 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0910011ac0 con 0x7f091c107ff0 2024-05-10T03:32:39.485 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.031+0000 7f0921125700 1 -- 172.21.15.45:0/1400456781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091c107ff0 msgr2=0x7f091c10a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:32:39.486 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.031+0000 7f0921125700 1 --2- 172.21.15.45:0/1400456781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091c107ff0 0x7f091c10a410 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f09100098a0 tx=0x7f0910009bb0 comp rx=0 tx=0).stop 2024-05-10T03:32:39.486 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.031+0000 7f0921125700 1 -- 172.21.15.45:0/1400456781 shutdown_connections 2024-05-10T03:32:39.486 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.031+0000 7f0921125700 1 --2- 172.21.15.45:0/1400456781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091c107ff0 0x7f091c10a410 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:39.486 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.031+0000 7f0921125700 1 -- 172.21.15.45:0/1400456781 >> 172.21.15.45:0/1400456781 conn(0x7f091c101a30 msgr2=0x7f091c103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:32:39.486 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.031+0000 7f0921125700 1 -- 172.21.15.45:0/1400456781 shutdown_connections 2024-05-10T03:32:39.486 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.031+0000 7f0921125700 1 -- 172.21.15.45:0/1400456781 wait complete. 2024-05-10T03:32:39.486 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.032+0000 7f0921125700 1 Processor -- start 2024-05-10T03:32:39.486 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.032+0000 7f0921125700 1 -- start start 2024-05-10T03:32:39.486 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.032+0000 7f0921125700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091c107ff0 0x7f091c19b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:39.486 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.032+0000 7f0921125700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091c19ba80 con 0x7f091c107ff0 2024-05-10T03:32:39.486 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.032+0000 7f091ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091c107ff0 0x7f091c19b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:32:39.486 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.032+0000 7f091ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091c107ff0 0x7f091c19b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52176/0 (socket says 172.21.15.45:52176) 2024-05-10T03:32:39.486 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.032+0000 7f091ad9d700 1 -- 172.21.15.45:0/1490551561 learned_addr learned my addr 172.21.15.45:0/1490551561 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:32:39.487 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.033+0000 7f091ad9d700 1 -- 172.21.15.45:0/1490551561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0910009550 con 0x7f091c107ff0 2024-05-10T03:32:39.487 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.033+0000 7f091ad9d700 1 --2- 172.21.15.45:0/1490551561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091c107ff0 0x7f091c19b540 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0910009fb0 tx=0x7f0910011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:32:39.487 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.033+0000 7f0903fff700 1 -- 172.21.15.45:0/1490551561 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09100038b0 con 0x7f091c107ff0 2024-05-10T03:32:39.487 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.033+0000 7f0921125700 1 -- 172.21.15.45:0/1490551561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f091c19bc80 con 0x7f091c107ff0 2024-05-10T03:32:39.487 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.033+0000 7f0903fff700 1 -- 172.21.15.45:0/1490551561 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f0910003a10 con 0x7f091c107ff0 2024-05-10T03:32:39.487 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.033+0000 7f0903fff700 1 -- 172.21.15.45:0/1490551561 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09100195e0 con 0x7f091c107ff0 2024-05-10T03:32:39.487 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.033+0000 7f0921125700 1 -- 172.21.15.45:0/1490551561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091c19c120 con 0x7f091c107ff0 2024-05-10T03:32:39.487 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.033+0000 7f0903fff700 1 -- 172.21.15.45:0/1490551561 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f0910019bc0 con 0x7f091c107ff0 2024-05-10T03:32:39.487 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.033+0000 7f0903fff700 1 -- 172.21.15.45:0/1490551561 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0910024730 con 0x7f091c107ff0 2024-05-10T03:32:39.487 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.034+0000 7f0921125700 1 -- 172.21.15.45:0/1490551561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091c10b6e0 con 0x7f091c107ff0 2024-05-10T03:32:39.487 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.037+0000 7f0903fff700 1 -- 172.21.15.45:0/1490551561 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f0910003b80 con 0x7f091c107ff0 2024-05-10T03:32:39.487 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.111+0000 7f0921125700 1 -- 172.21.15.45:0/1490551561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f091c19eb60 con 0x7f091c107ff0 2024-05-10T03:32:39.487 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.111+0000 7f0903fff700 1 -- 172.21.15.45:0/1490551561 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f091001a9f0 con 0x7f091c107ff0 2024-05-10T03:32:39.487 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.112+0000 7f0921125700 1 -- 172.21.15.45:0/1490551561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091c107ff0 msgr2=0x7f091c19b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:32:39.488 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.112+0000 7f0921125700 1 --2- 172.21.15.45:0/1490551561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091c107ff0 0x7f091c19b540 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0910009fb0 tx=0x7f0910011b20 comp rx=0 tx=0).stop 2024-05-10T03:32:39.488 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.112+0000 7f0921125700 1 -- 172.21.15.45:0/1490551561 shutdown_connections 2024-05-10T03:32:39.488 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.112+0000 7f0921125700 1 --2- 172.21.15.45:0/1490551561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091c107ff0 0x7f091c19b540 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:39.488 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.112+0000 7f0921125700 1 -- 172.21.15.45:0/1490551561 >> 172.21.15.45:0/1490551561 conn(0x7f091c101a30 msgr2=0x7f091c1022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:32:39.488 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.112+0000 7f0921125700 1 -- 172.21.15.45:0/1490551561 shutdown_connections 2024-05-10T03:32:39.488 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:39.112+0000 7f0921125700 1 -- 172.21.15.45:0/1490551561 wait complete. 2024-05-10T03:32:39.488 INFO:teuthology.orchestra.run.smithi045.stdout:Restarting the monitor... 2024-05-10T03:32:39.717 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:39 smithi045 systemd[1]: Stopping Ceph mon.a for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:32:40.020 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:39 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mon-a[42011]: 2024-05-10T03:32:39.712+0000 7ff88d72b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:32:40.020 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:39 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mon-a[42011]: 2024-05-10T03:32:39.712+0000 7ff88d72b700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-10T03:32:40.020 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:39 smithi045 bash[42362]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mon-a 2024-05-10T03:32:40.610 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 systemd[1]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mon.a.service: Succeeded. 2024-05-10T03:32:40.610 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 systemd[1]: Stopped Ceph mon.a for d2a0bafa-0e7d-11ef-bc98-c7b262605968. 2024-05-10T03:32:40.610 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 systemd[1]: Starting Ceph mon.a for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:32:40.658 INFO:teuthology.orchestra.run.smithi045.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-10T03:32:40.676 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 bash[42482]: 8adf55387e85dd52fc2cd1831a943966635ff27f0a10d7d89c250d92cc85213a 2024-05-10T03:32:40.676 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 systemd[1]: Started Ceph mon.a for d2a0bafa-0e7d-11ef-bc98-c7b262605968. 2024-05-10T03:32:40.676 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: set uid:gid to 167:167 (ceph:ceph) 2024-05-10T03:32:41.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: ceph version 18.2.2-1330-g50174015 (50174015a7e79f951b988949abe236791f52d4da) reef (stable), process ceph-mon, pid 7 2024-05-10T03:32:41.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: pidfile_write: ignore empty --pid-file 2024-05-10T03:32:41.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: load: jerasure load: lrc 2024-05-10T03:32:41.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: RocksDB version: 7.9.2 2024-05-10T03:32:41.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Git sha 0 2024-05-10T03:32:41.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Compile date 2024-05-10 00:51:33 2024-05-10T03:32:41.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: DB SUMMARY 2024-05-10T03:32:41.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: DB Session ID: S1K4N1CL9CKZXJRRS68X 2024-05-10T03:32:41.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: CURRENT file: CURRENT 2024-05-10T03:32:41.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: IDENTITY file: IDENTITY 2024-05-10T03:32:41.036 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-05-10T03:32:41.036 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-05-10T03:32:41.036 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 98076 ; 2024-05-10T03:32:41.036 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.error_if_exists: 0 2024-05-10T03:32:41.036 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.create_if_missing: 0 2024-05-10T03:32:41.036 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.paranoid_checks: 1 2024-05-10T03:32:41.036 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-10T03:32:41.036 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-10T03:32:41.036 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-10T03:32:41.036 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.env: 0x555c6b504460 2024-05-10T03:32:41.036 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.fs: PosixFileSystem 2024-05-10T03:32:41.036 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.info_log: 0x555c6c379760 2024-05-10T03:32:41.036 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_file_opening_threads: 16 2024-05-10T03:32:41.036 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.statistics: (nil) 2024-05-10T03:32:41.037 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.use_fsync: 0 2024-05-10T03:32:41.037 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_log_file_size: 0 2024-05-10T03:32:41.037 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-10T03:32:41.037 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-10T03:32:41.037 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.keep_log_file_num: 1000 2024-05-10T03:32:41.037 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.recycle_log_file_num: 0 2024-05-10T03:32:41.037 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.allow_fallocate: 1 2024-05-10T03:32:41.037 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.allow_mmap_reads: 0 2024-05-10T03:32:41.037 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.allow_mmap_writes: 0 2024-05-10T03:32:41.037 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.use_direct_reads: 0 2024-05-10T03:32:41.037 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-10T03:32:41.037 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.create_missing_column_families: 0 2024-05-10T03:32:41.037 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.db_log_dir: 2024-05-10T03:32:41.037 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.wal_dir: 2024-05-10T03:32:41.037 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-10T03:32:41.038 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-10T03:32:41.039 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-10T03:32:41.039 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-10T03:32:41.039 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-10T03:32:41.039 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-10T03:32:41.039 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.advise_random_on_open: 1 2024-05-10T03:32:41.039 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.db_write_buffer_size: 0 2024-05-10T03:32:41.039 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.write_buffer_manager: 0x555c6c2bd0e0 2024-05-10T03:32:41.040 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-10T03:32:41.040 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-10T03:32:41.040 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-10T03:32:41.040 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.rate_limiter: (nil) 2024-05-10T03:32:41.040 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-10T03:32:41.040 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.wal_recovery_mode: 2 2024-05-10T03:32:41.040 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.enable_thread_tracking: 0 2024-05-10T03:32:41.040 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.enable_pipelined_write: 0 2024-05-10T03:32:41.040 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.unordered_write: 0 2024-05-10T03:32:41.040 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-10T03:32:41.040 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-10T03:32:41.040 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-10T03:32:41.040 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-10T03:32:41.041 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.row_cache: None 2024-05-10T03:32:41.041 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.wal_filter: None 2024-05-10T03:32:41.041 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-10T03:32:41.041 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.allow_ingest_behind: 0 2024-05-10T03:32:41.041 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.two_write_queues: 0 2024-05-10T03:32:41.041 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.manual_wal_flush: 0 2024-05-10T03:32:41.041 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.wal_compression: 0 2024-05-10T03:32:41.041 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.atomic_flush: 0 2024-05-10T03:32:41.041 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-10T03:32:41.041 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-10T03:32:41.041 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-10T03:32:41.041 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.log_readahead_size: 0 2024-05-10T03:32:41.041 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-10T03:32:41.041 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.best_efforts_recovery: 0 2024-05-10T03:32:41.042 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-10T03:32:41.042 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-10T03:32:41.042 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.allow_data_in_errors: 0 2024-05-10T03:32:41.042 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.db_host_id: __hostname__ 2024-05-10T03:32:41.042 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-10T03:32:41.042 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_background_jobs: 2 2024-05-10T03:32:41.042 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_background_compactions: -1 2024-05-10T03:32:41.042 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_subcompactions: 1 2024-05-10T03:32:41.042 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-10T03:32:41.042 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-10T03:32:41.042 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-10T03:32:41.042 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_total_wal_size: 0 2024-05-10T03:32:41.043 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-10T03:32:41.043 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-10T03:32:41.043 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-10T03:32:41.043 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-10T03:32:41.043 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_open_files: -1 2024-05-10T03:32:41.043 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.bytes_per_sync: 0 2024-05-10T03:32:41.043 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-10T03:32:41.043 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-10T03:32:41.043 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.compaction_readahead_size: 0 2024-05-10T03:32:41.043 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_background_flushes: -1 2024-05-10T03:32:41.043 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Compression algorithms supported: 2024-05-10T03:32:41.043 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-10T03:32:41.043 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: kZSTD supported: 0 2024-05-10T03:32:41.043 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: kXpressCompression supported: 0 2024-05-10T03:32:41.043 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: kLZ4HCCompression supported: 1 2024-05-10T03:32:41.044 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: kZlibCompression supported: 1 2024-05-10T03:32:41.044 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: kSnappyCompression supported: 1 2024-05-10T03:32:41.044 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: kLZ4Compression supported: 1 2024-05-10T03:32:41.044 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: kBZip2Compression supported: 0 2024-05-10T03:32:41.044 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-10T03:32:41.044 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-10T03:32:41.044 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-05-10T03:32:41.044 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-10T03:32:41.044 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-10T03:32:41.044 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.merge_operator: 2024-05-10T03:32:41.044 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.compaction_filter: None 2024-05-10T03:32:41.044 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.compaction_filter_factory: None 2024-05-10T03:32:41.044 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.sst_partitioner_factory: None 2024-05-10T03:32:41.044 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-10T03:32:41.044 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-10T03:32:41.045 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555c6c379880) 2024-05-10T03:32:41.045 INFO:journalctl@ceph.mon.a.smithi045.stdout: cache_index_and_filter_blocks: 1 2024-05-10T03:32:41.045 INFO:journalctl@ceph.mon.a.smithi045.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-10T03:32:41.045 INFO:journalctl@ceph.mon.a.smithi045.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-10T03:32:41.045 INFO:journalctl@ceph.mon.a.smithi045.stdout: pin_top_level_index_and_filter: 1 2024-05-10T03:32:41.045 INFO:journalctl@ceph.mon.a.smithi045.stdout: index_type: 0 2024-05-10T03:32:41.045 INFO:journalctl@ceph.mon.a.smithi045.stdout: data_block_index_type: 0 2024-05-10T03:32:41.045 INFO:journalctl@ceph.mon.a.smithi045.stdout: index_shortening: 1 2024-05-10T03:32:41.045 INFO:journalctl@ceph.mon.a.smithi045.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-10T03:32:41.045 INFO:journalctl@ceph.mon.a.smithi045.stdout: checksum: 4 2024-05-10T03:32:41.045 INFO:journalctl@ceph.mon.a.smithi045.stdout: no_block_cache: 0 2024-05-10T03:32:41.045 INFO:journalctl@ceph.mon.a.smithi045.stdout: block_cache: 0x555c6c33f1f0 2024-05-10T03:32:41.045 INFO:journalctl@ceph.mon.a.smithi045.stdout: block_cache_name: BinnedLRUCache 2024-05-10T03:32:41.045 INFO:journalctl@ceph.mon.a.smithi045.stdout: block_cache_options: 2024-05-10T03:32:41.046 INFO:journalctl@ceph.mon.a.smithi045.stdout: capacity : 536870912 2024-05-10T03:32:41.046 INFO:journalctl@ceph.mon.a.smithi045.stdout: num_shard_bits : 4 2024-05-10T03:32:41.046 INFO:journalctl@ceph.mon.a.smithi045.stdout: strict_capacity_limit : 0 2024-05-10T03:32:41.046 INFO:journalctl@ceph.mon.a.smithi045.stdout: high_pri_pool_ratio: 0.000 2024-05-10T03:32:41.046 INFO:journalctl@ceph.mon.a.smithi045.stdout: block_cache_compressed: (nil) 2024-05-10T03:32:41.046 INFO:journalctl@ceph.mon.a.smithi045.stdout: persistent_cache: (nil) 2024-05-10T03:32:41.046 INFO:journalctl@ceph.mon.a.smithi045.stdout: block_size: 4096 2024-05-10T03:32:41.046 INFO:journalctl@ceph.mon.a.smithi045.stdout: block_size_deviation: 10 2024-05-10T03:32:41.046 INFO:journalctl@ceph.mon.a.smithi045.stdout: block_restart_interval: 16 2024-05-10T03:32:41.046 INFO:journalctl@ceph.mon.a.smithi045.stdout: index_block_restart_interval: 1 2024-05-10T03:32:41.046 INFO:journalctl@ceph.mon.a.smithi045.stdout: metadata_block_size: 4096 2024-05-10T03:32:41.046 INFO:journalctl@ceph.mon.a.smithi045.stdout: partition_filters: 0 2024-05-10T03:32:41.046 INFO:journalctl@ceph.mon.a.smithi045.stdout: use_delta_encoding: 1 2024-05-10T03:32:41.046 INFO:journalctl@ceph.mon.a.smithi045.stdout: filter_policy: bloomfilter 2024-05-10T03:32:41.047 INFO:journalctl@ceph.mon.a.smithi045.stdout: whole_key_filtering: 1 2024-05-10T03:32:41.047 INFO:journalctl@ceph.mon.a.smithi045.stdout: verify_compression: 0 2024-05-10T03:32:41.047 INFO:journalctl@ceph.mon.a.smithi045.stdout: read_amp_bytes_per_bit: 0 2024-05-10T03:32:41.047 INFO:journalctl@ceph.mon.a.smithi045.stdout: format_version: 5 2024-05-10T03:32:41.047 INFO:journalctl@ceph.mon.a.smithi045.stdout: enable_index_compression: 1 2024-05-10T03:32:41.047 INFO:journalctl@ceph.mon.a.smithi045.stdout: block_align: 0 2024-05-10T03:32:41.047 INFO:journalctl@ceph.mon.a.smithi045.stdout: max_auto_readahead_size: 262144 2024-05-10T03:32:41.047 INFO:journalctl@ceph.mon.a.smithi045.stdout: prepopulate_block_cache: 0 2024-05-10T03:32:41.047 INFO:journalctl@ceph.mon.a.smithi045.stdout: initial_auto_readahead_size: 8192 2024-05-10T03:32:41.047 INFO:journalctl@ceph.mon.a.smithi045.stdout: num_file_reads_for_auto_readahead: 2 2024-05-10T03:32:41.047 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.write_buffer_size: 33554432 2024-05-10T03:32:41.047 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_write_buffer_number: 2 2024-05-10T03:32:41.047 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.compression: NoCompression 2024-05-10T03:32:41.047 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.bottommost_compression: Disabled 2024-05-10T03:32:41.048 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.prefix_extractor: nullptr 2024-05-10T03:32:41.048 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-10T03:32:41.048 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.num_levels: 7 2024-05-10T03:32:41.048 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-10T03:32:41.048 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-10T03:32:41.048 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-10T03:32:41.048 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-10T03:32:41.048 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-10T03:32:41.048 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-10T03:32:41.048 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-10T03:32:41.048 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-10T03:32:41.048 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-10T03:32:41.048 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-10T03:32:41.048 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-10T03:32:41.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-10T03:32:41.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-10T03:32:41.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.compression_opts.level: 32767 2024-05-10T03:32:41.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.compression_opts.strategy: 0 2024-05-10T03:32:41.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-10T03:32:41.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-10T03:32:41.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-10T03:32:41.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-10T03:32:41.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.compression_opts.enabled: false 2024-05-10T03:32:41.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-10T03:32:41.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-10T03:32:41.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-10T03:32:41.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-10T03:32:41.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.target_file_size_base: 67108864 2024-05-10T03:32:41.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-10T03:32:41.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-10T03:32:41.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-10T03:32:41.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-10T03:32:41.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-10T03:32:41.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-10T03:32:41.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-10T03:32:41.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-10T03:32:41.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-10T03:32:41.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-10T03:32:41.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-10T03:32:41.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-10T03:32:41.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-10T03:32:41.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-10T03:32:41.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.arena_block_size: 1048576 2024-05-10T03:32:41.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-10T03:32:41.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-10T03:32:41.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.disable_auto_compactions: 0 2024-05-10T03:32:41.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-10T03:32:41.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-10T03:32:41.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-10T03:32:41.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-10T03:32:41.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-10T03:32:41.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-10T03:32:41.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-10T03:32:41.052 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-10T03:32:41.052 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-10T03:32:41.052 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-10T03:32:41.052 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.table_properties_collectors: 2024-05-10T03:32:41.052 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.inplace_update_support: 0 2024-05-10T03:32:41.052 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-10T03:32:41.052 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-10T03:32:41.052 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-10T03:32:41.052 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-10T03:32:41.052 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.bloom_locality: 0 2024-05-10T03:32:41.052 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.max_successive_merges: 0 2024-05-10T03:32:41.052 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-10T03:32:41.052 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.paranoid_file_checks: 0 2024-05-10T03:32:41.052 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.force_consistency_checks: 1 2024-05-10T03:32:41.053 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.report_bg_io_stats: 0 2024-05-10T03:32:41.053 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.ttl: 2592000 2024-05-10T03:32:41.053 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-10T03:32:41.053 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-10T03:32:41.053 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-10T03:32:41.053 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.enable_blob_files: false 2024-05-10T03:32:41.053 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.min_blob_size: 0 2024-05-10T03:32:41.053 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.blob_file_size: 268435456 2024-05-10T03:32:41.053 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-10T03:32:41.053 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-10T03:32:41.053 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-10T03:32:41.053 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-10T03:32:41.053 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-10T03:32:41.053 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.blob_file_starting_level: 0 2024-05-10T03:32:41.053 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-10T03:32:41.054 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-05-10T03:32:41.054 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-05-10T03:32:41.054 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 503f8f3a-97dc-4c4f-b265-e3e7b018d35c 2024-05-10T03:32:41.054 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715311960682067, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-05-10T03:32:41.054 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-05-10T03:32:41.054 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715311960683429, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 93383, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 309, "table_properties": {"data_size": 91388, "index_size": 277, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13743, "raw_average_key_size": 50, "raw_value_size": 83941, "raw_average_value_size": 308, "num_data_blocks": 11, "num_entries": 272, "num_filter_entries": 272, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715311960, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "503f8f3a-97dc-4c4f-b265-e3e7b018d35c", "db_session_id": "S1K4N1CL9CKZXJRRS68X", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-05-10T03:32:41.054 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715311960683513, "job": 1, "event": "recovery_finished"} 2024-05-10T03:32:41.054 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-05-10T03:32:41.054 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-10T03:32:41.054 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x555c6c2d1c00 2024-05-10T03:32:41.054 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: DB pointer 0x555c710c0000 2024-05-10T03:32:41.054 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-10T03:32:41.054 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-10T03:32:41.054 INFO:journalctl@ceph.mon.a.smithi045.stdout: ** DB Stats ** 2024-05-10T03:32:41.055 INFO:journalctl@ceph.mon.a.smithi045.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-10T03:32:41.055 INFO:journalctl@ceph.mon.a.smithi045.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-10T03:32:41.055 INFO:journalctl@ceph.mon.a.smithi045.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-10T03:32:41.055 INFO:journalctl@ceph.mon.a.smithi045.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-10T03:32:41.055 INFO:journalctl@ceph.mon.a.smithi045.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-10T03:32:41.055 INFO:journalctl@ceph.mon.a.smithi045.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-10T03:32:41.055 INFO:journalctl@ceph.mon.a.smithi045.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-10T03:32:41.055 INFO:journalctl@ceph.mon.a.smithi045.stdout: 2024-05-10T03:32:41.055 INFO:journalctl@ceph.mon.a.smithi045.stdout: ** Compaction Stats [default] ** 2024-05-10T03:32:41.055 INFO:journalctl@ceph.mon.a.smithi045.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-10T03:32:41.055 INFO:journalctl@ceph.mon.a.smithi045.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-10T03:32:41.055 INFO:journalctl@ceph.mon.a.smithi045.stdout: L0 2/0 93.03 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 123.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-10T03:32:41.055 INFO:journalctl@ceph.mon.a.smithi045.stdout: Sum 2/0 93.03 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 123.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-10T03:32:41.055 INFO:journalctl@ceph.mon.a.smithi045.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 123.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-10T03:32:41.056 INFO:journalctl@ceph.mon.a.smithi045.stdout: 2024-05-10T03:32:41.056 INFO:journalctl@ceph.mon.a.smithi045.stdout: ** Compaction Stats [default] ** 2024-05-10T03:32:41.056 INFO:journalctl@ceph.mon.a.smithi045.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-10T03:32:41.056 INFO:journalctl@ceph.mon.a.smithi045.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-10T03:32:41.056 INFO:journalctl@ceph.mon.a.smithi045.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 123.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-10T03:32:41.056 INFO:journalctl@ceph.mon.a.smithi045.stdout: 2024-05-10T03:32:41.056 INFO:journalctl@ceph.mon.a.smithi045.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-10T03:32:41.056 INFO:journalctl@ceph.mon.a.smithi045.stdout: 2024-05-10T03:32:41.056 INFO:journalctl@ceph.mon.a.smithi045.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-10T03:32:41.056 INFO:journalctl@ceph.mon.a.smithi045.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-10T03:32:41.056 INFO:journalctl@ceph.mon.a.smithi045.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-10T03:32:41.056 INFO:journalctl@ceph.mon.a.smithi045.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-10T03:32:41.056 INFO:journalctl@ceph.mon.a.smithi045.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-10T03:32:41.056 INFO:journalctl@ceph.mon.a.smithi045.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-10T03:32:41.057 INFO:journalctl@ceph.mon.a.smithi045.stdout: Cumulative compaction: 0.00 GB write, 21.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-10T03:32:41.057 INFO:journalctl@ceph.mon.a.smithi045.stdout: Interval compaction: 0.00 GB write, 21.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-10T03:32:41.057 INFO:journalctl@ceph.mon.a.smithi045.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-10T03:32:41.057 INFO:journalctl@ceph.mon.a.smithi045.stdout: Block cache BinnedLRUCache@0x555c6c33f1f0#7 capacity: 512.00 MB usage: 1.38 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-05-10T03:32:41.057 INFO:journalctl@ceph.mon.a.smithi045.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.91 KB,0.000172853%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-05-10T03:32:41.057 INFO:journalctl@ceph.mon.a.smithi045.stdout: 2024-05-10T03:32:41.057 INFO:journalctl@ceph.mon.a.smithi045.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-10T03:32:41.057 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: starting mon.a rank 0 at public addrs [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] at bind addrs [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 2024-05-10T03:32:41.057 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: mon.a@-1(???) e1 preinit fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 2024-05-10T03:32:41.057 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: mon.a@-1(???).mds e1 new map 2024-05-10T03:32:41.057 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: mon.a@-1(???).mds e1 print_map 2024-05-10T03:32:41.057 INFO:journalctl@ceph.mon.a.smithi045.stdout: e1 2024-05-10T03:32:41.057 INFO:journalctl@ceph.mon.a.smithi045.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-10T03:32:41.057 INFO:journalctl@ceph.mon.a.smithi045.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-10T03:32:41.058 INFO:journalctl@ceph.mon.a.smithi045.stdout: legacy client fscid: -1 2024-05-10T03:32:41.058 INFO:journalctl@ceph.mon.a.smithi045.stdout: 2024-05-10T03:32:41.058 INFO:journalctl@ceph.mon.a.smithi045.stdout: No filesystems configured 2024-05-10T03:32:41.058 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-10T03:32:41.058 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-10T03:32:41.058 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-10T03:32:41.058 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-10T03:32:41.058 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-10T03:32:41.058 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-10T03:32:41.058 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: monmap e1: 1 mons at {a=[v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-10T03:32:41.058 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: fsmap 2024-05-10T03:32:41.058 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: osdmap e1: 0 total, 0 up, 0 in 2024-05-10T03:32:41.058 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:40 smithi045 ceph-mon[42520]: mgrmap e1: no daemons active 2024-05-10T03:32:41.525 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.068+0000 7fa0a94c8700 1 Processor -- start 2024-05-10T03:32:41.525 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.068+0000 7fa0a94c8700 1 -- start start 2024-05-10T03:32:41.525 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.068+0000 7fa0a94c8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0a407ac50 0x7fa0a410a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:41.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.068+0000 7fa0a94c8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a410a640 con 0x7fa0a407ac50 2024-05-10T03:32:41.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.069+0000 7fa0a2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0a407ac50 0x7fa0a410a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:32:41.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.069+0000 7fa0a2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0a407ac50 0x7fa0a410a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52192/0 (socket says 172.21.15.45:52192) 2024-05-10T03:32:41.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.069+0000 7fa0a2ffd700 1 -- 172.21.15.45:0/4236423800 learned_addr learned my addr 172.21.15.45:0/4236423800 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:32:41.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.069+0000 7fa0a2ffd700 1 -- 172.21.15.45:0/4236423800 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a410a780 con 0x7fa0a407ac50 2024-05-10T03:32:41.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.069+0000 7fa0a2ffd700 1 --2- 172.21.15.45:0/4236423800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0a407ac50 0x7fa0a410a030 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0098a0 tx=0x7fa08c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c70507411b0835 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:32:41.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.069+0000 7fa0a1ffb700 1 -- 172.21.15.45:0/4236423800 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa08c004160 con 0x7fa0a407ac50 2024-05-10T03:32:41.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.070+0000 7fa0a1ffb700 1 -- 172.21.15.45:0/4236423800 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fa08c0042c0 con 0x7fa0a407ac50 2024-05-10T03:32:41.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.070+0000 7fa0a1ffb700 1 -- 172.21.15.45:0/4236423800 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa08c011ac0 con 0x7fa0a407ac50 2024-05-10T03:32:41.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.070+0000 7fa0a94c8700 1 -- 172.21.15.45:0/4236423800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0a407ac50 msgr2=0x7fa0a410a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:32:41.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.070+0000 7fa0a94c8700 1 --2- 172.21.15.45:0/4236423800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0a407ac50 0x7fa0a410a030 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0098a0 tx=0x7fa08c009bb0 comp rx=0 tx=0).stop 2024-05-10T03:32:41.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.070+0000 7fa0a94c8700 1 -- 172.21.15.45:0/4236423800 shutdown_connections 2024-05-10T03:32:41.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.070+0000 7fa0a94c8700 1 --2- 172.21.15.45:0/4236423800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0a407ac50 0x7fa0a410a030 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:41.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.070+0000 7fa0a94c8700 1 -- 172.21.15.45:0/4236423800 >> 172.21.15.45:0/4236423800 conn(0x7fa0a4101a60 msgr2=0x7fa0a4103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:32:41.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.070+0000 7fa0a94c8700 1 -- 172.21.15.45:0/4236423800 shutdown_connections 2024-05-10T03:32:41.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.070+0000 7fa0a94c8700 1 -- 172.21.15.45:0/4236423800 wait complete. 2024-05-10T03:32:41.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.071+0000 7fa0a94c8700 1 Processor -- start 2024-05-10T03:32:41.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.071+0000 7fa0a94c8700 1 -- start start 2024-05-10T03:32:41.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.072+0000 7fa0a94c8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0a407ac50 0x7fa0a419b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:41.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.072+0000 7fa0a94c8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a419bb40 con 0x7fa0a407ac50 2024-05-10T03:32:41.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.072+0000 7fa0a2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0a407ac50 0x7fa0a419b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:32:41.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.072+0000 7fa0a2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0a407ac50 0x7fa0a419b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52194/0 (socket says 172.21.15.45:52194) 2024-05-10T03:32:41.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.072+0000 7fa0a2ffd700 1 -- 172.21.15.45:0/1951822758 learned_addr learned my addr 172.21.15.45:0/1951822758 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:32:41.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.072+0000 7fa0a2ffd700 1 -- 172.21.15.45:0/1951822758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08c009550 con 0x7fa0a407ac50 2024-05-10T03:32:41.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.072+0000 7fa0a2ffd700 1 --2- 172.21.15.45:0/1951822758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0a407ac50 0x7fa0a419b600 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa08c003f70 tx=0x7fa08c011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:32:41.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.072+0000 7fa09bfff700 1 -- 172.21.15.45:0/1951822758 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa08c0039f0 con 0x7fa0a407ac50 2024-05-10T03:32:41.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.073+0000 7fa09bfff700 1 -- 172.21.15.45:0/1951822758 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fa08c003b50 con 0x7fa0a407ac50 2024-05-10T03:32:41.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.073+0000 7fa0a94c8700 1 -- 172.21.15.45:0/1951822758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a419bd40 con 0x7fa0a407ac50 2024-05-10T03:32:41.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.073+0000 7fa09bfff700 1 -- 172.21.15.45:0/1951822758 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa08c01a690 con 0x7fa0a407ac50 2024-05-10T03:32:41.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.073+0000 7fa0a94c8700 1 -- 172.21.15.45:0/1951822758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a419c1e0 con 0x7fa0a407ac50 2024-05-10T03:32:41.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.073+0000 7fa09bfff700 1 -- 172.21.15.45:0/1951822758 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fa08c01ac70 con 0x7fa0a407ac50 2024-05-10T03:32:41.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.073+0000 7fa09bfff700 1 -- 172.21.15.45:0/1951822758 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa08c019700 con 0x7fa0a407ac50 2024-05-10T03:32:41.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.074+0000 7fa0a94c8700 1 -- 172.21.15.45:0/1951822758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a410b6a0 con 0x7fa0a407ac50 2024-05-10T03:32:41.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.077+0000 7fa09bfff700 1 -- 172.21.15.45:0/1951822758 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fa08c0249f0 con 0x7fa0a407ac50 2024-05-10T03:32:41.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.149+0000 7fa0a94c8700 1 -- 172.21.15.45:0/1951822758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fa0a410b860 con 0x7fa0a407ac50 2024-05-10T03:32:41.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.152+0000 7fa09bfff700 1 -- 172.21.15.45:0/1951822758 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa08c024430 con 0x7fa0a407ac50 2024-05-10T03:32:41.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.153+0000 7fa0a94c8700 1 -- 172.21.15.45:0/1951822758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0a407ac50 msgr2=0x7fa0a419b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:32:41.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.153+0000 7fa0a94c8700 1 --2- 172.21.15.45:0/1951822758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0a407ac50 0x7fa0a419b600 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa08c003f70 tx=0x7fa08c011b40 comp rx=0 tx=0).stop 2024-05-10T03:32:41.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.153+0000 7fa0a94c8700 1 -- 172.21.15.45:0/1951822758 shutdown_connections 2024-05-10T03:32:41.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.153+0000 7fa0a94c8700 1 --2- 172.21.15.45:0/1951822758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0a407ac50 0x7fa0a419b600 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:41.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.153+0000 7fa0a94c8700 1 -- 172.21.15.45:0/1951822758 >> 172.21.15.45:0/1951822758 conn(0x7fa0a4101a60 msgr2=0x7fa0a4102380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:32:41.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.153+0000 7fa0a94c8700 1 -- 172.21.15.45:0/1951822758 shutdown_connections 2024-05-10T03:32:41.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:41.153+0000 7fa0a94c8700 1 -- 172.21.15.45:0/1951822758 wait complete. 2024-05-10T03:32:41.528 INFO:teuthology.orchestra.run.smithi045.stdout:Wrote config to /etc/ceph/ceph.conf 2024-05-10T03:32:41.546 INFO:teuthology.orchestra.run.smithi045.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-10T03:32:41.546 INFO:teuthology.orchestra.run.smithi045.stdout:Creating mgr... 2024-05-10T03:32:41.546 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying port 0.0.0.0:9283 ... 2024-05-10T03:32:41.547 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying port 0.0.0.0:8765 ... 2024-05-10T03:32:41.811 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mgr.x 2024-05-10T03:32:41.812 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mgr.x.service: Unit ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mgr.x.service not loaded. 2024-05-10T03:32:41.913 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968.target.wants/ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@.service. 2024-05-10T03:32:42.154 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:41 smithi045 systemd[1]: Starting Ceph mgr.x for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:32:42.335 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-10T03:32:42.335 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout disabled 2024-05-10T03:32:42.345 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-10T03:32:42.345 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout inactive 2024-05-10T03:32:42.346 INFO:teuthology.orchestra.run.smithi045.stdout:firewalld.service is not enabled 2024-05-10T03:32:42.346 INFO:teuthology.orchestra.run.smithi045.stdout:Not possible to enable service . firewalld.service is not available 2024-05-10T03:32:42.357 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-10T03:32:42.357 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout disabled 2024-05-10T03:32:42.367 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-10T03:32:42.367 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout inactive 2024-05-10T03:32:42.367 INFO:teuthology.orchestra.run.smithi045.stdout:firewalld.service is not enabled 2024-05-10T03:32:42.367 INFO:teuthology.orchestra.run.smithi045.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-05-10T03:32:42.367 INFO:teuthology.orchestra.run.smithi045.stdout:Waiting for mgr to start... 2024-05-10T03:32:42.368 INFO:teuthology.orchestra.run.smithi045.stdout:Waiting for mgr... 2024-05-10T03:32:42.532 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:42 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1951822758' entity='client.admin' 2024-05-10T03:32:42.532 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:42 smithi045 bash[42754]: c851df018759835306173fbbaf9a4282b89a0aa6982c1640578c5d4d31271007 2024-05-10T03:32:42.532 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:42 smithi045 systemd[1]: Started Ceph mgr.x for d2a0bafa-0e7d-11ef-bc98-c7b262605968. 2024-05-10T03:32:43.120 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:42 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:42.803+0000 7f1b34812200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T03:32:43.120 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:42 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:42.926+0000 7f1b34812200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T03:32:43.120 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:43 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:43.029+0000 7f1b34812200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T03:32:43.294 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-05-10T03:32:43.294 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout { 2024-05-10T03:32:43.294 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "fsid": "d2a0bafa-0e7d-11ef-bc98-c7b262605968", 2024-05-10T03:32:43.294 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "health": { 2024-05-10T03:32:43.294 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-10T03:32:43.294 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-10T03:32:43.294 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-10T03:32:43.294 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:43.294 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-10T03:32:43.294 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-10T03:32:43.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 0 2024-05-10T03:32:43.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-05-10T03:32:43.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-10T03:32:43.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "a" 2024-05-10T03:32:43.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-05-10T03:32:43.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-05-10T03:32:43.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-10T03:32:43.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T03:32:43.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-05-10T03:32:43.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-10T03:32:43.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:43.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-10T03:32:43.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T03:32:43.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-10T03:32:43.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-10T03:32:43.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-10T03:32:43.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-10T03:32:43.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-10T03:32:43.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-10T03:32:43.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:43.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-10T03:32:43.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-10T03:32:43.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-10T03:32:43.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-10T03:32:43.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-10T03:32:43.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-10T03:32:43.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-10T03:32:43.297 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-10T03:32:43.297 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-10T03:32:43.297 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:43.297 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-10T03:32:43.297 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T03:32:43.297 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-10T03:32:43.297 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-10T03:32:43.297 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:43.297 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-10T03:32:43.297 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-10T03:32:43.297 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-10T03:32:43.297 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-10T03:32:43.297 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-10T03:32:43.298 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-10T03:32:43.298 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "restful" 2024-05-10T03:32:43.298 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-05-10T03:32:43.298 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-10T03:32:43.298 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:43.298 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-10T03:32:43.298 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T03:32:43.298 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "modified": "2024-05-10T03:32:36.840758+0000", 2024-05-10T03:32:43.298 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-10T03:32:43.298 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:43.298 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-10T03:32:43.298 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout } 2024-05-10T03:32:43.299 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.809+0000 7f77d5047700 1 Processor -- start 2024-05-10T03:32:43.299 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.809+0000 7f77d5047700 1 -- start start 2024-05-10T03:32:43.299 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.809+0000 7f77d5047700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77d0107fe0 0x7f77d010a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:43.299 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.809+0000 7f77d5047700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d007ad60 con 0x7f77d0107fe0 2024-05-10T03:32:43.299 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.810+0000 7f77ced9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77d0107fe0 0x7f77d010a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:32:43.299 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.810+0000 7f77ced9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77d0107fe0 0x7f77d010a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52228/0 (socket says 172.21.15.45:52228) 2024-05-10T03:32:43.299 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.810+0000 7f77ced9d700 1 -- 172.21.15.45:0/3813581831 learned_addr learned my addr 172.21.15.45:0/3813581831 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:32:43.299 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.810+0000 7f77ced9d700 1 -- 172.21.15.45:0/3813581831 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d007aea0 con 0x7f77d0107fe0 2024-05-10T03:32:43.299 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.810+0000 7f77ced9d700 1 --2- 172.21.15.45:0/3813581831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77d0107fe0 0x7f77d010a400 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f77c00098a0 tx=0x7f77c0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36243cd4b19b4f68 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:32:43.299 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.810+0000 7f77cdd9b700 1 -- 172.21.15.45:0/3813581831 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77c0004160 con 0x7f77d0107fe0 2024-05-10T03:32:43.299 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.810+0000 7f77cdd9b700 1 -- 172.21.15.45:0/3813581831 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f77c00042c0 con 0x7f77d0107fe0 2024-05-10T03:32:43.299 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.810+0000 7f77cdd9b700 1 -- 172.21.15.45:0/3813581831 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77c0011ac0 con 0x7f77d0107fe0 2024-05-10T03:32:43.299 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.811+0000 7f77d5047700 1 -- 172.21.15.45:0/3813581831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77d0107fe0 msgr2=0x7f77d010a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:32:43.300 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.811+0000 7f77d5047700 1 --2- 172.21.15.45:0/3813581831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77d0107fe0 0x7f77d010a400 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f77c00098a0 tx=0x7f77c0009bb0 comp rx=0 tx=0).stop 2024-05-10T03:32:43.300 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.812+0000 7f77d5047700 1 -- 172.21.15.45:0/3813581831 shutdown_connections 2024-05-10T03:32:43.300 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.812+0000 7f77d5047700 1 --2- 172.21.15.45:0/3813581831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77d0107fe0 0x7f77d010a400 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:43.300 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.812+0000 7f77d5047700 1 -- 172.21.15.45:0/3813581831 >> 172.21.15.45:0/3813581831 conn(0x7f77d0101a60 msgr2=0x7f77d0103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:32:43.300 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.812+0000 7f77d5047700 1 -- 172.21.15.45:0/3813581831 shutdown_connections 2024-05-10T03:32:43.300 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.812+0000 7f77d5047700 1 -- 172.21.15.45:0/3813581831 wait complete. 2024-05-10T03:32:43.300 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.813+0000 7f77d5047700 1 Processor -- start 2024-05-10T03:32:43.300 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.813+0000 7f77d5047700 1 -- start start 2024-05-10T03:32:43.300 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.814+0000 7f77d5047700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77d0107fe0 0x7f77d0107760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:43.300 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.814+0000 7f77d5047700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d0107ca0 con 0x7f77d0107fe0 2024-05-10T03:32:43.300 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.814+0000 7f77ced9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77d0107fe0 0x7f77d0107760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:32:43.300 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.814+0000 7f77ced9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77d0107fe0 0x7f77d0107760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52244/0 (socket says 172.21.15.45:52244) 2024-05-10T03:32:43.300 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.814+0000 7f77ced9d700 1 -- 172.21.15.45:0/1757116670 learned_addr learned my addr 172.21.15.45:0/1757116670 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:32:43.300 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.814+0000 7f77ced9d700 1 -- 172.21.15.45:0/1757116670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c0009550 con 0x7f77d0107fe0 2024-05-10T03:32:43.301 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.814+0000 7f77ced9d700 1 --2- 172.21.15.45:0/1757116670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77d0107fe0 0x7f77d0107760 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f77c0003f70 tx=0x7f77c0011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:32:43.301 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.815+0000 7f77b7fff700 1 -- 172.21.15.45:0/1757116670 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77c00039f0 con 0x7f77d0107fe0 2024-05-10T03:32:43.301 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.815+0000 7f77b7fff700 1 -- 172.21.15.45:0/1757116670 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f77c0003b50 con 0x7f77d0107fe0 2024-05-10T03:32:43.301 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.815+0000 7f77d5047700 1 -- 172.21.15.45:0/1757116670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d0105ef0 con 0x7f77d0107fe0 2024-05-10T03:32:43.301 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.815+0000 7f77b7fff700 1 -- 172.21.15.45:0/1757116670 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77c001a690 con 0x7f77d0107fe0 2024-05-10T03:32:43.301 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.815+0000 7f77d5047700 1 -- 172.21.15.45:0/1757116670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d0106390 con 0x7f77d0107fe0 2024-05-10T03:32:43.301 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.815+0000 7f77b7fff700 1 -- 172.21.15.45:0/1757116670 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f77c001ac20 con 0x7f77d0107fe0 2024-05-10T03:32:43.301 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.815+0000 7f77b7fff700 1 -- 172.21.15.45:0/1757116670 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f77c0019700 con 0x7f77d0107fe0 2024-05-10T03:32:43.301 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.816+0000 7f77d5047700 1 -- 172.21.15.45:0/1757116670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d0062840 con 0x7f77d0107fe0 2024-05-10T03:32:43.301 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.818+0000 7f77b7fff700 1 -- 172.21.15.45:0/1757116670 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f77c00249f0 con 0x7f77d0107fe0 2024-05-10T03:32:43.301 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.915+0000 7f77d5047700 1 -- 172.21.15.45:0/1757116670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f77d010b960 con 0x7f77d0107fe0 2024-05-10T03:32:43.301 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.915+0000 7f77b7fff700 1 -- 172.21.15.45:0/1757116670 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f77c0024430 con 0x7f77d0107fe0 2024-05-10T03:32:43.301 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.916+0000 7f77d5047700 1 -- 172.21.15.45:0/1757116670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77d0107fe0 msgr2=0x7f77d0107760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:32:43.302 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.917+0000 7f77d5047700 1 --2- 172.21.15.45:0/1757116670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77d0107fe0 0x7f77d0107760 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f77c0003f70 tx=0x7f77c0011b40 comp rx=0 tx=0).stop 2024-05-10T03:32:43.302 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.917+0000 7f77d5047700 1 -- 172.21.15.45:0/1757116670 shutdown_connections 2024-05-10T03:32:43.302 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.917+0000 7f77d5047700 1 --2- 172.21.15.45:0/1757116670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77d0107fe0 0x7f77d0107760 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:43.302 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.917+0000 7f77d5047700 1 -- 172.21.15.45:0/1757116670 >> 172.21.15.45:0/1757116670 conn(0x7f77d0101a60 msgr2=0x7f77d01023a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:32:43.302 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.917+0000 7f77d5047700 1 -- 172.21.15.45:0/1757116670 shutdown_connections 2024-05-10T03:32:43.302 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:42.917+0000 7f77d5047700 1 -- 172.21.15.45:0/1757116670 wait complete. 2024-05-10T03:32:43.302 INFO:teuthology.orchestra.run.smithi045.stdout:mgr not available, waiting (1/15)... 2024-05-10T03:32:43.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:43 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1757116670' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-10T03:32:43.535 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:43 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:43.126+0000 7f1b34812200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T03:32:44.153 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:43 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:43.868+0000 7f1b34812200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T03:32:44.534 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:44 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:44.150+0000 7f1b34812200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T03:32:44.534 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:44 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:44.246+0000 7f1b34812200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T03:32:44.535 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:44 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:44.369+0000 7f1b34812200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T03:32:45.034 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:44 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:44.550+0000 7f1b34812200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T03:32:45.034 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:44 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:44.694+0000 7f1b34812200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T03:32:45.034 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:44 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:44.790+0000 7f1b34812200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T03:32:45.492 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:45 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:45.215+0000 7f1b34812200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T03:32:45.969 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:45 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/59993344' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-10T03:32:45.969 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:45 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:45.668+0000 7f1b34812200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T03:32:45.969 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:45 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:45.901+0000 7f1b34812200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-10T03:32:46.147 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-05-10T03:32:46.147 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout { 2024-05-10T03:32:46.147 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "fsid": "d2a0bafa-0e7d-11ef-bc98-c7b262605968", 2024-05-10T03:32:46.147 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "health": { 2024-05-10T03:32:46.147 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-10T03:32:46.147 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-10T03:32:46.147 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-10T03:32:46.147 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:46.147 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-10T03:32:46.147 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-10T03:32:46.147 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 0 2024-05-10T03:32:46.147 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-05-10T03:32:46.148 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-10T03:32:46.148 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "a" 2024-05-10T03:32:46.148 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-05-10T03:32:46.148 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-05-10T03:32:46.148 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-10T03:32:46.148 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T03:32:46.148 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-05-10T03:32:46.148 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-10T03:32:46.148 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:46.148 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-10T03:32:46.148 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T03:32:46.148 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-10T03:32:46.156 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-10T03:32:46.157 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-10T03:32:46.157 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-10T03:32:46.157 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-10T03:32:46.157 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-10T03:32:46.157 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:46.157 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-10T03:32:46.157 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-10T03:32:46.157 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-10T03:32:46.157 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-10T03:32:46.157 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-10T03:32:46.157 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-10T03:32:46.157 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-10T03:32:46.157 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-10T03:32:46.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-10T03:32:46.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:46.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-10T03:32:46.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T03:32:46.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-10T03:32:46.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-10T03:32:46.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:46.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-10T03:32:46.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-10T03:32:46.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-10T03:32:46.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-10T03:32:46.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-10T03:32:46.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-10T03:32:46.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "restful" 2024-05-10T03:32:46.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-05-10T03:32:46.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-10T03:32:46.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:46.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-10T03:32:46.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T03:32:46.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "modified": "2024-05-10T03:32:36.840758+0000", 2024-05-10T03:32:46.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-10T03:32:46.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:46.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-10T03:32:46.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout } 2024-05-10T03:32:46.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.714+0000 7f7e617c5700 1 Processor -- start 2024-05-10T03:32:46.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.715+0000 7f7e617c5700 1 -- start start 2024-05-10T03:32:46.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.715+0000 7f7e617c5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e5c107fb0 0x7f7e5c10a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:46.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.715+0000 7f7e617c5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5c07ad60 con 0x7f7e5c107fb0 2024-05-10T03:32:46.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.715+0000 7f7e5affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e5c107fb0 0x7f7e5c10a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:32:46.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.715+0000 7f7e5affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e5c107fb0 0x7f7e5c10a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52252/0 (socket says 172.21.15.45:52252) 2024-05-10T03:32:46.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.715+0000 7f7e5affd700 1 -- 172.21.15.45:0/1807631388 learned_addr learned my addr 172.21.15.45:0/1807631388 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:32:46.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.715+0000 7f7e5affd700 1 -- 172.21.15.45:0/1807631388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5c07aea0 con 0x7f7e5c107fb0 2024-05-10T03:32:46.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.716+0000 7f7e5affd700 1 --2- 172.21.15.45:0/1807631388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e5c107fb0 0x7f7e5c10a3d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0098a0 tx=0x7f7e4c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0cb60066d250e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:32:46.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.716+0000 7f7e59ffb700 1 -- 172.21.15.45:0/1807631388 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e4c004160 con 0x7f7e5c107fb0 2024-05-10T03:32:46.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.716+0000 7f7e59ffb700 1 -- 172.21.15.45:0/1807631388 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f7e4c0042c0 con 0x7f7e5c107fb0 2024-05-10T03:32:46.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.716+0000 7f7e59ffb700 1 -- 172.21.15.45:0/1807631388 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e4c011ac0 con 0x7f7e5c107fb0 2024-05-10T03:32:46.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.717+0000 7f7e617c5700 1 -- 172.21.15.45:0/1807631388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e5c107fb0 msgr2=0x7f7e5c10a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:32:46.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.717+0000 7f7e617c5700 1 --2- 172.21.15.45:0/1807631388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e5c107fb0 0x7f7e5c10a3d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0098a0 tx=0x7f7e4c009bb0 comp rx=0 tx=0).stop 2024-05-10T03:32:46.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.717+0000 7f7e617c5700 1 -- 172.21.15.45:0/1807631388 shutdown_connections 2024-05-10T03:32:46.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.717+0000 7f7e617c5700 1 --2- 172.21.15.45:0/1807631388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e5c107fb0 0x7f7e5c10a3d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:46.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.717+0000 7f7e617c5700 1 -- 172.21.15.45:0/1807631388 >> 172.21.15.45:0/1807631388 conn(0x7f7e5c101a30 msgr2=0x7f7e5c103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:32:46.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.717+0000 7f7e617c5700 1 -- 172.21.15.45:0/1807631388 shutdown_connections 2024-05-10T03:32:46.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.717+0000 7f7e617c5700 1 -- 172.21.15.45:0/1807631388 wait complete. 2024-05-10T03:32:46.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.717+0000 7f7e617c5700 1 Processor -- start 2024-05-10T03:32:46.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.718+0000 7f7e617c5700 1 -- start start 2024-05-10T03:32:46.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.718+0000 7f7e617c5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e5c107fb0 0x7f7e5c107730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:46.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.718+0000 7f7e617c5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5c107c70 con 0x7f7e5c107fb0 2024-05-10T03:32:46.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.718+0000 7f7e5affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e5c107fb0 0x7f7e5c107730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:32:46.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.718+0000 7f7e5affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e5c107fb0 0x7f7e5c107730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52264/0 (socket says 172.21.15.45:52264) 2024-05-10T03:32:46.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.718+0000 7f7e5affd700 1 -- 172.21.15.45:0/59993344 learned_addr learned my addr 172.21.15.45:0/59993344 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:32:46.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.718+0000 7f7e5affd700 1 -- 172.21.15.45:0/59993344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4c009550 con 0x7f7e5c107fb0 2024-05-10T03:32:46.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.719+0000 7f7e5affd700 1 --2- 172.21.15.45:0/59993344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e5c107fb0 0x7f7e5c107730 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c000c00 tx=0x7f7e4c011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:32:46.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.719+0000 7f7e43fff700 1 -- 172.21.15.45:0/59993344 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e4c003aa0 con 0x7f7e5c107fb0 2024-05-10T03:32:46.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.719+0000 7f7e43fff700 1 -- 172.21.15.45:0/59993344 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f7e4c003c00 con 0x7f7e5c107fb0 2024-05-10T03:32:46.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.719+0000 7f7e617c5700 1 -- 172.21.15.45:0/59993344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e5c105ec0 con 0x7f7e5c107fb0 2024-05-10T03:32:46.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.719+0000 7f7e43fff700 1 -- 172.21.15.45:0/59993344 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e4c0248a0 con 0x7f7e5c107fb0 2024-05-10T03:32:46.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.719+0000 7f7e617c5700 1 -- 172.21.15.45:0/59993344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5c106360 con 0x7f7e5c107fb0 2024-05-10T03:32:46.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.719+0000 7f7e43fff700 1 -- 172.21.15.45:0/59993344 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f7e4c02d3f0 con 0x7f7e5c107fb0 2024-05-10T03:32:46.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.719+0000 7f7e43fff700 1 -- 172.21.15.45:0/59993344 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7e4c019450 con 0x7f7e5c107fb0 2024-05-10T03:32:46.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.720+0000 7f7e617c5700 1 -- 172.21.15.45:0/59993344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e5c062840 con 0x7f7e5c107fb0 2024-05-10T03:32:46.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.722+0000 7f7e43fff700 1 -- 172.21.15.45:0/59993344 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f7e4c01ac60 con 0x7f7e5c107fb0 2024-05-10T03:32:46.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.800+0000 7f7e617c5700 1 -- 172.21.15.45:0/59993344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f7e5c10b900 con 0x7f7e5c107fb0 2024-05-10T03:32:46.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.800+0000 7f7e43fff700 1 -- 172.21.15.45:0/59993344 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f7e4c02d830 con 0x7f7e5c107fb0 2024-05-10T03:32:46.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.801+0000 7f7e617c5700 1 -- 172.21.15.45:0/59993344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e5c107fb0 msgr2=0x7f7e5c107730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:32:46.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.801+0000 7f7e617c5700 1 --2- 172.21.15.45:0/59993344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e5c107fb0 0x7f7e5c107730 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c000c00 tx=0x7f7e4c011b40 comp rx=0 tx=0).stop 2024-05-10T03:32:46.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.801+0000 7f7e617c5700 1 -- 172.21.15.45:0/59993344 shutdown_connections 2024-05-10T03:32:46.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.801+0000 7f7e617c5700 1 --2- 172.21.15.45:0/59993344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e5c107fb0 0x7f7e5c107730 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:46.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.801+0000 7f7e617c5700 1 -- 172.21.15.45:0/59993344 >> 172.21.15.45:0/59993344 conn(0x7f7e5c101a30 msgr2=0x7f7e5c102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:32:46.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.801+0000 7f7e617c5700 1 -- 172.21.15.45:0/59993344 shutdown_connections 2024-05-10T03:32:46.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:45.801+0000 7f7e617c5700 1 -- 172.21.15.45:0/59993344 wait complete. 2024-05-10T03:32:46.163 INFO:teuthology.orchestra.run.smithi045.stdout:mgr not available, waiting (2/15)... 2024-05-10T03:32:46.284 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:46 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:46.009+0000 7f1b34812200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T03:32:47.161 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:46 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:46.882+0000 7f1b34812200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T03:32:47.161 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:46 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:46.990+0000 7f1b34812200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T03:32:47.161 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:47 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:47.158+0000 7f1b34812200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T03:32:48.254 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:47 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:47.877+0000 7f1b34812200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-10T03:32:48.254 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:48 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:48.081+0000 7f1b34812200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T03:32:48.534 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:48 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:48.309+0000 7f1b34812200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T03:32:48.921 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:48 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3696675448' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-10T03:32:48.987 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-05-10T03:32:48.988 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout { 2024-05-10T03:32:48.988 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "fsid": "d2a0bafa-0e7d-11ef-bc98-c7b262605968", 2024-05-10T03:32:48.988 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "health": { 2024-05-10T03:32:48.988 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-10T03:32:48.988 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-10T03:32:48.988 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-10T03:32:48.988 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:48.988 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-10T03:32:48.988 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-10T03:32:48.989 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 0 2024-05-10T03:32:48.989 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-05-10T03:32:48.989 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-10T03:32:48.989 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "a" 2024-05-10T03:32:48.989 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-05-10T03:32:48.989 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-05-10T03:32:48.989 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-10T03:32:48.989 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T03:32:48.989 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-05-10T03:32:48.989 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-10T03:32:48.989 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:48.989 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-10T03:32:48.989 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T03:32:48.989 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-10T03:32:48.990 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-10T03:32:48.990 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-10T03:32:48.990 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-10T03:32:48.990 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-10T03:32:48.990 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-10T03:32:48.990 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:48.990 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-10T03:32:48.990 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-10T03:32:48.990 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-10T03:32:48.990 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-10T03:32:48.990 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-10T03:32:48.990 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-10T03:32:48.990 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-10T03:32:48.990 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-10T03:32:48.990 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-10T03:32:48.991 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:48.991 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-10T03:32:48.991 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T03:32:48.991 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-10T03:32:48.991 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-10T03:32:48.991 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:48.991 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-10T03:32:48.991 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-10T03:32:48.991 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-10T03:32:48.991 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-10T03:32:48.991 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-10T03:32:48.991 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-10T03:32:48.992 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "restful" 2024-05-10T03:32:48.992 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-05-10T03:32:48.992 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-10T03:32:48.992 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:48.992 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-10T03:32:48.992 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T03:32:48.992 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "modified": "2024-05-10T03:32:36.840758+0000", 2024-05-10T03:32:48.992 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-10T03:32:48.992 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:48.992 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-10T03:32:48.992 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout } 2024-05-10T03:32:48.992 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.535+0000 7f30cf3c5700 1 Processor -- start 2024-05-10T03:32:48.992 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.535+0000 7f30cf3c5700 1 -- start start 2024-05-10T03:32:48.992 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.536+0000 7f30cf3c5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30c8107fe0 0x7f30c810a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:48.993 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.536+0000 7f30cf3c5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c807ad60 con 0x7f30c8107fe0 2024-05-10T03:32:48.993 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.536+0000 7f30cd161700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30c8107fe0 0x7f30c810a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:32:48.993 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.536+0000 7f30cd161700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30c8107fe0 0x7f30c810a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60044/0 (socket says 172.21.15.45:60044) 2024-05-10T03:32:48.993 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.536+0000 7f30cd161700 1 -- 172.21.15.45:0/1028677273 learned_addr learned my addr 172.21.15.45:0/1028677273 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:32:48.993 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.536+0000 7f30cd161700 1 -- 172.21.15.45:0/1028677273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c807aea0 con 0x7f30c8107fe0 2024-05-10T03:32:48.993 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.536+0000 7f30cd161700 1 --2- 172.21.15.45:0/1028677273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30c8107fe0 0x7f30c810a400 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f30c40098a0 tx=0x7f30c4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841869522cf5babe server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:32:48.993 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.536+0000 7f30bffff700 1 -- 172.21.15.45:0/1028677273 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f30c4004160 con 0x7f30c8107fe0 2024-05-10T03:32:48.993 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.537+0000 7f30bffff700 1 -- 172.21.15.45:0/1028677273 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f30c40042c0 con 0x7f30c8107fe0 2024-05-10T03:32:48.993 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.537+0000 7f30bffff700 1 -- 172.21.15.45:0/1028677273 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f30c4011ac0 con 0x7f30c8107fe0 2024-05-10T03:32:48.993 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.537+0000 7f30cf3c5700 1 -- 172.21.15.45:0/1028677273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30c8107fe0 msgr2=0x7f30c810a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:32:48.994 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.537+0000 7f30cf3c5700 1 --2- 172.21.15.45:0/1028677273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30c8107fe0 0x7f30c810a400 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f30c40098a0 tx=0x7f30c4009bb0 comp rx=0 tx=0).stop 2024-05-10T03:32:48.994 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.538+0000 7f30cf3c5700 1 -- 172.21.15.45:0/1028677273 shutdown_connections 2024-05-10T03:32:48.994 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.538+0000 7f30cf3c5700 1 --2- 172.21.15.45:0/1028677273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30c8107fe0 0x7f30c810a400 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:48.994 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.538+0000 7f30cf3c5700 1 -- 172.21.15.45:0/1028677273 >> 172.21.15.45:0/1028677273 conn(0x7f30c8101a60 msgr2=0x7f30c8103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:32:48.994 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.538+0000 7f30cf3c5700 1 -- 172.21.15.45:0/1028677273 shutdown_connections 2024-05-10T03:32:48.994 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.538+0000 7f30cf3c5700 1 -- 172.21.15.45:0/1028677273 wait complete. 2024-05-10T03:32:48.994 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.539+0000 7f30cf3c5700 1 Processor -- start 2024-05-10T03:32:48.994 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.539+0000 7f30cf3c5700 1 -- start start 2024-05-10T03:32:48.994 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.539+0000 7f30cf3c5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30c8107fe0 0x7f30c819b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:48.994 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.539+0000 7f30cf3c5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c819bb20 con 0x7f30c8107fe0 2024-05-10T03:32:48.994 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.539+0000 7f30cd161700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30c8107fe0 0x7f30c819b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:32:48.994 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.539+0000 7f30cd161700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30c8107fe0 0x7f30c819b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60046/0 (socket says 172.21.15.45:60046) 2024-05-10T03:32:48.994 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.539+0000 7f30cd161700 1 -- 172.21.15.45:0/3696675448 learned_addr learned my addr 172.21.15.45:0/3696675448 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:32:48.994 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.540+0000 7f30cd161700 1 -- 172.21.15.45:0/3696675448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c4009550 con 0x7f30c8107fe0 2024-05-10T03:32:48.995 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.540+0000 7f30cd161700 1 --2- 172.21.15.45:0/3696675448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30c8107fe0 0x7f30c819b5e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f30c4003f70 tx=0x7f30c4011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:32:48.995 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.540+0000 7f30be7fc700 1 -- 172.21.15.45:0/3696675448 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f30c40039f0 con 0x7f30c8107fe0 2024-05-10T03:32:48.995 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.540+0000 7f30be7fc700 1 -- 172.21.15.45:0/3696675448 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f30c4003b50 con 0x7f30c8107fe0 2024-05-10T03:32:48.995 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.540+0000 7f30cf3c5700 1 -- 172.21.15.45:0/3696675448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c819bd20 con 0x7f30c8107fe0 2024-05-10T03:32:48.995 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.540+0000 7f30be7fc700 1 -- 172.21.15.45:0/3696675448 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f30c401a690 con 0x7f30c8107fe0 2024-05-10T03:32:48.995 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.540+0000 7f30cf3c5700 1 -- 172.21.15.45:0/3696675448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c819c1c0 con 0x7f30c8107fe0 2024-05-10T03:32:48.995 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.540+0000 7f30be7fc700 1 -- 172.21.15.45:0/3696675448 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f30c401ac70 con 0x7f30c8107fe0 2024-05-10T03:32:48.995 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.540+0000 7f30be7fc700 1 -- 172.21.15.45:0/3696675448 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f30c4019700 con 0x7f30c8107fe0 2024-05-10T03:32:48.995 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.541+0000 7f30cf3c5700 1 -- 172.21.15.45:0/3696675448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c810b6d0 con 0x7f30c8107fe0 2024-05-10T03:32:48.996 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.544+0000 7f30be7fc700 1 -- 172.21.15.45:0/3696675448 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f30c40249f0 con 0x7f30c8107fe0 2024-05-10T03:32:48.996 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.621+0000 7f30cf3c5700 1 -- 172.21.15.45:0/3696675448 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f30c819ec10 con 0x7f30c8107fe0 2024-05-10T03:32:48.996 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.622+0000 7f30be7fc700 1 -- 172.21.15.45:0/3696675448 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f30c4024430 con 0x7f30c8107fe0 2024-05-10T03:32:48.996 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.623+0000 7f30cf3c5700 1 -- 172.21.15.45:0/3696675448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30c8107fe0 msgr2=0x7f30c819b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:32:48.996 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.623+0000 7f30cf3c5700 1 --2- 172.21.15.45:0/3696675448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30c8107fe0 0x7f30c819b5e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f30c4003f70 tx=0x7f30c4011b40 comp rx=0 tx=0).stop 2024-05-10T03:32:48.996 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.623+0000 7f30cf3c5700 1 -- 172.21.15.45:0/3696675448 shutdown_connections 2024-05-10T03:32:48.996 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.623+0000 7f30cf3c5700 1 --2- 172.21.15.45:0/3696675448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30c8107fe0 0x7f30c819b5e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:48.997 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.623+0000 7f30cf3c5700 1 -- 172.21.15.45:0/3696675448 >> 172.21.15.45:0/3696675448 conn(0x7f30c8101a60 msgr2=0x7f30c81023a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:32:48.997 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.623+0000 7f30cf3c5700 1 -- 172.21.15.45:0/3696675448 shutdown_connections 2024-05-10T03:32:48.997 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:48.623+0000 7f30cf3c5700 1 -- 172.21.15.45:0/3696675448 wait complete. 2024-05-10T03:32:48.997 INFO:teuthology.orchestra.run.smithi045.stdout:mgr not available, waiting (3/15)... 2024-05-10T03:32:49.705 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:49 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:49.380+0000 7f1b34812200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T03:32:50.021 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:49 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:49.702+0000 7f1b34812200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T03:32:50.021 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:49 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:49.801+0000 7f1b34812200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T03:32:50.284 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:50 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:50.018+0000 7f1b34812200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T03:32:50.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:50 smithi045 ceph-mon[42520]: Activating manager daemon x 2024-05-10T03:32:50.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:50 smithi045 ceph-mon[42520]: mgrmap e2: x(active, starting, since 0.00418912s) 2024-05-10T03:32:50.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:50 smithi045 ceph-mon[42520]: from='mgr.14100 172.21.15.45:0/635528588' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-10T03:32:50.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:50 smithi045 ceph-mon[42520]: from='mgr.14100 172.21.15.45:0/635528588' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-10T03:32:50.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:50 smithi045 ceph-mon[42520]: from='mgr.14100 172.21.15.45:0/635528588' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-10T03:32:50.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:50 smithi045 ceph-mon[42520]: from='mgr.14100 172.21.15.45:0/635528588' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T03:32:50.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:50 smithi045 ceph-mon[42520]: from='mgr.14100 172.21.15.45:0/635528588' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-10T03:32:50.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:50 smithi045 ceph-mon[42520]: Manager daemon x is now available 2024-05-10T03:32:50.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:50 smithi045 ceph-mon[42520]: from='mgr.14100 172.21.15.45:0/635528588' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-10T03:32:50.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:50 smithi045 ceph-mon[42520]: from='mgr.14100 172.21.15.45:0/635528588' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-10T03:32:50.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:50 smithi045 ceph-mon[42520]: from='mgr.14100 172.21.15.45:0/635528588' entity='mgr.x' 2024-05-10T03:32:50.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:50 smithi045 ceph-mon[42520]: from='mgr.14100 172.21.15.45:0/635528588' entity='mgr.x' 2024-05-10T03:32:51.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:51 smithi045 ceph-mon[42520]: from='mgr.14100 172.21.15.45:0/635528588' entity='mgr.x' 2024-05-10T03:32:51.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:51 smithi045 ceph-mon[42520]: mgrmap e3: x(active, since 1.00792s) 2024-05-10T03:32:52.580 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-05-10T03:32:52.580 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout { 2024-05-10T03:32:52.580 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "fsid": "d2a0bafa-0e7d-11ef-bc98-c7b262605968", 2024-05-10T03:32:52.580 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "health": { 2024-05-10T03:32:52.580 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-10T03:32:52.580 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-10T03:32:52.581 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-10T03:32:52.581 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:52.581 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-10T03:32:52.581 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-10T03:32:52.581 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 0 2024-05-10T03:32:52.581 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-05-10T03:32:52.581 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-10T03:32:52.581 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "a" 2024-05-10T03:32:52.581 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-05-10T03:32:52.581 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-05-10T03:32:52.581 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-10T03:32:52.581 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T03:32:52.581 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-05-10T03:32:52.581 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-10T03:32:52.582 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:52.582 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-10T03:32:52.582 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T03:32:52.582 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-10T03:32:52.582 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-10T03:32:52.582 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-10T03:32:52.591 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-10T03:32:52.591 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-10T03:32:52.591 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-10T03:32:52.591 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:52.591 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-10T03:32:52.591 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-10T03:32:52.591 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-10T03:32:52.591 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-10T03:32:52.592 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-10T03:32:52.592 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-10T03:32:52.592 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-10T03:32:52.592 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-10T03:32:52.592 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-10T03:32:52.592 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:52.592 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-10T03:32:52.592 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T03:32:52.592 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-10T03:32:52.592 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-10T03:32:52.592 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:52.592 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-10T03:32:52.592 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-10T03:32:52.592 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-10T03:32:52.593 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-10T03:32:52.593 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-10T03:32:52.593 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-10T03:32:52.593 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "restful" 2024-05-10T03:32:52.593 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-05-10T03:32:52.593 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-10T03:32:52.593 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:52.593 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-10T03:32:52.593 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T03:32:52.593 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "modified": "2024-05-10T03:32:36.840758+0000", 2024-05-10T03:32:52.593 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-10T03:32:52.593 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-05-10T03:32:52.593 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-10T03:32:52.593 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout } 2024-05-10T03:32:52.594 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.916+0000 7f15f5712700 1 Processor -- start 2024-05-10T03:32:52.594 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.916+0000 7f15f5712700 1 -- start start 2024-05-10T03:32:52.594 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.916+0000 7f15f5712700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f007ac50 0x7f15f010c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:52.594 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.916+0000 7f15f5712700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f010c970 con 0x7f15f007ac50 2024-05-10T03:32:52.594 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.916+0000 7f15eeffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f007ac50 0x7f15f010c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:32:52.594 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.916+0000 7f15eeffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f007ac50 0x7f15f010c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60114/0 (socket says 172.21.15.45:60114) 2024-05-10T03:32:52.594 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.916+0000 7f15eeffd700 1 -- 172.21.15.45:0/2066564900 learned_addr learned my addr 172.21.15.45:0/2066564900 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:32:52.594 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.916+0000 7f15eeffd700 1 -- 172.21.15.45:0/2066564900 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f010cab0 con 0x7f15f007ac50 2024-05-10T03:32:52.594 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.917+0000 7f15eeffd700 1 --2- 172.21.15.45:0/2066564900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f007ac50 0x7f15f010c430 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f15e00098a0 tx=0x7f15e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa82e038c29475ec server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:32:52.594 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.917+0000 7f15edffb700 1 -- 172.21.15.45:0/2066564900 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15e0004160 con 0x7f15f007ac50 2024-05-10T03:32:52.594 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.917+0000 7f15edffb700 1 -- 172.21.15.45:0/2066564900 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f15e00042c0 con 0x7f15f007ac50 2024-05-10T03:32:52.594 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.917+0000 7f15edffb700 1 -- 172.21.15.45:0/2066564900 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15e0011ac0 con 0x7f15f007ac50 2024-05-10T03:32:52.595 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.918+0000 7f15f5712700 1 -- 172.21.15.45:0/2066564900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f007ac50 msgr2=0x7f15f010c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:32:52.595 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.918+0000 7f15f5712700 1 --2- 172.21.15.45:0/2066564900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f007ac50 0x7f15f010c430 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f15e00098a0 tx=0x7f15e0009bb0 comp rx=0 tx=0).stop 2024-05-10T03:32:52.595 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.918+0000 7f15f5712700 1 -- 172.21.15.45:0/2066564900 shutdown_connections 2024-05-10T03:32:52.595 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.918+0000 7f15f5712700 1 --2- 172.21.15.45:0/2066564900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f007ac50 0x7f15f010c430 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:52.595 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.918+0000 7f15f5712700 1 -- 172.21.15.45:0/2066564900 >> 172.21.15.45:0/2066564900 conn(0x7f15f0101a60 msgr2=0x7f15f0103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:32:52.595 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.918+0000 7f15f5712700 1 -- 172.21.15.45:0/2066564900 shutdown_connections 2024-05-10T03:32:52.595 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.918+0000 7f15f5712700 1 -- 172.21.15.45:0/2066564900 wait complete. 2024-05-10T03:32:52.595 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.918+0000 7f15f5712700 1 Processor -- start 2024-05-10T03:32:52.595 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.919+0000 7f15f5712700 1 -- start start 2024-05-10T03:32:52.595 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.919+0000 7f15f5712700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f007ac50 0x7f15f019d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:52.595 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.919+0000 7f15f5712700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f019dd50 con 0x7f15f007ac50 2024-05-10T03:32:52.595 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.919+0000 7f15eeffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f007ac50 0x7f15f019d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:32:52.595 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.919+0000 7f15eeffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f007ac50 0x7f15f019d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60116/0 (socket says 172.21.15.45:60116) 2024-05-10T03:32:52.595 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.919+0000 7f15eeffd700 1 -- 172.21.15.45:0/1696056987 learned_addr learned my addr 172.21.15.45:0/1696056987 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:32:52.596 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.919+0000 7f15eeffd700 1 -- 172.21.15.45:0/1696056987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e0009550 con 0x7f15f007ac50 2024-05-10T03:32:52.596 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.920+0000 7f15eeffd700 1 --2- 172.21.15.45:0/1696056987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f007ac50 0x7f15f019d810 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f15e0003f70 tx=0x7f15e0011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:32:52.596 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.920+0000 7f15d7fff700 1 -- 172.21.15.45:0/1696056987 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15e00039f0 con 0x7f15f007ac50 2024-05-10T03:32:52.596 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.920+0000 7f15d7fff700 1 -- 172.21.15.45:0/1696056987 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f15e0003b50 con 0x7f15f007ac50 2024-05-10T03:32:52.596 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.920+0000 7f15f5712700 1 -- 172.21.15.45:0/1696056987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f019df50 con 0x7f15f007ac50 2024-05-10T03:32:52.596 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.920+0000 7f15d7fff700 1 -- 172.21.15.45:0/1696056987 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15e001a690 con 0x7f15f007ac50 2024-05-10T03:32:52.596 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.920+0000 7f15f5712700 1 -- 172.21.15.45:0/1696056987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f019e3f0 con 0x7f15f007ac50 2024-05-10T03:32:52.596 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.921+0000 7f15d7fff700 1 -- 172.21.15.45:0/1696056987 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 3) v1 ==== 45424+0+0 (secure 0 0 0) 0x7f15e001a970 con 0x7f15f007ac50 2024-05-10T03:32:52.596 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.921+0000 7f15d7fff700 1 --2- 172.21.15.45:0/1696056987 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f15d8038600 0x7f15d803ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:52.596 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.921+0000 7f15f5712700 1 -- 172.21.15.45:0/1696056987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f010d8b0 con 0x7f15f007ac50 2024-05-10T03:32:52.596 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.921+0000 7f15d7fff700 1 -- 172.21.15.45:0/1696056987 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f15e004c670 con 0x7f15f007ac50 2024-05-10T03:32:52.596 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.921+0000 7f15ee7fc700 1 --2- 172.21.15.45:0/1696056987 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f15d8038600 0x7f15d803ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:32:52.596 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.922+0000 7f15ee7fc700 1 --2- 172.21.15.45:0/1696056987 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f15d8038600 0x7f15d803ab10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f15e4006fd0 tx=0x7f15e4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:32:52.596 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:51.927+0000 7f15d7fff700 1 -- 172.21.15.45:0/1696056987 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f15e001ae00 con 0x7f15f007ac50 2024-05-10T03:32:52.597 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.087+0000 7f15d7fff700 1 -- 172.21.15.45:0/1696056987 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7f15e002d960 con 0x7f15f007ac50 2024-05-10T03:32:52.597 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.228+0000 7f15f5712700 1 -- 172.21.15.45:0/1696056987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f15f010dac0 con 0x7f15f007ac50 2024-05-10T03:32:52.597 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.229+0000 7f15d7fff700 1 -- 172.21.15.45:0/1696056987 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f15e001ae00 con 0x7f15f007ac50 2024-05-10T03:32:52.597 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.231+0000 7f15f5712700 1 -- 172.21.15.45:0/1696056987 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f15d8038600 msgr2=0x7f15d803ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:32:52.597 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.231+0000 7f15f5712700 1 --2- 172.21.15.45:0/1696056987 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f15d8038600 0x7f15d803ab10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f15e4006fd0 tx=0x7f15e4006e40 comp rx=0 tx=0).stop 2024-05-10T03:32:52.597 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.231+0000 7f15f5712700 1 -- 172.21.15.45:0/1696056987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f007ac50 msgr2=0x7f15f019d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:32:52.597 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.231+0000 7f15f5712700 1 --2- 172.21.15.45:0/1696056987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f007ac50 0x7f15f019d810 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f15e0003f70 tx=0x7f15e0011b40 comp rx=0 tx=0).stop 2024-05-10T03:32:52.597 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.231+0000 7f15f5712700 1 -- 172.21.15.45:0/1696056987 shutdown_connections 2024-05-10T03:32:52.597 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.231+0000 7f15f5712700 1 --2- 172.21.15.45:0/1696056987 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f15d8038600 0x7f15d803ab10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:52.597 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.231+0000 7f15f5712700 1 --2- 172.21.15.45:0/1696056987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15f007ac50 0x7f15f019d810 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:52.597 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.231+0000 7f15f5712700 1 -- 172.21.15.45:0/1696056987 >> 172.21.15.45:0/1696056987 conn(0x7f15f0101a60 msgr2=0x7f15f01023a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:32:52.597 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.232+0000 7f15f5712700 1 -- 172.21.15.45:0/1696056987 shutdown_connections 2024-05-10T03:32:52.597 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.232+0000 7f15f5712700 1 -- 172.21.15.45:0/1696056987 wait complete. 2024-05-10T03:32:52.597 INFO:teuthology.orchestra.run.smithi045.stdout:mgr is available 2024-05-10T03:32:53.377 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:53 smithi045 ceph-mon[42520]: mgrmap e4: x(active, since 2s) 2024-05-10T03:32:53.377 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:53 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1696056987' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-10T03:32:53.525 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-05-10T03:32:53.525 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout [global] 2024-05-10T03:32:53.525 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout fsid = d2a0bafa-0e7d-11ef-bc98-c7b262605968 2024-05-10T03:32:53.525 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-10T03:32:53.525 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-10T03:32:53.525 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-10T03:32:53.525 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-10T03:32:53.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-05-10T03:32:53.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-10T03:32:53.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-10T03:32:53.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-05-10T03:32:53.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout [osd] 2024-05-10T03:32:53.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-10T03:32:53.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-10T03:32:53.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-10T03:32:53.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-10T03:32:53.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-10T03:32:53.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.958+0000 7f0272bda700 1 Processor -- start 2024-05-10T03:32:53.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.959+0000 7f0272bda700 1 -- start start 2024-05-10T03:32:53.526 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.959+0000 7f0272bda700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f026c07ac50 0x7f026c10a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:53.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.959+0000 7f0272bda700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c10a640 con 0x7f026c07ac50 2024-05-10T03:32:53.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.959+0000 7f0270976700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f026c07ac50 0x7f026c10a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:32:53.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.959+0000 7f0270976700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f026c07ac50 0x7f026c10a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60122/0 (socket says 172.21.15.45:60122) 2024-05-10T03:32:53.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.959+0000 7f0270976700 1 -- 172.21.15.45:0/3220992493 learned_addr learned my addr 172.21.15.45:0/3220992493 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:32:53.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.959+0000 7f0270976700 1 -- 172.21.15.45:0/3220992493 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026c10a780 con 0x7f026c07ac50 2024-05-10T03:32:53.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.960+0000 7f0270976700 1 --2- 172.21.15.45:0/3220992493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f026c07ac50 0x7f026c10a030 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f02600098a0 tx=0x7f0260009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937035af09ea745d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:32:53.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.960+0000 7f026b7fe700 1 -- 172.21.15.45:0/3220992493 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0260004160 con 0x7f026c07ac50 2024-05-10T03:32:53.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.960+0000 7f026b7fe700 1 -- 172.21.15.45:0/3220992493 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f02600042c0 con 0x7f026c07ac50 2024-05-10T03:32:53.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.960+0000 7f026b7fe700 1 -- 172.21.15.45:0/3220992493 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0260011ac0 con 0x7f026c07ac50 2024-05-10T03:32:53.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.961+0000 7f0272bda700 1 -- 172.21.15.45:0/3220992493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f026c07ac50 msgr2=0x7f026c10a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:32:53.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.961+0000 7f0272bda700 1 --2- 172.21.15.45:0/3220992493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f026c07ac50 0x7f026c10a030 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f02600098a0 tx=0x7f0260009bb0 comp rx=0 tx=0).stop 2024-05-10T03:32:53.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.961+0000 7f0272bda700 1 -- 172.21.15.45:0/3220992493 shutdown_connections 2024-05-10T03:32:53.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.961+0000 7f0272bda700 1 --2- 172.21.15.45:0/3220992493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f026c07ac50 0x7f026c10a030 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:53.527 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.961+0000 7f0272bda700 1 -- 172.21.15.45:0/3220992493 >> 172.21.15.45:0/3220992493 conn(0x7f026c101a60 msgr2=0x7f026c103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:32:53.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.961+0000 7f0272bda700 1 -- 172.21.15.45:0/3220992493 shutdown_connections 2024-05-10T03:32:53.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.961+0000 7f0272bda700 1 -- 172.21.15.45:0/3220992493 wait complete. 2024-05-10T03:32:53.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.962+0000 7f0272bda700 1 Processor -- start 2024-05-10T03:32:53.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.962+0000 7f0272bda700 1 -- start start 2024-05-10T03:32:53.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.962+0000 7f0272bda700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f026c07ac50 0x7f026c19b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:53.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.962+0000 7f0272bda700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c19bb40 con 0x7f026c07ac50 2024-05-10T03:32:53.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.962+0000 7f0270976700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f026c07ac50 0x7f026c19b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:32:53.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.962+0000 7f0270976700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f026c07ac50 0x7f026c19b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60134/0 (socket says 172.21.15.45:60134) 2024-05-10T03:32:53.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.962+0000 7f0270976700 1 -- 172.21.15.45:0/1337118025 learned_addr learned my addr 172.21.15.45:0/1337118025 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:32:53.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.962+0000 7f0270976700 1 -- 172.21.15.45:0/1337118025 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0260009550 con 0x7f026c07ac50 2024-05-10T03:32:53.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.962+0000 7f0270976700 1 --2- 172.21.15.45:0/1337118025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f026c07ac50 0x7f026c19b600 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0260003f70 tx=0x7f0260011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:32:53.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.963+0000 7f0269ffb700 1 -- 172.21.15.45:0/1337118025 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02600039f0 con 0x7f026c07ac50 2024-05-10T03:32:53.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.963+0000 7f0269ffb700 1 -- 172.21.15.45:0/1337118025 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f0260003b50 con 0x7f026c07ac50 2024-05-10T03:32:53.528 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.963+0000 7f0269ffb700 1 -- 172.21.15.45:0/1337118025 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f026001a690 con 0x7f026c07ac50 2024-05-10T03:32:53.529 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.963+0000 7f0272bda700 1 -- 172.21.15.45:0/1337118025 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026c19bd40 con 0x7f026c07ac50 2024-05-10T03:32:53.529 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.963+0000 7f0272bda700 1 -- 172.21.15.45:0/1337118025 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f026c19c1e0 con 0x7f026c07ac50 2024-05-10T03:32:53.529 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.964+0000 7f0269ffb700 1 -- 172.21.15.45:0/1337118025 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7f0260024430 con 0x7f026c07ac50 2024-05-10T03:32:53.529 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.964+0000 7f0272bda700 1 -- 172.21.15.45:0/1337118025 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026c10b6a0 con 0x7f026c07ac50 2024-05-10T03:32:53.529 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.964+0000 7f0269ffb700 1 --2- 172.21.15.45:0/1337118025 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f025c038770 0x7f025c03ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:53.529 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.964+0000 7f0269ffb700 1 -- 172.21.15.45:0/1337118025 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f026004c820 con 0x7f026c07ac50 2024-05-10T03:32:53.529 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.964+0000 7f026bfff700 1 --2- 172.21.15.45:0/1337118025 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f025c038770 0x7f025c03ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:32:53.529 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.965+0000 7f026bfff700 1 --2- 172.21.15.45:0/1337118025 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f025c038770 0x7f025c03ac80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0258006fd0 tx=0x7f0258006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:32:53.529 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:52.970+0000 7f0269ffb700 1 -- 172.21.15.45:0/1337118025 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f02600189a0 con 0x7f026c07ac50 2024-05-10T03:32:53.529 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.181+0000 7f0272bda700 1 -- 172.21.15.45:0/1337118025 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f026c10b8b0 con 0x7f026c07ac50 2024-05-10T03:32:53.529 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.182+0000 7f0269ffb700 1 -- 172.21.15.45:0/1337118025 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f0260018350 con 0x7f026c07ac50 2024-05-10T03:32:53.529 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.185+0000 7f0272bda700 1 -- 172.21.15.45:0/1337118025 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f025c038770 msgr2=0x7f025c03ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:32:53.529 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.185+0000 7f0272bda700 1 --2- 172.21.15.45:0/1337118025 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f025c038770 0x7f025c03ac80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0258006fd0 tx=0x7f0258006e40 comp rx=0 tx=0).stop 2024-05-10T03:32:53.529 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.185+0000 7f0272bda700 1 -- 172.21.15.45:0/1337118025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f026c07ac50 msgr2=0x7f026c19b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:32:53.529 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.185+0000 7f0272bda700 1 --2- 172.21.15.45:0/1337118025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f026c07ac50 0x7f026c19b600 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0260003f70 tx=0x7f0260011b40 comp rx=0 tx=0).stop 2024-05-10T03:32:53.530 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.185+0000 7f0272bda700 1 -- 172.21.15.45:0/1337118025 shutdown_connections 2024-05-10T03:32:53.530 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.185+0000 7f0272bda700 1 --2- 172.21.15.45:0/1337118025 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f025c038770 0x7f025c03ac80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:53.530 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.185+0000 7f0272bda700 1 --2- 172.21.15.45:0/1337118025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f026c07ac50 0x7f026c19b600 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:53.530 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.185+0000 7f0272bda700 1 -- 172.21.15.45:0/1337118025 >> 172.21.15.45:0/1337118025 conn(0x7f026c101a60 msgr2=0x7f026c102380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:32:53.530 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.185+0000 7f0272bda700 1 -- 172.21.15.45:0/1337118025 shutdown_connections 2024-05-10T03:32:53.530 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.185+0000 7f0272bda700 1 -- 172.21.15.45:0/1337118025 wait complete. 2024-05-10T03:32:53.530 INFO:teuthology.orchestra.run.smithi045.stdout:Enabling cephadm module... 2024-05-10T03:32:54.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:54 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1337118025' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-10T03:32:55.420 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:55 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2542534352' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-10T03:32:55.421 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:55 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: ignoring --setuser ceph since I am not root 2024-05-10T03:32:55.421 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:55 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: ignoring --setgroup ceph since I am not root 2024-05-10T03:32:55.482 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.877+0000 7f2e9e345700 1 Processor -- start 2024-05-10T03:32:55.482 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.877+0000 7f2e9e345700 1 -- start start 2024-05-10T03:32:55.482 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.878+0000 7f2e9e345700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e9807ac10 0x7f2e9810a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:55.482 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.878+0000 7f2e9e345700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9810a610 con 0x7f2e9807ac10 2024-05-10T03:32:55.482 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.878+0000 7f2e97fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e9807ac10 0x7f2e9810a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:32:55.482 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.878+0000 7f2e97fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e9807ac10 0x7f2e9810a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60150/0 (socket says 172.21.15.45:60150) 2024-05-10T03:32:55.483 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.878+0000 7f2e97fff700 1 -- 172.21.15.45:0/347399296 learned_addr learned my addr 172.21.15.45:0/347399296 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:32:55.483 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.878+0000 7f2e97fff700 1 -- 172.21.15.45:0/347399296 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9810a750 con 0x7f2e9807ac10 2024-05-10T03:32:55.483 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.879+0000 7f2e97fff700 1 --2- 172.21.15.45:0/347399296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e9807ac10 0x7f2e9810a040 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2e880098a0 tx=0x7f2e88009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852182e5a1ad9af1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:32:55.483 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.879+0000 7f2e96ffd700 1 -- 172.21.15.45:0/347399296 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e88004160 con 0x7f2e9807ac10 2024-05-10T03:32:55.483 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.879+0000 7f2e96ffd700 1 -- 172.21.15.45:0/347399296 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f2e880042c0 con 0x7f2e9807ac10 2024-05-10T03:32:55.483 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.879+0000 7f2e96ffd700 1 -- 172.21.15.45:0/347399296 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e88011ac0 con 0x7f2e9807ac10 2024-05-10T03:32:55.483 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.879+0000 7f2e9e345700 1 -- 172.21.15.45:0/347399296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e9807ac10 msgr2=0x7f2e9810a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:32:55.483 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.879+0000 7f2e9e345700 1 --2- 172.21.15.45:0/347399296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e9807ac10 0x7f2e9810a040 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2e880098a0 tx=0x7f2e88009bb0 comp rx=0 tx=0).stop 2024-05-10T03:32:55.483 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.880+0000 7f2e9e345700 1 -- 172.21.15.45:0/347399296 shutdown_connections 2024-05-10T03:32:55.483 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.880+0000 7f2e9e345700 1 --2- 172.21.15.45:0/347399296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e9807ac10 0x7f2e9810a040 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:55.483 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.880+0000 7f2e9e345700 1 -- 172.21.15.45:0/347399296 >> 172.21.15.45:0/347399296 conn(0x7f2e98101a30 msgr2=0x7f2e98103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:32:55.483 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.880+0000 7f2e9e345700 1 -- 172.21.15.45:0/347399296 shutdown_connections 2024-05-10T03:32:55.483 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.880+0000 7f2e9e345700 1 -- 172.21.15.45:0/347399296 wait complete. 2024-05-10T03:32:55.483 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.880+0000 7f2e9e345700 1 Processor -- start 2024-05-10T03:32:55.484 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.880+0000 7f2e9e345700 1 -- start start 2024-05-10T03:32:55.484 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.881+0000 7f2e9e345700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e9807ac10 0x7f2e981077b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:55.484 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.881+0000 7f2e9e345700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e98107cf0 con 0x7f2e9807ac10 2024-05-10T03:32:55.484 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.881+0000 7f2e97fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e9807ac10 0x7f2e981077b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:32:55.484 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.881+0000 7f2e97fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e9807ac10 0x7f2e981077b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60154/0 (socket says 172.21.15.45:60154) 2024-05-10T03:32:55.484 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.881+0000 7f2e97fff700 1 -- 172.21.15.45:0/2542534352 learned_addr learned my addr 172.21.15.45:0/2542534352 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:32:55.484 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.881+0000 7f2e97fff700 1 -- 172.21.15.45:0/2542534352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e88009550 con 0x7f2e9807ac10 2024-05-10T03:32:55.484 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.881+0000 7f2e97fff700 1 --2- 172.21.15.45:0/2542534352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e9807ac10 0x7f2e981077b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009130 tx=0x7f2e88011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:32:55.484 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.882+0000 7f2e957fa700 1 -- 172.21.15.45:0/2542534352 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e88003aa0 con 0x7f2e9807ac10 2024-05-10T03:32:55.484 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.882+0000 7f2e957fa700 1 -- 172.21.15.45:0/2542534352 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f2e88003c00 con 0x7f2e9807ac10 2024-05-10T03:32:55.484 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.882+0000 7f2e9e345700 1 -- 172.21.15.45:0/2542534352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e98105f40 con 0x7f2e9807ac10 2024-05-10T03:32:55.484 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.882+0000 7f2e957fa700 1 -- 172.21.15.45:0/2542534352 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e88024800 con 0x7f2e9807ac10 2024-05-10T03:32:55.484 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.882+0000 7f2e9e345700 1 -- 172.21.15.45:0/2542534352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e981063e0 con 0x7f2e9807ac10 2024-05-10T03:32:55.484 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.883+0000 7f2e957fa700 1 -- 172.21.15.45:0/2542534352 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7f2e88024ac0 con 0x7f2e9807ac10 2024-05-10T03:32:55.485 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.883+0000 7f2e957fa700 1 --2- 172.21.15.45:0/2542534352 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f2e80038770 0x7f2e8003ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:55.485 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.883+0000 7f2e957fa700 1 -- 172.21.15.45:0/2542534352 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2e8804d4a0 con 0x7f2e9807ac10 2024-05-10T03:32:55.485 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.883+0000 7f2e977fe700 1 --2- 172.21.15.45:0/2542534352 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f2e80038770 0x7f2e8003ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:32:55.485 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.883+0000 7f2e9e345700 1 -- 172.21.15.45:0/2542534352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e98062840 con 0x7f2e9807ac10 2024-05-10T03:32:55.485 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.884+0000 7f2e977fe700 1 --2- 172.21.15.45:0/2542534352 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f2e80038770 0x7f2e8003ac80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c006fd0 tx=0x7f2e8c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:32:55.485 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:53.889+0000 7f2e957fa700 1 -- 172.21.15.45:0/2542534352 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2e88024d70 con 0x7f2e9807ac10 2024-05-10T03:32:55.485 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:54.163+0000 7f2e9e345700 1 -- 172.21.15.45:0/2542534352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f2e9810b810 con 0x7f2e9807ac10 2024-05-10T03:32:55.485 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.091+0000 7f2e957fa700 1 -- 172.21.15.45:0/2542534352 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f2e88018350 con 0x7f2e9807ac10 2024-05-10T03:32:55.485 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.093+0000 7f2e957fa700 1 -- 172.21.15.45:0/2542534352 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f2e8800bde0 con 0x7f2e9807ac10 2024-05-10T03:32:55.485 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.096+0000 7f2e9e345700 1 -- 172.21.15.45:0/2542534352 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f2e80038770 msgr2=0x7f2e8003ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:32:55.485 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.096+0000 7f2e9e345700 1 --2- 172.21.15.45:0/2542534352 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f2e80038770 0x7f2e8003ac80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c006fd0 tx=0x7f2e8c006e40 comp rx=0 tx=0).stop 2024-05-10T03:32:55.485 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.096+0000 7f2e9e345700 1 -- 172.21.15.45:0/2542534352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e9807ac10 msgr2=0x7f2e981077b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:32:55.485 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.096+0000 7f2e9e345700 1 --2- 172.21.15.45:0/2542534352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e9807ac10 0x7f2e981077b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009130 tx=0x7f2e88011b40 comp rx=0 tx=0).stop 2024-05-10T03:32:55.486 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.096+0000 7f2e9e345700 1 -- 172.21.15.45:0/2542534352 shutdown_connections 2024-05-10T03:32:55.486 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.096+0000 7f2e9e345700 1 --2- 172.21.15.45:0/2542534352 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f2e80038770 0x7f2e8003ac80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:55.486 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.096+0000 7f2e9e345700 1 --2- 172.21.15.45:0/2542534352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e9807ac10 0x7f2e981077b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:55.486 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.096+0000 7f2e9e345700 1 -- 172.21.15.45:0/2542534352 >> 172.21.15.45:0/2542534352 conn(0x7f2e98101a30 msgr2=0x7f2e981022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:32:55.486 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.097+0000 7f2e9e345700 1 -- 172.21.15.45:0/2542534352 shutdown_connections 2024-05-10T03:32:55.486 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.097+0000 7f2e9e345700 1 -- 172.21.15.45:0/2542534352 wait complete. 2024-05-10T03:32:55.721 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:55 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:55.609+0000 7fe785c68200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T03:32:55.722 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:55 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:55.717+0000 7fe785c68200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T03:32:56.034 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:55 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:55.819+0000 7fe785c68200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T03:32:56.034 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:55 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:55.920+0000 7fe785c68200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T03:32:56.454 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:56 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2542534352' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-10T03:32:56.454 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:56 smithi045 ceph-mon[42520]: mgrmap e5: x(active, since 5s) 2024-05-10T03:32:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout { 2024-05-10T03:32:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-05-10T03:32:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-10T03:32:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-10T03:32:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-10T03:32:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout } 2024-05-10T03:32:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.868+0000 7f7acde3c700 1 Processor -- start 2024-05-10T03:32:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.868+0000 7f7acde3c700 1 -- start start 2024-05-10T03:32:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.868+0000 7f7acde3c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac807ac30 0x7f7ac810a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.868+0000 7f7acde3c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac810a610 con 0x7f7ac807ac30 2024-05-10T03:32:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.869+0000 7f7ac77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac807ac30 0x7f7ac810a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:32:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.869+0000 7f7ac77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac807ac30 0x7f7ac810a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60184/0 (socket says 172.21.15.45:60184) 2024-05-10T03:32:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.869+0000 7f7ac77fe700 1 -- 172.21.15.45:0/1855420687 learned_addr learned my addr 172.21.15.45:0/1855420687 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:32:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.869+0000 7f7ac77fe700 1 -- 172.21.15.45:0/1855420687 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac810a750 con 0x7f7ac807ac30 2024-05-10T03:32:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.869+0000 7f7ac77fe700 1 --2- 172.21.15.45:0/1855420687 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac807ac30 0x7f7ac810a020 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7ab80098a0 tx=0x7f7ab8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e16ecfcb5e60ab0d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:32:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.869+0000 7f7ac67fc700 1 -- 172.21.15.45:0/1855420687 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ab8004160 con 0x7f7ac807ac30 2024-05-10T03:32:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.869+0000 7f7ac67fc700 1 -- 172.21.15.45:0/1855420687 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f7ab80042c0 con 0x7f7ac807ac30 2024-05-10T03:32:56.501 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.869+0000 7f7ac67fc700 1 -- 172.21.15.45:0/1855420687 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ab8011ac0 con 0x7f7ac807ac30 2024-05-10T03:32:56.501 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.870+0000 7f7acde3c700 1 -- 172.21.15.45:0/1855420687 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac807ac30 msgr2=0x7f7ac810a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:32:56.501 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.870+0000 7f7acde3c700 1 --2- 172.21.15.45:0/1855420687 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac807ac30 0x7f7ac810a020 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7ab80098a0 tx=0x7f7ab8009bb0 comp rx=0 tx=0).stop 2024-05-10T03:32:56.501 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.870+0000 7f7acde3c700 1 -- 172.21.15.45:0/1855420687 shutdown_connections 2024-05-10T03:32:56.501 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.870+0000 7f7acde3c700 1 --2- 172.21.15.45:0/1855420687 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac807ac30 0x7f7ac810a020 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:56.501 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.870+0000 7f7acde3c700 1 -- 172.21.15.45:0/1855420687 >> 172.21.15.45:0/1855420687 conn(0x7f7ac8101a30 msgr2=0x7f7ac8103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:32:56.501 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.870+0000 7f7acde3c700 1 -- 172.21.15.45:0/1855420687 shutdown_connections 2024-05-10T03:32:56.501 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.870+0000 7f7acde3c700 1 -- 172.21.15.45:0/1855420687 wait complete. 2024-05-10T03:32:56.501 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.871+0000 7f7acde3c700 1 Processor -- start 2024-05-10T03:32:56.501 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.871+0000 7f7acde3c700 1 -- start start 2024-05-10T03:32:56.501 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.872+0000 7f7acde3c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac807ac30 0x7f7ac8107790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:56.501 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.872+0000 7f7acde3c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac8107cd0 con 0x7f7ac807ac30 2024-05-10T03:32:56.501 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.872+0000 7f7ac77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac807ac30 0x7f7ac8107790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:32:56.501 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.872+0000 7f7ac77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac807ac30 0x7f7ac8107790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60200/0 (socket says 172.21.15.45:60200) 2024-05-10T03:32:56.502 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.872+0000 7f7ac77fe700 1 -- 172.21.15.45:0/1447157168 learned_addr learned my addr 172.21.15.45:0/1447157168 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:32:56.502 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.872+0000 7f7ac77fe700 1 -- 172.21.15.45:0/1447157168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab8009550 con 0x7f7ac807ac30 2024-05-10T03:32:56.502 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.872+0000 7f7ac77fe700 1 --2- 172.21.15.45:0/1447157168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac807ac30 0x7f7ac8107790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8000c00 tx=0x7f7ab8011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:32:56.502 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.873+0000 7f7ac4ff9700 1 -- 172.21.15.45:0/1447157168 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ab8003aa0 con 0x7f7ac807ac30 2024-05-10T03:32:56.502 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.873+0000 7f7ac4ff9700 1 -- 172.21.15.45:0/1447157168 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f7ab8003c00 con 0x7f7ac807ac30 2024-05-10T03:32:56.502 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.873+0000 7f7acde3c700 1 -- 172.21.15.45:0/1447157168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac8105f20 con 0x7f7ac807ac30 2024-05-10T03:32:56.502 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.873+0000 7f7ac4ff9700 1 -- 172.21.15.45:0/1447157168 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ab80248a0 con 0x7f7ac807ac30 2024-05-10T03:32:56.502 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.873+0000 7f7acde3c700 1 -- 172.21.15.45:0/1447157168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac81063c0 con 0x7f7ac807ac30 2024-05-10T03:32:56.502 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.874+0000 7f7ac4ff9700 1 -- 172.21.15.45:0/1447157168 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f7ab802d3f0 con 0x7f7ac807ac30 2024-05-10T03:32:56.502 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.874+0000 7f7ac4ff9700 1 --2- 172.21.15.45:0/1447157168 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f7ab00387c0 0x7f7ab003acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:32:56.502 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.874+0000 7f7ac4ff9700 1 -- 172.21.15.45:0/1447157168 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7ab804d4f0 con 0x7f7ac807ac30 2024-05-10T03:32:56.502 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.874+0000 7f7acde3c700 1 -- 172.21.15.45:0/1447157168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac8062840 con 0x7f7ac807ac30 2024-05-10T03:32:56.503 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.874+0000 7f7ac6ffd700 1 -- 172.21.15.45:0/1447157168 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f7ab00387c0 msgr2=0x7f7ab003acd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/534860598 2024-05-10T03:32:56.503 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.874+0000 7f7ac6ffd700 1 --2- 172.21.15.45:0/1447157168 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f7ab00387c0 0x7f7ab003acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-10T03:32:56.503 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:55.879+0000 7f7ac4ff9700 1 -- 172.21.15.45:0/1447157168 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7ab8049080 con 0x7f7ac807ac30 2024-05-10T03:32:56.503 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.075+0000 7f7ac6ffd700 1 -- 172.21.15.45:0/1447157168 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f7ab00387c0 msgr2=0x7f7ab003acd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/534860598 2024-05-10T03:32:56.503 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.075+0000 7f7ac6ffd700 1 --2- 172.21.15.45:0/1447157168 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f7ab00387c0 0x7f7ab003acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-10T03:32:56.503 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.151+0000 7f7acde3c700 1 -- 172.21.15.45:0/1447157168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f7ac810b850 con 0x7f7ac807ac30 2024-05-10T03:32:56.503 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.151+0000 7f7ac4ff9700 1 -- 172.21.15.45:0/1447157168 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f7ab8010740 con 0x7f7ac807ac30 2024-05-10T03:32:56.503 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.154+0000 7f7acde3c700 1 -- 172.21.15.45:0/1447157168 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f7ab00387c0 msgr2=0x7f7ab003acd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-10T03:32:56.503 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.154+0000 7f7acde3c700 1 --2- 172.21.15.45:0/1447157168 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f7ab00387c0 0x7f7ab003acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:56.503 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.154+0000 7f7acde3c700 1 -- 172.21.15.45:0/1447157168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac807ac30 msgr2=0x7f7ac8107790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:32:56.503 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.154+0000 7f7acde3c700 1 --2- 172.21.15.45:0/1447157168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac807ac30 0x7f7ac8107790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8000c00 tx=0x7f7ab8011b40 comp rx=0 tx=0).stop 2024-05-10T03:32:56.503 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.154+0000 7f7acde3c700 1 -- 172.21.15.45:0/1447157168 shutdown_connections 2024-05-10T03:32:56.503 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.154+0000 7f7acde3c700 1 --2- 172.21.15.45:0/1447157168 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7f7ab00387c0 0x7f7ab003acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:56.504 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.154+0000 7f7acde3c700 1 --2- 172.21.15.45:0/1447157168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ac807ac30 0x7f7ac8107790 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:32:56.504 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.154+0000 7f7acde3c700 1 -- 172.21.15.45:0/1447157168 >> 172.21.15.45:0/1447157168 conn(0x7f7ac8101a30 msgr2=0x7f7ac8102320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:32:56.504 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.154+0000 7f7acde3c700 1 -- 172.21.15.45:0/1447157168 shutdown_connections 2024-05-10T03:32:56.504 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.154+0000 7f7acde3c700 1 -- 172.21.15.45:0/1447157168 wait complete. 2024-05-10T03:32:56.504 INFO:teuthology.orchestra.run.smithi045.stdout:Waiting for the mgr to restart... 2024-05-10T03:32:56.504 INFO:teuthology.orchestra.run.smithi045.stdout:Waiting for mgr epoch 5... 2024-05-10T03:32:56.784 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:56 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:56.663+0000 7fe785c68200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T03:32:57.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:32:57 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1447157168' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-10T03:32:57.284 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:56 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:56.962+0000 7fe785c68200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T03:32:57.285 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:57 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:57.060+0000 7fe785c68200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T03:32:57.285 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:57 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:57.186+0000 7fe785c68200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T03:32:57.784 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:57 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:57.368+0000 7fe785c68200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T03:32:57.784 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:57 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:57.513+0000 7fe785c68200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T03:32:57.784 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:57 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:57.610+0000 7fe785c68200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T03:32:58.485 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:58 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:58.034+0000 7fe785c68200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T03:32:58.485 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:58 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:58.481+0000 7fe785c68200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T03:32:58.784 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:58 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:58.702+0000 7fe785c68200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-10T03:32:59.284 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:58 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:58.808+0000 7fe785c68200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T03:32:59.966 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:59 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:59.682+0000 7fe785c68200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T03:32:59.966 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:59 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:59.792+0000 7fe785c68200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T03:32:59.966 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:32:59 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:32:59.962+0000 7fe785c68200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T03:33:01.034 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:00 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:00.687+0000 7fe785c68200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-10T03:33:01.034 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:00 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:00.895+0000 7fe785c68200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T03:33:01.534 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:01 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:01.115+0000 7fe785c68200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T03:33:02.513 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:02 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:02.184+0000 7fe785c68200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T03:33:02.784 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:02 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:02.509+0000 7fe785c68200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T03:33:02.784 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:02 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:02.611+0000 7fe785c68200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T03:33:03.284 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:02 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:02.831+0000 7fe785c68200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T03:33:03.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:02 smithi045 ceph-mon[42520]: Active manager daemon x restarted 2024-05-10T03:33:03.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:02 smithi045 ceph-mon[42520]: Activating manager daemon x 2024-05-10T03:33:03.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:02 smithi045 ceph-mon[42520]: osdmap e2: 0 total, 0 up, 0 in 2024-05-10T03:33:03.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:02 smithi045 ceph-mon[42520]: mgrmap e6: x(active, starting, since 0.0040709s) 2024-05-10T03:33:03.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:02 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T03:33:03.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:02 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-10T03:33:03.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:02 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-10T03:33:03.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:02 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-10T03:33:03.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:02 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-10T03:33:03.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:02 smithi045 ceph-mon[42520]: Manager daemon x is now available 2024-05-10T03:33:03.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:02 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' 2024-05-10T03:33:03.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:02 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' 2024-05-10T03:33:04.209 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout { 2024-05-10T03:33:04.218 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-05-10T03:33:04.218 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-10T03:33:04.218 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout } 2024-05-10T03:33:04.218 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.945+0000 7fd771faa700 1 Processor -- start 2024-05-10T03:33:04.218 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.945+0000 7fd771faa700 1 -- start start 2024-05-10T03:33:04.218 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.946+0000 7fd771faa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd76c107520 0x7fd76c107930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:04.218 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.946+0000 7fd771faa700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c107f20 con 0x7fd76c107520 2024-05-10T03:33:04.218 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.946+0000 7fd76b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd76c107520 0x7fd76c107930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:04.218 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.946+0000 7fd76b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd76c107520 0x7fd76c107930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60212/0 (socket says 172.21.15.45:60212) 2024-05-10T03:33:04.218 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.946+0000 7fd76b7fe700 1 -- 172.21.15.45:0/1844755029 learned_addr learned my addr 172.21.15.45:0/1844755029 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:04.219 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.946+0000 7fd76b7fe700 1 -- 172.21.15.45:0/1844755029 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c108650 con 0x7fd76c107520 2024-05-10T03:33:04.219 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.946+0000 7fd76b7fe700 1 --2- 172.21.15.45:0/1844755029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd76c107520 0x7fd76c107930 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0098a0 tx=0x7fd75c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae06293974f9e99 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:04.219 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.947+0000 7fd76a7fc700 1 -- 172.21.15.45:0/1844755029 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd75c004160 con 0x7fd76c107520 2024-05-10T03:33:04.219 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.947+0000 7fd76a7fc700 1 -- 172.21.15.45:0/1844755029 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fd75c0042c0 con 0x7fd76c107520 2024-05-10T03:33:04.219 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.947+0000 7fd76a7fc700 1 -- 172.21.15.45:0/1844755029 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd75c011ac0 con 0x7fd76c107520 2024-05-10T03:33:04.219 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.948+0000 7fd771faa700 1 -- 172.21.15.45:0/1844755029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd76c107520 msgr2=0x7fd76c107930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:04.219 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.948+0000 7fd771faa700 1 --2- 172.21.15.45:0/1844755029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd76c107520 0x7fd76c107930 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0098a0 tx=0x7fd75c009bb0 comp rx=0 tx=0).stop 2024-05-10T03:33:04.219 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.948+0000 7fd771faa700 1 -- 172.21.15.45:0/1844755029 shutdown_connections 2024-05-10T03:33:04.219 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.948+0000 7fd771faa700 1 --2- 172.21.15.45:0/1844755029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd76c107520 0x7fd76c107930 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:04.219 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.948+0000 7fd771faa700 1 -- 172.21.15.45:0/1844755029 >> 172.21.15.45:0/1844755029 conn(0x7fd76c102b40 msgr2=0x7fd76c105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:04.219 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.948+0000 7fd771faa700 1 -- 172.21.15.45:0/1844755029 shutdown_connections 2024-05-10T03:33:04.219 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.948+0000 7fd771faa700 1 -- 172.21.15.45:0/1844755029 wait complete. 2024-05-10T03:33:04.219 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.949+0000 7fd771faa700 1 Processor -- start 2024-05-10T03:33:04.219 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.949+0000 7fd771faa700 1 -- start start 2024-05-10T03:33:04.220 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.949+0000 7fd771faa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd76c107520 0x7fd76c07c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:04.220 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.949+0000 7fd771faa700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c07cf30 con 0x7fd76c107520 2024-05-10T03:33:04.220 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.949+0000 7fd76b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd76c107520 0x7fd76c07c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:04.220 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.949+0000 7fd76b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd76c107520 0x7fd76c07c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60220/0 (socket says 172.21.15.45:60220) 2024-05-10T03:33:04.220 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.950+0000 7fd76b7fe700 1 -- 172.21.15.45:0/3751212245 learned_addr learned my addr 172.21.15.45:0/3751212245 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:04.220 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.950+0000 7fd76b7fe700 1 -- 172.21.15.45:0/3751212245 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c009550 con 0x7fd76c107520 2024-05-10T03:33:04.220 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.950+0000 7fd76b7fe700 1 --2- 172.21.15.45:0/3751212245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd76c107520 0x7fd76c07c9f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd75c011a70 tx=0x7fd75c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:04.220 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.950+0000 7fd768ff9700 1 -- 172.21.15.45:0/3751212245 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd75c0039c0 con 0x7fd76c107520 2024-05-10T03:33:04.220 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.950+0000 7fd768ff9700 1 -- 172.21.15.45:0/3751212245 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fd75c003b20 con 0x7fd76c107520 2024-05-10T03:33:04.220 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.950+0000 7fd771faa700 1 -- 172.21.15.45:0/3751212245 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76c07b180 con 0x7fd76c107520 2024-05-10T03:33:04.220 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.950+0000 7fd768ff9700 1 -- 172.21.15.45:0/3751212245 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd75c024630 con 0x7fd76c107520 2024-05-10T03:33:04.220 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.950+0000 7fd771faa700 1 -- 172.21.15.45:0/3751212245 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76c07b620 con 0x7fd76c107520 2024-05-10T03:33:04.220 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.952+0000 7fd768ff9700 1 -- 172.21.15.45:0/3751212245 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fd75c0248a0 con 0x7fd76c107520 2024-05-10T03:33:04.220 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.952+0000 7fd768ff9700 1 --2- 172.21.15.45:0/3751212245 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7fd754038810 0x7fd75403ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:04.220 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.952+0000 7fd768ff9700 1 -- 172.21.15.45:0/3751212245 --> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd75403b430 con 0x7fd754038810 2024-05-10T03:33:04.221 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.952+0000 7fd768ff9700 1 -- 172.21.15.45:0/3751212245 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd75c04c590 con 0x7fd76c107520 2024-05-10T03:33:04.221 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.952+0000 7fd76affd700 1 -- 172.21.15.45:0/3751212245 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7fd754038810 msgr2=0x7fd75403ad20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/534860598 2024-05-10T03:33:04.221 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:56.952+0000 7fd76affd700 1 --2- 172.21.15.45:0/3751212245 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7fd754038810 0x7fd75403ad20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-10T03:33:04.221 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:57.153+0000 7fd76affd700 1 -- 172.21.15.45:0/3751212245 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7fd754038810 msgr2=0x7fd75403ad20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/534860598 2024-05-10T03:33:04.221 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:57.153+0000 7fd76affd700 1 --2- 172.21.15.45:0/3751212245 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7fd754038810 0x7fd75403ad20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-10T03:33:04.221 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:57.554+0000 7fd76affd700 1 -- 172.21.15.45:0/3751212245 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7fd754038810 msgr2=0x7fd75403ad20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/534860598 2024-05-10T03:33:04.221 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:57.554+0000 7fd76affd700 1 --2- 172.21.15.45:0/3751212245 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7fd754038810 0x7fd75403ad20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-10T03:33:04.221 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:58.355+0000 7fd76affd700 1 -- 172.21.15.45:0/3751212245 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7fd754038810 msgr2=0x7fd75403ad20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/534860598 2024-05-10T03:33:04.221 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:58.355+0000 7fd76affd700 1 --2- 172.21.15.45:0/3751212245 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7fd754038810 0x7fd75403ad20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-10T03:33:04.221 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:59.956+0000 7fd76affd700 1 -- 172.21.15.45:0/3751212245 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7fd754038810 msgr2=0x7fd75403ad20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/534860598 2024-05-10T03:33:04.221 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:32:59.956+0000 7fd76affd700 1 --2- 172.21.15.45:0/3751212245 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7fd754038810 0x7fd75403ad20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-10T03:33:04.221 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:02.847+0000 7fd768ff9700 1 -- 172.21.15.45:0/3751212245 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mgrmap(e 6) v1 ==== 45308+0+0 (secure 0 0 0) 0x7fd75c02d910 con 0x7fd76c107520 2024-05-10T03:33:04.221 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:02.848+0000 7fd768ff9700 1 -- 172.21.15.45:0/3751212245 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7fd754038810 msgr2=0x7fd75403ad20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-10T03:33:04.222 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:02.848+0000 7fd768ff9700 1 --2- 172.21.15.45:0/3751212245 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7fd754038810 0x7fd75403ad20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:04.222 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:03.849+0000 7fd768ff9700 1 -- 172.21.15.45:0/3751212245 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mgrmap(e 7) v1 ==== 45435+0+0 (secure 0 0 0) 0x7fd75c04e3a0 con 0x7fd76c107520 2024-05-10T03:33:04.222 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:03.849+0000 7fd768ff9700 1 --2- 172.21.15.45:0/3751212245 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fd75403bfe0 0x7fd75403e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:04.222 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:03.849+0000 7fd768ff9700 1 -- 172.21.15.45:0/3751212245 --> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd75403b430 con 0x7fd75403bfe0 2024-05-10T03:33:04.222 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:03.850+0000 7fd76affd700 1 --2- 172.21.15.45:0/3751212245 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fd75403bfe0 0x7fd75403e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:04.222 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:03.850+0000 7fd76affd700 1 --2- 172.21.15.45:0/3751212245 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fd75403bfe0 0x7fd75403e400 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd760003a10 tx=0x7fd7600092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:04.222 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:03.851+0000 7fd768ff9700 1 -- 172.21.15.45:0/3751212245 <== mgr.14120 v2:172.21.15.45:6800/485502847 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7fd75403b430 con 0x7fd75403bfe0 2024-05-10T03:33:04.222 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:03.858+0000 7fd771faa700 1 -- 172.21.15.45:0/3751212245 --> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fd76c062840 con 0x7fd75403bfe0 2024-05-10T03:33:04.222 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:03.858+0000 7fd768ff9700 1 -- 172.21.15.45:0/3751212245 <== mgr.14120 v2:172.21.15.45:6800/485502847 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fd76c062840 con 0x7fd75403bfe0 2024-05-10T03:33:04.222 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:03.859+0000 7fd771faa700 1 -- 172.21.15.45:0/3751212245 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fd75403bfe0 msgr2=0x7fd75403e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:04.222 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:03.859+0000 7fd771faa700 1 --2- 172.21.15.45:0/3751212245 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fd75403bfe0 0x7fd75403e400 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd760003a10 tx=0x7fd7600092b0 comp rx=0 tx=0).stop 2024-05-10T03:33:04.222 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:03.859+0000 7fd771faa700 1 -- 172.21.15.45:0/3751212245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd76c107520 msgr2=0x7fd76c07c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:04.222 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:03.859+0000 7fd771faa700 1 --2- 172.21.15.45:0/3751212245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd76c107520 0x7fd76c07c9f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd75c011a70 tx=0x7fd75c011b50 comp rx=0 tx=0).stop 2024-05-10T03:33:04.223 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:03.859+0000 7fd771faa700 1 -- 172.21.15.45:0/3751212245 shutdown_connections 2024-05-10T03:33:04.223 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:03.859+0000 7fd771faa700 1 --2- 172.21.15.45:0/3751212245 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fd75403bfe0 0x7fd75403e400 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:04.223 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:03.859+0000 7fd771faa700 1 --2- 172.21.15.45:0/3751212245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd76c107520 0x7fd76c07c9f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:04.223 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:03.859+0000 7fd771faa700 1 --2- 172.21.15.45:0/3751212245 >> [v2:172.21.15.45:6800/534860598,v1:172.21.15.45:6801/534860598] conn(0x7fd754038810 0x7fd75403ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:04.223 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:03.859+0000 7fd771faa700 1 -- 172.21.15.45:0/3751212245 >> 172.21.15.45:0/3751212245 conn(0x7fd76c102b40 msgr2=0x7fd76c103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:04.223 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:03.859+0000 7fd771faa700 1 -- 172.21.15.45:0/3751212245 shutdown_connections 2024-05-10T03:33:04.223 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:03.859+0000 7fd771faa700 1 -- 172.21.15.45:0/3751212245 wait complete. 2024-05-10T03:33:04.223 INFO:teuthology.orchestra.run.smithi045.stdout:mgr epoch 5 is available 2024-05-10T03:33:04.223 INFO:teuthology.orchestra.run.smithi045.stdout:Setting orchestrator backend to cephadm... 2024-05-10T03:33:04.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:03 smithi045 ceph-mon[42520]: Found migration_current of "None". Setting to last migration. 2024-05-10T03:33:04.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:03 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:33:04.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:03 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:33:04.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:03 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-10T03:33:04.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:03 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-10T03:33:04.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:03 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' 2024-05-10T03:33:04.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:03 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' 2024-05-10T03:33:04.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:03 smithi045 ceph-mon[42520]: mgrmap e7: x(active, since 1.0072s) 2024-05-10T03:33:05.128 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:04 smithi045 ceph-mon[42520]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-10T03:33:05.129 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:04 smithi045 ceph-mon[42520]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-10T03:33:05.129 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:04 smithi045 ceph-mon[42520]: [10/May/2024:03:33:03] ENGINE Bus STARTING 2024-05-10T03:33:05.129 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:04 smithi045 ceph-mon[42520]: [10/May/2024:03:33:04] ENGINE Serving on https://172.21.15.45:7150 2024-05-10T03:33:05.129 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:04 smithi045 ceph-mon[42520]: [10/May/2024:03:33:04] ENGINE Serving on http://172.21.15.45:8765 2024-05-10T03:33:05.129 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:04 smithi045 ceph-mon[42520]: [10/May/2024:03:33:04] ENGINE Bus STARTED 2024-05-10T03:33:05.129 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:04 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:33:05.129 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:04 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' 2024-05-10T03:33:05.129 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:04 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:33:05.189 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.584+0000 7f83c6446700 1 Processor -- start 2024-05-10T03:33:05.189 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.584+0000 7f83c6446700 1 -- start start 2024-05-10T03:33:05.189 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.585+0000 7f83c6446700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83c0107520 0x7f83c0107930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:05.189 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.585+0000 7f83c6446700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c0107f20 con 0x7f83c0107520 2024-05-10T03:33:05.189 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.585+0000 7f83bffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83c0107520 0x7f83c0107930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:05.190 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.585+0000 7f83bffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83c0107520 0x7f83c0107930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49964/0 (socket says 172.21.15.45:49964) 2024-05-10T03:33:05.190 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.585+0000 7f83bffff700 1 -- 172.21.15.45:0/1454731983 learned_addr learned my addr 172.21.15.45:0/1454731983 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:05.190 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.585+0000 7f83bffff700 1 -- 172.21.15.45:0/1454731983 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c0108650 con 0x7f83c0107520 2024-05-10T03:33:05.190 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.585+0000 7f83bffff700 1 --2- 172.21.15.45:0/1454731983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83c0107520 0x7f83c0107930 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f83b00098a0 tx=0x7f83b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3167076a0094189d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:05.190 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.585+0000 7f83beffd700 1 -- 172.21.15.45:0/1454731983 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83b0004160 con 0x7f83c0107520 2024-05-10T03:33:05.190 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.586+0000 7f83beffd700 1 -- 172.21.15.45:0/1454731983 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f83b00042c0 con 0x7f83c0107520 2024-05-10T03:33:05.190 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.586+0000 7f83beffd700 1 -- 172.21.15.45:0/1454731983 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83b0011ac0 con 0x7f83c0107520 2024-05-10T03:33:05.190 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.586+0000 7f83c6446700 1 -- 172.21.15.45:0/1454731983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83c0107520 msgr2=0x7f83c0107930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:05.190 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.586+0000 7f83c6446700 1 --2- 172.21.15.45:0/1454731983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83c0107520 0x7f83c0107930 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f83b00098a0 tx=0x7f83b0009bb0 comp rx=0 tx=0).stop 2024-05-10T03:33:05.190 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.586+0000 7f83c6446700 1 -- 172.21.15.45:0/1454731983 shutdown_connections 2024-05-10T03:33:05.190 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.586+0000 7f83c6446700 1 --2- 172.21.15.45:0/1454731983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83c0107520 0x7f83c0107930 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:05.190 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.586+0000 7f83c6446700 1 -- 172.21.15.45:0/1454731983 >> 172.21.15.45:0/1454731983 conn(0x7f83c0102b40 msgr2=0x7f83c0105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:05.191 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.586+0000 7f83c6446700 1 -- 172.21.15.45:0/1454731983 shutdown_connections 2024-05-10T03:33:05.191 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.586+0000 7f83c6446700 1 -- 172.21.15.45:0/1454731983 wait complete. 2024-05-10T03:33:05.191 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.587+0000 7f83c6446700 1 Processor -- start 2024-05-10T03:33:05.191 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.587+0000 7f83c6446700 1 -- start start 2024-05-10T03:33:05.191 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.588+0000 7f83c6446700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83c0107520 0x7f83c019d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:05.191 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.588+0000 7f83c6446700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c019dda0 con 0x7f83c0107520 2024-05-10T03:33:05.191 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.588+0000 7f83bffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83c0107520 0x7f83c019d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:05.191 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.588+0000 7f83bffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83c0107520 0x7f83c019d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49970/0 (socket says 172.21.15.45:49970) 2024-05-10T03:33:05.191 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.588+0000 7f83bffff700 1 -- 172.21.15.45:0/1786840898 learned_addr learned my addr 172.21.15.45:0/1786840898 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:05.191 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.588+0000 7f83bffff700 1 -- 172.21.15.45:0/1786840898 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b0009550 con 0x7f83c0107520 2024-05-10T03:33:05.191 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.588+0000 7f83bffff700 1 --2- 172.21.15.45:0/1786840898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83c0107520 0x7f83c019d860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f83b0011a70 tx=0x7f83b0011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:05.191 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.588+0000 7f83bd7fa700 1 -- 172.21.15.45:0/1786840898 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83b00039c0 con 0x7f83c0107520 2024-05-10T03:33:05.191 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.588+0000 7f83bd7fa700 1 -- 172.21.15.45:0/1786840898 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f83b0003b20 con 0x7f83c0107520 2024-05-10T03:33:05.191 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.588+0000 7f83c6446700 1 -- 172.21.15.45:0/1786840898 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c019dfa0 con 0x7f83c0107520 2024-05-10T03:33:05.192 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.588+0000 7f83bd7fa700 1 -- 172.21.15.45:0/1786840898 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83b0024630 con 0x7f83c0107520 2024-05-10T03:33:05.192 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.588+0000 7f83c6446700 1 -- 172.21.15.45:0/1786840898 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c019e440 con 0x7f83c0107520 2024-05-10T03:33:05.192 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.589+0000 7f83bd7fa700 1 -- 172.21.15.45:0/1786840898 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 7) v1 ==== 45435+0+0 (secure 0 0 0) 0x7f83b00248a0 con 0x7f83c0107520 2024-05-10T03:33:05.192 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.589+0000 7f83c6446700 1 -- 172.21.15.45:0/1786840898 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c0197760 con 0x7f83c0107520 2024-05-10T03:33:05.192 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.590+0000 7f83bd7fa700 1 --2- 172.21.15.45:0/1786840898 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f83a80386e0 0x7f83a803abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:05.192 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.590+0000 7f83bd7fa700 1 -- 172.21.15.45:0/1786840898 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f83b004c3f0 con 0x7f83c0107520 2024-05-10T03:33:05.192 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.590+0000 7f83bf7fe700 1 --2- 172.21.15.45:0/1786840898 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f83a80386e0 0x7f83a803abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:05.192 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.590+0000 7f83bf7fe700 1 --2- 172.21.15.45:0/1786840898 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f83a80386e0 0x7f83a803abf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f83b4006fd0 tx=0x7f83b4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:05.192 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.595+0000 7f83bd7fa700 1 -- 172.21.15.45:0/1786840898 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f83b0024b50 con 0x7f83c0107520 2024-05-10T03:33:05.192 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.826+0000 7f83c6446700 1 -- 172.21.15.45:0/1786840898 --> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f83c002d020 con 0x7f83a80386e0 2024-05-10T03:33:05.192 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.837+0000 7f83bd7fa700 1 -- 172.21.15.45:0/1786840898 <== mgr.14120 v2:172.21.15.45:6800/485502847 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f83c002d020 con 0x7f83a80386e0 2024-05-10T03:33:05.192 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.839+0000 7f83c6446700 1 -- 172.21.15.45:0/1786840898 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f83a80386e0 msgr2=0x7f83a803abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:05.192 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.839+0000 7f83c6446700 1 --2- 172.21.15.45:0/1786840898 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f83a80386e0 0x7f83a803abf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f83b4006fd0 tx=0x7f83b4006e40 comp rx=0 tx=0).stop 2024-05-10T03:33:05.193 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.839+0000 7f83c6446700 1 -- 172.21.15.45:0/1786840898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83c0107520 msgr2=0x7f83c019d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:05.193 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.839+0000 7f83c6446700 1 --2- 172.21.15.45:0/1786840898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83c0107520 0x7f83c019d860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f83b0011a70 tx=0x7f83b0011b50 comp rx=0 tx=0).stop 2024-05-10T03:33:05.193 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.840+0000 7f83c6446700 1 -- 172.21.15.45:0/1786840898 shutdown_connections 2024-05-10T03:33:05.193 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.840+0000 7f83c6446700 1 --2- 172.21.15.45:0/1786840898 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f83a80386e0 0x7f83a803abf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:05.193 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.840+0000 7f83c6446700 1 --2- 172.21.15.45:0/1786840898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83c0107520 0x7f83c019d860 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:05.193 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.840+0000 7f83c6446700 1 -- 172.21.15.45:0/1786840898 >> 172.21.15.45:0/1786840898 conn(0x7f83c0102b40 msgr2=0x7f83c007b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:05.193 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.840+0000 7f83c6446700 1 -- 172.21.15.45:0/1786840898 shutdown_connections 2024-05-10T03:33:05.193 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:04.840+0000 7f83c6446700 1 -- 172.21.15.45:0/1786840898 wait complete. 2024-05-10T03:33:06.097 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:05 smithi045 ceph-mon[42520]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:33:06.097 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:05 smithi045 ceph-mon[42520]: mgrmap e8: x(active, since 2s) 2024-05-10T03:33:06.172 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout value unchanged 2024-05-10T03:33:06.172 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.589+0000 7f89ace4b700 1 Processor -- start 2024-05-10T03:33:06.172 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.589+0000 7f89ace4b700 1 -- start start 2024-05-10T03:33:06.172 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.589+0000 7f89ace4b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a8107520 0x7f89a8107930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:06.172 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.589+0000 7f89ace4b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a8107f20 con 0x7f89a8107520 2024-05-10T03:33:06.173 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.589+0000 7f89a659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a8107520 0x7f89a8107930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:06.173 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.589+0000 7f89a659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a8107520 0x7f89a8107930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49986/0 (socket says 172.21.15.45:49986) 2024-05-10T03:33:06.173 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.589+0000 7f89a659c700 1 -- 172.21.15.45:0/992064777 learned_addr learned my addr 172.21.15.45:0/992064777 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:06.173 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.590+0000 7f89a659c700 1 -- 172.21.15.45:0/992064777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a8108650 con 0x7f89a8107520 2024-05-10T03:33:06.173 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.590+0000 7f89a659c700 1 --2- 172.21.15.45:0/992064777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a8107520 0x7f89a8107930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f89980098a0 tx=0x7f8998009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b9607077f34242 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:06.173 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.590+0000 7f89a559a700 1 -- 172.21.15.45:0/992064777 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8998004160 con 0x7f89a8107520 2024-05-10T03:33:06.173 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.590+0000 7f89a559a700 1 -- 172.21.15.45:0/992064777 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f89980042c0 con 0x7f89a8107520 2024-05-10T03:33:06.173 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.590+0000 7f89a559a700 1 -- 172.21.15.45:0/992064777 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8998011ac0 con 0x7f89a8107520 2024-05-10T03:33:06.173 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.591+0000 7f89ace4b700 1 -- 172.21.15.45:0/992064777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a8107520 msgr2=0x7f89a8107930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:06.173 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.591+0000 7f89ace4b700 1 --2- 172.21.15.45:0/992064777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a8107520 0x7f89a8107930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f89980098a0 tx=0x7f8998009bb0 comp rx=0 tx=0).stop 2024-05-10T03:33:06.173 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.591+0000 7f89ace4b700 1 -- 172.21.15.45:0/992064777 shutdown_connections 2024-05-10T03:33:06.173 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.591+0000 7f89ace4b700 1 --2- 172.21.15.45:0/992064777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a8107520 0x7f89a8107930 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:06.173 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.591+0000 7f89ace4b700 1 -- 172.21.15.45:0/992064777 >> 172.21.15.45:0/992064777 conn(0x7f89a8102b40 msgr2=0x7f89a8105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:06.173 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.591+0000 7f89ace4b700 1 -- 172.21.15.45:0/992064777 shutdown_connections 2024-05-10T03:33:06.174 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.591+0000 7f89ace4b700 1 -- 172.21.15.45:0/992064777 wait complete. 2024-05-10T03:33:06.174 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.592+0000 7f89ace4b700 1 Processor -- start 2024-05-10T03:33:06.174 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.592+0000 7f89ace4b700 1 -- start start 2024-05-10T03:33:06.174 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.592+0000 7f89ace4b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a8107520 0x7f89a807c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:06.174 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.592+0000 7f89ace4b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a807cf30 con 0x7f89a8107520 2024-05-10T03:33:06.174 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.592+0000 7f89a659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a8107520 0x7f89a807c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:06.174 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.593+0000 7f89a659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a8107520 0x7f89a807c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49994/0 (socket says 172.21.15.45:49994) 2024-05-10T03:33:06.174 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.593+0000 7f89a659c700 1 -- 172.21.15.45:0/1900424847 learned_addr learned my addr 172.21.15.45:0/1900424847 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:06.174 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.593+0000 7f89a659c700 1 -- 172.21.15.45:0/1900424847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8998009550 con 0x7f89a8107520 2024-05-10T03:33:06.174 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.593+0000 7f89a659c700 1 --2- 172.21.15.45:0/1900424847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a8107520 0x7f89a807c9f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8998009fb0 tx=0x7f8998011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:06.174 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.593+0000 7f89977fe700 1 -- 172.21.15.45:0/1900424847 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89980038b0 con 0x7f89a8107520 2024-05-10T03:33:06.174 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.593+0000 7f89977fe700 1 -- 172.21.15.45:0/1900424847 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f8998003a10 con 0x7f89a8107520 2024-05-10T03:33:06.174 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.593+0000 7f89ace4b700 1 -- 172.21.15.45:0/1900424847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a807b180 con 0x7f89a8107520 2024-05-10T03:33:06.175 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.593+0000 7f89977fe700 1 -- 172.21.15.45:0/1900424847 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89980195e0 con 0x7f89a8107520 2024-05-10T03:33:06.175 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.593+0000 7f89ace4b700 1 -- 172.21.15.45:0/1900424847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a807b620 con 0x7f89a8107520 2024-05-10T03:33:06.175 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.594+0000 7f89977fe700 1 -- 172.21.15.45:0/1900424847 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 7) v1 ==== 45435+0+0 (secure 0 0 0) 0x7f8998019850 con 0x7f89a8107520 2024-05-10T03:33:06.175 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.594+0000 7f89ace4b700 1 -- 172.21.15.45:0/1900424847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a8062840 con 0x7f89a8107520 2024-05-10T03:33:06.175 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.594+0000 7f89977fe700 1 --2- 172.21.15.45:0/1900424847 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f89900386a0 0x7f899003abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:06.175 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.594+0000 7f89977fe700 1 -- 172.21.15.45:0/1900424847 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f899804c640 con 0x7f89a8107520 2024-05-10T03:33:06.175 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.595+0000 7f89a5d9b700 1 --2- 172.21.15.45:0/1900424847 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f89900386a0 0x7f899003abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:06.175 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.595+0000 7f89a5d9b700 1 --2- 172.21.15.45:0/1900424847 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f89900386a0 0x7f899003abb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f899c006fd0 tx=0x7f899c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:06.175 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.600+0000 7f89977fe700 1 -- 172.21.15.45:0/1900424847 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f899802b340 con 0x7f89a8107520 2024-05-10T03:33:06.175 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.813+0000 7f89ace4b700 1 -- 172.21.15.45:0/1900424847 --> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f89a807bae0 con 0x7f89900386a0 2024-05-10T03:33:06.175 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.814+0000 7f89977fe700 1 -- 172.21.15.45:0/1900424847 <== mgr.14120 v2:172.21.15.45:6800/485502847 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f89a807bae0 con 0x7f89900386a0 2024-05-10T03:33:06.175 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.816+0000 7f89ace4b700 1 -- 172.21.15.45:0/1900424847 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f89900386a0 msgr2=0x7f899003abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:06.175 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.816+0000 7f89ace4b700 1 --2- 172.21.15.45:0/1900424847 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f89900386a0 0x7f899003abb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f899c006fd0 tx=0x7f899c006e40 comp rx=0 tx=0).stop 2024-05-10T03:33:06.176 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.816+0000 7f89ace4b700 1 -- 172.21.15.45:0/1900424847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a8107520 msgr2=0x7f89a807c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:06.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.816+0000 7f89ace4b700 1 --2- 172.21.15.45:0/1900424847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a8107520 0x7f89a807c9f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8998009fb0 tx=0x7f8998011b20 comp rx=0 tx=0).stop 2024-05-10T03:33:06.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.816+0000 7f89ace4b700 1 -- 172.21.15.45:0/1900424847 shutdown_connections 2024-05-10T03:33:06.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.816+0000 7f89ace4b700 1 --2- 172.21.15.45:0/1900424847 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f89900386a0 0x7f899003abb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:06.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.816+0000 7f89ace4b700 1 --2- 172.21.15.45:0/1900424847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a8107520 0x7f89a807c9f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:06.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.817+0000 7f89ace4b700 1 -- 172.21.15.45:0/1900424847 >> 172.21.15.45:0/1900424847 conn(0x7f89a8102b40 msgr2=0x7f89a8103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:06.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.817+0000 7f89ace4b700 1 -- 172.21.15.45:0/1900424847 shutdown_connections 2024-05-10T03:33:06.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:05.817+0000 7f89ace4b700 1 -- 172.21.15.45:0/1900424847 wait complete. 2024-05-10T03:33:06.177 INFO:teuthology.orchestra.run.smithi045.stdout:Generating ssh key... 2024-05-10T03:33:07.157 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:06 smithi045 ceph-mon[42520]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:33:07.157 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:06 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: Generating public/private rsa key pair. 2024-05-10T03:33:07.157 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:06 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: Your identification has been saved in /tmp/tmpalunwvrr/key. 2024-05-10T03:33:07.157 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:06 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: Your public key has been saved in /tmp/tmpalunwvrr/key.pub. 2024-05-10T03:33:07.157 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:06 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: The key fingerprint is: 2024-05-10T03:33:07.157 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:06 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: SHA256:t1X28nCOGZvt2ZSfdomNIolupw7UhegJPKN7ryfBAGM ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968 2024-05-10T03:33:07.157 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:06 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: The key's randomart image is: 2024-05-10T03:33:07.157 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:06 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: +---[RSA 3072]----+ 2024-05-10T03:33:07.157 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:06 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: | | 2024-05-10T03:33:07.158 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:06 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: |oE. . . | 2024-05-10T03:33:07.158 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:06 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: |o. = . . . o | 2024-05-10T03:33:07.158 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:06 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: | .. = o . o . | 2024-05-10T03:33:07.158 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:06 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: | .o + .S . . + o| 2024-05-10T03:33:07.158 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:06 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: | .o. . o &.| 2024-05-10T03:33:07.158 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:06 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: | . ... . o O.*| 2024-05-10T03:33:07.158 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:06 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: | .....o + . o **| 2024-05-10T03:33:07.158 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:06 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: | .+.++o . . .o=| 2024-05-10T03:33:07.158 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:06 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: +----[SHA256]-----+ 2024-05-10T03:33:07.330 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.545+0000 7f8cfb073700 1 Processor -- start 2024-05-10T03:33:07.330 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.545+0000 7f8cfb073700 1 -- start start 2024-05-10T03:33:07.330 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.545+0000 7f8cfb073700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cf407ac50 0x7f8cf410a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:07.330 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.545+0000 7f8cfb073700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf410a650 con 0x7f8cf407ac50 2024-05-10T03:33:07.330 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.546+0000 7f8cf8e0f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cf407ac50 0x7f8cf410a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:07.330 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.546+0000 7f8cf8e0f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cf407ac50 0x7f8cf410a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50008/0 (socket says 172.21.15.45:50008) 2024-05-10T03:33:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.546+0000 7f8cf8e0f700 1 -- 172.21.15.45:0/855900602 learned_addr learned my addr 172.21.15.45:0/855900602 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.546+0000 7f8cf8e0f700 1 -- 172.21.15.45:0/855900602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf410a790 con 0x7f8cf407ac50 2024-05-10T03:33:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.546+0000 7f8cf8e0f700 1 --2- 172.21.15.45:0/855900602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cf407ac50 0x7f8cf410a040 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8ce80098a0 tx=0x7f8ce8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5364fe4c495403c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.546+0000 7f8cf37fe700 1 -- 172.21.15.45:0/855900602 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ce8004160 con 0x7f8cf407ac50 2024-05-10T03:33:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.546+0000 7f8cf37fe700 1 -- 172.21.15.45:0/855900602 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f8ce80042c0 con 0x7f8cf407ac50 2024-05-10T03:33:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.546+0000 7f8cf37fe700 1 -- 172.21.15.45:0/855900602 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ce8011ac0 con 0x7f8cf407ac50 2024-05-10T03:33:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.547+0000 7f8cfb073700 1 -- 172.21.15.45:0/855900602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cf407ac50 msgr2=0x7f8cf410a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.547+0000 7f8cfb073700 1 --2- 172.21.15.45:0/855900602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cf407ac50 0x7f8cf410a040 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8ce80098a0 tx=0x7f8ce8009bb0 comp rx=0 tx=0).stop 2024-05-10T03:33:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.547+0000 7f8cfb073700 1 -- 172.21.15.45:0/855900602 shutdown_connections 2024-05-10T03:33:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.547+0000 7f8cfb073700 1 --2- 172.21.15.45:0/855900602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cf407ac50 0x7f8cf410a040 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.547+0000 7f8cfb073700 1 -- 172.21.15.45:0/855900602 >> 172.21.15.45:0/855900602 conn(0x7f8cf4101a30 msgr2=0x7f8cf4103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.547+0000 7f8cfb073700 1 -- 172.21.15.45:0/855900602 shutdown_connections 2024-05-10T03:33:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.547+0000 7f8cfb073700 1 -- 172.21.15.45:0/855900602 wait complete. 2024-05-10T03:33:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.548+0000 7f8cfb073700 1 Processor -- start 2024-05-10T03:33:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.548+0000 7f8cfb073700 1 -- start start 2024-05-10T03:33:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.548+0000 7f8cfb073700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cf407ac50 0x7f8cf419b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.548+0000 7f8cfb073700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf419bac0 con 0x7f8cf407ac50 2024-05-10T03:33:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.548+0000 7f8cf8e0f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cf407ac50 0x7f8cf419b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.548+0000 7f8cf8e0f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cf407ac50 0x7f8cf419b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50018/0 (socket says 172.21.15.45:50018) 2024-05-10T03:33:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.548+0000 7f8cf8e0f700 1 -- 172.21.15.45:0/3403932693 learned_addr learned my addr 172.21.15.45:0/3403932693 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.549+0000 7f8cf8e0f700 1 -- 172.21.15.45:0/3403932693 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce8009550 con 0x7f8cf407ac50 2024-05-10T03:33:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.549+0000 7f8cf8e0f700 1 --2- 172.21.15.45:0/3403932693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cf407ac50 0x7f8cf419b580 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8011780 tx=0x7f8ce8011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.549+0000 7f8cf1ffb700 1 -- 172.21.15.45:0/3403932693 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ce8003af0 con 0x7f8cf407ac50 2024-05-10T03:33:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.549+0000 7f8cf1ffb700 1 -- 172.21.15.45:0/3403932693 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f8ce8003c50 con 0x7f8cf407ac50 2024-05-10T03:33:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.549+0000 7f8cfb073700 1 -- 172.21.15.45:0/3403932693 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf419bcc0 con 0x7f8cf407ac50 2024-05-10T03:33:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.549+0000 7f8cf1ffb700 1 -- 172.21.15.45:0/3403932693 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ce8019800 con 0x7f8cf407ac50 2024-05-10T03:33:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.549+0000 7f8cfb073700 1 -- 172.21.15.45:0/3403932693 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf419c160 con 0x7f8cf407ac50 2024-05-10T03:33:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.550+0000 7f8cfb073700 1 -- 172.21.15.45:0/3403932693 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf410b6b0 con 0x7f8cf407ac50 2024-05-10T03:33:07.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.551+0000 7f8cf1ffb700 1 -- 172.21.15.45:0/3403932693 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f8ce8019a80 con 0x7f8cf407ac50 2024-05-10T03:33:07.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.551+0000 7f8cf1ffb700 1 --2- 172.21.15.45:0/3403932693 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f8ce40387c0 0x7f8ce403acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:07.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.551+0000 7f8cf1ffb700 1 -- 172.21.15.45:0/3403932693 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f8ce804ca40 con 0x7f8cf407ac50 2024-05-10T03:33:07.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.551+0000 7f8cf3fff700 1 --2- 172.21.15.45:0/3403932693 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f8ce40387c0 0x7f8ce403acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:07.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.551+0000 7f8cf3fff700 1 --2- 172.21.15.45:0/3403932693 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f8ce40387c0 0x7f8ce403acd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0006fd0 tx=0x7f8ce0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:07.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.556+0000 7f8cf1ffb700 1 -- 172.21.15.45:0/3403932693 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8ce8018db0 con 0x7f8cf407ac50 2024-05-10T03:33:07.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.769+0000 7f8cfb073700 1 -- 172.21.15.45:0/3403932693 --> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cf41029c0 con 0x7f8ce40387c0 2024-05-10T03:33:07.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.978+0000 7f8cf1ffb700 1 -- 172.21.15.45:0/3403932693 <== mgr.14120 v2:172.21.15.45:6800/485502847 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8cf41029c0 con 0x7f8ce40387c0 2024-05-10T03:33:07.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.980+0000 7f8cfb073700 1 -- 172.21.15.45:0/3403932693 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f8ce40387c0 msgr2=0x7f8ce403acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:07.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.980+0000 7f8cfb073700 1 --2- 172.21.15.45:0/3403932693 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f8ce40387c0 0x7f8ce403acd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0006fd0 tx=0x7f8ce0006e40 comp rx=0 tx=0).stop 2024-05-10T03:33:07.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.980+0000 7f8cfb073700 1 -- 172.21.15.45:0/3403932693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cf407ac50 msgr2=0x7f8cf419b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:07.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.980+0000 7f8cfb073700 1 --2- 172.21.15.45:0/3403932693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cf407ac50 0x7f8cf419b580 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8011780 tx=0x7f8ce8011b40 comp rx=0 tx=0).stop 2024-05-10T03:33:07.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.980+0000 7f8cfb073700 1 -- 172.21.15.45:0/3403932693 shutdown_connections 2024-05-10T03:33:07.334 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.980+0000 7f8cfb073700 1 --2- 172.21.15.45:0/3403932693 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f8ce40387c0 0x7f8ce403acd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:07.334 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.980+0000 7f8cfb073700 1 --2- 172.21.15.45:0/3403932693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cf407ac50 0x7f8cf419b580 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:07.334 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.980+0000 7f8cfb073700 1 -- 172.21.15.45:0/3403932693 >> 172.21.15.45:0/3403932693 conn(0x7f8cf4101a30 msgr2=0x7f8cf41022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:07.334 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.981+0000 7f8cfb073700 1 -- 172.21.15.45:0/3403932693 shutdown_connections 2024-05-10T03:33:07.334 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:06.981+0000 7f8cfb073700 1 -- 172.21.15.45:0/3403932693 wait complete. 2024-05-10T03:33:08.253 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:07 smithi045 ceph-mon[42520]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:33:08.253 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:07 smithi045 ceph-mon[42520]: Generating ssh key... 2024-05-10T03:33:08.253 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:07 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' 2024-05-10T03:33:08.253 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:07 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' 2024-05-10T03:33:08.322 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfyzPWKT6S3e4YdioutXBYLIT9gpLQpDRlZR/UGXcMPVdYP3VSXH0Jp0QnYfxZXBglSchmlq8exGwCJT0VtQqVO50vhYLYNp/LCyVyBfB1BuR5O65buYf996u4C+D8tbcA2/JcH/6uUXQzDbl4Xf9KhXswmdE60FQsUrlivDOGotFKKVqODcwOxLYp4XVY/z3ywFyumLCL8cvz/zEIxaP9x1e00p4xZc+0FThBt4JLXYMVkJ+QJ+CgKqFy9enG406/Y2an3eRV5ko2Q87m2ZxGKzFdM/jjeJbpECZbscn5qIu6UHTpv4AoP6jhR5OPp80NNwQRMrk2dREnmA1dMMB9A969heJbLGqjimn5OIz2gInvH6aTZl+jvH6Kb13Y7UYXf0qUhP+nes7hY4IKCM1KXmBFcy0kDW9OHg8ezDzqbNtj+NaD+vSulz7iVujk84AiwMiNYm2KvbzuF9V2VOUq8nOlwoxqZ67+ZtrDx7+ZQveLfPV2Otp6Mspd9FnZT58= ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968 2024-05-10T03:33:08.322 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.703+0000 7f12b971b700 1 Processor -- start 2024-05-10T03:33:08.322 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.703+0000 7f12b971b700 1 -- start start 2024-05-10T03:33:08.323 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.703+0000 7f12b971b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12b4107fe0 0x7f12b410a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:08.323 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.704+0000 7f12b971b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b407ad60 con 0x7f12b4107fe0 2024-05-10T03:33:08.323 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.704+0000 7f12b2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12b4107fe0 0x7f12b410a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:08.323 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.704+0000 7f12b2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12b4107fe0 0x7f12b410a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43166/0 (socket says 172.21.15.45:43166) 2024-05-10T03:33:08.323 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.704+0000 7f12b2ffd700 1 -- 172.21.15.45:0/762824732 learned_addr learned my addr 172.21.15.45:0/762824732 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:08.323 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.704+0000 7f12b2ffd700 1 -- 172.21.15.45:0/762824732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b407aea0 con 0x7f12b4107fe0 2024-05-10T03:33:08.323 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.705+0000 7f12b2ffd700 1 --2- 172.21.15.45:0/762824732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12b4107fe0 0x7f12b410a400 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f12a80098a0 tx=0x7f12a8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e19ff76a164640 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:08.323 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.705+0000 7f12b1ffb700 1 -- 172.21.15.45:0/762824732 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12a8004160 con 0x7f12b4107fe0 2024-05-10T03:33:08.323 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.705+0000 7f12b1ffb700 1 -- 172.21.15.45:0/762824732 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f12a80042c0 con 0x7f12b4107fe0 2024-05-10T03:33:08.323 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.705+0000 7f12b1ffb700 1 -- 172.21.15.45:0/762824732 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12a8011ac0 con 0x7f12b4107fe0 2024-05-10T03:33:08.323 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.705+0000 7f12b971b700 1 -- 172.21.15.45:0/762824732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12b4107fe0 msgr2=0x7f12b410a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:08.323 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.705+0000 7f12b971b700 1 --2- 172.21.15.45:0/762824732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12b4107fe0 0x7f12b410a400 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f12a80098a0 tx=0x7f12a8009bb0 comp rx=0 tx=0).stop 2024-05-10T03:33:08.323 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.705+0000 7f12b971b700 1 -- 172.21.15.45:0/762824732 shutdown_connections 2024-05-10T03:33:08.324 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.705+0000 7f12b971b700 1 --2- 172.21.15.45:0/762824732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12b4107fe0 0x7f12b410a400 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:08.324 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.705+0000 7f12b971b700 1 -- 172.21.15.45:0/762824732 >> 172.21.15.45:0/762824732 conn(0x7f12b4101a60 msgr2=0x7f12b4103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:08.324 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.706+0000 7f12b971b700 1 -- 172.21.15.45:0/762824732 shutdown_connections 2024-05-10T03:33:08.324 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.706+0000 7f12b971b700 1 -- 172.21.15.45:0/762824732 wait complete. 2024-05-10T03:33:08.324 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.706+0000 7f12b971b700 1 Processor -- start 2024-05-10T03:33:08.324 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.706+0000 7f12b971b700 1 -- start start 2024-05-10T03:33:08.324 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.707+0000 7f12b971b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12b4107fe0 0x7f12b419b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:08.324 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.707+0000 7f12b971b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b419bb20 con 0x7f12b4107fe0 2024-05-10T03:33:08.324 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.707+0000 7f12b2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12b4107fe0 0x7f12b419b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:08.324 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.707+0000 7f12b2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12b4107fe0 0x7f12b419b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43168/0 (socket says 172.21.15.45:43168) 2024-05-10T03:33:08.324 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.707+0000 7f12b2ffd700 1 -- 172.21.15.45:0/649427463 learned_addr learned my addr 172.21.15.45:0/649427463 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:08.324 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.707+0000 7f12b2ffd700 1 -- 172.21.15.45:0/649427463 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a8009550 con 0x7f12b4107fe0 2024-05-10T03:33:08.324 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.707+0000 7f12b2ffd700 1 --2- 172.21.15.45:0/649427463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12b4107fe0 0x7f12b419b5e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f12a8000c00 tx=0x7f12a8011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:08.324 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.707+0000 7f129bfff700 1 -- 172.21.15.45:0/649427463 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12a8003aa0 con 0x7f12b4107fe0 2024-05-10T03:33:08.325 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.708+0000 7f12b971b700 1 -- 172.21.15.45:0/649427463 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b419bd20 con 0x7f12b4107fe0 2024-05-10T03:33:08.325 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.708+0000 7f129bfff700 1 -- 172.21.15.45:0/649427463 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f12a8003c00 con 0x7f12b4107fe0 2024-05-10T03:33:08.325 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.708+0000 7f129bfff700 1 -- 172.21.15.45:0/649427463 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12a80248a0 con 0x7f12b4107fe0 2024-05-10T03:33:08.325 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.708+0000 7f12b971b700 1 -- 172.21.15.45:0/649427463 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b419c1c0 con 0x7f12b4107fe0 2024-05-10T03:33:08.325 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.709+0000 7f129bfff700 1 -- 172.21.15.45:0/649427463 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f12a802d3f0 con 0x7f12b4107fe0 2024-05-10T03:33:08.325 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.709+0000 7f12b971b700 1 -- 172.21.15.45:0/649427463 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b410b6d0 con 0x7f12b4107fe0 2024-05-10T03:33:08.325 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.709+0000 7f129bfff700 1 --2- 172.21.15.45:0/649427463 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f129c0387c0 0x7f129c03acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:08.325 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.709+0000 7f129bfff700 1 -- 172.21.15.45:0/649427463 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f12a804c850 con 0x7f12b4107fe0 2024-05-10T03:33:08.325 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.709+0000 7f12b27fc700 1 --2- 172.21.15.45:0/649427463 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f129c0387c0 0x7f129c03acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:08.325 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.709+0000 7f12b27fc700 1 --2- 172.21.15.45:0/649427463 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f129c0387c0 0x7f129c03acd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f12a4006fd0 tx=0x7f12a4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:08.325 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.714+0000 7f129bfff700 1 -- 172.21.15.45:0/649427463 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f12a8010970 con 0x7f12b4107fe0 2024-05-10T03:33:08.325 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.928+0000 7f12b971b700 1 -- 172.21.15.45:0/649427463 --> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f12b4102ab0 con 0x7f129c0387c0 2024-05-10T03:33:08.326 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.929+0000 7f129bfff700 1 -- 172.21.15.45:0/649427463 <== mgr.14120 v2:172.21.15.45:6800/485502847 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f12b4102ab0 con 0x7f129c0387c0 2024-05-10T03:33:08.326 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.932+0000 7f12b971b700 1 -- 172.21.15.45:0/649427463 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f129c0387c0 msgr2=0x7f129c03acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:08.326 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.932+0000 7f12b971b700 1 --2- 172.21.15.45:0/649427463 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f129c0387c0 0x7f129c03acd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f12a4006fd0 tx=0x7f12a4006e40 comp rx=0 tx=0).stop 2024-05-10T03:33:08.326 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.932+0000 7f12b971b700 1 -- 172.21.15.45:0/649427463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12b4107fe0 msgr2=0x7f12b419b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:08.326 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.932+0000 7f12b971b700 1 --2- 172.21.15.45:0/649427463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12b4107fe0 0x7f12b419b5e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f12a8000c00 tx=0x7f12a8011b40 comp rx=0 tx=0).stop 2024-05-10T03:33:08.326 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.932+0000 7f12b971b700 1 -- 172.21.15.45:0/649427463 shutdown_connections 2024-05-10T03:33:08.326 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.932+0000 7f12b971b700 1 --2- 172.21.15.45:0/649427463 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f129c0387c0 0x7f129c03acd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:08.326 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.932+0000 7f12b971b700 1 --2- 172.21.15.45:0/649427463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12b4107fe0 0x7f12b419b5e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:08.326 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.932+0000 7f12b971b700 1 -- 172.21.15.45:0/649427463 >> 172.21.15.45:0/649427463 conn(0x7f12b4101a60 msgr2=0x7f12b41023a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:08.326 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.932+0000 7f12b971b700 1 -- 172.21.15.45:0/649427463 shutdown_connections 2024-05-10T03:33:08.326 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:07.932+0000 7f12b971b700 1 -- 172.21.15.45:0/649427463 wait complete. 2024-05-10T03:33:08.326 INFO:teuthology.orchestra.run.smithi045.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-10T03:33:08.326 INFO:teuthology.orchestra.run.smithi045.stdout:Adding key to root@localhost authorized_keys... 2024-05-10T03:33:08.327 INFO:teuthology.orchestra.run.smithi045.stdout:Adding host smithi045... 2024-05-10T03:33:09.230 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:08 smithi045 ceph-mon[42520]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:33:10.113 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:09 smithi045 ceph-mon[42520]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi045", "addr": "172.21.15.45", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:33:11.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:10 smithi045 ceph-mon[42520]: Deploying cephadm binary to smithi045 2024-05-10T03:33:11.837 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout Added host 'smithi045' with addr '172.21.15.45' 2024-05-10T03:33:11.837 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.873+0000 7f5b411e3700 1 Processor -- start 2024-05-10T03:33:11.837 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.873+0000 7f5b411e3700 1 -- start start 2024-05-10T03:33:11.838 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.873+0000 7f5b411e3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b3c07ac50 0x7f5b3c10a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:11.838 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.873+0000 7f5b411e3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c10a650 con 0x7f5b3c07ac50 2024-05-10T03:33:11.838 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.874+0000 7f5b3ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b3c07ac50 0x7f5b3c10a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:11.838 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.874+0000 7f5b3ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b3c07ac50 0x7f5b3c10a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43174/0 (socket says 172.21.15.45:43174) 2024-05-10T03:33:11.838 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.874+0000 7f5b3ad9d700 1 -- 172.21.15.45:0/582876560 learned_addr learned my addr 172.21.15.45:0/582876560 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:11.838 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.874+0000 7f5b3ad9d700 1 -- 172.21.15.45:0/582876560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c10a790 con 0x7f5b3c07ac50 2024-05-10T03:33:11.838 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.874+0000 7f5b3ad9d700 1 --2- 172.21.15.45:0/582876560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b3c07ac50 0x7f5b3c10a040 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0098a0 tx=0x7f5b2c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824c8577d26d0c3d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:11.838 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.874+0000 7f5b39d9b700 1 -- 172.21.15.45:0/582876560 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b2c004160 con 0x7f5b3c07ac50 2024-05-10T03:33:11.838 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.874+0000 7f5b39d9b700 1 -- 172.21.15.45:0/582876560 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f5b2c0042c0 con 0x7f5b3c07ac50 2024-05-10T03:33:11.838 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.874+0000 7f5b39d9b700 1 -- 172.21.15.45:0/582876560 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b2c011ac0 con 0x7f5b3c07ac50 2024-05-10T03:33:11.838 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.875+0000 7f5b411e3700 1 -- 172.21.15.45:0/582876560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b3c07ac50 msgr2=0x7f5b3c10a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:11.838 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.875+0000 7f5b411e3700 1 --2- 172.21.15.45:0/582876560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b3c07ac50 0x7f5b3c10a040 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0098a0 tx=0x7f5b2c009bb0 comp rx=0 tx=0).stop 2024-05-10T03:33:11.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.875+0000 7f5b411e3700 1 -- 172.21.15.45:0/582876560 shutdown_connections 2024-05-10T03:33:11.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.875+0000 7f5b411e3700 1 --2- 172.21.15.45:0/582876560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b3c07ac50 0x7f5b3c10a040 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:11.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.875+0000 7f5b411e3700 1 -- 172.21.15.45:0/582876560 >> 172.21.15.45:0/582876560 conn(0x7f5b3c101a30 msgr2=0x7f5b3c103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:11.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.875+0000 7f5b411e3700 1 -- 172.21.15.45:0/582876560 shutdown_connections 2024-05-10T03:33:11.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.875+0000 7f5b411e3700 1 -- 172.21.15.45:0/582876560 wait complete. 2024-05-10T03:33:11.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.876+0000 7f5b411e3700 1 Processor -- start 2024-05-10T03:33:11.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.876+0000 7f5b411e3700 1 -- start start 2024-05-10T03:33:11.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.877+0000 7f5b411e3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b3c07ac50 0x7f5b3c1077b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:11.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.877+0000 7f5b411e3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c107cf0 con 0x7f5b3c07ac50 2024-05-10T03:33:11.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.877+0000 7f5b3ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b3c07ac50 0x7f5b3c1077b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:11.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.877+0000 7f5b3ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b3c07ac50 0x7f5b3c1077b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43190/0 (socket says 172.21.15.45:43190) 2024-05-10T03:33:11.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.877+0000 7f5b3ad9d700 1 -- 172.21.15.45:0/2497796859 learned_addr learned my addr 172.21.15.45:0/2497796859 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:11.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.877+0000 7f5b3ad9d700 1 -- 172.21.15.45:0/2497796859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c009550 con 0x7f5b3c07ac50 2024-05-10T03:33:11.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.877+0000 7f5b3ad9d700 1 --2- 172.21.15.45:0/2497796859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b3c07ac50 0x7f5b3c1077b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009fb0 tx=0x7f5b2c011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:11.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.877+0000 7f5b23fff700 1 -- 172.21.15.45:0/2497796859 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b2c0038b0 con 0x7f5b3c07ac50 2024-05-10T03:33:11.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.877+0000 7f5b23fff700 1 -- 172.21.15.45:0/2497796859 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f5b2c003a10 con 0x7f5b3c07ac50 2024-05-10T03:33:11.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.878+0000 7f5b411e3700 1 -- 172.21.15.45:0/2497796859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3c105f40 con 0x7f5b3c07ac50 2024-05-10T03:33:11.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.878+0000 7f5b23fff700 1 -- 172.21.15.45:0/2497796859 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b2c0195e0 con 0x7f5b3c07ac50 2024-05-10T03:33:11.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.878+0000 7f5b411e3700 1 -- 172.21.15.45:0/2497796859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3c1063e0 con 0x7f5b3c07ac50 2024-05-10T03:33:11.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.879+0000 7f5b411e3700 1 -- 172.21.15.45:0/2497796859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3c062840 con 0x7f5b3c07ac50 2024-05-10T03:33:11.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.879+0000 7f5b23fff700 1 -- 172.21.15.45:0/2497796859 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f5b2c019850 con 0x7f5b3c07ac50 2024-05-10T03:33:11.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.879+0000 7f5b23fff700 1 --2- 172.21.15.45:0/2497796859 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f5b240387c0 0x7f5b2403acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:11.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.879+0000 7f5b23fff700 1 -- 172.21.15.45:0/2497796859 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f5b2c04c7e0 con 0x7f5b3c07ac50 2024-05-10T03:33:11.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.879+0000 7f5b3a59c700 1 --2- 172.21.15.45:0/2497796859 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f5b240387c0 0x7f5b2403acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:11.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.880+0000 7f5b3a59c700 1 --2- 172.21.15.45:0/2497796859 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f5b240387c0 0x7f5b2403acd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5b30006fd0 tx=0x7f5b30006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:11.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:08.884+0000 7f5b23fff700 1 -- 172.21.15.45:0/2497796859 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5b2c02b340 con 0x7f5b3c07ac50 2024-05-10T03:33:11.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:09.102+0000 7f5b411e3700 1 -- 172.21.15.45:0/2497796859 --> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi045", "addr": "172.21.15.45", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b3c1068d0 con 0x7f5b240387c0 2024-05-10T03:33:11.841 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:11.511+0000 7f5b23fff700 1 -- 172.21.15.45:0/2497796859 <== mgr.14120 v2:172.21.15.45:6800/485502847 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f5b3c1068d0 con 0x7f5b240387c0 2024-05-10T03:33:11.841 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:11.514+0000 7f5b411e3700 1 -- 172.21.15.45:0/2497796859 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f5b240387c0 msgr2=0x7f5b2403acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:11.841 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:11.514+0000 7f5b411e3700 1 --2- 172.21.15.45:0/2497796859 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f5b240387c0 0x7f5b2403acd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5b30006fd0 tx=0x7f5b30006e40 comp rx=0 tx=0).stop 2024-05-10T03:33:11.841 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:11.515+0000 7f5b411e3700 1 -- 172.21.15.45:0/2497796859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b3c07ac50 msgr2=0x7f5b3c1077b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:11.841 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:11.515+0000 7f5b411e3700 1 --2- 172.21.15.45:0/2497796859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b3c07ac50 0x7f5b3c1077b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009fb0 tx=0x7f5b2c011b20 comp rx=0 tx=0).stop 2024-05-10T03:33:11.841 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:11.515+0000 7f5b411e3700 1 -- 172.21.15.45:0/2497796859 shutdown_connections 2024-05-10T03:33:11.841 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:11.515+0000 7f5b411e3700 1 --2- 172.21.15.45:0/2497796859 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f5b240387c0 0x7f5b2403acd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:11.841 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:11.515+0000 7f5b411e3700 1 --2- 172.21.15.45:0/2497796859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b3c07ac50 0x7f5b3c1077b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:11.841 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:11.515+0000 7f5b411e3700 1 -- 172.21.15.45:0/2497796859 >> 172.21.15.45:0/2497796859 conn(0x7f5b3c101a30 msgr2=0x7f5b3c1022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:11.841 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:11.515+0000 7f5b411e3700 1 -- 172.21.15.45:0/2497796859 shutdown_connections 2024-05-10T03:33:11.841 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:11.515+0000 7f5b411e3700 1 -- 172.21.15.45:0/2497796859 wait complete. 2024-05-10T03:33:11.841 INFO:teuthology.orchestra.run.smithi045.stdout:Deploying unmanaged mon service... 2024-05-10T03:33:12.698 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:12 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' 2024-05-10T03:33:12.698 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:12 smithi045 ceph-mon[42520]: Added host smithi045 2024-05-10T03:33:12.698 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:12 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:33:13.071 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-05-10T03:33:13.071 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.343+0000 7fb853a50700 1 Processor -- start 2024-05-10T03:33:13.071 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.343+0000 7fb853a50700 1 -- start start 2024-05-10T03:33:13.072 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.343+0000 7fb853a50700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb84c106400 0x7fb84c106810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:13.072 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.343+0000 7fb853a50700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c106e00 con 0x7fb84c106400 2024-05-10T03:33:13.072 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.344+0000 7fb8517ec700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb84c106400 0x7fb84c106810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:13.072 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.344+0000 7fb8517ec700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb84c106400 0x7fb84c106810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43204/0 (socket says 172.21.15.45:43204) 2024-05-10T03:33:13.072 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.344+0000 7fb8517ec700 1 -- 172.21.15.45:0/393266674 learned_addr learned my addr 172.21.15.45:0/393266674 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:13.072 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.344+0000 7fb8517ec700 1 -- 172.21.15.45:0/393266674 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84c107530 con 0x7fb84c106400 2024-05-10T03:33:13.072 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.344+0000 7fb8517ec700 1 --2- 172.21.15.45:0/393266674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb84c106400 0x7fb84c106810 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb8480098a0 tx=0x7fb848009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2963f2a81c10ca51 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:13.072 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.344+0000 7fb843fff700 1 -- 172.21.15.45:0/393266674 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb848004160 con 0x7fb84c106400 2024-05-10T03:33:13.072 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.344+0000 7fb843fff700 1 -- 172.21.15.45:0/393266674 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fb8480042c0 con 0x7fb84c106400 2024-05-10T03:33:13.072 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.344+0000 7fb843fff700 1 -- 172.21.15.45:0/393266674 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb848011ac0 con 0x7fb84c106400 2024-05-10T03:33:13.072 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.345+0000 7fb853a50700 1 -- 172.21.15.45:0/393266674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb84c106400 msgr2=0x7fb84c106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:13.072 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.345+0000 7fb853a50700 1 --2- 172.21.15.45:0/393266674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb84c106400 0x7fb84c106810 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb8480098a0 tx=0x7fb848009bb0 comp rx=0 tx=0).stop 2024-05-10T03:33:13.072 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.345+0000 7fb853a50700 1 -- 172.21.15.45:0/393266674 shutdown_connections 2024-05-10T03:33:13.072 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.345+0000 7fb853a50700 1 --2- 172.21.15.45:0/393266674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb84c106400 0x7fb84c106810 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:13.073 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.345+0000 7fb853a50700 1 -- 172.21.15.45:0/393266674 >> 172.21.15.45:0/393266674 conn(0x7fb84c101a60 msgr2=0x7fb84c103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:13.073 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.345+0000 7fb853a50700 1 -- 172.21.15.45:0/393266674 shutdown_connections 2024-05-10T03:33:13.073 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.345+0000 7fb853a50700 1 -- 172.21.15.45:0/393266674 wait complete. 2024-05-10T03:33:13.073 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.346+0000 7fb853a50700 1 Processor -- start 2024-05-10T03:33:13.073 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.346+0000 7fb853a50700 1 -- start start 2024-05-10T03:33:13.073 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.346+0000 7fb853a50700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb84c106400 0x7fb84c19b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:13.073 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.346+0000 7fb853a50700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c19bb60 con 0x7fb84c106400 2024-05-10T03:33:13.073 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.347+0000 7fb8517ec700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb84c106400 0x7fb84c19b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:13.073 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.347+0000 7fb8517ec700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb84c106400 0x7fb84c19b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43206/0 (socket says 172.21.15.45:43206) 2024-05-10T03:33:13.073 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.347+0000 7fb8517ec700 1 -- 172.21.15.45:0/2741582285 learned_addr learned my addr 172.21.15.45:0/2741582285 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:13.073 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.347+0000 7fb8517ec700 1 -- 172.21.15.45:0/2741582285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb848009550 con 0x7fb84c106400 2024-05-10T03:33:13.073 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.347+0000 7fb8517ec700 1 --2- 172.21.15.45:0/2741582285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb84c106400 0x7fb84c19b620 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb848009fb0 tx=0x7fb848011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:13.073 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.347+0000 7fb8427fc700 1 -- 172.21.15.45:0/2741582285 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8480038b0 con 0x7fb84c106400 2024-05-10T03:33:13.073 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.347+0000 7fb8427fc700 1 -- 172.21.15.45:0/2741582285 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fb848003a10 con 0x7fb84c106400 2024-05-10T03:33:13.074 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.347+0000 7fb853a50700 1 -- 172.21.15.45:0/2741582285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84c19bd60 con 0x7fb84c106400 2024-05-10T03:33:13.074 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.347+0000 7fb8427fc700 1 -- 172.21.15.45:0/2741582285 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8480195e0 con 0x7fb84c106400 2024-05-10T03:33:13.074 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.347+0000 7fb853a50700 1 -- 172.21.15.45:0/2741582285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84c19c200 con 0x7fb84c106400 2024-05-10T03:33:13.074 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.348+0000 7fb8427fc700 1 -- 172.21.15.45:0/2741582285 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fb8480198a0 con 0x7fb84c106400 2024-05-10T03:33:13.074 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.348+0000 7fb853a50700 1 -- 172.21.15.45:0/2741582285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb84c194cc0 con 0x7fb84c106400 2024-05-10T03:33:13.074 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.349+0000 7fb8427fc700 1 --2- 172.21.15.45:0/2741582285 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fb838038770 0x7fb83803ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:13.074 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.349+0000 7fb8427fc700 1 -- 172.21.15.45:0/2741582285 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb84804ca20 con 0x7fb84c106400 2024-05-10T03:33:13.074 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.349+0000 7fb850feb700 1 --2- 172.21.15.45:0/2741582285 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fb838038770 0x7fb83803ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:13.074 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.349+0000 7fb850feb700 1 --2- 172.21.15.45:0/2741582285 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fb838038770 0x7fb83803ac80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb83c006fd0 tx=0x7fb83c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:13.074 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.354+0000 7fb8427fc700 1 -- 172.21.15.45:0/2741582285 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb84802b340 con 0x7fb84c106400 2024-05-10T03:33:13.074 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.588+0000 7fb853a50700 1 -- 172.21.15.45:0/2741582285 --> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fb84c02d020 con 0x7fb838038770 2024-05-10T03:33:13.074 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.594+0000 7fb8427fc700 1 -- 172.21.15.45:0/2741582285 <== mgr.14120 v2:172.21.15.45:6800/485502847 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fb84c02d020 con 0x7fb838038770 2024-05-10T03:33:13.074 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.596+0000 7fb853a50700 1 -- 172.21.15.45:0/2741582285 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fb838038770 msgr2=0x7fb83803ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:13.075 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.596+0000 7fb853a50700 1 --2- 172.21.15.45:0/2741582285 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fb838038770 0x7fb83803ac80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb83c006fd0 tx=0x7fb83c006e40 comp rx=0 tx=0).stop 2024-05-10T03:33:13.075 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.596+0000 7fb853a50700 1 -- 172.21.15.45:0/2741582285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb84c106400 msgr2=0x7fb84c19b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:13.075 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.596+0000 7fb853a50700 1 --2- 172.21.15.45:0/2741582285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb84c106400 0x7fb84c19b620 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb848009fb0 tx=0x7fb848011b20 comp rx=0 tx=0).stop 2024-05-10T03:33:13.075 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.596+0000 7fb853a50700 1 -- 172.21.15.45:0/2741582285 shutdown_connections 2024-05-10T03:33:13.075 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.596+0000 7fb853a50700 1 --2- 172.21.15.45:0/2741582285 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fb838038770 0x7fb83803ac80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:13.075 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.596+0000 7fb853a50700 1 --2- 172.21.15.45:0/2741582285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb84c106400 0x7fb84c19b620 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:13.075 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.596+0000 7fb853a50700 1 -- 172.21.15.45:0/2741582285 >> 172.21.15.45:0/2741582285 conn(0x7fb84c101a60 msgr2=0x7fb84c191e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:13.075 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.596+0000 7fb853a50700 1 -- 172.21.15.45:0/2741582285 shutdown_connections 2024-05-10T03:33:13.075 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:12.597+0000 7fb853a50700 1 -- 172.21.15.45:0/2741582285 wait complete. 2024-05-10T03:33:13.075 INFO:teuthology.orchestra.run.smithi045.stdout:Deploying unmanaged mgr service... 2024-05-10T03:33:13.948 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:13 smithi045 ceph-mon[42520]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:33:13.948 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:13 smithi045 ceph-mon[42520]: Saving service mon spec with placement count:5 2024-05-10T03:33:13.948 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:13 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' 2024-05-10T03:33:13.948 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:13 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' 2024-05-10T03:33:13.948 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:13 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' 2024-05-10T03:33:14.087 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-05-10T03:33:14.087 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.441+0000 7f6acffdc700 1 Processor -- start 2024-05-10T03:33:14.087 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.441+0000 7f6acffdc700 1 -- start start 2024-05-10T03:33:14.087 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.441+0000 7f6acffdc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ac807ac50 0x7f6ac810a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:14.088 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.441+0000 7f6acffdc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac810a610 con 0x7f6ac807ac50 2024-05-10T03:33:14.088 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.442+0000 7f6acdd78700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ac807ac50 0x7f6ac810a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:14.088 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.442+0000 7f6acdd78700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ac807ac50 0x7f6ac810a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43214/0 (socket says 172.21.15.45:43214) 2024-05-10T03:33:14.088 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.442+0000 7f6acdd78700 1 -- 172.21.15.45:0/4275239588 learned_addr learned my addr 172.21.15.45:0/4275239588 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:14.088 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.442+0000 7f6acdd78700 1 -- 172.21.15.45:0/4275239588 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac810a750 con 0x7f6ac807ac50 2024-05-10T03:33:14.088 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.442+0000 7f6acdd78700 1 --2- 172.21.15.45:0/4275239588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ac807ac50 0x7f6ac810a000 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6ac40098a0 tx=0x7f6ac4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884b12a7d0417243 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:14.088 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.443+0000 7f6accd76700 1 -- 172.21.15.45:0/4275239588 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ac4004160 con 0x7f6ac807ac50 2024-05-10T03:33:14.088 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.443+0000 7f6accd76700 1 -- 172.21.15.45:0/4275239588 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6ac40042c0 con 0x7f6ac807ac50 2024-05-10T03:33:14.088 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.443+0000 7f6accd76700 1 -- 172.21.15.45:0/4275239588 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ac4011a80 con 0x7f6ac807ac50 2024-05-10T03:33:14.088 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.444+0000 7f6acffdc700 1 -- 172.21.15.45:0/4275239588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ac807ac50 msgr2=0x7f6ac810a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:14.088 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.444+0000 7f6acffdc700 1 --2- 172.21.15.45:0/4275239588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ac807ac50 0x7f6ac810a000 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6ac40098a0 tx=0x7f6ac4009bb0 comp rx=0 tx=0).stop 2024-05-10T03:33:14.088 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.444+0000 7f6acffdc700 1 -- 172.21.15.45:0/4275239588 shutdown_connections 2024-05-10T03:33:14.088 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.444+0000 7f6acffdc700 1 --2- 172.21.15.45:0/4275239588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ac807ac50 0x7f6ac810a000 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:14.088 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.444+0000 7f6acffdc700 1 -- 172.21.15.45:0/4275239588 >> 172.21.15.45:0/4275239588 conn(0x7f6ac8101a30 msgr2=0x7f6ac8103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:14.089 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.444+0000 7f6acffdc700 1 -- 172.21.15.45:0/4275239588 shutdown_connections 2024-05-10T03:33:14.089 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.444+0000 7f6acffdc700 1 -- 172.21.15.45:0/4275239588 wait complete. 2024-05-10T03:33:14.089 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.444+0000 7f6acffdc700 1 Processor -- start 2024-05-10T03:33:14.089 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.445+0000 7f6acffdc700 1 -- start start 2024-05-10T03:33:14.089 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.445+0000 7f6acffdc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ac807ac50 0x7f6ac8107770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:14.089 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.445+0000 7f6acffdc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac8107cb0 con 0x7f6ac807ac50 2024-05-10T03:33:14.089 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.445+0000 7f6acdd78700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ac807ac50 0x7f6ac8107770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:14.089 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.445+0000 7f6acdd78700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ac807ac50 0x7f6ac8107770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43224/0 (socket says 172.21.15.45:43224) 2024-05-10T03:33:14.089 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.445+0000 7f6acdd78700 1 -- 172.21.15.45:0/2281623763 learned_addr learned my addr 172.21.15.45:0/2281623763 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:14.089 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.445+0000 7f6acdd78700 1 -- 172.21.15.45:0/2281623763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac4009550 con 0x7f6ac807ac50 2024-05-10T03:33:14.089 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.445+0000 7f6acdd78700 1 --2- 172.21.15.45:0/2281623763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ac807ac50 0x7f6ac8107770 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4009fb0 tx=0x7f6ac4011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:14.089 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.446+0000 7f6abeffd700 1 -- 172.21.15.45:0/2281623763 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ac40038b0 con 0x7f6ac807ac50 2024-05-10T03:33:14.089 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.446+0000 7f6abeffd700 1 -- 172.21.15.45:0/2281623763 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6ac4003a10 con 0x7f6ac807ac50 2024-05-10T03:33:14.089 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.446+0000 7f6acffdc700 1 -- 172.21.15.45:0/2281623763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac8105f00 con 0x7f6ac807ac50 2024-05-10T03:33:14.089 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.446+0000 7f6abeffd700 1 -- 172.21.15.45:0/2281623763 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ac4019620 con 0x7f6ac807ac50 2024-05-10T03:33:14.090 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.446+0000 7f6acffdc700 1 -- 172.21.15.45:0/2281623763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac81063a0 con 0x7f6ac807ac50 2024-05-10T03:33:14.090 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.447+0000 7f6acffdc700 1 -- 172.21.15.45:0/2281623763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac8062840 con 0x7f6ac807ac50 2024-05-10T03:33:14.090 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.447+0000 7f6abeffd700 1 -- 172.21.15.45:0/2281623763 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f6ac4019890 con 0x7f6ac807ac50 2024-05-10T03:33:14.090 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.447+0000 7f6abeffd700 1 --2- 172.21.15.45:0/2281623763 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f6ab4038770 0x7f6ab403ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:14.090 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.447+0000 7f6abeffd700 1 -- 172.21.15.45:0/2281623763 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f6ac404c840 con 0x7f6ac807ac50 2024-05-10T03:33:14.090 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.448+0000 7f6acd577700 1 --2- 172.21.15.45:0/2281623763 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f6ab4038770 0x7f6ab403ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:14.090 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.448+0000 7f6acd577700 1 --2- 172.21.15.45:0/2281623763 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f6ab4038770 0x7f6ab403ac80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8006fd0 tx=0x7f6ab8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:14.090 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.453+0000 7f6abeffd700 1 -- 172.21.15.45:0/2281623763 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6ac402b340 con 0x7f6ac807ac50 2024-05-10T03:33:14.090 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.701+0000 7f6acffdc700 1 -- 172.21.15.45:0/2281623763 --> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f6ac81067d0 con 0x7f6ab4038770 2024-05-10T03:33:14.090 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.707+0000 7f6abeffd700 1 -- 172.21.15.45:0/2281623763 <== mgr.14120 v2:172.21.15.45:6800/485502847 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f6ac81067d0 con 0x7f6ab4038770 2024-05-10T03:33:14.090 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.709+0000 7f6acffdc700 1 -- 172.21.15.45:0/2281623763 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f6ab4038770 msgr2=0x7f6ab403ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:14.090 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.709+0000 7f6acffdc700 1 --2- 172.21.15.45:0/2281623763 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f6ab4038770 0x7f6ab403ac80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8006fd0 tx=0x7f6ab8006e40 comp rx=0 tx=0).stop 2024-05-10T03:33:14.090 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.709+0000 7f6acffdc700 1 -- 172.21.15.45:0/2281623763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ac807ac50 msgr2=0x7f6ac8107770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:14.090 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.709+0000 7f6acffdc700 1 --2- 172.21.15.45:0/2281623763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ac807ac50 0x7f6ac8107770 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4009fb0 tx=0x7f6ac4011ae0 comp rx=0 tx=0).stop 2024-05-10T03:33:14.091 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.710+0000 7f6acffdc700 1 -- 172.21.15.45:0/2281623763 shutdown_connections 2024-05-10T03:33:14.091 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.710+0000 7f6acffdc700 1 --2- 172.21.15.45:0/2281623763 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f6ab4038770 0x7f6ab403ac80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:14.091 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.710+0000 7f6acffdc700 1 --2- 172.21.15.45:0/2281623763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ac807ac50 0x7f6ac8107770 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:14.091 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.710+0000 7f6acffdc700 1 -- 172.21.15.45:0/2281623763 >> 172.21.15.45:0/2281623763 conn(0x7f6ac8101a30 msgr2=0x7f6ac8102280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:14.091 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.710+0000 7f6acffdc700 1 -- 172.21.15.45:0/2281623763 shutdown_connections 2024-05-10T03:33:14.091 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:13.710+0000 7f6acffdc700 1 -- 172.21.15.45:0/2281623763 wait complete. 2024-05-10T03:33:14.952 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:14 smithi045 ceph-mon[42520]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:33:14.952 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:14 smithi045 ceph-mon[42520]: Saving service mgr spec with placement count:2 2024-05-10T03:33:14.952 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:14 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' 2024-05-10T03:33:14.952 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:14 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' 2024-05-10T03:33:15.290 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.667+0000 7fa500837700 1 Processor -- start 2024-05-10T03:33:15.291 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.667+0000 7fa500837700 1 -- start start 2024-05-10T03:33:15.291 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.667+0000 7fa500837700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4fc07ac10 0x7fa4fc10a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:15.291 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.667+0000 7fa500837700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc10a650 con 0x7fa4fc07ac10 2024-05-10T03:33:15.291 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.668+0000 7fa4fa59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4fc07ac10 0x7fa4fc10a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:15.291 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.668+0000 7fa4fa59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4fc07ac10 0x7fa4fc10a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43226/0 (socket says 172.21.15.45:43226) 2024-05-10T03:33:15.292 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.668+0000 7fa4fa59c700 1 -- 172.21.15.45:0/921778776 learned_addr learned my addr 172.21.15.45:0/921778776 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:15.292 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.668+0000 7fa4fa59c700 1 -- 172.21.15.45:0/921778776 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4fc10a790 con 0x7fa4fc07ac10 2024-05-10T03:33:15.292 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.668+0000 7fa4fa59c700 1 --2- 172.21.15.45:0/921778776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4fc07ac10 0x7fa4fc10a080 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0098a0 tx=0x7fa4ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33c9823015deea4b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:15.292 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.668+0000 7fa4f959a700 1 -- 172.21.15.45:0/921778776 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4ec004160 con 0x7fa4fc07ac10 2024-05-10T03:33:15.292 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.669+0000 7fa4f959a700 1 -- 172.21.15.45:0/921778776 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa4ec0042c0 con 0x7fa4fc07ac10 2024-05-10T03:33:15.293 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.669+0000 7fa4f959a700 1 -- 172.21.15.45:0/921778776 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4ec011a80 con 0x7fa4fc07ac10 2024-05-10T03:33:15.293 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.670+0000 7fa500837700 1 -- 172.21.15.45:0/921778776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4fc07ac10 msgr2=0x7fa4fc10a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:15.293 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.670+0000 7fa500837700 1 --2- 172.21.15.45:0/921778776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4fc07ac10 0x7fa4fc10a080 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0098a0 tx=0x7fa4ec009bb0 comp rx=0 tx=0).stop 2024-05-10T03:33:15.293 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.670+0000 7fa500837700 1 -- 172.21.15.45:0/921778776 shutdown_connections 2024-05-10T03:33:15.293 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.670+0000 7fa500837700 1 --2- 172.21.15.45:0/921778776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4fc07ac10 0x7fa4fc10a080 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:15.294 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.670+0000 7fa500837700 1 -- 172.21.15.45:0/921778776 >> 172.21.15.45:0/921778776 conn(0x7fa4fc101a30 msgr2=0x7fa4fc103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:15.294 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.670+0000 7fa500837700 1 -- 172.21.15.45:0/921778776 shutdown_connections 2024-05-10T03:33:15.294 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.670+0000 7fa500837700 1 -- 172.21.15.45:0/921778776 wait complete. 2024-05-10T03:33:15.294 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.671+0000 7fa500837700 1 Processor -- start 2024-05-10T03:33:15.294 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.671+0000 7fa500837700 1 -- start start 2024-05-10T03:33:15.294 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.671+0000 7fa500837700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4fc07ac10 0x7fa4fc19b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:15.294 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.671+0000 7fa500837700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc19ba10 con 0x7fa4fc07ac10 2024-05-10T03:33:15.294 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.672+0000 7fa4fa59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4fc07ac10 0x7fa4fc19b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:15.294 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.672+0000 7fa4fa59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4fc07ac10 0x7fa4fc19b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43234/0 (socket says 172.21.15.45:43234) 2024-05-10T03:33:15.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.672+0000 7fa4fa59c700 1 -- 172.21.15.45:0/3646305965 learned_addr learned my addr 172.21.15.45:0/3646305965 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:15.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.672+0000 7fa4fa59c700 1 -- 172.21.15.45:0/3646305965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec009550 con 0x7fa4fc07ac10 2024-05-10T03:33:15.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.672+0000 7fa4fa59c700 1 --2- 172.21.15.45:0/3646305965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4fc07ac10 0x7fa4fc19b4d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0116a0 tx=0x7fa4ec011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:15.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.672+0000 7fa4eb7fe700 1 -- 172.21.15.45:0/3646305965 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4ec0039f0 con 0x7fa4fc07ac10 2024-05-10T03:33:15.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.672+0000 7fa4eb7fe700 1 -- 172.21.15.45:0/3646305965 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa4ec003b50 con 0x7fa4fc07ac10 2024-05-10T03:33:15.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.672+0000 7fa500837700 1 -- 172.21.15.45:0/3646305965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4fc19bc10 con 0x7fa4fc07ac10 2024-05-10T03:33:15.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.672+0000 7fa4eb7fe700 1 -- 172.21.15.45:0/3646305965 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4ec01a6d0 con 0x7fa4fc07ac10 2024-05-10T03:33:15.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.673+0000 7fa500837700 1 -- 172.21.15.45:0/3646305965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4fc19c0b0 con 0x7fa4fc07ac10 2024-05-10T03:33:15.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.673+0000 7fa4eb7fe700 1 -- 172.21.15.45:0/3646305965 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fa4ec01a990 con 0x7fa4fc07ac10 2024-05-10T03:33:15.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.674+0000 7fa4eb7fe700 1 --2- 172.21.15.45:0/3646305965 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fa4e4038770 0x7fa4e403ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:15.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.674+0000 7fa4eb7fe700 1 -- 172.21.15.45:0/3646305965 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa4ec04d960 con 0x7fa4fc07ac10 2024-05-10T03:33:15.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.674+0000 7fa500837700 1 -- 172.21.15.45:0/3646305965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4fc10b6f0 con 0x7fa4fc07ac10 2024-05-10T03:33:15.295 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.674+0000 7fa4f9d9b700 1 --2- 172.21.15.45:0/3646305965 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fa4e4038770 0x7fa4e403ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:15.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.675+0000 7fa4f9d9b700 1 --2- 172.21.15.45:0/3646305965 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fa4e4038770 0x7fa4e403ac80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0006fd0 tx=0x7fa4f0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:15.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.679+0000 7fa4eb7fe700 1 -- 172.21.15.45:0/3646305965 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa4ec01ac40 con 0x7fa4fc07ac10 2024-05-10T03:33:15.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.912+0000 7fa500837700 1 -- 172.21.15.45:0/3646305965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fa4fc19ea90 con 0x7fa4fc07ac10 2024-05-10T03:33:15.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.916+0000 7fa4eb7fe700 1 -- 172.21.15.45:0/3646305965 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fa4ec018b40 con 0x7fa4fc07ac10 2024-05-10T03:33:15.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.919+0000 7fa500837700 1 -- 172.21.15.45:0/3646305965 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fa4e4038770 msgr2=0x7fa4e403ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:15.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.919+0000 7fa500837700 1 --2- 172.21.15.45:0/3646305965 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fa4e4038770 0x7fa4e403ac80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0006fd0 tx=0x7fa4f0006e40 comp rx=0 tx=0).stop 2024-05-10T03:33:15.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.919+0000 7fa500837700 1 -- 172.21.15.45:0/3646305965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4fc07ac10 msgr2=0x7fa4fc19b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:15.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.919+0000 7fa500837700 1 --2- 172.21.15.45:0/3646305965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4fc07ac10 0x7fa4fc19b4d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0116a0 tx=0x7fa4ec011b00 comp rx=0 tx=0).stop 2024-05-10T03:33:15.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.919+0000 7fa500837700 1 -- 172.21.15.45:0/3646305965 shutdown_connections 2024-05-10T03:33:15.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.919+0000 7fa500837700 1 --2- 172.21.15.45:0/3646305965 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fa4e4038770 0x7fa4e403ac80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:15.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.919+0000 7fa500837700 1 --2- 172.21.15.45:0/3646305965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4fc07ac10 0x7fa4fc19b4d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:15.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.919+0000 7fa500837700 1 -- 172.21.15.45:0/3646305965 >> 172.21.15.45:0/3646305965 conn(0x7fa4fc101a30 msgr2=0x7fa4fc102200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:15.296 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.919+0000 7fa500837700 1 -- 172.21.15.45:0/3646305965 shutdown_connections 2024-05-10T03:33:15.297 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:14.919+0000 7fa500837700 1 -- 172.21.15.45:0/3646305965 wait complete. 2024-05-10T03:33:16.205 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:15 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3646305965' entity='client.admin' 2024-05-10T03:33:16.206 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:15 smithi045 ceph-mon[42520]: from='mgr.14120 172.21.15.45:0/3849515715' entity='mgr.x' 2024-05-10T03:33:16.496 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.677+0000 7fd661420700 1 Processor -- start 2024-05-10T03:33:16.496 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.678+0000 7fd661420700 1 -- start start 2024-05-10T03:33:16.496 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.678+0000 7fd661420700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd65c107980 0x7fd65c107d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:16.496 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.678+0000 7fd661420700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c108360 con 0x7fd65c107980 2024-05-10T03:33:16.496 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.678+0000 7fd65affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd65c107980 0x7fd65c107d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:16.496 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.678+0000 7fd65affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd65c107980 0x7fd65c107d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43250/0 (socket says 172.21.15.45:43250) 2024-05-10T03:33:16.496 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.678+0000 7fd65affd700 1 -- 172.21.15.45:0/1461851590 learned_addr learned my addr 172.21.15.45:0/1461851590 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:16.496 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.679+0000 7fd65affd700 1 -- 172.21.15.45:0/1461851590 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65c106600 con 0x7fd65c107980 2024-05-10T03:33:16.497 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.679+0000 7fd65affd700 1 --2- 172.21.15.45:0/1461851590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd65c107980 0x7fd65c107d90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd64c00bb40 tx=0x7fd64c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b02f8d6343e0bf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:16.497 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.679+0000 7fd659ffb700 1 -- 172.21.15.45:0/1461851590 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd64c00dbe0 con 0x7fd65c107980 2024-05-10T03:33:16.497 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.679+0000 7fd659ffb700 1 -- 172.21.15.45:0/1461851590 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd64c004510 con 0x7fd65c107980 2024-05-10T03:33:16.497 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.679+0000 7fd659ffb700 1 -- 172.21.15.45:0/1461851590 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd64c010470 con 0x7fd65c107980 2024-05-10T03:33:16.497 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.680+0000 7fd661420700 1 -- 172.21.15.45:0/1461851590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd65c107980 msgr2=0x7fd65c107d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:16.497 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.680+0000 7fd661420700 1 --2- 172.21.15.45:0/1461851590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd65c107980 0x7fd65c107d90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd64c00bb40 tx=0x7fd64c00be50 comp rx=0 tx=0).stop 2024-05-10T03:33:16.497 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.680+0000 7fd661420700 1 -- 172.21.15.45:0/1461851590 shutdown_connections 2024-05-10T03:33:16.497 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.680+0000 7fd661420700 1 --2- 172.21.15.45:0/1461851590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd65c107980 0x7fd65c107d90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:16.497 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.680+0000 7fd661420700 1 -- 172.21.15.45:0/1461851590 >> 172.21.15.45:0/1461851590 conn(0x7fd65c101260 msgr2=0x7fd65c1036b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:16.497 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.680+0000 7fd661420700 1 -- 172.21.15.45:0/1461851590 shutdown_connections 2024-05-10T03:33:16.497 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.680+0000 7fd661420700 1 -- 172.21.15.45:0/1461851590 wait complete. 2024-05-10T03:33:16.497 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.681+0000 7fd661420700 1 Processor -- start 2024-05-10T03:33:16.497 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.682+0000 7fd661420700 1 -- start start 2024-05-10T03:33:16.498 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.682+0000 7fd661420700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd65c107980 0x7fd65c199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:16.498 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.682+0000 7fd661420700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c199960 con 0x7fd65c107980 2024-05-10T03:33:16.498 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.682+0000 7fd65affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd65c107980 0x7fd65c199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:16.498 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.682+0000 7fd65affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd65c107980 0x7fd65c199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43258/0 (socket says 172.21.15.45:43258) 2024-05-10T03:33:16.498 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.682+0000 7fd65affd700 1 -- 172.21.15.45:0/2950716318 learned_addr learned my addr 172.21.15.45:0/2950716318 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:16.498 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.683+0000 7fd65affd700 1 -- 172.21.15.45:0/2950716318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64c00b7f0 con 0x7fd65c107980 2024-05-10T03:33:16.498 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.683+0000 7fd65affd700 1 --2- 172.21.15.45:0/2950716318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd65c107980 0x7fd65c199420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd64c003bc0 tx=0x7fd64c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:16.498 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.683+0000 7fd643fff700 1 -- 172.21.15.45:0/2950716318 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd64c01e070 con 0x7fd65c107980 2024-05-10T03:33:16.498 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.683+0000 7fd643fff700 1 -- 172.21.15.45:0/2950716318 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd64c010c10 con 0x7fd65c107980 2024-05-10T03:33:16.498 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.683+0000 7fd661420700 1 -- 172.21.15.45:0/2950716318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd65c199b60 con 0x7fd65c107980 2024-05-10T03:33:16.498 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.683+0000 7fd643fff700 1 -- 172.21.15.45:0/2950716318 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd64c022af0 con 0x7fd65c107980 2024-05-10T03:33:16.498 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.683+0000 7fd661420700 1 -- 172.21.15.45:0/2950716318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd65c19a000 con 0x7fd65c107980 2024-05-10T03:33:16.499 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.684+0000 7fd643fff700 1 -- 172.21.15.45:0/2950716318 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fd64c02c440 con 0x7fd65c107980 2024-05-10T03:33:16.499 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.684+0000 7fd643fff700 1 --2- 172.21.15.45:0/2950716318 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fd644038770 0x7fd64403ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:16.499 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.684+0000 7fd643fff700 1 -- 172.21.15.45:0/2950716318 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd64c04fdd0 con 0x7fd65c107980 2024-05-10T03:33:16.499 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.685+0000 7fd65a7fc700 1 --2- 172.21.15.45:0/2950716318 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fd644038770 0x7fd64403ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:16.499 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.685+0000 7fd661420700 1 -- 172.21.15.45:0/2950716318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd65c1054f0 con 0x7fd65c107980 2024-05-10T03:33:16.499 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.685+0000 7fd65a7fc700 1 --2- 172.21.15.45:0/2950716318 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fd644038770 0x7fd64403ac80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd650006fd0 tx=0x7fd650006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:16.499 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.690+0000 7fd643fff700 1 -- 172.21.15.45:0/2950716318 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd64c027030 con 0x7fd65c107980 2024-05-10T03:33:16.499 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.937+0000 7fd661420700 1 -- 172.21.15.45:0/2950716318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fd65c1928b0 con 0x7fd65c107980 2024-05-10T03:33:16.499 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.941+0000 7fd643fff700 1 -- 172.21.15.45:0/2950716318 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fd64c04d030 con 0x7fd65c107980 2024-05-10T03:33:16.499 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.943+0000 7fd661420700 1 -- 172.21.15.45:0/2950716318 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fd644038770 msgr2=0x7fd64403ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:16.500 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.943+0000 7fd661420700 1 --2- 172.21.15.45:0/2950716318 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fd644038770 0x7fd64403ac80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd650006fd0 tx=0x7fd650006e40 comp rx=0 tx=0).stop 2024-05-10T03:33:16.500 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.943+0000 7fd661420700 1 -- 172.21.15.45:0/2950716318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd65c107980 msgr2=0x7fd65c199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:16.500 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.943+0000 7fd661420700 1 --2- 172.21.15.45:0/2950716318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd65c107980 0x7fd65c199420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd64c003bc0 tx=0x7fd64c003d40 comp rx=0 tx=0).stop 2024-05-10T03:33:16.500 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.943+0000 7fd661420700 1 -- 172.21.15.45:0/2950716318 shutdown_connections 2024-05-10T03:33:16.500 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.943+0000 7fd661420700 1 --2- 172.21.15.45:0/2950716318 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fd644038770 0x7fd64403ac80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:16.500 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.943+0000 7fd661420700 1 --2- 172.21.15.45:0/2950716318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd65c107980 0x7fd65c199420 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:16.500 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.943+0000 7fd661420700 1 -- 172.21.15.45:0/2950716318 >> 172.21.15.45:0/2950716318 conn(0x7fd65c101260 msgr2=0x7fd65c18f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:16.501 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.943+0000 7fd661420700 1 -- 172.21.15.45:0/2950716318 shutdown_connections 2024-05-10T03:33:16.501 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:15.944+0000 7fd661420700 1 -- 172.21.15.45:0/2950716318 wait complete. 2024-05-10T03:33:16.501 INFO:teuthology.orchestra.run.smithi045.stdout:Enabling the dashboard module... 2024-05-10T03:33:17.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:16 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2950716318' entity='client.admin' 2024-05-10T03:33:18.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:17 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1603543064' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-10T03:33:18.284 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:18 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: ignoring --setuser ceph since I am not root 2024-05-10T03:33:18.285 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:18 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: ignoring --setgroup ceph since I am not root 2024-05-10T03:33:18.349 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.910+0000 7f819d51a700 1 Processor -- start 2024-05-10T03:33:18.360 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.910+0000 7f819d51a700 1 -- start start 2024-05-10T03:33:18.360 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.910+0000 7f819d51a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f819807abd0 0x7f819810a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:18.361 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.910+0000 7f819d51a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819810a680 con 0x7f819807abd0 2024-05-10T03:33:18.361 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.911+0000 7f8196ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f819807abd0 0x7f819810a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:18.361 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.911+0000 7f8196ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f819807abd0 0x7f819810a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43262/0 (socket says 172.21.15.45:43262) 2024-05-10T03:33:18.361 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.911+0000 7f8196ffd700 1 -- 172.21.15.45:0/162121823 learned_addr learned my addr 172.21.15.45:0/162121823 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:18.361 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.911+0000 7f8196ffd700 1 -- 172.21.15.45:0/162121823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819810a7c0 con 0x7f819807abd0 2024-05-10T03:33:18.361 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.911+0000 7f8196ffd700 1 --2- 172.21.15.45:0/162121823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f819807abd0 0x7f819810a0b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f81880098a0 tx=0x7f8188009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d85e6d92e1237d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:18.362 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.911+0000 7f8195ffb700 1 -- 172.21.15.45:0/162121823 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8188004160 con 0x7f819807abd0 2024-05-10T03:33:18.362 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.911+0000 7f8195ffb700 1 -- 172.21.15.45:0/162121823 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f81880042c0 con 0x7f819807abd0 2024-05-10T03:33:18.362 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.911+0000 7f8195ffb700 1 -- 172.21.15.45:0/162121823 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8188011a80 con 0x7f819807abd0 2024-05-10T03:33:18.362 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.912+0000 7f819d51a700 1 -- 172.21.15.45:0/162121823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f819807abd0 msgr2=0x7f819810a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:18.362 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.912+0000 7f819d51a700 1 --2- 172.21.15.45:0/162121823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f819807abd0 0x7f819810a0b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f81880098a0 tx=0x7f8188009bb0 comp rx=0 tx=0).stop 2024-05-10T03:33:18.363 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.912+0000 7f819d51a700 1 -- 172.21.15.45:0/162121823 shutdown_connections 2024-05-10T03:33:18.363 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.912+0000 7f819d51a700 1 --2- 172.21.15.45:0/162121823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f819807abd0 0x7f819810a0b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:18.363 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.912+0000 7f819d51a700 1 -- 172.21.15.45:0/162121823 >> 172.21.15.45:0/162121823 conn(0x7f8198101a60 msgr2=0x7f8198103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:18.363 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.912+0000 7f819d51a700 1 -- 172.21.15.45:0/162121823 shutdown_connections 2024-05-10T03:33:18.363 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.912+0000 7f819d51a700 1 -- 172.21.15.45:0/162121823 wait complete. 2024-05-10T03:33:18.363 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.913+0000 7f819d51a700 1 Processor -- start 2024-05-10T03:33:18.364 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.913+0000 7f819d51a700 1 -- start start 2024-05-10T03:33:18.364 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.913+0000 7f819d51a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f819807abd0 0x7f8198107820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:18.364 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.913+0000 7f819d51a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8198107d60 con 0x7f819807abd0 2024-05-10T03:33:18.364 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.914+0000 7f8196ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f819807abd0 0x7f8198107820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:18.364 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.914+0000 7f8196ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f819807abd0 0x7f8198107820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43272/0 (socket says 172.21.15.45:43272) 2024-05-10T03:33:18.365 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.914+0000 7f8196ffd700 1 -- 172.21.15.45:0/1603543064 learned_addr learned my addr 172.21.15.45:0/1603543064 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:18.365 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.914+0000 7f8196ffd700 1 -- 172.21.15.45:0/1603543064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8188009550 con 0x7f819807abd0 2024-05-10T03:33:18.365 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.914+0000 7f8196ffd700 1 --2- 172.21.15.45:0/1603543064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f819807abd0 0x7f8198107820 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8188009fb0 tx=0x7f8188011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:18.365 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.914+0000 7f817ffff700 1 -- 172.21.15.45:0/1603543064 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81880038b0 con 0x7f819807abd0 2024-05-10T03:33:18.365 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.914+0000 7f817ffff700 1 -- 172.21.15.45:0/1603543064 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8188003a10 con 0x7f819807abd0 2024-05-10T03:33:18.365 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.914+0000 7f819d51a700 1 -- 172.21.15.45:0/1603543064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8198105fb0 con 0x7f819807abd0 2024-05-10T03:33:18.366 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.914+0000 7f817ffff700 1 -- 172.21.15.45:0/1603543064 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8188019620 con 0x7f819807abd0 2024-05-10T03:33:18.366 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.914+0000 7f819d51a700 1 -- 172.21.15.45:0/1603543064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8198106450 con 0x7f819807abd0 2024-05-10T03:33:18.366 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.915+0000 7f817ffff700 1 -- 172.21.15.45:0/1603543064 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f81880197c0 con 0x7f819807abd0 2024-05-10T03:33:18.366 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.915+0000 7f819d51a700 1 -- 172.21.15.45:0/1603543064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8198062840 con 0x7f819807abd0 2024-05-10T03:33:18.366 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.916+0000 7f817ffff700 1 --2- 172.21.15.45:0/1603543064 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f81800387c0 0x7f818003acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:18.366 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.916+0000 7f817ffff700 1 -- 172.21.15.45:0/1603543064 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f818804caa0 con 0x7f819807abd0 2024-05-10T03:33:18.367 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.916+0000 7f81967fc700 1 --2- 172.21.15.45:0/1603543064 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f81800387c0 0x7f818003acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:18.367 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.916+0000 7f81967fc700 1 --2- 172.21.15.45:0/1603543064 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f81800387c0 0x7f818003acd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f818c006fd0 tx=0x7f818c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:18.367 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:16.921+0000 7f817ffff700 1 -- 172.21.15.45:0/1603543064 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8188018db0 con 0x7f819807abd0 2024-05-10T03:33:18.367 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:17.198+0000 7f819d51a700 1 -- 172.21.15.45:0/1603543064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f819810b720 con 0x7f819807abd0 2024-05-10T03:33:18.367 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:17.944+0000 7f817ffff700 1 -- 172.21.15.45:0/1603543064 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f818802d960 con 0x7f819807abd0 2024-05-10T03:33:18.368 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:17.946+0000 7f817ffff700 1 -- 172.21.15.45:0/1603543064 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f8188019d50 con 0x7f819807abd0 2024-05-10T03:33:18.368 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:17.950+0000 7f819d51a700 1 -- 172.21.15.45:0/1603543064 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f81800387c0 msgr2=0x7f818003acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:18.368 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:17.950+0000 7f819d51a700 1 --2- 172.21.15.45:0/1603543064 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f81800387c0 0x7f818003acd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f818c006fd0 tx=0x7f818c006e40 comp rx=0 tx=0).stop 2024-05-10T03:33:18.368 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:17.950+0000 7f819d51a700 1 -- 172.21.15.45:0/1603543064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f819807abd0 msgr2=0x7f8198107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:18.368 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:17.950+0000 7f819d51a700 1 --2- 172.21.15.45:0/1603543064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f819807abd0 0x7f8198107820 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8188009fb0 tx=0x7f8188011ae0 comp rx=0 tx=0).stop 2024-05-10T03:33:18.368 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:17.951+0000 7f819d51a700 1 -- 172.21.15.45:0/1603543064 shutdown_connections 2024-05-10T03:33:18.369 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:17.951+0000 7f819d51a700 1 --2- 172.21.15.45:0/1603543064 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f81800387c0 0x7f818003acd0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:18.369 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:17.951+0000 7f819d51a700 1 --2- 172.21.15.45:0/1603543064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f819807abd0 0x7f8198107820 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:18.369 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:17.951+0000 7f819d51a700 1 -- 172.21.15.45:0/1603543064 >> 172.21.15.45:0/1603543064 conn(0x7f8198101a60 msgr2=0x7f8198102300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:18.369 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:17.951+0000 7f819d51a700 1 -- 172.21.15.45:0/1603543064 shutdown_connections 2024-05-10T03:33:18.370 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:17.951+0000 7f819d51a700 1 -- 172.21.15.45:0/1603543064 wait complete. 2024-05-10T03:33:18.568 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:18 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:18.501+0000 7f0fb8521200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T03:33:18.947 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:18 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:18.625+0000 7f0fb8521200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T03:33:18.947 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:18 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:18.735+0000 7f0fb8521200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T03:33:18.947 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:18 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:18.837+0000 7f0fb8521200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T03:33:19.255 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:18 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1603543064' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-10T03:33:19.255 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:18 smithi045 ceph-mon[42520]: mgrmap e9: x(active, since 15s) 2024-05-10T03:33:19.454 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout { 2024-05-10T03:33:19.454 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-05-10T03:33:19.454 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-10T03:33:19.455 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-10T03:33:19.455 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-10T03:33:19.455 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout } 2024-05-10T03:33:19.455 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.801+0000 7fb809bbf700 1 Processor -- start 2024-05-10T03:33:19.455 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.801+0000 7fb809bbf700 1 -- start start 2024-05-10T03:33:19.455 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.801+0000 7fb809bbf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80407ac30 0x7fb80410c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:19.455 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.801+0000 7fb809bbf700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb804107ef0 con 0x7fb80407ac30 2024-05-10T03:33:19.455 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.802+0000 7fb8037fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80407ac30 0x7fb80410c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:19.455 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.802+0000 7fb8037fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80407ac30 0x7fb80410c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39922/0 (socket says 172.21.15.45:39922) 2024-05-10T03:33:19.455 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.802+0000 7fb8037fe700 1 -- 172.21.15.45:0/604384761 learned_addr learned my addr 172.21.15.45:0/604384761 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:19.455 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.802+0000 7fb8037fe700 1 -- 172.21.15.45:0/604384761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80410c990 con 0x7fb80407ac30 2024-05-10T03:33:19.455 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.802+0000 7fb8037fe700 1 --2- 172.21.15.45:0/604384761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80407ac30 0x7fb80410c450 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40098a0 tx=0x7fb7f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e092af1c7a05aa95 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:19.455 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.803+0000 7fb8027fc700 1 -- 172.21.15.45:0/604384761 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7f4004160 con 0x7fb80407ac30 2024-05-10T03:33:19.456 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.803+0000 7fb8027fc700 1 -- 172.21.15.45:0/604384761 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb7f40042c0 con 0x7fb80407ac30 2024-05-10T03:33:19.456 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.803+0000 7fb8027fc700 1 -- 172.21.15.45:0/604384761 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7f4011a80 con 0x7fb80407ac30 2024-05-10T03:33:19.456 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.804+0000 7fb809bbf700 1 -- 172.21.15.45:0/604384761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80407ac30 msgr2=0x7fb80410c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:19.456 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.804+0000 7fb809bbf700 1 --2- 172.21.15.45:0/604384761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80407ac30 0x7fb80410c450 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40098a0 tx=0x7fb7f4009bb0 comp rx=0 tx=0).stop 2024-05-10T03:33:19.456 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.804+0000 7fb809bbf700 1 -- 172.21.15.45:0/604384761 shutdown_connections 2024-05-10T03:33:19.456 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.804+0000 7fb809bbf700 1 --2- 172.21.15.45:0/604384761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80407ac30 0x7fb80410c450 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:19.456 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.804+0000 7fb809bbf700 1 -- 172.21.15.45:0/604384761 >> 172.21.15.45:0/604384761 conn(0x7fb804101a60 msgr2=0x7fb804103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:19.456 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.804+0000 7fb809bbf700 1 -- 172.21.15.45:0/604384761 shutdown_connections 2024-05-10T03:33:19.456 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.804+0000 7fb809bbf700 1 -- 172.21.15.45:0/604384761 wait complete. 2024-05-10T03:33:19.456 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.804+0000 7fb809bbf700 1 Processor -- start 2024-05-10T03:33:19.456 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.805+0000 7fb809bbf700 1 -- start start 2024-05-10T03:33:19.456 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.805+0000 7fb809bbf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80407ac30 0x7fb80419d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:19.456 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.805+0000 7fb809bbf700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80419dca0 con 0x7fb80407ac30 2024-05-10T03:33:19.456 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.805+0000 7fb8037fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80407ac30 0x7fb80419d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:19.457 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.805+0000 7fb8037fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80407ac30 0x7fb80419d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39930/0 (socket says 172.21.15.45:39930) 2024-05-10T03:33:19.457 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.805+0000 7fb8037fe700 1 -- 172.21.15.45:0/3717494606 learned_addr learned my addr 172.21.15.45:0/3717494606 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:19.457 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.805+0000 7fb8037fe700 1 -- 172.21.15.45:0/3717494606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f4009550 con 0x7fb80407ac30 2024-05-10T03:33:19.457 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.806+0000 7fb8037fe700 1 --2- 172.21.15.45:0/3717494606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80407ac30 0x7fb80419d760 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009fb0 tx=0x7fb7f4011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:19.457 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.806+0000 7fb800ff9700 1 -- 172.21.15.45:0/3717494606 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7f40038b0 con 0x7fb80407ac30 2024-05-10T03:33:19.457 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.806+0000 7fb809bbf700 1 -- 172.21.15.45:0/3717494606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb80419dea0 con 0x7fb80407ac30 2024-05-10T03:33:19.457 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.806+0000 7fb800ff9700 1 -- 172.21.15.45:0/3717494606 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb7f4003a10 con 0x7fb80407ac30 2024-05-10T03:33:19.457 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.806+0000 7fb800ff9700 1 -- 172.21.15.45:0/3717494606 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7f4019620 con 0x7fb80407ac30 2024-05-10T03:33:19.457 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.806+0000 7fb809bbf700 1 -- 172.21.15.45:0/3717494606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb80419e340 con 0x7fb80407ac30 2024-05-10T03:33:19.457 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.807+0000 7fb800ff9700 1 -- 172.21.15.45:0/3717494606 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7fb7f4019890 con 0x7fb80407ac30 2024-05-10T03:33:19.457 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.807+0000 7fb809bbf700 1 -- 172.21.15.45:0/3717494606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80410d8f0 con 0x7fb80407ac30 2024-05-10T03:33:19.457 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.807+0000 7fb800ff9700 1 --2- 172.21.15.45:0/3717494606 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fb7ec0387c0 0x7fb7ec03acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:19.457 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.807+0000 7fb800ff9700 1 -- 172.21.15.45:0/3717494606 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb7f404d8d0 con 0x7fb80407ac30 2024-05-10T03:33:19.457 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.807+0000 7fb802ffd700 1 -- 172.21.15.45:0/3717494606 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fb7ec0387c0 msgr2=0x7fb7ec03acd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/485502847 2024-05-10T03:33:19.458 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.807+0000 7fb802ffd700 1 --2- 172.21.15.45:0/3717494606 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fb7ec0387c0 0x7fb7ec03acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-10T03:33:19.458 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:18.813+0000 7fb800ff9700 1 -- 172.21.15.45:0/3717494606 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb7f402b340 con 0x7fb80407ac30 2024-05-10T03:33:19.458 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.008+0000 7fb802ffd700 1 -- 172.21.15.45:0/3717494606 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fb7ec0387c0 msgr2=0x7fb7ec03acd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/485502847 2024-05-10T03:33:19.458 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.008+0000 7fb802ffd700 1 --2- 172.21.15.45:0/3717494606 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fb7ec0387c0 0x7fb7ec03acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-10T03:33:19.458 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.085+0000 7fb809bbf700 1 -- 172.21.15.45:0/3717494606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fb8041a0b40 con 0x7fb80407ac30 2024-05-10T03:33:19.458 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.085+0000 7fb800ff9700 1 -- 172.21.15.45:0/3717494606 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7fb7f4018b40 con 0x7fb80407ac30 2024-05-10T03:33:19.458 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.088+0000 7fb809bbf700 1 -- 172.21.15.45:0/3717494606 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fb7ec0387c0 msgr2=0x7fb7ec03acd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-10T03:33:19.458 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.088+0000 7fb809bbf700 1 --2- 172.21.15.45:0/3717494606 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fb7ec0387c0 0x7fb7ec03acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:19.458 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.088+0000 7fb809bbf700 1 -- 172.21.15.45:0/3717494606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80407ac30 msgr2=0x7fb80419d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:19.458 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.088+0000 7fb809bbf700 1 --2- 172.21.15.45:0/3717494606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80407ac30 0x7fb80419d760 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009fb0 tx=0x7fb7f4011ae0 comp rx=0 tx=0).stop 2024-05-10T03:33:19.458 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.088+0000 7fb809bbf700 1 -- 172.21.15.45:0/3717494606 shutdown_connections 2024-05-10T03:33:19.458 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.088+0000 7fb809bbf700 1 --2- 172.21.15.45:0/3717494606 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7fb7ec0387c0 0x7fb7ec03acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:19.458 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.088+0000 7fb809bbf700 1 --2- 172.21.15.45:0/3717494606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb80407ac30 0x7fb80419d760 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:19.459 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.088+0000 7fb809bbf700 1 -- 172.21.15.45:0/3717494606 >> 172.21.15.45:0/3717494606 conn(0x7fb804101a60 msgr2=0x7fb804102300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:19.459 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.088+0000 7fb809bbf700 1 -- 172.21.15.45:0/3717494606 shutdown_connections 2024-05-10T03:33:19.459 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.088+0000 7fb809bbf700 1 -- 172.21.15.45:0/3717494606 wait complete. 2024-05-10T03:33:19.459 INFO:teuthology.orchestra.run.smithi045.stdout:Waiting for the mgr to restart... 2024-05-10T03:33:19.459 INFO:teuthology.orchestra.run.smithi045.stdout:Waiting for mgr epoch 9... 2024-05-10T03:33:19.890 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:19 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:19.590+0000 7f0fb8521200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T03:33:20.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:19 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3717494606' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-10T03:33:20.284 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:19 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:19.886+0000 7f0fb8521200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T03:33:20.285 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:19 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:19.984+0000 7f0fb8521200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T03:33:20.285 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:20 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:20.110+0000 7f0fb8521200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T03:33:20.784 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:20 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:20.292+0000 7f0fb8521200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T03:33:20.784 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:20 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:20.439+0000 7f0fb8521200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T03:33:20.784 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:20 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:20.537+0000 7f0fb8521200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T03:33:21.284 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:20 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:20.963+0000 7f0fb8521200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T03:33:21.744 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:21 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:21.410+0000 7f0fb8521200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T03:33:21.744 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:21 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:21.634+0000 7f0fb8521200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-10T03:33:22.905 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:21 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:21.741+0000 7f0fb8521200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T03:33:22.906 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:22 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:22.618+0000 7f0fb8521200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T03:33:22.906 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:22 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:22.731+0000 7f0fb8521200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T03:33:23.284 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:22 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:22.902+0000 7f0fb8521200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T03:33:24.034 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:23 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:23.628+0000 7f0fb8521200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-10T03:33:24.034 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:23 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:23.840+0000 7f0fb8521200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T03:33:24.534 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:24 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:24.064+0000 7f0fb8521200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T03:33:25.466 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:25 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:25.135+0000 7f0fb8521200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T03:33:25.784 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:25 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:25.463+0000 7f0fb8521200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T03:33:25.784 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:25 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:25.566+0000 7f0fb8521200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T03:33:26.284 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:33:25 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:33:25.788+0000 7f0fb8521200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T03:33:26.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:25 smithi045 ceph-mon[42520]: Active manager daemon x restarted 2024-05-10T03:33:26.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:25 smithi045 ceph-mon[42520]: Activating manager daemon x 2024-05-10T03:33:26.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:25 smithi045 ceph-mon[42520]: osdmap e3: 0 total, 0 up, 0 in 2024-05-10T03:33:26.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:25 smithi045 ceph-mon[42520]: mgrmap e10: x(active, starting, since 0.00414106s) 2024-05-10T03:33:26.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T03:33:26.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-10T03:33:26.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-10T03:33:26.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-10T03:33:26.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-10T03:33:26.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:25 smithi045 ceph-mon[42520]: Manager daemon x is now available 2024-05-10T03:33:26.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:33:27.237 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-10T03:33:27.237 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-10T03:33:27.238 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:26 smithi045 ceph-mon[42520]: mgrmap e11: x(active, since 1.00775s) 2024-05-10T03:33:27.379 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout { 2024-05-10T03:33:27.379 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-05-10T03:33:27.379 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-10T03:33:27.379 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout } 2024-05-10T03:33:27.379 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.825+0000 7f6d35346700 1 Processor -- start 2024-05-10T03:33:27.379 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.825+0000 7f6d35346700 1 -- start start 2024-05-10T03:33:27.379 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.825+0000 7f6d35346700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d30107520 0x7f6d30107930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:27.380 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.825+0000 7f6d35346700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d30107f20 con 0x7f6d30107520 2024-05-10T03:33:27.380 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.825+0000 7f6d2effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d30107520 0x7f6d30107930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:27.380 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.826+0000 7f6d2effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d30107520 0x7f6d30107930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39942/0 (socket says 172.21.15.45:39942) 2024-05-10T03:33:27.380 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.826+0000 7f6d2effd700 1 -- 172.21.15.45:0/1110848994 learned_addr learned my addr 172.21.15.45:0/1110848994 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:27.380 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.826+0000 7f6d2effd700 1 -- 172.21.15.45:0/1110848994 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d30108650 con 0x7f6d30107520 2024-05-10T03:33:27.380 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.826+0000 7f6d2effd700 1 --2- 172.21.15.45:0/1110848994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d30107520 0x7f6d30107930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6d200098a0 tx=0x7f6d20009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d1ee3b839b11ad server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:27.380 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.826+0000 7f6d2dffb700 1 -- 172.21.15.45:0/1110848994 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d20004160 con 0x7f6d30107520 2024-05-10T03:33:27.380 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.826+0000 7f6d2dffb700 1 -- 172.21.15.45:0/1110848994 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6d200042c0 con 0x7f6d30107520 2024-05-10T03:33:27.380 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.826+0000 7f6d2dffb700 1 -- 172.21.15.45:0/1110848994 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d20011a80 con 0x7f6d30107520 2024-05-10T03:33:27.380 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.827+0000 7f6d35346700 1 -- 172.21.15.45:0/1110848994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d30107520 msgr2=0x7f6d30107930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:27.380 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.827+0000 7f6d35346700 1 --2- 172.21.15.45:0/1110848994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d30107520 0x7f6d30107930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6d200098a0 tx=0x7f6d20009bb0 comp rx=0 tx=0).stop 2024-05-10T03:33:27.380 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.827+0000 7f6d35346700 1 -- 172.21.15.45:0/1110848994 shutdown_connections 2024-05-10T03:33:27.380 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.827+0000 7f6d35346700 1 --2- 172.21.15.45:0/1110848994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d30107520 0x7f6d30107930 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:27.380 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.827+0000 7f6d35346700 1 -- 172.21.15.45:0/1110848994 >> 172.21.15.45:0/1110848994 conn(0x7f6d30102b40 msgr2=0x7f6d30105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:27.381 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.827+0000 7f6d35346700 1 -- 172.21.15.45:0/1110848994 shutdown_connections 2024-05-10T03:33:27.381 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.827+0000 7f6d35346700 1 -- 172.21.15.45:0/1110848994 wait complete. 2024-05-10T03:33:27.381 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.828+0000 7f6d35346700 1 Processor -- start 2024-05-10T03:33:27.381 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.829+0000 7f6d35346700 1 -- start start 2024-05-10T03:33:27.381 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.829+0000 7f6d35346700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d30107520 0x7f6d3007c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:27.381 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.829+0000 7f6d35346700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3007cf30 con 0x7f6d30107520 2024-05-10T03:33:27.381 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.829+0000 7f6d2effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d30107520 0x7f6d3007c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:27.381 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.829+0000 7f6d2effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d30107520 0x7f6d3007c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39946/0 (socket says 172.21.15.45:39946) 2024-05-10T03:33:27.381 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.829+0000 7f6d2effd700 1 -- 172.21.15.45:0/1572304375 learned_addr learned my addr 172.21.15.45:0/1572304375 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:27.381 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.829+0000 7f6d2effd700 1 -- 172.21.15.45:0/1572304375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d20009550 con 0x7f6d30107520 2024-05-10T03:33:27.381 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.830+0000 7f6d2effd700 1 --2- 172.21.15.45:0/1572304375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d30107520 0x7f6d3007c9f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6d20009fb0 tx=0x7f6d20011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:27.381 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.830+0000 7f6d17fff700 1 -- 172.21.15.45:0/1572304375 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d20003970 con 0x7f6d30107520 2024-05-10T03:33:27.381 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.830+0000 7f6d17fff700 1 -- 172.21.15.45:0/1572304375 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6d20003ad0 con 0x7f6d30107520 2024-05-10T03:33:27.381 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.830+0000 7f6d35346700 1 -- 172.21.15.45:0/1572304375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d3007b180 con 0x7f6d30107520 2024-05-10T03:33:27.382 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.830+0000 7f6d17fff700 1 -- 172.21.15.45:0/1572304375 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d2001a650 con 0x7f6d30107520 2024-05-10T03:33:27.382 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.830+0000 7f6d35346700 1 -- 172.21.15.45:0/1572304375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d3007b620 con 0x7f6d30107520 2024-05-10T03:33:27.382 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.831+0000 7f6d17fff700 1 -- 172.21.15.45:0/1572304375 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f6d20024a20 con 0x7f6d30107520 2024-05-10T03:33:27.382 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.832+0000 7f6d17fff700 1 --2- 172.21.15.45:0/1572304375 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f6d18038810 0x7f6d1803ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:27.382 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.832+0000 7f6d17fff700 1 -- 172.21.15.45:0/1572304375 --> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d1803b430 con 0x7f6d18038810 2024-05-10T03:33:27.382 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.832+0000 7f6d17fff700 1 -- 172.21.15.45:0/1572304375 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f6d2004c6e0 con 0x7f6d30107520 2024-05-10T03:33:27.382 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.832+0000 7f6d2e7fc700 1 -- 172.21.15.45:0/1572304375 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f6d18038810 msgr2=0x7f6d1803ad20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/485502847 2024-05-10T03:33:27.382 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:19.832+0000 7f6d2e7fc700 1 --2- 172.21.15.45:0/1572304375 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f6d18038810 0x7f6d1803ad20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-10T03:33:27.382 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:20.033+0000 7f6d2e7fc700 1 -- 172.21.15.45:0/1572304375 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f6d18038810 msgr2=0x7f6d1803ad20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/485502847 2024-05-10T03:33:27.382 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:20.033+0000 7f6d2e7fc700 1 --2- 172.21.15.45:0/1572304375 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f6d18038810 0x7f6d1803ad20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-10T03:33:27.382 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:20.434+0000 7f6d2e7fc700 1 -- 172.21.15.45:0/1572304375 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f6d18038810 msgr2=0x7f6d1803ad20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/485502847 2024-05-10T03:33:27.382 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:20.434+0000 7f6d2e7fc700 1 --2- 172.21.15.45:0/1572304375 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f6d18038810 0x7f6d1803ad20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-10T03:33:27.382 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:21.235+0000 7f6d2e7fc700 1 -- 172.21.15.45:0/1572304375 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f6d18038810 msgr2=0x7f6d1803ad20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/485502847 2024-05-10T03:33:27.383 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:21.235+0000 7f6d2e7fc700 1 --2- 172.21.15.45:0/1572304375 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f6d18038810 0x7f6d1803ad20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-10T03:33:27.383 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:22.836+0000 7f6d2e7fc700 1 -- 172.21.15.45:0/1572304375 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f6d18038810 msgr2=0x7f6d1803ad20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/485502847 2024-05-10T03:33:27.383 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:22.836+0000 7f6d2e7fc700 1 --2- 172.21.15.45:0/1572304375 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f6d18038810 0x7f6d1803ad20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-10T03:33:27.383 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:25.804+0000 7f6d17fff700 1 -- 172.21.15.45:0/1572304375 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mgrmap(e 10) v1 ==== 45321+0+0 (secure 0 0 0) 0x7f6d2002d910 con 0x7f6d30107520 2024-05-10T03:33:27.383 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:25.804+0000 7f6d17fff700 1 -- 172.21.15.45:0/1572304375 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f6d18038810 msgr2=0x7f6d1803ad20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-10T03:33:27.383 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:25.804+0000 7f6d17fff700 1 --2- 172.21.15.45:0/1572304375 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f6d18038810 0x7f6d1803ad20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:27.383 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:26.806+0000 7f6d17fff700 1 -- 172.21.15.45:0/1572304375 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mgrmap(e 11) v1 ==== 45448+0+0 (secure 0 0 0) 0x7f6d2004e3d0 con 0x7f6d30107520 2024-05-10T03:33:27.383 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:26.806+0000 7f6d17fff700 1 --2- 172.21.15.45:0/1572304375 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6d2004c270 0x7f6d1803e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:27.383 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:26.806+0000 7f6d17fff700 1 -- 172.21.15.45:0/1572304375 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d1803b430 con 0x7f6d2004c270 2024-05-10T03:33:27.383 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:26.806+0000 7f6d2e7fc700 1 --2- 172.21.15.45:0/1572304375 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6d2004c270 0x7f6d1803e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:27.383 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:26.808+0000 7f6d2e7fc700 1 --2- 172.21.15.45:0/1572304375 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6d2004c270 0x7f6d1803e1b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6d24003a10 tx=0x7f6d24009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:27.383 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:26.809+0000 7f6d17fff700 1 -- 172.21.15.45:0/1572304375 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f6d1803b430 con 0x7f6d2004c270 2024-05-10T03:33:27.383 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:26.816+0000 7f6d35346700 1 -- 172.21.15.45:0/1572304375 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f6d30062840 con 0x7f6d2004c270 2024-05-10T03:33:27.383 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:26.817+0000 7f6d17fff700 1 -- 172.21.15.45:0/1572304375 <== mgr.14152 v2:172.21.15.45:6800/596110596 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f6d30062840 con 0x7f6d2004c270 2024-05-10T03:33:27.384 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:26.817+0000 7f6d35346700 1 -- 172.21.15.45:0/1572304375 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6d2004c270 msgr2=0x7f6d1803e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:27.384 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:26.817+0000 7f6d35346700 1 --2- 172.21.15.45:0/1572304375 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6d2004c270 0x7f6d1803e1b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6d24003a10 tx=0x7f6d24009270 comp rx=0 tx=0).stop 2024-05-10T03:33:27.384 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:26.817+0000 7f6d35346700 1 -- 172.21.15.45:0/1572304375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d30107520 msgr2=0x7f6d3007c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:27.384 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:26.817+0000 7f6d35346700 1 --2- 172.21.15.45:0/1572304375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d30107520 0x7f6d3007c9f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6d20009fb0 tx=0x7f6d20011b00 comp rx=0 tx=0).stop 2024-05-10T03:33:27.384 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:26.818+0000 7f6d35346700 1 -- 172.21.15.45:0/1572304375 shutdown_connections 2024-05-10T03:33:27.384 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:26.818+0000 7f6d35346700 1 --2- 172.21.15.45:0/1572304375 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6d2004c270 0x7f6d1803e1b0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:27.384 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:26.818+0000 7f6d35346700 1 --2- 172.21.15.45:0/1572304375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d30107520 0x7f6d3007c9f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:27.384 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:26.818+0000 7f6d35346700 1 --2- 172.21.15.45:0/1572304375 >> [v2:172.21.15.45:6800/485502847,v1:172.21.15.45:6801/485502847] conn(0x7f6d18038810 0x7f6d1803ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:27.384 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:26.818+0000 7f6d35346700 1 -- 172.21.15.45:0/1572304375 >> 172.21.15.45:0/1572304375 conn(0x7f6d30102b40 msgr2=0x7f6d301033f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:27.384 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:26.818+0000 7f6d35346700 1 -- 172.21.15.45:0/1572304375 shutdown_connections 2024-05-10T03:33:27.384 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:26.818+0000 7f6d35346700 1 -- 172.21.15.45:0/1572304375 wait complete. 2024-05-10T03:33:27.384 INFO:teuthology.orchestra.run.smithi045.stdout:mgr epoch 9 is available 2024-05-10T03:33:27.384 INFO:teuthology.orchestra.run.smithi045.stdout:Generating a dashboard self-signed certificate... 2024-05-10T03:33:28.164 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:27 smithi045 ceph-mon[42520]: [10/May/2024:03:33:26] ENGINE Bus STARTING 2024-05-10T03:33:28.164 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:27 smithi045 ceph-mon[42520]: [10/May/2024:03:33:26] ENGINE Serving on http://172.21.15.45:8765 2024-05-10T03:33:28.164 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:27 smithi045 ceph-mon[42520]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-10T03:33:28.164 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:27 smithi045 ceph-mon[42520]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-10T03:33:28.164 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:27 smithi045 ceph-mon[42520]: [10/May/2024:03:33:26] ENGINE Serving on https://172.21.15.45:7150 2024-05-10T03:33:28.164 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:27 smithi045 ceph-mon[42520]: [10/May/2024:03:33:26] ENGINE Bus STARTED 2024-05-10T03:33:28.164 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:28.164 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:28.711 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-05-10T03:33:28.712 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.823+0000 7f7f6f548700 1 Processor -- start 2024-05-10T03:33:28.712 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.824+0000 7f7f6f548700 1 -- start start 2024-05-10T03:33:28.712 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.824+0000 7f7f6f548700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f681079b0 0x7f7f68107dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:28.712 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.824+0000 7f7f6f548700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f681083b0 con 0x7f7f681079b0 2024-05-10T03:33:28.712 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.824+0000 7f7f6d2e4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f681079b0 0x7f7f68107dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:28.712 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.824+0000 7f7f6d2e4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f681079b0 0x7f7f68107dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34878/0 (socket says 172.21.15.45:34878) 2024-05-10T03:33:28.712 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.824+0000 7f7f6d2e4700 1 -- 172.21.15.45:0/3415461273 learned_addr learned my addr 172.21.15.45:0/3415461273 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:28.712 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.825+0000 7f7f6d2e4700 1 -- 172.21.15.45:0/3415461273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f681084f0 con 0x7f7f681079b0 2024-05-10T03:33:28.712 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.825+0000 7f7f6d2e4700 1 --2- 172.21.15.45:0/3415461273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f681079b0 0x7f7f68107dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7f640098a0 tx=0x7f7f64009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2359ddc434760e37 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:28.712 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.825+0000 7f7f5ffff700 1 -- 172.21.15.45:0/3415461273 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f64004160 con 0x7f7f681079b0 2024-05-10T03:33:28.712 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.825+0000 7f7f5ffff700 1 -- 172.21.15.45:0/3415461273 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7f640042c0 con 0x7f7f681079b0 2024-05-10T03:33:28.712 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.825+0000 7f7f5ffff700 1 -- 172.21.15.45:0/3415461273 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f64011a80 con 0x7f7f681079b0 2024-05-10T03:33:28.712 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.826+0000 7f7f6f548700 1 -- 172.21.15.45:0/3415461273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f681079b0 msgr2=0x7f7f68107dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:28.713 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.826+0000 7f7f6f548700 1 --2- 172.21.15.45:0/3415461273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f681079b0 0x7f7f68107dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7f640098a0 tx=0x7f7f64009bb0 comp rx=0 tx=0).stop 2024-05-10T03:33:28.713 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.826+0000 7f7f6f548700 1 -- 172.21.15.45:0/3415461273 shutdown_connections 2024-05-10T03:33:28.713 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.826+0000 7f7f6f548700 1 --2- 172.21.15.45:0/3415461273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f681079b0 0x7f7f68107dc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:28.713 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.826+0000 7f7f6f548700 1 -- 172.21.15.45:0/3415461273 >> 172.21.15.45:0/3415461273 conn(0x7f7f68101260 msgr2=0x7f7f681036b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:28.713 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.826+0000 7f7f6f548700 1 -- 172.21.15.45:0/3415461273 shutdown_connections 2024-05-10T03:33:28.713 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.826+0000 7f7f6f548700 1 -- 172.21.15.45:0/3415461273 wait complete. 2024-05-10T03:33:28.713 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.827+0000 7f7f6f548700 1 Processor -- start 2024-05-10T03:33:28.713 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.827+0000 7f7f6f548700 1 -- start start 2024-05-10T03:33:28.713 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.827+0000 7f7f6f548700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f681079b0 0x7f7f6819d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:28.713 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.827+0000 7f7f6f548700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6819dd20 con 0x7f7f681079b0 2024-05-10T03:33:28.713 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.828+0000 7f7f6d2e4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f681079b0 0x7f7f6819d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:28.713 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.828+0000 7f7f6d2e4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f681079b0 0x7f7f6819d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34882/0 (socket says 172.21.15.45:34882) 2024-05-10T03:33:28.713 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.828+0000 7f7f6d2e4700 1 -- 172.21.15.45:0/3245392969 learned_addr learned my addr 172.21.15.45:0/3245392969 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:28.713 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.828+0000 7f7f6d2e4700 1 -- 172.21.15.45:0/3245392969 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f64009550 con 0x7f7f681079b0 2024-05-10T03:33:28.713 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.828+0000 7f7f6d2e4700 1 --2- 172.21.15.45:0/3245392969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f681079b0 0x7f7f6819d7e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009fb0 tx=0x7f7f64011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:28.714 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.828+0000 7f7f5e7fc700 1 -- 172.21.15.45:0/3245392969 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f64003970 con 0x7f7f681079b0 2024-05-10T03:33:28.714 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.828+0000 7f7f5e7fc700 1 -- 172.21.15.45:0/3245392969 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7f64003ad0 con 0x7f7f681079b0 2024-05-10T03:33:28.714 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.828+0000 7f7f6f548700 1 -- 172.21.15.45:0/3245392969 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f6819df20 con 0x7f7f681079b0 2024-05-10T03:33:28.714 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.828+0000 7f7f5e7fc700 1 -- 172.21.15.45:0/3245392969 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f6401a650 con 0x7f7f681079b0 2024-05-10T03:33:28.714 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.828+0000 7f7f6f548700 1 -- 172.21.15.45:0/3245392969 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f6819e3c0 con 0x7f7f681079b0 2024-05-10T03:33:28.714 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.829+0000 7f7f5e7fc700 1 -- 172.21.15.45:0/3245392969 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 11) v1 ==== 45448+0+0 (secure 0 0 0) 0x7f7f6401a8c0 con 0x7f7f681079b0 2024-05-10T03:33:28.714 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.830+0000 7f7f5e7fc700 1 --2- 172.21.15.45:0/3245392969 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7f540386f0 0x7f7f5403ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:28.714 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.830+0000 7f7f6f548700 1 -- 172.21.15.45:0/3245392969 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f6810d920 con 0x7f7f681079b0 2024-05-10T03:33:28.714 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.830+0000 7f7f5e7fc700 1 -- 172.21.15.45:0/3245392969 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7f6404d650 con 0x7f7f681079b0 2024-05-10T03:33:28.714 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.830+0000 7f7f6cae3700 1 --2- 172.21.15.45:0/3245392969 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7f540386f0 0x7f7f5403ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:28.714 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.830+0000 7f7f6cae3700 1 --2- 172.21.15.45:0/3245392969 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7f540386f0 0x7f7f5403ac00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7f58006fd0 tx=0x7f7f58006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:28.714 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:27.835+0000 7f7f5e7fc700 1 -- 172.21.15.45:0/3245392969 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7f64018d90 con 0x7f7f681079b0 2024-05-10T03:33:28.714 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:28.064+0000 7f7f6f548700 1 -- 172.21.15.45:0/3245392969 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f681031d0 con 0x7f7f540386f0 2024-05-10T03:33:28.715 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:28.131+0000 7f7f5e7fc700 1 -- 172.21.15.45:0/3245392969 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f7f681031d0 con 0x7f7f540386f0 2024-05-10T03:33:28.715 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:28.134+0000 7f7f6f548700 1 -- 172.21.15.45:0/3245392969 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7f540386f0 msgr2=0x7f7f5403ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:28.715 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:28.134+0000 7f7f6f548700 1 --2- 172.21.15.45:0/3245392969 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7f540386f0 0x7f7f5403ac00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7f58006fd0 tx=0x7f7f58006e40 comp rx=0 tx=0).stop 2024-05-10T03:33:28.715 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:28.134+0000 7f7f6f548700 1 -- 172.21.15.45:0/3245392969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f681079b0 msgr2=0x7f7f6819d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:28.715 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:28.134+0000 7f7f6f548700 1 --2- 172.21.15.45:0/3245392969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f681079b0 0x7f7f6819d7e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009fb0 tx=0x7f7f64011b00 comp rx=0 tx=0).stop 2024-05-10T03:33:28.715 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:28.134+0000 7f7f6f548700 1 -- 172.21.15.45:0/3245392969 shutdown_connections 2024-05-10T03:33:28.715 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:28.134+0000 7f7f6f548700 1 --2- 172.21.15.45:0/3245392969 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7f540386f0 0x7f7f5403ac00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:28.715 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:28.134+0000 7f7f6f548700 1 --2- 172.21.15.45:0/3245392969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f681079b0 0x7f7f6819d7e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:28.715 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:28.134+0000 7f7f6f548700 1 -- 172.21.15.45:0/3245392969 >> 172.21.15.45:0/3245392969 conn(0x7f7f68101260 msgr2=0x7f7f68102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:28.715 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:28.134+0000 7f7f6f548700 1 -- 172.21.15.45:0/3245392969 shutdown_connections 2024-05-10T03:33:28.715 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:28.134+0000 7f7f6f548700 1 -- 172.21.15.45:0/3245392969 wait complete. 2024-05-10T03:33:28.715 INFO:teuthology.orchestra.run.smithi045.stdout:Creating initial admin user... 2024-05-10T03:33:29.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:29 smithi045 ceph-mon[42520]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:33:29.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:29 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:29.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:29 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:29.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:29 smithi045 ceph-mon[42520]: mgrmap e12: x(active, since 3s) 2024-05-10T03:33:30.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$L3ntv6gsZ0QXqHv6F/6jE.4NwofuNeVe92h6AV5NeF6ET1objfs52", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1715312009, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-10T03:33:30.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.318+0000 7fde26466700 1 Processor -- start 2024-05-10T03:33:30.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.318+0000 7fde26466700 1 -- start start 2024-05-10T03:33:30.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.318+0000 7fde26466700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde2007ac10 0x7fde2010c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:30.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.318+0000 7fde26466700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde20107ec0 con 0x7fde2007ac10 2024-05-10T03:33:30.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.318+0000 7fde1ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde2007ac10 0x7fde2010c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:30.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.318+0000 7fde1ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde2007ac10 0x7fde2010c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34890/0 (socket says 172.21.15.45:34890) 2024-05-10T03:33:30.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.318+0000 7fde1ffff700 1 -- 172.21.15.45:0/380007485 learned_addr learned my addr 172.21.15.45:0/380007485 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:30.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.319+0000 7fde1ffff700 1 -- 172.21.15.45:0/380007485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde2010c980 con 0x7fde2007ac10 2024-05-10T03:33:30.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.319+0000 7fde1ffff700 1 --2- 172.21.15.45:0/380007485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde2007ac10 0x7fde2010c440 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fde100098a0 tx=0x7fde10009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633b6483139bc4e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:30.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.319+0000 7fde1effd700 1 -- 172.21.15.45:0/380007485 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde10004160 con 0x7fde2007ac10 2024-05-10T03:33:30.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.319+0000 7fde1effd700 1 -- 172.21.15.45:0/380007485 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fde100042c0 con 0x7fde2007ac10 2024-05-10T03:33:30.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.319+0000 7fde1effd700 1 -- 172.21.15.45:0/380007485 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde10011a80 con 0x7fde2007ac10 2024-05-10T03:33:30.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.320+0000 7fde26466700 1 -- 172.21.15.45:0/380007485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde2007ac10 msgr2=0x7fde2010c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:30.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.320+0000 7fde26466700 1 --2- 172.21.15.45:0/380007485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde2007ac10 0x7fde2010c440 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fde100098a0 tx=0x7fde10009bb0 comp rx=0 tx=0).stop 2024-05-10T03:33:30.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.320+0000 7fde26466700 1 -- 172.21.15.45:0/380007485 shutdown_connections 2024-05-10T03:33:30.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.320+0000 7fde26466700 1 --2- 172.21.15.45:0/380007485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde2007ac10 0x7fde2010c440 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:30.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.320+0000 7fde26466700 1 -- 172.21.15.45:0/380007485 >> 172.21.15.45:0/380007485 conn(0x7fde20101a30 msgr2=0x7fde20103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:30.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.320+0000 7fde26466700 1 -- 172.21.15.45:0/380007485 shutdown_connections 2024-05-10T03:33:30.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.320+0000 7fde26466700 1 -- 172.21.15.45:0/380007485 wait complete. 2024-05-10T03:33:30.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.321+0000 7fde26466700 1 Processor -- start 2024-05-10T03:33:30.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.321+0000 7fde26466700 1 -- start start 2024-05-10T03:33:30.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.321+0000 7fde26466700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde2007ac10 0x7fde2019d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:30.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.321+0000 7fde26466700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2019dc60 con 0x7fde2007ac10 2024-05-10T03:33:30.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.321+0000 7fde1ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde2007ac10 0x7fde2019d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:30.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.321+0000 7fde1ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde2007ac10 0x7fde2019d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34894/0 (socket says 172.21.15.45:34894) 2024-05-10T03:33:30.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.321+0000 7fde1ffff700 1 -- 172.21.15.45:0/1730591414 learned_addr learned my addr 172.21.15.45:0/1730591414 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:30.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.322+0000 7fde1ffff700 1 -- 172.21.15.45:0/1730591414 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde10009550 con 0x7fde2007ac10 2024-05-10T03:33:30.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.322+0000 7fde1ffff700 1 --2- 172.21.15.45:0/1730591414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde2007ac10 0x7fde2019d720 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fde10011a30 tx=0x7fde10011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:30.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.322+0000 7fde1d7fa700 1 -- 172.21.15.45:0/1730591414 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde100039c0 con 0x7fde2007ac10 2024-05-10T03:33:30.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.322+0000 7fde1d7fa700 1 -- 172.21.15.45:0/1730591414 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fde10003b20 con 0x7fde2007ac10 2024-05-10T03:33:30.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.322+0000 7fde1d7fa700 1 -- 172.21.15.45:0/1730591414 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde10024630 con 0x7fde2007ac10 2024-05-10T03:33:30.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.322+0000 7fde26466700 1 -- 172.21.15.45:0/1730591414 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde2019de60 con 0x7fde2007ac10 2024-05-10T03:33:30.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.322+0000 7fde26466700 1 -- 172.21.15.45:0/1730591414 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde2019e300 con 0x7fde2007ac10 2024-05-10T03:33:30.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.323+0000 7fde1d7fa700 1 -- 172.21.15.45:0/1730591414 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7fde1002d3f0 con 0x7fde2007ac10 2024-05-10T03:33:30.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.323+0000 7fde26466700 1 -- 172.21.15.45:0/1730591414 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde2010d8e0 con 0x7fde2007ac10 2024-05-10T03:33:30.180 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.323+0000 7fde1d7fa700 1 --2- 172.21.15.45:0/1730591414 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fde08038860 0x7fde0803ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:30.180 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.324+0000 7fde1d7fa700 1 -- 172.21.15.45:0/1730591414 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fde1004c770 con 0x7fde2007ac10 2024-05-10T03:33:30.180 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.324+0000 7fde1f7fe700 1 --2- 172.21.15.45:0/1730591414 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fde08038860 0x7fde0803ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:30.180 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.324+0000 7fde1f7fe700 1 --2- 172.21.15.45:0/1730591414 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fde08038860 0x7fde0803ad70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fde14006fd0 tx=0x7fde14006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:30.180 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.329+0000 7fde1d7fa700 1 -- 172.21.15.45:0/1730591414 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fde10010bd0 con 0x7fde2007ac10 2024-05-10T03:33:30.180 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.556+0000 7fde26466700 1 -- 172.21.15.45:0/1730591414 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fde2010daf0 con 0x7fde08038860 2024-05-10T03:33:30.180 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.809+0000 7fde1d7fa700 1 -- 172.21.15.45:0/1730591414 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fde2010daf0 con 0x7fde08038860 2024-05-10T03:33:30.180 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.812+0000 7fde26466700 1 -- 172.21.15.45:0/1730591414 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fde08038860 msgr2=0x7fde0803ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:30.180 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.812+0000 7fde26466700 1 --2- 172.21.15.45:0/1730591414 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fde08038860 0x7fde0803ad70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fde14006fd0 tx=0x7fde14006e40 comp rx=0 tx=0).stop 2024-05-10T03:33:30.180 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.812+0000 7fde26466700 1 -- 172.21.15.45:0/1730591414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde2007ac10 msgr2=0x7fde2019d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:30.180 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.812+0000 7fde26466700 1 --2- 172.21.15.45:0/1730591414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde2007ac10 0x7fde2019d720 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fde10011a30 tx=0x7fde10011b10 comp rx=0 tx=0).stop 2024-05-10T03:33:30.180 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.812+0000 7fde26466700 1 -- 172.21.15.45:0/1730591414 shutdown_connections 2024-05-10T03:33:30.180 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.812+0000 7fde26466700 1 --2- 172.21.15.45:0/1730591414 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fde08038860 0x7fde0803ad70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:30.180 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.812+0000 7fde26466700 1 --2- 172.21.15.45:0/1730591414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde2007ac10 0x7fde2019d720 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:30.181 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.812+0000 7fde26466700 1 -- 172.21.15.45:0/1730591414 >> 172.21.15.45:0/1730591414 conn(0x7fde20101a30 msgr2=0x7fde20102260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:30.181 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.812+0000 7fde26466700 1 -- 172.21.15.45:0/1730591414 shutdown_connections 2024-05-10T03:33:30.181 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:29.812+0000 7fde26466700 1 -- 172.21.15.45:0/1730591414 wait complete. 2024-05-10T03:33:30.181 INFO:teuthology.orchestra.run.smithi045.stdout:Fetching dashboard port number... 2024-05-10T03:33:31.123 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:30 smithi045 ceph-mon[42520]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:33:31.123 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:30 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:31.176 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 8443 2024-05-10T03:33:31.176 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.589+0000 7f5cd03bc700 1 Processor -- start 2024-05-10T03:33:31.176 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.590+0000 7f5cd03bc700 1 -- start start 2024-05-10T03:33:31.176 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.590+0000 7f5cd03bc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cc807ac10 0x7f5cc810c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:31.176 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.590+0000 7f5cd03bc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc8107ef0 con 0x7f5cc807ac10 2024-05-10T03:33:31.176 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.590+0000 7f5cce158700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cc807ac10 0x7f5cc810c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:31.176 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.590+0000 7f5cce158700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cc807ac10 0x7f5cc810c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34906/0 (socket says 172.21.15.45:34906) 2024-05-10T03:33:31.176 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.590+0000 7f5cce158700 1 -- 172.21.15.45:0/2550419455 learned_addr learned my addr 172.21.15.45:0/2550419455 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:31.176 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.591+0000 7f5cce158700 1 -- 172.21.15.45:0/2550419455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc810c9b0 con 0x7f5cc807ac10 2024-05-10T03:33:31.176 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.591+0000 7f5cce158700 1 --2- 172.21.15.45:0/2550419455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cc807ac10 0x7f5cc810c470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5cc40098a0 tx=0x7f5cc4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52bc9090e87d5861 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:31.176 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.591+0000 7f5ccd156700 1 -- 172.21.15.45:0/2550419455 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cc4004160 con 0x7f5cc807ac10 2024-05-10T03:33:31.176 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.591+0000 7f5ccd156700 1 -- 172.21.15.45:0/2550419455 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5cc40042c0 con 0x7f5cc807ac10 2024-05-10T03:33:31.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.591+0000 7f5ccd156700 1 -- 172.21.15.45:0/2550419455 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cc4011a80 con 0x7f5cc807ac10 2024-05-10T03:33:31.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.592+0000 7f5cd03bc700 1 -- 172.21.15.45:0/2550419455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cc807ac10 msgr2=0x7f5cc810c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:31.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.592+0000 7f5cd03bc700 1 --2- 172.21.15.45:0/2550419455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cc807ac10 0x7f5cc810c470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5cc40098a0 tx=0x7f5cc4009bb0 comp rx=0 tx=0).stop 2024-05-10T03:33:31.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.592+0000 7f5cd03bc700 1 -- 172.21.15.45:0/2550419455 shutdown_connections 2024-05-10T03:33:31.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.592+0000 7f5cd03bc700 1 --2- 172.21.15.45:0/2550419455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cc807ac10 0x7f5cc810c470 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:31.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.592+0000 7f5cd03bc700 1 -- 172.21.15.45:0/2550419455 >> 172.21.15.45:0/2550419455 conn(0x7f5cc8101a60 msgr2=0x7f5cc8103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:31.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.592+0000 7f5cd03bc700 1 -- 172.21.15.45:0/2550419455 shutdown_connections 2024-05-10T03:33:31.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.592+0000 7f5cd03bc700 1 -- 172.21.15.45:0/2550419455 wait complete. 2024-05-10T03:33:31.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.593+0000 7f5cd03bc700 1 Processor -- start 2024-05-10T03:33:31.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.593+0000 7f5cd03bc700 1 -- start start 2024-05-10T03:33:31.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.593+0000 7f5cd03bc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cc807ac10 0x7f5cc819d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:31.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.593+0000 7f5cd03bc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc819dc90 con 0x7f5cc807ac10 2024-05-10T03:33:31.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.593+0000 7f5cce158700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cc807ac10 0x7f5cc819d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:31.177 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.593+0000 7f5cce158700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cc807ac10 0x7f5cc819d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34912/0 (socket says 172.21.15.45:34912) 2024-05-10T03:33:31.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.593+0000 7f5cce158700 1 -- 172.21.15.45:0/1769223547 learned_addr learned my addr 172.21.15.45:0/1769223547 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:31.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.593+0000 7f5cce158700 1 -- 172.21.15.45:0/1769223547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc4009550 con 0x7f5cc807ac10 2024-05-10T03:33:31.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.593+0000 7f5cce158700 1 --2- 172.21.15.45:0/1769223547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cc807ac10 0x7f5cc819d750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4009fb0 tx=0x7f5cc4011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:31.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.594+0000 7f5cbf7fe700 1 -- 172.21.15.45:0/1769223547 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cc40038b0 con 0x7f5cc807ac10 2024-05-10T03:33:31.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.594+0000 7f5cbf7fe700 1 -- 172.21.15.45:0/1769223547 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5cc4003a10 con 0x7f5cc807ac10 2024-05-10T03:33:31.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.594+0000 7f5cd03bc700 1 -- 172.21.15.45:0/1769223547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc819de90 con 0x7f5cc807ac10 2024-05-10T03:33:31.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.594+0000 7f5cbf7fe700 1 -- 172.21.15.45:0/1769223547 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cc40195e0 con 0x7f5cc807ac10 2024-05-10T03:33:31.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.594+0000 7f5cd03bc700 1 -- 172.21.15.45:0/1769223547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc819e330 con 0x7f5cc807ac10 2024-05-10T03:33:31.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.595+0000 7f5cbf7fe700 1 -- 172.21.15.45:0/1769223547 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f5cc40198a0 con 0x7f5cc807ac10 2024-05-10T03:33:31.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.595+0000 7f5cbf7fe700 1 --2- 172.21.15.45:0/1769223547 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f5cb40387c0 0x7f5cb403acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:31.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.595+0000 7f5cbf7fe700 1 -- 172.21.15.45:0/1769223547 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5cc404c9e0 con 0x7f5cc807ac10 2024-05-10T03:33:31.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.595+0000 7f5cd03bc700 1 -- 172.21.15.45:0/1769223547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc810d910 con 0x7f5cc807ac10 2024-05-10T03:33:31.178 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.595+0000 7f5ccd957700 1 --2- 172.21.15.45:0/1769223547 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f5cb40387c0 0x7f5cb403acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:31.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.596+0000 7f5ccd957700 1 --2- 172.21.15.45:0/1769223547 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f5cb40387c0 0x7f5cb403acd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8006fd0 tx=0x7f5cb8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:31.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.600+0000 7f5cbf7fe700 1 -- 172.21.15.45:0/1769223547 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5cc4019bf0 con 0x7f5cc807ac10 2024-05-10T03:33:31.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.814+0000 7f5cd03bc700 1 -- 172.21.15.45:0/1769223547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f5cc810db00 con 0x7f5cc807ac10 2024-05-10T03:33:31.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.815+0000 7f5cbf7fe700 1 -- 172.21.15.45:0/1769223547 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f5cc4018b40 con 0x7f5cc807ac10 2024-05-10T03:33:31.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.817+0000 7f5cd03bc700 1 -- 172.21.15.45:0/1769223547 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f5cb40387c0 msgr2=0x7f5cb403acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:31.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.817+0000 7f5cd03bc700 1 --2- 172.21.15.45:0/1769223547 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f5cb40387c0 0x7f5cb403acd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8006fd0 tx=0x7f5cb8006e40 comp rx=0 tx=0).stop 2024-05-10T03:33:31.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.817+0000 7f5cd03bc700 1 -- 172.21.15.45:0/1769223547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cc807ac10 msgr2=0x7f5cc819d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:31.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.817+0000 7f5cd03bc700 1 --2- 172.21.15.45:0/1769223547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cc807ac10 0x7f5cc819d750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4009fb0 tx=0x7f5cc4011ae0 comp rx=0 tx=0).stop 2024-05-10T03:33:31.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.817+0000 7f5cd03bc700 1 -- 172.21.15.45:0/1769223547 shutdown_connections 2024-05-10T03:33:31.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.817+0000 7f5cd03bc700 1 --2- 172.21.15.45:0/1769223547 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f5cb40387c0 0x7f5cb403acd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:31.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.817+0000 7f5cd03bc700 1 --2- 172.21.15.45:0/1769223547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cc807ac10 0x7f5cc819d750 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:31.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.817+0000 7f5cd03bc700 1 -- 172.21.15.45:0/1769223547 >> 172.21.15.45:0/1769223547 conn(0x7f5cc8101a60 msgr2=0x7f5cc8102290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:31.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.817+0000 7f5cd03bc700 1 -- 172.21.15.45:0/1769223547 shutdown_connections 2024-05-10T03:33:31.179 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:30.817+0000 7f5cd03bc700 1 -- 172.21.15.45:0/1769223547 wait complete. 2024-05-10T03:33:31.185 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-10T03:33:31.185 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout disabled 2024-05-10T03:33:31.194 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-10T03:33:31.194 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout inactive 2024-05-10T03:33:31.194 INFO:teuthology.orchestra.run.smithi045.stdout:firewalld.service is not enabled 2024-05-10T03:33:31.194 INFO:teuthology.orchestra.run.smithi045.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-10T03:33:31.196 INFO:teuthology.orchestra.run.smithi045.stdout:Ceph Dashboard is now available at: 2024-05-10T03:33:31.196 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:33:31.196 INFO:teuthology.orchestra.run.smithi045.stdout: URL: https://smithi045:8443/ 2024-05-10T03:33:31.196 INFO:teuthology.orchestra.run.smithi045.stdout: User: admin 2024-05-10T03:33:31.196 INFO:teuthology.orchestra.run.smithi045.stdout: Password: rcoxa6e3s8 2024-05-10T03:33:31.196 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:33:31.197 INFO:teuthology.orchestra.run.smithi045.stdout:Saving cluster configuration to /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/config directory 2024-05-10T03:33:31.197 INFO:teuthology.orchestra.run.smithi045.stdout:Enabling autotune for osd_memory_target 2024-05-10T03:33:32.074 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:31 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1769223547' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-10T03:33:32.155 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.584+0000 7f35d856f700 1 Processor -- start 2024-05-10T03:33:32.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.584+0000 7f35d856f700 1 -- start start 2024-05-10T03:33:32.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.584+0000 7f35d856f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35d0106400 0x7f35d0106810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:32.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.584+0000 7f35d856f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d0106e00 con 0x7f35d0106400 2024-05-10T03:33:32.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.584+0000 7f35d630b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35d0106400 0x7f35d0106810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:32.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.584+0000 7f35d630b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35d0106400 0x7f35d0106810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34918/0 (socket says 172.21.15.45:34918) 2024-05-10T03:33:32.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.584+0000 7f35d630b700 1 -- 172.21.15.45:0/3529183623 learned_addr learned my addr 172.21.15.45:0/3529183623 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:32.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.585+0000 7f35d630b700 1 -- 172.21.15.45:0/3529183623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d0107530 con 0x7f35d0106400 2024-05-10T03:33:32.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.585+0000 7f35d630b700 1 --2- 172.21.15.45:0/3529183623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35d0106400 0x7f35d0106810 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f35cc0098a0 tx=0x7f35cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56cc58a72870b68d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:32.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.585+0000 7f35d5309700 1 -- 172.21.15.45:0/3529183623 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35cc004160 con 0x7f35d0106400 2024-05-10T03:33:32.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.585+0000 7f35d5309700 1 -- 172.21.15.45:0/3529183623 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f35cc0042c0 con 0x7f35d0106400 2024-05-10T03:33:32.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.585+0000 7f35d5309700 1 -- 172.21.15.45:0/3529183623 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35cc011a80 con 0x7f35d0106400 2024-05-10T03:33:32.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.586+0000 7f35d856f700 1 -- 172.21.15.45:0/3529183623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35d0106400 msgr2=0x7f35d0106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:32.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.586+0000 7f35d856f700 1 --2- 172.21.15.45:0/3529183623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35d0106400 0x7f35d0106810 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f35cc0098a0 tx=0x7f35cc009bb0 comp rx=0 tx=0).stop 2024-05-10T03:33:32.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.586+0000 7f35d856f700 1 -- 172.21.15.45:0/3529183623 shutdown_connections 2024-05-10T03:33:32.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.586+0000 7f35d856f700 1 --2- 172.21.15.45:0/3529183623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35d0106400 0x7f35d0106810 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:32.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.586+0000 7f35d856f700 1 -- 172.21.15.45:0/3529183623 >> 172.21.15.45:0/3529183623 conn(0x7f35d0101a60 msgr2=0x7f35d0103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:32.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.586+0000 7f35d856f700 1 -- 172.21.15.45:0/3529183623 shutdown_connections 2024-05-10T03:33:32.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.586+0000 7f35d856f700 1 -- 172.21.15.45:0/3529183623 wait complete. 2024-05-10T03:33:32.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.587+0000 7f35d856f700 1 Processor -- start 2024-05-10T03:33:32.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.587+0000 7f35d856f700 1 -- start start 2024-05-10T03:33:32.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.587+0000 7f35d856f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35d0106400 0x7f35d0103bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:32.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.587+0000 7f35d856f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d0104100 con 0x7f35d0106400 2024-05-10T03:33:32.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.587+0000 7f35d630b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35d0106400 0x7f35d0103bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:32.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.587+0000 7f35d630b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35d0106400 0x7f35d0103bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34932/0 (socket says 172.21.15.45:34932) 2024-05-10T03:33:32.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.587+0000 7f35d630b700 1 -- 172.21.15.45:0/1335100711 learned_addr learned my addr 172.21.15.45:0/1335100711 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:32.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.588+0000 7f35d630b700 1 -- 172.21.15.45:0/1335100711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc009550 con 0x7f35d0106400 2024-05-10T03:33:32.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.588+0000 7f35d630b700 1 --2- 172.21.15.45:0/1335100711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35d0106400 0x7f35d0103bc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f35cc011a50 tx=0x7f35cc011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:32.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.588+0000 7f35c77fe700 1 -- 172.21.15.45:0/1335100711 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35cc003aa0 con 0x7f35d0106400 2024-05-10T03:33:32.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.588+0000 7f35c77fe700 1 -- 172.21.15.45:0/1335100711 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f35cc003c00 con 0x7f35d0106400 2024-05-10T03:33:32.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.588+0000 7f35d856f700 1 -- 172.21.15.45:0/1335100711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d0102350 con 0x7f35d0106400 2024-05-10T03:33:32.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.588+0000 7f35c77fe700 1 -- 172.21.15.45:0/1335100711 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35cc0247d0 con 0x7f35d0106400 2024-05-10T03:33:32.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.588+0000 7f35d856f700 1 -- 172.21.15.45:0/1335100711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d01027f0 con 0x7f35d0106400 2024-05-10T03:33:32.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.589+0000 7f35c77fe700 1 -- 172.21.15.45:0/1335100711 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f35cc02d3f0 con 0x7f35d0106400 2024-05-10T03:33:32.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.589+0000 7f35c77fe700 1 --2- 172.21.15.45:0/1335100711 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f35bc038860 0x7f35bc03ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:32.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.589+0000 7f35d856f700 1 -- 172.21.15.45:0/1335100711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d0103200 con 0x7f35d0106400 2024-05-10T03:33:32.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.589+0000 7f35c77fe700 1 -- 172.21.15.45:0/1335100711 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f35cc04cab0 con 0x7f35d0106400 2024-05-10T03:33:32.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.589+0000 7f35d5b0a700 1 --2- 172.21.15.45:0/1335100711 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f35bc038860 0x7f35bc03ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:32.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.590+0000 7f35d5b0a700 1 --2- 172.21.15.45:0/1335100711 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f35bc038860 0x7f35bc03ad70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f35c0006fd0 tx=0x7f35c0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:32.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.595+0000 7f35c77fe700 1 -- 172.21.15.45:0/1335100711 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f35cc02d740 con 0x7f35d0106400 2024-05-10T03:33:32.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.810+0000 7f35d856f700 1 -- 172.21.15.45:0/1335100711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f35d010aa10 con 0x7f35d0106400 2024-05-10T03:33:32.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.811+0000 7f35c77fe700 1 -- 172.21.15.45:0/1335100711 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f35cc0107f0 con 0x7f35d0106400 2024-05-10T03:33:32.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.813+0000 7f35d856f700 1 -- 172.21.15.45:0/1335100711 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f35bc038860 msgr2=0x7f35bc03ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:32.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.813+0000 7f35d856f700 1 --2- 172.21.15.45:0/1335100711 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f35bc038860 0x7f35bc03ad70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f35c0006fd0 tx=0x7f35c0006e40 comp rx=0 tx=0).stop 2024-05-10T03:33:32.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.813+0000 7f35d856f700 1 -- 172.21.15.45:0/1335100711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35d0106400 msgr2=0x7f35d0103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:32.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.813+0000 7f35d856f700 1 --2- 172.21.15.45:0/1335100711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35d0106400 0x7f35d0103bc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f35cc011a50 tx=0x7f35cc011b30 comp rx=0 tx=0).stop 2024-05-10T03:33:32.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.813+0000 7f35d856f700 1 -- 172.21.15.45:0/1335100711 shutdown_connections 2024-05-10T03:33:32.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.813+0000 7f35d856f700 1 --2- 172.21.15.45:0/1335100711 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f35bc038860 0x7f35bc03ad70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:32.164 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.813+0000 7f35d856f700 1 --2- 172.21.15.45:0/1335100711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35d0106400 0x7f35d0103bc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:32.164 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.813+0000 7f35d856f700 1 -- 172.21.15.45:0/1335100711 >> 172.21.15.45:0/1335100711 conn(0x7f35d0101a60 msgr2=0x7f35d0191d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:32.164 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.813+0000 7f35d856f700 1 -- 172.21.15.45:0/1335100711 shutdown_connections 2024-05-10T03:33:32.164 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:31.813+0000 7f35d856f700 1 -- 172.21.15.45:0/1335100711 wait complete. 2024-05-10T03:33:33.235 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.545+0000 7f1a8c1c3700 1 Processor -- start 2024-05-10T03:33:33.235 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.545+0000 7f1a8c1c3700 1 -- start start 2024-05-10T03:33:33.235 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.546+0000 7f1a8c1c3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a841063d0 0x7f1a841067e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:33.235 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.546+0000 7f1a8c1c3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a84106dd0 con 0x7f1a841063d0 2024-05-10T03:33:33.235 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.546+0000 7f1a89f5f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a841063d0 0x7f1a841067e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:33.236 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.546+0000 7f1a89f5f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a841063d0 0x7f1a841067e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34936/0 (socket says 172.21.15.45:34936) 2024-05-10T03:33:33.236 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.546+0000 7f1a89f5f700 1 -- 172.21.15.45:0/2123317643 learned_addr learned my addr 172.21.15.45:0/2123317643 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:33.236 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.546+0000 7f1a89f5f700 1 -- 172.21.15.45:0/2123317643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a84107500 con 0x7f1a841063d0 2024-05-10T03:33:33.236 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.546+0000 7f1a89f5f700 1 --2- 172.21.15.45:0/2123317643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a841063d0 0x7f1a841067e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1a740098a0 tx=0x7f1a74009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe4fa52fc4ba2ea server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:33.236 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.546+0000 7f1a88f5d700 1 -- 172.21.15.45:0/2123317643 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a74004160 con 0x7f1a841063d0 2024-05-10T03:33:33.236 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.547+0000 7f1a88f5d700 1 -- 172.21.15.45:0/2123317643 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1a740042c0 con 0x7f1a841063d0 2024-05-10T03:33:33.236 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.547+0000 7f1a88f5d700 1 -- 172.21.15.45:0/2123317643 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a74011a80 con 0x7f1a841063d0 2024-05-10T03:33:33.236 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.547+0000 7f1a8c1c3700 1 -- 172.21.15.45:0/2123317643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a841063d0 msgr2=0x7f1a841067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:33.236 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.547+0000 7f1a8c1c3700 1 --2- 172.21.15.45:0/2123317643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a841063d0 0x7f1a841067e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1a740098a0 tx=0x7f1a74009bb0 comp rx=0 tx=0).stop 2024-05-10T03:33:33.236 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.547+0000 7f1a8c1c3700 1 -- 172.21.15.45:0/2123317643 shutdown_connections 2024-05-10T03:33:33.236 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.547+0000 7f1a8c1c3700 1 --2- 172.21.15.45:0/2123317643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a841063d0 0x7f1a841067e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:33.236 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.547+0000 7f1a8c1c3700 1 -- 172.21.15.45:0/2123317643 >> 172.21.15.45:0/2123317643 conn(0x7f1a84101a30 msgr2=0x7f1a84103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:33.236 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.548+0000 7f1a8c1c3700 1 -- 172.21.15.45:0/2123317643 shutdown_connections 2024-05-10T03:33:33.236 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.548+0000 7f1a8c1c3700 1 -- 172.21.15.45:0/2123317643 wait complete. 2024-05-10T03:33:33.237 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.548+0000 7f1a8c1c3700 1 Processor -- start 2024-05-10T03:33:33.237 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.549+0000 7f1a8c1c3700 1 -- start start 2024-05-10T03:33:33.237 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.549+0000 7f1a8c1c3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a841063d0 0x7f1a8419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:33.237 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.549+0000 7f1a8c1c3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8419a9e0 con 0x7f1a841063d0 2024-05-10T03:33:33.237 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.549+0000 7f1a89f5f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a841063d0 0x7f1a8419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:33.237 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.549+0000 7f1a89f5f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a841063d0 0x7f1a8419a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34940/0 (socket says 172.21.15.45:34940) 2024-05-10T03:33:33.237 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.549+0000 7f1a89f5f700 1 -- 172.21.15.45:0/3161474496 learned_addr learned my addr 172.21.15.45:0/3161474496 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:33.237 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.549+0000 7f1a89f5f700 1 -- 172.21.15.45:0/3161474496 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a74009550 con 0x7f1a841063d0 2024-05-10T03:33:33.237 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.550+0000 7f1a89f5f700 1 --2- 172.21.15.45:0/3161474496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a841063d0 0x7f1a8419a4a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1a74009fb0 tx=0x7f1a74011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:33.238 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.550+0000 7f1a7affd700 1 -- 172.21.15.45:0/3161474496 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a74003970 con 0x7f1a841063d0 2024-05-10T03:33:33.238 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.550+0000 7f1a7affd700 1 -- 172.21.15.45:0/3161474496 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1a74003ad0 con 0x7f1a841063d0 2024-05-10T03:33:33.238 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.550+0000 7f1a8c1c3700 1 -- 172.21.15.45:0/3161474496 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8419abe0 con 0x7f1a841063d0 2024-05-10T03:33:33.238 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.550+0000 7f1a7affd700 1 -- 172.21.15.45:0/3161474496 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a7401a650 con 0x7f1a841063d0 2024-05-10T03:33:33.238 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.550+0000 7f1a8c1c3700 1 -- 172.21.15.45:0/3161474496 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8419b080 con 0x7f1a841063d0 2024-05-10T03:33:33.238 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.551+0000 7f1a7affd700 1 -- 172.21.15.45:0/3161474496 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f1a74024a20 con 0x7f1a841063d0 2024-05-10T03:33:33.238 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.551+0000 7f1a8c1c3700 1 -- 172.21.15.45:0/3161474496 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8410a730 con 0x7f1a841063d0 2024-05-10T03:33:33.238 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.551+0000 7f1a7affd700 1 --2- 172.21.15.45:0/3161474496 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1a700387c0 0x7f1a7003acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:33.238 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.551+0000 7f1a7affd700 1 -- 172.21.15.45:0/3161474496 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1a7404c850 con 0x7f1a841063d0 2024-05-10T03:33:33.238 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.552+0000 7f1a8975e700 1 --2- 172.21.15.45:0/3161474496 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1a700387c0 0x7f1a7003acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:33.238 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.552+0000 7f1a8975e700 1 --2- 172.21.15.45:0/3161474496 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1a700387c0 0x7f1a7003acd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1a80006fd0 tx=0x7f1a80006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:33.238 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.557+0000 7f1a7affd700 1 -- 172.21.15.45:0/3161474496 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1a740189a0 con 0x7f1a841063d0 2024-05-10T03:33:33.238 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.811+0000 7f1a7affd700 1 -- 172.21.15.45:0/3161474496 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f1a7402d910 con 0x7f1a841063d0 2024-05-10T03:33:33.239 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.887+0000 7f1a8c1c3700 1 -- 172.21.15.45:0/3161474496 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f1a8410a970 con 0x7f1a841063d0 2024-05-10T03:33:33.239 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.890+0000 7f1a7affd700 1 -- 172.21.15.45:0/3161474496 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f1a74018b80 con 0x7f1a841063d0 2024-05-10T03:33:33.239 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.892+0000 7f1a8c1c3700 1 -- 172.21.15.45:0/3161474496 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1a700387c0 msgr2=0x7f1a7003acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:33.239 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.892+0000 7f1a8c1c3700 1 --2- 172.21.15.45:0/3161474496 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1a700387c0 0x7f1a7003acd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1a80006fd0 tx=0x7f1a80006e40 comp rx=0 tx=0).stop 2024-05-10T03:33:33.239 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.892+0000 7f1a8c1c3700 1 -- 172.21.15.45:0/3161474496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a841063d0 msgr2=0x7f1a8419a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:33.239 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.892+0000 7f1a8c1c3700 1 --2- 172.21.15.45:0/3161474496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a841063d0 0x7f1a8419a4a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1a74009fb0 tx=0x7f1a74011b00 comp rx=0 tx=0).stop 2024-05-10T03:33:33.239 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.893+0000 7f1a8c1c3700 1 -- 172.21.15.45:0/3161474496 shutdown_connections 2024-05-10T03:33:33.239 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.893+0000 7f1a8c1c3700 1 --2- 172.21.15.45:0/3161474496 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1a700387c0 0x7f1a7003acd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:33.239 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.893+0000 7f1a8c1c3700 1 --2- 172.21.15.45:0/3161474496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a841063d0 0x7f1a8419a4a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:33.239 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.893+0000 7f1a8c1c3700 1 -- 172.21.15.45:0/3161474496 >> 172.21.15.45:0/3161474496 conn(0x7f1a84101a30 msgr2=0x7f1a841022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:33.239 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.893+0000 7f1a8c1c3700 1 -- 172.21.15.45:0/3161474496 shutdown_connections 2024-05-10T03:33:33.239 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-05-10T03:33:32.893+0000 7f1a8c1c3700 1 -- 172.21.15.45:0/3161474496 wait complete. 2024-05-10T03:33:33.239 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-05-10T03:33:33.240 INFO:teuthology.orchestra.run.smithi045.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-10T03:33:33.240 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:33:33.240 INFO:teuthology.orchestra.run.smithi045.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-10T03:33:33.240 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:33:33.240 INFO:teuthology.orchestra.run.smithi045.stdout:Or, if you are only running a single cluster on this host: 2024-05-10T03:33:33.240 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:33:33.240 INFO:teuthology.orchestra.run.smithi045.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-10T03:33:33.240 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:33:33.240 INFO:teuthology.orchestra.run.smithi045.stdout:Please consider enabling telemetry to help improve Ceph: 2024-05-10T03:33:33.240 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:33:33.240 INFO:teuthology.orchestra.run.smithi045.stdout: ceph telemetry on 2024-05-10T03:33:33.240 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:33:33.240 INFO:teuthology.orchestra.run.smithi045.stdout:For more information see: 2024-05-10T03:33:33.240 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:33:33.240 INFO:teuthology.orchestra.run.smithi045.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-05-10T03:33:33.241 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:33:33.241 INFO:teuthology.orchestra.run.smithi045.stdout:Bootstrap complete. 2024-05-10T03:33:33.279 INFO:tasks.cephadm:Fetching config... 2024-05-10T03:33:33.280 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-10T03:33:33.280 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-10T03:33:33.300 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-10T03:33:33.300 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-10T03:33:33.300 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-10T03:33:33.360 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-10T03:33:33.360 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-10T03:33:33.360 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/keyring of=/dev/stdout 2024-05-10T03:33:33.435 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-10T03:33:33.436 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-10T03:33:33.436 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-10T03:33:33.496 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-10T03:33:33.497 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfyzPWKT6S3e4YdioutXBYLIT9gpLQpDRlZR/UGXcMPVdYP3VSXH0Jp0QnYfxZXBglSchmlq8exGwCJT0VtQqVO50vhYLYNp/LCyVyBfB1BuR5O65buYf996u4C+D8tbcA2/JcH/6uUXQzDbl4Xf9KhXswmdE60FQsUrlivDOGotFKKVqODcwOxLYp4XVY/z3ywFyumLCL8cvz/zEIxaP9x1e00p4xZc+0FThBt4JLXYMVkJ+QJ+CgKqFy9enG406/Y2an3eRV5ko2Q87m2ZxGKzFdM/jjeJbpECZbscn5qIu6UHTpv4AoP6jhR5OPp80NNwQRMrk2dREnmA1dMMB9A969heJbLGqjimn5OIz2gInvH6aTZl+jvH6Kb13Y7UYXf0qUhP+nes7hY4IKCM1KXmBFcy0kDW9OHg8ezDzqbNtj+NaD+vSulz7iVujk84AiwMiNYm2KvbzuF9V2VOUq8nOlwoxqZ67+ZtrDx7+ZQveLfPV2Otp6Mspd9FnZT58= ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-10T03:33:33.583 INFO:teuthology.orchestra.run.smithi045.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfyzPWKT6S3e4YdioutXBYLIT9gpLQpDRlZR/UGXcMPVdYP3VSXH0Jp0QnYfxZXBglSchmlq8exGwCJT0VtQqVO50vhYLYNp/LCyVyBfB1BuR5O65buYf996u4C+D8tbcA2/JcH/6uUXQzDbl4Xf9KhXswmdE60FQsUrlivDOGotFKKVqODcwOxLYp4XVY/z3ywFyumLCL8cvz/zEIxaP9x1e00p4xZc+0FThBt4JLXYMVkJ+QJ+CgKqFy9enG406/Y2an3eRV5ko2Q87m2ZxGKzFdM/jjeJbpECZbscn5qIu6UHTpv4AoP6jhR5OPp80NNwQRMrk2dREnmA1dMMB9A969heJbLGqjimn5OIz2gInvH6aTZl+jvH6Kb13Y7UYXf0qUhP+nes7hY4IKCM1KXmBFcy0kDW9OHg8ezDzqbNtj+NaD+vSulz7iVujk84AiwMiNYm2KvbzuF9V2VOUq8nOlwoxqZ67+ZtrDx7+ZQveLfPV2Otp6Mspd9FnZT58= ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968 2024-05-10T03:33:33.597 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfyzPWKT6S3e4YdioutXBYLIT9gpLQpDRlZR/UGXcMPVdYP3VSXH0Jp0QnYfxZXBglSchmlq8exGwCJT0VtQqVO50vhYLYNp/LCyVyBfB1BuR5O65buYf996u4C+D8tbcA2/JcH/6uUXQzDbl4Xf9KhXswmdE60FQsUrlivDOGotFKKVqODcwOxLYp4XVY/z3ywFyumLCL8cvz/zEIxaP9x1e00p4xZc+0FThBt4JLXYMVkJ+QJ+CgKqFy9enG406/Y2an3eRV5ko2Q87m2ZxGKzFdM/jjeJbpECZbscn5qIu6UHTpv4AoP6jhR5OPp80NNwQRMrk2dREnmA1dMMB9A969heJbLGqjimn5OIz2gInvH6aTZl+jvH6Kb13Y7UYXf0qUhP+nes7hY4IKCM1KXmBFcy0kDW9OHg8ezDzqbNtj+NaD+vSulz7iVujk84AiwMiNYm2KvbzuF9V2VOUq8nOlwoxqZ67+ZtrDx7+ZQveLfPV2Otp6Mspd9FnZT58= ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-10T03:33:33.643 INFO:teuthology.orchestra.run.smithi106.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfyzPWKT6S3e4YdioutXBYLIT9gpLQpDRlZR/UGXcMPVdYP3VSXH0Jp0QnYfxZXBglSchmlq8exGwCJT0VtQqVO50vhYLYNp/LCyVyBfB1BuR5O65buYf996u4C+D8tbcA2/JcH/6uUXQzDbl4Xf9KhXswmdE60FQsUrlivDOGotFKKVqODcwOxLYp4XVY/z3ywFyumLCL8cvz/zEIxaP9x1e00p4xZc+0FThBt4JLXYMVkJ+QJ+CgKqFy9enG406/Y2an3eRV5ko2Q87m2ZxGKzFdM/jjeJbpECZbscn5qIu6UHTpv4AoP6jhR5OPp80NNwQRMrk2dREnmA1dMMB9A969heJbLGqjimn5OIz2gInvH6aTZl+jvH6Kb13Y7UYXf0qUhP+nes7hY4IKCM1KXmBFcy0kDW9OHg8ezDzqbNtj+NaD+vSulz7iVujk84AiwMiNYm2KvbzuF9V2VOUq8nOlwoxqZ67+ZtrDx7+ZQveLfPV2Otp6Mspd9FnZT58= ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968 2024-05-10T03:33:33.656 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfyzPWKT6S3e4YdioutXBYLIT9gpLQpDRlZR/UGXcMPVdYP3VSXH0Jp0QnYfxZXBglSchmlq8exGwCJT0VtQqVO50vhYLYNp/LCyVyBfB1BuR5O65buYf996u4C+D8tbcA2/JcH/6uUXQzDbl4Xf9KhXswmdE60FQsUrlivDOGotFKKVqODcwOxLYp4XVY/z3ywFyumLCL8cvz/zEIxaP9x1e00p4xZc+0FThBt4JLXYMVkJ+QJ+CgKqFy9enG406/Y2an3eRV5ko2Q87m2ZxGKzFdM/jjeJbpECZbscn5qIu6UHTpv4AoP6jhR5OPp80NNwQRMrk2dREnmA1dMMB9A969heJbLGqjimn5OIz2gInvH6aTZl+jvH6Kb13Y7UYXf0qUhP+nes7hY4IKCM1KXmBFcy0kDW9OHg8ezDzqbNtj+NaD+vSulz7iVujk84AiwMiNYm2KvbzuF9V2VOUq8nOlwoxqZ67+ZtrDx7+ZQveLfPV2Otp6Mspd9FnZT58= ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-10T03:33:33.700 INFO:teuthology.orchestra.run.smithi154.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfyzPWKT6S3e4YdioutXBYLIT9gpLQpDRlZR/UGXcMPVdYP3VSXH0Jp0QnYfxZXBglSchmlq8exGwCJT0VtQqVO50vhYLYNp/LCyVyBfB1BuR5O65buYf996u4C+D8tbcA2/JcH/6uUXQzDbl4Xf9KhXswmdE60FQsUrlivDOGotFKKVqODcwOxLYp4XVY/z3ywFyumLCL8cvz/zEIxaP9x1e00p4xZc+0FThBt4JLXYMVkJ+QJ+CgKqFy9enG406/Y2an3eRV5ko2Q87m2ZxGKzFdM/jjeJbpECZbscn5qIu6UHTpv4AoP6jhR5OPp80NNwQRMrk2dREnmA1dMMB9A969heJbLGqjimn5OIz2gInvH6aTZl+jvH6Kb13Y7UYXf0qUhP+nes7hY4IKCM1KXmBFcy0kDW9OHg8ezDzqbNtj+NaD+vSulz7iVujk84AiwMiNYm2KvbzuF9V2VOUq8nOlwoxqZ67+ZtrDx7+ZQveLfPV2Otp6Mspd9FnZT58= ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968 2024-05-10T03:33:33.713 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-10T03:33:33.960 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:33:34.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:33 smithi045 ceph-mon[42520]: mgrmap e13: x(active, since 7s) 2024-05-10T03:33:34.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:33 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3161474496' entity='client.admin' 2024-05-10T03:33:35.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.231+0000 7f2dd6d58700 1 -- 172.21.15.45:0/579499032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd0075170 msgr2=0x7f2dd00735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:35.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.231+0000 7f2dd6d58700 1 --2- 172.21.15.45:0/579499032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd0075170 0x7f2dd00735a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4009910 tx=0x7f2dc4009c20 comp rx=0 tx=0).stop 2024-05-10T03:33:35.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.231+0000 7f2dd6d58700 1 -- 172.21.15.45:0/579499032 shutdown_connections 2024-05-10T03:33:35.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.231+0000 7f2dd6d58700 1 --2- 172.21.15.45:0/579499032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd0075170 0x7f2dd00735a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:35.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.231+0000 7f2dd6d58700 1 -- 172.21.15.45:0/579499032 >> 172.21.15.45:0/579499032 conn(0x7f2dd00fcbb0 msgr2=0x7f2dd00ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:35.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.231+0000 7f2dd6d58700 1 -- 172.21.15.45:0/579499032 shutdown_connections 2024-05-10T03:33:35.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.231+0000 7f2dd6d58700 1 -- 172.21.15.45:0/579499032 wait complete. 2024-05-10T03:33:35.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.232+0000 7f2dd6d58700 1 Processor -- start 2024-05-10T03:33:35.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.232+0000 7f2dd6d58700 1 -- start start 2024-05-10T03:33:35.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.233+0000 7f2dd6d58700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd0075170 0x7f2dd0199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:35.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.233+0000 7f2dd6d58700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd0199690 con 0x7f2dd0075170 2024-05-10T03:33:35.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.233+0000 7f2dd4af4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd0075170 0x7f2dd0199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:35.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.233+0000 7f2dd4af4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd0075170 0x7f2dd0199150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34948/0 (socket says 172.21.15.45:34948) 2024-05-10T03:33:35.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.233+0000 7f2dd4af4700 1 -- 172.21.15.45:0/3083125443 learned_addr learned my addr 172.21.15.45:0/3083125443 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:35.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.233+0000 7f2dd4af4700 1 -- 172.21.15.45:0/3083125443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc40095f0 con 0x7f2dd0075170 2024-05-10T03:33:35.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.233+0000 7f2dd4af4700 1 --2- 172.21.15.45:0/3083125443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd0075170 0x7f2dd0199150 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4004e90 tx=0x7f2dc4004f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:35.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.234+0000 7f2dcdffb700 1 -- 172.21.15.45:0/3083125443 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2dc401d070 con 0x7f2dd0075170 2024-05-10T03:33:35.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.234+0000 7f2dcdffb700 1 -- 172.21.15.45:0/3083125443 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2dc4022470 con 0x7f2dd0075170 2024-05-10T03:33:35.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.234+0000 7f2dd6d58700 1 -- 172.21.15.45:0/3083125443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd0199890 con 0x7f2dd0075170 2024-05-10T03:33:35.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.234+0000 7f2dcdffb700 1 -- 172.21.15.45:0/3083125443 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2dc400f5f0 con 0x7f2dd0075170 2024-05-10T03:33:35.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.234+0000 7f2dd6d58700 1 -- 172.21.15.45:0/3083125443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd0199d30 con 0x7f2dd0075170 2024-05-10T03:33:35.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.235+0000 7f2dcdffb700 1 -- 172.21.15.45:0/3083125443 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f2dc400f8b0 con 0x7f2dd0075170 2024-05-10T03:33:35.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.235+0000 7f2dd6d58700 1 -- 172.21.15.45:0/3083125443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd0192620 con 0x7f2dd0075170 2024-05-10T03:33:35.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.235+0000 7f2dcdffb700 1 --2- 172.21.15.45:0/3083125443 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2dc00387a0 0x7f2dc003acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:35.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.235+0000 7f2dcdffb700 1 -- 172.21.15.45:0/3083125443 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2dc404c980 con 0x7f2dd0075170 2024-05-10T03:33:35.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.236+0000 7f2dcffff700 1 --2- 172.21.15.45:0/3083125443 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2dc00387a0 0x7f2dc003acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:35.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.236+0000 7f2dcffff700 1 --2- 172.21.15.45:0/3083125443 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2dc00387a0 0x7f2dc003acb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc006fd0 tx=0x7f2dbc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:35.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.241+0000 7f2dcdffb700 1 -- 172.21.15.45:0/3083125443 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2dc4017490 con 0x7f2dd0075170 2024-05-10T03:33:35.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.458+0000 7f2dd6d58700 1 -- 172.21.15.45:0/3083125443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f2dd0062840 con 0x7f2dd0075170 2024-05-10T03:33:35.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.462+0000 7f2dcdffb700 1 -- 172.21.15.45:0/3083125443 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f2dc4027070 con 0x7f2dd0075170 2024-05-10T03:33:35.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.465+0000 7f2dd6d58700 1 -- 172.21.15.45:0/3083125443 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2dc00387a0 msgr2=0x7f2dc003acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:35.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.465+0000 7f2dd6d58700 1 --2- 172.21.15.45:0/3083125443 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2dc00387a0 0x7f2dc003acb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc006fd0 tx=0x7f2dbc006e40 comp rx=0 tx=0).stop 2024-05-10T03:33:35.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.465+0000 7f2dd6d58700 1 -- 172.21.15.45:0/3083125443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd0075170 msgr2=0x7f2dd0199150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:35.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.465+0000 7f2dd6d58700 1 --2- 172.21.15.45:0/3083125443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd0075170 0x7f2dd0199150 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4004e90 tx=0x7f2dc4004f70 comp rx=0 tx=0).stop 2024-05-10T03:33:35.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.465+0000 7f2dd6d58700 1 -- 172.21.15.45:0/3083125443 shutdown_connections 2024-05-10T03:33:35.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.465+0000 7f2dd6d58700 1 --2- 172.21.15.45:0/3083125443 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2dc00387a0 0x7f2dc003acb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:35.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.465+0000 7f2dd6d58700 1 --2- 172.21.15.45:0/3083125443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd0075170 0x7f2dd0199150 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:35.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.465+0000 7f2dd6d58700 1 -- 172.21.15.45:0/3083125443 >> 172.21.15.45:0/3083125443 conn(0x7f2dd00fcbb0 msgr2=0x7f2dd00fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:35.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.465+0000 7f2dd6d58700 1 -- 172.21.15.45:0/3083125443 shutdown_connections 2024-05-10T03:33:35.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:35.465+0000 7f2dd6d58700 1 -- 172.21.15.45:0/3083125443 wait complete. 2024-05-10T03:33:35.881 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-10T03:33:35.881 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-10T03:33:36.166 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:33:36.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:36 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3083125443' entity='client.admin' 2024-05-10T03:33:37.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.419+0000 7f1882abb700 1 -- 172.21.15.45:0/2823995646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f187c100450 msgr2=0x7f187c100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:37.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.419+0000 7f1882abb700 1 --2- 172.21.15.45:0/2823995646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f187c100450 0x7f187c100860 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1870009910 tx=0x7f1870009c20 comp rx=0 tx=0).stop 2024-05-10T03:33:37.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.419+0000 7f1882abb700 1 -- 172.21.15.45:0/2823995646 shutdown_connections 2024-05-10T03:33:37.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.419+0000 7f1882abb700 1 --2- 172.21.15.45:0/2823995646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f187c100450 0x7f187c100860 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:37.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.419+0000 7f1882abb700 1 -- 172.21.15.45:0/2823995646 >> 172.21.15.45:0/2823995646 conn(0x7f187c0fba70 msgr2=0x7f187c0fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:37.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.419+0000 7f1882abb700 1 -- 172.21.15.45:0/2823995646 shutdown_connections 2024-05-10T03:33:37.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.419+0000 7f1882abb700 1 -- 172.21.15.45:0/2823995646 wait complete. 2024-05-10T03:33:37.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.420+0000 7f1882abb700 1 Processor -- start 2024-05-10T03:33:37.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.420+0000 7f1882abb700 1 -- start start 2024-05-10T03:33:37.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.420+0000 7f1882abb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f187c100450 0x7f187c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:37.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.420+0000 7f1882abb700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187c06a2f0 con 0x7f187c100450 2024-05-10T03:33:37.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.420+0000 7f1880857700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f187c100450 0x7f187c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:37.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.420+0000 7f1880857700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f187c100450 0x7f187c069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46302/0 (socket says 172.21.15.45:46302) 2024-05-10T03:33:37.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.420+0000 7f1880857700 1 -- 172.21.15.45:0/3519985906 learned_addr learned my addr 172.21.15.45:0/3519985906 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:37.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.421+0000 7f1880857700 1 -- 172.21.15.45:0/3519985906 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18700095f0 con 0x7f187c100450 2024-05-10T03:33:37.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.421+0000 7f1880857700 1 --2- 172.21.15.45:0/3519985906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f187c100450 0x7f187c069db0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1870005850 tx=0x7f1870004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:37.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.421+0000 7f1879ffb700 1 -- 172.21.15.45:0/3519985906 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f187001d070 con 0x7f187c100450 2024-05-10T03:33:37.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.421+0000 7f1879ffb700 1 -- 172.21.15.45:0/3519985906 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f187000bc30 con 0x7f187c100450 2024-05-10T03:33:37.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.421+0000 7f1882abb700 1 -- 172.21.15.45:0/3519985906 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187c199fe0 con 0x7f187c100450 2024-05-10T03:33:37.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.421+0000 7f1879ffb700 1 -- 172.21.15.45:0/3519985906 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18700039f0 con 0x7f187c100450 2024-05-10T03:33:37.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.421+0000 7f1882abb700 1 -- 172.21.15.45:0/3519985906 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187c19a3c0 con 0x7f187c100450 2024-05-10T03:33:37.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.422+0000 7f1879ffb700 1 -- 172.21.15.45:0/3519985906 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f1870003c60 con 0x7f187c100450 2024-05-10T03:33:37.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.422+0000 7f1882abb700 1 -- 172.21.15.45:0/3519985906 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f187c062840 con 0x7f187c100450 2024-05-10T03:33:37.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.422+0000 7f1879ffb700 1 --2- 172.21.15.45:0/3519985906 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f186c0387f0 0x7f186c03ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:37.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.423+0000 7f1879ffb700 1 -- 172.21.15.45:0/3519985906 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f187004c4f0 con 0x7f187c100450 2024-05-10T03:33:37.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.423+0000 7f187bfff700 1 --2- 172.21.15.45:0/3519985906 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f186c0387f0 0x7f186c03ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:37.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.423+0000 7f187bfff700 1 --2- 172.21.15.45:0/3519985906 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f186c0387f0 0x7f186c03ad00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1868006fd0 tx=0x7f1868006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:37.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.428+0000 7f1879ffb700 1 -- 172.21.15.45:0/3519985906 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f187002aba0 con 0x7f187c100450 2024-05-10T03:33:37.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.646+0000 7f1882abb700 1 -- 172.21.15.45:0/3519985906 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f187c0fd810 con 0x7f186c0387f0 2024-05-10T03:33:37.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.650+0000 7f1879ffb700 1 -- 172.21.15.45:0/3519985906 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f187c0fd810 con 0x7f186c0387f0 2024-05-10T03:33:37.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.652+0000 7f1882abb700 1 -- 172.21.15.45:0/3519985906 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f186c0387f0 msgr2=0x7f186c03ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:37.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.652+0000 7f1882abb700 1 --2- 172.21.15.45:0/3519985906 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f186c0387f0 0x7f186c03ad00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1868006fd0 tx=0x7f1868006e40 comp rx=0 tx=0).stop 2024-05-10T03:33:37.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.652+0000 7f1882abb700 1 -- 172.21.15.45:0/3519985906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f187c100450 msgr2=0x7f187c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:37.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.652+0000 7f1882abb700 1 --2- 172.21.15.45:0/3519985906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f187c100450 0x7f187c069db0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1870005850 tx=0x7f1870004ff0 comp rx=0 tx=0).stop 2024-05-10T03:33:37.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.652+0000 7f1882abb700 1 -- 172.21.15.45:0/3519985906 shutdown_connections 2024-05-10T03:33:37.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.652+0000 7f1882abb700 1 --2- 172.21.15.45:0/3519985906 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f186c0387f0 0x7f186c03ad00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:37.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.652+0000 7f1882abb700 1 --2- 172.21.15.45:0/3519985906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f187c100450 0x7f187c069db0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:37.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.652+0000 7f1882abb700 1 -- 172.21.15.45:0/3519985906 >> 172.21.15.45:0/3519985906 conn(0x7f187c0fba70 msgr2=0x7f187c0fd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:37.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.652+0000 7f1882abb700 1 -- 172.21.15.45:0/3519985906 shutdown_connections 2024-05-10T03:33:37.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:37.652+0000 7f1882abb700 1 -- 172.21.15.45:0/3519985906 wait complete. 2024-05-10T03:33:37.990 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:37 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:37.990 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:37 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:37.990 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:37 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi045", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:33:37.990 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:37 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:37.990 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:37 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:33:37.990 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:37 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:37.990 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:37 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:37.990 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:37 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:33:37.991 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:37 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:33:37.991 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:37 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:33:38.078 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi106 2024-05-10T03:33:38.078 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T03:33:38.078 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/etc/ceph/ceph.conf 2024-05-10T03:33:38.099 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T03:33:38.099 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-10T03:33:38.159 INFO:tasks.cephadm:Adding host smithi106 to orchestrator... 2024-05-10T03:33:38.159 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph orch host add smithi106 2024-05-10T03:33:38.415 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:33:39.241 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:38 smithi045 ceph-mon[42520]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:33:39.241 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:38 smithi045 ceph-mon[42520]: Updating smithi045:/etc/ceph/ceph.conf 2024-05-10T03:33:39.241 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:38 smithi045 ceph-mon[42520]: Updating smithi045:/var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T03:33:39.241 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:38 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:39.241 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:38 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:39.242 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:38 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:39.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.448+0000 7f6897438700 1 -- 172.21.15.45:0/2984101174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6890107580 msgr2=0x7f6890107990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:39.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.448+0000 7f6897438700 1 --2- 172.21.15.45:0/2984101174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6890107580 0x7f6890107990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f688c009910 tx=0x7f688c009c20 comp rx=0 tx=0).stop 2024-05-10T03:33:39.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.448+0000 7f6897438700 1 -- 172.21.15.45:0/2984101174 shutdown_connections 2024-05-10T03:33:39.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.448+0000 7f6897438700 1 --2- 172.21.15.45:0/2984101174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6890107580 0x7f6890107990 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:39.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.448+0000 7f6897438700 1 -- 172.21.15.45:0/2984101174 >> 172.21.15.45:0/2984101174 conn(0x7f68900fcfa0 msgr2=0x7f68900ff3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:39.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.448+0000 7f6897438700 1 -- 172.21.15.45:0/2984101174 shutdown_connections 2024-05-10T03:33:39.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.448+0000 7f6897438700 1 -- 172.21.15.45:0/2984101174 wait complete. 2024-05-10T03:33:39.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.449+0000 7f6897438700 1 Processor -- start 2024-05-10T03:33:39.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.449+0000 7f6897438700 1 -- start start 2024-05-10T03:33:39.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.450+0000 7f6897438700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6890107580 0x7f68901970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:39.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.450+0000 7f6897438700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6890197620 con 0x7f6890107580 2024-05-10T03:33:39.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.450+0000 7f68951d4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6890107580 0x7f68901970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:39.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.450+0000 7f68951d4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6890107580 0x7f68901970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46320/0 (socket says 172.21.15.45:46320) 2024-05-10T03:33:39.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.450+0000 7f68951d4700 1 -- 172.21.15.45:0/3765848069 learned_addr learned my addr 172.21.15.45:0/3765848069 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:39.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.450+0000 7f68951d4700 1 -- 172.21.15.45:0/3765848069 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688c0095f0 con 0x7f6890107580 2024-05-10T03:33:39.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.450+0000 7f68951d4700 1 --2- 172.21.15.45:0/3765848069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6890107580 0x7f68901970e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f688c0092e0 tx=0x7f688c004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:39.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.451+0000 7f68867fc700 1 -- 172.21.15.45:0/3765848069 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f688c01d070 con 0x7f6890107580 2024-05-10T03:33:39.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.451+0000 7f6897438700 1 -- 172.21.15.45:0/3765848069 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6890197880 con 0x7f6890107580 2024-05-10T03:33:39.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.451+0000 7f68867fc700 1 -- 172.21.15.45:0/3765848069 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f688c00b750 con 0x7f6890107580 2024-05-10T03:33:39.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.451+0000 7f68867fc700 1 -- 172.21.15.45:0/3765848069 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f688c0038a0 con 0x7f6890107580 2024-05-10T03:33:39.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.451+0000 7f6897438700 1 -- 172.21.15.45:0/3765848069 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6890197d80 con 0x7f6890107580 2024-05-10T03:33:39.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.452+0000 7f68867fc700 1 -- 172.21.15.45:0/3765848069 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f688c003b60 con 0x7f6890107580 2024-05-10T03:33:39.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.452+0000 7f6897438700 1 -- 172.21.15.45:0/3765848069 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6890102bc0 con 0x7f6890107580 2024-05-10T03:33:39.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.452+0000 7f68867fc700 1 --2- 172.21.15.45:0/3765848069 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f687c0387a0 0x7f687c03acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:39.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.452+0000 7f68867fc700 1 -- 172.21.15.45:0/3765848069 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f688c04c1b0 con 0x7f6890107580 2024-05-10T03:33:39.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.452+0000 7f68949d3700 1 --2- 172.21.15.45:0/3765848069 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f687c0387a0 0x7f687c03acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:39.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.453+0000 7f68949d3700 1 --2- 172.21.15.45:0/3765848069 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f687c0387a0 0x7f687c03acb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6880006fd0 tx=0x7f6880006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:39.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.457+0000 7f68867fc700 1 -- 172.21.15.45:0/3765848069 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f688c029360 con 0x7f6890107580 2024-05-10T03:33:39.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:39.673+0000 7f6897438700 1 -- 172.21.15.45:0/3765848069 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi106", "target": ["mon-mgr", ""]}) v1 -- 0x7f68901080a0 con 0x7f687c0387a0 2024-05-10T03:33:40.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:39 smithi045 ceph-mon[42520]: Updating smithi045:/etc/ceph/ceph.client.admin.keyring 2024-05-10T03:33:40.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:39 smithi045 ceph-mon[42520]: Updating smithi045:/var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-10T03:33:41.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:40 smithi045 ceph-mon[42520]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi106", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:33:41.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:41.934+0000 7f68867fc700 1 -- 172.21.15.45:0/3765848069 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f68901080a0 con 0x7f687c0387a0 2024-05-10T03:33:41.938 INFO:teuthology.orchestra.run.smithi045.stdout:Added host 'smithi106' with addr '172.21.15.106' 2024-05-10T03:33:41.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:41.937+0000 7f6897438700 1 -- 172.21.15.45:0/3765848069 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f687c0387a0 msgr2=0x7f687c03acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:41.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:41.937+0000 7f6897438700 1 --2- 172.21.15.45:0/3765848069 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f687c0387a0 0x7f687c03acb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6880006fd0 tx=0x7f6880006e40 comp rx=0 tx=0).stop 2024-05-10T03:33:41.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:41.937+0000 7f6897438700 1 -- 172.21.15.45:0/3765848069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6890107580 msgr2=0x7f68901970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:41.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:41.937+0000 7f6897438700 1 --2- 172.21.15.45:0/3765848069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6890107580 0x7f68901970e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f688c0092e0 tx=0x7f688c004ff0 comp rx=0 tx=0).stop 2024-05-10T03:33:41.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:41.937+0000 7f6897438700 1 -- 172.21.15.45:0/3765848069 shutdown_connections 2024-05-10T03:33:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:41.937+0000 7f6897438700 1 --2- 172.21.15.45:0/3765848069 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f687c0387a0 0x7f687c03acb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:41.937+0000 7f6897438700 1 --2- 172.21.15.45:0/3765848069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6890107580 0x7f68901970e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:41.937+0000 7f6897438700 1 -- 172.21.15.45:0/3765848069 >> 172.21.15.45:0/3765848069 conn(0x7f68900fcfa0 msgr2=0x7f68900fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:41.938+0000 7f6897438700 1 -- 172.21.15.45:0/3765848069 shutdown_connections 2024-05-10T03:33:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:41.938+0000 7f6897438700 1 -- 172.21.15.45:0/3765848069 wait complete. 2024-05-10T03:33:42.279 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:41 smithi045 ceph-mon[42520]: Deploying cephadm binary to smithi106 2024-05-10T03:33:42.338 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph orch host ls --format=json 2024-05-10T03:33:42.588 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:33:43.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:42 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:43.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:42 smithi045 ceph-mon[42520]: Added host smithi106 2024-05-10T03:33:43.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:42 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:33:43.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:42 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:43.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:42 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:43.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.635+0000 7f6d47b69700 1 -- 172.21.15.45:0/2777275288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d401005f0 msgr2=0x7f6d40100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:43.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.635+0000 7f6d47b69700 1 --2- 172.21.15.45:0/2777275288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d401005f0 0x7f6d40100a00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00b0a0 tx=0x7f6d3c00b3b0 comp rx=0 tx=0).stop 2024-05-10T03:33:43.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.635+0000 7f6d47b69700 1 -- 172.21.15.45:0/2777275288 shutdown_connections 2024-05-10T03:33:43.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.635+0000 7f6d47b69700 1 --2- 172.21.15.45:0/2777275288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d401005f0 0x7f6d40100a00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:43.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.635+0000 7f6d47b69700 1 -- 172.21.15.45:0/2777275288 >> 172.21.15.45:0/2777275288 conn(0x7f6d400fbfe0 msgr2=0x7f6d400fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:43.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.635+0000 7f6d47b69700 1 -- 172.21.15.45:0/2777275288 shutdown_connections 2024-05-10T03:33:43.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.635+0000 7f6d47b69700 1 -- 172.21.15.45:0/2777275288 wait complete. 2024-05-10T03:33:43.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.636+0000 7f6d47b69700 1 Processor -- start 2024-05-10T03:33:43.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.636+0000 7f6d47b69700 1 -- start start 2024-05-10T03:33:43.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.636+0000 7f6d47b69700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d401005f0 0x7f6d401970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:43.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.636+0000 7f6d47b69700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d40197620 con 0x7f6d401005f0 2024-05-10T03:33:43.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.636+0000 7f6d45905700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d401005f0 0x7f6d401970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:43.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.636+0000 7f6d45905700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d401005f0 0x7f6d401970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46338/0 (socket says 172.21.15.45:46338) 2024-05-10T03:33:43.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.636+0000 7f6d45905700 1 -- 172.21.15.45:0/3321572517 learned_addr learned my addr 172.21.15.45:0/3321572517 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:43.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.637+0000 7f6d45905700 1 -- 172.21.15.45:0/3321572517 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c009d00 con 0x7f6d401005f0 2024-05-10T03:33:43.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.637+0000 7f6d45905700 1 --2- 172.21.15.45:0/3321572517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d401005f0 0x7f6d401970e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00b830 tx=0x7f6d3c00bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:43.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.637+0000 7f6d36ffd700 1 -- 172.21.15.45:0/3321572517 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d3c00e040 con 0x7f6d401005f0 2024-05-10T03:33:43.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.637+0000 7f6d36ffd700 1 -- 172.21.15.45:0/3321572517 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6d3c0096a0 con 0x7f6d401005f0 2024-05-10T03:33:43.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.637+0000 7f6d47b69700 1 -- 172.21.15.45:0/3321572517 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d40197820 con 0x7f6d401005f0 2024-05-10T03:33:43.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.637+0000 7f6d36ffd700 1 -- 172.21.15.45:0/3321572517 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d3c01d5e0 con 0x7f6d401005f0 2024-05-10T03:33:43.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.637+0000 7f6d47b69700 1 -- 172.21.15.45:0/3321572517 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d40197ca0 con 0x7f6d401005f0 2024-05-10T03:33:43.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.638+0000 7f6d36ffd700 1 -- 172.21.15.45:0/3321572517 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f6d3c019070 con 0x7f6d401005f0 2024-05-10T03:33:43.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.638+0000 7f6d47b69700 1 -- 172.21.15.45:0/3321572517 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d40101aa0 con 0x7f6d401005f0 2024-05-10T03:33:43.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.638+0000 7f6d36ffd700 1 --2- 172.21.15.45:0/3321572517 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6d2c0387f0 0x7f6d2c03ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:43.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.639+0000 7f6d36ffd700 1 -- 172.21.15.45:0/3321572517 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6d3c04c950 con 0x7f6d401005f0 2024-05-10T03:33:43.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.639+0000 7f6d45104700 1 --2- 172.21.15.45:0/3321572517 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6d2c0387f0 0x7f6d2c03ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:43.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.639+0000 7f6d45104700 1 --2- 172.21.15.45:0/3321572517 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6d2c0387f0 0x7f6d2c03ad00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6d30006fd0 tx=0x7f6d30006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:43.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.644+0000 7f6d36ffd700 1 -- 172.21.15.45:0/3321572517 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6d3c026e00 con 0x7f6d401005f0 2024-05-10T03:33:43.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.863+0000 7f6d47b69700 1 -- 172.21.15.45:0/3321572517 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6d4010a840 con 0x7f6d2c0387f0 2024-05-10T03:33:43.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.864+0000 7f6d36ffd700 1 -- 172.21.15.45:0/3321572517 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f6d4010a840 con 0x7f6d2c0387f0 2024-05-10T03:33:43.867 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:33:43.867 INFO:teuthology.orchestra.run.smithi045.stdout:[{"addr": "172.21.15.45", "hostname": "smithi045", "labels": [], "status": ""}, {"addr": "172.21.15.106", "hostname": "smithi106", "labels": [], "status": ""}] 2024-05-10T03:33:43.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.867+0000 7f6d47b69700 1 -- 172.21.15.45:0/3321572517 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6d2c0387f0 msgr2=0x7f6d2c03ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:43.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.867+0000 7f6d47b69700 1 --2- 172.21.15.45:0/3321572517 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6d2c0387f0 0x7f6d2c03ad00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6d30006fd0 tx=0x7f6d30006e40 comp rx=0 tx=0).stop 2024-05-10T03:33:43.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.867+0000 7f6d47b69700 1 -- 172.21.15.45:0/3321572517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d401005f0 msgr2=0x7f6d401970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:43.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.867+0000 7f6d47b69700 1 --2- 172.21.15.45:0/3321572517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d401005f0 0x7f6d401970e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00b830 tx=0x7f6d3c00bd40 comp rx=0 tx=0).stop 2024-05-10T03:33:43.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.867+0000 7f6d47b69700 1 -- 172.21.15.45:0/3321572517 shutdown_connections 2024-05-10T03:33:43.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.867+0000 7f6d47b69700 1 --2- 172.21.15.45:0/3321572517 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6d2c0387f0 0x7f6d2c03ad00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:43.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.867+0000 7f6d47b69700 1 --2- 172.21.15.45:0/3321572517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d401005f0 0x7f6d401970e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:43.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.867+0000 7f6d47b69700 1 -- 172.21.15.45:0/3321572517 >> 172.21.15.45:0/3321572517 conn(0x7f6d400fbfe0 msgr2=0x7f6d40068600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:43.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.867+0000 7f6d47b69700 1 -- 172.21.15.45:0/3321572517 shutdown_connections 2024-05-10T03:33:43.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:43.867+0000 7f6d47b69700 1 -- 172.21.15.45:0/3321572517 wait complete. 2024-05-10T03:33:44.299 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi154 2024-05-10T03:33:44.299 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-10T03:33:44.299 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/etc/ceph/ceph.conf 2024-05-10T03:33:44.320 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-10T03:33:44.320 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-10T03:33:44.380 INFO:tasks.cephadm:Adding host smithi154 to orchestrator... 2024-05-10T03:33:44.380 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph orch host add smithi154 2024-05-10T03:33:44.417 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:44 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:44.417 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:44 smithi045 ceph-mon[42520]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T03:33:44.632 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:33:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.645+0000 7fd6f11f7700 1 -- 172.21.15.45:0/2006928559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6ec1005f0 msgr2=0x7fd6ec100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.645+0000 7fd6f11f7700 1 --2- 172.21.15.45:0/2006928559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6ec1005f0 0x7fd6ec100a00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009910 tx=0x7fd6dc009c20 comp rx=0 tx=0).stop 2024-05-10T03:33:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.645+0000 7fd6f11f7700 1 -- 172.21.15.45:0/2006928559 shutdown_connections 2024-05-10T03:33:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.645+0000 7fd6f11f7700 1 --2- 172.21.15.45:0/2006928559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6ec1005f0 0x7fd6ec100a00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.645+0000 7fd6f11f7700 1 -- 172.21.15.45:0/2006928559 >> 172.21.15.45:0/2006928559 conn(0x7fd6ec0fbfe0 msgr2=0x7fd6ec0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:45.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.645+0000 7fd6f11f7700 1 -- 172.21.15.45:0/2006928559 shutdown_connections 2024-05-10T03:33:45.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.645+0000 7fd6f11f7700 1 -- 172.21.15.45:0/2006928559 wait complete. 2024-05-10T03:33:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.646+0000 7fd6f11f7700 1 Processor -- start 2024-05-10T03:33:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.646+0000 7fd6f11f7700 1 -- start start 2024-05-10T03:33:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.647+0000 7fd6f11f7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6ec1005f0 0x7fd6ec1061f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.647+0000 7fd6f11f7700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec1080b0 con 0x7fd6ec1005f0 2024-05-10T03:33:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.647+0000 7fd6ead9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6ec1005f0 0x7fd6ec1061f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.647+0000 7fd6ead9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6ec1005f0 0x7fd6ec1061f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46356/0 (socket says 172.21.15.45:46356) 2024-05-10T03:33:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.647+0000 7fd6ead9d700 1 -- 172.21.15.45:0/1910305963 learned_addr learned my addr 172.21.15.45:0/1910305963 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.647+0000 7fd6ead9d700 1 -- 172.21.15.45:0/1910305963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc0095f0 con 0x7fd6ec1005f0 2024-05-10T03:33:45.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.647+0000 7fd6ead9d700 1 --2- 172.21.15.45:0/1910305963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6ec1005f0 0x7fd6ec1061f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc004f40 tx=0x7fd6dc005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.648+0000 7fd6d3fff700 1 -- 172.21.15.45:0/1910305963 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6dc01d070 con 0x7fd6ec1005f0 2024-05-10T03:33:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.648+0000 7fd6f11f7700 1 -- 172.21.15.45:0/1910305963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ec106730 con 0x7fd6ec1005f0 2024-05-10T03:33:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.648+0000 7fd6d3fff700 1 -- 172.21.15.45:0/1910305963 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd6dc00bbd0 con 0x7fd6ec1005f0 2024-05-10T03:33:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.648+0000 7fd6d3fff700 1 -- 172.21.15.45:0/1910305963 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6dc0038a0 con 0x7fd6ec1005f0 2024-05-10T03:33:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.648+0000 7fd6f11f7700 1 -- 172.21.15.45:0/1910305963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ec106bb0 con 0x7fd6ec1005f0 2024-05-10T03:33:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.649+0000 7fd6d3fff700 1 -- 172.21.15.45:0/1910305963 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fd6dc003b60 con 0x7fd6ec1005f0 2024-05-10T03:33:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.649+0000 7fd6f11f7700 1 -- 172.21.15.45:0/1910305963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ec101aa0 con 0x7fd6ec1005f0 2024-05-10T03:33:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.649+0000 7fd6d3fff700 1 --2- 172.21.15.45:0/1910305963 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd6d40387a0 0x7fd6d403acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.649+0000 7fd6d3fff700 1 -- 172.21.15.45:0/1910305963 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd6dc04c550 con 0x7fd6ec1005f0 2024-05-10T03:33:45.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.649+0000 7fd6ea59c700 1 --2- 172.21.15.45:0/1910305963 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd6d40387a0 0x7fd6d403acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:45.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.649+0000 7fd6ea59c700 1 --2- 172.21.15.45:0/1910305963 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd6d40387a0 0x7fd6d403acb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0006fd0 tx=0x7fd6e0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:45.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.654+0000 7fd6d3fff700 1 -- 172.21.15.45:0/1910305963 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd6dc029950 con 0x7fd6ec1005f0 2024-05-10T03:33:45.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:45.875+0000 7fd6f11f7700 1 -- 172.21.15.45:0/1910305963 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi154", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6ec106df0 con 0x7fd6d40387a0 2024-05-10T03:33:47.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:46 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:47.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:46 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:47.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:46 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:47.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:46 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:47.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:46 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi106", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:33:47.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:46 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:33:47.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:46 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:33:47.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:46 smithi045 ceph-mon[42520]: Updating smithi106:/etc/ceph/ceph.conf 2024-05-10T03:33:47.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:46 smithi045 ceph-mon[42520]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:33:47.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:46 smithi045 ceph-mon[42520]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi154", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:33:47.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:46 smithi045 ceph-mon[42520]: Updating smithi106:/var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T03:33:48.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:47 smithi045 ceph-mon[42520]: Updating smithi106:/etc/ceph/ceph.client.admin.keyring 2024-05-10T03:33:48.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:47 smithi045 ceph-mon[42520]: Deploying cephadm binary to smithi154 2024-05-10T03:33:48.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:47 smithi045 ceph-mon[42520]: Updating smithi106:/var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-10T03:33:48.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:47 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:48.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:47 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:48.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:47 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:48.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:48.133+0000 7fd6d3fff700 1 -- 172.21.15.45:0/1910305963 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fd6ec106df0 con 0x7fd6d40387a0 2024-05-10T03:33:48.138 INFO:teuthology.orchestra.run.smithi045.stdout:Added host 'smithi154' with addr '172.21.15.154' 2024-05-10T03:33:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:48.136+0000 7fd6f11f7700 1 -- 172.21.15.45:0/1910305963 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd6d40387a0 msgr2=0x7fd6d403acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:48.136+0000 7fd6f11f7700 1 --2- 172.21.15.45:0/1910305963 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd6d40387a0 0x7fd6d403acb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0006fd0 tx=0x7fd6e0006e40 comp rx=0 tx=0).stop 2024-05-10T03:33:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:48.136+0000 7fd6f11f7700 1 -- 172.21.15.45:0/1910305963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6ec1005f0 msgr2=0x7fd6ec1061f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:48.136+0000 7fd6f11f7700 1 --2- 172.21.15.45:0/1910305963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6ec1005f0 0x7fd6ec1061f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc004f40 tx=0x7fd6dc005020 comp rx=0 tx=0).stop 2024-05-10T03:33:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:48.137+0000 7fd6f11f7700 1 -- 172.21.15.45:0/1910305963 shutdown_connections 2024-05-10T03:33:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:48.137+0000 7fd6f11f7700 1 --2- 172.21.15.45:0/1910305963 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd6d40387a0 0x7fd6d403acb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:48.137+0000 7fd6f11f7700 1 --2- 172.21.15.45:0/1910305963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6ec1005f0 0x7fd6ec1061f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:48.137+0000 7fd6f11f7700 1 -- 172.21.15.45:0/1910305963 >> 172.21.15.45:0/1910305963 conn(0x7fd6ec0fbfe0 msgr2=0x7fd6ec068600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:48.137+0000 7fd6f11f7700 1 -- 172.21.15.45:0/1910305963 shutdown_connections 2024-05-10T03:33:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:48.137+0000 7fd6f11f7700 1 -- 172.21.15.45:0/1910305963 wait complete. 2024-05-10T03:33:48.547 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph orch host ls --format=json 2024-05-10T03:33:48.850 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:33:49.010 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:48 smithi045 ceph-mon[42520]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:33:49.010 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:48 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:49.010 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:48 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:33:49.010 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:48 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:49.010 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:48 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:49.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.900+0000 7f2bf6230700 1 -- 172.21.15.45:0/2218897617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf01005f0 msgr2=0x7f2bf0100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:49.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.900+0000 7f2bf6230700 1 --2- 172.21.15.45:0/2218897617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf01005f0 0x7f2bf0100a00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2be0009910 tx=0x7f2be0009c20 comp rx=0 tx=0).stop 2024-05-10T03:33:49.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.900+0000 7f2bf6230700 1 -- 172.21.15.45:0/2218897617 shutdown_connections 2024-05-10T03:33:49.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.900+0000 7f2bf6230700 1 --2- 172.21.15.45:0/2218897617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf01005f0 0x7f2bf0100a00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:49.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.900+0000 7f2bf6230700 1 -- 172.21.15.45:0/2218897617 >> 172.21.15.45:0/2218897617 conn(0x7f2bf00fbfe0 msgr2=0x7f2bf00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:49.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.900+0000 7f2bf6230700 1 -- 172.21.15.45:0/2218897617 shutdown_connections 2024-05-10T03:33:49.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.900+0000 7f2bf6230700 1 -- 172.21.15.45:0/2218897617 wait complete. 2024-05-10T03:33:49.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.901+0000 7f2bf6230700 1 Processor -- start 2024-05-10T03:33:49.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.901+0000 7f2bf6230700 1 -- start start 2024-05-10T03:33:49.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.901+0000 7f2bf6230700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf01005f0 0x7f2bf01061f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:49.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.901+0000 7f2bf6230700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf0108060 con 0x7f2bf01005f0 2024-05-10T03:33:49.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.901+0000 7f2bef7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf01005f0 0x7f2bf01061f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:49.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.902+0000 7f2bef7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf01005f0 0x7f2bf01061f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48012/0 (socket says 172.21.15.45:48012) 2024-05-10T03:33:49.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.902+0000 7f2bef7fe700 1 -- 172.21.15.45:0/499508839 learned_addr learned my addr 172.21.15.45:0/499508839 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:49.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.902+0000 7f2bef7fe700 1 -- 172.21.15.45:0/499508839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be00095f0 con 0x7f2bf01005f0 2024-05-10T03:33:49.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.902+0000 7f2bef7fe700 1 --2- 172.21.15.45:0/499508839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf01005f0 0x7f2bf01061f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2be0006010 tx=0x7f2be0004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:49.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.902+0000 7f2becff9700 1 -- 172.21.15.45:0/499508839 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2be001d070 con 0x7f2bf01005f0 2024-05-10T03:33:49.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.902+0000 7f2becff9700 1 -- 172.21.15.45:0/499508839 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2be000bbd0 con 0x7f2bf01005f0 2024-05-10T03:33:49.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.902+0000 7f2becff9700 1 -- 172.21.15.45:0/499508839 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2be0003880 con 0x7f2bf01005f0 2024-05-10T03:33:49.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.902+0000 7f2bf6230700 1 -- 172.21.15.45:0/499508839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf0106730 con 0x7f2bf01005f0 2024-05-10T03:33:49.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.902+0000 7f2bf6230700 1 -- 172.21.15.45:0/499508839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf0106bb0 con 0x7f2bf01005f0 2024-05-10T03:33:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.903+0000 7f2becff9700 1 -- 172.21.15.45:0/499508839 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f2be0003ac0 con 0x7f2bf01005f0 2024-05-10T03:33:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.903+0000 7f2bf6230700 1 -- 172.21.15.45:0/499508839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf0101aa0 con 0x7f2bf01005f0 2024-05-10T03:33:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.904+0000 7f2becff9700 1 --2- 172.21.15.45:0/499508839 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2bd80387a0 0x7f2bd803acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.904+0000 7f2becff9700 1 -- 172.21.15.45:0/499508839 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2be004c4f0 con 0x7f2bf01005f0 2024-05-10T03:33:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.904+0000 7f2beeffd700 1 --2- 172.21.15.45:0/499508839 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2bd80387a0 0x7f2bd803acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.904+0000 7f2beeffd700 1 --2- 172.21.15.45:0/499508839 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2bd80387a0 0x7f2bd803acb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2be4006fd0 tx=0x7f2be4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:49.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:49.909+0000 7f2becff9700 1 -- 172.21.15.45:0/499508839 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2be0029770 con 0x7f2bf01005f0 2024-05-10T03:33:50.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:49 smithi045 ceph-mon[42520]: Added host smithi154 2024-05-10T03:33:50.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:49 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:50.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:50.127+0000 7f2bf6230700 1 -- 172.21.15.45:0/499508839 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2bf0106df0 con 0x7f2bd80387a0 2024-05-10T03:33:50.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:50.128+0000 7f2becff9700 1 -- 172.21.15.45:0/499508839 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+240 (secure 0 0 0) 0x7f2bf0106df0 con 0x7f2bd80387a0 2024-05-10T03:33:50.131 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:33:50.131 INFO:teuthology.orchestra.run.smithi045.stdout:[{"addr": "172.21.15.45", "hostname": "smithi045", "labels": [], "status": ""}, {"addr": "172.21.15.106", "hostname": "smithi106", "labels": [], "status": ""}, {"addr": "172.21.15.154", "hostname": "smithi154", "labels": [], "status": ""}] 2024-05-10T03:33:50.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:50.131+0000 7f2bf6230700 1 -- 172.21.15.45:0/499508839 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2bd80387a0 msgr2=0x7f2bd803acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:50.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:50.131+0000 7f2bf6230700 1 --2- 172.21.15.45:0/499508839 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2bd80387a0 0x7f2bd803acb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2be4006fd0 tx=0x7f2be4006e40 comp rx=0 tx=0).stop 2024-05-10T03:33:50.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:50.131+0000 7f2bf6230700 1 -- 172.21.15.45:0/499508839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf01005f0 msgr2=0x7f2bf01061f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:50.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:50.131+0000 7f2bf6230700 1 --2- 172.21.15.45:0/499508839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf01005f0 0x7f2bf01061f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2be0006010 tx=0x7f2be0004ff0 comp rx=0 tx=0).stop 2024-05-10T03:33:50.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:50.131+0000 7f2bf6230700 1 -- 172.21.15.45:0/499508839 shutdown_connections 2024-05-10T03:33:50.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:50.131+0000 7f2bf6230700 1 --2- 172.21.15.45:0/499508839 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2bd80387a0 0x7f2bd803acb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:50.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:50.131+0000 7f2bf6230700 1 --2- 172.21.15.45:0/499508839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf01005f0 0x7f2bf01061f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:50.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:50.131+0000 7f2bf6230700 1 -- 172.21.15.45:0/499508839 >> 172.21.15.45:0/499508839 conn(0x7f2bf00fbfe0 msgr2=0x7f2bf0068600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:50.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:50.131+0000 7f2bf6230700 1 -- 172.21.15.45:0/499508839 shutdown_connections 2024-05-10T03:33:50.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:50.131+0000 7f2bf6230700 1 -- 172.21.15.45:0/499508839 wait complete. 2024-05-10T03:33:50.515 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-10T03:33:50.515 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph osd crush tunables default 2024-05-10T03:33:50.766 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:33:51.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:50 smithi045 ceph-mon[42520]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:33:51.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.846+0000 7f45f5fe7700 1 -- 172.21.15.45:0/120276482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f0102630 msgr2=0x7f45f0102a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:51.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.846+0000 7f45f5fe7700 1 --2- 172.21.15.45:0/120276482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f0102630 0x7f45f0102a40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009910 tx=0x7f45e0009c20 comp rx=0 tx=0).stop 2024-05-10T03:33:51.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.846+0000 7f45f5fe7700 1 -- 172.21.15.45:0/120276482 shutdown_connections 2024-05-10T03:33:51.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.846+0000 7f45f5fe7700 1 --2- 172.21.15.45:0/120276482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f0102630 0x7f45f0102a40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:51.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.846+0000 7f45f5fe7700 1 -- 172.21.15.45:0/120276482 >> 172.21.15.45:0/120276482 conn(0x7f45f00fbfe0 msgr2=0x7f45f00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:51.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.846+0000 7f45f5fe7700 1 -- 172.21.15.45:0/120276482 shutdown_connections 2024-05-10T03:33:51.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.846+0000 7f45f5fe7700 1 -- 172.21.15.45:0/120276482 wait complete. 2024-05-10T03:33:51.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.847+0000 7f45f5fe7700 1 Processor -- start 2024-05-10T03:33:51.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.847+0000 7f45f5fe7700 1 -- start start 2024-05-10T03:33:51.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.847+0000 7f45f5fe7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f0102630 0x7f45f01971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:51.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.848+0000 7f45f5fe7700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f0197700 con 0x7f45f0102630 2024-05-10T03:33:51.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.848+0000 7f45ef7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f0102630 0x7f45f01971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:51.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.848+0000 7f45ef7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f0102630 0x7f45f01971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48026/0 (socket says 172.21.15.45:48026) 2024-05-10T03:33:51.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.848+0000 7f45ef7fe700 1 -- 172.21.15.45:0/287005217 learned_addr learned my addr 172.21.15.45:0/287005217 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:33:51.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.848+0000 7f45ef7fe700 1 -- 172.21.15.45:0/287005217 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e00095f0 con 0x7f45f0102630 2024-05-10T03:33:51.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.848+0000 7f45ef7fe700 1 --2- 172.21.15.45:0/287005217 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f0102630 0x7f45f01971c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f45e0004f40 tx=0x7f45e0005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:51.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.848+0000 7f45ecff9700 1 -- 172.21.15.45:0/287005217 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45e001d070 con 0x7f45f0102630 2024-05-10T03:33:51.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.848+0000 7f45ecff9700 1 -- 172.21.15.45:0/287005217 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f45e000bc30 con 0x7f45f0102630 2024-05-10T03:33:51.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.848+0000 7f45f5fe7700 1 -- 172.21.15.45:0/287005217 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f0197900 con 0x7f45f0102630 2024-05-10T03:33:51.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.848+0000 7f45ecff9700 1 -- 172.21.15.45:0/287005217 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45e0003970 con 0x7f45f0102630 2024-05-10T03:33:51.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.848+0000 7f45f5fe7700 1 -- 172.21.15.45:0/287005217 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f0197d20 con 0x7f45f0102630 2024-05-10T03:33:51.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.850+0000 7f45ecff9700 1 -- 172.21.15.45:0/287005217 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f45e0003be0 con 0x7f45f0102630 2024-05-10T03:33:51.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.850+0000 7f45f5fe7700 1 -- 172.21.15.45:0/287005217 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f0068e40 con 0x7f45f0102630 2024-05-10T03:33:51.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.850+0000 7f45ecff9700 1 --2- 172.21.15.45:0/287005217 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f45d80387f0 0x7f45d803ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:51.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.850+0000 7f45ecff9700 1 -- 172.21.15.45:0/287005217 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f45e004c540 con 0x7f45f0102630 2024-05-10T03:33:51.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.850+0000 7f45eeffd700 1 --2- 172.21.15.45:0/287005217 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f45d80387f0 0x7f45d803ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:51.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.851+0000 7f45eeffd700 1 --2- 172.21.15.45:0/287005217 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f45d80387f0 0x7f45d803ad00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f45e4006fd0 tx=0x7f45e4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:51.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:51.856+0000 7f45ecff9700 1 -- 172.21.15.45:0/287005217 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f45e0029950 con 0x7f45f0102630 2024-05-10T03:33:52.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:51 smithi045 ceph-mon[42520]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T03:33:52.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:52.079+0000 7f45f5fe7700 1 -- 172.21.15.45:0/287005217 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f45f010ba20 con 0x7f45f0102630 2024-05-10T03:33:52.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:52.809+0000 7f45ecff9700 1 -- 172.21.15.45:0/287005217 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f45e0026090 con 0x7f45f0102630 2024-05-10T03:33:52.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:52.812+0000 7f45f5fe7700 1 -- 172.21.15.45:0/287005217 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f45d80387f0 msgr2=0x7f45d803ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:52.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:52.812+0000 7f45f5fe7700 1 --2- 172.21.15.45:0/287005217 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f45d80387f0 0x7f45d803ad00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f45e4006fd0 tx=0x7f45e4006e40 comp rx=0 tx=0).stop 2024-05-10T03:33:52.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:52.812+0000 7f45f5fe7700 1 -- 172.21.15.45:0/287005217 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f0102630 msgr2=0x7f45f01971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:52.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:52.812+0000 7f45f5fe7700 1 --2- 172.21.15.45:0/287005217 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f0102630 0x7f45f01971c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f45e0004f40 tx=0x7f45e0005020 comp rx=0 tx=0).stop 2024-05-10T03:33:52.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:52.813+0000 7f45f5fe7700 1 -- 172.21.15.45:0/287005217 shutdown_connections 2024-05-10T03:33:52.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:52.813+0000 7f45f5fe7700 1 --2- 172.21.15.45:0/287005217 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f45d80387f0 0x7f45d803ad00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:52.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:52.813+0000 7f45f5fe7700 1 --2- 172.21.15.45:0/287005217 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45f0102630 0x7f45f01971c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:52.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:52.813+0000 7f45f5fe7700 1 -- 172.21.15.45:0/287005217 >> 172.21.15.45:0/287005217 conn(0x7f45f00fbfe0 msgr2=0x7f45f01078a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:52.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:52.813+0000 7f45f5fe7700 1 -- 172.21.15.45:0/287005217 shutdown_connections 2024-05-10T03:33:52.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:33:52.813+0000 7f45f5fe7700 1 -- 172.21.15.45:0/287005217 wait complete. 2024-05-10T03:33:52.818 INFO:teuthology.orchestra.run.smithi045.stderr:adjusted tunables profile to default 2024-05-10T03:33:53.098 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:52 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:53.099 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:52 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:53.099 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:52 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:53.099 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:52 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:53.099 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:52 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:33:53.099 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:52 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:33:53.099 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:52 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:33:53.099 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:52 smithi045 ceph-mon[42520]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:33:53.099 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:52 smithi045 ceph-mon[42520]: Updating smithi154:/etc/ceph/ceph.conf 2024-05-10T03:33:53.099 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:52 smithi045 ceph-mon[42520]: Updating smithi154:/var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T03:33:53.099 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:52 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/287005217' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-10T03:33:53.099 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:52 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:53.099 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:52 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:53.099 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:52 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:53.187 INFO:tasks.cephadm:Adding mon.a on smithi045 2024-05-10T03:33:53.187 INFO:tasks.cephadm:Adding mon.b on smithi106 2024-05-10T03:33:53.188 INFO:tasks.cephadm:Adding mon.c on smithi154 2024-05-10T03:33:53.188 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph orch apply mon '3;smithi045:172.21.15.45=a;smithi106:172.21.15.106=b;smithi154:172.21.15.154=c' 2024-05-10T03:33:53.432 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T03:33:54.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:53 smithi045 ceph-mon[42520]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-05-10T03:33:54.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:53 smithi045 ceph-mon[42520]: Updating smithi154:/var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-10T03:33:54.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:53 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/287005217' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-10T03:33:54.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:53 smithi045 ceph-mon[42520]: osdmap e4: 0 total, 0 up, 0 in 2024-05-10T03:33:54.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.471+0000 7f2590865700 1 -- 172.21.15.154:0/2030515216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f258c102670 msgr2=0x7f258c102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:54.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.471+0000 7f2590865700 1 --2- 172.21.15.154:0/2030515216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f258c102670 0x7f258c102a80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2580009910 tx=0x7f2580009c20 comp rx=0 tx=0).stop 2024-05-10T03:33:54.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.471+0000 7f2590865700 1 -- 172.21.15.154:0/2030515216 shutdown_connections 2024-05-10T03:33:54.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.471+0000 7f2590865700 1 --2- 172.21.15.154:0/2030515216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f258c102670 0x7f258c102a80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:54.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.471+0000 7f2590865700 1 -- 172.21.15.154:0/2030515216 >> 172.21.15.154:0/2030515216 conn(0x7f258c0fbec0 msgr2=0x7f258c0fe310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:54.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.471+0000 7f2590865700 1 -- 172.21.15.154:0/2030515216 shutdown_connections 2024-05-10T03:33:54.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.471+0000 7f2590865700 1 -- 172.21.15.154:0/2030515216 wait complete. 2024-05-10T03:33:54.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.472+0000 7f2590865700 1 Processor -- start 2024-05-10T03:33:54.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.472+0000 7f2590865700 1 -- start start 2024-05-10T03:33:54.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.472+0000 7f2590865700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f258c102670 0x7f258c1971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:54.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.472+0000 7f2590865700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258c1976f0 con 0x7f258c102670 2024-05-10T03:33:54.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.472+0000 7f258a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f258c102670 0x7f258c1971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:54.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.473+0000 7f258a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f258c102670 0x7f258c1971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.154:52366/0 (socket says 172.21.15.154:52366) 2024-05-10T03:33:54.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.473+0000 7f258a59c700 1 -- 172.21.15.154:0/3738299859 learned_addr learned my addr 172.21.15.154:0/3738299859 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-10T03:33:54.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.473+0000 7f258a59c700 1 -- 172.21.15.154:0/3738299859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25800095f0 con 0x7f258c102670 2024-05-10T03:33:54.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.473+0000 7f258a59c700 1 --2- 172.21.15.154:0/3738299859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f258c102670 0x7f258c1971b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2580005850 tx=0x7f2580004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:54.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.473+0000 7f257b7fe700 1 -- 172.21.15.154:0/3738299859 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f258001d070 con 0x7f258c102670 2024-05-10T03:33:54.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.473+0000 7f2590865700 1 -- 172.21.15.154:0/3738299859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f258c1978f0 con 0x7f258c102670 2024-05-10T03:33:54.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.473+0000 7f257b7fe700 1 -- 172.21.15.154:0/3738299859 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f258000bc30 con 0x7f258c102670 2024-05-10T03:33:54.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.473+0000 7f257b7fe700 1 -- 172.21.15.154:0/3738299859 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25800039e0 con 0x7f258c102670 2024-05-10T03:33:54.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.473+0000 7f2590865700 1 -- 172.21.15.154:0/3738299859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f258c197d10 con 0x7f258c102670 2024-05-10T03:33:54.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.474+0000 7f2590865700 1 -- 172.21.15.154:0/3738299859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f258c069910 con 0x7f258c102670 2024-05-10T03:33:54.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.474+0000 7f257b7fe700 1 -- 172.21.15.154:0/3738299859 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f2580003ca0 con 0x7f258c102670 2024-05-10T03:33:54.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.475+0000 7f257b7fe700 1 --2- 172.21.15.154:0/3738299859 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f25740387a0 0x7f257403acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:54.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.475+0000 7f257b7fe700 1 -- 172.21.15.154:0/3738299859 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f258004c480 con 0x7f258c102670 2024-05-10T03:33:54.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.475+0000 7f2589d9b700 1 --2- 172.21.15.154:0/3738299859 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f25740387a0 0x7f257403acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:54.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.475+0000 7f2589d9b700 1 --2- 172.21.15.154:0/3738299859 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f25740387a0 0x7f257403acb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f257c006fd0 tx=0x7f257c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:54.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.480+0000 7f257b7fe700 1 -- 172.21.15.154:0/3738299859 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2580029950 con 0x7f258c102670 2024-05-10T03:33:54.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.681+0000 7f2590865700 1 -- 172.21.15.154:0/3738299859 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi045:172.21.15.45=a;smithi106:172.21.15.106=b;smithi154:172.21.15.154=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f258c10ba70 con 0x7f25740387a0 2024-05-10T03:33:54.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.688+0000 7f257b7fe700 1 -- 172.21.15.154:0/3738299859 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f258c10ba70 con 0x7f25740387a0 2024-05-10T03:33:54.693 INFO:teuthology.orchestra.run.smithi154.stdout:Scheduled mon update... 2024-05-10T03:33:54.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.690+0000 7f2590865700 1 -- 172.21.15.154:0/3738299859 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f25740387a0 msgr2=0x7f257403acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:54.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.690+0000 7f2590865700 1 --2- 172.21.15.154:0/3738299859 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f25740387a0 0x7f257403acb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f257c006fd0 tx=0x7f257c006e40 comp rx=0 tx=0).stop 2024-05-10T03:33:54.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.690+0000 7f2590865700 1 -- 172.21.15.154:0/3738299859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f258c102670 msgr2=0x7f258c1971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:54.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.690+0000 7f2590865700 1 --2- 172.21.15.154:0/3738299859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f258c102670 0x7f258c1971b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2580005850 tx=0x7f2580004ff0 comp rx=0 tx=0).stop 2024-05-10T03:33:54.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.690+0000 7f2590865700 1 -- 172.21.15.154:0/3738299859 shutdown_connections 2024-05-10T03:33:54.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.690+0000 7f2590865700 1 --2- 172.21.15.154:0/3738299859 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f25740387a0 0x7f257403acb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:54.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.690+0000 7f2590865700 1 --2- 172.21.15.154:0/3738299859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f258c102670 0x7f258c1971b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:54.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.690+0000 7f2590865700 1 -- 172.21.15.154:0/3738299859 >> 172.21.15.154:0/3738299859 conn(0x7f258c0fbec0 msgr2=0x7f258c1033f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:54.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.690+0000 7f2590865700 1 -- 172.21.15.154:0/3738299859 shutdown_connections 2024-05-10T03:33:54.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:54.691+0000 7f2590865700 1 -- 172.21.15.154:0/3738299859 wait complete. 2024-05-10T03:33:55.080 DEBUG:teuthology.orchestra.run.smithi106:mon.b> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mon.b.service 2024-05-10T03:33:55.083 DEBUG:teuthology.orchestra.run.smithi154:mon.c> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mon.c.service 2024-05-10T03:33:55.085 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-10T03:33:55.085 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph mon dump -f json 2024-05-10T03:33:55.116 INFO:journalctl@ceph.mon.c.smithi154.stdout:-- Logs begin at Fri 2024-05-10 03:15:42 UTC. -- 2024-05-10T03:33:55.118 INFO:journalctl@ceph.mon.b.smithi106.stdout:-- Logs begin at Fri 2024-05-10 03:15:26 UTC. -- 2024-05-10T03:33:55.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:54 smithi045 ceph-mon[42520]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:33:55.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:54 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:55.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:54 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:33:55.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:54 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:33:55.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:54 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:33:55.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:54 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:55.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:54 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T03:33:55.286 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:54 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:33:55.396 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T03:33:56.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:55 smithi045 ceph-mon[42520]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi045:172.21.15.45=a;smithi106:172.21.15.106=b;smithi154:172.21.15.154=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:33:56.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:55 smithi045 ceph-mon[42520]: Saving service mon spec with placement smithi045:172.21.15.45=a;smithi106:172.21.15.106=b;smithi154:172.21.15.154=c;count:3 2024-05-10T03:33:56.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:55 smithi045 ceph-mon[42520]: Deploying daemon mon.c on smithi154 2024-05-10T03:33:56.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.787+0000 7f361ec62700 1 -- 172.21.15.154:0/3117948348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36180ffbd0 msgr2=0x7f36180fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:56.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.787+0000 7f361ec62700 1 --2- 172.21.15.154:0/3117948348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36180ffbd0 0x7f36180fffe0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f361000b0a0 tx=0x7f361000b3b0 comp rx=0 tx=0).stop 2024-05-10T03:33:56.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.787+0000 7f361ec62700 1 -- 172.21.15.154:0/3117948348 shutdown_connections 2024-05-10T03:33:56.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.787+0000 7f361ec62700 1 --2- 172.21.15.154:0/3117948348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36180ffbd0 0x7f36180fffe0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:56.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.787+0000 7f361ec62700 1 -- 172.21.15.154:0/3117948348 >> 172.21.15.154:0/3117948348 conn(0x7f36180755a0 msgr2=0x7f36180759e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:56.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.787+0000 7f361ec62700 1 -- 172.21.15.154:0/3117948348 shutdown_connections 2024-05-10T03:33:56.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.787+0000 7f361ec62700 1 -- 172.21.15.154:0/3117948348 wait complete. 2024-05-10T03:33:56.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.788+0000 7f361ec62700 1 Processor -- start 2024-05-10T03:33:56.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.788+0000 7f361ec62700 1 -- start start 2024-05-10T03:33:56.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.788+0000 7f361ec62700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36180ffbd0 0x7f3618197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:56.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.788+0000 7f361ec62700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3618197660 con 0x7f36180ffbd0 2024-05-10T03:33:56.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.789+0000 7f361c9fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36180ffbd0 0x7f3618197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:56.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.789+0000 7f361c9fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36180ffbd0 0x7f3618197120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.154:52386/0 (socket says 172.21.15.154:52386) 2024-05-10T03:33:56.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.789+0000 7f361c9fe700 1 -- 172.21.15.154:0/3364679400 learned_addr learned my addr 172.21.15.154:0/3364679400 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-10T03:33:56.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.789+0000 7f361c9fe700 1 -- 172.21.15.154:0/3364679400 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3610009d00 con 0x7f36180ffbd0 2024-05-10T03:33:56.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.789+0000 7f361c9fe700 1 --2- 172.21.15.154:0/3364679400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36180ffbd0 0x7f3618197120 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f361000b830 tx=0x7f361000bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:56.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.790+0000 7f3615ffb700 1 -- 172.21.15.154:0/3364679400 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f361000e040 con 0x7f36180ffbd0 2024-05-10T03:33:56.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.790+0000 7f361ec62700 1 -- 172.21.15.154:0/3364679400 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3618197860 con 0x7f36180ffbd0 2024-05-10T03:33:56.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.790+0000 7f3615ffb700 1 -- 172.21.15.154:0/3364679400 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f36100096a0 con 0x7f36180ffbd0 2024-05-10T03:33:56.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.790+0000 7f3615ffb700 1 -- 172.21.15.154:0/3364679400 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f361001d5e0 con 0x7f36180ffbd0 2024-05-10T03:33:56.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.790+0000 7f361ec62700 1 -- 172.21.15.154:0/3364679400 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3618197ce0 con 0x7f36180ffbd0 2024-05-10T03:33:56.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.791+0000 7f361ec62700 1 -- 172.21.15.154:0/3364679400 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3618102c60 con 0x7f36180ffbd0 2024-05-10T03:33:56.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.791+0000 7f3615ffb700 1 -- 172.21.15.154:0/3364679400 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f3610019070 con 0x7f36180ffbd0 2024-05-10T03:33:56.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.791+0000 7f3615ffb700 1 --2- 172.21.15.154:0/3364679400 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f36000387a0 0x7f360003acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:33:56.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.791+0000 7f3615ffb700 1 -- 172.21.15.154:0/3364679400 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f361004c880 con 0x7f36180ffbd0 2024-05-10T03:33:56.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.791+0000 7f3617fff700 1 --2- 172.21.15.154:0/3364679400 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f36000387a0 0x7f360003acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:33:56.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.792+0000 7f3617fff700 1 --2- 172.21.15.154:0/3364679400 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f36000387a0 0x7f360003acb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f360c006fd0 tx=0x7f360c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:33:56.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:56.797+0000 7f3615ffb700 1 -- 172.21.15.154:0/3364679400 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f361001cbc0 con 0x7f36180ffbd0 2024-05-10T03:33:57.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:57.095+0000 7f361ec62700 1 -- 172.21.15.154:0/3364679400 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f361810b990 con 0x7f36180ffbd0 2024-05-10T03:33:57.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:57.095+0000 7f3615ffb700 1 -- 172.21.15.154:0/3364679400 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+736 (secure 0 0 0) 0x7f3610017030 con 0x7f36180ffbd0 2024-05-10T03:33:57.100 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-10T03:33:57.100 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","modified":"2024-05-10T03:32:34.369158Z","created":"2024-05-10T03:32:34.369158Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-10T03:33:57.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:57.097+0000 7f361ec62700 1 -- 172.21.15.154:0/3364679400 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f36000387a0 msgr2=0x7f360003acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:57.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:57.097+0000 7f361ec62700 1 --2- 172.21.15.154:0/3364679400 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f36000387a0 0x7f360003acb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f360c006fd0 tx=0x7f360c006e40 comp rx=0 tx=0).stop 2024-05-10T03:33:57.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:57.097+0000 7f361ec62700 1 -- 172.21.15.154:0/3364679400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36180ffbd0 msgr2=0x7f3618197120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:33:57.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:57.097+0000 7f361ec62700 1 --2- 172.21.15.154:0/3364679400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36180ffbd0 0x7f3618197120 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f361000b830 tx=0x7f361000bd40 comp rx=0 tx=0).stop 2024-05-10T03:33:57.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:57.097+0000 7f361ec62700 1 -- 172.21.15.154:0/3364679400 shutdown_connections 2024-05-10T03:33:57.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:57.097+0000 7f361ec62700 1 --2- 172.21.15.154:0/3364679400 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f36000387a0 0x7f360003acb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:57.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:57.097+0000 7f361ec62700 1 --2- 172.21.15.154:0/3364679400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36180ffbd0 0x7f3618197120 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:33:57.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:57.097+0000 7f361ec62700 1 -- 172.21.15.154:0/3364679400 >> 172.21.15.154:0/3364679400 conn(0x7f36180755a0 msgr2=0x7f3618103080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:33:57.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:57.098+0000 7f361ec62700 1 -- 172.21.15.154:0/3364679400 shutdown_connections 2024-05-10T03:33:57.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:33:57.098+0000 7f361ec62700 1 -- 172.21.15.154:0/3364679400 wait complete. 2024-05-10T03:33:57.103 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2024-05-10T03:33:57.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:56 smithi045 ceph-mon[42520]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:33:57.952 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:57 smithi154 systemd[1]: Starting Ceph mon.c for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:33:58.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:33:57 smithi045 ceph-mon[42520]: from='client.? 172.21.15.154:0/3364679400' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-10T03:33:58.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 bash[46527]: a477806f49ddde967bb7d825a6ec0803e2feb47e506b70e21aa7df99fe1abc2e 2024-05-10T03:33:58.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 systemd[1]: Started Ceph mon.c for d2a0bafa-0e7d-11ef-bc98-c7b262605968. 2024-05-10T03:33:58.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: set uid:gid to 167:167 (ceph:ceph) 2024-05-10T03:33:58.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: ceph version 18.2.2-1330-g50174015 (50174015a7e79f951b988949abe236791f52d4da) reef (stable), process ceph-mon, pid 7 2024-05-10T03:33:58.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: pidfile_write: ignore empty --pid-file 2024-05-10T03:33:58.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: load: jerasure load: lrc 2024-05-10T03:33:58.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: RocksDB version: 7.9.2 2024-05-10T03:33:58.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Git sha 0 2024-05-10T03:33:58.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Compile date 2024-05-10 00:51:33 2024-05-10T03:33:58.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: DB SUMMARY 2024-05-10T03:33:58.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: DB Session ID: KMWLVPWOYS196IU5QLEC 2024-05-10T03:33:58.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: CURRENT file: CURRENT 2024-05-10T03:33:58.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: IDENTITY file: IDENTITY 2024-05-10T03:33:58.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-05-10T03:33:58.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-05-10T03:33:58.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-05-10T03:33:58.477 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.error_if_exists: 0 2024-05-10T03:33:58.477 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.create_if_missing: 0 2024-05-10T03:33:58.477 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.paranoid_checks: 1 2024-05-10T03:33:58.477 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-10T03:33:58.477 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-10T03:33:58.477 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-10T03:33:58.477 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.env: 0x5618ffdca460 2024-05-10T03:33:58.477 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.fs: PosixFileSystem 2024-05-10T03:33:58.477 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.info_log: 0x561900b9d760 2024-05-10T03:33:58.477 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_file_opening_threads: 16 2024-05-10T03:33:58.477 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.statistics: (nil) 2024-05-10T03:33:58.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.use_fsync: 0 2024-05-10T03:33:58.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_log_file_size: 0 2024-05-10T03:33:58.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-10T03:33:58.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-10T03:33:58.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.keep_log_file_num: 1000 2024-05-10T03:33:58.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.recycle_log_file_num: 0 2024-05-10T03:33:58.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.allow_fallocate: 1 2024-05-10T03:33:58.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.allow_mmap_reads: 0 2024-05-10T03:33:58.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.allow_mmap_writes: 0 2024-05-10T03:33:58.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.use_direct_reads: 0 2024-05-10T03:33:58.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-10T03:33:58.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.create_missing_column_families: 0 2024-05-10T03:33:58.479 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.db_log_dir: 2024-05-10T03:33:58.479 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.wal_dir: 2024-05-10T03:33:58.479 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-10T03:33:58.479 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-10T03:33:58.479 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-10T03:33:58.479 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-10T03:33:58.479 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-10T03:33:58.479 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-10T03:33:58.479 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.advise_random_on_open: 1 2024-05-10T03:33:58.479 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.db_write_buffer_size: 0 2024-05-10T03:33:58.479 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.write_buffer_manager: 0x561900ae10e0 2024-05-10T03:33:58.479 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-10T03:33:58.480 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-10T03:33:58.480 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-10T03:33:58.480 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.rate_limiter: (nil) 2024-05-10T03:33:58.480 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-10T03:33:58.480 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.wal_recovery_mode: 2 2024-05-10T03:33:58.480 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.enable_thread_tracking: 0 2024-05-10T03:33:58.480 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.enable_pipelined_write: 0 2024-05-10T03:33:58.480 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.unordered_write: 0 2024-05-10T03:33:58.480 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-10T03:33:58.481 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-10T03:33:58.481 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-10T03:33:58.481 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-10T03:33:58.481 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.row_cache: None 2024-05-10T03:33:58.481 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.wal_filter: None 2024-05-10T03:33:58.481 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-10T03:33:58.481 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.allow_ingest_behind: 0 2024-05-10T03:33:58.481 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.two_write_queues: 0 2024-05-10T03:33:58.481 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.manual_wal_flush: 0 2024-05-10T03:33:58.482 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.wal_compression: 0 2024-05-10T03:33:58.482 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.atomic_flush: 0 2024-05-10T03:33:58.482 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-10T03:33:58.482 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-10T03:33:58.482 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-10T03:33:58.482 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.log_readahead_size: 0 2024-05-10T03:33:58.482 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-10T03:33:58.482 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.best_efforts_recovery: 0 2024-05-10T03:33:58.482 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-10T03:33:58.483 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-10T03:33:58.483 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.allow_data_in_errors: 0 2024-05-10T03:33:58.484 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.db_host_id: __hostname__ 2024-05-10T03:33:58.484 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-10T03:33:58.484 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_background_jobs: 2 2024-05-10T03:33:58.484 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_background_compactions: -1 2024-05-10T03:33:58.485 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_subcompactions: 1 2024-05-10T03:33:58.485 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-10T03:33:58.485 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-10T03:33:58.485 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-10T03:33:58.485 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_total_wal_size: 0 2024-05-10T03:33:58.485 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-10T03:33:58.485 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-10T03:33:58.485 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-10T03:33:58.485 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-10T03:33:58.485 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_open_files: -1 2024-05-10T03:33:58.485 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.bytes_per_sync: 0 2024-05-10T03:33:58.485 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-10T03:33:58.485 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-10T03:33:58.486 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.compaction_readahead_size: 0 2024-05-10T03:33:58.486 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_background_flushes: -1 2024-05-10T03:33:58.486 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Compression algorithms supported: 2024-05-10T03:33:58.486 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-10T03:33:58.486 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: kZSTD supported: 0 2024-05-10T03:33:58.486 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: kXpressCompression supported: 0 2024-05-10T03:33:58.486 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: kLZ4HCCompression supported: 1 2024-05-10T03:33:58.486 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: kZlibCompression supported: 1 2024-05-10T03:33:58.486 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: kSnappyCompression supported: 1 2024-05-10T03:33:58.486 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: kLZ4Compression supported: 1 2024-05-10T03:33:58.486 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: kBZip2Compression supported: 0 2024-05-10T03:33:58.487 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-10T03:33:58.487 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-10T03:33:58.487 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-05-10T03:33:58.487 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-10T03:33:58.487 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-10T03:33:58.487 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.merge_operator: 2024-05-10T03:33:58.487 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.compaction_filter: None 2024-05-10T03:33:58.487 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.compaction_filter_factory: None 2024-05-10T03:33:58.487 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.sst_partitioner_factory: None 2024-05-10T03:33:58.487 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-10T03:33:58.487 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-10T03:33:58.487 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561900b9d880) 2024-05-10T03:33:58.487 INFO:journalctl@ceph.mon.c.smithi154.stdout: cache_index_and_filter_blocks: 1 2024-05-10T03:33:58.488 INFO:journalctl@ceph.mon.c.smithi154.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-10T03:33:58.488 INFO:journalctl@ceph.mon.c.smithi154.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-10T03:33:58.488 INFO:journalctl@ceph.mon.c.smithi154.stdout: pin_top_level_index_and_filter: 1 2024-05-10T03:33:58.488 INFO:journalctl@ceph.mon.c.smithi154.stdout: index_type: 0 2024-05-10T03:33:58.488 INFO:journalctl@ceph.mon.c.smithi154.stdout: data_block_index_type: 0 2024-05-10T03:33:58.488 INFO:journalctl@ceph.mon.c.smithi154.stdout: index_shortening: 1 2024-05-10T03:33:58.488 INFO:journalctl@ceph.mon.c.smithi154.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-10T03:33:58.488 INFO:journalctl@ceph.mon.c.smithi154.stdout: checksum: 4 2024-05-10T03:33:58.488 INFO:journalctl@ceph.mon.c.smithi154.stdout: no_block_cache: 0 2024-05-10T03:33:58.488 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_cache: 0x561900b631f0 2024-05-10T03:33:58.488 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_cache_name: BinnedLRUCache 2024-05-10T03:33:58.488 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_cache_options: 2024-05-10T03:33:58.488 INFO:journalctl@ceph.mon.c.smithi154.stdout: capacity : 536870912 2024-05-10T03:33:58.489 INFO:journalctl@ceph.mon.c.smithi154.stdout: num_shard_bits : 4 2024-05-10T03:33:58.489 INFO:journalctl@ceph.mon.c.smithi154.stdout: strict_capacity_limit : 0 2024-05-10T03:33:58.489 INFO:journalctl@ceph.mon.c.smithi154.stdout: high_pri_pool_ratio: 0.000 2024-05-10T03:33:58.489 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_cache_compressed: (nil) 2024-05-10T03:33:58.489 INFO:journalctl@ceph.mon.c.smithi154.stdout: persistent_cache: (nil) 2024-05-10T03:33:58.489 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_size: 4096 2024-05-10T03:33:58.489 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_size_deviation: 10 2024-05-10T03:33:58.489 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_restart_interval: 16 2024-05-10T03:33:58.489 INFO:journalctl@ceph.mon.c.smithi154.stdout: index_block_restart_interval: 1 2024-05-10T03:33:58.489 INFO:journalctl@ceph.mon.c.smithi154.stdout: metadata_block_size: 4096 2024-05-10T03:33:58.489 INFO:journalctl@ceph.mon.c.smithi154.stdout: partition_filters: 0 2024-05-10T03:33:58.489 INFO:journalctl@ceph.mon.c.smithi154.stdout: use_delta_encoding: 1 2024-05-10T03:33:58.489 INFO:journalctl@ceph.mon.c.smithi154.stdout: filter_policy: bloomfilter 2024-05-10T03:33:58.490 INFO:journalctl@ceph.mon.c.smithi154.stdout: whole_key_filtering: 1 2024-05-10T03:33:58.490 INFO:journalctl@ceph.mon.c.smithi154.stdout: verify_compression: 0 2024-05-10T03:33:58.490 INFO:journalctl@ceph.mon.c.smithi154.stdout: read_amp_bytes_per_bit: 0 2024-05-10T03:33:58.490 INFO:journalctl@ceph.mon.c.smithi154.stdout: format_version: 5 2024-05-10T03:33:58.490 INFO:journalctl@ceph.mon.c.smithi154.stdout: enable_index_compression: 1 2024-05-10T03:33:58.490 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_align: 0 2024-05-10T03:33:58.490 INFO:journalctl@ceph.mon.c.smithi154.stdout: max_auto_readahead_size: 262144 2024-05-10T03:33:58.490 INFO:journalctl@ceph.mon.c.smithi154.stdout: prepopulate_block_cache: 0 2024-05-10T03:33:58.490 INFO:journalctl@ceph.mon.c.smithi154.stdout: initial_auto_readahead_size: 8192 2024-05-10T03:33:58.490 INFO:journalctl@ceph.mon.c.smithi154.stdout: num_file_reads_for_auto_readahead: 2 2024-05-10T03:33:58.490 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.write_buffer_size: 33554432 2024-05-10T03:33:58.490 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_write_buffer_number: 2 2024-05-10T03:33:58.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.compression: NoCompression 2024-05-10T03:33:58.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.bottommost_compression: Disabled 2024-05-10T03:33:58.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.prefix_extractor: nullptr 2024-05-10T03:33:58.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-10T03:33:58.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.num_levels: 7 2024-05-10T03:33:58.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-10T03:33:58.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-10T03:33:58.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-10T03:33:58.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-10T03:33:58.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-10T03:33:58.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-10T03:33:58.492 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-10T03:33:58.492 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-10T03:33:58.492 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-10T03:33:58.492 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-10T03:33:58.492 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-10T03:33:58.492 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-10T03:33:58.492 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-10T03:33:58.492 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.compression_opts.level: 32767 2024-05-10T03:33:58.492 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.compression_opts.strategy: 0 2024-05-10T03:33:58.492 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-10T03:33:58.492 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-10T03:33:58.492 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-10T03:33:58.493 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-10T03:33:58.493 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.compression_opts.enabled: false 2024-05-10T03:33:58.493 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-10T03:33:58.493 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-10T03:33:58.493 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-10T03:33:58.493 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-10T03:33:58.493 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.target_file_size_base: 67108864 2024-05-10T03:33:58.493 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-10T03:33:58.493 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-10T03:33:58.493 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-10T03:33:58.493 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-10T03:33:58.493 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-10T03:33:58.493 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-10T03:33:58.494 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-10T03:33:58.494 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-10T03:33:58.494 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-10T03:33:58.494 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-10T03:33:58.494 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-10T03:33:58.494 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-10T03:33:58.494 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-10T03:33:58.494 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-10T03:33:58.494 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.arena_block_size: 1048576 2024-05-10T03:33:58.494 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-10T03:33:58.494 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-10T03:33:58.494 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.disable_auto_compactions: 0 2024-05-10T03:33:58.495 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-10T03:33:58.495 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-10T03:33:58.495 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-10T03:33:58.495 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-10T03:33:58.495 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-10T03:33:58.495 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-10T03:33:58.495 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-10T03:33:58.495 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-10T03:33:58.495 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-10T03:33:58.495 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-10T03:33:58.495 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.table_properties_collectors: 2024-05-10T03:33:58.495 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.inplace_update_support: 0 2024-05-10T03:33:58.495 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-10T03:33:58.496 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-10T03:33:58.496 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-10T03:33:58.496 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-10T03:33:58.496 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.bloom_locality: 0 2024-05-10T03:33:58.496 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.max_successive_merges: 0 2024-05-10T03:33:58.496 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-10T03:33:58.496 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.paranoid_file_checks: 0 2024-05-10T03:33:58.496 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.force_consistency_checks: 1 2024-05-10T03:33:58.496 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.report_bg_io_stats: 0 2024-05-10T03:33:58.496 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.ttl: 2592000 2024-05-10T03:33:58.496 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-10T03:33:58.496 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-10T03:33:58.496 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-10T03:33:58.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.enable_blob_files: false 2024-05-10T03:33:58.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.min_blob_size: 0 2024-05-10T03:33:58.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.blob_file_size: 268435456 2024-05-10T03:33:58.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-10T03:33:58.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-10T03:33:58.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-10T03:33:58.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-10T03:33:58.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-10T03:33:58.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.blob_file_starting_level: 0 2024-05-10T03:33:58.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-10T03:33:58.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-10T03:33:58.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-10T03:33:58.498 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d2125a3d-94ba-48fd-9dfe-d936d45e9b81 2024-05-10T03:33:58.498 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715312038020937, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-10T03:33:58.498 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-10T03:33:58.498 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715312038021524, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715312038, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d2125a3d-94ba-48fd-9dfe-d936d45e9b81", "db_session_id": "KMWLVPWOYS196IU5QLEC", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-10T03:33:58.498 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715312038021617, "job": 1, "event": "recovery_finished"} 2024-05-10T03:33:58.498 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-10T03:33:58.498 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-10T03:33:58.498 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x561900af5c00 2024-05-10T03:33:58.498 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: DB pointer 0x5619058e4000 2024-05-10T03:33:58.498 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-10T03:33:58.498 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-10T03:33:58.499 INFO:journalctl@ceph.mon.c.smithi154.stdout: ** DB Stats ** 2024-05-10T03:33:58.499 INFO:journalctl@ceph.mon.c.smithi154.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-10T03:33:58.499 INFO:journalctl@ceph.mon.c.smithi154.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-10T03:33:58.499 INFO:journalctl@ceph.mon.c.smithi154.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-10T03:33:58.499 INFO:journalctl@ceph.mon.c.smithi154.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-10T03:33:58.499 INFO:journalctl@ceph.mon.c.smithi154.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-10T03:33:58.499 INFO:journalctl@ceph.mon.c.smithi154.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-10T03:33:58.499 INFO:journalctl@ceph.mon.c.smithi154.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-10T03:33:58.499 INFO:journalctl@ceph.mon.c.smithi154.stdout: 2024-05-10T03:33:58.499 INFO:journalctl@ceph.mon.c.smithi154.stdout: ** Compaction Stats [default] ** 2024-05-10T03:33:58.500 INFO:journalctl@ceph.mon.c.smithi154.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-10T03:33:58.500 INFO:journalctl@ceph.mon.c.smithi154.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-10T03:33:58.500 INFO:journalctl@ceph.mon.c.smithi154.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-10T03:33:58.500 INFO:journalctl@ceph.mon.c.smithi154.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-10T03:33:58.500 INFO:journalctl@ceph.mon.c.smithi154.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-10T03:33:58.500 INFO:journalctl@ceph.mon.c.smithi154.stdout: 2024-05-10T03:33:58.500 INFO:journalctl@ceph.mon.c.smithi154.stdout: ** Compaction Stats [default] ** 2024-05-10T03:33:58.500 INFO:journalctl@ceph.mon.c.smithi154.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-10T03:33:58.500 INFO:journalctl@ceph.mon.c.smithi154.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-10T03:33:58.500 INFO:journalctl@ceph.mon.c.smithi154.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-10T03:33:58.500 INFO:journalctl@ceph.mon.c.smithi154.stdout: 2024-05-10T03:33:58.501 INFO:journalctl@ceph.mon.c.smithi154.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-10T03:33:58.501 INFO:journalctl@ceph.mon.c.smithi154.stdout: 2024-05-10T03:33:58.501 INFO:journalctl@ceph.mon.c.smithi154.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-10T03:33:58.501 INFO:journalctl@ceph.mon.c.smithi154.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-10T03:33:58.501 INFO:journalctl@ceph.mon.c.smithi154.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-10T03:33:58.501 INFO:journalctl@ceph.mon.c.smithi154.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-10T03:33:58.501 INFO:journalctl@ceph.mon.c.smithi154.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-10T03:33:58.501 INFO:journalctl@ceph.mon.c.smithi154.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-10T03:33:58.501 INFO:journalctl@ceph.mon.c.smithi154.stdout: Cumulative compaction: 0.00 GB write, 0.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-10T03:33:58.501 INFO:journalctl@ceph.mon.c.smithi154.stdout: Interval compaction: 0.00 GB write, 0.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-10T03:33:58.502 INFO:journalctl@ceph.mon.c.smithi154.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-10T03:33:58.502 INFO:journalctl@ceph.mon.c.smithi154.stdout: Block cache BinnedLRUCache@0x561900b631f0#7 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-05-10T03:33:58.502 INFO:journalctl@ceph.mon.c.smithi154.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-10T03:33:58.502 INFO:journalctl@ceph.mon.c.smithi154.stdout: 2024-05-10T03:33:58.502 INFO:journalctl@ceph.mon.c.smithi154.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-10T03:33:58.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-05-10T03:33:58.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: using public_addr v2:172.21.15.154:0/0 -> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-05-10T03:33:58.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: starting mon.c rank -1 at public addrs [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] at bind addrs [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 2024-05-10T03:33:58.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: mon.c@-1(???) e0 preinit fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 2024-05-10T03:33:58.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: mon.c@-1(synchronizing).mds e1 new map 2024-05-10T03:33:58.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: mon.c@-1(synchronizing).mds e1 print_map 2024-05-10T03:33:58.503 INFO:journalctl@ceph.mon.c.smithi154.stdout: e1 2024-05-10T03:33:58.503 INFO:journalctl@ceph.mon.c.smithi154.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-10T03:33:58.503 INFO:journalctl@ceph.mon.c.smithi154.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-10T03:33:58.503 INFO:journalctl@ceph.mon.c.smithi154.stdout: legacy client fscid: -1 2024-05-10T03:33:58.503 INFO:journalctl@ceph.mon.c.smithi154.stdout: 2024-05-10T03:33:58.503 INFO:journalctl@ceph.mon.c.smithi154.stdout: No filesystems configured 2024-05-10T03:33:58.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-10T03:33:58.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-10T03:33:58.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-10T03:33:58.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-10T03:33:58.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-10T03:33:58.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-10T03:33:58.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-10T03:33:58.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-10T03:33:58.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-10T03:33:58.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-10T03:33:58.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: Added host smithi154 2024-05-10T03:33:58.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:58.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:33:58.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T03:33:58.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:58.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:58.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:58.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:58.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:33:58.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:33:58.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:33:58.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:33:58.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: Updating smithi154:/etc/ceph/ceph.conf 2024-05-10T03:33:58.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: Updating smithi154:/var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T03:33:58.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/287005217' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-10T03:33:58.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:58.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:58.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:58.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-05-10T03:33:58.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: Updating smithi154:/var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-10T03:33:58.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/287005217' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-10T03:33:58.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: osdmap e4: 0 total, 0 up, 0 in 2024-05-10T03:33:58.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:33:58.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:58.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:33:58.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:33:58.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:33:58.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:33:58.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T03:33:58.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:33:58.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi045:172.21.15.45=a;smithi106:172.21.15.106=b;smithi154:172.21.15.154=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:33:58.507 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: Saving service mon spec with placement smithi045:172.21.15.45=a;smithi106:172.21.15.106=b;smithi154:172.21.15.154=c;count:3 2024-05-10T03:33:58.507 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: Deploying daemon mon.c on smithi154 2024-05-10T03:33:58.507 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:33:58.507 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: from='client.? 172.21.15.154:0/3364679400' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-10T03:33:58.507 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:33:58 smithi154 ceph-mon[46565]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-10T03:33:58.601 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-10T03:33:58.601 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph mon dump -f json 2024-05-10T03:33:58.822 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T03:34:03.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.086+0000 7ff5a759f700 1 -- 172.21.15.154:0/2984809558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff58c0057d0 msgr2=0x7ff58c007cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:03.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.086+0000 7ff5a759f700 1 --2- 172.21.15.154:0/2984809558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff58c0057d0 0x7ff58c007cb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff5a01003f0 tx=0x7ff590013e90 comp rx=0 tx=0).stop 2024-05-10T03:34:03.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.086+0000 7ff5a759f700 1 -- 172.21.15.154:0/2984809558 shutdown_connections 2024-05-10T03:34:03.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.086+0000 7ff5a759f700 1 --2- 172.21.15.154:0/2984809558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff58c0057d0 0x7ff58c007cb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:03.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.086+0000 7ff5a759f700 1 -- 172.21.15.154:0/2984809558 >> 172.21.15.154:0/2984809558 conn(0x7ff5a0076030 msgr2=0x7ff5a0076470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:34:03.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.086+0000 7ff5a759f700 1 -- 172.21.15.154:0/2984809558 shutdown_connections 2024-05-10T03:34:03.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.086+0000 7ff5a759f700 1 -- 172.21.15.154:0/2984809558 wait complete. 2024-05-10T03:34:03.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.087+0000 7ff5a759f700 1 Processor -- start 2024-05-10T03:34:03.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.087+0000 7ff5a759f700 1 -- start start 2024-05-10T03:34:03.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.088+0000 7ff5a759f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff58c0057d0 0x7ff5a0194eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:03.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.088+0000 7ff5a759f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5a01953f0 0x7ff5a0199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:03.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.088+0000 7ff5a759f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a0195970 con 0x7ff58c0057d0 2024-05-10T03:34:03.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.088+0000 7ff5a759f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a0195ab0 con 0x7ff5a01953f0 2024-05-10T03:34:03.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.088+0000 7ff5a4b3a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5a01953f0 0x7ff5a0199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:03.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.088+0000 7ff5a4b3a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5a01953f0 0x7ff5a0199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53406/0 (socket says 172.21.15.154:53406) 2024-05-10T03:34:03.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.088+0000 7ff5a533b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff58c0057d0 0x7ff5a0194eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:03.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.088+0000 7ff5a4b3a700 1 -- 172.21.15.154:0/1018266883 learned_addr learned my addr 172.21.15.154:0/1018266883 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-10T03:34:03.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.088+0000 7ff5a4b3a700 1 -- 172.21.15.154:0/1018266883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5a01953f0 msgr2=0x7ff5a0199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-10T03:34:03.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.088+0000 7ff5a4b3a700 1 -- 172.21.15.154:0/1018266883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5a01953f0 msgr2=0x7ff5a0199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-10T03:34:03.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.088+0000 7ff5a4b3a700 1 --2- 172.21.15.154:0/1018266883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5a01953f0 0x7ff5a0199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T03:34:03.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.088+0000 7ff5a4b3a700 1 --2- 172.21.15.154:0/1018266883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5a01953f0 0x7ff5a0199750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-10T03:34:03.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.088+0000 7ff5a533b700 1 -- 172.21.15.154:0/1018266883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5a01953f0 msgr2=0x7ff5a0199750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-10T03:34:03.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.088+0000 7ff5a533b700 1 --2- 172.21.15.154:0/1018266883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5a01953f0 0x7ff5a0199750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:03.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.088+0000 7ff5a533b700 1 -- 172.21.15.154:0/1018266883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5900138e0 con 0x7ff58c0057d0 2024-05-10T03:34:03.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.089+0000 7ff5a533b700 1 --2- 172.21.15.154:0/1018266883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff58c0057d0 0x7ff5a0194eb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff59001c000 tx=0x7ff590005410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:34:03.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.105+0000 7ff5967fc700 1 -- 172.21.15.154:0/1018266883 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7ff590018070 con 0x7ff58c0057d0 2024-05-10T03:34:03.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.105+0000 7ff5967fc700 1 -- 172.21.15.154:0/1018266883 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff5900056e0 con 0x7ff58c0057d0 2024-05-10T03:34:03.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.105+0000 7ff5a759f700 1 -- 172.21.15.154:0/1018266883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a0199cf0 con 0x7ff58c0057d0 2024-05-10T03:34:03.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.105+0000 7ff5967fc700 1 -- 172.21.15.154:0/1018266883 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7ff590003b00 con 0x7ff58c0057d0 2024-05-10T03:34:03.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.105+0000 7ff5a759f700 1 -- 172.21.15.154:0/1018266883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a019a2c0 con 0x7ff58c0057d0 2024-05-10T03:34:03.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.106+0000 7ff5a759f700 1 -- 172.21.15.154:0/1018266883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a018ec70 con 0x7ff58c0057d0 2024-05-10T03:34:03.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.108+0000 7ff5967fc700 1 -- 172.21.15.154:0/1018266883 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7ff59000fc20 con 0x7ff58c0057d0 2024-05-10T03:34:03.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.108+0000 7ff5967fc700 1 --2- 172.21.15.154:0/1018266883 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff584038620 0x7ff58403ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:03.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.108+0000 7ff5967fc700 1 -- 172.21.15.154:0/1018266883 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff59004e4f0 con 0x7ff58c0057d0 2024-05-10T03:34:03.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.108+0000 7ff5a4b3a700 1 --2- 172.21.15.154:0/1018266883 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff584038620 0x7ff58403ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:03.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.109+0000 7ff5a4b3a700 1 --2- 172.21.15.154:0/1018266883 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff584038620 0x7ff58403ab30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00fe180 tx=0x7ff59c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:34:03.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.113+0000 7ff5967fc700 1 -- 172.21.15.154:0/1018266883 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff59002ebf0 con 0x7ff58c0057d0 2024-05-10T03:34:03.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.390+0000 7ff5a759f700 1 -- 172.21.15.154:0/1018266883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff5a019a530 con 0x7ff58c0057d0 2024-05-10T03:34:03.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.391+0000 7ff5967fc700 1 -- 172.21.15.154:0/1018266883 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1006 (secure 0 0 0) 0x7ff59002ebf0 con 0x7ff58c0057d0 2024-05-10T03:34:03.394 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-10T03:34:03.394 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":2,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","modified":"2024-05-10T03:33:58.052366Z","created":"2024-05-10T03:32:34.369158Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-10T03:34:03.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.393+0000 7ff5a759f700 1 -- 172.21.15.154:0/1018266883 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff584038620 msgr2=0x7ff58403ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:03.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.393+0000 7ff5a759f700 1 --2- 172.21.15.154:0/1018266883 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff584038620 0x7ff58403ab30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00fe180 tx=0x7ff59c008040 comp rx=0 tx=0).stop 2024-05-10T03:34:03.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.393+0000 7ff5a759f700 1 -- 172.21.15.154:0/1018266883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff58c0057d0 msgr2=0x7ff5a0194eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:03.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.393+0000 7ff5a759f700 1 --2- 172.21.15.154:0/1018266883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff58c0057d0 0x7ff5a0194eb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff59001c000 tx=0x7ff590005410 comp rx=0 tx=0).stop 2024-05-10T03:34:03.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.393+0000 7ff5a759f700 1 -- 172.21.15.154:0/1018266883 shutdown_connections 2024-05-10T03:34:03.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.393+0000 7ff5a759f700 1 --2- 172.21.15.154:0/1018266883 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff584038620 0x7ff58403ab30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:03.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.393+0000 7ff5a759f700 1 --2- 172.21.15.154:0/1018266883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff58c0057d0 0x7ff5a0194eb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:03.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.393+0000 7ff5a759f700 1 --2- 172.21.15.154:0/1018266883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5a01953f0 0x7ff5a0199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:03.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.393+0000 7ff5a759f700 1 -- 172.21.15.154:0/1018266883 >> 172.21.15.154:0/1018266883 conn(0x7ff5a0076030 msgr2=0x7ff5a00fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:34:03.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.393+0000 7ff5a759f700 1 -- 172.21.15.154:0/1018266883 shutdown_connections 2024-05-10T03:34:03.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:03.393+0000 7ff5a759f700 1 -- 172.21.15.154:0/1018266883 wait complete. 2024-05-10T03:34:03.398 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 2 2024-05-10T03:34:03.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:03 smithi154 ceph-mon[46565]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:03.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:03 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T03:34:03.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:03 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:34:03.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:03 smithi154 ceph-mon[46565]: mon.a calling monitor election 2024-05-10T03:34:03.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:03 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:34:03.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:03 smithi154 ceph-mon[46565]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:03.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:03 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:34:03.417 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:03 smithi154 ceph-mon[46565]: mon.c calling monitor election 2024-05-10T03:34:03.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:03 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:34:03.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:03 smithi154 ceph-mon[46565]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:03.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:03 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:34:03.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:03 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:34:03.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:03 smithi154 ceph-mon[46565]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-10T03:34:03.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:03 smithi154 ceph-mon[46565]: monmap e2: 2 mons at {a=[v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0],c=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-10T03:34:03.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:03 smithi154 ceph-mon[46565]: fsmap 2024-05-10T03:34:03.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:03 smithi154 ceph-mon[46565]: osdmap e4: 0 total, 0 up, 0 in 2024-05-10T03:34:03.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:03 smithi154 ceph-mon[46565]: mgrmap e13: x(active, since 37s) 2024-05-10T03:34:03.418 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:03 smithi154 ceph-mon[46565]: overall HEALTH_OK 2024-05-10T03:34:03.419 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:03 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:03.419 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:03 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:03.419 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:03 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:03.419 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:03 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T03:34:03.419 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:03 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:03.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:03 smithi045 ceph-mon[42520]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:03.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:03 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T03:34:03.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:03 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:34:03.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:03 smithi045 ceph-mon[42520]: mon.a calling monitor election 2024-05-10T03:34:03.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:03 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:34:03.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:03 smithi045 ceph-mon[42520]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:03.536 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:03 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:34:03.536 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:03 smithi045 ceph-mon[42520]: mon.c calling monitor election 2024-05-10T03:34:03.536 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:03 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:34:03.536 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:03 smithi045 ceph-mon[42520]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:03.536 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:03 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:34:03.536 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:03 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:34:03.537 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:03 smithi045 ceph-mon[42520]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-10T03:34:03.537 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:03 smithi045 ceph-mon[42520]: monmap e2: 2 mons at {a=[v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0],c=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-10T03:34:03.537 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:03 smithi045 ceph-mon[42520]: fsmap 2024-05-10T03:34:03.537 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:03 smithi045 ceph-mon[42520]: osdmap e4: 0 total, 0 up, 0 in 2024-05-10T03:34:03.537 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:03 smithi045 ceph-mon[42520]: mgrmap e13: x(active, since 37s) 2024-05-10T03:34:03.538 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:03 smithi045 ceph-mon[42520]: overall HEALTH_OK 2024-05-10T03:34:03.538 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:03 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:03.538 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:03 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:03.538 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:03 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:03.538 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:03 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T03:34:03.538 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:03 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:04.479 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:04 smithi154 ceph-mon[46565]: Deploying daemon mon.b on smithi106 2024-05-10T03:34:04.479 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:04 smithi154 ceph-mon[46565]: from='client.? 172.21.15.154:0/1018266883' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-10T03:34:04.480 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:04 smithi154 ceph-mon[46565]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:04.480 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:04 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:34:04.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:04 smithi045 ceph-mon[42520]: Deploying daemon mon.b on smithi106 2024-05-10T03:34:04.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:04 smithi045 ceph-mon[42520]: from='client.? 172.21.15.154:0/1018266883' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-10T03:34:04.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:04 smithi045 ceph-mon[42520]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:04.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:04 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:34:04.773 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-10T03:34:04.774 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph mon dump -f json 2024-05-10T03:34:05.002 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T03:34:06.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 systemd[1]: Started Ceph mon.b for d2a0bafa-0e7d-11ef-bc98-c7b262605968. 2024-05-10T03:34:06.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: mon.b@-1(synchronizing).mds e1 new map 2024-05-10T03:34:06.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: mon.b@-1(synchronizing).mds e1 print_map 2024-05-10T03:34:06.153 INFO:journalctl@ceph.mon.b.smithi106.stdout: e1 2024-05-10T03:34:06.153 INFO:journalctl@ceph.mon.b.smithi106.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-10T03:34:06.153 INFO:journalctl@ceph.mon.b.smithi106.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-10T03:34:06.153 INFO:journalctl@ceph.mon.b.smithi106.stdout: legacy client fscid: -1 2024-05-10T03:34:06.153 INFO:journalctl@ceph.mon.b.smithi106.stdout: 2024-05-10T03:34:06.153 INFO:journalctl@ceph.mon.b.smithi106.stdout: No filesystems configured 2024-05-10T03:34:06.153 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-10T03:34:06.153 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-10T03:34:06.153 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-10T03:34:06.153 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-10T03:34:06.153 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-10T03:34:06.153 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-10T03:34:06.154 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-10T03:34:06.154 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-10T03:34:06.154 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-10T03:34:06.154 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-10T03:34:06.154 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: Added host smithi154 2024-05-10T03:34:06.154 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:06.154 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:06.154 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T03:34:06.154 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:06.154 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:06.154 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:06.154 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:06.154 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:34:06.155 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:06.155 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:06.155 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:06.155 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: Updating smithi154:/etc/ceph/ceph.conf 2024-05-10T03:34:06.155 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: Updating smithi154:/var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T03:34:06.155 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/287005217' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-10T03:34:06.155 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:06.155 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:06.155 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:06.155 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-05-10T03:34:06.155 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: Updating smithi154:/var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-10T03:34:06.155 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/287005217' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-10T03:34:06.155 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: osdmap e4: 0 total, 0 up, 0 in 2024-05-10T03:34:06.155 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:06.156 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:06.156 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:06.156 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:06.156 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:06.156 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:06.156 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T03:34:06.156 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:06.156 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi045:172.21.15.45=a;smithi106:172.21.15.106=b;smithi154:172.21.15.154=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:34:06.156 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: Saving service mon spec with placement smithi045:172.21.15.45=a;smithi106:172.21.15.106=b;smithi154:172.21.15.154=c;count:3 2024-05-10T03:34:06.156 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: Deploying daemon mon.c on smithi154 2024-05-10T03:34:06.156 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:06.156 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='client.? 172.21.15.154:0/3364679400' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-10T03:34:06.157 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:06.157 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T03:34:06.157 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:34:06.157 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: mon.a calling monitor election 2024-05-10T03:34:06.157 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:34:06.157 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:06.157 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:34:06.157 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: mon.c calling monitor election 2024-05-10T03:34:06.157 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:34:06.157 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:06.157 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:34:06.157 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:34:06.157 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-10T03:34:06.157 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: monmap e2: 2 mons at {a=[v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0],c=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-10T03:34:06.158 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: fsmap 2024-05-10T03:34:06.158 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: osdmap e4: 0 total, 0 up, 0 in 2024-05-10T03:34:06.158 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: mgrmap e13: x(active, since 37s) 2024-05-10T03:34:06.158 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: overall HEALTH_OK 2024-05-10T03:34:06.158 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:06.158 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:06.158 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:06.158 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T03:34:06.158 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:06.158 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: Deploying daemon mon.b on smithi106 2024-05-10T03:34:06.158 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='client.? 172.21.15.154:0/1018266883' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-10T03:34:06.158 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:06.158 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:34:06.158 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:05 smithi106 ceph-mon[46996]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-10T03:34:11.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:10 smithi045 ceph-mon[42520]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:11.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:10 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T03:34:11.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:10 smithi045 ceph-mon[42520]: mon.a calling monitor election 2024-05-10T03:34:11.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:10 smithi045 ceph-mon[42520]: mon.c calling monitor election 2024-05-10T03:34:11.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:10 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:34:11.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:10 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:34:11.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:10 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:34:11.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:10 smithi045 ceph-mon[42520]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:11.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:10 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:34:11.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:10 smithi045 ceph-mon[42520]: mon.b calling monitor election 2024-05-10T03:34:11.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:10 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:34:11.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:10 smithi045 ceph-mon[42520]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:11.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:10 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:34:11.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:10 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:34:11.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:10 smithi045 ceph-mon[42520]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-10T03:34:11.286 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:10 smithi045 ceph-mon[42520]: monmap e3: 3 mons at {a=[v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0],b=[v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0],c=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-10T03:34:11.286 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:10 smithi045 ceph-mon[42520]: fsmap 2024-05-10T03:34:11.286 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:10 smithi045 ceph-mon[42520]: osdmap e4: 0 total, 0 up, 0 in 2024-05-10T03:34:11.286 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:10 smithi045 ceph-mon[42520]: mgrmap e13: x(active, since 45s) 2024-05-10T03:34:11.286 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:10 smithi045 ceph-mon[42520]: overall HEALTH_OK 2024-05-10T03:34:11.286 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:10 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:11.286 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:10 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:11.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:10 smithi106 ceph-mon[46996]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:11.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:10 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T03:34:11.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:10 smithi106 ceph-mon[46996]: mon.a calling monitor election 2024-05-10T03:34:11.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:10 smithi106 ceph-mon[46996]: mon.c calling monitor election 2024-05-10T03:34:11.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:10 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:34:11.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:10 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:34:11.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:10 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:34:11.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:10 smithi106 ceph-mon[46996]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:11.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:10 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:34:11.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:10 smithi106 ceph-mon[46996]: mon.b calling monitor election 2024-05-10T03:34:11.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:10 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:34:11.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:10 smithi106 ceph-mon[46996]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:11.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:10 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:34:11.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:10 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:34:11.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:10 smithi106 ceph-mon[46996]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-10T03:34:11.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:10 smithi106 ceph-mon[46996]: monmap e3: 3 mons at {a=[v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0],b=[v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0],c=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-10T03:34:11.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:10 smithi106 ceph-mon[46996]: fsmap 2024-05-10T03:34:11.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:10 smithi106 ceph-mon[46996]: osdmap e4: 0 total, 0 up, 0 in 2024-05-10T03:34:11.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:10 smithi106 ceph-mon[46996]: mgrmap e13: x(active, since 45s) 2024-05-10T03:34:11.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:10 smithi106 ceph-mon[46996]: overall HEALTH_OK 2024-05-10T03:34:11.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:10 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:11.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:10 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:11.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:10 smithi154 ceph-mon[46565]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:11.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:10 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T03:34:11.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:10 smithi154 ceph-mon[46565]: mon.a calling monitor election 2024-05-10T03:34:11.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:10 smithi154 ceph-mon[46565]: mon.c calling monitor election 2024-05-10T03:34:11.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:10 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:34:11.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:10 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:34:11.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:10 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:34:11.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:10 smithi154 ceph-mon[46565]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:11.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:10 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:34:11.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:10 smithi154 ceph-mon[46565]: mon.b calling monitor election 2024-05-10T03:34:11.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:10 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:34:11.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:10 smithi154 ceph-mon[46565]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:11.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:10 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:34:11.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:10 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:34:11.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:10 smithi154 ceph-mon[46565]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-10T03:34:11.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:10 smithi154 ceph-mon[46565]: monmap e3: 3 mons at {a=[v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0],b=[v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0],c=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-10T03:34:11.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:10 smithi154 ceph-mon[46565]: fsmap 2024-05-10T03:34:11.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:10 smithi154 ceph-mon[46565]: osdmap e4: 0 total, 0 up, 0 in 2024-05-10T03:34:11.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:10 smithi154 ceph-mon[46565]: mgrmap e13: x(active, since 45s) 2024-05-10T03:34:11.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:10 smithi154 ceph-mon[46565]: overall HEALTH_OK 2024-05-10T03:34:11.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:10 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:11.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:10 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:11.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.919+0000 7ff93ff31700 1 -- 172.21.15.154:0/3017649991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9240064e0 msgr2=0x7ff924003ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:11.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.919+0000 7ff93ff31700 1 --2- 172.21.15.154:0/3017649991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9240064e0 0x7ff924003ab0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff938101580 tx=0x7ff92c00fe90 comp rx=0 tx=0).stop 2024-05-10T03:34:11.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.919+0000 7ff93ff31700 1 -- 172.21.15.154:0/3017649991 shutdown_connections 2024-05-10T03:34:11.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.919+0000 7ff93ff31700 1 --2- 172.21.15.154:0/3017649991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9240064e0 0x7ff924003ab0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:11.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.919+0000 7ff93ff31700 1 -- 172.21.15.154:0/3017649991 >> 172.21.15.154:0/3017649991 conn(0x7ff938076030 msgr2=0x7ff938076470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:34:11.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.919+0000 7ff93ff31700 1 -- 172.21.15.154:0/3017649991 shutdown_connections 2024-05-10T03:34:11.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.919+0000 7ff93ff31700 1 -- 172.21.15.154:0/3017649991 wait complete. 2024-05-10T03:34:11.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.920+0000 7ff93ff31700 1 Processor -- start 2024-05-10T03:34:11.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.920+0000 7ff93ff31700 1 -- start start 2024-05-10T03:34:11.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.920+0000 7ff93ff31700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9240064e0 0x7ff938109950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:11.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.920+0000 7ff93ff31700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff938109e90 0x7ff93810a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:11.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.920+0000 7ff93ff31700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9381a34f0 0x7ff9381a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:11.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.920+0000 7ff93ff31700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9381a5e80 con 0x7ff938109e90 2024-05-10T03:34:11.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.920+0000 7ff93ff31700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9381a5ff0 con 0x7ff9381a34f0 2024-05-10T03:34:11.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.920+0000 7ff93ff31700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9381a61b0 con 0x7ff9240064e0 2024-05-10T03:34:11.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.920+0000 7ff93dccd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9240064e0 0x7ff938109950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:11.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.920+0000 7ff93dccd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9240064e0 0x7ff938109950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56518/0 (socket says 172.21.15.154:56518) 2024-05-10T03:34:11.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.920+0000 7ff93dccd700 1 -- 172.21.15.154:0/4173696002 learned_addr learned my addr 172.21.15.154:0/4173696002 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-10T03:34:11.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.920+0000 7ff93d4cc700 1 --2- 172.21.15.154:0/4173696002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff938109e90 0x7ff93810a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:11.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.921+0000 7ff93e4ce700 1 --2- 172.21.15.154:0/4173696002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9381a34f0 0x7ff9381a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:11.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.921+0000 7ff93dccd700 1 -- 172.21.15.154:0/4173696002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9240064e0 msgr2=0x7ff938109950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-05-10T03:34:11.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.921+0000 7ff93dccd700 1 -- 172.21.15.154:0/4173696002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9240064e0 msgr2=0x7ff938109950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-10T03:34:11.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.921+0000 7ff93dccd700 1 --2- 172.21.15.154:0/4173696002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9240064e0 0x7ff938109950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T03:34:11.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.921+0000 7ff93dccd700 1 --2- 172.21.15.154:0/4173696002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9240064e0 0x7ff938109950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-10T03:34:11.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.921+0000 7ff93e4ce700 1 -- 172.21.15.154:0/4173696002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9381a34f0 msgr2=0x7ff9381a5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-05-10T03:34:11.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.921+0000 7ff93e4ce700 1 -- 172.21.15.154:0/4173696002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9381a34f0 msgr2=0x7ff9381a5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-10T03:34:11.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.921+0000 7ff93e4ce700 1 --2- 172.21.15.154:0/4173696002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9381a34f0 0x7ff9381a5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T03:34:11.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.921+0000 7ff93e4ce700 1 --2- 172.21.15.154:0/4173696002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9381a34f0 0x7ff9381a5910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-10T03:34:11.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.921+0000 7ff93d4cc700 1 -- 172.21.15.154:0/4173696002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9240064e0 msgr2=0x7ff938109950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-10T03:34:11.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.921+0000 7ff93d4cc700 1 --2- 172.21.15.154:0/4173696002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9240064e0 0x7ff938109950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:11.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.921+0000 7ff93d4cc700 1 -- 172.21.15.154:0/4173696002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9381a34f0 msgr2=0x7ff9381a5910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-10T03:34:11.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.921+0000 7ff93d4cc700 1 --2- 172.21.15.154:0/4173696002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9381a34f0 0x7ff9381a5910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:11.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.921+0000 7ff93d4cc700 1 -- 172.21.15.154:0/4173696002 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92c00f8e0 con 0x7ff938109e90 2024-05-10T03:34:11.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.921+0000 7ff93d4cc700 1 --2- 172.21.15.154:0/4173696002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff938109e90 0x7ff93810a2a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff93400b550 tx=0x7ff93400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:34:11.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.921+0000 7ff92affd700 1 -- 172.21.15.154:0/4173696002 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934004230 con 0x7ff938109e90 2024-05-10T03:34:11.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.921+0000 7ff92affd700 1 -- 172.21.15.154:0/4173696002 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff934004390 con 0x7ff938109e90 2024-05-10T03:34:11.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.921+0000 7ff93ff31700 1 -- 172.21.15.154:0/4173696002 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9381a6490 con 0x7ff938109e90 2024-05-10T03:34:11.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.921+0000 7ff92affd700 1 -- 172.21.15.154:0/4173696002 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934011b90 con 0x7ff938109e90 2024-05-10T03:34:11.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.921+0000 7ff93ff31700 1 -- 172.21.15.154:0/4173696002 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9381a6a10 con 0x7ff938109e90 2024-05-10T03:34:11.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.922+0000 7ff93ff31700 1 -- 172.21.15.154:0/4173696002 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff938101c00 con 0x7ff938109e90 2024-05-10T03:34:11.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.923+0000 7ff92affd700 1 -- 172.21.15.154:0/4173696002 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7ff934011cf0 con 0x7ff938109e90 2024-05-10T03:34:11.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.923+0000 7ff92affd700 1 --2- 172.21.15.154:0/4173696002 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff91c038c70 0x7ff91c03b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:11.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.923+0000 7ff92affd700 1 -- 172.21.15.154:0/4173696002 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff93404ac60 con 0x7ff938109e90 2024-05-10T03:34:11.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.923+0000 7ff93dccd700 1 --2- 172.21.15.154:0/4173696002 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff91c038c70 0x7ff91c03b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:11.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.924+0000 7ff93dccd700 1 --2- 172.21.15.154:0/4173696002 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff91c038c70 0x7ff91c03b180 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff92c010010 tx=0x7ff92c00f5c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:34:11.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:11.928+0000 7ff92affd700 1 -- 172.21.15.154:0/4173696002 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff9340214d0 con 0x7ff938109e90 2024-05-10T03:34:12.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:12.215+0000 7ff93ff31700 1 -- 172.21.15.154:0/4173696002 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff9381083e0 con 0x7ff938109e90 2024-05-10T03:34:12.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:12.216+0000 7ff92affd700 1 -- 172.21.15.154:0/4173696002 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1276 (secure 0 0 0) 0x7ff9340212f0 con 0x7ff938109e90 2024-05-10T03:34:12.219 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-05-10T03:34:12.219 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":3,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","modified":"2024-05-10T03:34:05.880872Z","created":"2024-05-10T03:32:34.369158Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:3300","nonce":0},{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-05-10T03:34:12.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:12.218+0000 7ff93ff31700 1 -- 172.21.15.154:0/4173696002 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff91c038c70 msgr2=0x7ff91c03b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:12.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:12.218+0000 7ff93ff31700 1 --2- 172.21.15.154:0/4173696002 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff91c038c70 0x7ff91c03b180 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff92c010010 tx=0x7ff92c00f5c0 comp rx=0 tx=0).stop 2024-05-10T03:34:12.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:12.218+0000 7ff93ff31700 1 -- 172.21.15.154:0/4173696002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff938109e90 msgr2=0x7ff93810a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:12.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:12.218+0000 7ff93ff31700 1 --2- 172.21.15.154:0/4173696002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff938109e90 0x7ff93810a2a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff93400b550 tx=0x7ff93400b910 comp rx=0 tx=0).stop 2024-05-10T03:34:12.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:12.218+0000 7ff93ff31700 1 -- 172.21.15.154:0/4173696002 shutdown_connections 2024-05-10T03:34:12.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:12.218+0000 7ff93ff31700 1 --2- 172.21.15.154:0/4173696002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9240064e0 0x7ff938109950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:12.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:12.218+0000 7ff93ff31700 1 --2- 172.21.15.154:0/4173696002 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff91c038c70 0x7ff91c03b180 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:12.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:12.218+0000 7ff93ff31700 1 --2- 172.21.15.154:0/4173696002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9381a34f0 0x7ff9381a5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:12.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:12.218+0000 7ff93ff31700 1 --2- 172.21.15.154:0/4173696002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff938109e90 0x7ff93810a2a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:12.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:12.218+0000 7ff93ff31700 1 -- 172.21.15.154:0/4173696002 >> 172.21.15.154:0/4173696002 conn(0x7ff938076030 msgr2=0x7ff9380fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:34:12.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:12.218+0000 7ff93ff31700 1 -- 172.21.15.154:0/4173696002 shutdown_connections 2024-05-10T03:34:12.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:12.218+0000 7ff93ff31700 1 -- 172.21.15.154:0/4173696002 wait complete. 2024-05-10T03:34:12.222 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 3 2024-05-10T03:34:12.246 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:11 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:12.246 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:11 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:12.246 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:11 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:12.246 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:11 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:34:12.246 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:11 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:12.246 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:11 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:12.246 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:11 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:12.246 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:11 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:12.246 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:11 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:12.246 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:11 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:12.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:11 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:12.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:11 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:12.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:11 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:12.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:11 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:34:12.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:11 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:12.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:11 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:12.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:11 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:12.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:11 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:12.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:11 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:12.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:11 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:12.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:11 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:12.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:11 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:12.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:11 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:12.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:11 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:34:12.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:11 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:12.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:11 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:12.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:11 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:12.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:11 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:12.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:11 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:12.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:11 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:12.655 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-10T03:34:12.655 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph config generate-minimal-conf 2024-05-10T03:34:12.917 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:34:13.244 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:12 smithi045 ceph-mon[42520]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:13.245 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:12 smithi045 ceph-mon[42520]: Updating smithi045:/etc/ceph/ceph.conf 2024-05-10T03:34:13.245 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:12 smithi045 ceph-mon[42520]: Updating smithi106:/etc/ceph/ceph.conf 2024-05-10T03:34:13.245 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:12 smithi045 ceph-mon[42520]: Updating smithi154:/etc/ceph/ceph.conf 2024-05-10T03:34:13.245 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:12 smithi045 ceph-mon[42520]: from='client.? 172.21.15.154:0/4173696002' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-10T03:34:13.245 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.245 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.245 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.245 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.245 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.245 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.245 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.245 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.245 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.246 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.246 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.246 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T03:34:13.246 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-10T03:34:13.246 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:13.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:12 smithi106 ceph-mon[46996]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:13.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:12 smithi106 ceph-mon[46996]: Updating smithi045:/etc/ceph/ceph.conf 2024-05-10T03:34:13.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:12 smithi106 ceph-mon[46996]: Updating smithi106:/etc/ceph/ceph.conf 2024-05-10T03:34:13.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:12 smithi106 ceph-mon[46996]: Updating smithi154:/etc/ceph/ceph.conf 2024-05-10T03:34:13.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:12 smithi106 ceph-mon[46996]: from='client.? 172.21.15.154:0/4173696002' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-10T03:34:13.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T03:34:13.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-10T03:34:13.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:13.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:12 smithi154 ceph-mon[46565]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:13.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:12 smithi154 ceph-mon[46565]: Updating smithi045:/etc/ceph/ceph.conf 2024-05-10T03:34:13.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:12 smithi154 ceph-mon[46565]: Updating smithi106:/etc/ceph/ceph.conf 2024-05-10T03:34:13.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:12 smithi154 ceph-mon[46565]: Updating smithi154:/etc/ceph/ceph.conf 2024-05-10T03:34:13.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:12 smithi154 ceph-mon[46565]: from='client.? 172.21.15.154:0/4173696002' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-10T03:34:13.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:13.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T03:34:13.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-10T03:34:13.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:14.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:14 smithi045 ceph-mon[42520]: Updating smithi154:/var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T03:34:14.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:14 smithi045 ceph-mon[42520]: Updating smithi106:/var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T03:34:14.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:14 smithi045 ceph-mon[42520]: Updating smithi045:/var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T03:34:14.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:14 smithi045 ceph-mon[42520]: Reconfiguring mon.a (unknown last config time)... 2024-05-10T03:34:14.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:14 smithi045 ceph-mon[42520]: Reconfiguring daemon mon.a on smithi045 2024-05-10T03:34:14.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:14 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:14.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:14 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.389+0000 7f9158188700 1 -- 172.21.15.45:0/1660836735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91501060c0 msgr2=0x7f915010da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.389+0000 7f9158188700 1 --2- 172.21.15.45:0/1660836735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91501060c0 0x7f915010da20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9148009990 tx=0x7f9148009ca0 comp rx=0 tx=0).stop 2024-05-10T03:34:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.389+0000 7f9158188700 1 -- 172.21.15.45:0/1660836735 shutdown_connections 2024-05-10T03:34:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.389+0000 7f9158188700 1 --2- 172.21.15.45:0/1660836735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9150100e40 0x7f9150101250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.389+0000 7f9158188700 1 --2- 172.21.15.45:0/1660836735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91501060c0 0x7f915010da20 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.389+0000 7f9158188700 1 --2- 172.21.15.45:0/1660836735 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9150105770 0x7f9150105b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.389+0000 7f9158188700 1 -- 172.21.15.45:0/1660836735 >> 172.21.15.45:0/1660836735 conn(0x7f91500fc760 msgr2=0x7f91500feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:34:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.390+0000 7f9158188700 1 -- 172.21.15.45:0/1660836735 shutdown_connections 2024-05-10T03:34:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.390+0000 7f9158188700 1 -- 172.21.15.45:0/1660836735 wait complete. 2024-05-10T03:34:14.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.390+0000 7f9158188700 1 Processor -- start 2024-05-10T03:34:14.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.390+0000 7f9158188700 1 -- start start 2024-05-10T03:34:14.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.391+0000 7f9158188700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9150100e40 0x7f91500fcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:14.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.391+0000 7f9158188700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9150105770 0x7f91500fd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:14.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.391+0000 7f9158188700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91501060c0 0x7f91501a6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.391+0000 7f9158188700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91500fd9f0 con 0x7f9150105770 2024-05-10T03:34:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.391+0000 7f9158188700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91501a6c40 con 0x7f9150100e40 2024-05-10T03:34:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.391+0000 7f9158188700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91501a6d80 con 0x7f91501060c0 2024-05-10T03:34:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.391+0000 7f9155723700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9150105770 0x7f91500fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.391+0000 7f9155723700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9150105770 0x7f91500fd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38330/0 (socket says 172.21.15.45:38330) 2024-05-10T03:34:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.391+0000 7f9155723700 1 -- 172.21.15.45:0/1470054584 learned_addr learned my addr 172.21.15.45:0/1470054584 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:34:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.391+0000 7f9155f24700 1 --2- 172.21.15.45:0/1470054584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9150100e40 0x7f91500fcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.391+0000 7f9156725700 1 --2- 172.21.15.45:0/1470054584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91501060c0 0x7f91501a6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.391+0000 7f9155723700 1 -- 172.21.15.45:0/1470054584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91501060c0 msgr2=0x7f91501a6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.391+0000 7f9155723700 1 --2- 172.21.15.45:0/1470054584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91501060c0 0x7f91501a6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.391+0000 7f9155723700 1 -- 172.21.15.45:0/1470054584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9150100e40 msgr2=0x7f91500fcc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.391+0000 7f9155723700 1 --2- 172.21.15.45:0/1470054584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9150100e40 0x7f91500fcc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:14.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.391+0000 7f9155723700 1 -- 172.21.15.45:0/1470054584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9140009520 con 0x7f9150105770 2024-05-10T03:34:14.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.391+0000 7f9155f24700 1 --2- 172.21.15.45:0/1470054584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9150100e40 0x7f91500fcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:34:14.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.391+0000 7f9155723700 1 --2- 172.21.15.45:0/1470054584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9150105770 0x7f91500fd180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f914000ea30 tx=0x7f914000ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:34:14.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.392+0000 7f9146ffd700 1 -- 172.21.15.45:0/1470054584 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9140009820 con 0x7f9150105770 2024-05-10T03:34:14.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.392+0000 7f9146ffd700 1 -- 172.21.15.45:0/1470054584 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9140004500 con 0x7f9150105770 2024-05-10T03:34:14.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.392+0000 7f9146ffd700 1 -- 172.21.15.45:0/1470054584 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9140010430 con 0x7f9150105770 2024-05-10T03:34:14.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.392+0000 7f9158188700 1 -- 172.21.15.45:0/1470054584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91480095f0 con 0x7f9150105770 2024-05-10T03:34:14.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.392+0000 7f9158188700 1 -- 172.21.15.45:0/1470054584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91501a7290 con 0x7f9150105770 2024-05-10T03:34:14.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.393+0000 7f9146ffd700 1 -- 172.21.15.45:0/1470054584 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f9140010590 con 0x7f9150105770 2024-05-10T03:34:14.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.393+0000 7f9158188700 1 -- 172.21.15.45:0/1470054584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f915010a080 con 0x7f9150105770 2024-05-10T03:34:14.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.393+0000 7f9146ffd700 1 --2- 172.21.15.45:0/1470054584 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f913c0389d0 0x7f913c03aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:14.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.393+0000 7f9146ffd700 1 -- 172.21.15.45:0/1470054584 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9140014070 con 0x7f9150105770 2024-05-10T03:34:14.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.393+0000 7f9155f24700 1 --2- 172.21.15.45:0/1470054584 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f913c0389d0 0x7f913c03aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:14.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.394+0000 7f9155f24700 1 --2- 172.21.15.45:0/1470054584 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f913c0389d0 0x7f913c03aee0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f914c009480 tx=0x7f914c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:34:14.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:14 smithi106 ceph-mon[46996]: Updating smithi154:/var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T03:34:14.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:14 smithi106 ceph-mon[46996]: Updating smithi106:/var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T03:34:14.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:14 smithi106 ceph-mon[46996]: Updating smithi045:/var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T03:34:14.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:14 smithi106 ceph-mon[46996]: Reconfiguring mon.a (unknown last config time)... 2024-05-10T03:34:14.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:14 smithi106 ceph-mon[46996]: Reconfiguring daemon mon.a on smithi045 2024-05-10T03:34:14.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:14 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:14.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:14 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:14.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.398+0000 7f9146ffd700 1 -- 172.21.15.45:0/1470054584 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9140016330 con 0x7f9150105770 2024-05-10T03:34:14.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:14 smithi154 ceph-mon[46565]: Updating smithi154:/var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T03:34:14.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:14 smithi154 ceph-mon[46565]: Updating smithi106:/var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T03:34:14.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:14 smithi154 ceph-mon[46565]: Updating smithi045:/var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T03:34:14.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:14 smithi154 ceph-mon[46565]: Reconfiguring mon.a (unknown last config time)... 2024-05-10T03:34:14.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:14 smithi154 ceph-mon[46565]: Reconfiguring daemon mon.a on smithi045 2024-05-10T03:34:14.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:14 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:14.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:14 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:14.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.609+0000 7f9158188700 1 -- 172.21.15.45:0/1470054584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f915004edc0 con 0x7f9150105770 2024-05-10T03:34:14.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.609+0000 7f9146ffd700 1 -- 172.21.15.45:0/1470054584 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+275 (secure 0 0 0) 0x7f914001fb30 con 0x7f9150105770 2024-05-10T03:34:14.613 INFO:teuthology.orchestra.run.smithi045.stdout:# minimal ceph.conf for d2a0bafa-0e7d-11ef-bc98-c7b262605968 2024-05-10T03:34:14.613 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2024-05-10T03:34:14.613 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = d2a0bafa-0e7d-11ef-bc98-c7b262605968 2024-05-10T03:34:14.614 INFO:teuthology.orchestra.run.smithi045.stdout: mon_host = [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-05-10T03:34:14.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.611+0000 7f9158188700 1 -- 172.21.15.45:0/1470054584 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f913c0389d0 msgr2=0x7f913c03aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:14.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.611+0000 7f9158188700 1 --2- 172.21.15.45:0/1470054584 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f913c0389d0 0x7f913c03aee0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f914c009480 tx=0x7f914c00b040 comp rx=0 tx=0).stop 2024-05-10T03:34:14.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.612+0000 7f9158188700 1 -- 172.21.15.45:0/1470054584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9150105770 msgr2=0x7f91500fd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:14.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.612+0000 7f9158188700 1 --2- 172.21.15.45:0/1470054584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9150105770 0x7f91500fd180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f914000ea30 tx=0x7f914000ed40 comp rx=0 tx=0).stop 2024-05-10T03:34:14.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.612+0000 7f9158188700 1 -- 172.21.15.45:0/1470054584 shutdown_connections 2024-05-10T03:34:14.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.612+0000 7f9158188700 1 --2- 172.21.15.45:0/1470054584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91501060c0 0x7f91501a6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:14.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.612+0000 7f9158188700 1 --2- 172.21.15.45:0/1470054584 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f913c0389d0 0x7f913c03aee0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:14.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.612+0000 7f9158188700 1 --2- 172.21.15.45:0/1470054584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9150100e40 0x7f91500fcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:14.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.612+0000 7f9158188700 1 --2- 172.21.15.45:0/1470054584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9150105770 0x7f91500fd180 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:14.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.612+0000 7f9158188700 1 -- 172.21.15.45:0/1470054584 >> 172.21.15.45:0/1470054584 conn(0x7f91500fc760 msgr2=0x7f91500ff120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:34:14.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.612+0000 7f9158188700 1 -- 172.21.15.45:0/1470054584 shutdown_connections 2024-05-10T03:34:14.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:14.612+0000 7f9158188700 1 -- 172.21.15.45:0/1470054584 wait complete. 2024-05-10T03:34:15.045 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-10T03:34:15.046 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-10T03:34:15.046 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.conf 2024-05-10T03:34:15.084 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-10T03:34:15.084 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-10T03:34:15.159 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T03:34:15.159 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.conf 2024-05-10T03:34:15.189 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T03:34:15.189 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-10T03:34:15.256 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-10T03:34:15.256 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.conf 2024-05-10T03:34:15.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:15 smithi045 ceph-mon[42520]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:15.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:15 smithi045 ceph-mon[42520]: Reconfiguring mon.b (monmap changed)... 2024-05-10T03:34:15.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:15 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T03:34:15.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:15 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-10T03:34:15.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:15 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:15.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:15 smithi045 ceph-mon[42520]: Reconfiguring daemon mon.b on smithi106 2024-05-10T03:34:15.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:15 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1470054584' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:15.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:15 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:15.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:15 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:15.288 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-10T03:34:15.288 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-10T03:34:15.353 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:15 smithi154 ceph-mon[46565]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:15.353 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:15 smithi154 ceph-mon[46565]: Reconfiguring mon.b (monmap changed)... 2024-05-10T03:34:15.353 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:15 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T03:34:15.353 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:15 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-10T03:34:15.353 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:15 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:15.353 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:15 smithi154 ceph-mon[46565]: Reconfiguring daemon mon.b on smithi106 2024-05-10T03:34:15.353 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:15 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1470054584' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:15.353 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:15 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:15.353 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:15 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:15.356 INFO:tasks.cephadm:Adding mgr.x on smithi045 2024-05-10T03:34:15.356 INFO:tasks.cephadm:Adding mgr.y on smithi106 2024-05-10T03:34:15.356 INFO:tasks.cephadm:Adding mgr.z on smithi154 2024-05-10T03:34:15.357 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph orch apply mgr '3;smithi045=x;smithi106=y;smithi154=z' 2024-05-10T03:34:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:15 smithi106 ceph-mon[46996]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:15 smithi106 ceph-mon[46996]: Reconfiguring mon.b (monmap changed)... 2024-05-10T03:34:15.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:15 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T03:34:15.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:15 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-10T03:34:15.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:15 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:15.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:15 smithi106 ceph-mon[46996]: Reconfiguring daemon mon.b on smithi106 2024-05-10T03:34:15.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:15 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1470054584' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:15.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:15 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:15.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:15 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:15.742 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T03:34:16.267 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:16 smithi154 ceph-mon[46565]: Reconfiguring mon.c (monmap changed)... 2024-05-10T03:34:16.267 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T03:34:16.267 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-10T03:34:16.267 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:16.267 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:16.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:16 smithi106 ceph-mon[46996]: Reconfiguring mon.c (monmap changed)... 2024-05-10T03:34:16.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T03:34:16.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-10T03:34:16.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:16.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:16.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:16 smithi045 ceph-mon[42520]: Reconfiguring mon.c (monmap changed)... 2024-05-10T03:34:16.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T03:34:16.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-10T03:34:16.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:16.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:16.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.974+0000 7fb1a117c700 1 -- 172.21.15.154:0/3321335147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb19c107a70 msgr2=0x7fb19c109e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:16.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.974+0000 7fb1a117c700 1 --2- 172.21.15.154:0/3321335147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb19c107a70 0x7fb19c109e90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb194009f90 tx=0x7fb19400b330 comp rx=0 tx=0).stop 2024-05-10T03:34:16.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.974+0000 7fb1a117c700 1 -- 172.21.15.154:0/3321335147 shutdown_connections 2024-05-10T03:34:16.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.974+0000 7fb1a117c700 1 --2- 172.21.15.154:0/3321335147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb19c107a70 0x7fb19c109e90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:16.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.974+0000 7fb1a117c700 1 --2- 172.21.15.154:0/3321335147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb19c1027b0 0x7fb19c104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:16.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.974+0000 7fb1a117c700 1 --2- 172.21.15.154:0/3321335147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb19c105110 0x7fb19c107530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:16.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.974+0000 7fb1a117c700 1 -- 172.21.15.154:0/3321335147 >> 172.21.15.154:0/3321335147 conn(0x7fb19c0fc1d0 msgr2=0x7fb19c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:34:16.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.974+0000 7fb1a117c700 1 -- 172.21.15.154:0/3321335147 shutdown_connections 2024-05-10T03:34:16.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.974+0000 7fb1a117c700 1 -- 172.21.15.154:0/3321335147 wait complete. 2024-05-10T03:34:16.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.975+0000 7fb1a117c700 1 Processor -- start 2024-05-10T03:34:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.975+0000 7fb1a117c700 1 -- start start 2024-05-10T03:34:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.976+0000 7fb1a117c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb19c1027b0 0x7fb19c198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.976+0000 7fb1a117c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb19c105110 0x7fb19c198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.976+0000 7fb1a117c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb19c107a70 0x7fb19c199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.976+0000 7fb1a117c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c199c60 con 0x7fb19c1027b0 2024-05-10T03:34:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.976+0000 7fb1a117c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c199da0 con 0x7fb19c105110 2024-05-10T03:34:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.976+0000 7fb1a117c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c199f60 con 0x7fb19c107a70 2024-05-10T03:34:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.976+0000 7fb19b59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb19c107a70 0x7fb19c199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.976+0000 7fb19b59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb19c107a70 0x7fb19c199600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56540/0 (socket says 172.21.15.154:56540) 2024-05-10T03:34:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.976+0000 7fb19b59e700 1 -- 172.21.15.154:0/1191777200 learned_addr learned my addr 172.21.15.154:0/1191777200 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-10T03:34:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.976+0000 7fb19a59c700 1 --2- 172.21.15.154:0/1191777200 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb19c105110 0x7fb19c198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.976+0000 7fb19ad9d700 1 --2- 172.21.15.154:0/1191777200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb19c1027b0 0x7fb19c198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.976+0000 7fb19b59e700 1 -- 172.21.15.154:0/1191777200 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb19c105110 msgr2=0x7fb19c198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.976+0000 7fb19b59e700 1 --2- 172.21.15.154:0/1191777200 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb19c105110 0x7fb19c198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:16.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.976+0000 7fb19b59e700 1 -- 172.21.15.154:0/1191777200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb19c1027b0 msgr2=0x7fb19c198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:16.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.976+0000 7fb19b59e700 1 --2- 172.21.15.154:0/1191777200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb19c1027b0 0x7fb19c198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:16.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.976+0000 7fb19b59e700 1 -- 172.21.15.154:0/1191777200 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb194009c40 con 0x7fb19c107a70 2024-05-10T03:34:16.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.976+0000 7fb19b59e700 1 --2- 172.21.15.154:0/1191777200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb19c107a70 0x7fb19c199600 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb194007b40 tx=0x7fb194007500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:34:16.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.976+0000 7fb183fff700 1 -- 172.21.15.154:0/1191777200 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19400e040 con 0x7fb19c107a70 2024-05-10T03:34:16.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.976+0000 7fb183fff700 1 -- 172.21.15.154:0/1191777200 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb19400bbf0 con 0x7fb19c107a70 2024-05-10T03:34:16.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.976+0000 7fb183fff700 1 -- 172.21.15.154:0/1191777200 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1940052a0 con 0x7fb19c107a70 2024-05-10T03:34:16.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.976+0000 7fb1a117c700 1 -- 172.21.15.154:0/1191777200 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19c19a1e0 con 0x7fb19c107a70 2024-05-10T03:34:16.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.977+0000 7fb1a117c700 1 -- 172.21.15.154:0/1191777200 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb19c1a0a20 con 0x7fb19c107a70 2024-05-10T03:34:16.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.977+0000 7fb1a117c700 1 -- 172.21.15.154:0/1191777200 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb19c0fdd80 con 0x7fb19c107a70 2024-05-10T03:34:16.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.977+0000 7fb183fff700 1 -- 172.21.15.154:0/1191777200 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fb194005400 con 0x7fb19c107a70 2024-05-10T03:34:16.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.978+0000 7fb183fff700 1 --2- 172.21.15.154:0/1191777200 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb1840389d0 0x7fb18403aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:16.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.978+0000 7fb183fff700 1 -- 172.21.15.154:0/1191777200 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb19404ca20 con 0x7fb19c107a70 2024-05-10T03:34:16.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.978+0000 7fb19ad9d700 1 --2- 172.21.15.154:0/1191777200 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb1840389d0 0x7fb18403aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:16.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.978+0000 7fb19ad9d700 1 --2- 172.21.15.154:0/1191777200 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb1840389d0 0x7fb18403aee0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb19c06a370 tx=0x7fb18c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:34:16.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:16.983+0000 7fb183fff700 1 -- 172.21.15.154:0/1191777200 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb194011390 con 0x7fb19c107a70 2024-05-10T03:34:17.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:17.187+0000 7fb1a117c700 1 -- 172.21.15.154:0/1191777200 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi045=x;smithi106=y;smithi154=z", "target": ["mon-mgr", ""]}) v1 -- 0x7fb19c10d750 con 0x7fb1840389d0 2024-05-10T03:34:17.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:17.194+0000 7fb183fff700 1 -- 172.21.15.154:0/1191777200 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fb19c10d750 con 0x7fb1840389d0 2024-05-10T03:34:17.197 INFO:teuthology.orchestra.run.smithi154.stdout:Scheduled mgr update... 2024-05-10T03:34:17.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:17.196+0000 7fb1a117c700 1 -- 172.21.15.154:0/1191777200 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb1840389d0 msgr2=0x7fb18403aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:17.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:17.196+0000 7fb1a117c700 1 --2- 172.21.15.154:0/1191777200 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb1840389d0 0x7fb18403aee0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb19c06a370 tx=0x7fb18c009260 comp rx=0 tx=0).stop 2024-05-10T03:34:17.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:17.196+0000 7fb1a117c700 1 -- 172.21.15.154:0/1191777200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb19c107a70 msgr2=0x7fb19c199600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:17.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:17.196+0000 7fb1a117c700 1 --2- 172.21.15.154:0/1191777200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb19c107a70 0x7fb19c199600 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb194007b40 tx=0x7fb194007500 comp rx=0 tx=0).stop 2024-05-10T03:34:17.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:17.196+0000 7fb1a117c700 1 -- 172.21.15.154:0/1191777200 shutdown_connections 2024-05-10T03:34:17.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:17.196+0000 7fb1a117c700 1 --2- 172.21.15.154:0/1191777200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb19c107a70 0x7fb19c199600 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:17.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:17.196+0000 7fb1a117c700 1 --2- 172.21.15.154:0/1191777200 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb1840389d0 0x7fb18403aee0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:17.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:17.196+0000 7fb1a117c700 1 --2- 172.21.15.154:0/1191777200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb19c1027b0 0x7fb19c198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:17.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:17.196+0000 7fb1a117c700 1 --2- 172.21.15.154:0/1191777200 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb19c105110 0x7fb19c198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:17.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:17.196+0000 7fb1a117c700 1 -- 172.21.15.154:0/1191777200 >> 172.21.15.154:0/1191777200 conn(0x7fb19c0fc1d0 msgr2=0x7fb19c103710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:34:17.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:17.196+0000 7fb1a117c700 1 -- 172.21.15.154:0/1191777200 shutdown_connections 2024-05-10T03:34:17.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:17.196+0000 7fb1a117c700 1 -- 172.21.15.154:0/1191777200 wait complete. 2024-05-10T03:34:17.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:17 smithi106 ceph-mon[46996]: Reconfiguring daemon mon.c on smithi154 2024-05-10T03:34:17.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:17 smithi106 ceph-mon[46996]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:17.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:17 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:17.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:17 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:17.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:17 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:17.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:17 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:17.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:17 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:17.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:17 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:17.415 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:17 smithi154 ceph-mon[46565]: Reconfiguring daemon mon.c on smithi154 2024-05-10T03:34:17.415 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:17 smithi154 ceph-mon[46565]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:17.415 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:17 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:17.415 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:17 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:17.415 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:17 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:17.415 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:17 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:17.415 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:17 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:17.415 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:17 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:17.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:17 smithi045 ceph-mon[42520]: Reconfiguring daemon mon.c on smithi154 2024-05-10T03:34:17.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:17 smithi045 ceph-mon[42520]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:17.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:17 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:17.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:17 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:17.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:17 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:17.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:17 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:17.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:17 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:17.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:17 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:17.613 DEBUG:teuthology.orchestra.run.smithi106:mgr.y> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mgr.y.service 2024-05-10T03:34:17.616 DEBUG:teuthology.orchestra.run.smithi154:mgr.z> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mgr.z.service 2024-05-10T03:34:17.618 INFO:tasks.cephadm:Deploying OSDs... 2024-05-10T03:34:17.618 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-10T03:34:17.618 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/scratch_devs of=/dev/stdout 2024-05-10T03:34:17.641 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-10T03:34:17.641 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_1 2024-05-10T03:34:17.648 INFO:journalctl@ceph.mgr.y.smithi106.stdout:-- Logs begin at Fri 2024-05-10 03:15:26 UTC. -- 2024-05-10T03:34:17.652 INFO:journalctl@ceph.mgr.z.smithi154.stdout:-- Logs begin at Fri 2024-05-10 03:15:42 UTC. -- 2024-05-10T03:34:17.703 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-10T03:34:17.703 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T03:34:17.704 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 6h/6d Inode: 180952 Links: 1 2024-05-10T03:34:17.704 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T03:34:17.704 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T03:34:17.704 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-05-10 03:33:35.975285496 +0000 2024-05-10T03:34:17.704 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-05-10 03:27:01.537117174 +0000 2024-05-10T03:34:17.704 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-05-10 03:27:01.537117174 +0000 2024-05-10T03:34:17.704 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2024-05-10T03:34:17.704 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-10T03:34:17.777 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2024-05-10T03:34:17.777 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2024-05-10T03:34:17.777 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000110409 s, 4.6 MB/s 2024-05-10T03:34:17.779 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-10T03:34:17.842 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_2 2024-05-10T03:34:17.904 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-10T03:34:17.904 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T03:34:17.904 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 6h/6d Inode: 181790 Links: 1 2024-05-10T03:34:17.904 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T03:34:17.904 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T03:34:17.904 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-05-10 03:33:36.039284473 +0000 2024-05-10T03:34:17.904 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-05-10 03:27:01.890111603 +0000 2024-05-10T03:34:17.904 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-05-10 03:27:01.890111603 +0000 2024-05-10T03:34:17.904 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2024-05-10T03:34:17.905 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-10T03:34:17.977 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2024-05-10T03:34:17.977 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2024-05-10T03:34:17.977 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000120497 s, 4.2 MB/s 2024-05-10T03:34:17.979 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-10T03:34:18.043 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_3 2024-05-10T03:34:18.106 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-10T03:34:18.106 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T03:34:18.106 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 6h/6d Inode: 181870 Links: 1 2024-05-10T03:34:18.106 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T03:34:18.106 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T03:34:18.106 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-05-10 03:33:36.092283626 +0000 2024-05-10T03:34:18.106 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-05-10 03:27:02.277105495 +0000 2024-05-10T03:34:18.106 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-05-10 03:27:02.277105495 +0000 2024-05-10T03:34:18.106 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2024-05-10T03:34:18.107 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-10T03:34:18.179 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2024-05-10T03:34:18.180 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2024-05-10T03:34:18.180 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000130504 s, 3.9 MB/s 2024-05-10T03:34:18.181 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-10T03:34:18.246 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_4 2024-05-10T03:34:18.308 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-10T03:34:18.308 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T03:34:18.308 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 6h/6d Inode: 182649 Links: 1 2024-05-10T03:34:18.308 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T03:34:18.309 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T03:34:18.309 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-05-10 03:33:36.155282620 +0000 2024-05-10T03:34:18.309 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-05-10 03:27:02.653099561 +0000 2024-05-10T03:34:18.309 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-05-10 03:27:02.653099561 +0000 2024-05-10T03:34:18.309 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2024-05-10T03:34:18.309 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-10T03:34:18.350 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:18 smithi154 ceph-mon[46565]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi045=x;smithi106=y;smithi154=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:34:18.350 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:18 smithi154 ceph-mon[46565]: Saving service mgr spec with placement smithi045=x;smithi106=y;smithi154=z;count:3 2024-05-10T03:34:18.350 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:18 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:18.350 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:18 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:18.350 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:18 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:18.350 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:18 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:18.350 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:18 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:18.350 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:18 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-10T03:34:18.350 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:18 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-10T03:34:18.350 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:18 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-10T03:34:18.350 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:18 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:18.351 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:18 smithi154 ceph-mon[46565]: Deploying daemon mgr.z on smithi154 2024-05-10T03:34:18.351 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:18 smithi154 ceph-mon[46565]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:18.381 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2024-05-10T03:34:18.381 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2024-05-10T03:34:18.381 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000110592 s, 4.6 MB/s 2024-05-10T03:34:18.383 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-10T03:34:18.447 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-10T03:34:18.447 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/scratch_devs of=/dev/stdout 2024-05-10T03:34:18.468 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-10T03:34:18.468 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_1 2024-05-10T03:34:18.529 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-10T03:34:18.529 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T03:34:18.530 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 184360 Links: 1 2024-05-10T03:34:18.530 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T03:34:18.530 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T03:34:18.530 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-05-10 03:34:05.423784709 +0000 2024-05-10T03:34:18.530 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-05-10 03:26:11.492879694 +0000 2024-05-10T03:34:18.530 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-05-10 03:26:11.492879694 +0000 2024-05-10T03:34:18.530 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2024-05-10T03:34:18.530 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-10T03:34:18.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:18 smithi045 ceph-mon[42520]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi045=x;smithi106=y;smithi154=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:34:18.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:18 smithi045 ceph-mon[42520]: Saving service mgr spec with placement smithi045=x;smithi106=y;smithi154=z;count:3 2024-05-10T03:34:18.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:18 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:18.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:18 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:18.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:18 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:18.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:18 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:18.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:18 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:18.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:18 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-10T03:34:18.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:18 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-10T03:34:18.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:18 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-10T03:34:18.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:18 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:18.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:18 smithi045 ceph-mon[42520]: Deploying daemon mgr.z on smithi154 2024-05-10T03:34:18.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:18 smithi045 ceph-mon[42520]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:18.596 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:18 smithi106 ceph-mon[46996]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi045=x;smithi106=y;smithi154=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:34:18.596 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:18 smithi106 ceph-mon[46996]: Saving service mgr spec with placement smithi045=x;smithi106=y;smithi154=z;count:3 2024-05-10T03:34:18.596 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:18 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:18.596 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:18 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:18.596 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:18 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:18.596 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:18 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:18.596 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:18 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:18.596 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:18 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-10T03:34:18.597 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:18 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-10T03:34:18.597 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:18 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-10T03:34:18.597 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:18 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:18.597 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:18 smithi106 ceph-mon[46996]: Deploying daemon mgr.z on smithi154 2024-05-10T03:34:18.597 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:18 smithi106 ceph-mon[46996]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:18.599 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-05-10T03:34:18.599 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-05-10T03:34:18.599 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000267177 s, 1.9 MB/s 2024-05-10T03:34:18.600 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-10T03:34:18.661 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_2 2024-05-10T03:34:18.720 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-10T03:34:18.721 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T03:34:18.721 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 181034 Links: 1 2024-05-10T03:34:18.721 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T03:34:18.721 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T03:34:18.721 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-05-10 03:34:05.423784709 +0000 2024-05-10T03:34:18.721 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-05-10 03:26:11.841878123 +0000 2024-05-10T03:34:18.721 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-05-10 03:26:11.841878123 +0000 2024-05-10T03:34:18.721 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2024-05-10T03:34:18.721 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-10T03:34:18.724 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:18 smithi154 systemd[1]: Starting Ceph mgr.z for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:34:18.789 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-05-10T03:34:18.789 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-05-10T03:34:18.789 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000275923 s, 1.9 MB/s 2024-05-10T03:34:18.790 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-10T03:34:18.851 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_3 2024-05-10T03:34:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-10T03:34:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T03:34:18.910 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 181130 Links: 1 2024-05-10T03:34:18.910 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T03:34:18.910 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T03:34:18.911 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-05-10 03:34:05.423784709 +0000 2024-05-10T03:34:18.911 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-05-10 03:26:12.188876561 +0000 2024-05-10T03:34:18.911 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-05-10 03:26:12.188876561 +0000 2024-05-10T03:34:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2024-05-10T03:34:18.911 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-10T03:34:18.978 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-05-10T03:34:18.978 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-05-10T03:34:18.978 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000172156 s, 3.0 MB/s 2024-05-10T03:34:18.979 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-10T03:34:19.039 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_4 2024-05-10T03:34:19.098 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-10T03:34:19.098 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T03:34:19.098 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 181185 Links: 1 2024-05-10T03:34:19.098 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T03:34:19.098 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T03:34:19.098 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-05-10 03:34:05.423784709 +0000 2024-05-10T03:34:19.099 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-05-10 03:26:12.531875016 +0000 2024-05-10T03:34:19.099 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-05-10 03:26:12.531875016 +0000 2024-05-10T03:34:19.099 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2024-05-10T03:34:19.099 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-10T03:34:19.166 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-05-10T03:34:19.166 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-05-10T03:34:19.166 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000236392 s, 2.2 MB/s 2024-05-10T03:34:19.167 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-10T03:34:19.224 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:18 smithi154 ceph-mgr[48446]: -- 172.21.15.154:0/718298991 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e8e8fa61a0 con 0x55e8e9003a80 2024-05-10T03:34:19.224 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:19 smithi154 bash[48408]: 6ddb02f561dbe06ab315e145cde9941651bbb9007a1bf178f25d8c8720f035be 2024-05-10T03:34:19.224 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:19 smithi154 systemd[1]: Started Ceph mgr.z for d2a0bafa-0e7d-11ef-bc98-c7b262605968. 2024-05-10T03:34:19.226 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-05-10T03:34:19.227 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2024-05-10T03:34:19.246 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-10T03:34:19.246 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2024-05-10T03:34:19.304 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-10T03:34:19.304 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T03:34:19.304 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 6h/6d Inode: 182517 Links: 1 2024-05-10T03:34:19.304 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T03:34:19.304 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T03:34:19.304 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-05-10 03:34:18.523993328 +0000 2024-05-10T03:34:19.304 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-05-10 03:26:13.593149832 +0000 2024-05-10T03:34:19.305 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-05-10 03:26:13.593149832 +0000 2024-05-10T03:34:19.305 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-05-10T03:34:19.305 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-10T03:34:19.371 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:19 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z[48423]: 2024-05-10T03:34:19.341+0000 7f68fe1cf200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T03:34:19.374 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-05-10T03:34:19.375 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-05-10T03:34:19.375 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000196143 s, 2.6 MB/s 2024-05-10T03:34:19.376 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-10T03:34:19.436 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2024-05-10T03:34:19.496 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-10T03:34:19.496 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T03:34:19.496 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 6h/6d Inode: 182578 Links: 1 2024-05-10T03:34:19.496 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T03:34:19.496 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T03:34:19.496 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-05-10 03:34:18.523993328 +0000 2024-05-10T03:34:19.496 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-05-10 03:26:13.940140516 +0000 2024-05-10T03:34:19.496 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-05-10 03:26:13.940140516 +0000 2024-05-10T03:34:19.496 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-05-10T03:34:19.496 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-10T03:34:19.565 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-05-10T03:34:19.565 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-05-10T03:34:19.565 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000215338 s, 2.4 MB/s 2024-05-10T03:34:19.566 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-10T03:34:19.626 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2024-05-10T03:34:19.630 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:19 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z[48423]: 2024-05-10T03:34:19.441+0000 7f68fe1cf200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T03:34:19.630 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:19 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z[48423]: 2024-05-10T03:34:19.532+0000 7f68fe1cf200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T03:34:19.648 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-10T03:34:19.649 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T03:34:19.649 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 6h/6d Inode: 176912 Links: 1 2024-05-10T03:34:19.649 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T03:34:19.649 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T03:34:19.649 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-05-10 03:34:18.524993300 +0000 2024-05-10T03:34:19.649 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-05-10 03:26:14.283131308 +0000 2024-05-10T03:34:19.649 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-05-10 03:26:14.283131308 +0000 2024-05-10T03:34:19.649 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-05-10T03:34:19.650 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-10T03:34:19.721 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-05-10T03:34:19.721 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-05-10T03:34:19.721 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000192766 s, 2.7 MB/s 2024-05-10T03:34:19.721 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-10T03:34:19.782 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2024-05-10T03:34:19.841 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-10T03:34:19.841 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T03:34:19.842 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 6h/6d Inode: 182660 Links: 1 2024-05-10T03:34:19.842 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T03:34:19.842 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T03:34:19.842 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-05-10 03:34:18.524993300 +0000 2024-05-10T03:34:19.842 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-05-10 03:26:14.653121374 +0000 2024-05-10T03:34:19.842 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-05-10 03:26:14.653121374 +0000 2024-05-10T03:34:19.842 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-05-10T03:34:19.842 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-10T03:34:19.907 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:19 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z[48423]: 2024-05-10T03:34:19.626+0000 7f68fe1cf200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T03:34:19.909 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-05-10T03:34:19.909 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-05-10T03:34:19.909 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000231149 s, 2.2 MB/s 2024-05-10T03:34:19.910 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-10T03:34:19.968 INFO:tasks.cephadm:Deploying osd.0 on smithi045 with /dev/vg_nvme/lv_4... 2024-05-10T03:34:19.968 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-10T03:34:20.219 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:34:20.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:20 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:20.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:20 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:20.226 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:20 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:20.226 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:20 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-10T03:34:20.226 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:20 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-10T03:34:20.226 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:20 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-10T03:34:20.226 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:20 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:20.226 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:20 smithi154 ceph-mon[46565]: Deploying daemon mgr.y on smithi106 2024-05-10T03:34:20.226 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:20 smithi154 ceph-mon[46565]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:20.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:20 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:20.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:20 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:20.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:20 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:20.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:20 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-10T03:34:20.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:20 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-10T03:34:20.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:20 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-10T03:34:20.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:20 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:20.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:20 smithi045 ceph-mon[42520]: Deploying daemon mgr.y on smithi106 2024-05-10T03:34:20.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:20 smithi045 ceph-mon[42520]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:20.402 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:20 smithi106 systemd[1]: Starting Ceph mgr.y for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:34:20.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:20 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:20.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:20 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:20.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:20 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:20.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:20 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-10T03:34:20.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:20 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-10T03:34:20.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:20 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-10T03:34:20.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:20 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:20.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:20 smithi106 ceph-mon[46996]: Deploying daemon mgr.y on smithi106 2024-05-10T03:34:20.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:20 smithi106 ceph-mon[46996]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:20.631 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:20 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z[48423]: 2024-05-10T03:34:20.293+0000 7f68fe1cf200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T03:34:20.631 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:20 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z[48423]: 2024-05-10T03:34:20.543+0000 7f68fe1cf200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T03:34:20.900 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:20 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z[48423]: 2024-05-10T03:34:20.627+0000 7f68fe1cf200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T03:34:20.900 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:20 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z[48423]: 2024-05-10T03:34:20.737+0000 7f68fe1cf200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T03:34:20.901 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:20 smithi106 bash[48459]: 1c2c049c017352d55bc87552a1e6193cad5512dba46482b2c811b5ec7bd32e32 2024-05-10T03:34:20.901 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:20 smithi106 systemd[1]: Started Ceph mgr.y for d2a0bafa-0e7d-11ef-bc98-c7b262605968. 2024-05-10T03:34:20.902 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:20 smithi106 ceph-mgr[48497]: -- 172.21.15.106:0/2134429309 <== mon.2 v2:172.21.15.106:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558ff12bc1a0 con 0x558ff1319a80 2024-05-10T03:34:21.206 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:21 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y[48474]: 2024-05-10T03:34:21.095+0000 7f6fa3a94200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T03:34:21.224 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:20 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z[48423]: 2024-05-10T03:34:20.896+0000 7f68fe1cf200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T03:34:21.224 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:21 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z[48423]: 2024-05-10T03:34:21.040+0000 7f68fe1cf200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T03:34:21.224 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:21 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z[48423]: 2024-05-10T03:34:21.129+0000 7f68fe1cf200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T03:34:21.402 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:21 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y[48474]: 2024-05-10T03:34:21.202+0000 7f6fa3a94200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T03:34:21.402 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:21 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y[48474]: 2024-05-10T03:34:21.308+0000 7f6fa3a94200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T03:34:21.651 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:21 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y[48474]: 2024-05-10T03:34:21.405+0000 7f6fa3a94200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T03:34:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-10T03:34:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-10T03:34:21.715 INFO:teuthology.orchestra.run.smithi045.stderr: stderr: 10+0 records in 2024-05-10T03:34:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:10+0 records out 2024-05-10T03:34:21.715 INFO:teuthology.orchestra.run.smithi045.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00903235 s, 1.2 GB/s 2024-05-10T03:34:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:--> Zapping successful for: 2024-05-10T03:34:21.963 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:21 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z[48423]: 2024-05-10T03:34:21.554+0000 7f68fe1cf200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T03:34:21.964 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:21 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z[48423]: 2024-05-10T03:34:21.959+0000 7f68fe1cf200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T03:34:21.964 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:21 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:21.964 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:21 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:21.964 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:21 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:21.964 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:21 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:21.964 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:21 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:21.964 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:21 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:21.964 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:21 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:21.964 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:21 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:21.964 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:21 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:21.964 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:21 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:22.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:21 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:22.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:21 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:22.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:21 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:22.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:21 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:22.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:21 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:22.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:21 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:22.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:21 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:22.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:21 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:22.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:21 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:22.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:21 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:22.089 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:21 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:22.090 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:21 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:22.090 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:21 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:22.090 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:21 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:22.090 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:21 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:22.090 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:21 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:22.090 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:21 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:22.090 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:21 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:22.090 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:21 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:22.090 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:21 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:22.098 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi045:vg_nvme/lv_4 2024-05-10T03:34:22.224 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:22 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z[48423]: 2024-05-10T03:34:22.154+0000 7f68fe1cf200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-10T03:34:22.401 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:22 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y[48474]: 2024-05-10T03:34:22.085+0000 7f6fa3a94200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T03:34:22.401 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:22 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y[48474]: 2024-05-10T03:34:22.335+0000 7f6fa3a94200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T03:34:22.687 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:22 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y[48474]: 2024-05-10T03:34:22.420+0000 7f6fa3a94200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T03:34:22.687 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:22 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y[48474]: 2024-05-10T03:34:22.528+0000 7f6fa3a94200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T03:34:22.687 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:22 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y[48474]: 2024-05-10T03:34:22.683+0000 7f6fa3a94200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T03:34:22.705 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:34:22.724 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:22 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z[48423]: 2024-05-10T03:34:22.246+0000 7f68fe1cf200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T03:34:23.010 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:22 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:23.010 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:22 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:23.010 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:22 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:23.010 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:22 smithi154 ceph-mon[46565]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:23.010 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:22 smithi154 ceph-mon[46565]: Reconfiguring mgr.x (unknown last config time)... 2024-05-10T03:34:23.011 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:22 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-10T03:34:23.011 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:22 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-10T03:34:23.011 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:22 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:23.011 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:22 smithi154 ceph-mon[46565]: Reconfiguring daemon mgr.x on smithi045 2024-05-10T03:34:23.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:22 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:23.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:22 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:23.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:22 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:23.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:22 smithi045 ceph-mon[42520]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:23.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:22 smithi045 ceph-mon[42520]: Reconfiguring mgr.x (unknown last config time)... 2024-05-10T03:34:23.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:22 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-10T03:34:23.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:22 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-10T03:34:23.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:22 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:23.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:22 smithi045 ceph-mon[42520]: Reconfiguring daemon mgr.x on smithi045 2024-05-10T03:34:23.151 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:22 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y[48474]: 2024-05-10T03:34:22.810+0000 7f6fa3a94200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T03:34:23.151 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:22 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y[48474]: 2024-05-10T03:34:22.894+0000 7f6fa3a94200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T03:34:23.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:22 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:23.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:22 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:23.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:22 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:23.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:22 smithi106 ceph-mon[46996]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:23.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:22 smithi106 ceph-mon[46996]: Reconfiguring mgr.x (unknown last config time)... 2024-05-10T03:34:23.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:22 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-10T03:34:23.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:22 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-10T03:34:23.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:22 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:23.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:22 smithi106 ceph-mon[46996]: Reconfiguring daemon mgr.x on smithi045 2024-05-10T03:34:23.474 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:23 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z[48423]: 2024-05-10T03:34:23.006+0000 7f68fe1cf200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T03:34:23.475 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:23 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z[48423]: 2024-05-10T03:34:23.103+0000 7f68fe1cf200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T03:34:23.475 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:23 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z[48423]: 2024-05-10T03:34:23.249+0000 7f68fe1cf200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T03:34:23.651 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:23 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y[48474]: 2024-05-10T03:34:23.262+0000 7f6fa3a94200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T03:34:23.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.781+0000 7f11dd2f1700 1 -- 172.21.15.45:0/3653315267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11d8102650 msgr2=0x7f11d8108f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:23.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.781+0000 7f11dd2f1700 1 --2- 172.21.15.45:0/3653315267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11d8102650 0x7f11d8108f00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f11d000b0a0 tx=0x7f11d000b3b0 comp rx=0 tx=0).stop 2024-05-10T03:34:23.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.781+0000 7f11dd2f1700 1 -- 172.21.15.45:0/3653315267 shutdown_connections 2024-05-10T03:34:23.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.781+0000 7f11dd2f1700 1 --2- 172.21.15.45:0/3653315267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11d8100b80 0x7f11d8100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:23.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.781+0000 7f11dd2f1700 1 --2- 172.21.15.45:0/3653315267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11d8102650 0x7f11d8108f00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:23.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.781+0000 7f11dd2f1700 1 --2- 172.21.15.45:0/3653315267 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11d8101cb0 0x7f11d81020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:23.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.781+0000 7f11dd2f1700 1 -- 172.21.15.45:0/3653315267 >> 172.21.15.45:0/3653315267 conn(0x7f11d80fc1c0 msgr2=0x7f11d80fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:34:23.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.781+0000 7f11dd2f1700 1 -- 172.21.15.45:0/3653315267 shutdown_connections 2024-05-10T03:34:23.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.781+0000 7f11dd2f1700 1 -- 172.21.15.45:0/3653315267 wait complete. 2024-05-10T03:34:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.781+0000 7f11dd2f1700 1 Processor -- start 2024-05-10T03:34:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.782+0000 7f11dd2f1700 1 -- start start 2024-05-10T03:34:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.782+0000 7f11dd2f1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11d8100b80 0x7f11d8104b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.782+0000 7f11dd2f1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11d8101cb0 0x7f11d8102ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.782+0000 7f11dd2f1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11d8102650 0x7f11d8103530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.782+0000 7f11dd2f1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d8103a70 con 0x7f11d8102650 2024-05-10T03:34:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.782+0000 7f11dd2f1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d8103be0 con 0x7f11d8100b80 2024-05-10T03:34:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.782+0000 7f11dd2f1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d8103da0 con 0x7f11d8101cb0 2024-05-10T03:34:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.782+0000 7f11d77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11d8102650 0x7f11d8103530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.782+0000 7f11d6ffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11d8100b80 0x7f11d8104b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.782+0000 7f11d77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11d8102650 0x7f11d8103530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41980/0 (socket says 172.21.15.45:41980) 2024-05-10T03:34:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.782+0000 7f11d77fe700 1 -- 172.21.15.45:0/241230247 learned_addr learned my addr 172.21.15.45:0/241230247 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:34:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.782+0000 7f11d67fc700 1 --2- 172.21.15.45:0/241230247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11d8101cb0 0x7f11d8102ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.782+0000 7f11d6ffd700 1 -- 172.21.15.45:0/241230247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11d8101cb0 msgr2=0x7f11d8102ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.782+0000 7f11d6ffd700 1 --2- 172.21.15.45:0/241230247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11d8101cb0 0x7f11d8102ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.782+0000 7f11d6ffd700 1 -- 172.21.15.45:0/241230247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11d8102650 msgr2=0x7f11d8103530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.782+0000 7f11d6ffd700 1 --2- 172.21.15.45:0/241230247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11d8102650 0x7f11d8103530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.782+0000 7f11d6ffd700 1 -- 172.21.15.45:0/241230247 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d0009d00 con 0x7f11d8100b80 2024-05-10T03:34:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.782+0000 7f11d77fe700 1 --2- 172.21.15.45:0/241230247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11d8102650 0x7f11d8103530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:34:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.783+0000 7f11d6ffd700 1 --2- 172.21.15.45:0/241230247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11d8100b80 0x7f11d8104b20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f11d8100880 tx=0x7f11c800eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:34:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.783+0000 7f11bffff700 1 -- 172.21.15.45:0/241230247 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8004220 con 0x7f11d8100b80 2024-05-10T03:34:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.783+0000 7f11bffff700 1 -- 172.21.15.45:0/241230247 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f11c8004380 con 0x7f11d8100b80 2024-05-10T03:34:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.783+0000 7f11dd2f1700 1 -- 172.21.15.45:0/241230247 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d81a6b60 con 0x7f11d8100b80 2024-05-10T03:34:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.783+0000 7f11bffff700 1 -- 172.21.15.45:0/241230247 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8003c50 con 0x7f11d8100b80 2024-05-10T03:34:23.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.783+0000 7f11dd2f1700 1 -- 172.21.15.45:0/241230247 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d81a7030 con 0x7f11d8100b80 2024-05-10T03:34:23.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.784+0000 7f11bffff700 1 -- 172.21.15.45:0/241230247 <== mon.2 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f11c8018430 con 0x7f11d8100b80 2024-05-10T03:34:23.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.784+0000 7f11dd2f1700 1 -- 172.21.15.45:0/241230247 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d80ffe80 con 0x7f11d8100b80 2024-05-10T03:34:23.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.784+0000 7f11bffff700 1 --2- 172.21.15.45:0/241230247 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f11c00389d0 0x7f11c003aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:23.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.784+0000 7f11bffff700 1 -- 172.21.15.45:0/241230247 <== mon.2 v2:172.21.15.106:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f11c8014070 con 0x7f11d8100b80 2024-05-10T03:34:23.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.784+0000 7f11d67fc700 1 --2- 172.21.15.45:0/241230247 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f11c00389d0 0x7f11c003aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:23.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.785+0000 7f11d67fc700 1 --2- 172.21.15.45:0/241230247 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f11c00389d0 0x7f11c003aee0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f11cc009c60 tx=0x7f11cc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:34:23.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:23.790+0000 7f11bffff700 1 -- 172.21.15.45:0/241230247 <== mon.2 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f11c8003db0 con 0x7f11d8100b80 2024-05-10T03:34:23.940 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:23 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y[48474]: 2024-05-10T03:34:23.652+0000 7f6fa3a94200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T03:34:23.940 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:23 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y[48474]: 2024-05-10T03:34:23.845+0000 7f6fa3a94200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-10T03:34:23.940 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:23 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y[48474]: 2024-05-10T03:34:23.936+0000 7f6fa3a94200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T03:34:24.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:24.011+0000 7f11dd2f1700 1 -- 172.21.15.45:0/241230247 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f11d80fe240 con 0x7f11c00389d0 2024-05-10T03:34:24.224 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:23 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z[48423]: 2024-05-10T03:34:23.883+0000 7f68fe1cf200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-10T03:34:24.224 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:24 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z[48423]: 2024-05-10T03:34:24.063+0000 7f68fe1cf200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T03:34:24.557 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:24 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:24.558 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:24 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:24.558 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:24 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:24.558 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:24 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:24.558 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:24 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:24.558 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:24 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:24.558 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:24 smithi045 ceph-mon[42520]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:24.558 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:24 smithi045 ceph-mon[42520]: from='client.24125 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:34:24.558 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:24 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:34:24.558 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:24 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:34:24.558 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:24 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:24.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:24 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:24.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:24 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:24.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:24 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:24.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:24 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:24.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:24 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:24.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:24 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:24.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:24 smithi106 ceph-mon[46996]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:24.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:24 smithi106 ceph-mon[46996]: from='client.24125 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:34:24.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:24 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:34:24.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:24 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:34:24.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:24 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:24.724 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:24 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z[48423]: 2024-05-10T03:34:24.256+0000 7f68fe1cf200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T03:34:24.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:24 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:24.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:24 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:24.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:24 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:24.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:24 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:24.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:24 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:24.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:24 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:24.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:24 smithi154 ceph-mon[46565]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:24.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:24 smithi154 ceph-mon[46565]: from='client.24125 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:34:24.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:24 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:34:24.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:24 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:34:24.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:24 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:25.151 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:24 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y[48474]: 2024-05-10T03:34:24.691+0000 7f6fa3a94200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T03:34:25.151 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:24 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y[48474]: 2024-05-10T03:34:24.786+0000 7f6fa3a94200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T03:34:25.151 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:24 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y[48474]: 2024-05-10T03:34:24.932+0000 7f6fa3a94200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T03:34:25.472 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:25 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z[48423]: 2024-05-10T03:34:25.185+0000 7f68fe1cf200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T03:34:25.472 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:25 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z[48423]: 2024-05-10T03:34:25.468+0000 7f68fe1cf200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T03:34:25.724 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:25 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z[48423]: 2024-05-10T03:34:25.556+0000 7f68fe1cf200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T03:34:25.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:25.817+0000 7f11bffff700 1 -- 172.21.15.45:0/241230247 <== mon.2 v2:172.21.15.106:3300/0 7 ==== mgrmap(e 14) v1 ==== 90707+0+0 (secure 0 0 0) 0x7f11c8010c70 con 0x7f11d8100b80 2024-05-10T03:34:25.823 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:25 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y[48474]: 2024-05-10T03:34:25.550+0000 7f6fa3a94200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-10T03:34:25.823 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:25 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y[48474]: 2024-05-10T03:34:25.729+0000 7f6fa3a94200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T03:34:26.151 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:25 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y[48474]: 2024-05-10T03:34:25.924+0000 7f6fa3a94200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T03:34:26.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:25 smithi106 ceph-mon[46996]: Standby manager daemon z started 2024-05-10T03:34:26.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:25 smithi106 ceph-mon[46996]: from='mgr.? 172.21.15.154:0/4232409064' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-10T03:34:26.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:25 smithi106 ceph-mon[46996]: from='mgr.? 172.21.15.154:0/4232409064' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-10T03:34:26.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:25 smithi106 ceph-mon[46996]: from='mgr.? 172.21.15.154:0/4232409064' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-10T03:34:26.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:25 smithi106 ceph-mon[46996]: from='mgr.? 172.21.15.154:0/4232409064' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-10T03:34:26.224 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:34:25 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z[48423]: 2024-05-10T03:34:25.745+0000 7f68fe1cf200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T03:34:26.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:25 smithi154 ceph-mon[46565]: Standby manager daemon z started 2024-05-10T03:34:26.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:25 smithi154 ceph-mon[46565]: from='mgr.? 172.21.15.154:0/4232409064' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-10T03:34:26.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:25 smithi154 ceph-mon[46565]: from='mgr.? 172.21.15.154:0/4232409064' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-10T03:34:26.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:25 smithi154 ceph-mon[46565]: from='mgr.? 172.21.15.154:0/4232409064' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-10T03:34:26.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:25 smithi154 ceph-mon[46565]: from='mgr.? 172.21.15.154:0/4232409064' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-10T03:34:26.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:25 smithi045 ceph-mon[42520]: Standby manager daemon z started 2024-05-10T03:34:26.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:25 smithi045 ceph-mon[42520]: from='mgr.? 172.21.15.154:0/4232409064' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-10T03:34:26.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:25 smithi045 ceph-mon[42520]: from='mgr.? 172.21.15.154:0/4232409064' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-10T03:34:26.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:25 smithi045 ceph-mon[42520]: from='mgr.? 172.21.15.154:0/4232409064' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-10T03:34:26.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:25 smithi045 ceph-mon[42520]: from='mgr.? 172.21.15.154:0/4232409064' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-10T03:34:27.139 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:26 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y[48474]: 2024-05-10T03:34:26.850+0000 7f6fa3a94200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T03:34:27.139 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:26 smithi106 ceph-mon[46996]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:27.139 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:26 smithi106 ceph-mon[46996]: mgrmap e14: x(active, since 60s), standbys: z 2024-05-10T03:34:27.139 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-10T03:34:27.139 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:26 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3466664043' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42ed038c-208a-4440-8150-f6933533b3b6"}]: dispatch 2024-05-10T03:34:27.140 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:26 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3466664043' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "42ed038c-208a-4440-8150-f6933533b3b6"}]': finished 2024-05-10T03:34:27.140 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:26 smithi106 ceph-mon[46996]: osdmap e5: 1 total, 0 up, 1 in 2024-05-10T03:34:27.140 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T03:34:27.140 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:26 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1109839503' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:34:27.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:26 smithi154 ceph-mon[46565]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:27.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:26 smithi154 ceph-mon[46565]: mgrmap e14: x(active, since 60s), standbys: z 2024-05-10T03:34:27.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-10T03:34:27.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:26 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3466664043' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42ed038c-208a-4440-8150-f6933533b3b6"}]: dispatch 2024-05-10T03:34:27.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:26 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3466664043' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "42ed038c-208a-4440-8150-f6933533b3b6"}]': finished 2024-05-10T03:34:27.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:26 smithi154 ceph-mon[46565]: osdmap e5: 1 total, 0 up, 1 in 2024-05-10T03:34:27.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T03:34:27.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:26 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1109839503' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:34:27.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:26 smithi045 ceph-mon[42520]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:27.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:26 smithi045 ceph-mon[42520]: mgrmap e14: x(active, since 60s), standbys: z 2024-05-10T03:34:27.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-10T03:34:27.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:26 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3466664043' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42ed038c-208a-4440-8150-f6933533b3b6"}]: dispatch 2024-05-10T03:34:27.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:26 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3466664043' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "42ed038c-208a-4440-8150-f6933533b3b6"}]': finished 2024-05-10T03:34:27.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:26 smithi045 ceph-mon[42520]: osdmap e5: 1 total, 0 up, 1 in 2024-05-10T03:34:27.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T03:34:27.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:26 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1109839503' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:34:27.401 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:27 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y[48474]: 2024-05-10T03:34:27.135+0000 7f6fa3a94200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T03:34:27.401 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:27 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y[48474]: 2024-05-10T03:34:27.222+0000 7f6fa3a94200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T03:34:27.832 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:34:27 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y[48474]: 2024-05-10T03:34:27.411+0000 7f6fa3a94200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T03:34:27.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:27.835+0000 7f11bffff700 1 -- 172.21.15.45:0/241230247 <== mon.2 v2:172.21.15.106:3300/0 8 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7f11c8017cf0 con 0x7f11d8100b80 2024-05-10T03:34:28.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:27 smithi106 ceph-mon[46996]: Standby manager daemon y started 2024-05-10T03:34:28.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:27 smithi106 ceph-mon[46996]: from='mgr.? 172.21.15.106:0/2996571422' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-10T03:34:28.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:27 smithi106 ceph-mon[46996]: from='mgr.? 172.21.15.106:0/2996571422' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-10T03:34:28.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:27 smithi106 ceph-mon[46996]: from='mgr.? 172.21.15.106:0/2996571422' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-10T03:34:28.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:27 smithi106 ceph-mon[46996]: from='mgr.? 172.21.15.106:0/2996571422' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-10T03:34:28.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:27 smithi154 ceph-mon[46565]: Standby manager daemon y started 2024-05-10T03:34:28.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:27 smithi154 ceph-mon[46565]: from='mgr.? 172.21.15.106:0/2996571422' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-10T03:34:28.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:27 smithi154 ceph-mon[46565]: from='mgr.? 172.21.15.106:0/2996571422' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-10T03:34:28.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:27 smithi154 ceph-mon[46565]: from='mgr.? 172.21.15.106:0/2996571422' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-10T03:34:28.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:27 smithi154 ceph-mon[46565]: from='mgr.? 172.21.15.106:0/2996571422' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-10T03:34:28.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:27 smithi045 ceph-mon[42520]: Standby manager daemon y started 2024-05-10T03:34:28.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:27 smithi045 ceph-mon[42520]: from='mgr.? 172.21.15.106:0/2996571422' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-10T03:34:28.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:27 smithi045 ceph-mon[42520]: from='mgr.? 172.21.15.106:0/2996571422' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-10T03:34:28.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:27 smithi045 ceph-mon[42520]: from='mgr.? 172.21.15.106:0/2996571422' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-10T03:34:28.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:27 smithi045 ceph-mon[42520]: from='mgr.? 172.21.15.106:0/2996571422' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-10T03:34:29.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:28 smithi106 ceph-mon[46996]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:29.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:28 smithi106 ceph-mon[46996]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-05-10T03:34:29.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:28 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-10T03:34:29.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:28 smithi154 ceph-mon[46565]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:29.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:28 smithi154 ceph-mon[46565]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-05-10T03:34:29.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:28 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-10T03:34:29.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:28 smithi045 ceph-mon[42520]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:29.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:28 smithi045 ceph-mon[42520]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-05-10T03:34:29.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:28 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-10T03:34:30.989 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:30 smithi045 ceph-mon[42520]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:31.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:30 smithi106 ceph-mon[46996]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:31.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:30 smithi154 ceph-mon[46565]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:32.960 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:32 smithi045 ceph-mon[42520]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:32.960 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:32 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-10T03:34:32.960 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:32 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:33.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:32 smithi106 ceph-mon[46996]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:33.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:32 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-10T03:34:33.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:32 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:33.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:32 smithi154 ceph-mon[46565]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:33.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:32 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-10T03:34:33.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:32 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:34.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:33 smithi045 ceph-mon[42520]: Deploying daemon osd.0 on smithi045 2024-05-10T03:34:34.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:33 smithi106 ceph-mon[46996]: Deploying daemon osd.0 on smithi045 2024-05-10T03:34:34.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:33 smithi154 ceph-mon[46565]: Deploying daemon osd.0 on smithi045 2024-05-10T03:34:34.859 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:34 smithi045 ceph-mon[42520]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:35.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:34 smithi106 ceph-mon[46996]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:35.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:34 smithi154 ceph-mon[46565]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:37.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:36 smithi045 ceph-mon[42520]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:37.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:36 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:37.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:36 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:37.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:36 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:37.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:36 smithi106 ceph-mon[46996]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:37.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:36 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:37.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:36 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:37.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:36 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:37.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:36 smithi154 ceph-mon[46565]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:37.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:36 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:37.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:36 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:37.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:36 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:38.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:38 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:38.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:38 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:38.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:38 smithi045 ceph-mon[42520]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:38.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:38 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:38.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:38 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:38.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:38 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:38.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:38 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:38.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:38 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:38.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:38 smithi106 ceph-mon[46996]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:38.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:38 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:38.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:38 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:38.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:38 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:38.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:38.959+0000 7f11bffff700 1 -- 172.21.15.45:0/241230247 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f11d80fe240 con 0x7f11c00389d0 2024-05-10T03:34:38.962 INFO:teuthology.orchestra.run.smithi045.stdout:Created osd(s) 0 on host 'smithi045' 2024-05-10T03:34:38.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:38.962+0000 7f11dd2f1700 1 -- 172.21.15.45:0/241230247 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f11c00389d0 msgr2=0x7f11c003aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:38.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:38.962+0000 7f11dd2f1700 1 --2- 172.21.15.45:0/241230247 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f11c00389d0 0x7f11c003aee0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f11cc009c60 tx=0x7f11cc009260 comp rx=0 tx=0).stop 2024-05-10T03:34:38.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:38.962+0000 7f11dd2f1700 1 -- 172.21.15.45:0/241230247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11d8100b80 msgr2=0x7f11d8104b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:38.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:38.962+0000 7f11dd2f1700 1 --2- 172.21.15.45:0/241230247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11d8100b80 0x7f11d8104b20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f11d8100880 tx=0x7f11c800eca0 comp rx=0 tx=0).stop 2024-05-10T03:34:38.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:38.962+0000 7f11dd2f1700 1 -- 172.21.15.45:0/241230247 shutdown_connections 2024-05-10T03:34:38.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:38.962+0000 7f11dd2f1700 1 --2- 172.21.15.45:0/241230247 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f11c00389d0 0x7f11c003aee0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:38.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:38.962+0000 7f11dd2f1700 1 --2- 172.21.15.45:0/241230247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11d8102650 0x7f11d8103530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:38.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:38.962+0000 7f11dd2f1700 1 --2- 172.21.15.45:0/241230247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11d8100b80 0x7f11d8104b20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:38.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:38.962+0000 7f11dd2f1700 1 --2- 172.21.15.45:0/241230247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11d8101cb0 0x7f11d8102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:38.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:38.962+0000 7f11dd2f1700 1 -- 172.21.15.45:0/241230247 >> 172.21.15.45:0/241230247 conn(0x7f11d80fc1c0 msgr2=0x7f11d80fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:34:38.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:38.963+0000 7f11dd2f1700 1 -- 172.21.15.45:0/241230247 shutdown_connections 2024-05-10T03:34:38.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:34:38.963+0000 7f11dd2f1700 1 -- 172.21.15.45:0/241230247 wait complete. 2024-05-10T03:34:38.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:38 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:38.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:38 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:38.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:38 smithi154 ceph-mon[46565]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:38.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:38 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:38.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:38 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:38.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:38 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:39.382 DEBUG:teuthology.orchestra.run.smithi045:osd.0> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.0.service 2024-05-10T03:34:39.384 INFO:tasks.cephadm:Deploying osd.1 on smithi106 with /dev/vg_nvme/lv_4... 2024-05-10T03:34:39.384 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-10T03:34:39.424 INFO:journalctl@ceph.osd.0.smithi045.stdout:-- Logs begin at Fri 2024-05-10 03:15:08 UTC. -- 2024-05-10T03:34:39.613 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.b/config 2024-05-10T03:34:40.002 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:39 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:40.002 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:39 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:40.002 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:39 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:40.223 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:39 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:40.223 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:39 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:40.223 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:39 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:40.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:39 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:40.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:39 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:40.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:39 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:40.534 INFO:journalctl@ceph.osd.0.smithi045.stdout:May 10 03:34:40 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-0[60984]: 2024-05-10T03:34:40.228+0000 7fbd6bba37c0 -1 osd.0 0 log_to_monitors true 2024-05-10T03:34:40.909 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-10T03:34:40.909 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-10T03:34:40.909 INFO:teuthology.orchestra.run.smithi106.stderr: stderr: 10+0 records in 2024-05-10T03:34:40.909 INFO:teuthology.orchestra.run.smithi106.stderr:10+0 records out 2024-05-10T03:34:40.910 INFO:teuthology.orchestra.run.smithi106.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113177 s, 926 MB/s 2024-05-10T03:34:40.910 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping successful for: 2024-05-10T03:34:41.196 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:40 smithi106 ceph-mon[46996]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:41.197 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:40 smithi106 ceph-mon[46996]: from='osd.0 [v2:172.21.15.45:6802/2233620683,v1:172.21.15.45:6803/2233620683]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-10T03:34:41.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:40 smithi154 ceph-mon[46565]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:41.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:40 smithi154 ceph-mon[46565]: from='osd.0 [v2:172.21.15.45:6802/2233620683,v1:172.21.15.45:6803/2233620683]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-10T03:34:41.246 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi106:vg_nvme/lv_4 2024-05-10T03:34:41.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:40 smithi045 ceph-mon[42520]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:41.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:40 smithi045 ceph-mon[42520]: from='osd.0 [v2:172.21.15.45:6802/2233620683,v1:172.21.15.45:6803/2233620683]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-10T03:34:41.461 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.b/config 2024-05-10T03:34:42.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:41 smithi106 ceph-mon[46996]: from='osd.0 [v2:172.21.15.45:6802/2233620683,v1:172.21.15.45:6803/2233620683]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-10T03:34:42.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:41 smithi106 ceph-mon[46996]: osdmap e6: 1 total, 0 up, 1 in 2024-05-10T03:34:42.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:41 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T03:34:42.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:41 smithi106 ceph-mon[46996]: from='osd.0 [v2:172.21.15.45:6802/2233620683,v1:172.21.15.45:6803/2233620683]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-05-10T03:34:42.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:41 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:42.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:41 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:42.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:41 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:34:42.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:41 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:42.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:41 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:42.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:41 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:42.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:41 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:42.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:41 smithi106 ceph-mon[46996]: from='osd.0 [v2:172.21.15.45:6802/2233620683,v1:172.21.15.45:6803/2233620683]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-05-10T03:34:42.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:41 smithi154 ceph-mon[46565]: from='osd.0 [v2:172.21.15.45:6802/2233620683,v1:172.21.15.45:6803/2233620683]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-10T03:34:42.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:41 smithi154 ceph-mon[46565]: osdmap e6: 1 total, 0 up, 1 in 2024-05-10T03:34:42.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:41 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T03:34:42.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:41 smithi154 ceph-mon[46565]: from='osd.0 [v2:172.21.15.45:6802/2233620683,v1:172.21.15.45:6803/2233620683]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-05-10T03:34:42.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:41 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:42.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:41 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:42.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:41 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:34:42.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:41 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:42.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:41 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:42.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:41 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:42.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:41 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:42.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:41 smithi154 ceph-mon[46565]: from='osd.0 [v2:172.21.15.45:6802/2233620683,v1:172.21.15.45:6803/2233620683]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-05-10T03:34:42.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:41 smithi045 ceph-mon[42520]: from='osd.0 [v2:172.21.15.45:6802/2233620683,v1:172.21.15.45:6803/2233620683]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-10T03:34:42.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:41 smithi045 ceph-mon[42520]: osdmap e6: 1 total, 0 up, 1 in 2024-05-10T03:34:42.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:41 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T03:34:42.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:41 smithi045 ceph-mon[42520]: from='osd.0 [v2:172.21.15.45:6802/2233620683,v1:172.21.15.45:6803/2233620683]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-05-10T03:34:42.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:41 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:42.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:41 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:42.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:41 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:34:42.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:41 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:42.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:41 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:42.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:41 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:42.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:41 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:42.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:41 smithi045 ceph-mon[42520]: from='osd.0 [v2:172.21.15.45:6802/2233620683,v1:172.21.15.45:6803/2233620683]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-05-10T03:34:42.286 INFO:journalctl@ceph.osd.0.smithi045.stdout:May 10 03:34:41 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-0[60984]: 2024-05-10T03:34:41.935+0000 7fbd61207700 -1 osd.0 0 waiting for initial osdmap 2024-05-10T03:34:42.286 INFO:journalctl@ceph.osd.0.smithi045.stdout:May 10 03:34:41 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-0[60984]: 2024-05-10T03:34:41.941+0000 7fbd5cfbe700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T03:34:42.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.377+0000 7faba99e6700 1 -- 172.21.15.106:0/2104240391 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faba4107a80 msgr2=0x7faba4109ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:42.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.377+0000 7faba99e6700 1 --2- 172.21.15.106:0/2104240391 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faba4107a80 0x7faba4109ea0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00b0a0 tx=0x7fab9c00b3b0 comp rx=0 tx=0).stop 2024-05-10T03:34:42.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.377+0000 7faba99e6700 1 -- 172.21.15.106:0/2104240391 shutdown_connections 2024-05-10T03:34:42.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.377+0000 7faba99e6700 1 --2- 172.21.15.106:0/2104240391 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faba4107a80 0x7faba4109ea0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:42.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.377+0000 7faba99e6700 1 --2- 172.21.15.106:0/2104240391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faba4100030 0x7faba4100480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:42.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.377+0000 7faba99e6700 1 --2- 172.21.15.106:0/2104240391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faba4105120 0x7faba4107540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:42.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.377+0000 7faba99e6700 1 -- 172.21.15.106:0/2104240391 >> 172.21.15.106:0/2104240391 conn(0x7faba40fb990 msgr2=0x7faba40fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:34:42.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.377+0000 7faba99e6700 1 -- 172.21.15.106:0/2104240391 shutdown_connections 2024-05-10T03:34:42.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.377+0000 7faba99e6700 1 -- 172.21.15.106:0/2104240391 wait complete. 2024-05-10T03:34:42.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.378+0000 7faba99e6700 1 Processor -- start 2024-05-10T03:34:42.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.378+0000 7faba99e6700 1 -- start start 2024-05-10T03:34:42.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.378+0000 7faba99e6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faba4100030 0x7faba4198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:42.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.378+0000 7faba99e6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faba4105120 0x7faba41987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:42.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.378+0000 7faba99e6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faba4107a80 0x7faba4199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:42.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.378+0000 7faba99e6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba4199bb0 con 0x7faba4107a80 2024-05-10T03:34:42.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.378+0000 7faba99e6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba4199cf0 con 0x7faba4105120 2024-05-10T03:34:42.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.378+0000 7faba99e6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba4199eb0 con 0x7faba4100030 2024-05-10T03:34:42.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.379+0000 7faba27fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faba4105120 0x7faba41987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:42.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.379+0000 7faba27fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faba4105120 0x7faba41987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:39468/0 (socket says 172.21.15.106:39468) 2024-05-10T03:34:42.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.379+0000 7faba27fc700 1 -- 172.21.15.106:0/2755818240 learned_addr learned my addr 172.21.15.106:0/2755818240 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-10T03:34:42.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.379+0000 7faba2ffd700 1 --2- 172.21.15.106:0/2755818240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faba4100030 0x7faba4198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:42.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.379+0000 7faba37fe700 1 --2- 172.21.15.106:0/2755818240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faba4107a80 0x7faba4199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:42.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.379+0000 7faba27fc700 1 -- 172.21.15.106:0/2755818240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faba4100030 msgr2=0x7faba4198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:42.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.379+0000 7faba27fc700 1 --2- 172.21.15.106:0/2755818240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faba4100030 0x7faba4198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:42.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.379+0000 7faba27fc700 1 -- 172.21.15.106:0/2755818240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faba4107a80 msgr2=0x7faba4199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:42.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.379+0000 7faba27fc700 1 --2- 172.21.15.106:0/2755818240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faba4107a80 0x7faba4199550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:42.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.379+0000 7faba27fc700 1 -- 172.21.15.106:0/2755818240 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9c009d00 con 0x7faba4105120 2024-05-10T03:34:42.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.379+0000 7faba27fc700 1 --2- 172.21.15.106:0/2755818240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faba4105120 0x7faba41987a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fab9400d950 tx=0x7fab9400dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:34:42.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.379+0000 7faba89e4700 1 -- 172.21.15.106:0/2755818240 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab94009b40 con 0x7faba4105120 2024-05-10T03:34:42.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.379+0000 7faba89e4700 1 -- 172.21.15.106:0/2755818240 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fab94009ca0 con 0x7faba4105120 2024-05-10T03:34:42.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.379+0000 7faba99e6700 1 -- 172.21.15.106:0/2755818240 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba419a190 con 0x7faba4105120 2024-05-10T03:34:42.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.379+0000 7faba89e4700 1 -- 172.21.15.106:0/2755818240 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9400f6b0 con 0x7faba4105120 2024-05-10T03:34:42.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.379+0000 7faba99e6700 1 -- 172.21.15.106:0/2755818240 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba41a0970 con 0x7faba4105120 2024-05-10T03:34:42.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.380+0000 7faba99e6700 1 -- 172.21.15.106:0/2755818240 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba40fd540 con 0x7faba4105120 2024-05-10T03:34:42.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.382+0000 7faba89e4700 1 -- 172.21.15.106:0/2755818240 <== mon.2 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7fab94010460 con 0x7faba4105120 2024-05-10T03:34:42.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.382+0000 7faba89e4700 1 --2- 172.21.15.106:0/2755818240 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fab8c0a1110 0x7fab8c0a3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:42.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.383+0000 7faba89e4700 1 -- 172.21.15.106:0/2755818240 <== mon.2 v2:172.21.15.106:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1487+0+0 (secure 0 0 0) 0x7fab940cb010 con 0x7faba4105120 2024-05-10T03:34:42.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.383+0000 7faba2ffd700 1 --2- 172.21.15.106:0/2755818240 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fab8c0a1110 0x7fab8c0a3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:42.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.383+0000 7faba2ffd700 1 --2- 172.21.15.106:0/2755818240 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fab8c0a1110 0x7fab8c0a3620 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fab98005950 tx=0x7fab980058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:34:42.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.386+0000 7faba89e4700 1 -- 172.21.15.106:0/2755818240 <== mon.2 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fab94096330 con 0x7faba4105120 2024-05-10T03:34:42.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:42.588+0000 7faba99e6700 1 -- 172.21.15.106:0/2755818240 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7faba410d7d0 con 0x7fab8c0a1110 2024-05-10T03:34:43.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:42 smithi154 ceph-mon[46565]: Detected new or changed devices on smithi045 2024-05-10T03:34:43.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:42 smithi154 ceph-mon[46565]: Adjusting osd_memory_target on smithi045 to 17118M 2024-05-10T03:34:43.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:42 smithi154 ceph-mon[46565]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:43.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:42 smithi154 ceph-mon[46565]: osdmap e7: 1 total, 0 up, 1 in 2024-05-10T03:34:43.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:42 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T03:34:43.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:42 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T03:34:43.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:42 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:34:43.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:42 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:34:43.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:42 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:43.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:42 smithi045 ceph-mon[42520]: Detected new or changed devices on smithi045 2024-05-10T03:34:43.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:42 smithi045 ceph-mon[42520]: Adjusting osd_memory_target on smithi045 to 17118M 2024-05-10T03:34:43.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:42 smithi045 ceph-mon[42520]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:43.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:42 smithi045 ceph-mon[42520]: osdmap e7: 1 total, 0 up, 1 in 2024-05-10T03:34:43.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:42 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T03:34:43.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:42 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T03:34:43.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:42 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:34:43.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:42 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:34:43.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:42 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:43.285 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:42 smithi106 ceph-mon[46996]: Detected new or changed devices on smithi045 2024-05-10T03:34:43.285 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:42 smithi106 ceph-mon[46996]: Adjusting osd_memory_target on smithi045 to 17118M 2024-05-10T03:34:43.285 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:42 smithi106 ceph-mon[46996]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:43.285 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:42 smithi106 ceph-mon[46996]: osdmap e7: 1 total, 0 up, 1 in 2024-05-10T03:34:43.285 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:42 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T03:34:43.285 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:42 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T03:34:43.285 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:42 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:34:43.285 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:42 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:34:43.285 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:42 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:44.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:43 smithi154 ceph-mon[46565]: purged_snaps scrub starts 2024-05-10T03:34:44.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:43 smithi154 ceph-mon[46565]: purged_snaps scrub ok 2024-05-10T03:34:44.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:43 smithi154 ceph-mon[46565]: from='client.24152 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:34:44.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:43 smithi154 ceph-mon[46565]: osd.0 [v2:172.21.15.45:6802/2233620683,v1:172.21.15.45:6803/2233620683] boot 2024-05-10T03:34:44.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:43 smithi154 ceph-mon[46565]: osdmap e8: 1 total, 1 up, 1 in 2024-05-10T03:34:44.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:43 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T03:34:44.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:43 smithi045 ceph-mon[42520]: purged_snaps scrub starts 2024-05-10T03:34:44.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:43 smithi045 ceph-mon[42520]: purged_snaps scrub ok 2024-05-10T03:34:44.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:43 smithi045 ceph-mon[42520]: from='client.24152 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:34:44.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:43 smithi045 ceph-mon[42520]: osd.0 [v2:172.21.15.45:6802/2233620683,v1:172.21.15.45:6803/2233620683] boot 2024-05-10T03:34:44.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:43 smithi045 ceph-mon[42520]: osdmap e8: 1 total, 1 up, 1 in 2024-05-10T03:34:44.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:43 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T03:34:44.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:43 smithi106 ceph-mon[46996]: purged_snaps scrub starts 2024-05-10T03:34:44.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:43 smithi106 ceph-mon[46996]: purged_snaps scrub ok 2024-05-10T03:34:44.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:43 smithi106 ceph-mon[46996]: from='client.24152 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:34:44.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:43 smithi106 ceph-mon[46996]: osd.0 [v2:172.21.15.45:6802/2233620683,v1:172.21.15.45:6803/2233620683] boot 2024-05-10T03:34:44.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:43 smithi106 ceph-mon[46996]: osdmap e8: 1 total, 1 up, 1 in 2024-05-10T03:34:44.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:43 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T03:34:45.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:44 smithi154 ceph-mon[46565]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:45.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:44 smithi154 ceph-mon[46565]: osdmap e9: 1 total, 1 up, 1 in 2024-05-10T03:34:45.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:44 smithi154 ceph-mon[46565]: from='client.? 172.21.15.106:0/555353148' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69265bae-5027-4810-978d-3d10eb35797c"}]: dispatch 2024-05-10T03:34:45.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:44 smithi154 ceph-mon[46565]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69265bae-5027-4810-978d-3d10eb35797c"}]: dispatch 2024-05-10T03:34:45.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:44 smithi154 ceph-mon[46565]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "69265bae-5027-4810-978d-3d10eb35797c"}]': finished 2024-05-10T03:34:45.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:44 smithi154 ceph-mon[46565]: osdmap e10: 2 total, 1 up, 2 in 2024-05-10T03:34:45.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:44 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T03:34:45.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:44 smithi045 ceph-mon[42520]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:45.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:44 smithi045 ceph-mon[42520]: osdmap e9: 1 total, 1 up, 1 in 2024-05-10T03:34:45.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:44 smithi045 ceph-mon[42520]: from='client.? 172.21.15.106:0/555353148' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69265bae-5027-4810-978d-3d10eb35797c"}]: dispatch 2024-05-10T03:34:45.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:44 smithi045 ceph-mon[42520]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69265bae-5027-4810-978d-3d10eb35797c"}]: dispatch 2024-05-10T03:34:45.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:44 smithi045 ceph-mon[42520]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "69265bae-5027-4810-978d-3d10eb35797c"}]': finished 2024-05-10T03:34:45.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:44 smithi045 ceph-mon[42520]: osdmap e10: 2 total, 1 up, 2 in 2024-05-10T03:34:45.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:44 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T03:34:45.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:44 smithi106 ceph-mon[46996]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T03:34:45.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:44 smithi106 ceph-mon[46996]: osdmap e9: 1 total, 1 up, 1 in 2024-05-10T03:34:45.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:44 smithi106 ceph-mon[46996]: from='client.? 172.21.15.106:0/555353148' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69265bae-5027-4810-978d-3d10eb35797c"}]: dispatch 2024-05-10T03:34:45.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:44 smithi106 ceph-mon[46996]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69265bae-5027-4810-978d-3d10eb35797c"}]: dispatch 2024-05-10T03:34:45.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:44 smithi106 ceph-mon[46996]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "69265bae-5027-4810-978d-3d10eb35797c"}]': finished 2024-05-10T03:34:45.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:44 smithi106 ceph-mon[46996]: osdmap e10: 2 total, 1 up, 2 in 2024-05-10T03:34:45.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:44 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T03:34:46.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:45 smithi154 ceph-mon[46565]: from='client.? 172.21.15.106:0/566631079' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:34:46.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:45 smithi045 ceph-mon[42520]: from='client.? 172.21.15.106:0/566631079' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:34:46.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:45 smithi106 ceph-mon[46996]: from='client.? 172.21.15.106:0/566631079' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:34:47.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:46 smithi154 ceph-mon[46565]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-10T03:34:47.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:46 smithi045 ceph-mon[42520]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-10T03:34:47.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:46 smithi106 ceph-mon[46996]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-10T03:34:49.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:48 smithi106 ceph-mon[46996]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-10T03:34:49.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:48 smithi154 ceph-mon[46565]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-10T03:34:49.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:48 smithi045 ceph-mon[42520]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-10T03:34:51.067 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:50 smithi106 ceph-mon[46996]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-10T03:34:51.067 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:50 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-10T03:34:51.067 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:50 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:51.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:50 smithi154 ceph-mon[46565]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-10T03:34:51.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:50 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-10T03:34:51.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:50 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:51.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:50 smithi045 ceph-mon[42520]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-10T03:34:51.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:50 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-10T03:34:51.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:50 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:52.086 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:51 smithi106 ceph-mon[46996]: Deploying daemon osd.1 on smithi106 2024-05-10T03:34:52.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:51 smithi154 ceph-mon[46565]: Deploying daemon osd.1 on smithi106 2024-05-10T03:34:52.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:51 smithi045 ceph-mon[42520]: Deploying daemon osd.1 on smithi106 2024-05-10T03:34:53.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:52 smithi106 ceph-mon[46996]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-10T03:34:53.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:52 smithi045 ceph-mon[42520]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-10T03:34:53.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:52 smithi154 ceph-mon[46565]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-10T03:34:55.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:55 smithi045 ceph-mon[42520]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-10T03:34:55.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:55 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:55.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:55 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:55.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:55 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:55.367 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:55 smithi106 ceph-mon[46996]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-10T03:34:55.368 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:55 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:55.368 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:55 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:55.368 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:55 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:55.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:55 smithi154 ceph-mon[46565]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-10T03:34:55.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:55 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:55.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:55 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:55.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:55 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:56.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:56.354+0000 7faba89e4700 1 -- 172.21.15.106:0/2755818240 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7faba410d7d0 con 0x7fab8c0a1110 2024-05-10T03:34:56.358 INFO:teuthology.orchestra.run.smithi106.stdout:Created osd(s) 1 on host 'smithi106' 2024-05-10T03:34:56.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:56.357+0000 7faba99e6700 1 -- 172.21.15.106:0/2755818240 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fab8c0a1110 msgr2=0x7fab8c0a3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:56.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:56.357+0000 7faba99e6700 1 --2- 172.21.15.106:0/2755818240 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fab8c0a1110 0x7fab8c0a3620 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fab98005950 tx=0x7fab980058e0 comp rx=0 tx=0).stop 2024-05-10T03:34:56.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:56.357+0000 7faba99e6700 1 -- 172.21.15.106:0/2755818240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faba4105120 msgr2=0x7faba41987a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:56.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:56.357+0000 7faba99e6700 1 --2- 172.21.15.106:0/2755818240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faba4105120 0x7faba41987a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fab9400d950 tx=0x7fab9400dd10 comp rx=0 tx=0).stop 2024-05-10T03:34:56.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:56.357+0000 7faba99e6700 1 -- 172.21.15.106:0/2755818240 shutdown_connections 2024-05-10T03:34:56.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:56.357+0000 7faba99e6700 1 --2- 172.21.15.106:0/2755818240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faba4100030 0x7faba4198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:56.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:56.357+0000 7faba99e6700 1 --2- 172.21.15.106:0/2755818240 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fab8c0a1110 0x7fab8c0a3620 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:56.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:56.357+0000 7faba99e6700 1 --2- 172.21.15.106:0/2755818240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faba4107a80 0x7faba4199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:56.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:56.357+0000 7faba99e6700 1 --2- 172.21.15.106:0/2755818240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faba4105120 0x7faba41987a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:56.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:56.357+0000 7faba99e6700 1 -- 172.21.15.106:0/2755818240 >> 172.21.15.106:0/2755818240 conn(0x7faba40fb990 msgr2=0x7faba4105bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:34:56.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:56.357+0000 7faba99e6700 1 -- 172.21.15.106:0/2755818240 shutdown_connections 2024-05-10T03:34:56.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:34:56.357+0000 7faba99e6700 1 -- 172.21.15.106:0/2755818240 wait complete. 2024-05-10T03:34:56.516 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:56 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:56.516 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:56 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:56.516 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:56 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:56.516 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:56 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:56.516 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:56 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:56.516 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:56 smithi106 ceph-mon[46996]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-10T03:34:56.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:56 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:56.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:56 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:56.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:56 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:56.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:56 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:56.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:56 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:56.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:56 smithi045 ceph-mon[42520]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-10T03:34:56.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:56 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:56.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:56 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:56.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:56 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:56.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:56 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:56.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:56 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:56.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:56 smithi154 ceph-mon[46565]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-10T03:34:56.750 DEBUG:teuthology.orchestra.run.smithi106:osd.1> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.1.service 2024-05-10T03:34:56.753 INFO:tasks.cephadm:Deploying osd.2 on smithi154 with /dev/vg_nvme/lv_4... 2024-05-10T03:34:56.753 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-10T03:34:56.785 INFO:journalctl@ceph.osd.1.smithi106.stdout:-- Logs begin at Fri 2024-05-10 03:15:26 UTC. -- 2024-05-10T03:34:56.982 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T03:34:57.408 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:57 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:57.408 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:57 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:57.409 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:57 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:57.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:57 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:57.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:57 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:57.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:57 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:57.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:57 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:57.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:57 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:57.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:57 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:34:58.306 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-10T03:34:58.307 INFO:teuthology.orchestra.run.smithi154.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-10T03:34:58.307 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10+0 records in 2024-05-10T03:34:58.307 INFO:teuthology.orchestra.run.smithi154.stderr:10+0 records out 2024-05-10T03:34:58.307 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112145 s, 935 MB/s 2024-05-10T03:34:58.307 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping successful for: 2024-05-10T03:34:58.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:58 smithi106 ceph-mon[46996]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-10T03:34:58.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:58 smithi106 ceph-mon[46996]: from='osd.1 [v2:172.21.15.106:6800/3117600187,v1:172.21.15.106:6801/3117600187]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-10T03:34:58.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:58 smithi106 ceph-mon[46996]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-10T03:34:58.402 INFO:journalctl@ceph.osd.1.smithi106.stdout:May 10 03:34:58 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-1[51969]: 2024-05-10T03:34:58.082+0000 7f70985a57c0 -1 osd.1 0 log_to_monitors true 2024-05-10T03:34:58.620 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:58 smithi154 ceph-mon[46565]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-10T03:34:58.620 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:58 smithi154 ceph-mon[46565]: from='osd.1 [v2:172.21.15.106:6800/3117600187,v1:172.21.15.106:6801/3117600187]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-10T03:34:58.620 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:58 smithi154 ceph-mon[46565]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-10T03:34:58.695 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_4 2024-05-10T03:34:58.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:58 smithi045 ceph-mon[42520]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-10T03:34:58.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:58 smithi045 ceph-mon[42520]: from='osd.1 [v2:172.21.15.106:6800/3117600187,v1:172.21.15.106:6801/3117600187]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-10T03:34:58.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:58 smithi045 ceph-mon[42520]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-10T03:34:58.912 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T03:34:59.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:59 smithi106 ceph-mon[46996]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-10T03:34:59.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:59 smithi106 ceph-mon[46996]: osdmap e11: 2 total, 1 up, 2 in 2024-05-10T03:34:59.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:59 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T03:34:59.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:59 smithi106 ceph-mon[46996]: from='osd.1 [v2:172.21.15.106:6800/3117600187,v1:172.21.15.106:6801/3117600187]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-10T03:34:59.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:59 smithi106 ceph-mon[46996]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-10T03:34:59.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:59 smithi106 ceph-mon[46996]: Detected new or changed devices on smithi106 2024-05-10T03:34:59.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:59 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:59.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:59 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:59.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:59 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:34:59.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:59 smithi106 ceph-mon[46996]: Adjusting osd_memory_target on smithi106 to 17114M 2024-05-10T03:34:59.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:59 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:59.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:59 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:59.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:59 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:59.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:34:59 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:59.718 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:59 smithi154 ceph-mon[46565]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-10T03:34:59.718 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:59 smithi154 ceph-mon[46565]: osdmap e11: 2 total, 1 up, 2 in 2024-05-10T03:34:59.718 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:59 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T03:34:59.718 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:59 smithi154 ceph-mon[46565]: from='osd.1 [v2:172.21.15.106:6800/3117600187,v1:172.21.15.106:6801/3117600187]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-10T03:34:59.718 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:59 smithi154 ceph-mon[46565]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-10T03:34:59.718 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:59 smithi154 ceph-mon[46565]: Detected new or changed devices on smithi106 2024-05-10T03:34:59.718 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:59 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:59.718 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:59 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:59.718 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:59 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:34:59.719 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:59 smithi154 ceph-mon[46565]: Adjusting osd_memory_target on smithi106 to 17114M 2024-05-10T03:34:59.719 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:59 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:59.719 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:59 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:59.719 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:59 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:59.719 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:34:59 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:59.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:59 smithi045 ceph-mon[42520]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-10T03:34:59.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:59 smithi045 ceph-mon[42520]: osdmap e11: 2 total, 1 up, 2 in 2024-05-10T03:34:59.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:59 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T03:34:59.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:59 smithi045 ceph-mon[42520]: from='osd.1 [v2:172.21.15.106:6800/3117600187,v1:172.21.15.106:6801/3117600187]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-10T03:34:59.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:59 smithi045 ceph-mon[42520]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-10T03:34:59.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:59 smithi045 ceph-mon[42520]: Detected new or changed devices on smithi106 2024-05-10T03:34:59.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:59 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:59.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:59 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:59.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:59 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:34:59.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:59 smithi045 ceph-mon[42520]: Adjusting osd_memory_target on smithi106 to 17114M 2024-05-10T03:34:59.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:59 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:59.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:59 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:34:59.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:59 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:34:59.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:34:59 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:34:59.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.891+0000 7f6715d29700 1 -- 172.21.15.154:0/2883351776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6710103230 msgr2=0x7f6710103640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:59.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.891+0000 7f6715d29700 1 --2- 172.21.15.154:0/2883351776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6710103230 0x7f6710103640 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f66f8009990 tx=0x7f66f8009ca0 comp rx=0 tx=0).stop 2024-05-10T03:34:59.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.891+0000 7f6715d29700 1 -- 172.21.15.154:0/2883351776 shutdown_connections 2024-05-10T03:34:59.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.891+0000 7f6715d29700 1 --2- 172.21.15.154:0/2883351776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6710103230 0x7f6710103640 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:59.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.891+0000 7f6715d29700 1 --2- 172.21.15.154:0/2883351776 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67101005d0 0x7f671010a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:59.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.891+0000 7f6715d29700 1 --2- 172.21.15.154:0/2883351776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67100ffc80 0x7f6710100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:59.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.891+0000 7f6715d29700 1 -- 172.21.15.154:0/2883351776 >> 172.21.15.154:0/2883351776 conn(0x7f67100fb950 msgr2=0x7f67100fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:34:59.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.891+0000 7f6715d29700 1 -- 172.21.15.154:0/2883351776 shutdown_connections 2024-05-10T03:34:59.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.891+0000 7f6715d29700 1 -- 172.21.15.154:0/2883351776 wait complete. 2024-05-10T03:34:59.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.892+0000 7f6715d29700 1 Processor -- start 2024-05-10T03:34:59.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.892+0000 7f6715d29700 1 -- start start 2024-05-10T03:34:59.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.892+0000 7f6715d29700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67100ffc80 0x7f67101981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:59.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.892+0000 7f6715d29700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67101005d0 0x7f6710198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:59.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.892+0000 7f6715d29700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6710103230 0x7f67101994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:59.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.892+0000 7f6715d29700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6710199a90 con 0x7f67100ffc80 2024-05-10T03:34:59.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.892+0000 7f6715d29700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6710199bd0 con 0x7f6710103230 2024-05-10T03:34:59.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.892+0000 7f6715d29700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6710199d90 con 0x7f67101005d0 2024-05-10T03:34:59.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.893+0000 7f670effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67101005d0 0x7f6710198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:59.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.893+0000 7f670effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67101005d0 0x7f6710198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39868/0 (socket says 172.21.15.154:39868) 2024-05-10T03:34:59.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.893+0000 7f670effd700 1 -- 172.21.15.154:0/798909963 learned_addr learned my addr 172.21.15.154:0/798909963 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-10T03:34:59.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.893+0000 7f670ffff700 1 --2- 172.21.15.154:0/798909963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6710103230 0x7f67101994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:59.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.893+0000 7f670f7fe700 1 --2- 172.21.15.154:0/798909963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67100ffc80 0x7f67101981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:59.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.893+0000 7f670effd700 1 -- 172.21.15.154:0/798909963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6710103230 msgr2=0x7f67101994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:59.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.893+0000 7f670effd700 1 --2- 172.21.15.154:0/798909963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6710103230 0x7f67101994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:59.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.893+0000 7f670effd700 1 -- 172.21.15.154:0/798909963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67100ffc80 msgr2=0x7f67101981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:34:59.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.893+0000 7f670effd700 1 --2- 172.21.15.154:0/798909963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67100ffc80 0x7f67101981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:34:59.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.893+0000 7f670effd700 1 -- 172.21.15.154:0/798909963 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f80095f0 con 0x7f67101005d0 2024-05-10T03:34:59.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.893+0000 7f670f7fe700 1 --2- 172.21.15.154:0/798909963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67100ffc80 0x7f67101981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:34:59.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.893+0000 7f670effd700 1 --2- 172.21.15.154:0/798909963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67101005d0 0x7f6710198710 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f670000c9b0 tx=0x7f670000ccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:34:59.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.893+0000 7f670cff9700 1 -- 172.21.15.154:0/798909963 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6700007b00 con 0x7f67101005d0 2024-05-10T03:34:59.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.893+0000 7f6715d29700 1 -- 172.21.15.154:0/798909963 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f671019a070 con 0x7f67101005d0 2024-05-10T03:34:59.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.893+0000 7f670cff9700 1 -- 172.21.15.154:0/798909963 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6700007c60 con 0x7f67101005d0 2024-05-10T03:34:59.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.893+0000 7f670cff9700 1 -- 172.21.15.154:0/798909963 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6700018660 con 0x7f67101005d0 2024-05-10T03:34:59.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.893+0000 7f6715d29700 1 -- 172.21.15.154:0/798909963 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67101a08e0 con 0x7f67101005d0 2024-05-10T03:34:59.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.894+0000 7f6715d29700 1 -- 172.21.15.154:0/798909963 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6710109090 con 0x7f67101005d0 2024-05-10T03:34:59.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.896+0000 7f670cff9700 1 -- 172.21.15.154:0/798909963 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7f670000f450 con 0x7f67101005d0 2024-05-10T03:34:59.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.896+0000 7f670cff9700 1 --2- 172.21.15.154:0/798909963 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f66fc0a1090 0x7f66fc0a35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:34:59.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.896+0000 7f670cff9700 1 -- 172.21.15.154:0/798909963 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2029+0+0 (secure 0 0 0) 0x7f67000cb1c0 con 0x7f67101005d0 2024-05-10T03:34:59.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.896+0000 7f670f7fe700 1 --2- 172.21.15.154:0/798909963 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f66fc0a1090 0x7f66fc0a35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:34:59.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.897+0000 7f670f7fe700 1 --2- 172.21.15.154:0/798909963 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f66fc0a1090 0x7f66fc0a35a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f66f800b2e0 tx=0x7f66f8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:34:59.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:34:59.900+0000 7f670cff9700 1 -- 172.21.15.154:0/798909963 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6700096350 con 0x7f67101005d0 2024-05-10T03:35:00.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:00.106+0000 7f6715d29700 1 -- 172.21.15.154:0/798909963 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f67100008d0 con 0x7f66fc0a1090 2024-05-10T03:35:00.338 INFO:journalctl@ceph.osd.1.smithi106.stdout:May 10 03:35:00 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-1[51969]: 2024-05-10T03:35:00.043+0000 7f708dc09700 -1 osd.1 0 waiting for initial osdmap 2024-05-10T03:35:00.338 INFO:journalctl@ceph.osd.1.smithi106.stdout:May 10 03:35:00 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-1[51969]: 2024-05-10T03:35:00.047+0000 7f70859b8700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T03:35:00.637 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:00 smithi154 ceph-mon[46565]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-05-10T03:35:00.637 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:00 smithi154 ceph-mon[46565]: osdmap e12: 2 total, 1 up, 2 in 2024-05-10T03:35:00.637 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:00 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T03:35:00.637 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:00 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T03:35:00.637 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:00 smithi154 ceph-mon[46565]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-10T03:35:00.637 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:00 smithi154 ceph-mon[46565]: from='osd.1 ' entity='osd.1' 2024-05-10T03:35:00.637 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:00 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:35:00.637 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:00 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:35:00.637 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:00 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:00.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:00 smithi106 ceph-mon[46996]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-05-10T03:35:00.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:00 smithi106 ceph-mon[46996]: osdmap e12: 2 total, 1 up, 2 in 2024-05-10T03:35:00.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:00 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T03:35:00.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:00 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T03:35:00.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:00 smithi106 ceph-mon[46996]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-10T03:35:00.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:00 smithi106 ceph-mon[46996]: from='osd.1 ' entity='osd.1' 2024-05-10T03:35:00.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:00 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:35:00.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:00 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:35:00.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:00 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:00.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:00 smithi045 ceph-mon[42520]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-05-10T03:35:00.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:00 smithi045 ceph-mon[42520]: osdmap e12: 2 total, 1 up, 2 in 2024-05-10T03:35:00.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:00 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T03:35:00.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:00 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T03:35:00.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:00 smithi045 ceph-mon[42520]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-10T03:35:00.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:00 smithi045 ceph-mon[42520]: from='osd.1 ' entity='osd.1' 2024-05-10T03:35:00.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:00 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:35:00.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:00 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:35:00.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:00 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:01.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:01 smithi106 ceph-mon[46996]: purged_snaps scrub starts 2024-05-10T03:35:01.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:01 smithi106 ceph-mon[46996]: purged_snaps scrub ok 2024-05-10T03:35:01.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:01 smithi106 ceph-mon[46996]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:35:01.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:01 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T03:35:01.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:01 smithi106 ceph-mon[46996]: osd.1 [v2:172.21.15.106:6800/3117600187,v1:172.21.15.106:6801/3117600187] boot 2024-05-10T03:35:01.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:01 smithi106 ceph-mon[46996]: osdmap e13: 2 total, 2 up, 2 in 2024-05-10T03:35:01.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:01 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T03:35:01.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:01 smithi154 ceph-mon[46565]: purged_snaps scrub starts 2024-05-10T03:35:01.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:01 smithi154 ceph-mon[46565]: purged_snaps scrub ok 2024-05-10T03:35:01.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:01 smithi154 ceph-mon[46565]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:35:01.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:01 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T03:35:01.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:01 smithi154 ceph-mon[46565]: osd.1 [v2:172.21.15.106:6800/3117600187,v1:172.21.15.106:6801/3117600187] boot 2024-05-10T03:35:01.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:01 smithi154 ceph-mon[46565]: osdmap e13: 2 total, 2 up, 2 in 2024-05-10T03:35:01.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:01 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T03:35:01.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:01 smithi045 ceph-mon[42520]: purged_snaps scrub starts 2024-05-10T03:35:01.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:01 smithi045 ceph-mon[42520]: purged_snaps scrub ok 2024-05-10T03:35:01.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:01 smithi045 ceph-mon[42520]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:35:01.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:01 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T03:35:01.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:01 smithi045 ceph-mon[42520]: osd.1 [v2:172.21.15.106:6800/3117600187,v1:172.21.15.106:6801/3117600187] boot 2024-05-10T03:35:01.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:01 smithi045 ceph-mon[42520]: osdmap e13: 2 total, 2 up, 2 in 2024-05-10T03:35:01.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:01 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T03:35:02.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:02 smithi106 ceph-mon[46996]: pgmap v51: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:02.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:02 smithi106 ceph-mon[46996]: from='client.? 172.21.15.154:0/2193911104' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56824828-0b1e-4068-b8c8-cbad269da7ef"}]: dispatch 2024-05-10T03:35:02.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:02 smithi106 ceph-mon[46996]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56824828-0b1e-4068-b8c8-cbad269da7ef"}]: dispatch 2024-05-10T03:35:02.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:02 smithi106 ceph-mon[46996]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56824828-0b1e-4068-b8c8-cbad269da7ef"}]': finished 2024-05-10T03:35:02.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:02 smithi106 ceph-mon[46996]: osdmap e14: 3 total, 2 up, 3 in 2024-05-10T03:35:02.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:02 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T03:35:02.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:02 smithi154 ceph-mon[46565]: pgmap v51: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:02.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:02 smithi154 ceph-mon[46565]: from='client.? 172.21.15.154:0/2193911104' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56824828-0b1e-4068-b8c8-cbad269da7ef"}]: dispatch 2024-05-10T03:35:02.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:02 smithi154 ceph-mon[46565]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56824828-0b1e-4068-b8c8-cbad269da7ef"}]: dispatch 2024-05-10T03:35:02.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:02 smithi154 ceph-mon[46565]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56824828-0b1e-4068-b8c8-cbad269da7ef"}]': finished 2024-05-10T03:35:02.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:02 smithi154 ceph-mon[46565]: osdmap e14: 3 total, 2 up, 3 in 2024-05-10T03:35:02.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:02 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T03:35:02.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:02 smithi045 ceph-mon[42520]: pgmap v51: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:02.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:02 smithi045 ceph-mon[42520]: from='client.? 172.21.15.154:0/2193911104' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56824828-0b1e-4068-b8c8-cbad269da7ef"}]: dispatch 2024-05-10T03:35:02.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:02 smithi045 ceph-mon[42520]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56824828-0b1e-4068-b8c8-cbad269da7ef"}]: dispatch 2024-05-10T03:35:02.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:02 smithi045 ceph-mon[42520]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56824828-0b1e-4068-b8c8-cbad269da7ef"}]': finished 2024-05-10T03:35:02.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:02 smithi045 ceph-mon[42520]: osdmap e14: 3 total, 2 up, 3 in 2024-05-10T03:35:02.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:02 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T03:35:03.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:03 smithi106 ceph-mon[46996]: from='client.? 172.21.15.154:0/172543430' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:35:03.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:03 smithi106 ceph-mon[46996]: osdmap e15: 3 total, 2 up, 3 in 2024-05-10T03:35:03.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:03 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T03:35:03.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:03 smithi154 ceph-mon[46565]: from='client.? 172.21.15.154:0/172543430' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:35:03.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:03 smithi154 ceph-mon[46565]: osdmap e15: 3 total, 2 up, 3 in 2024-05-10T03:35:03.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:03 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T03:35:03.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:03 smithi045 ceph-mon[42520]: from='client.? 172.21.15.154:0/172543430' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:35:03.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:03 smithi045 ceph-mon[42520]: osdmap e15: 3 total, 2 up, 3 in 2024-05-10T03:35:03.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:03 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T03:35:04.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:04 smithi106 ceph-mon[46996]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:04.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:04 smithi154 ceph-mon[46565]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:04.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:04 smithi045 ceph-mon[42520]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:07.056 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:06 smithi154 ceph-mon[46565]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:07.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:06 smithi106 ceph-mon[46996]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:07.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:06 smithi045 ceph-mon[42520]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:08.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:07 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-10T03:35:08.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:07 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:08.204 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:07 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-10T03:35:08.204 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:07 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:08.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:07 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-10T03:35:08.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:07 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:09.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:08 smithi106 ceph-mon[46996]: Deploying daemon osd.2 on smithi154 2024-05-10T03:35:09.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:08 smithi106 ceph-mon[46996]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:09.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:08 smithi154 ceph-mon[46565]: Deploying daemon osd.2 on smithi154 2024-05-10T03:35:09.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:08 smithi154 ceph-mon[46565]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:09.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:08 smithi045 ceph-mon[42520]: Deploying daemon osd.2 on smithi154 2024-05-10T03:35:09.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:08 smithi045 ceph-mon[42520]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:11.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:10 smithi106 ceph-mon[46996]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:11.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:10 smithi154 ceph-mon[46565]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:11.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:10 smithi045 ceph-mon[42520]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:12.907 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:12.907 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:12.907 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:35:12.907 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:12 smithi154 ceph-mon[46565]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:13.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:13.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:13.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:35:13.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:12 smithi045 ceph-mon[42520]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:13.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:13.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:13.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:35:13.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:12 smithi106 ceph-mon[46996]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:13.914 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 2 on host 'smithi154' 2024-05-10T03:35:13.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:13.910+0000 7f670cff9700 1 -- 172.21.15.154:0/798909963 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f67100008d0 con 0x7f66fc0a1090 2024-05-10T03:35:13.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:13.912+0000 7f6715d29700 1 -- 172.21.15.154:0/798909963 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f66fc0a1090 msgr2=0x7f66fc0a35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:35:13.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:13.912+0000 7f6715d29700 1 --2- 172.21.15.154:0/798909963 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f66fc0a1090 0x7f66fc0a35a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f66f800b2e0 tx=0x7f66f8005fb0 comp rx=0 tx=0).stop 2024-05-10T03:35:13.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:13.912+0000 7f6715d29700 1 -- 172.21.15.154:0/798909963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67101005d0 msgr2=0x7f6710198710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:35:13.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:13.912+0000 7f6715d29700 1 --2- 172.21.15.154:0/798909963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67101005d0 0x7f6710198710 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f670000c9b0 tx=0x7f670000ccc0 comp rx=0 tx=0).stop 2024-05-10T03:35:13.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:13.912+0000 7f6715d29700 1 -- 172.21.15.154:0/798909963 shutdown_connections 2024-05-10T03:35:13.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:13.912+0000 7f6715d29700 1 --2- 172.21.15.154:0/798909963 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f66fc0a1090 0x7f66fc0a35a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:13.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:13.912+0000 7f6715d29700 1 --2- 172.21.15.154:0/798909963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6710103230 0x7f67101994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:13.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:13.912+0000 7f6715d29700 1 --2- 172.21.15.154:0/798909963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67100ffc80 0x7f67101981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:13.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:13.912+0000 7f6715d29700 1 --2- 172.21.15.154:0/798909963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67101005d0 0x7f6710198710 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:13.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:13.912+0000 7f6715d29700 1 -- 172.21.15.154:0/798909963 >> 172.21.15.154:0/798909963 conn(0x7f67100fb950 msgr2=0x7f67101061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:35:13.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:13.912+0000 7f6715d29700 1 -- 172.21.15.154:0/798909963 shutdown_connections 2024-05-10T03:35:13.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:13.912+0000 7f6715d29700 1 -- 172.21.15.154:0/798909963 wait complete. 2024-05-10T03:35:14.306 DEBUG:teuthology.orchestra.run.smithi154:osd.2> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.2.service 2024-05-10T03:35:14.308 INFO:tasks.cephadm:Deploying osd.3 on smithi045 with /dev/vg_nvme/lv_3... 2024-05-10T03:35:14.308 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-10T03:35:14.338 INFO:journalctl@ceph.osd.2.smithi154.stdout:-- Logs begin at Fri 2024-05-10 03:15:42 UTC. -- 2024-05-10T03:35:14.387 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:14 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:14.387 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:14 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:14.387 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:14 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:14.387 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:14 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:35:14.387 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:14 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:14.387 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:14 smithi154 ceph-mon[46565]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:14.387 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:14 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:14.387 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:14 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:14.387 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:14 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:35:14.566 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:35:14.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:14 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:14.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:14 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:14.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:14 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:14.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:14 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:35:14.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:14 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:14.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:14 smithi106 ceph-mon[46996]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:14.653 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:14 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:14.653 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:14 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:14.653 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:14 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:35:14.680 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:14 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:14.681 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:14 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:14.681 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:14 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:14.681 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:14 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:35:14.681 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:14 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:14.681 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:14 smithi045 ceph-mon[42520]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:14.681 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:14 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:14.681 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:14 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:14.681 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:14 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:35:15.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:15 smithi154 ceph-mon[46565]: from='osd.2 [v2:172.21.15.154:6800/2777220958,v1:172.21.15.154:6801/2777220958]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-10T03:35:15.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:15 smithi154 ceph-mon[46565]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-10T03:35:15.975 INFO:journalctl@ceph.osd.2.smithi154.stdout:May 10 03:35:15 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-2[52343]: 2024-05-10T03:35:15.711+0000 7f021dd987c0 -1 osd.2 0 log_to_monitors true 2024-05-10T03:35:15.983 INFO:teuthology.orchestra.run.smithi045.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-10T03:35:15.984 INFO:teuthology.orchestra.run.smithi045.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-10T03:35:15.984 INFO:teuthology.orchestra.run.smithi045.stderr: stderr: 10+0 records in 2024-05-10T03:35:15.984 INFO:teuthology.orchestra.run.smithi045.stderr:10+0 records out 2024-05-10T03:35:15.984 INFO:teuthology.orchestra.run.smithi045.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00906621 s, 1.2 GB/s 2024-05-10T03:35:15.984 INFO:teuthology.orchestra.run.smithi045.stderr:--> Zapping successful for: 2024-05-10T03:35:16.031 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:15 smithi045 ceph-mon[42520]: from='osd.2 [v2:172.21.15.154:6800/2777220958,v1:172.21.15.154:6801/2777220958]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-10T03:35:16.031 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:15 smithi045 ceph-mon[42520]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-10T03:35:16.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:15 smithi106 ceph-mon[46996]: from='osd.2 [v2:172.21.15.154:6800/2777220958,v1:172.21.15.154:6801/2777220958]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-10T03:35:16.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:15 smithi106 ceph-mon[46996]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-10T03:35:16.412 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi045:vg_nvme/lv_3 2024-05-10T03:35:16.661 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:35:17.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:16 smithi045 ceph-mon[42520]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-10T03:35:17.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:16 smithi045 ceph-mon[42520]: osdmap e16: 3 total, 2 up, 3 in 2024-05-10T03:35:17.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T03:35:17.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:16 smithi045 ceph-mon[42520]: from='osd.2 [v2:172.21.15.154:6800/2777220958,v1:172.21.15.154:6801/2777220958]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-10T03:35:17.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:16 smithi045 ceph-mon[42520]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-10T03:35:17.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:16 smithi045 ceph-mon[42520]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:17.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:17.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:17.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:35:17.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:17.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:17.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:35:17.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:17.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:16 smithi106 ceph-mon[46996]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-10T03:35:17.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:16 smithi106 ceph-mon[46996]: osdmap e16: 3 total, 2 up, 3 in 2024-05-10T03:35:17.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T03:35:17.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:16 smithi106 ceph-mon[46996]: from='osd.2 [v2:172.21.15.154:6800/2777220958,v1:172.21.15.154:6801/2777220958]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-10T03:35:17.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:16 smithi106 ceph-mon[46996]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-10T03:35:17.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:16 smithi106 ceph-mon[46996]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:17.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:17.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:17.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:35:17.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:17.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:17.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:35:17.153 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:17.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:16 smithi154 ceph-mon[46565]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-10T03:35:17.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:16 smithi154 ceph-mon[46565]: osdmap e16: 3 total, 2 up, 3 in 2024-05-10T03:35:17.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T03:35:17.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:16 smithi154 ceph-mon[46565]: from='osd.2 [v2:172.21.15.154:6800/2777220958,v1:172.21.15.154:6801/2777220958]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-10T03:35:17.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:16 smithi154 ceph-mon[46565]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-10T03:35:17.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:16 smithi154 ceph-mon[46565]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:17.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:17.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:17.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:35:17.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:17.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:17.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:35:17.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:17.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.695+0000 7f9b34c7f700 1 -- 172.21.15.45:0/154154313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b301050e0 msgr2=0x7f9b30107500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:35:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.695+0000 7f9b34c7f700 1 --2- 172.21.15.45:0/154154313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b301050e0 0x7f9b30107500 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9b24009990 tx=0x7f9b24009ca0 comp rx=0 tx=0).stop 2024-05-10T03:35:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.695+0000 7f9b34c7f700 1 -- 172.21.15.45:0/154154313 shutdown_connections 2024-05-10T03:35:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.695+0000 7f9b34c7f700 1 --2- 172.21.15.45:0/154154313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b30102780 0x7f9b30104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.695+0000 7f9b34c7f700 1 --2- 172.21.15.45:0/154154313 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b30107a40 0x7f9b30109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.695+0000 7f9b34c7f700 1 --2- 172.21.15.45:0/154154313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b301050e0 0x7f9b30107500 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.695+0000 7f9b34c7f700 1 -- 172.21.15.45:0/154154313 >> 172.21.15.45:0/154154313 conn(0x7f9b300fc1c0 msgr2=0x7f9b300fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:35:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.696+0000 7f9b34c7f700 1 -- 172.21.15.45:0/154154313 shutdown_connections 2024-05-10T03:35:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.696+0000 7f9b34c7f700 1 -- 172.21.15.45:0/154154313 wait complete. 2024-05-10T03:35:17.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.697+0000 7f9b34c7f700 1 Processor -- start 2024-05-10T03:35:17.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.697+0000 7f9b34c7f700 1 -- start start 2024-05-10T03:35:17.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.697+0000 7f9b34c7f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b30102780 0x7f9b301981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:35:17.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.697+0000 7f9b34c7f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b301050e0 0x7f9b30198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:35:17.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.697+0000 7f9b34c7f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b30107a40 0x7f9b301994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:35:17.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.697+0000 7f9b34c7f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b30199b30 con 0x7f9b30107a40 2024-05-10T03:35:17.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.697+0000 7f9b34c7f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b30199c70 con 0x7f9b30102780 2024-05-10T03:35:17.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.697+0000 7f9b34c7f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b30199e30 con 0x7f9b301050e0 2024-05-10T03:35:17.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.697+0000 7f9b2ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b30107a40 0x7f9b301994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:35:17.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.697+0000 7f9b2ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b30107a40 0x7f9b301994d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58816/0 (socket says 172.21.15.45:58816) 2024-05-10T03:35:17.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.697+0000 7f9b2ed9d700 1 -- 172.21.15.45:0/3407012193 learned_addr learned my addr 172.21.15.45:0/3407012193 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:35:17.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.697+0000 7f9b2e59c700 1 --2- 172.21.15.45:0/3407012193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b30102780 0x7f9b301981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:35:17.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.697+0000 7f9b2dd9b700 1 --2- 172.21.15.45:0/3407012193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b301050e0 0x7f9b30198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:35:17.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.697+0000 7f9b2ed9d700 1 -- 172.21.15.45:0/3407012193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b301050e0 msgr2=0x7f9b30198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:35:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.697+0000 7f9b2ed9d700 1 --2- 172.21.15.45:0/3407012193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b301050e0 0x7f9b30198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.697+0000 7f9b2ed9d700 1 -- 172.21.15.45:0/3407012193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b30102780 msgr2=0x7f9b301981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:35:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.697+0000 7f9b2ed9d700 1 --2- 172.21.15.45:0/3407012193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b30102780 0x7f9b301981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.697+0000 7f9b2ed9d700 1 -- 172.21.15.45:0/3407012193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b240095f0 con 0x7f9b30107a40 2024-05-10T03:35:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.698+0000 7f9b2ed9d700 1 --2- 172.21.15.45:0/3407012193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b30107a40 0x7f9b301994d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9b28007ee0 tx=0x7f9b2800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:35:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.698+0000 7f9b1f7fe700 1 -- 172.21.15.45:0/3407012193 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2800ddd0 con 0x7f9b30107a40 2024-05-10T03:35:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.698+0000 7f9b34c7f700 1 -- 172.21.15.45:0/3407012193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b3019a110 con 0x7f9b30107a40 2024-05-10T03:35:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.698+0000 7f9b1f7fe700 1 -- 172.21.15.45:0/3407012193 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9b2800f040 con 0x7f9b30107a40 2024-05-10T03:35:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.698+0000 7f9b1f7fe700 1 -- 172.21.15.45:0/3407012193 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b28015400 con 0x7f9b30107a40 2024-05-10T03:35:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.698+0000 7f9b34c7f700 1 -- 172.21.15.45:0/3407012193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b301a08f0 con 0x7f9b30107a40 2024-05-10T03:35:17.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.699+0000 7f9b34c7f700 1 -- 172.21.15.45:0/3407012193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b300fdd70 con 0x7f9b30107a40 2024-05-10T03:35:17.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.700+0000 7f9b1f7fe700 1 -- 172.21.15.45:0/3407012193 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7f9b28003a00 con 0x7f9b30107a40 2024-05-10T03:35:17.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.701+0000 7f9b1f7fe700 1 --2- 172.21.15.45:0/3407012193 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9b180a1110 0x7f9b180a3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:35:17.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.701+0000 7f9b2e59c700 1 --2- 172.21.15.45:0/3407012193 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9b180a1110 0x7f9b180a3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:35:17.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.701+0000 7f9b1f7fe700 1 -- 172.21.15.45:0/3407012193 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 2571+0+0 (secure 0 0 0) 0x7f9b280caae0 con 0x7f9b30107a40 2024-05-10T03:35:17.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.702+0000 7f9b2e59c700 1 --2- 172.21.15.45:0/3407012193 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9b180a1110 0x7f9b180a3620 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9b30069740 tx=0x7f9b20009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:35:17.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.706+0000 7f9b1f7fe700 1 -- 172.21.15.45:0/3407012193 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9b28095920 con 0x7f9b30107a40 2024-05-10T03:35:17.785 INFO:journalctl@ceph.osd.2.smithi154.stdout:May 10 03:35:17 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-2[52343]: 2024-05-10T03:35:17.501+0000 7f02133fc700 -1 osd.2 0 waiting for initial osdmap 2024-05-10T03:35:17.785 INFO:journalctl@ceph.osd.2.smithi154.stdout:May 10 03:35:17 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-2[52343]: 2024-05-10T03:35:17.507+0000 7f020b1ab700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T03:35:17.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:17.931+0000 7f9b34c7f700 1 -- 172.21.15.45:0/3407012193 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b3010d620 con 0x7f9b180a1110 2024-05-10T03:35:18.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:17 smithi106 ceph-mon[46996]: Detected new or changed devices on smithi154 2024-05-10T03:35:18.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:17 smithi106 ceph-mon[46996]: Adjusting osd_memory_target on smithi154 to 17114M 2024-05-10T03:35:18.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:17 smithi106 ceph-mon[46996]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-05-10T03:35:18.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:17 smithi106 ceph-mon[46996]: osdmap e17: 3 total, 2 up, 3 in 2024-05-10T03:35:18.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:17 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T03:35:18.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:17 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T03:35:18.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:17 smithi106 ceph-mon[46996]: from='osd.2 ' entity='osd.2' 2024-05-10T03:35:18.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:17 smithi154 ceph-mon[46565]: Detected new or changed devices on smithi154 2024-05-10T03:35:18.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:17 smithi154 ceph-mon[46565]: Adjusting osd_memory_target on smithi154 to 17114M 2024-05-10T03:35:18.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:17 smithi154 ceph-mon[46565]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-05-10T03:35:18.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:17 smithi154 ceph-mon[46565]: osdmap e17: 3 total, 2 up, 3 in 2024-05-10T03:35:18.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:17 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T03:35:18.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:17 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T03:35:18.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:17 smithi154 ceph-mon[46565]: from='osd.2 ' entity='osd.2' 2024-05-10T03:35:18.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:17 smithi045 ceph-mon[42520]: Detected new or changed devices on smithi154 2024-05-10T03:35:18.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:17 smithi045 ceph-mon[42520]: Adjusting osd_memory_target on smithi154 to 17114M 2024-05-10T03:35:18.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:17 smithi045 ceph-mon[42520]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-05-10T03:35:18.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:17 smithi045 ceph-mon[42520]: osdmap e17: 3 total, 2 up, 3 in 2024-05-10T03:35:18.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:17 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T03:35:18.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:17 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T03:35:18.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:17 smithi045 ceph-mon[42520]: from='osd.2 ' entity='osd.2' 2024-05-10T03:35:19.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:18 smithi045 ceph-mon[42520]: purged_snaps scrub starts 2024-05-10T03:35:19.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:18 smithi045 ceph-mon[42520]: purged_snaps scrub ok 2024-05-10T03:35:19.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:18 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T03:35:19.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:18 smithi045 ceph-mon[42520]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:19.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:18 smithi045 ceph-mon[42520]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:35:19.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:18 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:35:19.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:18 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:35:19.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:18 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:19.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:18 smithi045 ceph-mon[42520]: osd.2 [v2:172.21.15.154:6800/2777220958,v1:172.21.15.154:6801/2777220958] boot 2024-05-10T03:35:19.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:18 smithi045 ceph-mon[42520]: osdmap e18: 3 total, 3 up, 3 in 2024-05-10T03:35:19.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:18 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T03:35:19.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:18 smithi106 ceph-mon[46996]: purged_snaps scrub starts 2024-05-10T03:35:19.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:18 smithi106 ceph-mon[46996]: purged_snaps scrub ok 2024-05-10T03:35:19.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:18 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T03:35:19.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:18 smithi106 ceph-mon[46996]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:19.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:18 smithi106 ceph-mon[46996]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:35:19.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:18 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:35:19.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:18 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:35:19.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:18 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:19.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:18 smithi106 ceph-mon[46996]: osd.2 [v2:172.21.15.154:6800/2777220958,v1:172.21.15.154:6801/2777220958] boot 2024-05-10T03:35:19.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:18 smithi106 ceph-mon[46996]: osdmap e18: 3 total, 3 up, 3 in 2024-05-10T03:35:19.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:18 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T03:35:19.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:18 smithi154 ceph-mon[46565]: purged_snaps scrub starts 2024-05-10T03:35:19.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:18 smithi154 ceph-mon[46565]: purged_snaps scrub ok 2024-05-10T03:35:19.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:18 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T03:35:19.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:18 smithi154 ceph-mon[46565]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T03:35:19.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:18 smithi154 ceph-mon[46565]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:35:19.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:18 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:35:19.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:18 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:35:19.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:18 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:19.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:18 smithi154 ceph-mon[46565]: osd.2 [v2:172.21.15.154:6800/2777220958,v1:172.21.15.154:6801/2777220958] boot 2024-05-10T03:35:19.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:18 smithi154 ceph-mon[46565]: osdmap e18: 3 total, 3 up, 3 in 2024-05-10T03:35:19.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:18 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T03:35:20.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:20 smithi045 ceph-mon[42520]: osdmap e19: 3 total, 3 up, 3 in 2024-05-10T03:35:20.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:20 smithi045 ceph-mon[42520]: pgmap v66: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:20.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:20 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-10T03:35:20.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:20 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2939966795' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0df18033-7b88-4497-8241-b9acff5f7ba5"}]: dispatch 2024-05-10T03:35:20.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:20 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-10T03:35:20.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:20 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2939966795' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0df18033-7b88-4497-8241-b9acff5f7ba5"}]': finished 2024-05-10T03:35:20.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:20 smithi045 ceph-mon[42520]: osdmap e20: 4 total, 3 up, 4 in 2024-05-10T03:35:20.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:20 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T03:35:20.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:20 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-10T03:35:20.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:20 smithi106 ceph-mon[46996]: osdmap e19: 3 total, 3 up, 3 in 2024-05-10T03:35:20.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:20 smithi106 ceph-mon[46996]: pgmap v66: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:20.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:20 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-10T03:35:20.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:20 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2939966795' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0df18033-7b88-4497-8241-b9acff5f7ba5"}]: dispatch 2024-05-10T03:35:20.903 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:20 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-10T03:35:20.903 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:20 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2939966795' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0df18033-7b88-4497-8241-b9acff5f7ba5"}]': finished 2024-05-10T03:35:20.903 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:20 smithi106 ceph-mon[46996]: osdmap e20: 4 total, 3 up, 4 in 2024-05-10T03:35:20.903 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:20 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T03:35:20.903 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:20 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-10T03:35:20.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:20 smithi154 ceph-mon[46565]: osdmap e19: 3 total, 3 up, 3 in 2024-05-10T03:35:20.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:20 smithi154 ceph-mon[46565]: pgmap v66: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:20.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:20 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-10T03:35:20.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:20 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2939966795' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0df18033-7b88-4497-8241-b9acff5f7ba5"}]: dispatch 2024-05-10T03:35:20.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:20 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-10T03:35:20.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:20 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2939966795' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0df18033-7b88-4497-8241-b9acff5f7ba5"}]': finished 2024-05-10T03:35:20.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:20 smithi154 ceph-mon[46565]: osdmap e20: 4 total, 3 up, 4 in 2024-05-10T03:35:20.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:20 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T03:35:20.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:20 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-10T03:35:21.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:21 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2119654808' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:35:21.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:21 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-10T03:35:21.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:21 smithi045 ceph-mon[42520]: osdmap e21: 4 total, 3 up, 4 in 2024-05-10T03:35:21.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:21 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T03:35:21.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:21 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2119654808' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:35:21.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:21 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-10T03:35:21.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:21 smithi106 ceph-mon[46996]: osdmap e21: 4 total, 3 up, 4 in 2024-05-10T03:35:21.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:21 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T03:35:21.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:21 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2119654808' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:35:21.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:21 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-10T03:35:21.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:21 smithi154 ceph-mon[46565]: osdmap e21: 4 total, 3 up, 4 in 2024-05-10T03:35:21.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:21 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T03:35:22.284 INFO:journalctl@ceph.osd.0.smithi045.stdout:May 10 03:35:21 smithi045 sudo[66924]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-10T03:35:22.284 INFO:journalctl@ceph.osd.0.smithi045.stdout:May 10 03:35:21 smithi045 sudo[66924]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-10T03:35:22.284 INFO:journalctl@ceph.osd.0.smithi045.stdout:May 10 03:35:21 smithi045 sudo[66924]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-10T03:35:22.284 INFO:journalctl@ceph.osd.0.smithi045.stdout:May 10 03:35:21 smithi045 sudo[66924]: pam_unix(sudo:session): session closed for user root 2024-05-10T03:35:22.784 INFO:journalctl@ceph.osd.0.smithi045.stdout:May 10 03:35:22 smithi045 sudo[67113]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-10T03:35:22.784 INFO:journalctl@ceph.osd.0.smithi045.stdout:May 10 03:35:22 smithi045 sudo[67113]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-10T03:35:22.784 INFO:journalctl@ceph.osd.0.smithi045.stdout:May 10 03:35:22 smithi045 sudo[67113]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-10T03:35:22.784 INFO:journalctl@ceph.osd.0.smithi045.stdout:May 10 03:35:22 smithi045 sudo[67113]: pam_unix(sudo:session): session closed for user root 2024-05-10T03:35:22.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:22 smithi045 ceph-mon[42520]: pgmap v69: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:22.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:22 smithi045 ceph-mon[42520]: osdmap e22: 4 total, 3 up, 4 in 2024-05-10T03:35:22.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:22 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T03:35:22.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:22 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:22.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:22 smithi106 ceph-mon[46996]: pgmap v69: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:22.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:22 smithi106 ceph-mon[46996]: osdmap e22: 4 total, 3 up, 4 in 2024-05-10T03:35:22.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:22 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T03:35:22.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:22 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:22.902 INFO:journalctl@ceph.osd.1.smithi106.stdout:May 10 03:35:22 smithi106 sudo[57422]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-10T03:35:22.902 INFO:journalctl@ceph.osd.1.smithi106.stdout:May 10 03:35:22 smithi106 sudo[57422]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-10T03:35:22.902 INFO:journalctl@ceph.osd.1.smithi106.stdout:May 10 03:35:22 smithi106 sudo[57422]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-10T03:35:22.902 INFO:journalctl@ceph.osd.1.smithi106.stdout:May 10 03:35:22 smithi106 sudo[57422]: pam_unix(sudo:session): session closed for user root 2024-05-10T03:35:22.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:22 smithi154 ceph-mon[46565]: pgmap v69: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:22.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:22 smithi154 ceph-mon[46565]: osdmap e22: 4 total, 3 up, 4 in 2024-05-10T03:35:22.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:22 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T03:35:22.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:22 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:23.401 INFO:journalctl@ceph.osd.1.smithi106.stdout:May 10 03:35:22 smithi106 sudo[57425]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-10T03:35:23.401 INFO:journalctl@ceph.osd.1.smithi106.stdout:May 10 03:35:22 smithi106 sudo[57425]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-10T03:35:23.401 INFO:journalctl@ceph.osd.1.smithi106.stdout:May 10 03:35:22 smithi106 sudo[57425]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-10T03:35:23.401 INFO:journalctl@ceph.osd.1.smithi106.stdout:May 10 03:35:22 smithi106 sudo[57425]: pam_unix(sudo:session): session closed for user root 2024-05-10T03:35:23.414 INFO:journalctl@ceph.osd.2.smithi154.stdout:May 10 03:35:23 smithi154 sudo[57138]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-10T03:35:23.414 INFO:journalctl@ceph.osd.2.smithi154.stdout:May 10 03:35:23 smithi154 sudo[57138]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-10T03:35:23.414 INFO:journalctl@ceph.osd.2.smithi154.stdout:May 10 03:35:23 smithi154 sudo[57138]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-10T03:35:23.414 INFO:journalctl@ceph.osd.2.smithi154.stdout:May 10 03:35:23 smithi154 sudo[57138]: pam_unix(sudo:session): session closed for user root 2024-05-10T03:35:23.414 INFO:journalctl@ceph.osd.2.smithi154.stdout:May 10 03:35:23 smithi154 sudo[57141]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-10T03:35:23.415 INFO:journalctl@ceph.osd.2.smithi154.stdout:May 10 03:35:23 smithi154 sudo[57141]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-10T03:35:23.415 INFO:journalctl@ceph.osd.2.smithi154.stdout:May 10 03:35:23 smithi154 sudo[57141]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-10T03:35:23.415 INFO:journalctl@ceph.osd.2.smithi154.stdout:May 10 03:35:23 smithi154 sudo[57141]: pam_unix(sudo:session): session closed for user root 2024-05-10T03:35:23.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:23.429+0000 7f9b1f7fe700 1 -- 172.21.15.45:0/3407012193 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9b28003cb0 con 0x7f9b30107a40 2024-05-10T03:35:24.229 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:23 smithi045 sudo[67865]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-10T03:35:24.229 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:23 smithi045 sudo[67865]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-10T03:35:24.229 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:23 smithi045 sudo[67865]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-10T03:35:24.229 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:23 smithi045 sudo[67865]: pam_unix(sudo:session): session closed for user root 2024-05-10T03:35:24.507 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:24 smithi045 sudo[68003]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-10T03:35:24.507 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:24 smithi045 sudo[68003]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-10T03:35:24.507 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:24 smithi045 sudo[68003]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-10T03:35:24.507 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:24 smithi045 sudo[68003]: pam_unix(sudo:session): session closed for user root 2024-05-10T03:35:24.507 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:24 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:24.507 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:24 smithi045 ceph-mon[42520]: mgrmap e16: x(active, since 117s), standbys: z, y 2024-05-10T03:35:24.507 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:24 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:24.508 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:24 smithi045 ceph-mon[42520]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-10T03:35:24.635 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:24 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:24.635 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:24 smithi154 ceph-mon[46565]: mgrmap e16: x(active, since 117s), standbys: z, y 2024-05-10T03:35:24.636 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:24 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:24.636 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:24 smithi154 ceph-mon[46565]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-10T03:35:24.636 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:24 smithi154 sudo[57144]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-10T03:35:24.636 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:24 smithi154 sudo[57144]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-10T03:35:24.636 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:24 smithi154 sudo[57144]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-10T03:35:24.636 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:24 smithi154 sudo[57144]: pam_unix(sudo:session): session closed for user root 2024-05-10T03:35:24.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:24 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:24.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:24 smithi106 ceph-mon[46996]: mgrmap e16: x(active, since 117s), standbys: z, y 2024-05-10T03:35:24.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:24 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:24.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:24 smithi106 ceph-mon[46996]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-10T03:35:24.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:24 smithi154 sudo[57155]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-10T03:35:24.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:24 smithi154 sudo[57155]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-10T03:35:24.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:24 smithi154 sudo[57155]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-10T03:35:24.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:24 smithi154 sudo[57155]: pam_unix(sudo:session): session closed for user root 2024-05-10T03:35:25.389 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:25 smithi106 sudo[57428]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-10T03:35:25.389 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:25 smithi106 sudo[57428]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-10T03:35:25.389 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:25 smithi106 sudo[57428]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-10T03:35:25.389 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:25 smithi106 sudo[57428]: pam_unix(sudo:session): session closed for user root 2024-05-10T03:35:25.389 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:25 smithi106 sudo[57431]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-10T03:35:25.389 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:25 smithi106 sudo[57431]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-10T03:35:25.389 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:25 smithi106 sudo[57431]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-10T03:35:25.389 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:25 smithi106 sudo[57431]: pam_unix(sudo:session): session closed for user root 2024-05-10T03:35:25.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:25 smithi106 ceph-mon[46996]: pgmap v71: 1 pgs: 1 creating+peering; 0 B data, 93 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:25.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:25 smithi106 ceph-mon[46996]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-10T03:35:25.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:25 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T03:35:25.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:25 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:35:25.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:25 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:35:25.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:25 smithi106 ceph-mon[46996]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-10T03:35:25.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:25 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T03:35:25.653 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:25 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:35:25.653 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:25 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:35:25.653 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:25 smithi106 ceph-mon[46996]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-10T03:35:25.653 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:25 smithi106 ceph-mon[46996]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-10T03:35:25.653 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:25 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T03:35:25.653 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:25 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:35:25.654 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:25 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:35:25.654 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:25 smithi106 ceph-mon[46996]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-10T03:35:25.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:25 smithi154 ceph-mon[46565]: pgmap v71: 1 pgs: 1 creating+peering; 0 B data, 93 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:25.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:25 smithi154 ceph-mon[46565]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-10T03:35:25.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:25 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T03:35:25.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:25 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:35:25.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:25 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:35:25.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:25 smithi154 ceph-mon[46565]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-10T03:35:25.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:25 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T03:35:25.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:25 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:35:25.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:25 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:35:25.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:25 smithi154 ceph-mon[46565]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-10T03:35:25.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:25 smithi154 ceph-mon[46565]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-10T03:35:25.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:25 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T03:35:25.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:25 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:35:25.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:25 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:35:25.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:25 smithi154 ceph-mon[46565]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-10T03:35:25.730 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:25 smithi045 ceph-mon[42520]: pgmap v71: 1 pgs: 1 creating+peering; 0 B data, 93 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:25.730 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:25 smithi045 ceph-mon[42520]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-10T03:35:25.730 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T03:35:25.730 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:35:25.730 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:35:25.730 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:25 smithi045 ceph-mon[42520]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-10T03:35:25.730 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T03:35:25.731 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:35:25.731 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:35:25.731 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:25 smithi045 ceph-mon[42520]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-10T03:35:25.731 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:25 smithi045 ceph-mon[42520]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-10T03:35:25.731 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T03:35:25.731 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T03:35:25.731 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T03:35:25.731 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:25 smithi045 ceph-mon[42520]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-10T03:35:26.456 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:26 smithi045 ceph-mon[42520]: pgmap v72: 1 pgs: 1 creating+peering; 0 B data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:26.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:26 smithi106 ceph-mon[46996]: pgmap v72: 1 pgs: 1 creating+peering; 0 B data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:26.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:26 smithi154 ceph-mon[46565]: pgmap v72: 1 pgs: 1 creating+peering; 0 B data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:27.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:27 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-10T03:35:27.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:27 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:27.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:27 smithi106 ceph-mon[46996]: Deploying daemon osd.3 on smithi045 2024-05-10T03:35:27.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:27 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-10T03:35:27.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:27 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:27.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:27 smithi154 ceph-mon[46565]: Deploying daemon osd.3 on smithi045 2024-05-10T03:35:27.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-10T03:35:27.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:27.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:27 smithi045 ceph-mon[42520]: Deploying daemon osd.3 on smithi045 2024-05-10T03:35:28.498 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:28 smithi045 ceph-mon[42520]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:28.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:28 smithi106 ceph-mon[46996]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:28.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:28 smithi154 ceph-mon[46565]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:31.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:30 smithi045 ceph-mon[42520]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:31.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:30 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:31.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:30 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:31.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:30 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:35:31.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:30 smithi106 ceph-mon[46996]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:31.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:30 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:31.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:30 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:31.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:30 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:35:31.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:30 smithi154 ceph-mon[46565]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:31.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:30 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:31.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:30 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:31.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:30 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:35:33.098 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:32 smithi045 ceph-mon[42520]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:33.098 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:32 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:33.098 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:32 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:33.098 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:32 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:33.098 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:32 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:35:33.098 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:32 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:33.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:32 smithi106 ceph-mon[46996]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:33.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:32 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:33.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:32 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:33.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:32 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:33.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:32 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:35:33.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:32 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:33.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:32 smithi154 ceph-mon[46565]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:33.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:32 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:33.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:32 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:33.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:32 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:33.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:32 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:35:33.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:32 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:33.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:33.230+0000 7f9b1f7fe700 1 -- 172.21.15.45:0/3407012193 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9b3010d620 con 0x7f9b180a1110 2024-05-10T03:35:33.233 INFO:teuthology.orchestra.run.smithi045.stdout:Created osd(s) 3 on host 'smithi045' 2024-05-10T03:35:33.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:33.233+0000 7f9b34c7f700 1 -- 172.21.15.45:0/3407012193 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9b180a1110 msgr2=0x7f9b180a3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:35:33.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:33.233+0000 7f9b34c7f700 1 --2- 172.21.15.45:0/3407012193 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9b180a1110 0x7f9b180a3620 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9b30069740 tx=0x7f9b20009260 comp rx=0 tx=0).stop 2024-05-10T03:35:33.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:33.233+0000 7f9b34c7f700 1 -- 172.21.15.45:0/3407012193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b30107a40 msgr2=0x7f9b301994d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:35:33.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:33.233+0000 7f9b34c7f700 1 --2- 172.21.15.45:0/3407012193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b30107a40 0x7f9b301994d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9b28007ee0 tx=0x7f9b2800d3b0 comp rx=0 tx=0).stop 2024-05-10T03:35:33.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:33.234+0000 7f9b34c7f700 1 -- 172.21.15.45:0/3407012193 shutdown_connections 2024-05-10T03:35:33.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:33.234+0000 7f9b34c7f700 1 --2- 172.21.15.45:0/3407012193 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9b180a1110 0x7f9b180a3620 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:33.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:33.234+0000 7f9b34c7f700 1 --2- 172.21.15.45:0/3407012193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b30107a40 0x7f9b301994d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:33.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:33.234+0000 7f9b34c7f700 1 --2- 172.21.15.45:0/3407012193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b30102780 0x7f9b301981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:33.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:33.234+0000 7f9b34c7f700 1 --2- 172.21.15.45:0/3407012193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b301050e0 0x7f9b30198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:33.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:33.234+0000 7f9b34c7f700 1 -- 172.21.15.45:0/3407012193 >> 172.21.15.45:0/3407012193 conn(0x7f9b300fc1c0 msgr2=0x7f9b30103250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:35:33.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:33.234+0000 7f9b34c7f700 1 -- 172.21.15.45:0/3407012193 shutdown_connections 2024-05-10T03:35:33.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:35:33.234+0000 7f9b34c7f700 1 -- 172.21.15.45:0/3407012193 wait complete. 2024-05-10T03:35:34.007 DEBUG:teuthology.orchestra.run.smithi045:osd.3> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.3.service 2024-05-10T03:35:34.010 INFO:tasks.cephadm:Deploying osd.4 on smithi106 with /dev/vg_nvme/lv_3... 2024-05-10T03:35:34.010 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-10T03:35:34.047 INFO:journalctl@ceph.osd.3.smithi045.stdout:-- Logs begin at Fri 2024-05-10 03:15:08 UTC. -- 2024-05-10T03:35:34.243 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.b/config 2024-05-10T03:35:34.345 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:34 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:34.345 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:34 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:34.345 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:34 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:35:34.345 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:34 smithi106 ceph-mon[46996]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:34.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:34 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:34.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:34 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:34.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:34 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:35:34.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:34 smithi154 ceph-mon[46565]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:34.517 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:34 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:34.517 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:34 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:34.517 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:34 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:35:34.517 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:34 smithi045 ceph-mon[42520]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:34.784 INFO:journalctl@ceph.osd.3.smithi045.stdout:May 10 03:35:34 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-3[68900]: 2024-05-10T03:35:34.513+0000 7fac6fe7e7c0 -1 osd.3 0 log_to_monitors true 2024-05-10T03:35:35.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:35 smithi106 ceph-mon[46996]: from='osd.3 [v2:172.21.15.45:6810/1188039324,v1:172.21.15.45:6811/1188039324]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-10T03:35:35.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:35 smithi154 ceph-mon[46565]: from='osd.3 [v2:172.21.15.45:6810/1188039324,v1:172.21.15.45:6811/1188039324]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-10T03:35:35.530 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-10T03:35:35.530 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-10T03:35:35.530 INFO:teuthology.orchestra.run.smithi106.stderr: stderr: 10+0 records in 2024-05-10T03:35:35.530 INFO:teuthology.orchestra.run.smithi106.stderr:10+0 records out 2024-05-10T03:35:35.530 INFO:teuthology.orchestra.run.smithi106.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113694 s, 922 MB/s 2024-05-10T03:35:35.530 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping successful for: 2024-05-10T03:35:35.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:35 smithi045 ceph-mon[42520]: from='osd.3 [v2:172.21.15.45:6810/1188039324,v1:172.21.15.45:6811/1188039324]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-10T03:35:35.924 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi106:vg_nvme/lv_3 2024-05-10T03:35:36.140 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.b/config 2024-05-10T03:35:36.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:36 smithi154 ceph-mon[46565]: from='osd.3 [v2:172.21.15.45:6810/1188039324,v1:172.21.15.45:6811/1188039324]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-10T03:35:36.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:36 smithi154 ceph-mon[46565]: osdmap e23: 4 total, 3 up, 4 in 2024-05-10T03:35:36.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:36 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T03:35:36.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:36 smithi154 ceph-mon[46565]: from='osd.3 [v2:172.21.15.45:6810/1188039324,v1:172.21.15.45:6811/1188039324]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-05-10T03:35:36.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:36 smithi154 ceph-mon[46565]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:36.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:36 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:36.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:36 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:36.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:36 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:35:36.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:36 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:35:36.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:36 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:36.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:36 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:36.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:36 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:35:36.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:36 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:36.534 INFO:journalctl@ceph.osd.3.smithi045.stdout:May 10 03:35:36 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-3[68900]: 2024-05-10T03:35:36.210+0000 7fac654e2700 -1 osd.3 0 waiting for initial osdmap 2024-05-10T03:35:36.534 INFO:journalctl@ceph.osd.3.smithi045.stdout:May 10 03:35:36 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-3[68900]: 2024-05-10T03:35:36.218+0000 7fac61299700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T03:35:36.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:36 smithi045 ceph-mon[42520]: from='osd.3 [v2:172.21.15.45:6810/1188039324,v1:172.21.15.45:6811/1188039324]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-10T03:35:36.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:36 smithi045 ceph-mon[42520]: osdmap e23: 4 total, 3 up, 4 in 2024-05-10T03:35:36.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:36 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T03:35:36.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:36 smithi045 ceph-mon[42520]: from='osd.3 [v2:172.21.15.45:6810/1188039324,v1:172.21.15.45:6811/1188039324]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-05-10T03:35:36.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:36 smithi045 ceph-mon[42520]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:36.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:36 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:36.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:36 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:36.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:36 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:35:36.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:36 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:35:36.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:36 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:36.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:36 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:36.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:36 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:35:36.536 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:36 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:36.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:36 smithi106 ceph-mon[46996]: from='osd.3 [v2:172.21.15.45:6810/1188039324,v1:172.21.15.45:6811/1188039324]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-10T03:35:36.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:36 smithi106 ceph-mon[46996]: osdmap e23: 4 total, 3 up, 4 in 2024-05-10T03:35:36.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:36 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T03:35:36.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:36 smithi106 ceph-mon[46996]: from='osd.3 [v2:172.21.15.45:6810/1188039324,v1:172.21.15.45:6811/1188039324]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-05-10T03:35:36.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:36 smithi106 ceph-mon[46996]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-05-10T03:35:36.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:36 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:36.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:36 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:36.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:36 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:35:36.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:36 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:35:36.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:36 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:36.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:36 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:36.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:36 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:35:36.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:36 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:37.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.179+0000 7face245f700 1 -- 172.21.15.106:0/423753889 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facdc103790 msgr2=0x7facdc10a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:35:37.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.179+0000 7face245f700 1 --2- 172.21.15.106:0/423753889 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facdc103790 0x7facdc10a040 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7facd400b0a0 tx=0x7facd400b3b0 comp rx=0 tx=0).stop 2024-05-10T03:35:37.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.179+0000 7face245f700 1 -- 172.21.15.106:0/423753889 shutdown_connections 2024-05-10T03:35:37.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.179+0000 7face245f700 1 --2- 172.21.15.106:0/423753889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facdc101cc0 0x7facdc1020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:37.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.179+0000 7face245f700 1 --2- 172.21.15.106:0/423753889 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facdc103790 0x7facdc10a040 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:37.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.179+0000 7face245f700 1 --2- 172.21.15.106:0/423753889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facdc102df0 0x7facdc103200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:37.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.179+0000 7face245f700 1 -- 172.21.15.106:0/423753889 >> 172.21.15.106:0/423753889 conn(0x7facdc0fd300 msgr2=0x7facdc0ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:35:37.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.179+0000 7face245f700 1 -- 172.21.15.106:0/423753889 shutdown_connections 2024-05-10T03:35:37.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.179+0000 7face245f700 1 -- 172.21.15.106:0/423753889 wait complete. 2024-05-10T03:35:37.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.180+0000 7face245f700 1 Processor -- start 2024-05-10T03:35:37.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.180+0000 7face245f700 1 -- start start 2024-05-10T03:35:37.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.180+0000 7face245f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facdc101cc0 0x7facdc1982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:35:37.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.180+0000 7face245f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facdc102df0 0x7facdc198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:35:37.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.181+0000 7face245f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facdc103790 0x7facdc1995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:35:37.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.181+0000 7face245f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc199c10 con 0x7facdc103790 2024-05-10T03:35:37.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.181+0000 7face245f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc199d50 con 0x7facdc102df0 2024-05-10T03:35:37.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.181+0000 7face245f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc199f10 con 0x7facdc101cc0 2024-05-10T03:35:37.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.181+0000 7facdb7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facdc102df0 0x7facdc198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:35:37.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.181+0000 7facdb7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facdc102df0 0x7facdc198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38046/0 (socket says 172.21.15.106:38046) 2024-05-10T03:35:37.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.181+0000 7facdb7fe700 1 -- 172.21.15.106:0/3258988558 learned_addr learned my addr 172.21.15.106:0/3258988558 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-10T03:35:37.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.181+0000 7facdbfff700 1 --2- 172.21.15.106:0/3258988558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facdc101cc0 0x7facdc1982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:35:37.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.181+0000 7face09fc700 1 --2- 172.21.15.106:0/3258988558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facdc103790 0x7facdc1995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:35:37.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.181+0000 7facdb7fe700 1 -- 172.21.15.106:0/3258988558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facdc101cc0 msgr2=0x7facdc1982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:35:37.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.181+0000 7facdb7fe700 1 --2- 172.21.15.106:0/3258988558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facdc101cc0 0x7facdc1982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:37.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.181+0000 7facdb7fe700 1 -- 172.21.15.106:0/3258988558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facdc103790 msgr2=0x7facdc1995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:35:37.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.181+0000 7facdb7fe700 1 --2- 172.21.15.106:0/3258988558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facdc103790 0x7facdc1995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:37.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.181+0000 7facdb7fe700 1 -- 172.21.15.106:0/3258988558 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd4009d00 con 0x7facdc102df0 2024-05-10T03:35:37.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.181+0000 7facdb7fe700 1 --2- 172.21.15.106:0/3258988558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facdc102df0 0x7facdc198800 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faccc00e9a0 tx=0x7faccc00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:35:37.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.181+0000 7facd97fa700 1 -- 172.21.15.106:0/3258988558 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc009790 con 0x7facdc102df0 2024-05-10T03:35:37.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.181+0000 7facd97fa700 1 -- 172.21.15.106:0/3258988558 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faccc010430 con 0x7facdc102df0 2024-05-10T03:35:37.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.181+0000 7facd97fa700 1 -- 172.21.15.106:0/3258988558 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc018680 con 0x7facdc102df0 2024-05-10T03:35:37.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.181+0000 7face245f700 1 -- 172.21.15.106:0/3258988558 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facdc19a1f0 con 0x7facdc102df0 2024-05-10T03:35:37.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.181+0000 7face245f700 1 -- 172.21.15.106:0/3258988558 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facdc1a09d0 con 0x7facdc102df0 2024-05-10T03:35:37.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.182+0000 7face245f700 1 -- 172.21.15.106:0/3258988558 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facdc108ee0 con 0x7facdc102df0 2024-05-10T03:35:37.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.184+0000 7facd97fa700 1 -- 172.21.15.106:0/3258988558 <== mon.2 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7faccc010910 con 0x7facdc102df0 2024-05-10T03:35:37.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.184+0000 7facd97fa700 1 --2- 172.21.15.106:0/3258988558 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7facc40a1120 0x7facc40a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:35:37.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.184+0000 7facd97fa700 1 -- 172.21.15.106:0/3258988558 <== mon.2 v2:172.21.15.106:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 3389+0+0 (secure 0 0 0) 0x7faccc014070 con 0x7facdc102df0 2024-05-10T03:35:37.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.185+0000 7facdbfff700 1 --2- 172.21.15.106:0/3258988558 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7facc40a1120 0x7facc40a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:35:37.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.185+0000 7facdbfff700 1 --2- 172.21.15.106:0/3258988558 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7facc40a1120 0x7facc40a3630 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7facdc102cf0 tx=0x7facd0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:35:37.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.188+0000 7facd97fa700 1 -- 172.21.15.106:0/3258988558 <== mon.2 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7faccc096700 con 0x7facdc102df0 2024-05-10T03:35:37.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:37.390+0000 7face245f700 1 -- 172.21.15.106:0/3258988558 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7facdc10d830 con 0x7facc40a1120 2024-05-10T03:35:37.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:37 smithi106 ceph-mon[46996]: Detected new or changed devices on smithi045 2024-05-10T03:35:37.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:37 smithi106 ceph-mon[46996]: Adjusting osd_memory_target on smithi045 to 8559M 2024-05-10T03:35:37.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:37 smithi106 ceph-mon[46996]: from='osd.3 [v2:172.21.15.45:6810/1188039324,v1:172.21.15.45:6811/1188039324]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-05-10T03:35:37.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:37 smithi106 ceph-mon[46996]: osdmap e24: 4 total, 3 up, 4 in 2024-05-10T03:35:37.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:37 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T03:35:37.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:37 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T03:35:37.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:37 smithi154 ceph-mon[46565]: Detected new or changed devices on smithi045 2024-05-10T03:35:37.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:37 smithi154 ceph-mon[46565]: Adjusting osd_memory_target on smithi045 to 8559M 2024-05-10T03:35:37.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:37 smithi154 ceph-mon[46565]: from='osd.3 [v2:172.21.15.45:6810/1188039324,v1:172.21.15.45:6811/1188039324]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-05-10T03:35:37.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:37 smithi154 ceph-mon[46565]: osdmap e24: 4 total, 3 up, 4 in 2024-05-10T03:35:37.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:37 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T03:35:37.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:37 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T03:35:37.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:37 smithi045 ceph-mon[42520]: Detected new or changed devices on smithi045 2024-05-10T03:35:37.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:37 smithi045 ceph-mon[42520]: Adjusting osd_memory_target on smithi045 to 8559M 2024-05-10T03:35:37.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:37 smithi045 ceph-mon[42520]: from='osd.3 [v2:172.21.15.45:6810/1188039324,v1:172.21.15.45:6811/1188039324]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-05-10T03:35:37.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:37 smithi045 ceph-mon[42520]: osdmap e24: 4 total, 3 up, 4 in 2024-05-10T03:35:37.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:37 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T03:35:37.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:37 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T03:35:38.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:38 smithi106 ceph-mon[46996]: purged_snaps scrub starts 2024-05-10T03:35:38.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:38 smithi106 ceph-mon[46996]: purged_snaps scrub ok 2024-05-10T03:35:38.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:38 smithi106 ceph-mon[46996]: osd.3 [v2:172.21.15.45:6810/1188039324,v1:172.21.15.45:6811/1188039324] boot 2024-05-10T03:35:38.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:38 smithi106 ceph-mon[46996]: osdmap e25: 4 total, 4 up, 4 in 2024-05-10T03:35:38.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:38 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T03:35:38.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:38 smithi106 ceph-mon[46996]: from='client.24239 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:35:38.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:38 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:35:38.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:38 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:35:38.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:38 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:38.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:38 smithi106 ceph-mon[46996]: pgmap v81: 1 pgs: 1 peering; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-05-10T03:35:38.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:38 smithi154 ceph-mon[46565]: purged_snaps scrub starts 2024-05-10T03:35:38.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:38 smithi154 ceph-mon[46565]: purged_snaps scrub ok 2024-05-10T03:35:38.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:38 smithi154 ceph-mon[46565]: osd.3 [v2:172.21.15.45:6810/1188039324,v1:172.21.15.45:6811/1188039324] boot 2024-05-10T03:35:38.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:38 smithi154 ceph-mon[46565]: osdmap e25: 4 total, 4 up, 4 in 2024-05-10T03:35:38.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:38 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T03:35:38.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:38 smithi154 ceph-mon[46565]: from='client.24239 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:35:38.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:38 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:35:38.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:38 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:35:38.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:38 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:38.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:38 smithi154 ceph-mon[46565]: pgmap v81: 1 pgs: 1 peering; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-05-10T03:35:38.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:38 smithi045 ceph-mon[42520]: purged_snaps scrub starts 2024-05-10T03:35:38.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:38 smithi045 ceph-mon[42520]: purged_snaps scrub ok 2024-05-10T03:35:38.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:38 smithi045 ceph-mon[42520]: osd.3 [v2:172.21.15.45:6810/1188039324,v1:172.21.15.45:6811/1188039324] boot 2024-05-10T03:35:38.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:38 smithi045 ceph-mon[42520]: osdmap e25: 4 total, 4 up, 4 in 2024-05-10T03:35:38.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:38 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T03:35:38.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:38 smithi045 ceph-mon[42520]: from='client.24239 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:35:38.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:38 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:35:38.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:38 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:35:38.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:38 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:38.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:38 smithi045 ceph-mon[42520]: pgmap v81: 1 pgs: 1 peering; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-05-10T03:35:39.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:39 smithi045 ceph-mon[42520]: osdmap e26: 4 total, 4 up, 4 in 2024-05-10T03:35:39.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:39 smithi106 ceph-mon[46996]: osdmap e26: 4 total, 4 up, 4 in 2024-05-10T03:35:39.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:39 smithi154 ceph-mon[46565]: osdmap e26: 4 total, 4 up, 4 in 2024-05-10T03:35:40.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:40 smithi045 ceph-mon[42520]: from='client.? 172.21.15.106:0/87832485' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "896f8ecb-bda0-4f80-90d2-c5987ab61f65"}]: dispatch 2024-05-10T03:35:40.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:40 smithi045 ceph-mon[42520]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "896f8ecb-bda0-4f80-90d2-c5987ab61f65"}]: dispatch 2024-05-10T03:35:40.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:40 smithi045 ceph-mon[42520]: osdmap e27: 4 total, 4 up, 4 in 2024-05-10T03:35:40.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:40 smithi045 ceph-mon[42520]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "896f8ecb-bda0-4f80-90d2-c5987ab61f65"}]': finished 2024-05-10T03:35:40.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:40 smithi045 ceph-mon[42520]: osdmap e28: 5 total, 4 up, 5 in 2024-05-10T03:35:40.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:40 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T03:35:40.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:40 smithi045 ceph-mon[42520]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-10T03:35:40.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:40 smithi045 ceph-mon[42520]: from='client.? 172.21.15.106:0/825799822' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:35:40.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:40 smithi106 ceph-mon[46996]: from='client.? 172.21.15.106:0/87832485' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "896f8ecb-bda0-4f80-90d2-c5987ab61f65"}]: dispatch 2024-05-10T03:35:40.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:40 smithi106 ceph-mon[46996]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "896f8ecb-bda0-4f80-90d2-c5987ab61f65"}]: dispatch 2024-05-10T03:35:40.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:40 smithi106 ceph-mon[46996]: osdmap e27: 4 total, 4 up, 4 in 2024-05-10T03:35:40.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:40 smithi106 ceph-mon[46996]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "896f8ecb-bda0-4f80-90d2-c5987ab61f65"}]': finished 2024-05-10T03:35:40.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:40 smithi106 ceph-mon[46996]: osdmap e28: 5 total, 4 up, 5 in 2024-05-10T03:35:40.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:40 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T03:35:40.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:40 smithi106 ceph-mon[46996]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-10T03:35:40.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:40 smithi106 ceph-mon[46996]: from='client.? 172.21.15.106:0/825799822' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:35:40.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:40 smithi154 ceph-mon[46565]: from='client.? 172.21.15.106:0/87832485' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "896f8ecb-bda0-4f80-90d2-c5987ab61f65"}]: dispatch 2024-05-10T03:35:40.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:40 smithi154 ceph-mon[46565]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "896f8ecb-bda0-4f80-90d2-c5987ab61f65"}]: dispatch 2024-05-10T03:35:40.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:40 smithi154 ceph-mon[46565]: osdmap e27: 4 total, 4 up, 4 in 2024-05-10T03:35:40.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:40 smithi154 ceph-mon[46565]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "896f8ecb-bda0-4f80-90d2-c5987ab61f65"}]': finished 2024-05-10T03:35:40.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:40 smithi154 ceph-mon[46565]: osdmap e28: 5 total, 4 up, 5 in 2024-05-10T03:35:40.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:40 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T03:35:40.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:40 smithi154 ceph-mon[46565]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-10T03:35:40.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:40 smithi154 ceph-mon[46565]: from='client.? 172.21.15.106:0/825799822' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:35:41.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:41 smithi045 ceph-mon[42520]: osdmap e29: 5 total, 4 up, 5 in 2024-05-10T03:35:41.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:41 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T03:35:41.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:41 smithi106 ceph-mon[46996]: osdmap e29: 5 total, 4 up, 5 in 2024-05-10T03:35:41.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:41 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T03:35:41.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:41 smithi154 ceph-mon[46565]: osdmap e29: 5 total, 4 up, 5 in 2024-05-10T03:35:41.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:41 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T03:35:42.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:42 smithi045 ceph-mon[42520]: osdmap e30: 5 total, 4 up, 5 in 2024-05-10T03:35:42.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:42 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T03:35:42.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:42 smithi045 ceph-mon[42520]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 159 KiB/s, 0 objects/s recovering 2024-05-10T03:35:42.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:42 smithi106 ceph-mon[46996]: osdmap e30: 5 total, 4 up, 5 in 2024-05-10T03:35:42.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:42 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T03:35:42.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:42 smithi106 ceph-mon[46996]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 159 KiB/s, 0 objects/s recovering 2024-05-10T03:35:42.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:42 smithi154 ceph-mon[46565]: osdmap e30: 5 total, 4 up, 5 in 2024-05-10T03:35:42.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:42 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T03:35:42.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:42 smithi154 ceph-mon[46565]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 159 KiB/s, 0 objects/s recovering 2024-05-10T03:35:45.097 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:44 smithi106 ceph-mon[46996]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-05-10T03:35:45.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:44 smithi154 ceph-mon[46565]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-05-10T03:35:45.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:44 smithi045 ceph-mon[42520]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-05-10T03:35:46.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:45 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-10T03:35:46.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:45 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:46.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:45 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-10T03:35:46.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:45 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:46.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:45 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-10T03:35:46.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:45 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:47.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:46 smithi106 ceph-mon[46996]: Deploying daemon osd.4 on smithi106 2024-05-10T03:35:47.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:46 smithi106 ceph-mon[46996]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-05-10T03:35:47.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:46 smithi154 ceph-mon[46565]: Deploying daemon osd.4 on smithi106 2024-05-10T03:35:47.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:46 smithi154 ceph-mon[46565]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-05-10T03:35:47.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:46 smithi045 ceph-mon[42520]: Deploying daemon osd.4 on smithi106 2024-05-10T03:35:47.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:46 smithi045 ceph-mon[42520]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-05-10T03:35:49.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:48 smithi106 ceph-mon[46996]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-10T03:35:49.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:48 smithi154 ceph-mon[46565]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-10T03:35:49.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:48 smithi045 ceph-mon[42520]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-10T03:35:50.086 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:49 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:50.086 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:49 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:50.086 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:49 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:35:50.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:49 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:50.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:49 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:50.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:49 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:35:50.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:49 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:50.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:49 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:50.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:49 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:35:50.979 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:50 smithi106 ceph-mon[46996]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-05-10T03:35:50.980 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:50 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:50.980 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:50 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:50.980 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:50 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:50.980 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:50 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:35:50.980 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:50 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:51.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:51.044+0000 7facd97fa700 1 -- 172.21.15.106:0/3258988558 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7facdc10d830 con 0x7facc40a1120 2024-05-10T03:35:51.047 INFO:teuthology.orchestra.run.smithi106.stdout:Created osd(s) 4 on host 'smithi106' 2024-05-10T03:35:51.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:51.047+0000 7face245f700 1 -- 172.21.15.106:0/3258988558 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7facc40a1120 msgr2=0x7facc40a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:35:51.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:51.047+0000 7face245f700 1 --2- 172.21.15.106:0/3258988558 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7facc40a1120 0x7facc40a3630 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7facdc102cf0 tx=0x7facd0009260 comp rx=0 tx=0).stop 2024-05-10T03:35:51.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:51.048+0000 7face245f700 1 -- 172.21.15.106:0/3258988558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facdc102df0 msgr2=0x7facdc198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:35:51.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:51.048+0000 7face245f700 1 --2- 172.21.15.106:0/3258988558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facdc102df0 0x7facdc198800 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faccc00e9a0 tx=0x7faccc00ecb0 comp rx=0 tx=0).stop 2024-05-10T03:35:51.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:51.048+0000 7face245f700 1 -- 172.21.15.106:0/3258988558 shutdown_connections 2024-05-10T03:35:51.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:51.048+0000 7face245f700 1 --2- 172.21.15.106:0/3258988558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facdc101cc0 0x7facdc1982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:51.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:51.048+0000 7face245f700 1 --2- 172.21.15.106:0/3258988558 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7facc40a1120 0x7facc40a3630 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:51.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:51.048+0000 7face245f700 1 --2- 172.21.15.106:0/3258988558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facdc103790 0x7facdc1995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:51.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:51.048+0000 7face245f700 1 --2- 172.21.15.106:0/3258988558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facdc102df0 0x7facdc198800 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:51.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:51.048+0000 7face245f700 1 -- 172.21.15.106:0/3258988558 >> 172.21.15.106:0/3258988558 conn(0x7facdc0fd300 msgr2=0x7facdc106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:35:51.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:51.048+0000 7face245f700 1 -- 172.21.15.106:0/3258988558 shutdown_connections 2024-05-10T03:35:51.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:35:51.048+0000 7face245f700 1 -- 172.21.15.106:0/3258988558 wait complete. 2024-05-10T03:35:51.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:50 smithi154 ceph-mon[46565]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-05-10T03:35:51.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:50 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:51.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:50 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:51.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:50 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:51.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:50 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:35:51.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:50 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:51.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:50 smithi045 ceph-mon[42520]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-05-10T03:35:51.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:50 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:51.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:50 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:51.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:50 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:51.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:50 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:35:51.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:50 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:51.427 DEBUG:teuthology.orchestra.run.smithi106:osd.4> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.4.service 2024-05-10T03:35:51.429 INFO:tasks.cephadm:Deploying osd.5 on smithi154 with /dev/vg_nvme/lv_3... 2024-05-10T03:35:51.430 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-10T03:35:51.462 INFO:journalctl@ceph.osd.4.smithi106.stdout:-- Logs begin at Fri 2024-05-10 03:15:26 UTC. -- 2024-05-10T03:35:51.664 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T03:35:52.106 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:52 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:52.107 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:52 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:52.107 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:52 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:35:52.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:52 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:52.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:52 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:52.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:52 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:35:52.319 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:52 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:52.319 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:52 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:52.319 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:52 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:35:52.967 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-10T03:35:52.967 INFO:teuthology.orchestra.run.smithi154.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-10T03:35:52.967 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10+0 records in 2024-05-10T03:35:52.967 INFO:teuthology.orchestra.run.smithi154.stderr:10+0 records out 2024-05-10T03:35:52.967 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112061 s, 936 MB/s 2024-05-10T03:35:52.967 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping successful for: 2024-05-10T03:35:53.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:53 smithi045 ceph-mon[42520]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-05-10T03:35:53.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:53 smithi045 ceph-mon[42520]: from='osd.4 [v2:172.21.15.106:6808/4186845524,v1:172.21.15.106:6809/4186845524]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-10T03:35:53.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:53 smithi045 ceph-mon[42520]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-10T03:35:53.293 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:53 smithi154 ceph-mon[46565]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-05-10T03:35:53.293 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:53 smithi154 ceph-mon[46565]: from='osd.4 [v2:172.21.15.106:6808/4186845524,v1:172.21.15.106:6809/4186845524]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-10T03:35:53.293 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:53 smithi154 ceph-mon[46565]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-10T03:35:53.325 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 10 03:35:52 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-4[60530]: 2024-05-10T03:35:52.910+0000 7f0bcc4cd7c0 -1 osd.4 0 log_to_monitors true 2024-05-10T03:35:53.325 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:53 smithi106 ceph-mon[46996]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-05-10T03:35:53.325 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:53 smithi106 ceph-mon[46996]: from='osd.4 [v2:172.21.15.106:6808/4186845524,v1:172.21.15.106:6809/4186845524]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-10T03:35:53.325 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:53 smithi106 ceph-mon[46996]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-10T03:35:53.360 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_3 2024-05-10T03:35:53.579 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T03:35:54.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:54 smithi045 ceph-mon[42520]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-10T03:35:54.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:54 smithi045 ceph-mon[42520]: osdmap e31: 5 total, 4 up, 5 in 2024-05-10T03:35:54.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:54 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T03:35:54.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:54 smithi045 ceph-mon[42520]: from='osd.4 [v2:172.21.15.106:6808/4186845524,v1:172.21.15.106:6809/4186845524]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-10T03:35:54.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:54 smithi045 ceph-mon[42520]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-10T03:35:54.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:54 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:54.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:54 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:54.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:54 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:35:54.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:54 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:35:54.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:54 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:54.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:54 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:54.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:54 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:35:54.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:54 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:54.332 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:54 smithi154 ceph-mon[46565]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-10T03:35:54.332 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:54 smithi154 ceph-mon[46565]: osdmap e31: 5 total, 4 up, 5 in 2024-05-10T03:35:54.332 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:54 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T03:35:54.332 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:54 smithi154 ceph-mon[46565]: from='osd.4 [v2:172.21.15.106:6808/4186845524,v1:172.21.15.106:6809/4186845524]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-10T03:35:54.332 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:54 smithi154 ceph-mon[46565]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-10T03:35:54.332 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:54 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:54.332 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:54 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:54.333 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:54 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:35:54.333 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:54 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:35:54.333 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:54 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:54.333 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:54 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:54.333 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:54 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:35:54.333 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:54 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:54.401 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 10 03:35:54 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-4[60530]: 2024-05-10T03:35:54.022+0000 7f0bc1b31700 -1 osd.4 0 waiting for initial osdmap 2024-05-10T03:35:54.401 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 10 03:35:54 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-4[60530]: 2024-05-10T03:35:54.029+0000 7f0bbd8e8700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T03:35:54.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:54 smithi106 ceph-mon[46996]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-10T03:35:54.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:54 smithi106 ceph-mon[46996]: osdmap e31: 5 total, 4 up, 5 in 2024-05-10T03:35:54.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:54 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T03:35:54.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:54 smithi106 ceph-mon[46996]: from='osd.4 [v2:172.21.15.106:6808/4186845524,v1:172.21.15.106:6809/4186845524]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-10T03:35:54.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:54 smithi106 ceph-mon[46996]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-10T03:35:54.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:54 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:54.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:54 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:54.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:54 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:35:54.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:54 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:35:54.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:54 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:54.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:54 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:54.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:54 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:35:54.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:54 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:35:54.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.510+0000 7f4a1cd9b700 1 -- 172.21.15.154:0/2001452697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a18102650 msgr2=0x7f4a18108f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:35:54.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.510+0000 7f4a1cd9b700 1 --2- 172.21.15.154:0/2001452697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a18102650 0x7f4a18108f00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4a1000b0a0 tx=0x7f4a1000b3b0 comp rx=0 tx=0).stop 2024-05-10T03:35:54.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.510+0000 7f4a1cd9b700 1 -- 172.21.15.154:0/2001452697 shutdown_connections 2024-05-10T03:35:54.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.510+0000 7f4a1cd9b700 1 --2- 172.21.15.154:0/2001452697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a18102650 0x7f4a18108f00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:54.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.510+0000 7f4a1cd9b700 1 --2- 172.21.15.154:0/2001452697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a18100b80 0x7f4a18100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:54.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.510+0000 7f4a1cd9b700 1 --2- 172.21.15.154:0/2001452697 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a18101cb0 0x7f4a181020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:54.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.510+0000 7f4a1cd9b700 1 -- 172.21.15.154:0/2001452697 >> 172.21.15.154:0/2001452697 conn(0x7f4a180fc1c0 msgr2=0x7f4a180fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:35:54.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.510+0000 7f4a1cd9b700 1 -- 172.21.15.154:0/2001452697 shutdown_connections 2024-05-10T03:35:54.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.510+0000 7f4a1cd9b700 1 -- 172.21.15.154:0/2001452697 wait complete. 2024-05-10T03:35:54.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.510+0000 7f4a1cd9b700 1 Processor -- start 2024-05-10T03:35:54.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.511+0000 7f4a1cd9b700 1 -- start start 2024-05-10T03:35:54.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.511+0000 7f4a1cd9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a18100b80 0x7f4a18104b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:35:54.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.511+0000 7f4a1cd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a18101cb0 0x7f4a18102ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:35:54.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.511+0000 7f4a1cd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a18102650 0x7f4a18103650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:35:54.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.511+0000 7f4a1cd9b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a18103cf0 con 0x7f4a18101cb0 2024-05-10T03:35:54.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.511+0000 7f4a1cd9b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a18103e60 con 0x7f4a18100b80 2024-05-10T03:35:54.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.511+0000 7f4a1cd9b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a181a2310 con 0x7f4a18102650 2024-05-10T03:35:54.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.511+0000 7f4a16d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a18102650 0x7f4a18103650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:35:54.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.511+0000 7f4a16d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a18102650 0x7f4a18103650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59730/0 (socket says 172.21.15.154:59730) 2024-05-10T03:35:54.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.511+0000 7f4a16d9d700 1 -- 172.21.15.154:0/1375942994 learned_addr learned my addr 172.21.15.154:0/1375942994 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-10T03:35:54.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.511+0000 7f4a1659c700 1 --2- 172.21.15.154:0/1375942994 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a18100b80 0x7f4a18104b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:35:54.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.511+0000 7f4a15d9b700 1 --2- 172.21.15.154:0/1375942994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a18101cb0 0x7f4a18102ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:35:54.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.511+0000 7f4a16d9d700 1 -- 172.21.15.154:0/1375942994 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a18100b80 msgr2=0x7f4a18104b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:35:54.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.511+0000 7f4a16d9d700 1 --2- 172.21.15.154:0/1375942994 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a18100b80 0x7f4a18104b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:54.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.511+0000 7f4a16d9d700 1 -- 172.21.15.154:0/1375942994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a18101cb0 msgr2=0x7f4a18102ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:35:54.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.511+0000 7f4a16d9d700 1 --2- 172.21.15.154:0/1375942994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a18101cb0 0x7f4a18102ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:35:54.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.511+0000 7f4a16d9d700 1 -- 172.21.15.154:0/1375942994 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a10009d00 con 0x7f4a18102650 2024-05-10T03:35:54.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.511+0000 7f4a16d9d700 1 --2- 172.21.15.154:0/1375942994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a18102650 0x7f4a18103650 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4a1000b070 tx=0x7f4a100079b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:35:54.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.511+0000 7f4a0f7fe700 1 -- 172.21.15.154:0/1375942994 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1000e040 con 0x7f4a18102650 2024-05-10T03:35:54.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.512+0000 7f4a1cd9b700 1 -- 172.21.15.154:0/1375942994 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a181a2590 con 0x7f4a18102650 2024-05-10T03:35:54.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.512+0000 7f4a0f7fe700 1 -- 172.21.15.154:0/1375942994 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4a1000be40 con 0x7f4a18102650 2024-05-10T03:35:54.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.512+0000 7f4a1cd9b700 1 -- 172.21.15.154:0/1375942994 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a181a2a00 con 0x7f4a18102650 2024-05-10T03:35:54.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.512+0000 7f4a0f7fe700 1 -- 172.21.15.154:0/1375942994 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1001b6c0 con 0x7f4a18102650 2024-05-10T03:35:54.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.512+0000 7f4a1cd9b700 1 -- 172.21.15.154:0/1375942994 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a180ffe80 con 0x7f4a18102650 2024-05-10T03:35:54.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.514+0000 7f4a0f7fe700 1 -- 172.21.15.154:0/1375942994 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4a1001d470 con 0x7f4a18102650 2024-05-10T03:35:54.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.514+0000 7f4a0f7fe700 1 --2- 172.21.15.154:0/1375942994 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4a040a1120 0x7f4a040a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:35:54.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.514+0000 7f4a0f7fe700 1 -- 172.21.15.154:0/1375942994 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 3821+0+0 (secure 0 0 0) 0x7f4a100ccda0 con 0x7f4a18102650 2024-05-10T03:35:54.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.515+0000 7f4a1659c700 1 --2- 172.21.15.154:0/1375942994 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4a040a1120 0x7f4a040a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:35:54.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.515+0000 7f4a1659c700 1 --2- 172.21.15.154:0/1375942994 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4a040a1120 0x7f4a040a3630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4a18104860 tx=0x7f4a0800a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:35:54.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.518+0000 7f4a0f7fe700 1 -- 172.21.15.154:0/1375942994 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4a10097750 con 0x7f4a18102650 2024-05-10T03:35:54.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:35:54.716+0000 7f4a1cd9b700 1 -- 172.21.15.154:0/1375942994 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a180fe1f0 con 0x7f4a040a1120 2024-05-10T03:35:55.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:55 smithi045 ceph-mon[42520]: Detected new or changed devices on smithi106 2024-05-10T03:35:55.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:55 smithi045 ceph-mon[42520]: Adjusting osd_memory_target on smithi106 to 8557M 2024-05-10T03:35:55.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:55 smithi045 ceph-mon[42520]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-10T03:35:55.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:55 smithi045 ceph-mon[42520]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-05-10T03:35:55.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:55 smithi045 ceph-mon[42520]: osdmap e32: 5 total, 4 up, 5 in 2024-05-10T03:35:55.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:55 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T03:35:55.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:55 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T03:35:55.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:55 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:35:55.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:55 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:35:55.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:55 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:55.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:55 smithi106 ceph-mon[46996]: Detected new or changed devices on smithi106 2024-05-10T03:35:55.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:55 smithi106 ceph-mon[46996]: Adjusting osd_memory_target on smithi106 to 8557M 2024-05-10T03:35:55.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:55 smithi106 ceph-mon[46996]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-10T03:35:55.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:55 smithi106 ceph-mon[46996]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-05-10T03:35:55.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:55 smithi106 ceph-mon[46996]: osdmap e32: 5 total, 4 up, 5 in 2024-05-10T03:35:55.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:55 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T03:35:55.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:55 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T03:35:55.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:55 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:35:55.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:55 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:35:55.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:55 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:55.456 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:55 smithi154 ceph-mon[46565]: Detected new or changed devices on smithi106 2024-05-10T03:35:55.456 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:55 smithi154 ceph-mon[46565]: Adjusting osd_memory_target on smithi106 to 8557M 2024-05-10T03:35:55.456 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:55 smithi154 ceph-mon[46565]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-10T03:35:55.456 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:55 smithi154 ceph-mon[46565]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-05-10T03:35:55.456 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:55 smithi154 ceph-mon[46565]: osdmap e32: 5 total, 4 up, 5 in 2024-05-10T03:35:55.456 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:55 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T03:35:55.456 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:55 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T03:35:55.456 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:55 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:35:55.457 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:55 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:35:55.457 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:55 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:35:56.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:56 smithi154 ceph-mon[46565]: purged_snaps scrub starts 2024-05-10T03:35:56.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:56 smithi154 ceph-mon[46565]: purged_snaps scrub ok 2024-05-10T03:35:56.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:56 smithi154 ceph-mon[46565]: from='client.24256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:35:56.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:56 smithi154 ceph-mon[46565]: osd.4 [v2:172.21.15.106:6808/4186845524,v1:172.21.15.106:6809/4186845524] boot 2024-05-10T03:35:56.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:56 smithi154 ceph-mon[46565]: osdmap e33: 5 total, 5 up, 5 in 2024-05-10T03:35:56.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:56 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T03:35:56.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:56 smithi045 ceph-mon[42520]: purged_snaps scrub starts 2024-05-10T03:35:56.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:56 smithi045 ceph-mon[42520]: purged_snaps scrub ok 2024-05-10T03:35:56.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:56 smithi045 ceph-mon[42520]: from='client.24256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:35:56.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:56 smithi045 ceph-mon[42520]: osd.4 [v2:172.21.15.106:6808/4186845524,v1:172.21.15.106:6809/4186845524] boot 2024-05-10T03:35:56.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:56 smithi045 ceph-mon[42520]: osdmap e33: 5 total, 5 up, 5 in 2024-05-10T03:35:56.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:56 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T03:35:56.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:56 smithi106 ceph-mon[46996]: purged_snaps scrub starts 2024-05-10T03:35:56.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:56 smithi106 ceph-mon[46996]: purged_snaps scrub ok 2024-05-10T03:35:56.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:56 smithi106 ceph-mon[46996]: from='client.24256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:35:56.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:56 smithi106 ceph-mon[46996]: osd.4 [v2:172.21.15.106:6808/4186845524,v1:172.21.15.106:6809/4186845524] boot 2024-05-10T03:35:56.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:56 smithi106 ceph-mon[46996]: osdmap e33: 5 total, 5 up, 5 in 2024-05-10T03:35:56.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:56 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T03:35:57.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:57 smithi106 ceph-mon[46996]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-10T03:35:57.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:57 smithi106 ceph-mon[46996]: osdmap e34: 5 total, 5 up, 5 in 2024-05-10T03:35:57.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:57 smithi106 ceph-mon[46996]: from='client.? 172.21.15.154:0/473082060' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5a4d9e4-2772-4d72-8963-dd47761c059a"}]: dispatch 2024-05-10T03:35:57.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:57 smithi106 ceph-mon[46996]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5a4d9e4-2772-4d72-8963-dd47761c059a"}]: dispatch 2024-05-10T03:35:57.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:57 smithi106 ceph-mon[46996]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5a4d9e4-2772-4d72-8963-dd47761c059a"}]': finished 2024-05-10T03:35:57.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:57 smithi106 ceph-mon[46996]: osdmap e35: 6 total, 5 up, 6 in 2024-05-10T03:35:57.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:57 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T03:35:57.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:57 smithi154 ceph-mon[46565]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-10T03:35:57.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:57 smithi154 ceph-mon[46565]: osdmap e34: 5 total, 5 up, 5 in 2024-05-10T03:35:57.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:57 smithi154 ceph-mon[46565]: from='client.? 172.21.15.154:0/473082060' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5a4d9e4-2772-4d72-8963-dd47761c059a"}]: dispatch 2024-05-10T03:35:57.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:57 smithi154 ceph-mon[46565]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5a4d9e4-2772-4d72-8963-dd47761c059a"}]: dispatch 2024-05-10T03:35:57.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:57 smithi154 ceph-mon[46565]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5a4d9e4-2772-4d72-8963-dd47761c059a"}]': finished 2024-05-10T03:35:57.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:57 smithi154 ceph-mon[46565]: osdmap e35: 6 total, 5 up, 6 in 2024-05-10T03:35:57.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:57 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T03:35:57.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:57 smithi045 ceph-mon[42520]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-05-10T03:35:57.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:57 smithi045 ceph-mon[42520]: osdmap e34: 5 total, 5 up, 5 in 2024-05-10T03:35:57.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:57 smithi045 ceph-mon[42520]: from='client.? 172.21.15.154:0/473082060' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5a4d9e4-2772-4d72-8963-dd47761c059a"}]: dispatch 2024-05-10T03:35:57.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:57 smithi045 ceph-mon[42520]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5a4d9e4-2772-4d72-8963-dd47761c059a"}]: dispatch 2024-05-10T03:35:57.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:57 smithi045 ceph-mon[42520]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5a4d9e4-2772-4d72-8963-dd47761c059a"}]': finished 2024-05-10T03:35:57.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:57 smithi045 ceph-mon[42520]: osdmap e35: 6 total, 5 up, 6 in 2024-05-10T03:35:57.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:57 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T03:35:58.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:58 smithi106 ceph-mon[46996]: from='client.? 172.21.15.154:0/1909521613' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:35:58.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:58 smithi154 ceph-mon[46565]: from='client.? 172.21.15.154:0/1909521613' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:35:58.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:58 smithi045 ceph-mon[42520]: from='client.? 172.21.15.154:0/1909521613' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:35:59.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:35:59 smithi106 ceph-mon[46996]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:35:59.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:35:59 smithi154 ceph-mon[46565]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:35:59.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:35:59 smithi045 ceph-mon[42520]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:36:01.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:01 smithi106 ceph-mon[46996]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:36:01.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:01 smithi154 ceph-mon[46565]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:36:01.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:01 smithi045 ceph-mon[42520]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:36:03.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:03 smithi106 ceph-mon[46996]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:36:03.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:03 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-10T03:36:03.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:03 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:03.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:03 smithi154 ceph-mon[46565]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:36:03.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:03 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-10T03:36:03.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:03 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:03.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:03 smithi045 ceph-mon[42520]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:36:03.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:03 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-10T03:36:03.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:03 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:04.380 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:04 smithi154 ceph-mon[46565]: Deploying daemon osd.5 on smithi154 2024-05-10T03:36:04.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:04 smithi106 ceph-mon[46996]: Deploying daemon osd.5 on smithi154 2024-05-10T03:36:04.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:04 smithi045 ceph-mon[42520]: Deploying daemon osd.5 on smithi154 2024-05-10T03:36:05.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:05 smithi154 ceph-mon[46565]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:36:05.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:05 smithi106 ceph-mon[46996]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:36:05.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:05 smithi045 ceph-mon[42520]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:36:07.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:07 smithi106 ceph-mon[46996]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:36:07.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:07 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:07.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:07 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:07.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:07 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:36:07.427 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:07 smithi154 ceph-mon[46565]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:36:07.427 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:07 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:07.427 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:07 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:07.427 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:07 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:36:07.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:07 smithi045 ceph-mon[42520]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:36:07.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:07 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:07.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:07 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:07.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:07 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:36:09.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:09.125+0000 7f4a0f7fe700 1 -- 172.21.15.154:0/1375942994 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4a180fe1f0 con 0x7f4a040a1120 2024-05-10T03:36:09.128 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 5 on host 'smithi154' 2024-05-10T03:36:09.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:09.127+0000 7f4a1cd9b700 1 -- 172.21.15.154:0/1375942994 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4a040a1120 msgr2=0x7f4a040a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:36:09.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:09.127+0000 7f4a1cd9b700 1 --2- 172.21.15.154:0/1375942994 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4a040a1120 0x7f4a040a3630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4a18104860 tx=0x7f4a0800a3b0 comp rx=0 tx=0).stop 2024-05-10T03:36:09.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:09.127+0000 7f4a1cd9b700 1 -- 172.21.15.154:0/1375942994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a18102650 msgr2=0x7f4a18103650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:36:09.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:09.127+0000 7f4a1cd9b700 1 --2- 172.21.15.154:0/1375942994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a18102650 0x7f4a18103650 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4a1000b070 tx=0x7f4a100079b0 comp rx=0 tx=0).stop 2024-05-10T03:36:09.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:09.127+0000 7f4a1cd9b700 1 -- 172.21.15.154:0/1375942994 shutdown_connections 2024-05-10T03:36:09.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:09.127+0000 7f4a1cd9b700 1 --2- 172.21.15.154:0/1375942994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a18102650 0x7f4a18103650 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:09.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:09.127+0000 7f4a1cd9b700 1 --2- 172.21.15.154:0/1375942994 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4a040a1120 0x7f4a040a3630 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:09.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:09.127+0000 7f4a1cd9b700 1 --2- 172.21.15.154:0/1375942994 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a18100b80 0x7f4a18104b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:09.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:09.127+0000 7f4a1cd9b700 1 --2- 172.21.15.154:0/1375942994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a18101cb0 0x7f4a18102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:09.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:09.127+0000 7f4a1cd9b700 1 -- 172.21.15.154:0/1375942994 >> 172.21.15.154:0/1375942994 conn(0x7f4a180fc1c0 msgr2=0x7f4a180fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:36:09.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:09.127+0000 7f4a1cd9b700 1 -- 172.21.15.154:0/1375942994 shutdown_connections 2024-05-10T03:36:09.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:09.127+0000 7f4a1cd9b700 1 -- 172.21.15.154:0/1375942994 wait complete. 2024-05-10T03:36:09.317 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:09 smithi154 ceph-mon[46565]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:36:09.317 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:09 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:09.318 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:09 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:09.318 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:09 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:09.318 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:09 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:36:09.318 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:09 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:09.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:09 smithi106 ceph-mon[46996]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:36:09.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:09 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:09.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:09 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:09.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:09 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:09.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:09 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:36:09.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:09 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:09.458 DEBUG:teuthology.orchestra.run.smithi154:osd.5> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.5.service 2024-05-10T03:36:09.460 INFO:tasks.cephadm:Deploying osd.6 on smithi045 with /dev/vg_nvme/lv_2... 2024-05-10T03:36:09.460 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-10T03:36:09.492 INFO:journalctl@ceph.osd.5.smithi154.stdout:-- Logs begin at Fri 2024-05-10 03:15:42 UTC. -- 2024-05-10T03:36:09.495 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:09 smithi045 ceph-mon[42520]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:36:09.495 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:09 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:09.495 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:09 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:09.495 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:09 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:09.495 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:09 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:36:09.495 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:09 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:09.714 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:36:10.322 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:10 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:10.322 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:10 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:10.322 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:10 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:36:10.322 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:10 smithi154 ceph-mon[46565]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:36:10.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:10 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:10.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:10 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:10.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:10 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:36:10.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:10 smithi106 ceph-mon[46996]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:36:10.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:10 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:10.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:10 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:10.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:10 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:36:10.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:10 smithi045 ceph-mon[42520]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:36:10.724 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 10 03:36:10 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-5[60308]: 2024-05-10T03:36:10.498+0000 7f7910fde7c0 -1 osd.5 0 log_to_monitors true 2024-05-10T03:36:11.155 INFO:teuthology.orchestra.run.smithi045.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-10T03:36:11.155 INFO:teuthology.orchestra.run.smithi045.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-10T03:36:11.155 INFO:teuthology.orchestra.run.smithi045.stderr: stderr: 10+0 records in 2024-05-10T03:36:11.155 INFO:teuthology.orchestra.run.smithi045.stderr:10+0 records out 2024-05-10T03:36:11.155 INFO:teuthology.orchestra.run.smithi045.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00913077 s, 1.1 GB/s 2024-05-10T03:36:11.155 INFO:teuthology.orchestra.run.smithi045.stderr: stderr: 2024-05-10T03:36:11.155 INFO:teuthology.orchestra.run.smithi045.stderr:--> Zapping successful for: 2024-05-10T03:36:11.371 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:11 smithi045 ceph-mon[42520]: from='osd.5 [v2:172.21.15.154:6808/3929679049,v1:172.21.15.154:6809/3929679049]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-10T03:36:11.371 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:11 smithi045 ceph-mon[42520]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-10T03:36:11.395 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:11 smithi154 ceph-mon[46565]: from='osd.5 [v2:172.21.15.154:6808/3929679049,v1:172.21.15.154:6809/3929679049]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-10T03:36:11.395 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:11 smithi154 ceph-mon[46565]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-10T03:36:11.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:11 smithi106 ceph-mon[46996]: from='osd.5 [v2:172.21.15.154:6808/3929679049,v1:172.21.15.154:6809/3929679049]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-10T03:36:11.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:11 smithi106 ceph-mon[46996]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-10T03:36:11.533 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi045:vg_nvme/lv_2 2024-05-10T03:36:11.835 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:36:12.279 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:12 smithi045 ceph-mon[42520]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-10T03:36:12.279 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:12 smithi045 ceph-mon[42520]: osdmap e36: 6 total, 5 up, 6 in 2024-05-10T03:36:12.279 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T03:36:12.279 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:12 smithi045 ceph-mon[42520]: from='osd.5 [v2:172.21.15.154:6808/3929679049,v1:172.21.15.154:6809/3929679049]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-10T03:36:12.279 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:12 smithi045 ceph-mon[42520]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-10T03:36:12.279 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:12 smithi045 ceph-mon[42520]: Detected new or changed devices on smithi154 2024-05-10T03:36:12.279 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:12.280 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:12.280 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:36:12.280 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:36:12.280 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:12 smithi045 ceph-mon[42520]: Adjusting osd_memory_target on smithi154 to 8557M 2024-05-10T03:36:12.280 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:12.280 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:12.280 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:36:12.280 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:12.280 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:12 smithi045 ceph-mon[42520]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:36:12.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:12 smithi106 ceph-mon[46996]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-10T03:36:12.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:12 smithi106 ceph-mon[46996]: osdmap e36: 6 total, 5 up, 6 in 2024-05-10T03:36:12.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T03:36:12.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:12 smithi106 ceph-mon[46996]: from='osd.5 [v2:172.21.15.154:6808/3929679049,v1:172.21.15.154:6809/3929679049]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-10T03:36:12.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:12 smithi106 ceph-mon[46996]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-10T03:36:12.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:12 smithi106 ceph-mon[46996]: Detected new or changed devices on smithi154 2024-05-10T03:36:12.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:12.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:12.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:36:12.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:36:12.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:12 smithi106 ceph-mon[46996]: Adjusting osd_memory_target on smithi154 to 8557M 2024-05-10T03:36:12.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:12.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:12.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:36:12.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:12.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:12 smithi106 ceph-mon[46996]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:36:12.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:12 smithi154 ceph-mon[46565]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-10T03:36:12.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:12 smithi154 ceph-mon[46565]: osdmap e36: 6 total, 5 up, 6 in 2024-05-10T03:36:12.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T03:36:12.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:12 smithi154 ceph-mon[46565]: from='osd.5 [v2:172.21.15.154:6808/3929679049,v1:172.21.15.154:6809/3929679049]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-10T03:36:12.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:12 smithi154 ceph-mon[46565]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-10T03:36:12.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:12 smithi154 ceph-mon[46565]: Detected new or changed devices on smithi154 2024-05-10T03:36:12.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:12.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:12.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:36:12.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:36:12.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:12 smithi154 ceph-mon[46565]: Adjusting osd_memory_target on smithi154 to 8557M 2024-05-10T03:36:12.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:12.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:12.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:36:12.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:12.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:12 smithi154 ceph-mon[46565]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:36:12.476 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 10 03:36:12 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-5[60308]: 2024-05-10T03:36:12.124+0000 7f7906642700 -1 osd.5 0 waiting for initial osdmap 2024-05-10T03:36:12.476 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 10 03:36:12 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-5[60308]: 2024-05-10T03:36:12.132+0000 7f79023f9700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T03:36:12.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.831+0000 7fdf48bb0700 1 -- 172.21.15.45:0/2480761227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf44109c10 msgr2=0x7fdf4410c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:36:12.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.831+0000 7fdf48bb0700 1 --2- 172.21.15.45:0/2480761227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf44109c10 0x7fdf4410c120 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c00b0a0 tx=0x7fdf3c00b3b0 comp rx=0 tx=0).stop 2024-05-10T03:36:12.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.831+0000 7fdf48bb0700 1 -- 172.21.15.45:0/2480761227 shutdown_connections 2024-05-10T03:36:12.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.831+0000 7fdf48bb0700 1 --2- 172.21.15.45:0/2480761227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf44109c10 0x7fdf4410c120 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:12.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.831+0000 7fdf48bb0700 1 --2- 172.21.15.45:0/2480761227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf440750d0 0x7fdf440735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:12.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.831+0000 7fdf48bb0700 1 --2- 172.21.15.45:0/2480761227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf44073ae0 0x7fdf44073f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:12.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.831+0000 7fdf48bb0700 1 -- 172.21.15.45:0/2480761227 >> 172.21.15.45:0/2480761227 conn(0x7fdf440fd390 msgr2=0x7fdf440ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:36:12.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.831+0000 7fdf48bb0700 1 -- 172.21.15.45:0/2480761227 shutdown_connections 2024-05-10T03:36:12.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.831+0000 7fdf48bb0700 1 -- 172.21.15.45:0/2480761227 wait complete. 2024-05-10T03:36:12.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.832+0000 7fdf48bb0700 1 Processor -- start 2024-05-10T03:36:12.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.832+0000 7fdf48bb0700 1 -- start start 2024-05-10T03:36:12.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.832+0000 7fdf48bb0700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf44073ae0 0x7fdf4419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:36:12.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.833+0000 7fdf48bb0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf440750d0 0x7fdf4419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:36:12.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.833+0000 7fdf48bb0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf44109c10 0x7fdf4419b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:36:12.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.833+0000 7fdf48bb0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4419be90 con 0x7fdf440750d0 2024-05-10T03:36:12.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.833+0000 7fdf48bb0700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4419bfd0 con 0x7fdf44073ae0 2024-05-10T03:36:12.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.833+0000 7fdf48bb0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4419c190 con 0x7fdf44109c10 2024-05-10T03:36:12.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.833+0000 7fdf41d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf440750d0 0x7fdf4419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:36:12.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.833+0000 7fdf41d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf440750d0 0x7fdf4419aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46214/0 (socket says 172.21.15.45:46214) 2024-05-10T03:36:12.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.833+0000 7fdf41d9b700 1 -- 172.21.15.45:0/1369678930 learned_addr learned my addr 172.21.15.45:0/1369678930 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:36:12.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.833+0000 7fdf42d9d700 1 --2- 172.21.15.45:0/1369678930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf44109c10 0x7fdf4419b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:36:12.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.833+0000 7fdf4259c700 1 --2- 172.21.15.45:0/1369678930 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf44073ae0 0x7fdf4419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:36:12.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.833+0000 7fdf41d9b700 1 -- 172.21.15.45:0/1369678930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf44109c10 msgr2=0x7fdf4419b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:36:12.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.833+0000 7fdf41d9b700 1 --2- 172.21.15.45:0/1369678930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf44109c10 0x7fdf4419b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:12.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.833+0000 7fdf41d9b700 1 -- 172.21.15.45:0/1369678930 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf44073ae0 msgr2=0x7fdf4419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:36:12.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.833+0000 7fdf41d9b700 1 --2- 172.21.15.45:0/1369678930 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf44073ae0 0x7fdf4419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:12.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.833+0000 7fdf41d9b700 1 -- 172.21.15.45:0/1369678930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3c009d00 con 0x7fdf440750d0 2024-05-10T03:36:12.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.833+0000 7fdf4259c700 1 --2- 172.21.15.45:0/1369678930 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf44073ae0 0x7fdf4419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:36:12.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.833+0000 7fdf41d9b700 1 --2- 172.21.15.45:0/1369678930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf440750d0 0x7fdf4419aad0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400e9a0 tx=0x7fdf3400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:36:12.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.833+0000 7fdf3b7fe700 1 -- 172.21.15.45:0/1369678930 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf34009790 con 0x7fdf440750d0 2024-05-10T03:36:12.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.833+0000 7fdf48bb0700 1 -- 172.21.15.45:0/1369678930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf4419c470 con 0x7fdf440750d0 2024-05-10T03:36:12.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.833+0000 7fdf3b7fe700 1 -- 172.21.15.45:0/1369678930 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdf3400cbd0 con 0x7fdf440750d0 2024-05-10T03:36:12.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.833+0000 7fdf3b7fe700 1 -- 172.21.15.45:0/1369678930 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf34018680 con 0x7fdf440750d0 2024-05-10T03:36:12.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.834+0000 7fdf48bb0700 1 -- 172.21.15.45:0/1369678930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf441a2c50 con 0x7fdf440750d0 2024-05-10T03:36:12.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.835+0000 7fdf48bb0700 1 -- 172.21.15.45:0/1369678930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf44108ab0 con 0x7fdf440750d0 2024-05-10T03:36:12.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.836+0000 7fdf3b7fe700 1 -- 172.21.15.45:0/1369678930 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fdf340188a0 con 0x7fdf440750d0 2024-05-10T03:36:12.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.837+0000 7fdf3b7fe700 1 --2- 172.21.15.45:0/1369678930 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fdf300a1120 0x7fdf300a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:36:12.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.837+0000 7fdf4259c700 1 --2- 172.21.15.45:0/1369678930 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fdf300a1120 0x7fdf300a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:36:12.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.837+0000 7fdf3b7fe700 1 -- 172.21.15.45:0/1369678930 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4253+0+0 (secure 0 0 0) 0x7fdf34014070 con 0x7fdf440750d0 2024-05-10T03:36:12.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.838+0000 7fdf4259c700 1 --2- 172.21.15.45:0/1369678930 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fdf300a1120 0x7fdf300a3630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c005950 tx=0x7fdf2c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:36:12.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:12.842+0000 7fdf3b7fe700 1 -- 172.21.15.45:0/1369678930 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fdf340967e0 con 0x7fdf440750d0 2024-05-10T03:36:13.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:13.065+0000 7fdf48bb0700 1 -- 172.21.15.45:0/1369678930 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf4410f980 con 0x7fdf300a1120 2024-05-10T03:36:13.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:13 smithi106 ceph-mon[46996]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-05-10T03:36:13.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:13 smithi106 ceph-mon[46996]: osdmap e37: 6 total, 5 up, 6 in 2024-05-10T03:36:13.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:13 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T03:36:13.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:13 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T03:36:13.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:13 smithi106 ceph-mon[46996]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:36:13.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:13 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:36:13.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:13 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:36:13.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:13 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:13.470 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:13 smithi045 ceph-mon[42520]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-05-10T03:36:13.470 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:13 smithi045 ceph-mon[42520]: osdmap e37: 6 total, 5 up, 6 in 2024-05-10T03:36:13.470 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:13 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T03:36:13.470 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:13 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T03:36:13.470 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:13 smithi045 ceph-mon[42520]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:36:13.471 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:13 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:36:13.471 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:13 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:36:13.471 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:13 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:13.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:13 smithi154 ceph-mon[46565]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-05-10T03:36:13.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:13 smithi154 ceph-mon[46565]: osdmap e37: 6 total, 5 up, 6 in 2024-05-10T03:36:13.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:13 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T03:36:13.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:13 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T03:36:13.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:13 smithi154 ceph-mon[46565]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:36:13.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:13 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:36:13.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:13 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:36:13.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:13 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:14.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:14 smithi106 ceph-mon[46996]: purged_snaps scrub starts 2024-05-10T03:36:14.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:14 smithi106 ceph-mon[46996]: purged_snaps scrub ok 2024-05-10T03:36:14.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:14 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T03:36:14.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:14 smithi106 ceph-mon[46996]: osd.5 [v2:172.21.15.154:6808/3929679049,v1:172.21.15.154:6809/3929679049] boot 2024-05-10T03:36:14.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:14 smithi106 ceph-mon[46996]: osdmap e38: 6 total, 6 up, 6 in 2024-05-10T03:36:14.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:14 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T03:36:14.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:14 smithi106 ceph-mon[46996]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:36:14.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:14 smithi154 ceph-mon[46565]: purged_snaps scrub starts 2024-05-10T03:36:14.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:14 smithi154 ceph-mon[46565]: purged_snaps scrub ok 2024-05-10T03:36:14.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:14 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T03:36:14.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:14 smithi154 ceph-mon[46565]: osd.5 [v2:172.21.15.154:6808/3929679049,v1:172.21.15.154:6809/3929679049] boot 2024-05-10T03:36:14.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:14 smithi154 ceph-mon[46565]: osdmap e38: 6 total, 6 up, 6 in 2024-05-10T03:36:14.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:14 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T03:36:14.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:14 smithi154 ceph-mon[46565]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:36:14.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:14 smithi045 ceph-mon[42520]: purged_snaps scrub starts 2024-05-10T03:36:14.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:14 smithi045 ceph-mon[42520]: purged_snaps scrub ok 2024-05-10T03:36:14.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:14 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T03:36:14.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:14 smithi045 ceph-mon[42520]: osd.5 [v2:172.21.15.154:6808/3929679049,v1:172.21.15.154:6809/3929679049] boot 2024-05-10T03:36:14.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:14 smithi045 ceph-mon[42520]: osdmap e38: 6 total, 6 up, 6 in 2024-05-10T03:36:14.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:14 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T03:36:14.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:14 smithi045 ceph-mon[42520]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-10T03:36:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:15 smithi106 ceph-mon[46996]: osdmap e39: 6 total, 6 up, 6 in 2024-05-10T03:36:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:15 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3394986960' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9010ff1-37d7-4426-aa77-6eed69de3567"}]: dispatch 2024-05-10T03:36:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:15 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3394986960' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9010ff1-37d7-4426-aa77-6eed69de3567"}]': finished 2024-05-10T03:36:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:15 smithi106 ceph-mon[46996]: osdmap e40: 7 total, 6 up, 7 in 2024-05-10T03:36:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:15 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T03:36:15.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:15 smithi154 ceph-mon[46565]: osdmap e39: 6 total, 6 up, 6 in 2024-05-10T03:36:15.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:15 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3394986960' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9010ff1-37d7-4426-aa77-6eed69de3567"}]: dispatch 2024-05-10T03:36:15.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:15 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3394986960' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9010ff1-37d7-4426-aa77-6eed69de3567"}]': finished 2024-05-10T03:36:15.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:15 smithi154 ceph-mon[46565]: osdmap e40: 7 total, 6 up, 7 in 2024-05-10T03:36:15.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:15 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T03:36:15.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:15 smithi045 ceph-mon[42520]: osdmap e39: 6 total, 6 up, 6 in 2024-05-10T03:36:15.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:15 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3394986960' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9010ff1-37d7-4426-aa77-6eed69de3567"}]: dispatch 2024-05-10T03:36:15.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:15 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3394986960' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9010ff1-37d7-4426-aa77-6eed69de3567"}]': finished 2024-05-10T03:36:15.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:15 smithi045 ceph-mon[42520]: osdmap e40: 7 total, 6 up, 7 in 2024-05-10T03:36:15.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:15 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T03:36:17.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:16 smithi045 ceph-mon[42520]: osdmap e41: 7 total, 6 up, 7 in 2024-05-10T03:36:17.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T03:36:17.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:16 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/4239287471' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:36:17.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:16 smithi045 ceph-mon[42520]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-10T03:36:17.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:16 smithi106 ceph-mon[46996]: osdmap e41: 7 total, 6 up, 7 in 2024-05-10T03:36:17.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T03:36:17.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:16 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/4239287471' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:36:17.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:16 smithi106 ceph-mon[46996]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-10T03:36:17.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:16 smithi154 ceph-mon[46565]: osdmap e41: 7 total, 6 up, 7 in 2024-05-10T03:36:17.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T03:36:17.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:16 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/4239287471' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:36:17.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:16 smithi154 ceph-mon[46565]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-10T03:36:18.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:17 smithi045 ceph-mon[42520]: osdmap e42: 7 total, 6 up, 7 in 2024-05-10T03:36:18.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:17 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T03:36:18.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:17 smithi106 ceph-mon[46996]: osdmap e42: 7 total, 6 up, 7 in 2024-05-10T03:36:18.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:17 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T03:36:18.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:17 smithi154 ceph-mon[46565]: osdmap e42: 7 total, 6 up, 7 in 2024-05-10T03:36:18.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:17 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T03:36:19.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:18 smithi045 ceph-mon[42520]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-10T03:36:19.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:18 smithi106 ceph-mon[46996]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-10T03:36:19.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:18 smithi154 ceph-mon[46565]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-10T03:36:21.107 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:20 smithi045 ceph-mon[42520]: pgmap v119: 1 pgs: 1 peering; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-05-10T03:36:21.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:20 smithi106 ceph-mon[46996]: pgmap v119: 1 pgs: 1 peering; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-05-10T03:36:21.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:20 smithi154 ceph-mon[46565]: pgmap v119: 1 pgs: 1 peering; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-05-10T03:36:22.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:21 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-10T03:36:22.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:21 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:22.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:21 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-10T03:36:22.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:21 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:22.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:21 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-10T03:36:22.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:21 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:23.023 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:22 smithi045 ceph-mon[42520]: Deploying daemon osd.6 on smithi045 2024-05-10T03:36:23.023 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:22 smithi045 ceph-mon[42520]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-05-10T03:36:23.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:22 smithi154 ceph-mon[46565]: Deploying daemon osd.6 on smithi045 2024-05-10T03:36:23.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:22 smithi154 ceph-mon[46565]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-05-10T03:36:23.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:22 smithi106 ceph-mon[46996]: Deploying daemon osd.6 on smithi045 2024-05-10T03:36:23.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:22 smithi106 ceph-mon[46996]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-05-10T03:36:25.203 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:24 smithi045 ceph-mon[42520]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-05-10T03:36:25.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:24 smithi154 ceph-mon[46565]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-05-10T03:36:25.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:24 smithi106 ceph-mon[46996]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-05-10T03:36:26.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:26.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:26.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:36:26.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:26 smithi106 ceph-mon[46996]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-10T03:36:26.655 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:26.655 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:26.655 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:36:26.655 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:26 smithi045 ceph-mon[42520]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-10T03:36:26.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:26.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:26.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:36:26.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:26 smithi154 ceph-mon[46565]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-10T03:36:27.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:27.668+0000 7fdf3b7fe700 1 -- 172.21.15.45:0/1369678930 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fdf4410f980 con 0x7fdf300a1120 2024-05-10T03:36:27.672 INFO:teuthology.orchestra.run.smithi045.stdout:Created osd(s) 6 on host 'smithi045' 2024-05-10T03:36:27.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:27.671+0000 7fdf48bb0700 1 -- 172.21.15.45:0/1369678930 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fdf300a1120 msgr2=0x7fdf300a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:36:27.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:27.671+0000 7fdf48bb0700 1 --2- 172.21.15.45:0/1369678930 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fdf300a1120 0x7fdf300a3630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c005950 tx=0x7fdf2c0058e0 comp rx=0 tx=0).stop 2024-05-10T03:36:27.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:27.671+0000 7fdf48bb0700 1 -- 172.21.15.45:0/1369678930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf440750d0 msgr2=0x7fdf4419aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:36:27.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:27.671+0000 7fdf48bb0700 1 --2- 172.21.15.45:0/1369678930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf440750d0 0x7fdf4419aad0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400e9a0 tx=0x7fdf3400ecb0 comp rx=0 tx=0).stop 2024-05-10T03:36:27.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:27.671+0000 7fdf48bb0700 1 -- 172.21.15.45:0/1369678930 shutdown_connections 2024-05-10T03:36:27.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:27.671+0000 7fdf48bb0700 1 --2- 172.21.15.45:0/1369678930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf44109c10 0x7fdf4419b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:27.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:27.671+0000 7fdf48bb0700 1 --2- 172.21.15.45:0/1369678930 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fdf300a1120 0x7fdf300a3630 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:27.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:27.671+0000 7fdf48bb0700 1 --2- 172.21.15.45:0/1369678930 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf44073ae0 0x7fdf4419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:27.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:27.671+0000 7fdf48bb0700 1 --2- 172.21.15.45:0/1369678930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf440750d0 0x7fdf4419aad0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:27.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:27.671+0000 7fdf48bb0700 1 -- 172.21.15.45:0/1369678930 >> 172.21.15.45:0/1369678930 conn(0x7fdf440fd390 msgr2=0x7fdf44105bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:36:27.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:27.671+0000 7fdf48bb0700 1 -- 172.21.15.45:0/1369678930 shutdown_connections 2024-05-10T03:36:27.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:36:27.671+0000 7fdf48bb0700 1 -- 172.21.15.45:0/1369678930 wait complete. 2024-05-10T03:36:28.058 DEBUG:teuthology.orchestra.run.smithi045:osd.6> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.6.service 2024-05-10T03:36:28.060 INFO:tasks.cephadm:Deploying osd.7 on smithi106 with /dev/vg_nvme/lv_2... 2024-05-10T03:36:28.060 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-10T03:36:28.100 INFO:journalctl@ceph.osd.6.smithi045.stdout:-- Logs begin at Fri 2024-05-10 03:15:08 UTC. -- 2024-05-10T03:36:28.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:27 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:28.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:27 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:28.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:27 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:28.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:27 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:36:28.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:27 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:28.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:27 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:28.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:27 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:28.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:27 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:36:28.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:27 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:28.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:27 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:28.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:27 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:28.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:27 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:36:28.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:27 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:28.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:27 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:28.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:27 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:28.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:27 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:36:28.251 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:28.251 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:28.251 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:28.251 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:36:28.251 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:28.251 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:28.251 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:28.251 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:36:28.293 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.b/config 2024-05-10T03:36:29.054 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:28 smithi106 ceph-mon[46996]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-10T03:36:29.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:28 smithi154 ceph-mon[46565]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-10T03:36:29.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:28 smithi045 ceph-mon[42520]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-10T03:36:29.578 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-10T03:36:29.578 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-10T03:36:29.578 INFO:teuthology.orchestra.run.smithi106.stderr: stderr: 10+0 records in 2024-05-10T03:36:29.579 INFO:teuthology.orchestra.run.smithi106.stderr:10+0 records out 2024-05-10T03:36:29.579 INFO:teuthology.orchestra.run.smithi106.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113253 s, 926 MB/s 2024-05-10T03:36:29.579 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping successful for: 2024-05-10T03:36:29.784 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:36:29 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:36:29.331+0000 7fa2c2fbe7c0 -1 osd.6 0 log_to_monitors true 2024-05-10T03:36:29.958 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi106:vg_nvme/lv_2 2024-05-10T03:36:30.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:29 smithi106 ceph-mon[46996]: from='osd.6 [v2:172.21.15.45:6818/202946315,v1:172.21.15.45:6819/202946315]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-10T03:36:30.176 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.b/config 2024-05-10T03:36:30.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:29 smithi154 ceph-mon[46565]: from='osd.6 [v2:172.21.15.45:6818/202946315,v1:172.21.15.45:6819/202946315]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-10T03:36:30.250 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:29 smithi045 ceph-mon[42520]: from='osd.6 [v2:172.21.15.45:6818/202946315,v1:172.21.15.45:6819/202946315]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-10T03:36:31.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.082+0000 7f3e3b08c700 1 -- 172.21.15.106:0/2988412878 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e34100b80 msgr2=0x7f3e34100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:36:31.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.082+0000 7f3e3b08c700 1 --2- 172.21.15.106:0/2988412878 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e34100b80 0x7f3e34100f90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3e28009990 tx=0x7f3e28009ca0 comp rx=0 tx=0).stop 2024-05-10T03:36:31.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.082+0000 7f3e3b08c700 1 -- 172.21.15.106:0/2988412878 shutdown_connections 2024-05-10T03:36:31.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.082+0000 7f3e3b08c700 1 --2- 172.21.15.106:0/2988412878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e34102650 0x7f3e34108f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:31.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.082+0000 7f3e3b08c700 1 --2- 172.21.15.106:0/2988412878 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e34100b80 0x7f3e34100f90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:31.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.082+0000 7f3e3b08c700 1 --2- 172.21.15.106:0/2988412878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e34101cb0 0x7f3e341020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:31.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.082+0000 7f3e3b08c700 1 -- 172.21.15.106:0/2988412878 >> 172.21.15.106:0/2988412878 conn(0x7f3e340fc1c0 msgr2=0x7f3e340fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:36:31.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.082+0000 7f3e3b08c700 1 -- 172.21.15.106:0/2988412878 shutdown_connections 2024-05-10T03:36:31.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.082+0000 7f3e3b08c700 1 -- 172.21.15.106:0/2988412878 wait complete. 2024-05-10T03:36:31.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.083+0000 7f3e3b08c700 1 Processor -- start 2024-05-10T03:36:31.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.083+0000 7f3e3b08c700 1 -- start start 2024-05-10T03:36:31.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.083+0000 7f3e3b08c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e34100b80 0x7f3e3419ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:36:31.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.083+0000 7f3e3b08c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e34101cb0 0x7f3e3419d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:36:31.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.083+0000 7f3e3b08c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e34102650 0x7f3e3419f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:36:31.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.083+0000 7f3e3b08c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3419fe70 con 0x7f3e34101cb0 2024-05-10T03:36:31.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.083+0000 7f3e3b08c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3419ffb0 con 0x7f3e34100b80 2024-05-10T03:36:31.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.083+0000 7f3e3b08c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e341a00f0 con 0x7f3e34102650 2024-05-10T03:36:31.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.083+0000 7f3e38e28700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e34100b80 0x7f3e3419ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:36:31.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.083+0000 7f3e38e28700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e34100b80 0x7f3e3419ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41376/0 (socket says 172.21.15.106:41376) 2024-05-10T03:36:31.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.083+0000 7f3e38e28700 1 -- 172.21.15.106:0/427127392 learned_addr learned my addr 172.21.15.106:0/427127392 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-10T03:36:31.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.083+0000 7f3e38e28700 1 -- 172.21.15.106:0/427127392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e34102650 msgr2=0x7f3e3419f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:36:31.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.083+0000 7f3e38e28700 1 --2- 172.21.15.106:0/427127392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e34102650 0x7f3e3419f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:31.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.083+0000 7f3e38e28700 1 -- 172.21.15.106:0/427127392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e34101cb0 msgr2=0x7f3e3419d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:36:31.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.083+0000 7f3e38e28700 1 --2- 172.21.15.106:0/427127392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e34101cb0 0x7f3e3419d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:31.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.083+0000 7f3e38e28700 1 -- 172.21.15.106:0/427127392 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e280095f0 con 0x7f3e34100b80 2024-05-10T03:36:31.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.083+0000 7f3e38e28700 1 --2- 172.21.15.106:0/427127392 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e34100b80 0x7f3e3419ae90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3e28000c00 tx=0x7f3e2800f740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:36:31.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.084+0000 7f3e31ffb700 1 -- 172.21.15.106:0/427127392 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2801d070 con 0x7f3e34100b80 2024-05-10T03:36:31.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.084+0000 7f3e31ffb700 1 -- 172.21.15.106:0/427127392 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3e28005530 con 0x7f3e34100b80 2024-05-10T03:36:31.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.084+0000 7f3e3b08c700 1 -- 172.21.15.106:0/427127392 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e341a02f0 con 0x7f3e34100b80 2024-05-10T03:36:31.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.084+0000 7f3e31ffb700 1 -- 172.21.15.106:0/427127392 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e28004c20 con 0x7f3e34100b80 2024-05-10T03:36:31.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.084+0000 7f3e3b08c700 1 -- 172.21.15.106:0/427127392 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e341a0700 con 0x7f3e34100b80 2024-05-10T03:36:31.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.085+0000 7f3e3b08c700 1 -- 172.21.15.106:0/427127392 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e34107da0 con 0x7f3e34100b80 2024-05-10T03:36:31.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.086+0000 7f3e31ffb700 1 -- 172.21.15.106:0/427127392 <== mon.2 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3e28005050 con 0x7f3e34100b80 2024-05-10T03:36:31.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.087+0000 7f3e31ffb700 1 --2- 172.21.15.106:0/427127392 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3e240a1120 0x7f3e240a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:36:31.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.087+0000 7f3e31ffb700 1 -- 172.21.15.106:0/427127392 <== mon.2 v2:172.21.15.106:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4685+0+0 (secure 0 0 0) 0x7f3e280ccec0 con 0x7f3e34100b80 2024-05-10T03:36:31.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.087+0000 7f3e33fff700 1 --2- 172.21.15.106:0/427127392 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3e240a1120 0x7f3e240a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:36:31.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.087+0000 7f3e33fff700 1 --2- 172.21.15.106:0/427127392 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3e240a1120 0x7f3e240a3630 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3e34069130 tx=0x7f3e20005c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:36:31.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.090+0000 7f3e31ffb700 1 -- 172.21.15.106:0/427127392 <== mon.2 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3e28097510 con 0x7f3e34100b80 2024-05-10T03:36:31.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:30 smithi106 ceph-mon[46996]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-10T03:36:31.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:30 smithi106 ceph-mon[46996]: from='osd.6 [v2:172.21.15.45:6818/202946315,v1:172.21.15.45:6819/202946315]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-10T03:36:31.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:30 smithi106 ceph-mon[46996]: osdmap e43: 7 total, 6 up, 7 in 2024-05-10T03:36:31.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:30 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T03:36:31.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:30 smithi106 ceph-mon[46996]: from='osd.6 [v2:172.21.15.45:6818/202946315,v1:172.21.15.45:6819/202946315]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-05-10T03:36:31.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:30 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:31.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:30 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:31.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:30 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:36:31.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:30 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:36:31.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:30 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:36:31.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:30 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:31.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:30 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:31.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:30 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:36:31.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:30 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:31.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:30 smithi154 ceph-mon[46565]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-10T03:36:31.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:30 smithi154 ceph-mon[46565]: from='osd.6 [v2:172.21.15.45:6818/202946315,v1:172.21.15.45:6819/202946315]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-10T03:36:31.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:30 smithi154 ceph-mon[46565]: osdmap e43: 7 total, 6 up, 7 in 2024-05-10T03:36:31.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:30 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T03:36:31.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:30 smithi154 ceph-mon[46565]: from='osd.6 [v2:172.21.15.45:6818/202946315,v1:172.21.15.45:6819/202946315]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-05-10T03:36:31.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:30 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:31.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:30 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:31.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:30 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:36:31.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:30 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:36:31.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:30 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:36:31.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:30 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:31.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:30 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:31.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:30 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:36:31.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:30 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:31.284 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:36:30 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:36:30.897+0000 7fa2b8622700 -1 osd.6 0 waiting for initial osdmap 2024-05-10T03:36:31.284 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:36:30 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:36:30.910+0000 7fa2b43d9700 -1 osd.6 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T03:36:31.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:30 smithi045 ceph-mon[42520]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-10T03:36:31.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:30 smithi045 ceph-mon[42520]: from='osd.6 [v2:172.21.15.45:6818/202946315,v1:172.21.15.45:6819/202946315]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-10T03:36:31.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:30 smithi045 ceph-mon[42520]: osdmap e43: 7 total, 6 up, 7 in 2024-05-10T03:36:31.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:30 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T03:36:31.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:30 smithi045 ceph-mon[42520]: from='osd.6 [v2:172.21.15.45:6818/202946315,v1:172.21.15.45:6819/202946315]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-05-10T03:36:31.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:30 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:31.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:30 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:31.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:30 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:36:31.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:30 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:36:31.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:30 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:36:31.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:30 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:31.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:30 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:31.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:30 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:36:31.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:30 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:31.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:31.295+0000 7f3e3b08c700 1 -- 172.21.15.106:0/427127392 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e34061650 con 0x7f3e240a1120 2024-05-10T03:36:32.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:31 smithi154 ceph-mon[46565]: Detected new or changed devices on smithi045 2024-05-10T03:36:32.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:31 smithi154 ceph-mon[46565]: Adjusting osd_memory_target on smithi045 to 5706M 2024-05-10T03:36:32.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:31 smithi154 ceph-mon[46565]: from='osd.6 [v2:172.21.15.45:6818/202946315,v1:172.21.15.45:6819/202946315]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-05-10T03:36:32.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:31 smithi154 ceph-mon[46565]: osdmap e44: 7 total, 6 up, 7 in 2024-05-10T03:36:32.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:31 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T03:36:32.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:31 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T03:36:32.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:31 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:36:32.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:31 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:36:32.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:31 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:32.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:31 smithi045 ceph-mon[42520]: Detected new or changed devices on smithi045 2024-05-10T03:36:32.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:31 smithi045 ceph-mon[42520]: Adjusting osd_memory_target on smithi045 to 5706M 2024-05-10T03:36:32.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:31 smithi045 ceph-mon[42520]: from='osd.6 [v2:172.21.15.45:6818/202946315,v1:172.21.15.45:6819/202946315]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-05-10T03:36:32.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:31 smithi045 ceph-mon[42520]: osdmap e44: 7 total, 6 up, 7 in 2024-05-10T03:36:32.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:31 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T03:36:32.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:31 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T03:36:32.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:31 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:36:32.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:31 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:36:32.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:31 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:32.287 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:31 smithi106 ceph-mon[46996]: Detected new or changed devices on smithi045 2024-05-10T03:36:32.287 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:31 smithi106 ceph-mon[46996]: Adjusting osd_memory_target on smithi045 to 5706M 2024-05-10T03:36:32.287 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:31 smithi106 ceph-mon[46996]: from='osd.6 [v2:172.21.15.45:6818/202946315,v1:172.21.15.45:6819/202946315]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-05-10T03:36:32.287 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:31 smithi106 ceph-mon[46996]: osdmap e44: 7 total, 6 up, 7 in 2024-05-10T03:36:32.287 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:31 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T03:36:32.288 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:31 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T03:36:32.288 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:31 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:36:32.288 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:31 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:36:32.288 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:31 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:33.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:32 smithi154 ceph-mon[46565]: purged_snaps scrub starts 2024-05-10T03:36:33.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:32 smithi154 ceph-mon[46565]: purged_snaps scrub ok 2024-05-10T03:36:33.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:32 smithi154 ceph-mon[46565]: from='client.24314 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:36:33.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:32 smithi154 ceph-mon[46565]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-10T03:36:33.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:32 smithi154 ceph-mon[46565]: osd.6 [v2:172.21.15.45:6818/202946315,v1:172.21.15.45:6819/202946315] boot 2024-05-10T03:36:33.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:32 smithi154 ceph-mon[46565]: osdmap e45: 7 total, 7 up, 7 in 2024-05-10T03:36:33.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:32 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T03:36:33.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:32 smithi045 ceph-mon[42520]: purged_snaps scrub starts 2024-05-10T03:36:33.286 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:32 smithi045 ceph-mon[42520]: purged_snaps scrub ok 2024-05-10T03:36:33.286 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:32 smithi045 ceph-mon[42520]: from='client.24314 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:36:33.286 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:32 smithi045 ceph-mon[42520]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-10T03:36:33.286 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:32 smithi045 ceph-mon[42520]: osd.6 [v2:172.21.15.45:6818/202946315,v1:172.21.15.45:6819/202946315] boot 2024-05-10T03:36:33.286 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:32 smithi045 ceph-mon[42520]: osdmap e45: 7 total, 7 up, 7 in 2024-05-10T03:36:33.286 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:32 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T03:36:33.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:32 smithi106 ceph-mon[46996]: purged_snaps scrub starts 2024-05-10T03:36:33.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:32 smithi106 ceph-mon[46996]: purged_snaps scrub ok 2024-05-10T03:36:33.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:32 smithi106 ceph-mon[46996]: from='client.24314 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:36:33.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:32 smithi106 ceph-mon[46996]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-10T03:36:33.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:32 smithi106 ceph-mon[46996]: osd.6 [v2:172.21.15.45:6818/202946315,v1:172.21.15.45:6819/202946315] boot 2024-05-10T03:36:33.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:32 smithi106 ceph-mon[46996]: osdmap e45: 7 total, 7 up, 7 in 2024-05-10T03:36:33.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:32 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T03:36:34.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:33 smithi154 ceph-mon[46565]: osdmap e46: 7 total, 7 up, 7 in 2024-05-10T03:36:34.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:33 smithi154 ceph-mon[46565]: from='client.? 172.21.15.106:0/1221541852' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e965b02-cc0b-4223-af80-97420f33102b"}]: dispatch 2024-05-10T03:36:34.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:33 smithi154 ceph-mon[46565]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e965b02-cc0b-4223-af80-97420f33102b"}]: dispatch 2024-05-10T03:36:34.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:33 smithi154 ceph-mon[46565]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3e965b02-cc0b-4223-af80-97420f33102b"}]': finished 2024-05-10T03:36:34.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:33 smithi154 ceph-mon[46565]: osdmap e47: 8 total, 7 up, 8 in 2024-05-10T03:36:34.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:33 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T03:36:34.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:33 smithi154 ceph-mon[46565]: from='client.? 172.21.15.106:0/2600926136' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:36:34.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:33 smithi045 ceph-mon[42520]: osdmap e46: 7 total, 7 up, 7 in 2024-05-10T03:36:34.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:33 smithi045 ceph-mon[42520]: from='client.? 172.21.15.106:0/1221541852' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e965b02-cc0b-4223-af80-97420f33102b"}]: dispatch 2024-05-10T03:36:34.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:33 smithi045 ceph-mon[42520]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e965b02-cc0b-4223-af80-97420f33102b"}]: dispatch 2024-05-10T03:36:34.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:33 smithi045 ceph-mon[42520]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3e965b02-cc0b-4223-af80-97420f33102b"}]': finished 2024-05-10T03:36:34.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:33 smithi045 ceph-mon[42520]: osdmap e47: 8 total, 7 up, 8 in 2024-05-10T03:36:34.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:33 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T03:36:34.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:33 smithi045 ceph-mon[42520]: from='client.? 172.21.15.106:0/2600926136' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:36:34.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:33 smithi106 ceph-mon[46996]: osdmap e46: 7 total, 7 up, 7 in 2024-05-10T03:36:34.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:33 smithi106 ceph-mon[46996]: from='client.? 172.21.15.106:0/1221541852' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e965b02-cc0b-4223-af80-97420f33102b"}]: dispatch 2024-05-10T03:36:34.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:33 smithi106 ceph-mon[46996]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e965b02-cc0b-4223-af80-97420f33102b"}]: dispatch 2024-05-10T03:36:34.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:33 smithi106 ceph-mon[46996]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3e965b02-cc0b-4223-af80-97420f33102b"}]': finished 2024-05-10T03:36:34.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:33 smithi106 ceph-mon[46996]: osdmap e47: 8 total, 7 up, 8 in 2024-05-10T03:36:34.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:33 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T03:36:34.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:33 smithi106 ceph-mon[46996]: from='client.? 172.21.15.106:0/2600926136' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:36:35.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:35 smithi106 ceph-mon[46996]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:35.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:35 smithi154 ceph-mon[46565]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:35.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:35 smithi045 ceph-mon[42520]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:37.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:37 smithi106 ceph-mon[46996]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:37.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:37 smithi154 ceph-mon[46565]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:37.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:37 smithi045 ceph-mon[42520]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:39.367 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:39 smithi106 ceph-mon[46996]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:39.368 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:39 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-10T03:36:39.368 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:39 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:39.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:39 smithi154 ceph-mon[46565]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:39.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:39 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-10T03:36:39.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:39 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:39.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:39 smithi045 ceph-mon[42520]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:39.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:39 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-10T03:36:39.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:39 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:40.358 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:40 smithi106 ceph-mon[46996]: Deploying daemon osd.7 on smithi106 2024-05-10T03:36:40.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:40 smithi154 ceph-mon[46565]: Deploying daemon osd.7 on smithi106 2024-05-10T03:36:40.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:40 smithi045 ceph-mon[42520]: Deploying daemon osd.7 on smithi106 2024-05-10T03:36:41.345 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:41 smithi106 ceph-mon[46996]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:41.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:41 smithi154 ceph-mon[46565]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:41.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:41 smithi045 ceph-mon[42520]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:42.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:42 smithi106 ceph-mon[46996]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:42.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:42 smithi154 ceph-mon[46565]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:42.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:42 smithi045 ceph-mon[42520]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:43.706 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:43 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:43.707 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:43 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:43.707 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:43 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:36:43.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:43 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:43.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:43 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:43.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:43 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:36:44.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:43 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:44.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:43 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:44.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:43 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:36:44.876 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:44 smithi106 ceph-mon[46996]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:44.877 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:44 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:44.877 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:44 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:44.877 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:44 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:44.877 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:44 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:36:44.877 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:44 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:44.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:44 smithi154 ceph-mon[46565]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:44.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:44 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:44.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:44 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:44.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:44 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:44.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:44 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:36:44.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:44 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:45.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:44 smithi045 ceph-mon[42520]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:45.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:44 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:45.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:44 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:45.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:44 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:45.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:44 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:36:45.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:44 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:45.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:45.098+0000 7f3e31ffb700 1 -- 172.21.15.106:0/427127392 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3e34061650 con 0x7f3e240a1120 2024-05-10T03:36:45.102 INFO:teuthology.orchestra.run.smithi106.stdout:Created osd(s) 7 on host 'smithi106' 2024-05-10T03:36:45.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:45.101+0000 7f3e3b08c700 1 -- 172.21.15.106:0/427127392 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3e240a1120 msgr2=0x7f3e240a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:36:45.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:45.101+0000 7f3e3b08c700 1 --2- 172.21.15.106:0/427127392 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3e240a1120 0x7f3e240a3630 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3e34069130 tx=0x7f3e20005c80 comp rx=0 tx=0).stop 2024-05-10T03:36:45.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:45.101+0000 7f3e3b08c700 1 -- 172.21.15.106:0/427127392 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e34100b80 msgr2=0x7f3e3419ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:36:45.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:45.101+0000 7f3e3b08c700 1 --2- 172.21.15.106:0/427127392 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e34100b80 0x7f3e3419ae90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3e28000c00 tx=0x7f3e2800f740 comp rx=0 tx=0).stop 2024-05-10T03:36:45.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:45.101+0000 7f3e3b08c700 1 -- 172.21.15.106:0/427127392 shutdown_connections 2024-05-10T03:36:45.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:45.101+0000 7f3e3b08c700 1 --2- 172.21.15.106:0/427127392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e34102650 0x7f3e3419f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:45.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:45.101+0000 7f3e3b08c700 1 --2- 172.21.15.106:0/427127392 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3e240a1120 0x7f3e240a3630 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:45.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:45.101+0000 7f3e3b08c700 1 --2- 172.21.15.106:0/427127392 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e34100b80 0x7f3e3419ae90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:45.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:45.101+0000 7f3e3b08c700 1 --2- 172.21.15.106:0/427127392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e34101cb0 0x7f3e3419d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:45.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:45.101+0000 7f3e3b08c700 1 -- 172.21.15.106:0/427127392 >> 172.21.15.106:0/427127392 conn(0x7f3e340fc1c0 msgr2=0x7f3e34104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:36:45.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:45.101+0000 7f3e3b08c700 1 -- 172.21.15.106:0/427127392 shutdown_connections 2024-05-10T03:36:45.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:36:45.101+0000 7f3e3b08c700 1 -- 172.21.15.106:0/427127392 wait complete. 2024-05-10T03:36:45.479 DEBUG:teuthology.orchestra.run.smithi106:osd.7> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.7.service 2024-05-10T03:36:45.481 INFO:tasks.cephadm:Deploying osd.8 on smithi154 with /dev/vg_nvme/lv_2... 2024-05-10T03:36:45.481 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-10T03:36:45.529 INFO:journalctl@ceph.osd.7.smithi106.stdout:-- Logs begin at Fri 2024-05-10 03:15:26 UTC. -- 2024-05-10T03:36:45.729 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T03:36:46.139 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:46 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:46.139 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:46 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:46.139 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:46 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:36:46.337 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:46 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:46.338 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:46 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:46.338 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:46 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:36:46.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:46 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:46.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:46 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:46.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:46 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:36:47.080 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-10T03:36:47.080 INFO:teuthology.orchestra.run.smithi154.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-10T03:36:47.080 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10+0 records in 2024-05-10T03:36:47.080 INFO:teuthology.orchestra.run.smithi154.stderr:10+0 records out 2024-05-10T03:36:47.080 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0127622 s, 822 MB/s 2024-05-10T03:36:47.080 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping successful for: 2024-05-10T03:36:47.082 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:36:46 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:36:46.669+0000 7f55b8ccb7c0 -1 osd.7 0 log_to_monitors true 2024-05-10T03:36:47.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:47 smithi106 ceph-mon[46996]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:47.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:47 smithi106 ceph-mon[46996]: from='osd.7 [v2:172.21.15.106:6816/1689864237,v1:172.21.15.106:6817/1689864237]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-10T03:36:47.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:47 smithi106 ceph-mon[46996]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-10T03:36:47.408 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:47 smithi154 ceph-mon[46565]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:47.408 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:47 smithi154 ceph-mon[46565]: from='osd.7 [v2:172.21.15.106:6816/1689864237,v1:172.21.15.106:6817/1689864237]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-10T03:36:47.408 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:47 smithi154 ceph-mon[46565]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-10T03:36:47.469 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_2 2024-05-10T03:36:47.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:47 smithi045 ceph-mon[42520]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:47.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:47 smithi045 ceph-mon[42520]: from='osd.7 [v2:172.21.15.106:6816/1689864237,v1:172.21.15.106:6817/1689864237]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-10T03:36:47.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:47 smithi045 ceph-mon[42520]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-10T03:36:47.691 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T03:36:48.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:36:48 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:36:48.093+0000 7f55ae32f700 -1 osd.7 0 waiting for initial osdmap 2024-05-10T03:36:48.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:36:48 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:36:48.105+0000 7f55aa0e6700 -1 osd.7 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T03:36:48.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:48 smithi106 ceph-mon[46996]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-10T03:36:48.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:48 smithi106 ceph-mon[46996]: osdmap e48: 8 total, 7 up, 8 in 2024-05-10T03:36:48.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:48 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T03:36:48.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:48 smithi106 ceph-mon[46996]: from='osd.7 [v2:172.21.15.106:6816/1689864237,v1:172.21.15.106:6817/1689864237]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-10T03:36:48.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:48 smithi106 ceph-mon[46996]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-10T03:36:48.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:48 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:48.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:48 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:48.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:48 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:36:48.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:48 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:36:48.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:48 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:36:48.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:48 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:48.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:48 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:48.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:48 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:36:48.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:48 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:48.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:48 smithi154 ceph-mon[46565]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-10T03:36:48.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:48 smithi154 ceph-mon[46565]: osdmap e48: 8 total, 7 up, 8 in 2024-05-10T03:36:48.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:48 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T03:36:48.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:48 smithi154 ceph-mon[46565]: from='osd.7 [v2:172.21.15.106:6816/1689864237,v1:172.21.15.106:6817/1689864237]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-10T03:36:48.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:48 smithi154 ceph-mon[46565]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-10T03:36:48.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:48 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:48.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:48 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:48.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:48 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:36:48.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:48 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:36:48.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:48 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:36:48.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:48 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:48.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:48 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:48.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:48 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:36:48.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:48 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:48.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:48 smithi045 ceph-mon[42520]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-10T03:36:48.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:48 smithi045 ceph-mon[42520]: osdmap e48: 8 total, 7 up, 8 in 2024-05-10T03:36:48.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:48 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T03:36:48.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:48 smithi045 ceph-mon[42520]: from='osd.7 [v2:172.21.15.106:6816/1689864237,v1:172.21.15.106:6817/1689864237]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-10T03:36:48.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:48 smithi045 ceph-mon[42520]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-10T03:36:48.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:48 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:48.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:48 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:48.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:48 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:36:48.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:48 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:36:48.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:48 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:36:48.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:48 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:48.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:48 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:48.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:48 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:36:48.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:48 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:36:48.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.683+0000 7f881107d700 1 -- 172.21.15.154:0/3527174118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f880c100b80 msgr2=0x7f880c100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:36:48.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.683+0000 7f881107d700 1 --2- 172.21.15.154:0/3527174118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f880c100b80 0x7f880c100f90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8800009990 tx=0x7f8800009ca0 comp rx=0 tx=0).stop 2024-05-10T03:36:48.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.683+0000 7f881107d700 1 -- 172.21.15.154:0/3527174118 shutdown_connections 2024-05-10T03:36:48.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.683+0000 7f881107d700 1 --2- 172.21.15.154:0/3527174118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f880c100b80 0x7f880c100f90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:48.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.683+0000 7f881107d700 1 --2- 172.21.15.154:0/3527174118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f880c102650 0x7f880c108f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:48.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.683+0000 7f881107d700 1 --2- 172.21.15.154:0/3527174118 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f880c101cb0 0x7f880c1020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:48.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.683+0000 7f881107d700 1 -- 172.21.15.154:0/3527174118 >> 172.21.15.154:0/3527174118 conn(0x7f880c0fc1c0 msgr2=0x7f880c0fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:36:48.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.683+0000 7f881107d700 1 -- 172.21.15.154:0/3527174118 shutdown_connections 2024-05-10T03:36:48.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.683+0000 7f881107d700 1 -- 172.21.15.154:0/3527174118 wait complete. 2024-05-10T03:36:48.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.684+0000 7f881107d700 1 Processor -- start 2024-05-10T03:36:48.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.684+0000 7f881107d700 1 -- start start 2024-05-10T03:36:48.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.684+0000 7f881107d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f880c100b80 0x7f880c19af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:36:48.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.684+0000 7f881107d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f880c101cb0 0x7f880c19d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:36:48.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.684+0000 7f881107d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f880c102650 0x7f880c19fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:36:48.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.684+0000 7f881107d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c069c70 con 0x7f880c101cb0 2024-05-10T03:36:48.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.684+0000 7f881107d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c19ff50 con 0x7f880c100b80 2024-05-10T03:36:48.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.684+0000 7f881107d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c1a00c0 con 0x7f880c102650 2024-05-10T03:36:48.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.684+0000 7f880b59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f880c102650 0x7f880c19fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:36:48.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.684+0000 7f880b59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f880c102650 0x7f880c19fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41222/0 (socket says 172.21.15.154:41222) 2024-05-10T03:36:48.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.684+0000 7f880b59e700 1 -- 172.21.15.154:0/1197680852 learned_addr learned my addr 172.21.15.154:0/1197680852 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-10T03:36:48.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.684+0000 7f880ad9d700 1 --2- 172.21.15.154:0/1197680852 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f880c100b80 0x7f880c19af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:36:48.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.685+0000 7f880a59c700 1 --2- 172.21.15.154:0/1197680852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f880c101cb0 0x7f880c19d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:36:48.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.685+0000 7f880b59e700 1 -- 172.21.15.154:0/1197680852 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f880c100b80 msgr2=0x7f880c19af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:36:48.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.685+0000 7f880b59e700 1 --2- 172.21.15.154:0/1197680852 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f880c100b80 0x7f880c19af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:48.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.685+0000 7f880b59e700 1 -- 172.21.15.154:0/1197680852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f880c101cb0 msgr2=0x7f880c19d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:36:48.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.685+0000 7f880b59e700 1 --2- 172.21.15.154:0/1197680852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f880c101cb0 0x7f880c19d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:36:48.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.685+0000 7f880b59e700 1 -- 172.21.15.154:0/1197680852 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88000095f0 con 0x7f880c102650 2024-05-10T03:36:48.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.685+0000 7f880b59e700 1 --2- 172.21.15.154:0/1197680852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f880c102650 0x7f880c19fa10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8804007d70 tx=0x7f880400a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:36:48.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.685+0000 7f87f3fff700 1 -- 172.21.15.154:0/1197680852 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880400ad40 con 0x7f880c102650 2024-05-10T03:36:48.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.685+0000 7f87f3fff700 1 -- 172.21.15.154:0/1197680852 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8804012900 con 0x7f880c102650 2024-05-10T03:36:48.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.685+0000 7f881107d700 1 -- 172.21.15.154:0/1197680852 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f880c1a03a0 con 0x7f880c102650 2024-05-10T03:36:48.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.685+0000 7f87f3fff700 1 -- 172.21.15.154:0/1197680852 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8804011780 con 0x7f880c102650 2024-05-10T03:36:48.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.685+0000 7f881107d700 1 -- 172.21.15.154:0/1197680852 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880c1a0850 con 0x7f880c102650 2024-05-10T03:36:48.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.686+0000 7f881107d700 1 -- 172.21.15.154:0/1197680852 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f880c107da0 con 0x7f880c102650 2024-05-10T03:36:48.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.687+0000 7f87f3fff700 1 -- 172.21.15.154:0/1197680852 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8804012a70 con 0x7f880c102650 2024-05-10T03:36:48.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.688+0000 7f87f3fff700 1 --2- 172.21.15.154:0/1197680852 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f87f40a1120 0x7f87f40a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:36:48.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.688+0000 7f87f3fff700 1 -- 172.21.15.154:0/1197680852 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5117+0+0 (secure 0 0 0) 0x7f88040cbea0 con 0x7f880c102650 2024-05-10T03:36:48.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.688+0000 7f880ad9d700 1 --2- 172.21.15.154:0/1197680852 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f87f40a1120 0x7f87f40a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:36:48.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.689+0000 7f880ad9d700 1 --2- 172.21.15.154:0/1197680852 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f87f40a1120 0x7f87f40a3630 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f880c0696a0 tx=0x7f880001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:36:48.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.693+0000 7f87f3fff700 1 -- 172.21.15.154:0/1197680852 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f88040962b0 con 0x7f880c102650 2024-05-10T03:36:48.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:36:48.896+0000 7f881107d700 1 -- 172.21.15.154:0/1197680852 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f880c10c6e0 con 0x7f87f40a1120 2024-05-10T03:36:49.367 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:49 smithi154 ceph-mon[46565]: Detected new or changed devices on smithi106 2024-05-10T03:36:49.367 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:49 smithi154 ceph-mon[46565]: Adjusting osd_memory_target on smithi106 to 5704M 2024-05-10T03:36:49.367 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:49 smithi154 ceph-mon[46565]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:49.367 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:49 smithi154 ceph-mon[46565]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-05-10T03:36:49.367 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:49 smithi154 ceph-mon[46565]: osdmap e49: 8 total, 7 up, 8 in 2024-05-10T03:36:49.367 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:49 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T03:36:49.367 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:49 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T03:36:49.367 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:49 smithi154 ceph-mon[46565]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:36:49.367 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:49 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:36:49.367 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:49 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:36:49.367 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:49 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:49.367 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:49 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T03:36:49.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:49 smithi106 ceph-mon[46996]: Detected new or changed devices on smithi106 2024-05-10T03:36:49.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:49 smithi106 ceph-mon[46996]: Adjusting osd_memory_target on smithi106 to 5704M 2024-05-10T03:36:49.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:49 smithi106 ceph-mon[46996]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:49.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:49 smithi106 ceph-mon[46996]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-05-10T03:36:49.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:49 smithi106 ceph-mon[46996]: osdmap e49: 8 total, 7 up, 8 in 2024-05-10T03:36:49.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:49 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T03:36:49.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:49 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T03:36:49.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:49 smithi106 ceph-mon[46996]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:36:49.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:49 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:36:49.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:49 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:36:49.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:49 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:49.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:49 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T03:36:49.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:49 smithi045 ceph-mon[42520]: Detected new or changed devices on smithi106 2024-05-10T03:36:49.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:49 smithi045 ceph-mon[42520]: Adjusting osd_memory_target on smithi106 to 5704M 2024-05-10T03:36:49.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:49 smithi045 ceph-mon[42520]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:49.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:49 smithi045 ceph-mon[42520]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-05-10T03:36:49.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:49 smithi045 ceph-mon[42520]: osdmap e49: 8 total, 7 up, 8 in 2024-05-10T03:36:49.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:49 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T03:36:49.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:49 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T03:36:49.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:49 smithi045 ceph-mon[42520]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:36:49.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:49 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:36:49.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:49 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:36:49.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:49 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:49.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:49 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T03:36:50.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:50 smithi106 ceph-mon[46996]: purged_snaps scrub starts 2024-05-10T03:36:50.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:50 smithi106 ceph-mon[46996]: purged_snaps scrub ok 2024-05-10T03:36:50.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:50 smithi106 ceph-mon[46996]: osd.7 [v2:172.21.15.106:6816/1689864237,v1:172.21.15.106:6817/1689864237] boot 2024-05-10T03:36:50.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:50 smithi106 ceph-mon[46996]: osdmap e50: 8 total, 8 up, 8 in 2024-05-10T03:36:50.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:50 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T03:36:50.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:50 smithi106 ceph-mon[46996]: pgmap v142: 1 pgs: 1 remapped; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:50.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:50 smithi154 ceph-mon[46565]: purged_snaps scrub starts 2024-05-10T03:36:50.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:50 smithi154 ceph-mon[46565]: purged_snaps scrub ok 2024-05-10T03:36:50.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:50 smithi154 ceph-mon[46565]: osd.7 [v2:172.21.15.106:6816/1689864237,v1:172.21.15.106:6817/1689864237] boot 2024-05-10T03:36:50.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:50 smithi154 ceph-mon[46565]: osdmap e50: 8 total, 8 up, 8 in 2024-05-10T03:36:50.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:50 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T03:36:50.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:50 smithi154 ceph-mon[46565]: pgmap v142: 1 pgs: 1 remapped; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:50.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:50 smithi045 ceph-mon[42520]: purged_snaps scrub starts 2024-05-10T03:36:50.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:50 smithi045 ceph-mon[42520]: purged_snaps scrub ok 2024-05-10T03:36:50.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:50 smithi045 ceph-mon[42520]: osd.7 [v2:172.21.15.106:6816/1689864237,v1:172.21.15.106:6817/1689864237] boot 2024-05-10T03:36:50.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:50 smithi045 ceph-mon[42520]: osdmap e50: 8 total, 8 up, 8 in 2024-05-10T03:36:50.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:50 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T03:36:50.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:50 smithi045 ceph-mon[42520]: pgmap v142: 1 pgs: 1 remapped; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-05-10T03:36:51.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:51 smithi106 ceph-mon[46996]: osdmap e51: 8 total, 8 up, 8 in 2024-05-10T03:36:51.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:51 smithi106 ceph-mon[46996]: from='client.? 172.21.15.154:0/1926578675' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "160c752d-e4ae-4670-aeed-db069ce61452"}]: dispatch 2024-05-10T03:36:51.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:51 smithi106 ceph-mon[46996]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "160c752d-e4ae-4670-aeed-db069ce61452"}]: dispatch 2024-05-10T03:36:51.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:51 smithi106 ceph-mon[46996]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "160c752d-e4ae-4670-aeed-db069ce61452"}]': finished 2024-05-10T03:36:51.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:51 smithi106 ceph-mon[46996]: osdmap e52: 9 total, 8 up, 9 in 2024-05-10T03:36:51.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:51 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T03:36:51.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:51 smithi154 ceph-mon[46565]: osdmap e51: 8 total, 8 up, 8 in 2024-05-10T03:36:51.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:51 smithi154 ceph-mon[46565]: from='client.? 172.21.15.154:0/1926578675' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "160c752d-e4ae-4670-aeed-db069ce61452"}]: dispatch 2024-05-10T03:36:51.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:51 smithi154 ceph-mon[46565]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "160c752d-e4ae-4670-aeed-db069ce61452"}]: dispatch 2024-05-10T03:36:51.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:51 smithi154 ceph-mon[46565]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "160c752d-e4ae-4670-aeed-db069ce61452"}]': finished 2024-05-10T03:36:51.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:51 smithi154 ceph-mon[46565]: osdmap e52: 9 total, 8 up, 9 in 2024-05-10T03:36:51.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:51 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T03:36:51.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:51 smithi045 ceph-mon[42520]: osdmap e51: 8 total, 8 up, 8 in 2024-05-10T03:36:51.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:51 smithi045 ceph-mon[42520]: from='client.? 172.21.15.154:0/1926578675' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "160c752d-e4ae-4670-aeed-db069ce61452"}]: dispatch 2024-05-10T03:36:51.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:51 smithi045 ceph-mon[42520]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "160c752d-e4ae-4670-aeed-db069ce61452"}]: dispatch 2024-05-10T03:36:51.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:51 smithi045 ceph-mon[42520]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "160c752d-e4ae-4670-aeed-db069ce61452"}]': finished 2024-05-10T03:36:51.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:51 smithi045 ceph-mon[42520]: osdmap e52: 9 total, 8 up, 9 in 2024-05-10T03:36:51.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:51 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T03:36:52.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:52 smithi106 ceph-mon[46996]: from='client.? 172.21.15.154:0/2112360498' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:36:52.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:52 smithi106 ceph-mon[46996]: pgmap v145: 1 pgs: 1 remapped; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:36:52.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:52 smithi106 ceph-mon[46996]: osdmap e53: 9 total, 8 up, 9 in 2024-05-10T03:36:52.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:52 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T03:36:52.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:52 smithi154 ceph-mon[46565]: from='client.? 172.21.15.154:0/2112360498' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:36:52.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:52 smithi154 ceph-mon[46565]: pgmap v145: 1 pgs: 1 remapped; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:36:52.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:52 smithi154 ceph-mon[46565]: osdmap e53: 9 total, 8 up, 9 in 2024-05-10T03:36:52.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:52 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T03:36:52.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:52 smithi045 ceph-mon[42520]: from='client.? 172.21.15.154:0/2112360498' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:36:52.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:52 smithi045 ceph-mon[42520]: pgmap v145: 1 pgs: 1 remapped; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:36:52.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:52 smithi045 ceph-mon[42520]: osdmap e53: 9 total, 8 up, 9 in 2024-05-10T03:36:52.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:52 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T03:36:54.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:53 smithi106 ceph-mon[46996]: osdmap e54: 9 total, 8 up, 9 in 2024-05-10T03:36:54.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:53 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T03:36:54.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:53 smithi154 ceph-mon[46565]: osdmap e54: 9 total, 8 up, 9 in 2024-05-10T03:36:54.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:53 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T03:36:54.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:53 smithi045 ceph-mon[42520]: osdmap e54: 9 total, 8 up, 9 in 2024-05-10T03:36:54.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:53 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T03:36:54.932 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:54 smithi154 ceph-mon[46565]: pgmap v148: 1 pgs: 1 remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:36:55.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:54 smithi106 ceph-mon[46996]: pgmap v148: 1 pgs: 1 remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:36:55.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:54 smithi045 ceph-mon[42520]: pgmap v148: 1 pgs: 1 remapped; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:36:57.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:56 smithi106 ceph-mon[46996]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:36:57.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:56 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-10T03:36:57.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:56 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:57.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:56 smithi154 ceph-mon[46565]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:36:57.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:56 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-10T03:36:57.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:56 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:57.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:56 smithi045 ceph-mon[42520]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:36:57.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:56 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-10T03:36:57.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:56 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:36:57.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:57 smithi154 ceph-mon[46565]: Deploying daemon osd.8 on smithi154 2024-05-10T03:36:58.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:57 smithi106 ceph-mon[46996]: Deploying daemon osd.8 on smithi154 2024-05-10T03:36:58.288 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:57 smithi045 ceph-mon[42520]: Deploying daemon osd.8 on smithi154 2024-05-10T03:36:58.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:36:58 smithi154 ceph-mon[46565]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:36:59.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:36:58 smithi106 ceph-mon[46996]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:36:59.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:36:58 smithi045 ceph-mon[42520]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:37:00.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:00 smithi154 ceph-mon[46565]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:37:00.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:00 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:00.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:00 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:00.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:00 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:37:01.154 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:00 smithi106 ceph-mon[46996]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:37:01.154 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:00 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:01.154 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:00 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:01.154 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:00 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:37:01.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:00 smithi045 ceph-mon[42520]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:37:01.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:00 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:01.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:00 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:01.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:00 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:37:02.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:02 smithi154 ceph-mon[46565]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:37:02.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:02 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:02.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:02 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:02.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:02 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:02.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:02 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:37:02.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:02 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:03.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:03.151+0000 7f87f3fff700 1 -- 172.21.15.154:0/1197680852 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f880c10c6e0 con 0x7f87f40a1120 2024-05-10T03:37:03.155 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 8 on host 'smithi154' 2024-05-10T03:37:03.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:03.154+0000 7f881107d700 1 -- 172.21.15.154:0/1197680852 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f87f40a1120 msgr2=0x7f87f40a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:37:03.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:03.154+0000 7f881107d700 1 --2- 172.21.15.154:0/1197680852 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f87f40a1120 0x7f87f40a3630 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f880c0696a0 tx=0x7f880001a040 comp rx=0 tx=0).stop 2024-05-10T03:37:03.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:03.154+0000 7f881107d700 1 -- 172.21.15.154:0/1197680852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f880c102650 msgr2=0x7f880c19fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:37:03.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:03.154+0000 7f881107d700 1 --2- 172.21.15.154:0/1197680852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f880c102650 0x7f880c19fa10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8804007d70 tx=0x7f880400a340 comp rx=0 tx=0).stop 2024-05-10T03:37:03.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:03.154+0000 7f881107d700 1 -- 172.21.15.154:0/1197680852 shutdown_connections 2024-05-10T03:37:03.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:03.154+0000 7f881107d700 1 --2- 172.21.15.154:0/1197680852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f880c102650 0x7f880c19fa10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:03.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:03.154+0000 7f881107d700 1 --2- 172.21.15.154:0/1197680852 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f87f40a1120 0x7f87f40a3630 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:03.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:03.154+0000 7f881107d700 1 --2- 172.21.15.154:0/1197680852 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f880c100b80 0x7f880c19af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:03.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:03.154+0000 7f881107d700 1 --2- 172.21.15.154:0/1197680852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f880c101cb0 0x7f880c19d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:03.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:03.154+0000 7f881107d700 1 -- 172.21.15.154:0/1197680852 >> 172.21.15.154:0/1197680852 conn(0x7f880c0fc1c0 msgr2=0x7f880c104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:37:03.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:03.154+0000 7f881107d700 1 -- 172.21.15.154:0/1197680852 shutdown_connections 2024-05-10T03:37:03.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:03.154+0000 7f881107d700 1 -- 172.21.15.154:0/1197680852 wait complete. 2024-05-10T03:37:03.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:02 smithi045 ceph-mon[42520]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:37:03.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:02 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:03.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:02 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:03.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:02 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:03.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:02 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:37:03.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:02 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:03.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:02 smithi106 ceph-mon[46996]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:37:03.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:02 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:03.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:02 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:03.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:02 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:03.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:02 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:37:03.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:02 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:03.561 DEBUG:teuthology.orchestra.run.smithi154:osd.8> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.8.service 2024-05-10T03:37:03.563 INFO:tasks.cephadm:Deploying osd.9 on smithi045 with /dev/vg_nvme/lv_1... 2024-05-10T03:37:03.563 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-10T03:37:03.592 INFO:journalctl@ceph.osd.8.smithi154.stdout:-- Logs begin at Fri 2024-05-10 03:15:42 UTC. -- 2024-05-10T03:37:03.832 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:37:04.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:03 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:37:04.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:03 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:04.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:03 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:04.271 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:03 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:37:04.272 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:03 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:04.272 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:03 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:04.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:03 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:37:04.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:03 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:04.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:03 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:05.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:04 smithi045 ceph-mon[42520]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:37:05.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:04 smithi045 ceph-mon[42520]: from='osd.8 [v2:172.21.15.154:6816/1548564532,v1:172.21.15.154:6817/1548564532]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-10T03:37:05.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:04 smithi045 ceph-mon[42520]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-10T03:37:05.224 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:37:04 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:37:04.739+0000 7f563087b7c0 -1 osd.8 0 log_to_monitors true 2024-05-10T03:37:05.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:04 smithi154 ceph-mon[46565]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:37:05.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:04 smithi154 ceph-mon[46565]: from='osd.8 [v2:172.21.15.154:6816/1548564532,v1:172.21.15.154:6817/1548564532]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-10T03:37:05.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:04 smithi154 ceph-mon[46565]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-10T03:37:05.272 INFO:teuthology.orchestra.run.smithi045.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-10T03:37:05.272 INFO:teuthology.orchestra.run.smithi045.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-10T03:37:05.272 INFO:teuthology.orchestra.run.smithi045.stderr: stderr: 10+0 records in 2024-05-10T03:37:05.272 INFO:teuthology.orchestra.run.smithi045.stderr:10+0 records out 2024-05-10T03:37:05.272 INFO:teuthology.orchestra.run.smithi045.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0158494 s, 662 MB/s 2024-05-10T03:37:05.272 INFO:teuthology.orchestra.run.smithi045.stderr:--> Zapping successful for: 2024-05-10T03:37:05.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:04 smithi106 ceph-mon[46996]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:37:05.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:04 smithi106 ceph-mon[46996]: from='osd.8 [v2:172.21.15.154:6816/1548564532,v1:172.21.15.154:6817/1548564532]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-10T03:37:05.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:04 smithi106 ceph-mon[46996]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-10T03:37:05.616 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi045:vg_nvme/lv_1 2024-05-10T03:37:05.876 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:37:06.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:06 smithi045 ceph-mon[42520]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-10T03:37:06.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:06 smithi045 ceph-mon[42520]: osdmap e55: 9 total, 8 up, 9 in 2024-05-10T03:37:06.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:06 smithi045 ceph-mon[42520]: from='osd.8 [v2:172.21.15.154:6816/1548564532,v1:172.21.15.154:6817/1548564532]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-10T03:37:06.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:06 smithi045 ceph-mon[42520]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-10T03:37:06.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:06 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T03:37:06.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:06 smithi045 ceph-mon[42520]: Detected new or changed devices on smithi154 2024-05-10T03:37:06.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:06 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:06.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:06 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:06.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:06 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:06.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:06 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:06.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:06 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:06.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:06 smithi045 ceph-mon[42520]: Adjusting osd_memory_target on smithi154 to 5704M 2024-05-10T03:37:06.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:06 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:06.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:06 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:06.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:06 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:37:06.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:06 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:06.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:06 smithi045 ceph-mon[42520]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:37:06.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:06 smithi106 ceph-mon[46996]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-10T03:37:06.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:06 smithi106 ceph-mon[46996]: osdmap e55: 9 total, 8 up, 9 in 2024-05-10T03:37:06.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:06 smithi106 ceph-mon[46996]: from='osd.8 [v2:172.21.15.154:6816/1548564532,v1:172.21.15.154:6817/1548564532]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-10T03:37:06.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:06 smithi106 ceph-mon[46996]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-10T03:37:06.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:06 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T03:37:06.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:06 smithi106 ceph-mon[46996]: Detected new or changed devices on smithi154 2024-05-10T03:37:06.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:06 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:06.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:06 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:06.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:06 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:06.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:06 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:06.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:06 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:06.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:06 smithi106 ceph-mon[46996]: Adjusting osd_memory_target on smithi154 to 5704M 2024-05-10T03:37:06.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:06 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:06.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:06 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:06.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:06 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:37:06.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:06 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:06.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:06 smithi106 ceph-mon[46996]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:37:06.474 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:37:06 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:37:06.120+0000 7f5625edf700 -1 osd.8 0 waiting for initial osdmap 2024-05-10T03:37:06.474 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:37:06 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:37:06.134+0000 7f5621c96700 -1 osd.8 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T03:37:06.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:06 smithi154 ceph-mon[46565]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-10T03:37:06.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:06 smithi154 ceph-mon[46565]: osdmap e55: 9 total, 8 up, 9 in 2024-05-10T03:37:06.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:06 smithi154 ceph-mon[46565]: from='osd.8 [v2:172.21.15.154:6816/1548564532,v1:172.21.15.154:6817/1548564532]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-10T03:37:06.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:06 smithi154 ceph-mon[46565]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-10T03:37:06.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:06 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T03:37:06.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:06 smithi154 ceph-mon[46565]: Detected new or changed devices on smithi154 2024-05-10T03:37:06.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:06 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:06.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:06 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:06.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:06 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:06.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:06 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:06.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:06 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:06.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:06 smithi154 ceph-mon[46565]: Adjusting osd_memory_target on smithi154 to 5704M 2024-05-10T03:37:06.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:06 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:06.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:06 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:06.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:06 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:37:06.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:06 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:06.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:06 smithi154 ceph-mon[46565]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:37:06.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.850+0000 7f4f21145700 1 -- 172.21.15.45:0/3860669712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1c100b80 msgr2=0x7f4f1c100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:37:06.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.850+0000 7f4f21145700 1 --2- 172.21.15.45:0/3860669712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1c100b80 0x7f4f1c100f90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009990 tx=0x7f4f0c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:37:06.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.850+0000 7f4f21145700 1 -- 172.21.15.45:0/3860669712 shutdown_connections 2024-05-10T03:37:06.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.850+0000 7f4f21145700 1 --2- 172.21.15.45:0/3860669712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f1c102650 0x7f4f1c108f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:06.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.850+0000 7f4f21145700 1 --2- 172.21.15.45:0/3860669712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1c100b80 0x7f4f1c100f90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:06.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.850+0000 7f4f21145700 1 --2- 172.21.15.45:0/3860669712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f1c101cb0 0x7f4f1c1020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:06.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.850+0000 7f4f21145700 1 -- 172.21.15.45:0/3860669712 >> 172.21.15.45:0/3860669712 conn(0x7f4f1c0fc1c0 msgr2=0x7f4f1c0fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:37:06.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.850+0000 7f4f21145700 1 -- 172.21.15.45:0/3860669712 shutdown_connections 2024-05-10T03:37:06.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.850+0000 7f4f21145700 1 -- 172.21.15.45:0/3860669712 wait complete. 2024-05-10T03:37:06.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.851+0000 7f4f21145700 1 Processor -- start 2024-05-10T03:37:06.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.852+0000 7f4f21145700 1 -- start start 2024-05-10T03:37:06.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.852+0000 7f4f21145700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f1c100b80 0x7f4f1c1982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:37:06.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.852+0000 7f4f21145700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1c101cb0 0x7f4f1c1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:37:06.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.852+0000 7f4f21145700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f1c102650 0x7f4f1c199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:37:06.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.852+0000 7f4f21145700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c199bf0 con 0x7f4f1c101cb0 2024-05-10T03:37:06.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.852+0000 7f4f21145700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c199d30 con 0x7f4f1c102650 2024-05-10T03:37:06.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.852+0000 7f4f21145700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c199ef0 con 0x7f4f1c100b80 2024-05-10T03:37:06.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.852+0000 7f4f1a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1c101cb0 0x7f4f1c1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:37:06.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.852+0000 7f4f1a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1c101cb0 0x7f4f1c1987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47458/0 (socket says 172.21.15.45:47458) 2024-05-10T03:37:06.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.852+0000 7f4f1a59c700 1 -- 172.21.15.45:0/1148218680 learned_addr learned my addr 172.21.15.45:0/1148218680 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:37:06.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.852+0000 7f4f1b59e700 1 --2- 172.21.15.45:0/1148218680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f1c102650 0x7f4f1c199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:37:06.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.852+0000 7f4f1ad9d700 1 --2- 172.21.15.45:0/1148218680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f1c100b80 0x7f4f1c1982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:37:06.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.852+0000 7f4f1a59c700 1 -- 172.21.15.45:0/1148218680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f1c100b80 msgr2=0x7f4f1c1982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:37:06.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.852+0000 7f4f1a59c700 1 --2- 172.21.15.45:0/1148218680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f1c100b80 0x7f4f1c1982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:06.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.852+0000 7f4f1a59c700 1 -- 172.21.15.45:0/1148218680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f1c102650 msgr2=0x7f4f1c199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:37:06.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.852+0000 7f4f1a59c700 1 --2- 172.21.15.45:0/1148218680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f1c102650 0x7f4f1c199590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:06.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.852+0000 7f4f1a59c700 1 -- 172.21.15.45:0/1148218680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c0095f0 con 0x7f4f1c101cb0 2024-05-10T03:37:06.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.852+0000 7f4f1b59e700 1 --2- 172.21.15.45:0/1148218680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f1c102650 0x7f4f1c199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:37:06.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.853+0000 7f4f1a59c700 1 --2- 172.21.15.45:0/1148218680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1c101cb0 0x7f4f1c1987e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000e9a0 tx=0x7f4f1000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:37:06.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.853+0000 7f4f03fff700 1 -- 172.21.15.45:0/1148218680 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f10009790 con 0x7f4f1c101cb0 2024-05-10T03:37:06.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.853+0000 7f4f21145700 1 -- 172.21.15.45:0/1148218680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f1c19a1d0 con 0x7f4f1c101cb0 2024-05-10T03:37:06.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.853+0000 7f4f03fff700 1 -- 172.21.15.45:0/1148218680 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4f1000cbd0 con 0x7f4f1c101cb0 2024-05-10T03:37:06.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.853+0000 7f4f03fff700 1 -- 172.21.15.45:0/1148218680 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f10018730 con 0x7f4f1c101cb0 2024-05-10T03:37:06.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.853+0000 7f4f21145700 1 -- 172.21.15.45:0/1148218680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f1c1a09b0 con 0x7f4f1c101cb0 2024-05-10T03:37:06.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.854+0000 7f4f21145700 1 -- 172.21.15.45:0/1148218680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1c0ffe80 con 0x7f4f1c101cb0 2024-05-10T03:37:06.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.855+0000 7f4f03fff700 1 -- 172.21.15.45:0/1148218680 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4f10010430 con 0x7f4f1c101cb0 2024-05-10T03:37:06.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.856+0000 7f4f03fff700 1 --2- 172.21.15.45:0/1148218680 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4f040a1120 0x7f4f040a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:37:06.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.856+0000 7f4f03fff700 1 -- 172.21.15.45:0/1148218680 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5549+0+0 (secure 0 0 0) 0x7f4f10014070 con 0x7f4f1c101cb0 2024-05-10T03:37:06.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.856+0000 7f4f1ad9d700 1 --2- 172.21.15.45:0/1148218680 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4f040a1120 0x7f4f040a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:37:06.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.857+0000 7f4f1ad9d700 1 --2- 172.21.15.45:0/1148218680 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4f040a1120 0x7f4f040a3630 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c006010 tx=0x7f4f0c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:37:06.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:06.860+0000 7f4f03fff700 1 -- 172.21.15.45:0/1148218680 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4f10096820 con 0x7f4f1c101cb0 2024-05-10T03:37:07.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:07.083+0000 7f4f21145700 1 -- 172.21.15.45:0/1148218680 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f1c0fe2f0 con 0x7f4f040a1120 2024-05-10T03:37:07.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:07 smithi106 ceph-mon[46996]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-05-10T03:37:07.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:07 smithi106 ceph-mon[46996]: osdmap e56: 9 total, 8 up, 9 in 2024-05-10T03:37:07.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:07 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T03:37:07.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:07 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T03:37:07.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:07 smithi106 ceph-mon[46996]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:37:07.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:07 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:37:07.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:07 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:37:07.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:07 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:07.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:07 smithi154 ceph-mon[46565]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-05-10T03:37:07.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:07 smithi154 ceph-mon[46565]: osdmap e56: 9 total, 8 up, 9 in 2024-05-10T03:37:07.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:07 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T03:37:07.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:07 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T03:37:07.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:07 smithi154 ceph-mon[46565]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:37:07.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:07 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:37:07.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:07 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:37:07.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:07 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:07.493 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:07 smithi045 ceph-mon[42520]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-05-10T03:37:07.494 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:07 smithi045 ceph-mon[42520]: osdmap e56: 9 total, 8 up, 9 in 2024-05-10T03:37:07.494 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:07 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T03:37:07.494 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:07 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T03:37:07.494 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:07 smithi045 ceph-mon[42520]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:37:07.494 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:07 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:37:07.494 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:07 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:37:07.494 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:07 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:08.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:08 smithi106 ceph-mon[46996]: purged_snaps scrub starts 2024-05-10T03:37:08.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:08 smithi106 ceph-mon[46996]: purged_snaps scrub ok 2024-05-10T03:37:08.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:08 smithi106 ceph-mon[46996]: osd.8 [v2:172.21.15.154:6816/1548564532,v1:172.21.15.154:6817/1548564532] boot 2024-05-10T03:37:08.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:08 smithi106 ceph-mon[46996]: osdmap e57: 9 total, 9 up, 9 in 2024-05-10T03:37:08.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:08 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T03:37:08.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:08 smithi106 ceph-mon[46996]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:37:08.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:08 smithi154 ceph-mon[46565]: purged_snaps scrub starts 2024-05-10T03:37:08.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:08 smithi154 ceph-mon[46565]: purged_snaps scrub ok 2024-05-10T03:37:08.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:08 smithi154 ceph-mon[46565]: osd.8 [v2:172.21.15.154:6816/1548564532,v1:172.21.15.154:6817/1548564532] boot 2024-05-10T03:37:08.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:08 smithi154 ceph-mon[46565]: osdmap e57: 9 total, 9 up, 9 in 2024-05-10T03:37:08.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:08 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T03:37:08.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:08 smithi154 ceph-mon[46565]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:37:08.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:08 smithi045 ceph-mon[42520]: purged_snaps scrub starts 2024-05-10T03:37:08.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:08 smithi045 ceph-mon[42520]: purged_snaps scrub ok 2024-05-10T03:37:08.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:08 smithi045 ceph-mon[42520]: osd.8 [v2:172.21.15.154:6816/1548564532,v1:172.21.15.154:6817/1548564532] boot 2024-05-10T03:37:08.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:08 smithi045 ceph-mon[42520]: osdmap e57: 9 total, 9 up, 9 in 2024-05-10T03:37:08.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:08 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T03:37:08.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:08 smithi045 ceph-mon[42520]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-10T03:37:09.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:09 smithi106 ceph-mon[46996]: osdmap e58: 9 total, 9 up, 9 in 2024-05-10T03:37:09.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:09 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2047204145' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc033cd1-677d-4728-b27e-d85b7ad79f7c"}]: dispatch 2024-05-10T03:37:09.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:09 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2047204145' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc033cd1-677d-4728-b27e-d85b7ad79f7c"}]': finished 2024-05-10T03:37:09.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:09 smithi106 ceph-mon[46996]: osdmap e59: 10 total, 9 up, 10 in 2024-05-10T03:37:09.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:09 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T03:37:09.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:09 smithi154 ceph-mon[46565]: osdmap e58: 9 total, 9 up, 9 in 2024-05-10T03:37:09.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:09 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2047204145' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc033cd1-677d-4728-b27e-d85b7ad79f7c"}]: dispatch 2024-05-10T03:37:09.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:09 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2047204145' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc033cd1-677d-4728-b27e-d85b7ad79f7c"}]': finished 2024-05-10T03:37:09.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:09 smithi154 ceph-mon[46565]: osdmap e59: 10 total, 9 up, 10 in 2024-05-10T03:37:09.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:09 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T03:37:09.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:09 smithi045 ceph-mon[42520]: osdmap e58: 9 total, 9 up, 9 in 2024-05-10T03:37:09.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:09 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2047204145' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc033cd1-677d-4728-b27e-d85b7ad79f7c"}]: dispatch 2024-05-10T03:37:09.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:09 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2047204145' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc033cd1-677d-4728-b27e-d85b7ad79f7c"}]': finished 2024-05-10T03:37:09.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:09 smithi045 ceph-mon[42520]: osdmap e59: 10 total, 9 up, 10 in 2024-05-10T03:37:09.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:09 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T03:37:10.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:10 smithi106 ceph-mon[46996]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-10T03:37:10.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:10 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2564324727' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:37:10.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:10 smithi154 ceph-mon[46565]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-10T03:37:10.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:10 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2564324727' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:37:10.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:10 smithi045 ceph-mon[42520]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-05-10T03:37:10.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:10 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2564324727' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:37:11.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:11 smithi106 ceph-mon[46996]: osdmap e60: 10 total, 9 up, 10 in 2024-05-10T03:37:11.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:11 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T03:37:11.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:11 smithi154 ceph-mon[46565]: osdmap e60: 10 total, 9 up, 10 in 2024-05-10T03:37:11.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:11 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T03:37:11.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:11 smithi045 ceph-mon[42520]: osdmap e60: 10 total, 9 up, 10 in 2024-05-10T03:37:11.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:11 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T03:37:12.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:12 smithi154 ceph-mon[46565]: osdmap e61: 10 total, 9 up, 10 in 2024-05-10T03:37:12.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T03:37:12.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:12 smithi154 ceph-mon[46565]: pgmap v164: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-10T03:37:12.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:12 smithi045 ceph-mon[42520]: osdmap e61: 10 total, 9 up, 10 in 2024-05-10T03:37:12.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T03:37:12.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:12 smithi045 ceph-mon[42520]: pgmap v164: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-10T03:37:12.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:12 smithi106 ceph-mon[46996]: osdmap e61: 10 total, 9 up, 10 in 2024-05-10T03:37:12.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T03:37:12.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:12 smithi106 ceph-mon[46996]: pgmap v164: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-10T03:37:15.149 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:14 smithi045 ceph-mon[42520]: pgmap v165: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-05-10T03:37:15.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:14 smithi154 ceph-mon[46565]: pgmap v165: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-05-10T03:37:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:14 smithi106 ceph-mon[46996]: pgmap v165: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-05-10T03:37:16.194 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:15 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-10T03:37:16.194 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:15 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:16.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:15 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-10T03:37:16.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:15 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:16.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:15 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-10T03:37:16.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:15 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:17.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:16 smithi154 ceph-mon[46565]: Deploying daemon osd.9 on smithi045 2024-05-10T03:37:17.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:16 smithi154 ceph-mon[46565]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-05-10T03:37:17.227 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:16 smithi045 ceph-mon[42520]: Deploying daemon osd.9 on smithi045 2024-05-10T03:37:17.227 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:16 smithi045 ceph-mon[42520]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-05-10T03:37:17.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:16 smithi106 ceph-mon[46996]: Deploying daemon osd.9 on smithi045 2024-05-10T03:37:17.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:16 smithi106 ceph-mon[46996]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-05-10T03:37:19.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:18 smithi154 ceph-mon[46565]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-10T03:37:19.289 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:18 smithi045 ceph-mon[42520]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-10T03:37:19.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:18 smithi106 ceph-mon[46996]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-10T03:37:20.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:20 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:20.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:20 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:20.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:20 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:37:20.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:20 smithi106 ceph-mon[46996]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-05-10T03:37:20.913 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:20 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:20.913 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:20 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:20.913 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:20 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:37:20.913 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:20 smithi045 ceph-mon[42520]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-05-10T03:37:20.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:20 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:20.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:20 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:20.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:20 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:37:20.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:20 smithi154 ceph-mon[46565]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-05-10T03:37:21.985 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:21.981+0000 7f4f03fff700 1 -- 172.21.15.45:0/1148218680 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4f1c0fe2f0 con 0x7f4f040a1120 2024-05-10T03:37:21.985 INFO:teuthology.orchestra.run.smithi045.stdout:Created osd(s) 9 on host 'smithi045' 2024-05-10T03:37:21.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:21.985+0000 7f4f21145700 1 -- 172.21.15.45:0/1148218680 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4f040a1120 msgr2=0x7f4f040a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:37:21.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:21.985+0000 7f4f21145700 1 --2- 172.21.15.45:0/1148218680 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4f040a1120 0x7f4f040a3630 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c006010 tx=0x7f4f0c01a040 comp rx=0 tx=0).stop 2024-05-10T03:37:21.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:21.985+0000 7f4f21145700 1 -- 172.21.15.45:0/1148218680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1c101cb0 msgr2=0x7f4f1c1987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:37:21.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:21.985+0000 7f4f21145700 1 --2- 172.21.15.45:0/1148218680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1c101cb0 0x7f4f1c1987e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000e9a0 tx=0x7f4f1000ed60 comp rx=0 tx=0).stop 2024-05-10T03:37:21.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:21.985+0000 7f4f21145700 1 -- 172.21.15.45:0/1148218680 shutdown_connections 2024-05-10T03:37:21.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:21.985+0000 7f4f21145700 1 --2- 172.21.15.45:0/1148218680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f1c100b80 0x7f4f1c1982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:21.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:21.985+0000 7f4f21145700 1 --2- 172.21.15.45:0/1148218680 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4f040a1120 0x7f4f040a3630 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:21.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:21.985+0000 7f4f21145700 1 --2- 172.21.15.45:0/1148218680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f1c102650 0x7f4f1c199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:21.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:21.985+0000 7f4f21145700 1 --2- 172.21.15.45:0/1148218680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1c101cb0 0x7f4f1c1987e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:21.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:21.985+0000 7f4f21145700 1 -- 172.21.15.45:0/1148218680 >> 172.21.15.45:0/1148218680 conn(0x7f4f1c0fc1c0 msgr2=0x7f4f1c0fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:37:21.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:21.985+0000 7f4f21145700 1 -- 172.21.15.45:0/1148218680 shutdown_connections 2024-05-10T03:37:21.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:21.985+0000 7f4f21145700 1 -- 172.21.15.45:0/1148218680 wait complete. 2024-05-10T03:37:22.375 DEBUG:teuthology.orchestra.run.smithi045:osd.9> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.9.service 2024-05-10T03:37:22.377 INFO:tasks.cephadm:Deploying osd.10 on smithi106 with /dev/vg_nvme/lv_1... 2024-05-10T03:37:22.377 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-10T03:37:22.417 INFO:journalctl@ceph.osd.9.smithi045.stdout:-- Logs begin at Fri 2024-05-10 03:15:08 UTC. -- 2024-05-10T03:37:22.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:22 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:22.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:22 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:22.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:22 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:22.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:22 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:37:22.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:22 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:22.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:22 smithi154 ceph-mon[46565]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-05-10T03:37:22.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:22 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:22.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:22 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:22.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:22 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:37:22.510 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:22 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:22.510 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:22 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:22.510 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:22 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:22.510 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:22 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:37:22.510 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:22 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:22.510 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:22 smithi045 ceph-mon[42520]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-05-10T03:37:22.510 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:22 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:22.510 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:22 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:22.510 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:22 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:37:22.608 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.b/config 2024-05-10T03:37:22.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:22 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:22.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:22 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:22.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:22 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:22.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:22 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:37:22.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:22 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:22.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:22 smithi106 ceph-mon[46996]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-05-10T03:37:22.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:22 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:22.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:22 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:22.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:22 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:37:23.882 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-10T03:37:23.883 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-10T03:37:23.883 INFO:teuthology.orchestra.run.smithi106.stderr: stderr: 10+0 records in 2024-05-10T03:37:23.883 INFO:teuthology.orchestra.run.smithi106.stderr:10+0 records out 2024-05-10T03:37:23.883 INFO:teuthology.orchestra.run.smithi106.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114373 s, 917 MB/s 2024-05-10T03:37:23.883 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping successful for: 2024-05-10T03:37:23.919 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:23 smithi106 ceph-mon[46996]: from='osd.9 [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-10T03:37:23.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:23 smithi154 ceph-mon[46565]: from='osd.9 [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-10T03:37:24.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:23 smithi045 ceph-mon[42520]: from='osd.9 [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-10T03:37:24.035 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:37:23 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:37:23.591+0000 7f739024e7c0 -1 osd.9 0 log_to_monitors true 2024-05-10T03:37:24.469 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi106:vg_nvme/lv_1 2024-05-10T03:37:24.690 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.b/config 2024-05-10T03:37:24.797 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:24 smithi106 ceph-mon[46996]: from='osd.9 [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-10T03:37:24.797 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:24 smithi106 ceph-mon[46996]: osdmap e62: 10 total, 9 up, 10 in 2024-05-10T03:37:24.797 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:24 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T03:37:24.797 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:24 smithi106 ceph-mon[46996]: from='osd.9 [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-05-10T03:37:24.798 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:24 smithi106 ceph-mon[46996]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-05-10T03:37:24.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:24 smithi154 ceph-mon[46565]: from='osd.9 [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-10T03:37:24.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:24 smithi154 ceph-mon[46565]: osdmap e62: 10 total, 9 up, 10 in 2024-05-10T03:37:24.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:24 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T03:37:24.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:24 smithi154 ceph-mon[46565]: from='osd.9 [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-05-10T03:37:24.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:24 smithi154 ceph-mon[46565]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-05-10T03:37:25.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:24 smithi045 ceph-mon[42520]: from='osd.9 [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-10T03:37:25.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:24 smithi045 ceph-mon[42520]: osdmap e62: 10 total, 9 up, 10 in 2024-05-10T03:37:25.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:24 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T03:37:25.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:24 smithi045 ceph-mon[42520]: from='osd.9 [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-05-10T03:37:25.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:24 smithi045 ceph-mon[42520]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-05-10T03:37:25.662 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:37:25 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:37:25.293+0000 7f73860b3700 -1 osd.9 0 waiting for initial osdmap 2024-05-10T03:37:25.662 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:37:25 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:37:25.309+0000 7f737d661700 -1 osd.9 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T03:37:25.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.682+0000 7f9a27578700 1 -- 172.21.15.106:0/3974168125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a20100bb0 msgr2=0x7f9a20100fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:37:25.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.682+0000 7f9a27578700 1 --2- 172.21.15.106:0/3974168125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a20100bb0 0x7f9a20100fc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c009990 tx=0x7f9a1c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:37:25.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.682+0000 7f9a27578700 1 -- 172.21.15.106:0/3974168125 shutdown_connections 2024-05-10T03:37:25.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.682+0000 7f9a27578700 1 --2- 172.21.15.106:0/3974168125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a20102680 0x7f9a20108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:25.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.682+0000 7f9a27578700 1 --2- 172.21.15.106:0/3974168125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a20100bb0 0x7f9a20100fc0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:25.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.682+0000 7f9a27578700 1 --2- 172.21.15.106:0/3974168125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a20101ce0 0x7f9a201020f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:25.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.682+0000 7f9a27578700 1 -- 172.21.15.106:0/3974168125 >> 172.21.15.106:0/3974168125 conn(0x7f9a200fc210 msgr2=0x7f9a200fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:37:25.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.682+0000 7f9a27578700 1 -- 172.21.15.106:0/3974168125 shutdown_connections 2024-05-10T03:37:25.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.682+0000 7f9a27578700 1 -- 172.21.15.106:0/3974168125 wait complete. 2024-05-10T03:37:25.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.683+0000 7f9a27578700 1 Processor -- start 2024-05-10T03:37:25.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.683+0000 7f9a27578700 1 -- start start 2024-05-10T03:37:25.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.683+0000 7f9a27578700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a20100bb0 0x7f9a20197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:37:25.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.683+0000 7f9a27578700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a20101ce0 0x7f9a201975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:37:25.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.683+0000 7f9a27578700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a20102680 0x7f9a20198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:37:25.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.683+0000 7f9a27578700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a20198950 con 0x7f9a20101ce0 2024-05-10T03:37:25.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.683+0000 7f9a27578700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a20198a90 con 0x7f9a20100bb0 2024-05-10T03:37:25.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.683+0000 7f9a27578700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a20198c50 con 0x7f9a20102680 2024-05-10T03:37:25.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.683+0000 7f9a25314700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a20100bb0 0x7f9a20197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:37:25.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.683+0000 7f9a25314700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a20100bb0 0x7f9a20197090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50120/0 (socket says 172.21.15.106:50120) 2024-05-10T03:37:25.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.683+0000 7f9a25314700 1 -- 172.21.15.106:0/507230370 learned_addr learned my addr 172.21.15.106:0/507230370 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-05-10T03:37:25.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.684+0000 7f9a25b15700 1 --2- 172.21.15.106:0/507230370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a20102680 0x7f9a20198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:37:25.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.684+0000 7f9a24b13700 1 --2- 172.21.15.106:0/507230370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a20101ce0 0x7f9a201975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:37:25.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.684+0000 7f9a25314700 1 -- 172.21.15.106:0/507230370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a20102680 msgr2=0x7f9a20198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:37:25.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.684+0000 7f9a25314700 1 --2- 172.21.15.106:0/507230370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a20102680 0x7f9a20198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:25.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.684+0000 7f9a25314700 1 -- 172.21.15.106:0/507230370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a20101ce0 msgr2=0x7f9a201975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:37:25.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.684+0000 7f9a25314700 1 --2- 172.21.15.106:0/507230370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a20101ce0 0x7f9a201975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:25.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.684+0000 7f9a25314700 1 -- 172.21.15.106:0/507230370 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c0095f0 con 0x7f9a20100bb0 2024-05-10T03:37:25.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.684+0000 7f9a24b13700 1 --2- 172.21.15.106:0/507230370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a20101ce0 0x7f9a201975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:37:25.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.684+0000 7f9a25314700 1 --2- 172.21.15.106:0/507230370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a20100bb0 0x7f9a20197090 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c000c00 tx=0x7f9a1c00f740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:37:25.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.684+0000 7f9a167fc700 1 -- 172.21.15.106:0/507230370 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c01d070 con 0x7f9a20100bb0 2024-05-10T03:37:25.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.684+0000 7f9a167fc700 1 -- 172.21.15.106:0/507230370 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9a1c005530 con 0x7f9a20100bb0 2024-05-10T03:37:25.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.684+0000 7f9a27578700 1 -- 172.21.15.106:0/507230370 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a20198ed0 con 0x7f9a20100bb0 2024-05-10T03:37:25.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.684+0000 7f9a167fc700 1 -- 172.21.15.106:0/507230370 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c004c20 con 0x7f9a20100bb0 2024-05-10T03:37:25.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.684+0000 7f9a27578700 1 -- 172.21.15.106:0/507230370 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2019f5d0 con 0x7f9a20100bb0 2024-05-10T03:37:25.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.685+0000 7f9a27578700 1 -- 172.21.15.106:0/507230370 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a20107dd0 con 0x7f9a20100bb0 2024-05-10T03:37:25.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.686+0000 7f9a167fc700 1 -- 172.21.15.106:0/507230370 <== mon.2 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9a1c005050 con 0x7f9a20100bb0 2024-05-10T03:37:25.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.687+0000 7f9a167fc700 1 --2- 172.21.15.106:0/507230370 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9a0c0a1120 0x7f9a0c0a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:37:25.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.687+0000 7f9a167fc700 1 -- 172.21.15.106:0/507230370 <== mon.2 v2:172.21.15.106:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5981+0+0 (secure 0 0 0) 0x7f9a1c0cd3d0 con 0x7f9a20100bb0 2024-05-10T03:37:25.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.687+0000 7f9a24b13700 1 --2- 172.21.15.106:0/507230370 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9a0c0a1120 0x7f9a0c0a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:37:25.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.688+0000 7f9a24b13700 1 --2- 172.21.15.106:0/507230370 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9a0c0a1120 0x7f9a0c0a3630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9a10005fd0 tx=0x7f9a10005e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:37:25.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.691+0000 7f9a167fc700 1 -- 172.21.15.106:0/507230370 <== mon.2 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9a1c097510 con 0x7f9a20100bb0 2024-05-10T03:37:25.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:25.893+0000 7f9a27578700 1 -- 172.21.15.106:0/507230370 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a2010c740 con 0x7f9a0c0a1120 2024-05-10T03:37:25.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:25 smithi106 ceph-mon[46996]: from='osd.9 [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-05-10T03:37:25.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:25 smithi106 ceph-mon[46996]: osdmap e63: 10 total, 9 up, 10 in 2024-05-10T03:37:25.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:25 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T03:37:25.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:25 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T03:37:25.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:25 smithi106 ceph-mon[46996]: Detected new or changed devices on smithi045 2024-05-10T03:37:25.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:25 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:25.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:25 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:25.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:25 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:25.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:25 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:25.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:25 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:25.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:25 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:25.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:25 smithi106 ceph-mon[46996]: Adjusting osd_memory_target on smithi045 to 4279M 2024-05-10T03:37:25.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:25 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:25.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:25 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:25.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:25 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:37:25.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:25 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:25.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:25 smithi106 ceph-mon[46996]: from='osd.9 [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087]' entity='osd.9' 2024-05-10T03:37:25.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:25 smithi154 ceph-mon[46565]: from='osd.9 [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-05-10T03:37:25.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:25 smithi154 ceph-mon[46565]: osdmap e63: 10 total, 9 up, 10 in 2024-05-10T03:37:25.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:25 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T03:37:25.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:25 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T03:37:25.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:25 smithi154 ceph-mon[46565]: Detected new or changed devices on smithi045 2024-05-10T03:37:25.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:25 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:25.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:25 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:25.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:25 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:25.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:25 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:25.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:25 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:25.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:25 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:25.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:25 smithi154 ceph-mon[46565]: Adjusting osd_memory_target on smithi045 to 4279M 2024-05-10T03:37:25.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:25 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:25.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:25 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:25.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:25 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:37:25.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:25 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:25.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:25 smithi154 ceph-mon[46565]: from='osd.9 [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087]' entity='osd.9' 2024-05-10T03:37:26.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:25 smithi045 ceph-mon[42520]: from='osd.9 [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-05-10T03:37:26.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:25 smithi045 ceph-mon[42520]: osdmap e63: 10 total, 9 up, 10 in 2024-05-10T03:37:26.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T03:37:26.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T03:37:26.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:25 smithi045 ceph-mon[42520]: Detected new or changed devices on smithi045 2024-05-10T03:37:26.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:26.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:26.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:26.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:26.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:26.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:26.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:25 smithi045 ceph-mon[42520]: Adjusting osd_memory_target on smithi045 to 4279M 2024-05-10T03:37:26.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:26.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:26.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:37:26.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:25 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:26.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:25 smithi045 ceph-mon[42520]: from='osd.9 [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087]' entity='osd.9' 2024-05-10T03:37:26.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:26 smithi106 ceph-mon[46996]: purged_snaps scrub starts 2024-05-10T03:37:26.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:26 smithi106 ceph-mon[46996]: purged_snaps scrub ok 2024-05-10T03:37:26.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T03:37:26.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:26 smithi106 ceph-mon[46996]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-05-10T03:37:26.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:26 smithi106 ceph-mon[46996]: from='client.24395 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:37:26.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:37:26.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:37:26.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:26.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:26 smithi106 ceph-mon[46996]: osd.9 [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087] boot 2024-05-10T03:37:26.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:26 smithi106 ceph-mon[46996]: osdmap e64: 10 total, 10 up, 10 in 2024-05-10T03:37:26.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T03:37:26.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:26 smithi154 ceph-mon[46565]: purged_snaps scrub starts 2024-05-10T03:37:26.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:26 smithi154 ceph-mon[46565]: purged_snaps scrub ok 2024-05-10T03:37:26.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T03:37:26.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:26 smithi154 ceph-mon[46565]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-05-10T03:37:26.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:26 smithi154 ceph-mon[46565]: from='client.24395 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:37:26.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:37:26.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:37:26.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:26.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:26 smithi154 ceph-mon[46565]: osd.9 [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087] boot 2024-05-10T03:37:26.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:26 smithi154 ceph-mon[46565]: osdmap e64: 10 total, 10 up, 10 in 2024-05-10T03:37:26.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T03:37:27.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:26 smithi045 ceph-mon[42520]: purged_snaps scrub starts 2024-05-10T03:37:27.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:26 smithi045 ceph-mon[42520]: purged_snaps scrub ok 2024-05-10T03:37:27.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T03:37:27.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:26 smithi045 ceph-mon[42520]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-05-10T03:37:27.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:26 smithi045 ceph-mon[42520]: from='client.24395 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:37:27.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:37:27.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:37:27.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:27.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:26 smithi045 ceph-mon[42520]: osd.9 [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087] boot 2024-05-10T03:37:27.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:26 smithi045 ceph-mon[42520]: osdmap e64: 10 total, 10 up, 10 in 2024-05-10T03:37:27.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T03:37:28.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:28 smithi106 ceph-mon[46996]: osdmap e65: 10 total, 10 up, 10 in 2024-05-10T03:37:28.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:28 smithi106 ceph-mon[46996]: from='client.? 172.21.15.106:0/976953036' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12f8e54b-8eb1-4410-8df7-c8ab651f3e02"}]: dispatch 2024-05-10T03:37:28.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:28 smithi106 ceph-mon[46996]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12f8e54b-8eb1-4410-8df7-c8ab651f3e02"}]: dispatch 2024-05-10T03:37:28.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:28 smithi106 ceph-mon[46996]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12f8e54b-8eb1-4410-8df7-c8ab651f3e02"}]': finished 2024-05-10T03:37:28.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:28 smithi106 ceph-mon[46996]: osdmap e66: 11 total, 10 up, 11 in 2024-05-10T03:37:28.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:28 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T03:37:28.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:28 smithi106 ceph-mon[46996]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:28.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:28 smithi154 ceph-mon[46565]: osdmap e65: 10 total, 10 up, 10 in 2024-05-10T03:37:28.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:28 smithi154 ceph-mon[46565]: from='client.? 172.21.15.106:0/976953036' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12f8e54b-8eb1-4410-8df7-c8ab651f3e02"}]: dispatch 2024-05-10T03:37:28.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:28 smithi154 ceph-mon[46565]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12f8e54b-8eb1-4410-8df7-c8ab651f3e02"}]: dispatch 2024-05-10T03:37:28.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:28 smithi154 ceph-mon[46565]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12f8e54b-8eb1-4410-8df7-c8ab651f3e02"}]': finished 2024-05-10T03:37:28.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:28 smithi154 ceph-mon[46565]: osdmap e66: 11 total, 10 up, 11 in 2024-05-10T03:37:28.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:28 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T03:37:28.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:28 smithi154 ceph-mon[46565]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:28.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:28 smithi045 ceph-mon[42520]: osdmap e65: 10 total, 10 up, 10 in 2024-05-10T03:37:28.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:28 smithi045 ceph-mon[42520]: from='client.? 172.21.15.106:0/976953036' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12f8e54b-8eb1-4410-8df7-c8ab651f3e02"}]: dispatch 2024-05-10T03:37:28.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:28 smithi045 ceph-mon[42520]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12f8e54b-8eb1-4410-8df7-c8ab651f3e02"}]: dispatch 2024-05-10T03:37:28.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:28 smithi045 ceph-mon[42520]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12f8e54b-8eb1-4410-8df7-c8ab651f3e02"}]': finished 2024-05-10T03:37:28.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:28 smithi045 ceph-mon[42520]: osdmap e66: 11 total, 10 up, 11 in 2024-05-10T03:37:28.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:28 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T03:37:28.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:28 smithi045 ceph-mon[42520]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:29.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:29 smithi106 ceph-mon[46996]: from='client.? 172.21.15.106:0/4073057697' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:37:29.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:29 smithi154 ceph-mon[46565]: from='client.? 172.21.15.106:0/4073057697' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:37:29.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:29 smithi045 ceph-mon[42520]: from='client.? 172.21.15.106:0/4073057697' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:37:30.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:30 smithi106 ceph-mon[46996]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:30.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:30 smithi154 ceph-mon[46565]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:30.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:30 smithi045 ceph-mon[42520]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:33.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:32 smithi106 ceph-mon[46996]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:33.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:32 smithi154 ceph-mon[46565]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:33.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:32 smithi045 ceph-mon[42520]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:34.219 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:33 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-10T03:37:34.219 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:33 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:34.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:33 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-10T03:37:34.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:33 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:34.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:33 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-10T03:37:34.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:33 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:35.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:34 smithi106 ceph-mon[46996]: Deploying daemon osd.10 on smithi106 2024-05-10T03:37:35.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:34 smithi106 ceph-mon[46996]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:35.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:34 smithi154 ceph-mon[46565]: Deploying daemon osd.10 on smithi106 2024-05-10T03:37:35.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:34 smithi154 ceph-mon[46565]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:35.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:34 smithi045 ceph-mon[42520]: Deploying daemon osd.10 on smithi106 2024-05-10T03:37:35.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:34 smithi045 ceph-mon[42520]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:37.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:36 smithi106 ceph-mon[46996]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:37.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:36 smithi154 ceph-mon[46565]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:37.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:36 smithi045 ceph-mon[42520]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:38.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:38 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:38.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:38 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:38.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:38 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:37:38.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:38 smithi106 ceph-mon[46996]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:38.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:38 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:38.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:38 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:38.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:38 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:37:38.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:38 smithi154 ceph-mon[46565]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:38.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:38 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:38.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:38 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:38.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:38 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:37:38.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:38 smithi045 ceph-mon[42520]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:39.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:39.849+0000 7f9a167fc700 1 -- 172.21.15.106:0/507230370 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f9a2010c740 con 0x7f9a0c0a1120 2024-05-10T03:37:39.853 INFO:teuthology.orchestra.run.smithi106.stdout:Created osd(s) 10 on host 'smithi106' 2024-05-10T03:37:39.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:39.851+0000 7f9a27578700 1 -- 172.21.15.106:0/507230370 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9a0c0a1120 msgr2=0x7f9a0c0a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:37:39.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:39.851+0000 7f9a27578700 1 --2- 172.21.15.106:0/507230370 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9a0c0a1120 0x7f9a0c0a3630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9a10005fd0 tx=0x7f9a10005e40 comp rx=0 tx=0).stop 2024-05-10T03:37:39.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:39.851+0000 7f9a27578700 1 -- 172.21.15.106:0/507230370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a20100bb0 msgr2=0x7f9a20197090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:37:39.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:39.851+0000 7f9a27578700 1 --2- 172.21.15.106:0/507230370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a20100bb0 0x7f9a20197090 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c000c00 tx=0x7f9a1c00f740 comp rx=0 tx=0).stop 2024-05-10T03:37:39.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:39.851+0000 7f9a27578700 1 -- 172.21.15.106:0/507230370 shutdown_connections 2024-05-10T03:37:39.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:39.851+0000 7f9a27578700 1 --2- 172.21.15.106:0/507230370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a20102680 0x7f9a20198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:39.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:39.852+0000 7f9a27578700 1 --2- 172.21.15.106:0/507230370 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9a0c0a1120 0x7f9a0c0a3630 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:39.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:39.852+0000 7f9a27578700 1 --2- 172.21.15.106:0/507230370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a20100bb0 0x7f9a20197090 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:39.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:39.852+0000 7f9a27578700 1 --2- 172.21.15.106:0/507230370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a20101ce0 0x7f9a201975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:39.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:39.852+0000 7f9a27578700 1 -- 172.21.15.106:0/507230370 >> 172.21.15.106:0/507230370 conn(0x7f9a200fc210 msgr2=0x7f9a20104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:37:39.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:39.852+0000 7f9a27578700 1 -- 172.21.15.106:0/507230370 shutdown_connections 2024-05-10T03:37:39.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-10T03:37:39.852+0000 7f9a27578700 1 -- 172.21.15.106:0/507230370 wait complete. 2024-05-10T03:37:40.044 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:39 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:40.044 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:39 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:40.044 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:39 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:40.044 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:39 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:37:40.044 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:39 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:40.044 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:39 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:40.045 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:39 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:37:40.045 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:39 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:40.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:39 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:40.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:39 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:40.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:39 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:40.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:39 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:37:40.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:39 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:40.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:39 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:40.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:39 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:37:40.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:39 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:40.262 DEBUG:teuthology.orchestra.run.smithi106:osd.10> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.10.service 2024-05-10T03:37:40.264 INFO:tasks.cephadm:Deploying osd.11 on smithi154 with /dev/vg_nvme/lv_1... 2024-05-10T03:37:40.265 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-10T03:37:40.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:39 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:40.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:39 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:40.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:39 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:40.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:39 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:37:40.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:39 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:40.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:39 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:40.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:39 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:37:40.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:39 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:40.294 INFO:journalctl@ceph.osd.10.smithi106.stdout:-- Logs begin at Fri 2024-05-10 03:15:26 UTC. -- 2024-05-10T03:37:40.499 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T03:37:40.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:40 smithi154 ceph-mon[46565]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:41.037 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:40 smithi106 ceph-mon[46996]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:41.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:40 smithi045 ceph-mon[42520]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:41.846 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:37:41 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:37:41.482+0000 7fb62de1f7c0 -1 osd.10 0 log_to_monitors true 2024-05-10T03:37:41.846 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:41 smithi106 ceph-mon[46996]: from='osd.10 [v2:172.21.15.106:6824/2680590999,v1:172.21.15.106:6825/2680590999]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-10T03:37:41.846 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:41 smithi106 ceph-mon[46996]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-10T03:37:41.955 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-10T03:37:41.955 INFO:teuthology.orchestra.run.smithi154.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-10T03:37:41.955 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10+0 records in 2024-05-10T03:37:41.955 INFO:teuthology.orchestra.run.smithi154.stderr:10+0 records out 2024-05-10T03:37:41.955 INFO:teuthology.orchestra.run.smithi154.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.01114 s, 941 MB/s 2024-05-10T03:37:41.955 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 2024-05-10T03:37:41.956 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping successful for: 2024-05-10T03:37:42.146 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:41 smithi154 ceph-mon[46565]: from='osd.10 [v2:172.21.15.106:6824/2680590999,v1:172.21.15.106:6825/2680590999]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-10T03:37:42.146 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:41 smithi154 ceph-mon[46565]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-10T03:37:42.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:41 smithi045 ceph-mon[42520]: from='osd.10 [v2:172.21.15.106:6824/2680590999,v1:172.21.15.106:6825/2680590999]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-10T03:37:42.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:41 smithi045 ceph-mon[42520]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-10T03:37:42.309 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_1 2024-05-10T03:37:42.532 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T03:37:42.962 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:42 smithi154 ceph-mon[46565]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-10T03:37:42.963 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:42 smithi154 ceph-mon[46565]: osdmap e67: 11 total, 10 up, 11 in 2024-05-10T03:37:42.963 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:42 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T03:37:42.963 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:42 smithi154 ceph-mon[46565]: from='osd.10 [v2:172.21.15.106:6824/2680590999,v1:172.21.15.106:6825/2680590999]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-10T03:37:42.963 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:42 smithi154 ceph-mon[46565]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-10T03:37:42.963 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:42 smithi154 ceph-mon[46565]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:42.963 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:42 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:42.963 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:42 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:42.963 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:42 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:42.963 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:42 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:42.963 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:42 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:42.963 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:42 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:42.963 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:42 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:42.963 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:42 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:42.964 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:42 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:37:42.964 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:42 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:43.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:37:42 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:37:42.858+0000 7fb623483700 -1 osd.10 0 waiting for initial osdmap 2024-05-10T03:37:43.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:37:42 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:37:42.874+0000 7fb61f23a700 -1 osd.10 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T03:37:43.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:42 smithi106 ceph-mon[46996]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-10T03:37:43.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:42 smithi106 ceph-mon[46996]: osdmap e67: 11 total, 10 up, 11 in 2024-05-10T03:37:43.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:42 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T03:37:43.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:42 smithi106 ceph-mon[46996]: from='osd.10 [v2:172.21.15.106:6824/2680590999,v1:172.21.15.106:6825/2680590999]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-10T03:37:43.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:42 smithi106 ceph-mon[46996]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-10T03:37:43.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:42 smithi106 ceph-mon[46996]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:43.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:42 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:43.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:42 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:43.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:42 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:43.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:42 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:43.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:42 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:43.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:42 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:43.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:42 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:43.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:42 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:43.153 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:42 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:37:43.153 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:42 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:43.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:42 smithi045 ceph-mon[42520]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-10T03:37:43.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:42 smithi045 ceph-mon[42520]: osdmap e67: 11 total, 10 up, 11 in 2024-05-10T03:37:43.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:42 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T03:37:43.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:42 smithi045 ceph-mon[42520]: from='osd.10 [v2:172.21.15.106:6824/2680590999,v1:172.21.15.106:6825/2680590999]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-10T03:37:43.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:42 smithi045 ceph-mon[42520]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2024-05-10T03:37:43.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:42 smithi045 ceph-mon[42520]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:43.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:42 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:43.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:42 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:43.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:42 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:43.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:42 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:43.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:42 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:43.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:42 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:37:43.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:42 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:43.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:42 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:43.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:42 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:37:43.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:42 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:43.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.522+0000 7f6d7726c700 1 -- 172.21.15.154:0/403861378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d70100b80 msgr2=0x7f6d70100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:37:43.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.522+0000 7f6d7726c700 1 --2- 172.21.15.154:0/403861378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d70100b80 0x7f6d70100f90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c009990 tx=0x7f6d6c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:37:43.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.522+0000 7f6d7726c700 1 -- 172.21.15.154:0/403861378 shutdown_connections 2024-05-10T03:37:43.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.522+0000 7f6d7726c700 1 --2- 172.21.15.154:0/403861378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d70100b80 0x7f6d70100f90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:43.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.522+0000 7f6d7726c700 1 --2- 172.21.15.154:0/403861378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d70102650 0x7f6d70108f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:43.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.522+0000 7f6d7726c700 1 --2- 172.21.15.154:0/403861378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d70101cb0 0x7f6d701020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:43.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.522+0000 7f6d7726c700 1 -- 172.21.15.154:0/403861378 >> 172.21.15.154:0/403861378 conn(0x7f6d700fc1c0 msgr2=0x7f6d700fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:37:43.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.522+0000 7f6d7726c700 1 -- 172.21.15.154:0/403861378 shutdown_connections 2024-05-10T03:37:43.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.522+0000 7f6d7726c700 1 -- 172.21.15.154:0/403861378 wait complete. 2024-05-10T03:37:43.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.523+0000 7f6d7726c700 1 Processor -- start 2024-05-10T03:37:43.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.523+0000 7f6d7726c700 1 -- start start 2024-05-10T03:37:43.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.523+0000 7f6d7726c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d70100b80 0x7f6d7019aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:37:43.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.523+0000 7f6d7726c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d70101cb0 0x7f6d7019d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:37:43.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.523+0000 7f6d7726c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d70102650 0x7f6d7019f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:37:43.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.523+0000 7f6d7726c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7019fe90 con 0x7f6d70100b80 2024-05-10T03:37:43.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.523+0000 7f6d7726c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7019ffd0 con 0x7f6d70102650 2024-05-10T03:37:43.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.523+0000 7f6d7726c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d701a0110 con 0x7f6d70101cb0 2024-05-10T03:37:43.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.523+0000 7f6d74807700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d70101cb0 0x7f6d7019d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:37:43.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.523+0000 7f6d74807700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d70101cb0 0x7f6d7019d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39772/0 (socket says 172.21.15.154:39772) 2024-05-10T03:37:43.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.523+0000 7f6d74807700 1 -- 172.21.15.154:0/1911721689 learned_addr learned my addr 172.21.15.154:0/1911721689 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-10T03:37:43.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.523+0000 7f6d75809700 1 --2- 172.21.15.154:0/1911721689 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d70102650 0x7f6d7019f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:37:43.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.523+0000 7f6d75008700 1 --2- 172.21.15.154:0/1911721689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d70100b80 0x7f6d7019aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:37:43.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.523+0000 7f6d74807700 1 -- 172.21.15.154:0/1911721689 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d70102650 msgr2=0x7f6d7019f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:37:43.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.523+0000 7f6d74807700 1 --2- 172.21.15.154:0/1911721689 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d70102650 0x7f6d7019f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:43.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.523+0000 7f6d74807700 1 -- 172.21.15.154:0/1911721689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d70100b80 msgr2=0x7f6d7019aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:37:43.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.523+0000 7f6d74807700 1 --2- 172.21.15.154:0/1911721689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d70100b80 0x7f6d7019aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:43.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.523+0000 7f6d74807700 1 -- 172.21.15.154:0/1911721689 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c0095f0 con 0x7f6d70101cb0 2024-05-10T03:37:43.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.523+0000 7f6d75809700 1 --2- 172.21.15.154:0/1911721689 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d70102650 0x7f6d7019f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:37:43.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.524+0000 7f6d74807700 1 --2- 172.21.15.154:0/1911721689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d70101cb0 0x7f6d7019d400 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000c920 tx=0x7f6d6000cce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:37:43.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.524+0000 7f6d667fc700 1 -- 172.21.15.154:0/1911721689 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d60007b00 con 0x7f6d70101cb0 2024-05-10T03:37:43.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.524+0000 7f6d667fc700 1 -- 172.21.15.154:0/1911721689 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6d60004d10 con 0x7f6d70101cb0 2024-05-10T03:37:43.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.524+0000 7f6d7726c700 1 -- 172.21.15.154:0/1911721689 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d701a0370 con 0x7f6d70101cb0 2024-05-10T03:37:43.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.524+0000 7f6d667fc700 1 -- 172.21.15.154:0/1911721689 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d60005660 con 0x7f6d70101cb0 2024-05-10T03:37:43.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.524+0000 7f6d7726c700 1 -- 172.21.15.154:0/1911721689 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d701a0870 con 0x7f6d70101cb0 2024-05-10T03:37:43.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.525+0000 7f6d7726c700 1 -- 172.21.15.154:0/1911721689 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d70107da0 con 0x7f6d70101cb0 2024-05-10T03:37:43.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.526+0000 7f6d667fc700 1 -- 172.21.15.154:0/1911721689 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6d60004750 con 0x7f6d70101cb0 2024-05-10T03:37:43.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.527+0000 7f6d667fc700 1 --2- 172.21.15.154:0/1911721689 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6d5c0a1120 0x7f6d5c0a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:37:43.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.527+0000 7f6d667fc700 1 -- 172.21.15.154:0/1911721689 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f6d600cc230 con 0x7f6d70101cb0 2024-05-10T03:37:43.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.527+0000 7f6d75008700 1 --2- 172.21.15.154:0/1911721689 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6d5c0a1120 0x7f6d5c0a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:37:43.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.528+0000 7f6d75008700 1 --2- 172.21.15.154:0/1911721689 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6d5c0a1120 0x7f6d5c0a3630 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6d700696a0 tx=0x7f6d6c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:37:43.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.531+0000 7f6d667fc700 1 -- 172.21.15.154:0/1911721689 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6d60096130 con 0x7f6d70101cb0 2024-05-10T03:37:43.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:43.729+0000 7f6d7726c700 1 -- 172.21.15.154:0/1911721689 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d700008d0 con 0x7f6d5c0a1120 2024-05-10T03:37:44.123 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:43 smithi154 ceph-mon[46565]: Detected new or changed devices on smithi106 2024-05-10T03:37:44.124 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:43 smithi154 ceph-mon[46565]: Adjusting osd_memory_target on smithi106 to 4278M 2024-05-10T03:37:44.124 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:43 smithi154 ceph-mon[46565]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-05-10T03:37:44.124 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:43 smithi154 ceph-mon[46565]: osdmap e68: 11 total, 10 up, 11 in 2024-05-10T03:37:44.124 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:43 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T03:37:44.124 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:43 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T03:37:44.124 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:43 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:37:44.124 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:43 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:37:44.124 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:43 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:44.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:43 smithi106 ceph-mon[46996]: Detected new or changed devices on smithi106 2024-05-10T03:37:44.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:43 smithi106 ceph-mon[46996]: Adjusting osd_memory_target on smithi106 to 4278M 2024-05-10T03:37:44.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:43 smithi106 ceph-mon[46996]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-05-10T03:37:44.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:43 smithi106 ceph-mon[46996]: osdmap e68: 11 total, 10 up, 11 in 2024-05-10T03:37:44.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:43 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T03:37:44.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:43 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T03:37:44.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:43 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:37:44.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:43 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:37:44.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:43 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:44.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:43 smithi045 ceph-mon[42520]: Detected new or changed devices on smithi106 2024-05-10T03:37:44.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:43 smithi045 ceph-mon[42520]: Adjusting osd_memory_target on smithi106 to 4278M 2024-05-10T03:37:44.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:43 smithi045 ceph-mon[42520]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-05-10T03:37:44.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:43 smithi045 ceph-mon[42520]: osdmap e68: 11 total, 10 up, 11 in 2024-05-10T03:37:44.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:43 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T03:37:44.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:43 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T03:37:44.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:43 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T03:37:44.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:43 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T03:37:44.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:43 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:45.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:44 smithi106 ceph-mon[46996]: purged_snaps scrub starts 2024-05-10T03:37:45.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:44 smithi106 ceph-mon[46996]: purged_snaps scrub ok 2024-05-10T03:37:45.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:44 smithi106 ceph-mon[46996]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:37:45.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:44 smithi106 ceph-mon[46996]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:45.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:44 smithi106 ceph-mon[46996]: osd.10 [v2:172.21.15.106:6824/2680590999,v1:172.21.15.106:6825/2680590999] boot 2024-05-10T03:37:45.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:44 smithi106 ceph-mon[46996]: osdmap e69: 11 total, 11 up, 11 in 2024-05-10T03:37:45.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:44 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T03:37:45.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:44 smithi154 ceph-mon[46565]: purged_snaps scrub starts 2024-05-10T03:37:45.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:44 smithi154 ceph-mon[46565]: purged_snaps scrub ok 2024-05-10T03:37:45.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:44 smithi154 ceph-mon[46565]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:37:45.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:44 smithi154 ceph-mon[46565]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:45.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:44 smithi154 ceph-mon[46565]: osd.10 [v2:172.21.15.106:6824/2680590999,v1:172.21.15.106:6825/2680590999] boot 2024-05-10T03:37:45.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:44 smithi154 ceph-mon[46565]: osdmap e69: 11 total, 11 up, 11 in 2024-05-10T03:37:45.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:44 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T03:37:45.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:44 smithi045 ceph-mon[42520]: purged_snaps scrub starts 2024-05-10T03:37:45.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:44 smithi045 ceph-mon[42520]: purged_snaps scrub ok 2024-05-10T03:37:45.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:44 smithi045 ceph-mon[42520]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:37:45.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:44 smithi045 ceph-mon[42520]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-10T03:37:45.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:44 smithi045 ceph-mon[42520]: osd.10 [v2:172.21.15.106:6824/2680590999,v1:172.21.15.106:6825/2680590999] boot 2024-05-10T03:37:45.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:44 smithi045 ceph-mon[42520]: osdmap e69: 11 total, 11 up, 11 in 2024-05-10T03:37:45.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:44 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T03:37:46.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:45 smithi106 ceph-mon[46996]: osdmap e70: 11 total, 11 up, 11 in 2024-05-10T03:37:46.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:45 smithi106 ceph-mon[46996]: from='client.? 172.21.15.154:0/1180471637' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43642c0b-911a-44ce-a6d4-54482dc7897a"}]: dispatch 2024-05-10T03:37:46.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:45 smithi106 ceph-mon[46996]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43642c0b-911a-44ce-a6d4-54482dc7897a"}]: dispatch 2024-05-10T03:37:46.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:45 smithi106 ceph-mon[46996]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43642c0b-911a-44ce-a6d4-54482dc7897a"}]': finished 2024-05-10T03:37:46.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:45 smithi106 ceph-mon[46996]: osdmap e71: 12 total, 11 up, 12 in 2024-05-10T03:37:46.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:45 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T03:37:46.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:45 smithi106 ceph-mon[46996]: osdmap e72: 12 total, 11 up, 12 in 2024-05-10T03:37:46.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:45 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T03:37:46.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:45 smithi154 ceph-mon[46565]: osdmap e70: 11 total, 11 up, 11 in 2024-05-10T03:37:46.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:45 smithi154 ceph-mon[46565]: from='client.? 172.21.15.154:0/1180471637' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43642c0b-911a-44ce-a6d4-54482dc7897a"}]: dispatch 2024-05-10T03:37:46.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:45 smithi154 ceph-mon[46565]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43642c0b-911a-44ce-a6d4-54482dc7897a"}]: dispatch 2024-05-10T03:37:46.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:45 smithi154 ceph-mon[46565]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43642c0b-911a-44ce-a6d4-54482dc7897a"}]': finished 2024-05-10T03:37:46.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:45 smithi154 ceph-mon[46565]: osdmap e71: 12 total, 11 up, 12 in 2024-05-10T03:37:46.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:45 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T03:37:46.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:45 smithi154 ceph-mon[46565]: osdmap e72: 12 total, 11 up, 12 in 2024-05-10T03:37:46.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:45 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T03:37:46.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:45 smithi045 ceph-mon[42520]: osdmap e70: 11 total, 11 up, 11 in 2024-05-10T03:37:46.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:45 smithi045 ceph-mon[42520]: from='client.? 172.21.15.154:0/1180471637' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43642c0b-911a-44ce-a6d4-54482dc7897a"}]: dispatch 2024-05-10T03:37:46.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:45 smithi045 ceph-mon[42520]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43642c0b-911a-44ce-a6d4-54482dc7897a"}]: dispatch 2024-05-10T03:37:46.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:45 smithi045 ceph-mon[42520]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43642c0b-911a-44ce-a6d4-54482dc7897a"}]': finished 2024-05-10T03:37:46.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:45 smithi045 ceph-mon[42520]: osdmap e71: 12 total, 11 up, 12 in 2024-05-10T03:37:46.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:45 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T03:37:46.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:45 smithi045 ceph-mon[42520]: osdmap e72: 12 total, 11 up, 12 in 2024-05-10T03:37:46.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:45 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T03:37:47.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:46 smithi106 ceph-mon[46996]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-05-10T03:37:47.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:46 smithi106 ceph-mon[46996]: from='client.? 172.21.15.154:0/2278447177' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:37:47.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:46 smithi106 ceph-mon[46996]: osdmap e73: 12 total, 11 up, 12 in 2024-05-10T03:37:47.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:46 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T03:37:47.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:46 smithi154 ceph-mon[46565]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-05-10T03:37:47.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:46 smithi154 ceph-mon[46565]: from='client.? 172.21.15.154:0/2278447177' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:37:47.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:46 smithi154 ceph-mon[46565]: osdmap e73: 12 total, 11 up, 12 in 2024-05-10T03:37:47.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:46 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T03:37:47.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:46 smithi045 ceph-mon[42520]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-05-10T03:37:47.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:46 smithi045 ceph-mon[42520]: from='client.? 172.21.15.154:0/2278447177' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T03:37:47.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:46 smithi045 ceph-mon[42520]: osdmap e73: 12 total, 11 up, 12 in 2024-05-10T03:37:47.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:46 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T03:37:49.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:48 smithi106 ceph-mon[46996]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-05-10T03:37:49.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:48 smithi154 ceph-mon[46565]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-05-10T03:37:49.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:48 smithi045 ceph-mon[42520]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-05-10T03:37:51.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:50 smithi106 ceph-mon[46996]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-05-10T03:37:51.152 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:50 smithi154 ceph-mon[46565]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-05-10T03:37:51.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:50 smithi045 ceph-mon[42520]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-05-10T03:37:52.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:51 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-10T03:37:52.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:51 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:52.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:51 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-10T03:37:52.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:51 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:52.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:51 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-10T03:37:52.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:51 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:52.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:52 smithi154 ceph-mon[46565]: Deploying daemon osd.11 on smithi154 2024-05-10T03:37:52.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:52 smithi154 ceph-mon[46565]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-05-10T03:37:53.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:52 smithi106 ceph-mon[46996]: Deploying daemon osd.11 on smithi154 2024-05-10T03:37:53.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:52 smithi106 ceph-mon[46996]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-05-10T03:37:53.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:52 smithi045 ceph-mon[42520]: Deploying daemon osd.11 on smithi154 2024-05-10T03:37:53.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:52 smithi045 ceph-mon[42520]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-05-10T03:37:55.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:54 smithi106 ceph-mon[46996]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-05-10T03:37:55.188 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:54 smithi154 ceph-mon[46565]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-05-10T03:37:55.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:54 smithi045 ceph-mon[42520]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-05-10T03:37:56.580 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:56 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:56.580 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:56 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:56.581 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:56 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:37:56.581 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:56 smithi154 ceph-mon[46565]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-10T03:37:56.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:56 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:56.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:56 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:56.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:56 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:37:56.652 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:56 smithi106 ceph-mon[46996]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-10T03:37:56.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:56 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:56.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:56 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:56.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:56 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:37:56.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:56 smithi045 ceph-mon[42520]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-10T03:37:57.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:57.784+0000 7f6d667fc700 1 -- 172.21.15.154:0/1911721689 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f6d700008d0 con 0x7f6d5c0a1120 2024-05-10T03:37:57.787 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 11 on host 'smithi154' 2024-05-10T03:37:57.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:57.786+0000 7f6d7726c700 1 -- 172.21.15.154:0/1911721689 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6d5c0a1120 msgr2=0x7f6d5c0a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:37:57.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:57.786+0000 7f6d7726c700 1 --2- 172.21.15.154:0/1911721689 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6d5c0a1120 0x7f6d5c0a3630 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6d700696a0 tx=0x7f6d6c01a040 comp rx=0 tx=0).stop 2024-05-10T03:37:57.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:57.786+0000 7f6d7726c700 1 -- 172.21.15.154:0/1911721689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d70101cb0 msgr2=0x7f6d7019d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:37:57.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:57.786+0000 7f6d7726c700 1 --2- 172.21.15.154:0/1911721689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d70101cb0 0x7f6d7019d400 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000c920 tx=0x7f6d6000cce0 comp rx=0 tx=0).stop 2024-05-10T03:37:57.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:57.786+0000 7f6d7726c700 1 -- 172.21.15.154:0/1911721689 shutdown_connections 2024-05-10T03:37:57.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:57.786+0000 7f6d7726c700 1 --2- 172.21.15.154:0/1911721689 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6d5c0a1120 0x7f6d5c0a3630 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:57.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:57.786+0000 7f6d7726c700 1 --2- 172.21.15.154:0/1911721689 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d70102650 0x7f6d7019f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:57.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:57.786+0000 7f6d7726c700 1 --2- 172.21.15.154:0/1911721689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d70100b80 0x7f6d7019aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:57.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:57.786+0000 7f6d7726c700 1 --2- 172.21.15.154:0/1911721689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d70101cb0 0x7f6d7019d400 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:57.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:57.786+0000 7f6d7726c700 1 -- 172.21.15.154:0/1911721689 >> 172.21.15.154:0/1911721689 conn(0x7f6d700fc1c0 msgr2=0x7f6d70104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:37:57.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:57.786+0000 7f6d7726c700 1 -- 172.21.15.154:0/1911721689 shutdown_connections 2024-05-10T03:37:57.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:37:57.786+0000 7f6d7726c700 1 -- 172.21.15.154:0/1911721689 wait complete. 2024-05-10T03:37:57.951 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:57 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:57.951 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:57 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:57.951 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:57 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:57.951 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:57 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:37:57.951 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:57 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:57.951 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:57 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:57.952 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:57 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:58.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:57 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:58.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:57 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:58.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:57 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:58.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:57 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:37:58.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:57 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:58.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:57 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:58.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:57 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:58.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:57 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:58.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:57 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:58.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:57 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:37:58.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:57 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:37:58.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:57 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:58.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:57 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:58.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:57 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:37:58.218 DEBUG:teuthology.orchestra.run.smithi154:osd.11> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.11.service 2024-05-10T03:37:58.220 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-05-10T03:37:58.220 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph osd stat -f json 2024-05-10T03:37:58.249 INFO:journalctl@ceph.osd.11.smithi154.stdout:-- Logs begin at Fri 2024-05-10 03:15:42 UTC. -- 2024-05-10T03:37:58.479 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:37:58.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:58 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:37:58.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:58 smithi154 ceph-mon[46565]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-05-10T03:37:59.021 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:58 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:37:59.021 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:58 smithi045 ceph-mon[42520]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-05-10T03:37:59.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:58 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:37:59.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:58 smithi106 ceph-mon[46996]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-05-10T03:37:59.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.641+0000 7ff25ac2f700 1 -- 172.21.15.45:0/310153754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff254100bb0 msgr2=0x7ff254100fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:37:59.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.641+0000 7ff25ac2f700 1 --2- 172.21.15.45:0/310153754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff254100bb0 0x7ff254100fc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff248009990 tx=0x7ff248009ca0 comp rx=0 tx=0).stop 2024-05-10T03:37:59.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.641+0000 7ff25ac2f700 1 -- 172.21.15.45:0/310153754 shutdown_connections 2024-05-10T03:37:59.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.641+0000 7ff25ac2f700 1 --2- 172.21.15.45:0/310153754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff254102680 0x7ff254108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:59.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.641+0000 7ff25ac2f700 1 --2- 172.21.15.45:0/310153754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff254100bb0 0x7ff254100fc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:59.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.641+0000 7ff25ac2f700 1 --2- 172.21.15.45:0/310153754 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff254101ce0 0x7ff2541020f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:59.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.641+0000 7ff25ac2f700 1 -- 172.21.15.45:0/310153754 >> 172.21.15.45:0/310153754 conn(0x7ff2540fc1d0 msgr2=0x7ff2540fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:37:59.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.641+0000 7ff25ac2f700 1 -- 172.21.15.45:0/310153754 shutdown_connections 2024-05-10T03:37:59.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.641+0000 7ff25ac2f700 1 -- 172.21.15.45:0/310153754 wait complete. 2024-05-10T03:37:59.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.642+0000 7ff25ac2f700 1 Processor -- start 2024-05-10T03:37:59.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.642+0000 7ff25ac2f700 1 -- start start 2024-05-10T03:37:59.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.643+0000 7ff25ac2f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff254100bb0 0x7ff25419af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:37:59.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.643+0000 7ff25ac2f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff254101ce0 0x7ff25419d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:37:59.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.643+0000 7ff25ac2f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff254102680 0x7ff25419fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:37:59.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.643+0000 7ff25ac2f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25419ff60 con 0x7ff254102680 2024-05-10T03:37:59.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.643+0000 7ff25ac2f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2541a00a0 con 0x7ff254100bb0 2024-05-10T03:37:59.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.643+0000 7ff25ac2f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2541a01e0 con 0x7ff254101ce0 2024-05-10T03:37:59.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.643+0000 7ff2591cc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff254102680 0x7ff25419fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:37:59.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.643+0000 7ff253fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff254101ce0 0x7ff25419d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:37:59.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.643+0000 7ff2591cc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff254102680 0x7ff25419fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34868/0 (socket says 172.21.15.45:34868) 2024-05-10T03:37:59.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.643+0000 7ff253fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff254101ce0 0x7ff25419d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:42876/0 (socket says 172.21.15.45:42876) 2024-05-10T03:37:59.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.643+0000 7ff2591cc700 1 -- 172.21.15.45:0/1476474779 learned_addr learned my addr 172.21.15.45:0/1476474779 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:37:59.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.643+0000 7ff2589cb700 1 --2- 172.21.15.45:0/1476474779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff254100bb0 0x7ff25419af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:37:59.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.643+0000 7ff253fff700 1 -- 172.21.15.45:0/1476474779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff254100bb0 msgr2=0x7ff25419af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:37:59.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.643+0000 7ff253fff700 1 --2- 172.21.15.45:0/1476474779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff254100bb0 0x7ff25419af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:59.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.643+0000 7ff253fff700 1 -- 172.21.15.45:0/1476474779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff254102680 msgr2=0x7ff25419fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:37:59.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.643+0000 7ff253fff700 1 --2- 172.21.15.45:0/1476474779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff254102680 0x7ff25419fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:59.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.643+0000 7ff253fff700 1 -- 172.21.15.45:0/1476474779 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2480095f0 con 0x7ff254101ce0 2024-05-10T03:37:59.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.643+0000 7ff2589cb700 1 --2- 172.21.15.45:0/1476474779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff254100bb0 0x7ff25419af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:37:59.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.643+0000 7ff2591cc700 1 --2- 172.21.15.45:0/1476474779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff254102680 0x7ff25419fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:37:59.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.643+0000 7ff253fff700 1 --2- 172.21.15.45:0/1476474779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff254101ce0 0x7ff25419d4d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff24000d750 tx=0x7ff24000da60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:37:59.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.644+0000 7ff251ffb700 1 -- 172.21.15.45:0/1476474779 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff240004220 con 0x7ff254101ce0 2024-05-10T03:37:59.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.644+0000 7ff25ac2f700 1 -- 172.21.15.45:0/1476474779 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2541a0410 con 0x7ff254101ce0 2024-05-10T03:37:59.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.644+0000 7ff251ffb700 1 -- 172.21.15.45:0/1476474779 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff240004d10 con 0x7ff254101ce0 2024-05-10T03:37:59.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.644+0000 7ff251ffb700 1 -- 172.21.15.45:0/1476474779 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24000f690 con 0x7ff254101ce0 2024-05-10T03:37:59.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.644+0000 7ff25ac2f700 1 -- 172.21.15.45:0/1476474779 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2541a0960 con 0x7ff254101ce0 2024-05-10T03:37:59.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.645+0000 7ff25ac2f700 1 -- 172.21.15.45:0/1476474779 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff254107dd0 con 0x7ff254101ce0 2024-05-10T03:37:59.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.646+0000 7ff251ffb700 1 -- 172.21.15.45:0/1476474779 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff240004750 con 0x7ff254101ce0 2024-05-10T03:37:59.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.647+0000 7ff251ffb700 1 --2- 172.21.15.45:0/1476474779 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff2440a11a0 0x7ff2440a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:37:59.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.647+0000 7ff2589cb700 1 --2- 172.21.15.45:0/1476474779 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff2440a11a0 0x7ff2440a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:37:59.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.647+0000 7ff251ffb700 1 -- 172.21.15.45:0/1476474779 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff2400cbfe0 con 0x7ff254101ce0 2024-05-10T03:37:59.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.647+0000 7ff2589cb700 1 --2- 172.21.15.45:0/1476474779 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff2440a11a0 0x7ff2440a36b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff25406a2f0 tx=0x7ff24801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:37:59.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.652+0000 7ff251ffb700 1 -- 172.21.15.45:0/1476474779 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff240095cf0 con 0x7ff254101ce0 2024-05-10T03:37:59.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:37:59 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:37:59.365+0000 7f91ae2337c0 -1 osd.11 0 log_to_monitors true 2024-05-10T03:37:59.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.867+0000 7ff25ac2f700 1 -- 172.21.15.45:0/1476474779 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7ff2540ffeb0 con 0x7ff254101ce0 2024-05-10T03:37:59.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.867+0000 7ff251ffb700 1 -- 172.21.15.45:0/1476474779 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) v1 ==== 74+0+133 (secure 0 0 0) 0x7ff240099310 con 0x7ff254101ce0 2024-05-10T03:37:59.870 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:37:59.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.870+0000 7ff25ac2f700 1 -- 172.21.15.45:0/1476474779 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff2440a11a0 msgr2=0x7ff2440a36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:37:59.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.870+0000 7ff25ac2f700 1 --2- 172.21.15.45:0/1476474779 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff2440a11a0 0x7ff2440a36b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff25406a2f0 tx=0x7ff24801a040 comp rx=0 tx=0).stop 2024-05-10T03:37:59.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.870+0000 7ff25ac2f700 1 -- 172.21.15.45:0/1476474779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff254101ce0 msgr2=0x7ff25419d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:37:59.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.870+0000 7ff25ac2f700 1 --2- 172.21.15.45:0/1476474779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff254101ce0 0x7ff25419d4d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff24000d750 tx=0x7ff24000da60 comp rx=0 tx=0).stop 2024-05-10T03:37:59.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.870+0000 7ff25ac2f700 1 -- 172.21.15.45:0/1476474779 shutdown_connections 2024-05-10T03:37:59.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.870+0000 7ff25ac2f700 1 --2- 172.21.15.45:0/1476474779 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff2440a11a0 0x7ff2440a36b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:59.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.870+0000 7ff25ac2f700 1 --2- 172.21.15.45:0/1476474779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff254102680 0x7ff25419fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:59.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.870+0000 7ff25ac2f700 1 --2- 172.21.15.45:0/1476474779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff254100bb0 0x7ff25419af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:59.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.870+0000 7ff25ac2f700 1 --2- 172.21.15.45:0/1476474779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff254101ce0 0x7ff25419d4d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:37:59.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.870+0000 7ff25ac2f700 1 -- 172.21.15.45:0/1476474779 >> 172.21.15.45:0/1476474779 conn(0x7ff2540fc1d0 msgr2=0x7ff254104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:37:59.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.870+0000 7ff25ac2f700 1 -- 172.21.15.45:0/1476474779 shutdown_connections 2024-05-10T03:37:59.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:37:59.870+0000 7ff25ac2f700 1 -- 172.21.15.45:0/1476474779 wait complete. 2024-05-10T03:38:00.045 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:59 smithi045 ceph-mon[42520]: from='osd.11 [v2:172.21.15.154:6824/3779086590,v1:172.21.15.154:6825/3779086590]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-10T03:38:00.046 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:37:59 smithi045 ceph-mon[42520]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-10T03:38:00.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:59 smithi106 ceph-mon[46996]: from='osd.11 [v2:172.21.15.154:6824/3779086590,v1:172.21.15.154:6825/3779086590]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-10T03:38:00.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:37:59 smithi106 ceph-mon[46996]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-10T03:38:00.159 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:59 smithi154 ceph-mon[46565]: from='osd.11 [v2:172.21.15.154:6824/3779086590,v1:172.21.15.154:6825/3779086590]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-10T03:38:00.159 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:37:59 smithi154 ceph-mon[46565]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-10T03:38:00.260 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":74,"num_osds":12,"num_up_osds":11,"osd_up_since":1715312263,"num_in_osds":12,"osd_in_since":1715312265,"num_remapped_pgs":0} 2024-05-10T03:38:01.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:00 smithi106 ceph-mon[46996]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-10T03:38:01.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:00 smithi106 ceph-mon[46996]: osdmap e74: 12 total, 11 up, 12 in 2024-05-10T03:38:01.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:00 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T03:38:01.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:00 smithi106 ceph-mon[46996]: from='osd.11 [v2:172.21.15.154:6824/3779086590,v1:172.21.15.154:6825/3779086590]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-10T03:38:01.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:00 smithi106 ceph-mon[46996]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-10T03:38:01.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:00 smithi106 ceph-mon[46996]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-10T03:38:01.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:00 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1476474779' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-10T03:38:01.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:00 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:01.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:00 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:01.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:00 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:38:01.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:00 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:38:01.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:00 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:38:01.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:00 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:38:01.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:00 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:01.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:00 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:01.153 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:00 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:38:01.153 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:00 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:01.224 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:38:00 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:38:00.806+0000 7f91a3897700 -1 osd.11 0 waiting for initial osdmap 2024-05-10T03:38:01.224 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:38:00 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:38:00.823+0000 7f919f64e700 -1 osd.11 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T03:38:01.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:00 smithi154 ceph-mon[46565]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-10T03:38:01.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:00 smithi154 ceph-mon[46565]: osdmap e74: 12 total, 11 up, 12 in 2024-05-10T03:38:01.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:00 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T03:38:01.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:00 smithi154 ceph-mon[46565]: from='osd.11 [v2:172.21.15.154:6824/3779086590,v1:172.21.15.154:6825/3779086590]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-10T03:38:01.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:00 smithi154 ceph-mon[46565]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-10T03:38:01.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:00 smithi154 ceph-mon[46565]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-10T03:38:01.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:00 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1476474779' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-10T03:38:01.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:00 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:01.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:00 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:01.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:00 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:38:01.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:00 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:38:01.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:00 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:38:01.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:00 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:38:01.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:00 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:01.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:00 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:01.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:00 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:38:01.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:00 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:01.261 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph osd stat -f json 2024-05-10T03:38:01.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:00 smithi045 ceph-mon[42520]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-10T03:38:01.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:00 smithi045 ceph-mon[42520]: osdmap e74: 12 total, 11 up, 12 in 2024-05-10T03:38:01.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:00 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T03:38:01.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:00 smithi045 ceph-mon[42520]: from='osd.11 [v2:172.21.15.154:6824/3779086590,v1:172.21.15.154:6825/3779086590]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-10T03:38:01.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:00 smithi045 ceph-mon[42520]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-05-10T03:38:01.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:00 smithi045 ceph-mon[42520]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-10T03:38:01.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:00 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1476474779' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-10T03:38:01.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:00 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:01.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:00 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:01.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:00 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:38:01.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:00 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:38:01.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:00 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:38:01.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:00 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-10T03:38:01.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:00 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:01.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:00 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:01.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:00 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:38:01.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:00 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:01.520 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:38:01.987 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:01 smithi045 ceph-mon[42520]: Detected new or changed devices on smithi154 2024-05-10T03:38:01.988 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:01 smithi045 ceph-mon[42520]: Adjusting osd_memory_target on smithi154 to 4278M 2024-05-10T03:38:01.988 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:01 smithi045 ceph-mon[42520]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-05-10T03:38:01.988 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:01 smithi045 ceph-mon[42520]: osdmap e75: 12 total, 11 up, 12 in 2024-05-10T03:38:01.988 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:01 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T03:38:01.988 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:01 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T03:38:02.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:01 smithi106 ceph-mon[46996]: Detected new or changed devices on smithi154 2024-05-10T03:38:02.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:01 smithi106 ceph-mon[46996]: Adjusting osd_memory_target on smithi154 to 4278M 2024-05-10T03:38:02.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:01 smithi106 ceph-mon[46996]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-05-10T03:38:02.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:01 smithi106 ceph-mon[46996]: osdmap e75: 12 total, 11 up, 12 in 2024-05-10T03:38:02.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:01 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T03:38:02.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:01 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T03:38:02.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:01 smithi154 ceph-mon[46565]: Detected new or changed devices on smithi154 2024-05-10T03:38:02.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:01 smithi154 ceph-mon[46565]: Adjusting osd_memory_target on smithi154 to 4278M 2024-05-10T03:38:02.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:01 smithi154 ceph-mon[46565]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-05-10T03:38:02.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:01 smithi154 ceph-mon[46565]: osdmap e75: 12 total, 11 up, 12 in 2024-05-10T03:38:02.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:01 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T03:38:02.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:01 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T03:38:02.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.539+0000 7f79dbc8e700 1 -- 172.21.15.45:0/1341354770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d4101ca0 msgr2=0x7f79d41020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:02.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.539+0000 7f79dbc8e700 1 --2- 172.21.15.45:0/1341354770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d4101ca0 0x7f79d41020b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f79d0009990 tx=0x7f79d0009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:02.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.539+0000 7f79dbc8e700 1 -- 172.21.15.45:0/1341354770 shutdown_connections 2024-05-10T03:38:02.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.539+0000 7f79dbc8e700 1 --2- 172.21.15.45:0/1341354770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79d4103770 0x7f79d410a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:02.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.539+0000 7f79dbc8e700 1 --2- 172.21.15.45:0/1341354770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d4101ca0 0x7f79d41020b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:02.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.539+0000 7f79dbc8e700 1 --2- 172.21.15.45:0/1341354770 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79d4102dd0 0x7f79d41031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:02.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.539+0000 7f79dbc8e700 1 -- 172.21.15.45:0/1341354770 >> 172.21.15.45:0/1341354770 conn(0x7f79d40fd300 msgr2=0x7f79d40ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:02.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.539+0000 7f79dbc8e700 1 -- 172.21.15.45:0/1341354770 shutdown_connections 2024-05-10T03:38:02.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.539+0000 7f79dbc8e700 1 -- 172.21.15.45:0/1341354770 wait complete. 2024-05-10T03:38:02.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.540+0000 7f79dbc8e700 1 Processor -- start 2024-05-10T03:38:02.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.540+0000 7f79dbc8e700 1 -- start start 2024-05-10T03:38:02.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.540+0000 7f79dbc8e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79d4101ca0 0x7f79d41981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:02.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.540+0000 7f79dbc8e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79d4102dd0 0x7f79d4198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:02.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.540+0000 7f79dbc8e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d4103770 0x7f79d41994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:02.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.540+0000 7f79dbc8e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d4199b30 con 0x7f79d4103770 2024-05-10T03:38:02.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.540+0000 7f79dbc8e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d4199c70 con 0x7f79d4101ca0 2024-05-10T03:38:02.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.540+0000 7f79dbc8e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d4199e30 con 0x7f79d4102dd0 2024-05-10T03:38:02.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.540+0000 7f79da22b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d4103770 0x7f79d41994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:02.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.540+0000 7f79da22b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d4103770 0x7f79d41994d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34888/0 (socket says 172.21.15.45:34888) 2024-05-10T03:38:02.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.540+0000 7f79da22b700 1 -- 172.21.15.45:0/876365248 learned_addr learned my addr 172.21.15.45:0/876365248 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:02.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.541+0000 7f79d9a2a700 1 --2- 172.21.15.45:0/876365248 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79d4101ca0 0x7f79d41981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:02.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.541+0000 7f79d9229700 1 --2- 172.21.15.45:0/876365248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79d4102dd0 0x7f79d4198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:02.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.541+0000 7f79da22b700 1 -- 172.21.15.45:0/876365248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79d4102dd0 msgr2=0x7f79d4198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:02.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.541+0000 7f79da22b700 1 --2- 172.21.15.45:0/876365248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79d4102dd0 0x7f79d4198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:02.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.541+0000 7f79da22b700 1 -- 172.21.15.45:0/876365248 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79d4101ca0 msgr2=0x7f79d41981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:02.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.541+0000 7f79da22b700 1 --2- 172.21.15.45:0/876365248 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79d4101ca0 0x7f79d41981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:02.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.541+0000 7f79da22b700 1 -- 172.21.15.45:0/876365248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d00095f0 con 0x7f79d4103770 2024-05-10T03:38:02.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.541+0000 7f79da22b700 1 --2- 172.21.15.45:0/876365248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d4103770 0x7f79d41994d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00ef30 tx=0x7f79cc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:02.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.541+0000 7f79caffd700 1 -- 172.21.15.45:0/876365248 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc018070 con 0x7f79d4103770 2024-05-10T03:38:02.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.541+0000 7f79caffd700 1 -- 172.21.15.45:0/876365248 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f79cc00f040 con 0x7f79d4103770 2024-05-10T03:38:02.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.541+0000 7f79dbc8e700 1 -- 172.21.15.45:0/876365248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d419a0b0 con 0x7f79d4103770 2024-05-10T03:38:02.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.541+0000 7f79caffd700 1 -- 172.21.15.45:0/876365248 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc00ce00 con 0x7f79d4103770 2024-05-10T03:38:02.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.541+0000 7f79dbc8e700 1 -- 172.21.15.45:0/876365248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d41a08f0 con 0x7f79d4103770 2024-05-10T03:38:02.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.543+0000 7f79dbc8e700 1 -- 172.21.15.45:0/876365248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d4108ec0 con 0x7f79d4103770 2024-05-10T03:38:02.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.544+0000 7f79caffd700 1 -- 172.21.15.45:0/876365248 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f79cc003a00 con 0x7f79d4103770 2024-05-10T03:38:02.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.544+0000 7f79caffd700 1 --2- 172.21.15.45:0/876365248 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f79c00a1120 0x7f79c00a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:02.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.544+0000 7f79caffd700 1 -- 172.21.15.45:0/876365248 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f79cc0cc010 con 0x7f79d4103770 2024-05-10T03:38:02.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.544+0000 7f79d9a2a700 1 --2- 172.21.15.45:0/876365248 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f79c00a1120 0x7f79c00a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:02.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.545+0000 7f79d9a2a700 1 --2- 172.21.15.45:0/876365248 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f79c00a1120 0x7f79c00a3630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f79d0006010 tx=0x7f79d001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:02.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.549+0000 7f79caffd700 1 -- 172.21.15.45:0/876365248 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f79cc095cd0 con 0x7f79d4103770 2024-05-10T03:38:02.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.763+0000 7f79dbc8e700 1 -- 172.21.15.45:0/876365248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f79d404edc0 con 0x7f79d4103770 2024-05-10T03:38:02.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.764+0000 7f79caffd700 1 -- 172.21.15.45:0/876365248 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) v1 ==== 74+0+133 (secure 0 0 0) 0x7f79cc0992f0 con 0x7f79d4103770 2024-05-10T03:38:02.768 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:38:02.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.766+0000 7f79dbc8e700 1 -- 172.21.15.45:0/876365248 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f79c00a1120 msgr2=0x7f79c00a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:02.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.766+0000 7f79dbc8e700 1 --2- 172.21.15.45:0/876365248 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f79c00a1120 0x7f79c00a3630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f79d0006010 tx=0x7f79d001a040 comp rx=0 tx=0).stop 2024-05-10T03:38:02.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.766+0000 7f79dbc8e700 1 -- 172.21.15.45:0/876365248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d4103770 msgr2=0x7f79d41994d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:02.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.766+0000 7f79dbc8e700 1 --2- 172.21.15.45:0/876365248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d4103770 0x7f79d41994d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00ef30 tx=0x7f79cc00c3a0 comp rx=0 tx=0).stop 2024-05-10T03:38:02.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.766+0000 7f79dbc8e700 1 -- 172.21.15.45:0/876365248 shutdown_connections 2024-05-10T03:38:02.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.766+0000 7f79dbc8e700 1 --2- 172.21.15.45:0/876365248 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f79c00a1120 0x7f79c00a3630 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:02.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.766+0000 7f79dbc8e700 1 --2- 172.21.15.45:0/876365248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79d4103770 0x7f79d41994d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:02.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.766+0000 7f79dbc8e700 1 --2- 172.21.15.45:0/876365248 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79d4101ca0 0x7f79d41981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:02.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.766+0000 7f79dbc8e700 1 --2- 172.21.15.45:0/876365248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79d4102dd0 0x7f79d4198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:02.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.766+0000 7f79dbc8e700 1 -- 172.21.15.45:0/876365248 >> 172.21.15.45:0/876365248 conn(0x7f79d40fd300 msgr2=0x7f79d4106000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:02.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.767+0000 7f79dbc8e700 1 -- 172.21.15.45:0/876365248 shutdown_connections 2024-05-10T03:38:02.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:02.767+0000 7f79dbc8e700 1 -- 172.21.15.45:0/876365248 wait complete. 2024-05-10T03:38:03.083 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:02 smithi045 ceph-mon[42520]: purged_snaps scrub starts 2024-05-10T03:38:03.083 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:02 smithi045 ceph-mon[42520]: purged_snaps scrub ok 2024-05-10T03:38:03.083 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:02 smithi045 ceph-mon[42520]: osd.11 [v2:172.21.15.154:6824/3779086590,v1:172.21.15.154:6825/3779086590] boot 2024-05-10T03:38:03.083 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:02 smithi045 ceph-mon[42520]: osdmap e76: 12 total, 12 up, 12 in 2024-05-10T03:38:03.083 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:02 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T03:38:03.083 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:02 smithi045 ceph-mon[42520]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:03.083 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:02 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/876365248' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-10T03:38:03.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:02 smithi106 ceph-mon[46996]: purged_snaps scrub starts 2024-05-10T03:38:03.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:02 smithi106 ceph-mon[46996]: purged_snaps scrub ok 2024-05-10T03:38:03.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:02 smithi106 ceph-mon[46996]: osd.11 [v2:172.21.15.154:6824/3779086590,v1:172.21.15.154:6825/3779086590] boot 2024-05-10T03:38:03.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:02 smithi106 ceph-mon[46996]: osdmap e76: 12 total, 12 up, 12 in 2024-05-10T03:38:03.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:02 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T03:38:03.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:02 smithi106 ceph-mon[46996]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:03.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:02 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/876365248' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-10T03:38:03.173 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":76,"num_osds":12,"num_up_osds":12,"osd_up_since":1715312281,"num_in_osds":12,"osd_in_since":1715312265,"num_remapped_pgs":0} 2024-05-10T03:38:03.174 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-10T03:38:03.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:02 smithi154 ceph-mon[46565]: purged_snaps scrub starts 2024-05-10T03:38:03.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:02 smithi154 ceph-mon[46565]: purged_snaps scrub ok 2024-05-10T03:38:03.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:02 smithi154 ceph-mon[46565]: osd.11 [v2:172.21.15.154:6824/3779086590,v1:172.21.15.154:6825/3779086590] boot 2024-05-10T03:38:03.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:02 smithi154 ceph-mon[46565]: osdmap e76: 12 total, 12 up, 12 in 2024-05-10T03:38:03.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:02 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T03:38:03.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:02 smithi154 ceph-mon[46565]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:03.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:02 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/876365248' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-10T03:38:03.468 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:38:03.920 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:03 smithi045 ceph-mon[42520]: osdmap e77: 12 total, 12 up, 12 in 2024-05-10T03:38:04.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:03 smithi106 ceph-mon[46996]: osdmap e77: 12 total, 12 up, 12 in 2024-05-10T03:38:04.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:03 smithi154 ceph-mon[46565]: osdmap e77: 12 total, 12 up, 12 in 2024-05-10T03:38:04.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.446+0000 7f4893975700 1 -- 172.21.15.45:0/2392255692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f488c10c210 msgr2=0x7f488c10e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:04.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.446+0000 7f4893975700 1 --2- 172.21.15.45:0/2392255692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f488c10c210 0x7f488c10e720 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f488400b0a0 tx=0x7f488400b3b0 comp rx=0 tx=0).stop 2024-05-10T03:38:04.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.446+0000 7f4893975700 1 -- 172.21.15.45:0/2392255692 shutdown_connections 2024-05-10T03:38:04.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.446+0000 7f4893975700 1 --2- 172.21.15.45:0/2392255692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f488c10c210 0x7f488c10e720 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:04.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.446+0000 7f4893975700 1 --2- 172.21.15.45:0/2392255692 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f488c102da0 0x7f488c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:04.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.446+0000 7f4893975700 1 --2- 172.21.15.45:0/2392255692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f488c1036f0 0x7f488c10bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:04.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.446+0000 7f4893975700 1 -- 172.21.15.45:0/2392255692 >> 172.21.15.45:0/2392255692 conn(0x7f488c0fc7a0 msgr2=0x7f488c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:04.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.446+0000 7f4893975700 1 -- 172.21.15.45:0/2392255692 shutdown_connections 2024-05-10T03:38:04.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.446+0000 7f4893975700 1 -- 172.21.15.45:0/2392255692 wait complete. 2024-05-10T03:38:04.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.446+0000 7f4893975700 1 Processor -- start 2024-05-10T03:38:04.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.447+0000 7f4893975700 1 -- start start 2024-05-10T03:38:04.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.447+0000 7f4893975700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f488c102da0 0x7f488c19e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:04.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.447+0000 7f4893975700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f488c1036f0 0x7f488c19ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:04.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.447+0000 7f4893975700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f488c10c210 0x7f488c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:04.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.447+0000 7f4893975700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c198a70 con 0x7f488c102da0 2024-05-10T03:38:04.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.447+0000 7f4893975700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c198be0 con 0x7f488c1036f0 2024-05-10T03:38:04.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.447+0000 7f4893975700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c198da0 con 0x7f488c10c210 2024-05-10T03:38:04.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.447+0000 7f4891711700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f488c102da0 0x7f488c19e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:04.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.447+0000 7f4890f10700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f488c1036f0 0x7f488c19ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:04.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.447+0000 7f4891711700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f488c102da0 0x7f488c19e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34906/0 (socket says 172.21.15.45:34906) 2024-05-10T03:38:04.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.447+0000 7f4891711700 1 -- 172.21.15.45:0/3039444262 learned_addr learned my addr 172.21.15.45:0/3039444262 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:04.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.447+0000 7f4891f12700 1 --2- 172.21.15.45:0/3039444262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f488c10c210 0x7f488c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:04.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.447+0000 7f4891711700 1 -- 172.21.15.45:0/3039444262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f488c10c210 msgr2=0x7f488c1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:04.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.447+0000 7f4891711700 1 --2- 172.21.15.45:0/3039444262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f488c10c210 0x7f488c1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:04.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.447+0000 7f4891711700 1 -- 172.21.15.45:0/3039444262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f488c1036f0 msgr2=0x7f488c19ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:04.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.447+0000 7f4891711700 1 --2- 172.21.15.45:0/3039444262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f488c1036f0 0x7f488c19ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:04.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.447+0000 7f4891711700 1 -- 172.21.15.45:0/3039444262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4884009d00 con 0x7f488c102da0 2024-05-10T03:38:04.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.448+0000 7f4891711700 1 --2- 172.21.15.45:0/3039444262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f488c102da0 0x7f488c19e540 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f488800d980 tx=0x7f488800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:04.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.448+0000 7f48827fc700 1 -- 172.21.15.45:0/3039444262 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4888004020 con 0x7f488c102da0 2024-05-10T03:38:04.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.448+0000 7f4893975700 1 -- 172.21.15.45:0/3039444262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f488c199080 con 0x7f488c102da0 2024-05-10T03:38:04.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.448+0000 7f48827fc700 1 -- 172.21.15.45:0/3039444262 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4888009730 con 0x7f488c102da0 2024-05-10T03:38:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.448+0000 7f48827fc700 1 -- 172.21.15.45:0/3039444262 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4888003be0 con 0x7f488c102da0 2024-05-10T03:38:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.448+0000 7f4893975700 1 -- 172.21.15.45:0/3039444262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f488c1a5510 con 0x7f488c102da0 2024-05-10T03:38:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.449+0000 7f4893975700 1 -- 172.21.15.45:0/3039444262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488c1072f0 con 0x7f488c102da0 2024-05-10T03:38:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.450+0000 7f48827fc700 1 -- 172.21.15.45:0/3039444262 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4888009ba0 con 0x7f488c102da0 2024-05-10T03:38:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.451+0000 7f48827fc700 1 --2- 172.21.15.45:0/3039444262 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f48780a1120 0x7f48780a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.451+0000 7f4890f10700 1 --2- 172.21.15.45:0/3039444262 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f48780a1120 0x7f48780a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.451+0000 7f48827fc700 1 -- 172.21.15.45:0/3039444262 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f48880cc490 con 0x7f488c102da0 2024-05-10T03:38:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.452+0000 7f4890f10700 1 --2- 172.21.15.45:0/3039444262 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f48780a1120 0x7f48780a3630 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f488c199e10 tx=0x7f487c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:04.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.455+0000 7f48827fc700 1 -- 172.21.15.45:0/3039444262 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4888096020 con 0x7f488c102da0 2024-05-10T03:38:04.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.665+0000 7f4893975700 1 -- 172.21.15.45:0/3039444262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f488c069600 con 0x7f488c102da0 2024-05-10T03:38:04.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.666+0000 7f48827fc700 1 -- 172.21.15.45:0/3039444262 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+18443 (secure 0 0 0) 0x7f4888099640 con 0x7f488c102da0 2024-05-10T03:38:04.670 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:38:04.670 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":77,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:38:02.806163+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:38:04.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.668+0000 7f4893975700 1 -- 172.21.15.45:0/3039444262 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f48780a1120 msgr2=0x7f48780a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:04.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.668+0000 7f4893975700 1 --2- 172.21.15.45:0/3039444262 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f48780a1120 0x7f48780a3630 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f488c199e10 tx=0x7f487c009260 comp rx=0 tx=0).stop 2024-05-10T03:38:04.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.668+0000 7f4893975700 1 -- 172.21.15.45:0/3039444262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f488c102da0 msgr2=0x7f488c19e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:04.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.668+0000 7f4893975700 1 --2- 172.21.15.45:0/3039444262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f488c102da0 0x7f488c19e540 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f488800d980 tx=0x7f488800dc90 comp rx=0 tx=0).stop 2024-05-10T03:38:04.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.668+0000 7f4893975700 1 -- 172.21.15.45:0/3039444262 shutdown_connections 2024-05-10T03:38:04.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.668+0000 7f4893975700 1 --2- 172.21.15.45:0/3039444262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f488c10c210 0x7f488c1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:04.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.668+0000 7f4893975700 1 --2- 172.21.15.45:0/3039444262 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f48780a1120 0x7f48780a3630 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:04.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.668+0000 7f4893975700 1 --2- 172.21.15.45:0/3039444262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f488c102da0 0x7f488c19e540 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:04.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.668+0000 7f4893975700 1 --2- 172.21.15.45:0/3039444262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f488c1036f0 0x7f488c19ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:04.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.668+0000 7f4893975700 1 -- 172.21.15.45:0/3039444262 >> 172.21.15.45:0/3039444262 conn(0x7f488c0fc7a0 msgr2=0x7f488c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:04.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.668+0000 7f4893975700 1 -- 172.21.15.45:0/3039444262 shutdown_connections 2024-05-10T03:38:04.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:04.668+0000 7f4893975700 1 -- 172.21.15.45:0/3039444262 wait complete. 2024-05-10T03:38:05.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:04 smithi045 ceph-mon[42520]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:05.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:04 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3039444262' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:05.075 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T03:35:20.339400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T03:38:05.075 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-10T03:38:05.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:04 smithi106 ceph-mon[46996]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:05.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:04 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3039444262' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:05.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:04 smithi154 ceph-mon[46565]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:05.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:04 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3039444262' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:05.330 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:38:06.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.366+0000 7f90dcc3a700 1 -- 172.21.15.45:0/2406029308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90d8105730 msgr2=0x7f90d8105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:06.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.366+0000 7f90dcc3a700 1 --2- 172.21.15.45:0/2406029308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90d8105730 0x7f90d8105b40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f90cc009990 tx=0x7f90cc009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:06.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.366+0000 7f90dcc3a700 1 -- 172.21.15.45:0/2406029308 shutdown_connections 2024-05-10T03:38:06.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.366+0000 7f90dcc3a700 1 --2- 172.21.15.45:0/2406029308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90d8100e00 0x7f90d8101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:06.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.366+0000 7f90dcc3a700 1 --2- 172.21.15.45:0/2406029308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90d8106080 0x7f90d810d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:06.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.366+0000 7f90dcc3a700 1 --2- 172.21.15.45:0/2406029308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90d8105730 0x7f90d8105b40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:06.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.366+0000 7f90dcc3a700 1 -- 172.21.15.45:0/2406029308 >> 172.21.15.45:0/2406029308 conn(0x7f90d80fc7a0 msgr2=0x7f90d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:06.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.366+0000 7f90dcc3a700 1 -- 172.21.15.45:0/2406029308 shutdown_connections 2024-05-10T03:38:06.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.366+0000 7f90dcc3a700 1 -- 172.21.15.45:0/2406029308 wait complete. 2024-05-10T03:38:06.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.367+0000 7f90dcc3a700 1 Processor -- start 2024-05-10T03:38:06.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.367+0000 7f90dcc3a700 1 -- start start 2024-05-10T03:38:06.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.368+0000 7f90dcc3a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90d8100e00 0x7f90d81974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:06.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.368+0000 7f90dcc3a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90d8105730 0x7f90d8197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:06.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.368+0000 7f90dcc3a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90d8106080 0x7f90d819bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:06.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.368+0000 7f90dcc3a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d819c480 con 0x7f90d8106080 2024-05-10T03:38:06.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.368+0000 7f90dcc3a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d819c5f0 con 0x7f90d8105730 2024-05-10T03:38:06.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.368+0000 7f90dcc3a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d819c7b0 con 0x7f90d8100e00 2024-05-10T03:38:06.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.368+0000 7f90d6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90d8106080 0x7f90d819bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:06.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.368+0000 7f90d6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90d8106080 0x7f90d819bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34928/0 (socket says 172.21.15.45:34928) 2024-05-10T03:38:06.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.368+0000 7f90d6d9d700 1 -- 172.21.15.45:0/2465210314 learned_addr learned my addr 172.21.15.45:0/2465210314 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:06.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.368+0000 7f90d659c700 1 --2- 172.21.15.45:0/2465210314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90d8100e00 0x7f90d81974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:06.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.368+0000 7f90d5d9b700 1 --2- 172.21.15.45:0/2465210314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90d8105730 0x7f90d8197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:06.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.368+0000 7f90d6d9d700 1 -- 172.21.15.45:0/2465210314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90d8100e00 msgr2=0x7f90d81974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:06.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.368+0000 7f90d6d9d700 1 --2- 172.21.15.45:0/2465210314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90d8100e00 0x7f90d81974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:06.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.368+0000 7f90d6d9d700 1 -- 172.21.15.45:0/2465210314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90d8105730 msgr2=0x7f90d8197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:06.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.368+0000 7f90d6d9d700 1 --2- 172.21.15.45:0/2465210314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90d8105730 0x7f90d8197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:06.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.368+0000 7f90d6d9d700 1 -- 172.21.15.45:0/2465210314 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90cc0095f0 con 0x7f90d8106080 2024-05-10T03:38:06.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.369+0000 7f90d6d9d700 1 --2- 172.21.15.45:0/2465210314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90d8106080 0x7f90d819bf10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f90d0007ee0 tx=0x7f90d000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:06.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.369+0000 7f90c77fe700 1 -- 172.21.15.45:0/2465210314 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d0017070 con 0x7f90d8106080 2024-05-10T03:38:06.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.369+0000 7f90dcc3a700 1 -- 172.21.15.45:0/2465210314 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d819ca90 con 0x7f90d8106080 2024-05-10T03:38:06.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.369+0000 7f90c77fe700 1 -- 172.21.15.45:0/2465210314 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f90d000f040 con 0x7f90d8106080 2024-05-10T03:38:06.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.369+0000 7f90c77fe700 1 -- 172.21.15.45:0/2465210314 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d0005610 con 0x7f90d8106080 2024-05-10T03:38:06.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.369+0000 7f90dcc3a700 1 -- 172.21.15.45:0/2465210314 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d819cd90 con 0x7f90d8106080 2024-05-10T03:38:06.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.370+0000 7f90dcc3a700 1 -- 172.21.15.45:0/2465210314 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d8109040 con 0x7f90d8106080 2024-05-10T03:38:06.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.372+0000 7f90c77fe700 1 -- 172.21.15.45:0/2465210314 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f90d0005770 con 0x7f90d8106080 2024-05-10T03:38:06.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.372+0000 7f90c77fe700 1 --2- 172.21.15.45:0/2465210314 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f90c00a11a0 0x7f90c00a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:06.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.372+0000 7f90d659c700 1 --2- 172.21.15.45:0/2465210314 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f90c00a11a0 0x7f90c00a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:06.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.372+0000 7f90c77fe700 1 -- 172.21.15.45:0/2465210314 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f90d00cc120 con 0x7f90d8106080 2024-05-10T03:38:06.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.373+0000 7f90d659c700 1 --2- 172.21.15.45:0/2465210314 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f90c00a11a0 0x7f90c00a36b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f90c8005950 tx=0x7f90c800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:06.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.376+0000 7f90c77fe700 1 -- 172.21.15.45:0/2465210314 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f90d0095d50 con 0x7f90d8106080 2024-05-10T03:38:06.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.588+0000 7f90dcc3a700 1 -- 172.21.15.45:0/2465210314 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f90d804edc0 con 0x7f90d8106080 2024-05-10T03:38:06.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.589+0000 7f90c77fe700 1 -- 172.21.15.45:0/2465210314 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7f90d0009390 con 0x7f90d8106080 2024-05-10T03:38:06.593 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-05-10T03:38:06.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.591+0000 7f90dcc3a700 1 -- 172.21.15.45:0/2465210314 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f90c00a11a0 msgr2=0x7f90c00a36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:06.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.591+0000 7f90dcc3a700 1 --2- 172.21.15.45:0/2465210314 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f90c00a11a0 0x7f90c00a36b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f90c8005950 tx=0x7f90c800b410 comp rx=0 tx=0).stop 2024-05-10T03:38:06.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.591+0000 7f90dcc3a700 1 -- 172.21.15.45:0/2465210314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90d8106080 msgr2=0x7f90d819bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:06.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.591+0000 7f90dcc3a700 1 --2- 172.21.15.45:0/2465210314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90d8106080 0x7f90d819bf10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f90d0007ee0 tx=0x7f90d000d3b0 comp rx=0 tx=0).stop 2024-05-10T03:38:06.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.591+0000 7f90dcc3a700 1 -- 172.21.15.45:0/2465210314 shutdown_connections 2024-05-10T03:38:06.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.591+0000 7f90dcc3a700 1 --2- 172.21.15.45:0/2465210314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90d8100e00 0x7f90d81974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:06.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.591+0000 7f90dcc3a700 1 --2- 172.21.15.45:0/2465210314 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f90c00a11a0 0x7f90c00a36b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:06.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.591+0000 7f90dcc3a700 1 --2- 172.21.15.45:0/2465210314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90d8106080 0x7f90d819bf10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:06.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.591+0000 7f90dcc3a700 1 --2- 172.21.15.45:0/2465210314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90d8105730 0x7f90d8197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:06.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.591+0000 7f90dcc3a700 1 -- 172.21.15.45:0/2465210314 >> 172.21.15.45:0/2465210314 conn(0x7f90d80fc7a0 msgr2=0x7f90d8104a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:06.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.591+0000 7f90dcc3a700 1 -- 172.21.15.45:0/2465210314 shutdown_connections 2024-05-10T03:38:06.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:06.591+0000 7f90dcc3a700 1 -- 172.21.15.45:0/2465210314 wait complete. 2024-05-10T03:38:06.992 INFO:tasks.cephadm:Adding mds.a on smithi045 2024-05-10T03:38:06.992 INFO:tasks.cephadm:Adding mds.d on smithi045 2024-05-10T03:38:06.993 INFO:tasks.cephadm:Adding mds.g on smithi045 2024-05-10T03:38:06.993 INFO:tasks.cephadm:Adding mds.j on smithi045 2024-05-10T03:38:06.993 INFO:tasks.cephadm:Adding mds.b on smithi106 2024-05-10T03:38:06.993 INFO:tasks.cephadm:Adding mds.e on smithi106 2024-05-10T03:38:06.993 INFO:tasks.cephadm:Adding mds.h on smithi106 2024-05-10T03:38:06.993 INFO:tasks.cephadm:Adding mds.k on smithi106 2024-05-10T03:38:06.994 INFO:tasks.cephadm:Adding mds.c on smithi154 2024-05-10T03:38:06.994 INFO:tasks.cephadm:Adding mds.f on smithi154 2024-05-10T03:38:06.994 INFO:tasks.cephadm:Adding mds.i on smithi154 2024-05-10T03:38:06.994 INFO:tasks.cephadm:Adding mds.l on smithi154 2024-05-10T03:38:06.995 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph orch apply mds all '12;smithi045=a;smithi045=d;smithi045=g;smithi045=j;smithi106=b;smithi106=e;smithi106=h;smithi106=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l' 2024-05-10T03:38:07.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:06 smithi154 ceph-mon[46565]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:07.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:06 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2465210314' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:38:07.233 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T03:38:07.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:06 smithi045 ceph-mon[42520]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:07.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:06 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2465210314' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:38:07.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:06 smithi106 ceph-mon[46996]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:07.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:06 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2465210314' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:38:08.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.237+0000 7fb5fb56a700 1 -- 172.21.15.154:0/3001152396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f4102650 msgr2=0x7fb5f4108f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:08.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.237+0000 7fb5fb56a700 1 --2- 172.21.15.154:0/3001152396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f4102650 0x7fb5f4108f00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00b0a0 tx=0x7fb5ec00b3b0 comp rx=0 tx=0).stop 2024-05-10T03:38:08.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.237+0000 7fb5fb56a700 1 -- 172.21.15.154:0/3001152396 shutdown_connections 2024-05-10T03:38:08.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.237+0000 7fb5fb56a700 1 --2- 172.21.15.154:0/3001152396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f4102650 0x7fb5f4108f00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:08.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.237+0000 7fb5fb56a700 1 --2- 172.21.15.154:0/3001152396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f4100b80 0x7fb5f4100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:08.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.237+0000 7fb5fb56a700 1 --2- 172.21.15.154:0/3001152396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5f4101cb0 0x7fb5f41020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:08.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.237+0000 7fb5fb56a700 1 -- 172.21.15.154:0/3001152396 >> 172.21.15.154:0/3001152396 conn(0x7fb5f40fc1c0 msgr2=0x7fb5f40fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:08.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.237+0000 7fb5fb56a700 1 -- 172.21.15.154:0/3001152396 shutdown_connections 2024-05-10T03:38:08.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.237+0000 7fb5fb56a700 1 -- 172.21.15.154:0/3001152396 wait complete. 2024-05-10T03:38:08.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.238+0000 7fb5fb56a700 1 Processor -- start 2024-05-10T03:38:08.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.238+0000 7fb5fb56a700 1 -- start start 2024-05-10T03:38:08.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.238+0000 7fb5fb56a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f4100b80 0x7fb5f419af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:08.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.238+0000 7fb5fb56a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f4101cb0 0x7fb5f419d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:08.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.238+0000 7fb5fb56a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5f4102650 0x7fb5f419fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:08.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.238+0000 7fb5fb56a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f419ff60 con 0x7fb5f4102650 2024-05-10T03:38:08.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.238+0000 7fb5fb56a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f41a00a0 con 0x7fb5f4100b80 2024-05-10T03:38:08.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.238+0000 7fb5fb56a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f41a01e0 con 0x7fb5f4101cb0 2024-05-10T03:38:08.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.238+0000 7fb5f8b05700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f4101cb0 0x7fb5f419d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:08.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.238+0000 7fb5f8b05700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f4101cb0 0x7fb5f419d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35954/0 (socket says 172.21.15.154:35954) 2024-05-10T03:38:08.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.238+0000 7fb5f8b05700 1 -- 172.21.15.154:0/2391340429 learned_addr learned my addr 172.21.15.154:0/2391340429 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-05-10T03:38:08.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.238+0000 7fb5f9306700 1 --2- 172.21.15.154:0/2391340429 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f4100b80 0x7fb5f419af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:08.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.238+0000 7fb5f9b07700 1 --2- 172.21.15.154:0/2391340429 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5f4102650 0x7fb5f419fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:08.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.238+0000 7fb5f8b05700 1 -- 172.21.15.154:0/2391340429 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f4100b80 msgr2=0x7fb5f419af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:08.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.238+0000 7fb5f8b05700 1 --2- 172.21.15.154:0/2391340429 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f4100b80 0x7fb5f419af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:08.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.238+0000 7fb5f8b05700 1 -- 172.21.15.154:0/2391340429 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5f4102650 msgr2=0x7fb5f419fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:08.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.238+0000 7fb5f8b05700 1 --2- 172.21.15.154:0/2391340429 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5f4102650 0x7fb5f419fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:08.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.238+0000 7fb5f8b05700 1 -- 172.21.15.154:0/2391340429 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec009d00 con 0x7fb5f4101cb0 2024-05-10T03:38:08.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.238+0000 7fb5f9306700 1 --2- 172.21.15.154:0/2391340429 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f4100b80 0x7fb5f419af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:38:08.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.238+0000 7fb5f9b07700 1 --2- 172.21.15.154:0/2391340429 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5f4102650 0x7fb5f419fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:38:08.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.238+0000 7fb5f8b05700 1 --2- 172.21.15.154:0/2391340429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f4101cb0 0x7fb5f419d4d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000c920 tx=0x7fb5f000cce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:08.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.239+0000 7fb5e67fc700 1 -- 172.21.15.154:0/2391340429 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0007b00 con 0x7fb5f4101cb0 2024-05-10T03:38:08.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.239+0000 7fb5e67fc700 1 -- 172.21.15.154:0/2391340429 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb5f0004d10 con 0x7fb5f4101cb0 2024-05-10T03:38:08.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.239+0000 7fb5fb56a700 1 -- 172.21.15.154:0/2391340429 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f41a0410 con 0x7fb5f4101cb0 2024-05-10T03:38:08.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.239+0000 7fb5e67fc700 1 -- 172.21.15.154:0/2391340429 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0005660 con 0x7fb5f4101cb0 2024-05-10T03:38:08.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.239+0000 7fb5fb56a700 1 -- 172.21.15.154:0/2391340429 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f41a0910 con 0x7fb5f4101cb0 2024-05-10T03:38:08.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.240+0000 7fb5fb56a700 1 -- 172.21.15.154:0/2391340429 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f4107da0 con 0x7fb5f4101cb0 2024-05-10T03:38:08.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.241+0000 7fb5e67fc700 1 -- 172.21.15.154:0/2391340429 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb5f0004750 con 0x7fb5f4101cb0 2024-05-10T03:38:08.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.242+0000 7fb5e67fc700 1 --2- 172.21.15.154:0/2391340429 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb5e00a11a0 0x7fb5e00a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:08.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.242+0000 7fb5e67fc700 1 -- 172.21.15.154:0/2391340429 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb5f00cc6c0 con 0x7fb5f4101cb0 2024-05-10T03:38:08.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.242+0000 7fb5f9306700 1 --2- 172.21.15.154:0/2391340429 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb5e00a11a0 0x7fb5e00a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:08.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.242+0000 7fb5f9306700 1 --2- 172.21.15.154:0/2391340429 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb5e00a11a0 0x7fb5e00a36b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8005fd0 tx=0x7fb5e8005f20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:08.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.245+0000 7fb5e67fc700 1 -- 172.21.15.154:0/2391340429 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb5f0096250 con 0x7fb5f4101cb0 2024-05-10T03:38:08.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.449+0000 7fb5fb56a700 1 -- 172.21.15.154:0/2391340429 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi045=a;smithi045=d;smithi045=g;smithi045=j;smithi106=b;smithi106=e;smithi106=h;smithi106=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5f4061650 con 0x7fb5e00a11a0 2024-05-10T03:38:08.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.458+0000 7fb5e67fc700 1 -- 172.21.15.154:0/2391340429 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fb5f4061650 con 0x7fb5e00a11a0 2024-05-10T03:38:08.462 INFO:teuthology.orchestra.run.smithi154.stdout:Scheduled mds.all update... 2024-05-10T03:38:08.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.460+0000 7fb5fb56a700 1 -- 172.21.15.154:0/2391340429 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb5e00a11a0 msgr2=0x7fb5e00a36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:08.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.460+0000 7fb5fb56a700 1 --2- 172.21.15.154:0/2391340429 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb5e00a11a0 0x7fb5e00a36b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8005fd0 tx=0x7fb5e8005f20 comp rx=0 tx=0).stop 2024-05-10T03:38:08.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.460+0000 7fb5fb56a700 1 -- 172.21.15.154:0/2391340429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f4101cb0 msgr2=0x7fb5f419d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:08.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.460+0000 7fb5fb56a700 1 --2- 172.21.15.154:0/2391340429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f4101cb0 0x7fb5f419d4d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000c920 tx=0x7fb5f000cce0 comp rx=0 tx=0).stop 2024-05-10T03:38:08.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.460+0000 7fb5fb56a700 1 -- 172.21.15.154:0/2391340429 shutdown_connections 2024-05-10T03:38:08.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.460+0000 7fb5fb56a700 1 --2- 172.21.15.154:0/2391340429 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb5e00a11a0 0x7fb5e00a36b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:08.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.460+0000 7fb5fb56a700 1 --2- 172.21.15.154:0/2391340429 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5f4102650 0x7fb5f419fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:08.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.460+0000 7fb5fb56a700 1 --2- 172.21.15.154:0/2391340429 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f4100b80 0x7fb5f419af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:08.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.460+0000 7fb5fb56a700 1 --2- 172.21.15.154:0/2391340429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f4101cb0 0x7fb5f419d4d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:08.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.460+0000 7fb5fb56a700 1 -- 172.21.15.154:0/2391340429 >> 172.21.15.154:0/2391340429 conn(0x7fb5f40fc1c0 msgr2=0x7fb5f4104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:08.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.460+0000 7fb5fb56a700 1 -- 172.21.15.154:0/2391340429 shutdown_connections 2024-05-10T03:38:08.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-05-10T03:38:08.460+0000 7fb5fb56a700 1 -- 172.21.15.154:0/2391340429 wait complete. 2024-05-10T03:38:08.862 DEBUG:teuthology.orchestra.run.smithi045:mds.a> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.a.service 2024-05-10T03:38:08.865 DEBUG:teuthology.orchestra.run.smithi045:mds.d> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.d.service 2024-05-10T03:38:08.898 INFO:journalctl@ceph.mds.a.smithi045.stdout:-- Logs begin at Fri 2024-05-10 03:15:08 UTC. -- 2024-05-10T03:38:08.899 DEBUG:teuthology.orchestra.run.smithi045:mds.g> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.g.service 2024-05-10T03:38:08.931 INFO:journalctl@ceph.mds.d.smithi045.stdout:-- Logs begin at Fri 2024-05-10 03:15:08 UTC. -- 2024-05-10T03:38:08.933 DEBUG:teuthology.orchestra.run.smithi045:mds.j> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.j.service 2024-05-10T03:38:08.962 INFO:journalctl@ceph.mds.g.smithi045.stdout:-- Logs begin at Fri 2024-05-10 03:15:08 UTC. -- 2024-05-10T03:38:08.963 DEBUG:teuthology.orchestra.run.smithi106:mds.b> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.b.service 2024-05-10T03:38:08.966 DEBUG:teuthology.orchestra.run.smithi106:mds.e> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.e.service 2024-05-10T03:38:08.993 INFO:journalctl@ceph.mds.j.smithi045.stdout:-- Logs begin at Fri 2024-05-10 03:15:08 UTC. -- 2024-05-10T03:38:09.004 INFO:journalctl@ceph.mds.b.smithi106.stdout:-- Logs begin at Fri 2024-05-10 03:15:26 UTC. -- 2024-05-10T03:38:09.006 DEBUG:teuthology.orchestra.run.smithi106:mds.h> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.h.service 2024-05-10T03:38:09.036 INFO:journalctl@ceph.mds.e.smithi106.stdout:-- Logs begin at Fri 2024-05-10 03:15:26 UTC. -- 2024-05-10T03:38:09.037 DEBUG:teuthology.orchestra.run.smithi106:mds.k> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.k.service 2024-05-10T03:38:09.064 INFO:journalctl@ceph.mds.h.smithi106.stdout:-- Logs begin at Fri 2024-05-10 03:15:26 UTC. -- 2024-05-10T03:38:09.065 DEBUG:teuthology.orchestra.run.smithi154:mds.c> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.c.service 2024-05-10T03:38:09.068 DEBUG:teuthology.orchestra.run.smithi154:mds.f> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.f.service 2024-05-10T03:38:09.092 INFO:journalctl@ceph.mds.k.smithi106.stdout:-- Logs begin at Fri 2024-05-10 03:15:26 UTC. -- 2024-05-10T03:38:09.094 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:08 smithi154 ceph-mon[46565]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:09.094 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:08 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:09.094 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:08 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:38:09.094 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:08 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:09.094 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:08 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:38:09.094 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:08 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:09.094 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:08 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:09.094 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:08 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:09.094 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:08 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:09.095 DEBUG:teuthology.orchestra.run.smithi154:mds.i> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.i.service 2024-05-10T03:38:09.101 INFO:journalctl@ceph.mds.c.smithi154.stdout:-- Logs begin at Fri 2024-05-10 03:15:42 UTC. -- 2024-05-10T03:38:09.102 DEBUG:teuthology.orchestra.run.smithi154:mds.l> sudo journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.l.service 2024-05-10T03:38:09.125 INFO:journalctl@ceph.mds.f.smithi154.stdout:-- Logs begin at Fri 2024-05-10 03:15:42 UTC. -- 2024-05-10T03:38:09.126 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-05-10T03:38:09.127 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:38:09.131 INFO:journalctl@ceph.mds.i.smithi154.stdout:-- Logs begin at Fri 2024-05-10 03:15:42 UTC. -- 2024-05-10T03:38:09.156 INFO:journalctl@ceph.mds.l.smithi154.stdout:-- Logs begin at Fri 2024-05-10 03:15:42 UTC. -- 2024-05-10T03:38:09.156 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:08 smithi045 ceph-mon[42520]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:09.157 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:08 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:09.157 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:08 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:38:09.157 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:08 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:09.157 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:08 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:38:09.157 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:08 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:09.157 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:08 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:09.157 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:08 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:09.157 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:08 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:09.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.341+0000 7fb500f6e700 1 -- 172.21.15.45:0/669531088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4fc0fff90 msgr2=0x7fb4fc1003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:09.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.341+0000 7fb500f6e700 1 --2- 172.21.15.45:0/669531088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4fc0fff90 0x7fb4fc1003a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec009990 tx=0x7fb4ec009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:09.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.341+0000 7fb500f6e700 1 -- 172.21.15.45:0/669531088 shutdown_connections 2024-05-10T03:38:09.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.341+0000 7fb500f6e700 1 --2- 172.21.15.45:0/669531088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4fc107a10 0x7fb4fc109e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:09.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.341+0000 7fb500f6e700 1 --2- 172.21.15.45:0/669531088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4fc0fff90 0x7fb4fc1003a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:09.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.341+0000 7fb500f6e700 1 --2- 172.21.15.45:0/669531088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4fc1050b0 0x7fb4fc1074d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:09.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.341+0000 7fb500f6e700 1 -- 172.21.15.45:0/669531088 >> 172.21.15.45:0/669531088 conn(0x7fb4fc0fb880 msgr2=0x7fb4fc0fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:09.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.341+0000 7fb500f6e700 1 -- 172.21.15.45:0/669531088 shutdown_connections 2024-05-10T03:38:09.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.341+0000 7fb500f6e700 1 -- 172.21.15.45:0/669531088 wait complete. 2024-05-10T03:38:09.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.342+0000 7fb500f6e700 1 Processor -- start 2024-05-10T03:38:09.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.342+0000 7fb500f6e700 1 -- start start 2024-05-10T03:38:09.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.343+0000 7fb500f6e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4fc0fff90 0x7fb4fc102880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:09.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.343+0000 7fb500f6e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4fc1050b0 0x7fb4fc100f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:09.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.343+0000 7fb500f6e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4fc107a10 0x7fb4fc101460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:09.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.343+0000 7fb500f6e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc101ac0 con 0x7fb4fc0fff90 2024-05-10T03:38:09.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.343+0000 7fb500f6e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc101c30 con 0x7fb4fc107a10 2024-05-10T03:38:09.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.343+0000 7fb500f6e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc101df0 con 0x7fb4fc1050b0 2024-05-10T03:38:09.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.343+0000 7fb4fa59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4fc0fff90 0x7fb4fc102880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:09.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.343+0000 7fb4fa59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4fc0fff90 0x7fb4fc102880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48532/0 (socket says 172.21.15.45:48532) 2024-05-10T03:38:09.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.343+0000 7fb4fa59c700 1 -- 172.21.15.45:0/1385045260 learned_addr learned my addr 172.21.15.45:0/1385045260 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:09.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.343+0000 7fb4fad9d700 1 --2- 172.21.15.45:0/1385045260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4fc107a10 0x7fb4fc101460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:09.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.343+0000 7fb4f9d9b700 1 --2- 172.21.15.45:0/1385045260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4fc1050b0 0x7fb4fc100f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:09.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.343+0000 7fb4fa59c700 1 -- 172.21.15.45:0/1385045260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4fc1050b0 msgr2=0x7fb4fc100f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:09.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.343+0000 7fb4fa59c700 1 --2- 172.21.15.45:0/1385045260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4fc1050b0 0x7fb4fc100f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:09.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.343+0000 7fb4fa59c700 1 -- 172.21.15.45:0/1385045260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4fc107a10 msgr2=0x7fb4fc101460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:09.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.343+0000 7fb4fa59c700 1 --2- 172.21.15.45:0/1385045260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4fc107a10 0x7fb4fc101460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:09.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.343+0000 7fb4fa59c700 1 -- 172.21.15.45:0/1385045260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ec0095f0 con 0x7fb4fc0fff90 2024-05-10T03:38:09.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.343+0000 7fb4fad9d700 1 --2- 172.21.15.45:0/1385045260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4fc107a10 0x7fb4fc101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:38:09.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.343+0000 7fb4fa59c700 1 --2- 172.21.15.45:0/1385045260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4fc0fff90 0x7fb4fc102880 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec006010 tx=0x7fb4ec00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:09.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.343+0000 7fb4eb7fe700 1 -- 172.21.15.45:0/1385045260 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec01d070 con 0x7fb4fc0fff90 2024-05-10T03:38:09.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.344+0000 7fb500f6e700 1 -- 172.21.15.45:0/1385045260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4fc1a22c0 con 0x7fb4fc0fff90 2024-05-10T03:38:09.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.344+0000 7fb4eb7fe700 1 -- 172.21.15.45:0/1385045260 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb4ec005050 con 0x7fb4fc0fff90 2024-05-10T03:38:09.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.344+0000 7fb4eb7fe700 1 -- 172.21.15.45:0/1385045260 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec0049e0 con 0x7fb4fc0fff90 2024-05-10T03:38:09.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.344+0000 7fb500f6e700 1 -- 172.21.15.45:0/1385045260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4fc1a2740 con 0x7fb4fc0fff90 2024-05-10T03:38:09.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.345+0000 7fb500f6e700 1 -- 172.21.15.45:0/1385045260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4fc0fd430 con 0x7fb4fc0fff90 2024-05-10T03:38:09.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.347+0000 7fb4eb7fe700 1 -- 172.21.15.45:0/1385045260 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb4ec0051c0 con 0x7fb4fc0fff90 2024-05-10T03:38:09.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.347+0000 7fb4eb7fe700 1 --2- 172.21.15.45:0/1385045260 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb4e40a1120 0x7fb4e40a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:09.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.348+0000 7fb4f9d9b700 1 --2- 172.21.15.45:0/1385045260 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb4e40a1120 0x7fb4e40a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:09.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.348+0000 7fb4eb7fe700 1 -- 172.21.15.45:0/1385045260 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb4ec0cd7c0 con 0x7fb4fc0fff90 2024-05-10T03:38:09.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.348+0000 7fb4f9d9b700 1 --2- 172.21.15.45:0/1385045260 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb4e40a1120 0x7fb4e40a3630 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc102220 tx=0x7fb4f00073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:09.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.351+0000 7fb4eb7fe700 1 -- 172.21.15.45:0/1385045260 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb4ec09b030 con 0x7fb4fc0fff90 2024-05-10T03:38:09.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:08 smithi106 ceph-mon[46996]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:09.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:08 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:09.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:08 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:38:09.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:08 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:09.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:08 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:38:09.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:08 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:09.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:08 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:09.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:08 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:09.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:08 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:09.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.571+0000 7fb500f6e700 1 -- 172.21.15.45:0/1385045260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4fc10d550 con 0x7fb4fc0fff90 2024-05-10T03:38:09.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.572+0000 7fb4eb7fe700 1 -- 172.21.15.45:0/1385045260 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+18443 (secure 0 0 0) 0x7fb4ec09abc0 con 0x7fb4fc0fff90 2024-05-10T03:38:09.576 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:38:09.576 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":77,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:38:02.806163+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:38:09.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.574+0000 7fb500f6e700 1 -- 172.21.15.45:0/1385045260 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb4e40a1120 msgr2=0x7fb4e40a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:09.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.574+0000 7fb500f6e700 1 --2- 172.21.15.45:0/1385045260 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb4e40a1120 0x7fb4e40a3630 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc102220 tx=0x7fb4f00073d0 comp rx=0 tx=0).stop 2024-05-10T03:38:09.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.574+0000 7fb500f6e700 1 -- 172.21.15.45:0/1385045260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4fc0fff90 msgr2=0x7fb4fc102880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:09.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.574+0000 7fb500f6e700 1 --2- 172.21.15.45:0/1385045260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4fc0fff90 0x7fb4fc102880 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec006010 tx=0x7fb4ec00f690 comp rx=0 tx=0).stop 2024-05-10T03:38:09.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.574+0000 7fb500f6e700 1 -- 172.21.15.45:0/1385045260 shutdown_connections 2024-05-10T03:38:09.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.574+0000 7fb500f6e700 1 --2- 172.21.15.45:0/1385045260 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb4e40a1120 0x7fb4e40a3630 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:09.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.574+0000 7fb500f6e700 1 --2- 172.21.15.45:0/1385045260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4fc107a10 0x7fb4fc101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:09.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.574+0000 7fb500f6e700 1 --2- 172.21.15.45:0/1385045260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4fc0fff90 0x7fb4fc102880 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:09.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.574+0000 7fb500f6e700 1 --2- 172.21.15.45:0/1385045260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4fc1050b0 0x7fb4fc100f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:09.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.574+0000 7fb500f6e700 1 -- 172.21.15.45:0/1385045260 >> 172.21.15.45:0/1385045260 conn(0x7fb4fc0fb880 msgr2=0x7fb4fc106010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:09.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.575+0000 7fb500f6e700 1 -- 172.21.15.45:0/1385045260 shutdown_connections 2024-05-10T03:38:09.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.575+0000 7fb500f6e700 1 -- 172.21.15.45:0/1385045260 wait complete. 2024-05-10T03:38:09.593 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T03:35:20.339400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T03:38:09.593 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T03:38:09.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.784+0000 7f88f070f700 1 -- 172.21.15.45:0/1406402345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88e8100ac0 msgr2=0x7f88e8100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:09.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.784+0000 7f88f070f700 1 --2- 172.21.15.45:0/1406402345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88e8100ac0 0x7f88e8100ed0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f88e4009990 tx=0x7f88e4009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:09.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.784+0000 7f88f070f700 1 -- 172.21.15.45:0/1406402345 shutdown_connections 2024-05-10T03:38:09.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.784+0000 7f88f070f700 1 --2- 172.21.15.45:0/1406402345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88e8102580 0x7f88e8108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:09.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.784+0000 7f88f070f700 1 --2- 172.21.15.45:0/1406402345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88e8100ac0 0x7f88e8100ed0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:09.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.784+0000 7f88f070f700 1 --2- 172.21.15.45:0/1406402345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e8101be0 0x7f88e8101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:09.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.784+0000 7f88f070f700 1 -- 172.21.15.45:0/1406402345 >> 172.21.15.45:0/1406402345 conn(0x7f88e80fc0d0 msgr2=0x7f88e80fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:09.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.784+0000 7f88f070f700 1 -- 172.21.15.45:0/1406402345 shutdown_connections 2024-05-10T03:38:09.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.784+0000 7f88f070f700 1 -- 172.21.15.45:0/1406402345 wait complete. 2024-05-10T03:38:09.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.785+0000 7f88f070f700 1 Processor -- start 2024-05-10T03:38:09.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.785+0000 7f88f070f700 1 -- start start 2024-05-10T03:38:09.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.785+0000 7f88f070f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88e8100ac0 0x7f88e8197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:09.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.785+0000 7f88f070f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e8101be0 0x7f88e8198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:09.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.785+0000 7f88f070f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88e8102580 0x7f88e819f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:09.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.785+0000 7f88f070f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e819fab0 con 0x7f88e8100ac0 2024-05-10T03:38:09.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.785+0000 7f88f070f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e819fc20 con 0x7f88e8102580 2024-05-10T03:38:09.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.785+0000 7f88f070f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e819fde0 con 0x7f88e8101be0 2024-05-10T03:38:09.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.785+0000 7f88ee4ab700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88e8100ac0 0x7f88e8197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:09.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.786+0000 7f88ee4ab700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88e8100ac0 0x7f88e8197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48554/0 (socket says 172.21.15.45:48554) 2024-05-10T03:38:09.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.786+0000 7f88ee4ab700 1 -- 172.21.15.45:0/3785496798 learned_addr learned my addr 172.21.15.45:0/3785496798 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:09.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.786+0000 7f88edcaa700 1 --2- 172.21.15.45:0/3785496798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e8101be0 0x7f88e8198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:09.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.786+0000 7f88eecac700 1 --2- 172.21.15.45:0/3785496798 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88e8102580 0x7f88e819f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:09.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.786+0000 7f88ee4ab700 1 -- 172.21.15.45:0/3785496798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e8101be0 msgr2=0x7f88e8198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:09.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.786+0000 7f88ee4ab700 1 --2- 172.21.15.45:0/3785496798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e8101be0 0x7f88e8198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:09.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.786+0000 7f88ee4ab700 1 -- 172.21.15.45:0/3785496798 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88e8102580 msgr2=0x7f88e819f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:09.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.786+0000 7f88ee4ab700 1 --2- 172.21.15.45:0/3785496798 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88e8102580 0x7f88e819f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:09.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.786+0000 7f88ee4ab700 1 -- 172.21.15.45:0/3785496798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e40095f0 con 0x7f88e8100ac0 2024-05-10T03:38:09.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.786+0000 7f88ee4ab700 1 --2- 172.21.15.45:0/3785496798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88e8100ac0 0x7f88e8197fd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f88e40098e0 tx=0x7f88e4005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:09.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.786+0000 7f88df7fe700 1 -- 172.21.15.45:0/3785496798 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e401d070 con 0x7f88e8100ac0 2024-05-10T03:38:09.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.786+0000 7f88df7fe700 1 -- 172.21.15.45:0/3785496798 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f88e400be70 con 0x7f88e8100ac0 2024-05-10T03:38:09.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.786+0000 7f88f070f700 1 -- 172.21.15.45:0/3785496798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e81a0060 con 0x7f88e8100ac0 2024-05-10T03:38:09.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.786+0000 7f88df7fe700 1 -- 172.21.15.45:0/3785496798 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e40173f0 con 0x7f88e8100ac0 2024-05-10T03:38:09.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.786+0000 7f88f070f700 1 -- 172.21.15.45:0/3785496798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e81a0480 con 0x7f88e8100ac0 2024-05-10T03:38:09.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.787+0000 7f88f070f700 1 -- 172.21.15.45:0/3785496798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e80694d0 con 0x7f88e8100ac0 2024-05-10T03:38:09.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.789+0000 7f88df7fe700 1 -- 172.21.15.45:0/3785496798 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f88e4021410 con 0x7f88e8100ac0 2024-05-10T03:38:09.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.789+0000 7f88df7fe700 1 --2- 172.21.15.45:0/3785496798 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f88d40a11c0 0x7f88d40a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:09.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.790+0000 7f88edcaa700 1 --2- 172.21.15.45:0/3785496798 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f88d40a11c0 0x7f88d40a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:09.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.790+0000 7f88df7fe700 1 -- 172.21.15.45:0/3785496798 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f88e40cda20 con 0x7f88e8100ac0 2024-05-10T03:38:09.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.790+0000 7f88edcaa700 1 --2- 172.21.15.45:0/3785496798 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f88d40a11c0 0x7f88d40a36d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f88e8199070 tx=0x7f88d8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:09.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:09.793+0000 7f88df7fe700 1 -- 172.21.15.45:0/3785496798 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f88e40976e0 con 0x7f88e8100ac0 2024-05-10T03:38:10.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.011+0000 7f88f070f700 1 -- 172.21.15.45:0/3785496798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f88e81a07a0 con 0x7f88e8100ac0 2024-05-10T03:38:10.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.012+0000 7f88df7fe700 1 -- 172.21.15.45:0/3785496798 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7f88e409ad00 con 0x7f88e8100ac0 2024-05-10T03:38:10.015 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-05-10T03:38:10.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.014+0000 7f88f070f700 1 -- 172.21.15.45:0/3785496798 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f88d40a11c0 msgr2=0x7f88d40a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:10.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.014+0000 7f88f070f700 1 --2- 172.21.15.45:0/3785496798 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f88d40a11c0 0x7f88d40a36d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f88e8199070 tx=0x7f88d8009260 comp rx=0 tx=0).stop 2024-05-10T03:38:10.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.014+0000 7f88f070f700 1 -- 172.21.15.45:0/3785496798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88e8100ac0 msgr2=0x7f88e8197fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:10.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.014+0000 7f88f070f700 1 --2- 172.21.15.45:0/3785496798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88e8100ac0 0x7f88e8197fd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f88e40098e0 tx=0x7f88e4005b00 comp rx=0 tx=0).stop 2024-05-10T03:38:10.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.014+0000 7f88f070f700 1 -- 172.21.15.45:0/3785496798 shutdown_connections 2024-05-10T03:38:10.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.014+0000 7f88f070f700 1 --2- 172.21.15.45:0/3785496798 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f88d40a11c0 0x7f88d40a36d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:10.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.014+0000 7f88f070f700 1 --2- 172.21.15.45:0/3785496798 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88e8102580 0x7f88e819f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:10.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.014+0000 7f88f070f700 1 --2- 172.21.15.45:0/3785496798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88e8100ac0 0x7f88e8197fd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:10.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.014+0000 7f88f070f700 1 --2- 172.21.15.45:0/3785496798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88e8101be0 0x7f88e8198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:10.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.014+0000 7f88f070f700 1 -- 172.21.15.45:0/3785496798 >> 172.21.15.45:0/3785496798 conn(0x7f88e80fc0d0 msgr2=0x7f88e80fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:10.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.014+0000 7f88f070f700 1 -- 172.21.15.45:0/3785496798 shutdown_connections 2024-05-10T03:38:10.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.014+0000 7f88f070f700 1 -- 172.21.15.45:0/3785496798 wait complete. 2024-05-10T03:38:10.032 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:38:10.105 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:09 smithi154 ceph-mon[46565]: from='client.24454 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi045=a;smithi045=d;smithi045=g;smithi045=j;smithi106=b;smithi106=e;smithi106=h;smithi106=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:38:10.106 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:09 smithi154 ceph-mon[46565]: Saving service mds.all spec with placement smithi045=a;smithi045=d;smithi045=g;smithi045=j;smithi106=b;smithi106=e;smithi106=h;smithi106=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l;count:12 2024-05-10T03:38:10.106 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:09 smithi154 ceph-mon[46565]: Deploying daemon mds.l on smithi154 2024-05-10T03:38:10.106 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:09 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1385045260' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:10.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.177+0000 7f318e924700 1 -- 172.21.15.45:0/81719237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3188100ac0 msgr2=0x7f3188100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:10.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.177+0000 7f318e924700 1 --2- 172.21.15.45:0/81719237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3188100ac0 0x7f3188100ed0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3178009990 tx=0x7f3178009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:10.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.177+0000 7f318e924700 1 -- 172.21.15.45:0/81719237 shutdown_connections 2024-05-10T03:38:10.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.177+0000 7f318e924700 1 --2- 172.21.15.45:0/81719237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3188102580 0x7f3188108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:10.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.177+0000 7f318e924700 1 --2- 172.21.15.45:0/81719237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3188100ac0 0x7f3188100ed0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:10.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.177+0000 7f318e924700 1 --2- 172.21.15.45:0/81719237 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3188101be0 0x7f3188101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:10.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.177+0000 7f318e924700 1 -- 172.21.15.45:0/81719237 >> 172.21.15.45:0/81719237 conn(0x7f31880fc0d0 msgr2=0x7f31880fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:10.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.177+0000 7f318e924700 1 -- 172.21.15.45:0/81719237 shutdown_connections 2024-05-10T03:38:10.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.177+0000 7f318e924700 1 -- 172.21.15.45:0/81719237 wait complete. 2024-05-10T03:38:10.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.178+0000 7f318e924700 1 Processor -- start 2024-05-10T03:38:10.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.178+0000 7f318e924700 1 -- start start 2024-05-10T03:38:10.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.179+0000 7f318e924700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3188100ac0 0x7f31881980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:10.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.179+0000 7f318e924700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3188101be0 0x7f31881985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:10.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.179+0000 7f318e924700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3188102580 0x7f318819f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:10.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.179+0000 7f318e924700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318819fb90 con 0x7f3188101be0 2024-05-10T03:38:10.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.179+0000 7f318e924700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318819fd00 con 0x7f3188102580 2024-05-10T03:38:10.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.179+0000 7f318e924700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318819fec0 con 0x7f3188100ac0 2024-05-10T03:38:10.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.179+0000 7f31877fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3188101be0 0x7f31881985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:10.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.179+0000 7f3187fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3188100ac0 0x7f31881980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:10.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.179+0000 7f3187fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3188100ac0 0x7f31881980b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:33270/0 (socket says 172.21.15.45:33270) 2024-05-10T03:38:10.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.179+0000 7f31877fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3188101be0 0x7f31881985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48574/0 (socket says 172.21.15.45:48574) 2024-05-10T03:38:10.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.179+0000 7f3187fff700 1 -- 172.21.15.45:0/3537575498 learned_addr learned my addr 172.21.15.45:0/3537575498 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:10.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.179+0000 7f318cec1700 1 --2- 172.21.15.45:0/3537575498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3188102580 0x7f318819f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:10.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.179+0000 7f3187fff700 1 -- 172.21.15.45:0/3537575498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3188102580 msgr2=0x7f318819f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:10.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.179+0000 7f3187fff700 1 --2- 172.21.15.45:0/3537575498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3188102580 0x7f318819f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:10.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.179+0000 7f3187fff700 1 -- 172.21.15.45:0/3537575498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3188101be0 msgr2=0x7f31881985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:10.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.179+0000 7f3187fff700 1 --2- 172.21.15.45:0/3537575498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3188101be0 0x7f31881985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:10.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.179+0000 7f3187fff700 1 -- 172.21.15.45:0/3537575498 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3180009c40 con 0x7f3188100ac0 2024-05-10T03:38:10.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.179+0000 7f318cec1700 1 --2- 172.21.15.45:0/3537575498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3188102580 0x7f318819f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:38:10.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.179+0000 7f3187fff700 1 --2- 172.21.15.45:0/3537575498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3188100ac0 0x7f31881980b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3178000c00 tx=0x7f317800f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:10.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.179+0000 7f31857fa700 1 -- 172.21.15.45:0/3537575498 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317801d070 con 0x7f3188100ac0 2024-05-10T03:38:10.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.180+0000 7f31857fa700 1 -- 172.21.15.45:0/3537575498 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f317800fe90 con 0x7f3188100ac0 2024-05-10T03:38:10.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.180+0000 7f318e924700 1 -- 172.21.15.45:0/3537575498 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31780095f0 con 0x7f3188100ac0 2024-05-10T03:38:10.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.180+0000 7f31857fa700 1 -- 172.21.15.45:0/3537575498 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31780173f0 con 0x7f3188100ac0 2024-05-10T03:38:10.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.180+0000 7f318e924700 1 -- 172.21.15.45:0/3537575498 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31881a03d0 con 0x7f3188100ac0 2024-05-10T03:38:10.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.181+0000 7f318e924700 1 -- 172.21.15.45:0/3537575498 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31880694d0 con 0x7f3188100ac0 2024-05-10T03:38:10.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.182+0000 7f31857fa700 1 -- 172.21.15.45:0/3537575498 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3178021410 con 0x7f3188100ac0 2024-05-10T03:38:10.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.182+0000 7f31857fa700 1 --2- 172.21.15.45:0/3537575498 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f31740a1120 0x7f31740a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:10.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.183+0000 7f31877fe700 1 --2- 172.21.15.45:0/3537575498 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f31740a1120 0x7f31740a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:10.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.183+0000 7f31857fa700 1 -- 172.21.15.45:0/3537575498 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f31780cda70 con 0x7f3188100ac0 2024-05-10T03:38:10.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.183+0000 7f31877fe700 1 --2- 172.21.15.45:0/3537575498 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f31740a1120 0x7f31740a3630 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3188199150 tx=0x7f3170009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:10.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.186+0000 7f31857fa700 1 -- 172.21.15.45:0/3537575498 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3178097690 con 0x7f3188100ac0 2024-05-10T03:38:10.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:09 smithi045 ceph-mon[42520]: from='client.24454 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi045=a;smithi045=d;smithi045=g;smithi045=j;smithi106=b;smithi106=e;smithi106=h;smithi106=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:38:10.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:09 smithi045 ceph-mon[42520]: Saving service mds.all spec with placement smithi045=a;smithi045=d;smithi045=g;smithi045=j;smithi106=b;smithi106=e;smithi106=h;smithi106=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l;count:12 2024-05-10T03:38:10.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:09 smithi045 ceph-mon[42520]: Deploying daemon mds.l on smithi154 2024-05-10T03:38:10.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:09 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1385045260' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:10.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:09 smithi106 ceph-mon[46996]: from='client.24454 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi045=a;smithi045=d;smithi045=g;smithi045=j;smithi106=b;smithi106=e;smithi106=h;smithi106=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:38:10.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:09 smithi106 ceph-mon[46996]: Saving service mds.all spec with placement smithi045=a;smithi045=d;smithi045=g;smithi045=j;smithi106=b;smithi106=e;smithi106=h;smithi106=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l;count:12 2024-05-10T03:38:10.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:09 smithi106 ceph-mon[46996]: Deploying daemon mds.l on smithi154 2024-05-10T03:38:10.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:09 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1385045260' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:10.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.455+0000 7f318e924700 1 -- 172.21.15.45:0/3537575498 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f318810c3e0 con 0x7f3188100ac0 2024-05-10T03:38:10.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.456+0000 7f31857fa700 1 -- 172.21.15.45:0/3537575498 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7f317809acb0 con 0x7f3188100ac0 2024-05-10T03:38:10.460 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:38:10.460 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-05-10T03:38:10.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.458+0000 7f318e924700 1 -- 172.21.15.45:0/3537575498 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f31740a1120 msgr2=0x7f31740a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:10.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.458+0000 7f318e924700 1 --2- 172.21.15.45:0/3537575498 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f31740a1120 0x7f31740a3630 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3188199150 tx=0x7f3170009260 comp rx=0 tx=0).stop 2024-05-10T03:38:10.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.458+0000 7f318e924700 1 -- 172.21.15.45:0/3537575498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3188100ac0 msgr2=0x7f31881980b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:10.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.458+0000 7f318e924700 1 --2- 172.21.15.45:0/3537575498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3188100ac0 0x7f31881980b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3178000c00 tx=0x7f317800f690 comp rx=0 tx=0).stop 2024-05-10T03:38:10.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.458+0000 7f318e924700 1 -- 172.21.15.45:0/3537575498 shutdown_connections 2024-05-10T03:38:10.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.459+0000 7f318e924700 1 --2- 172.21.15.45:0/3537575498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3188100ac0 0x7f31881980b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:10.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.459+0000 7f318e924700 1 --2- 172.21.15.45:0/3537575498 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f31740a1120 0x7f31740a3630 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:10.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.459+0000 7f318e924700 1 --2- 172.21.15.45:0/3537575498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3188102580 0x7f318819f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:10.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.459+0000 7f318e924700 1 --2- 172.21.15.45:0/3537575498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3188101be0 0x7f31881985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:10.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.459+0000 7f318e924700 1 -- 172.21.15.45:0/3537575498 >> 172.21.15.45:0/3537575498 conn(0x7f31880fc0d0 msgr2=0x7f31880fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:10.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.459+0000 7f318e924700 1 -- 172.21.15.45:0/3537575498 shutdown_connections 2024-05-10T03:38:10.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:10.459+0000 7f318e924700 1 -- 172.21.15.45:0/3537575498 wait complete. 2024-05-10T03:38:10.464 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 1 2024-05-10T03:38:10.474 INFO:journalctl@ceph.mds.l.smithi154.stdout:May 10 03:38:10 smithi154 systemd[1]: Starting Ceph mds.l for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:38:10.932 INFO:journalctl@ceph.mds.l.smithi154.stdout:May 10 03:38:10 smithi154 bash[82371]: d3d56278b277beb3951202ed7709a15d85ad3e70031134b1b0d6996970b01921 2024-05-10T03:38:10.932 INFO:journalctl@ceph.mds.l.smithi154.stdout:May 10 03:38:10 smithi154 systemd[1]: Started Ceph mds.l for d2a0bafa-0e7d-11ef-bc98-c7b262605968. 2024-05-10T03:38:10.932 INFO:journalctl@ceph.mds.l.smithi154.stdout:May 10 03:38:10 smithi154 ceph-mds[82409]: -- 172.21.15.154:0/3416114652 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c6c46681a0 con 0x55c6c46c8d00 2024-05-10T03:38:10.932 INFO:journalctl@ceph.mds.l.smithi154.stdout:May 10 03:38:10 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-l[82386]: starting mds.l at 2024-05-10T03:38:11.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:10 smithi154 ceph-mon[46565]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:11.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:10 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3785496798' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:38:11.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:10 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3537575498' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:11.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:10 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.154:6832/4274344062,v1:172.21.15.154:6833/4274344062] up:boot 2024-05-10T03:38:11.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:10 smithi154 ceph-mon[46565]: fsmap 1 up:standby 2024-05-10T03:38:11.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:10 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-10T03:38:11.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:10 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:11.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:10 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:11.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:10 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:11.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:10 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:11.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:10 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:11.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:10 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:11.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:10 smithi045 ceph-mon[42520]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:11.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:10 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3785496798' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:38:11.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:10 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3537575498' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:11.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:10 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.154:6832/4274344062,v1:172.21.15.154:6833/4274344062] up:boot 2024-05-10T03:38:11.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:10 smithi045 ceph-mon[42520]: fsmap 1 up:standby 2024-05-10T03:38:11.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:10 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-10T03:38:11.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:10 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:11.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:10 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:11.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:10 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:11.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:10 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:11.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:10 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:11.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:10 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:11.307 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:10 smithi106 ceph-mon[46996]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:11.307 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:10 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3785496798' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:38:11.307 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:10 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3537575498' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:11.307 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:10 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.154:6832/4274344062,v1:172.21.15.154:6833/4274344062] up:boot 2024-05-10T03:38:11.307 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:10 smithi106 ceph-mon[46996]: fsmap 1 up:standby 2024-05-10T03:38:11.307 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:10 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-10T03:38:11.307 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:10 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:11.307 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:10 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:11.307 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:10 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:11.308 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:10 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:11.308 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:10 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:11.308 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:10 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:12.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:11 smithi106 ceph-mon[46996]: Deploying daemon mds.k on smithi106 2024-05-10T03:38:12.152 INFO:journalctl@ceph.mds.k.smithi106.stdout:May 10 03:38:11 smithi106 systemd[1]: Starting Ceph mds.k for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:38:12.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:11 smithi154 ceph-mon[46565]: Deploying daemon mds.k on smithi106 2024-05-10T03:38:12.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:11 smithi045 ceph-mon[42520]: Deploying daemon mds.k on smithi106 2024-05-10T03:38:12.477 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:38:12.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.635+0000 7f9458e7f700 1 -- 172.21.15.45:0/2047072280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9454105010 msgr2=0x7f9454107430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:12.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.635+0000 7f9458e7f700 1 --2- 172.21.15.45:0/2047072280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9454105010 0x7f9454107430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9448009990 tx=0x7f9448009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:12.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.635+0000 7f9458e7f700 1 -- 172.21.15.45:0/2047072280 shutdown_connections 2024-05-10T03:38:12.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.635+0000 7f9458e7f700 1 --2- 172.21.15.45:0/2047072280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9454107970 0x7f9454109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:12.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.635+0000 7f9458e7f700 1 --2- 172.21.15.45:0/2047072280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94541026b0 0x7f9454104ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:12.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.635+0000 7f9458e7f700 1 --2- 172.21.15.45:0/2047072280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9454105010 0x7f9454107430 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:12.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.635+0000 7f9458e7f700 1 -- 172.21.15.45:0/2047072280 >> 172.21.15.45:0/2047072280 conn(0x7f94540fc0d0 msgr2=0x7f94540fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:12.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.635+0000 7f9458e7f700 1 -- 172.21.15.45:0/2047072280 shutdown_connections 2024-05-10T03:38:12.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.635+0000 7f9458e7f700 1 -- 172.21.15.45:0/2047072280 wait complete. 2024-05-10T03:38:12.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.636+0000 7f9458e7f700 1 Processor -- start 2024-05-10T03:38:12.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.636+0000 7f9458e7f700 1 -- start start 2024-05-10T03:38:12.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.636+0000 7f9458e7f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94541026b0 0x7f9454198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:12.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.636+0000 7f9458e7f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9454105010 0x7f9454198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:12.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.636+0000 7f9458e7f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9454107970 0x7f945419f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:12.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.636+0000 7f9458e7f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945419fbd0 con 0x7f94541026b0 2024-05-10T03:38:12.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.636+0000 7f9458e7f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945419fd40 con 0x7f9454107970 2024-05-10T03:38:12.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.636+0000 7f9458e7f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945419ff00 con 0x7f9454105010 2024-05-10T03:38:12.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.636+0000 7f945259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94541026b0 0x7f9454198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:12.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.636+0000 7f945259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94541026b0 0x7f9454198140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48592/0 (socket says 172.21.15.45:48592) 2024-05-10T03:38:12.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.636+0000 7f9452d9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9454107970 0x7f945419f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:12.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.636+0000 7f945259c700 1 -- 172.21.15.45:0/803723100 learned_addr learned my addr 172.21.15.45:0/803723100 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:12.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.636+0000 7f9451d9b700 1 --2- 172.21.15.45:0/803723100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9454105010 0x7f9454198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:12.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.637+0000 7f945259c700 1 -- 172.21.15.45:0/803723100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9454105010 msgr2=0x7f9454198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:12.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.637+0000 7f945259c700 1 --2- 172.21.15.45:0/803723100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9454105010 0x7f9454198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:12.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.637+0000 7f945259c700 1 -- 172.21.15.45:0/803723100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9454107970 msgr2=0x7f945419f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:12.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.637+0000 7f945259c700 1 --2- 172.21.15.45:0/803723100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9454107970 0x7f945419f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:12.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.637+0000 7f945259c700 1 -- 172.21.15.45:0/803723100 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94480095f0 con 0x7f94541026b0 2024-05-10T03:38:12.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.637+0000 7f9451d9b700 1 --2- 172.21.15.45:0/803723100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9454105010 0x7f9454198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:38:12.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.637+0000 7f945259c700 1 --2- 172.21.15.45:0/803723100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94541026b0 0x7f9454198140 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f944400e970 tx=0x7f944400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:12.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.637+0000 7f94437fe700 1 -- 172.21.15.45:0/803723100 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9444009790 con 0x7f94541026b0 2024-05-10T03:38:12.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.637+0000 7f94437fe700 1 -- 172.21.15.45:0/803723100 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f944400eec0 con 0x7f94541026b0 2024-05-10T03:38:12.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.637+0000 7f9458e7f700 1 -- 172.21.15.45:0/803723100 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94541a01e0 con 0x7f94541026b0 2024-05-10T03:38:12.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.637+0000 7f94437fe700 1 -- 172.21.15.45:0/803723100 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9444005690 con 0x7f94541026b0 2024-05-10T03:38:12.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.637+0000 7f9458e7f700 1 -- 172.21.15.45:0/803723100 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94541a06f0 con 0x7f94541026b0 2024-05-10T03:38:12.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.638+0000 7f9458e7f700 1 -- 172.21.15.45:0/803723100 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94540fdc80 con 0x7f94541026b0 2024-05-10T03:38:12.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.640+0000 7f94437fe700 1 -- 172.21.15.45:0/803723100 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9444004750 con 0x7f94541026b0 2024-05-10T03:38:12.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.641+0000 7f94437fe700 1 --2- 172.21.15.45:0/803723100 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f943c0a1120 0x7f943c0a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:12.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.641+0000 7f9451d9b700 1 --2- 172.21.15.45:0/803723100 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f943c0a1120 0x7f943c0a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:12.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.641+0000 7f94437fe700 1 -- 172.21.15.45:0/803723100 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9444014070 con 0x7f94541026b0 2024-05-10T03:38:12.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.641+0000 7f9451d9b700 1 --2- 172.21.15.45:0/803723100 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f943c0a1120 0x7f943c0a3630 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f944800b2e0 tx=0x7f944801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:12.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.645+0000 7f94437fe700 1 -- 172.21.15.45:0/803723100 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9444096500 con 0x7f94541026b0 2024-05-10T03:38:12.651 INFO:journalctl@ceph.mds.k.smithi106.stdout:May 10 03:38:12 smithi106 bash[83310]: 35db0d1f7cb52f979ec326ad0de23dbac31abd0a2d6c2e3443bc113f5a4eb35d 2024-05-10T03:38:12.651 INFO:journalctl@ceph.mds.k.smithi106.stdout:May 10 03:38:12 smithi106 systemd[1]: Started Ceph mds.k for d2a0bafa-0e7d-11ef-bc98-c7b262605968. 2024-05-10T03:38:12.651 INFO:journalctl@ceph.mds.k.smithi106.stdout:May 10 03:38:12 smithi106 ceph-mds[83348]: -- 172.21.15.106:0/3539869507 <== mon.2 v2:172.21.15.106:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55583d1d81a0 con 0x55583d238d00 2024-05-10T03:38:12.651 INFO:journalctl@ceph.mds.k.smithi106.stdout:May 10 03:38:12 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-k[83325]: starting mds.k at 2024-05-10T03:38:12.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.953+0000 7f9458e7f700 1 -- 172.21.15.45:0/803723100 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94540694d0 con 0x7f94541026b0 2024-05-10T03:38:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.953+0000 7f94437fe700 1 -- 172.21.15.45:0/803723100 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2020 (secure 0 0 0) 0x7f9444099b20 con 0x7f94541026b0 2024-05-10T03:38:12.957 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:38:12.957 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24491,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-05-10T03:38:12.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.956+0000 7f9458e7f700 1 -- 172.21.15.45:0/803723100 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f943c0a1120 msgr2=0x7f943c0a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:12.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.956+0000 7f9458e7f700 1 --2- 172.21.15.45:0/803723100 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f943c0a1120 0x7f943c0a3630 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f944800b2e0 tx=0x7f944801a040 comp rx=0 tx=0).stop 2024-05-10T03:38:12.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.956+0000 7f9458e7f700 1 -- 172.21.15.45:0/803723100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94541026b0 msgr2=0x7f9454198140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:12.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.956+0000 7f9458e7f700 1 --2- 172.21.15.45:0/803723100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94541026b0 0x7f9454198140 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f944400e970 tx=0x7f944400ec80 comp rx=0 tx=0).stop 2024-05-10T03:38:12.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.956+0000 7f9458e7f700 1 -- 172.21.15.45:0/803723100 shutdown_connections 2024-05-10T03:38:12.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.956+0000 7f9458e7f700 1 --2- 172.21.15.45:0/803723100 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f943c0a1120 0x7f943c0a3630 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:12.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.956+0000 7f9458e7f700 1 --2- 172.21.15.45:0/803723100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9454107970 0x7f945419f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:12.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.956+0000 7f9458e7f700 1 --2- 172.21.15.45:0/803723100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94541026b0 0x7f9454198140 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:12.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.956+0000 7f9458e7f700 1 --2- 172.21.15.45:0/803723100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9454105010 0x7f9454198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:12.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.956+0000 7f9458e7f700 1 -- 172.21.15.45:0/803723100 >> 172.21.15.45:0/803723100 conn(0x7f94540fc0d0 msgr2=0x7f94541032a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:12.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.956+0000 7f9458e7f700 1 -- 172.21.15.45:0/803723100 shutdown_connections 2024-05-10T03:38:12.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:12.956+0000 7f9458e7f700 1 -- 172.21.15.45:0/803723100 wait complete. 2024-05-10T03:38:12.960 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 3 2024-05-10T03:38:13.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:12 smithi154 ceph-mon[46565]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:13.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:13.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:13.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:13.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:13.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:13.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:12 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:13.236 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:12 smithi045 ceph-mon[42520]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:13.236 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:13.236 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:13.236 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:13.236 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:13.236 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:13.236 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:12 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:13.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:12 smithi106 ceph-mon[46996]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:13.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:13.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:13.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:13.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:13.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:13.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:12 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:14.066 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:13 smithi045 ceph-mon[42520]: Deploying daemon mds.j on smithi045 2024-05-10T03:38:14.066 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:13 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.106:6832/3404247109,v1:172.21.15.106:6833/3404247109] up:boot 2024-05-10T03:38:14.066 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:13 smithi045 ceph-mon[42520]: fsmap 2 up:standby 2024-05-10T03:38:14.066 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:13 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-10T03:38:14.067 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:13 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/803723100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:14.067 INFO:journalctl@ceph.mds.j.smithi045.stdout:May 10 03:38:13 smithi045 systemd[1]: Starting Ceph mds.j for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:38:14.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:13 smithi154 ceph-mon[46565]: Deploying daemon mds.j on smithi045 2024-05-10T03:38:14.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:13 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.106:6832/3404247109,v1:172.21.15.106:6833/3404247109] up:boot 2024-05-10T03:38:14.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:13 smithi154 ceph-mon[46565]: fsmap 2 up:standby 2024-05-10T03:38:14.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:13 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-10T03:38:14.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:13 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/803723100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:14.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:13 smithi106 ceph-mon[46996]: Deploying daemon mds.j on smithi045 2024-05-10T03:38:14.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:13 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.106:6832/3404247109,v1:172.21.15.106:6833/3404247109] up:boot 2024-05-10T03:38:14.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:13 smithi106 ceph-mon[46996]: fsmap 2 up:standby 2024-05-10T03:38:14.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:13 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-10T03:38:14.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:13 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/803723100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:14.534 INFO:journalctl@ceph.mds.j.smithi045.stdout:May 10 03:38:14 smithi045 bash[92602]: feb00f4e3c490c0800a5170ef25847e48d813f9dd2b4443532a0cd7a39dc24b6 2024-05-10T03:38:14.534 INFO:journalctl@ceph.mds.j.smithi045.stdout:May 10 03:38:14 smithi045 systemd[1]: Started Ceph mds.j for d2a0bafa-0e7d-11ef-bc98-c7b262605968. 2024-05-10T03:38:14.534 INFO:journalctl@ceph.mds.j.smithi045.stdout:May 10 03:38:14 smithi045 ceph-mds[92639]: -- 172.21.15.45:0/865306096 <== mon.2 v2:172.21.15.106:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55aa315a61a0 con 0x55aa31606400 2024-05-10T03:38:14.534 INFO:journalctl@ceph.mds.j.smithi045.stdout:May 10 03:38:14 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-j[92616]: starting mds.j at 2024-05-10T03:38:14.975 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:38:15.008 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:14 smithi045 ceph-mon[42520]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:15.008 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:14 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:15.008 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:14 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:15.008 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:14 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:15.008 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:14 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:15.008 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:14 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:15.008 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:14 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:15.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.132+0000 7f31c93c9700 1 -- 172.21.15.45:0/1064212412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c4101c00 msgr2=0x7f31c4102010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:15.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.132+0000 7f31c93c9700 1 --2- 172.21.15.45:0/1064212412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c4101c00 0x7f31c4102010 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f31b400b0a0 tx=0x7f31b400b3b0 comp rx=0 tx=0).stop 2024-05-10T03:38:15.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.132+0000 7f31c93c9700 1 -- 172.21.15.45:0/1064212412 shutdown_connections 2024-05-10T03:38:15.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.132+0000 7f31c93c9700 1 --2- 172.21.15.45:0/1064212412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31c41036c0 0x7f31c4109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:15.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.132+0000 7f31c93c9700 1 --2- 172.21.15.45:0/1064212412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c4101c00 0x7f31c4102010 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:15.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.132+0000 7f31c93c9700 1 --2- 172.21.15.45:0/1064212412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31c4102d20 0x7f31c4103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:15.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.132+0000 7f31c93c9700 1 -- 172.21.15.45:0/1064212412 >> 172.21.15.45:0/1064212412 conn(0x7f31c40fd210 msgr2=0x7f31c40ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:15.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.132+0000 7f31c93c9700 1 -- 172.21.15.45:0/1064212412 shutdown_connections 2024-05-10T03:38:15.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.132+0000 7f31c93c9700 1 -- 172.21.15.45:0/1064212412 wait complete. 2024-05-10T03:38:15.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.133+0000 7f31c93c9700 1 Processor -- start 2024-05-10T03:38:15.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.133+0000 7f31c93c9700 1 -- start start 2024-05-10T03:38:15.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.133+0000 7f31c93c9700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31c4101c00 0x7f31c4075fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:15.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.133+0000 7f31c93c9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31c4102d20 0x7f31c4074670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:15.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.133+0000 7f31c93c9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c41036c0 0x7f31c4074bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:15.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.133+0000 7f31c93c9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c4075210 con 0x7f31c41036c0 2024-05-10T03:38:15.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.133+0000 7f31c93c9700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c4075380 con 0x7f31c4101c00 2024-05-10T03:38:15.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.133+0000 7f31c93c9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c4075540 con 0x7f31c4102d20 2024-05-10T03:38:15.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.133+0000 7f31c37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c41036c0 0x7f31c4074bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:15.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.133+0000 7f31c37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c41036c0 0x7f31c4074bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48616/0 (socket says 172.21.15.45:48616) 2024-05-10T03:38:15.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.133+0000 7f31c37fe700 1 -- 172.21.15.45:0/1401803345 learned_addr learned my addr 172.21.15.45:0/1401803345 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:15.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.134+0000 7f31c2ffd700 1 --2- 172.21.15.45:0/1401803345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31c4101c00 0x7f31c4075fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:15.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.134+0000 7f31c27fc700 1 --2- 172.21.15.45:0/1401803345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31c4102d20 0x7f31c4074670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:15.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.134+0000 7f31c37fe700 1 -- 172.21.15.45:0/1401803345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31c4102d20 msgr2=0x7f31c4074670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:15.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.134+0000 7f31c37fe700 1 --2- 172.21.15.45:0/1401803345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31c4102d20 0x7f31c4074670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:15.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.134+0000 7f31c37fe700 1 -- 172.21.15.45:0/1401803345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31c4101c00 msgr2=0x7f31c4075fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:15.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.134+0000 7f31c37fe700 1 --2- 172.21.15.45:0/1401803345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31c4101c00 0x7f31c4075fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:15.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.134+0000 7f31c37fe700 1 -- 172.21.15.45:0/1401803345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b4009d00 con 0x7f31c41036c0 2024-05-10T03:38:15.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.134+0000 7f31c37fe700 1 --2- 172.21.15.45:0/1401803345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c41036c0 0x7f31c4074bb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00c900 tx=0x7f31bc00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:15.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.134+0000 7f31abfff700 1 -- 172.21.15.45:0/1401803345 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0078d0 con 0x7f31c41036c0 2024-05-10T03:38:15.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.134+0000 7f31abfff700 1 -- 172.21.15.45:0/1401803345 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f31bc00f450 con 0x7f31c41036c0 2024-05-10T03:38:15.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.134+0000 7f31c93c9700 1 -- 172.21.15.45:0/1401803345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c41a2450 con 0x7f31c41036c0 2024-05-10T03:38:15.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.134+0000 7f31abfff700 1 -- 172.21.15.45:0/1401803345 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc018660 con 0x7f31c41036c0 2024-05-10T03:38:15.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.134+0000 7f31c93c9700 1 -- 172.21.15.45:0/1401803345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c41a2910 con 0x7f31c41036c0 2024-05-10T03:38:15.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.135+0000 7f31c93c9700 1 -- 172.21.15.45:0/1401803345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c4108e10 con 0x7f31c41036c0 2024-05-10T03:38:15.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.137+0000 7f31abfff700 1 -- 172.21.15.45:0/1401803345 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f31bc007a30 con 0x7f31c41036c0 2024-05-10T03:38:15.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.137+0000 7f31abfff700 1 --2- 172.21.15.45:0/1401803345 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f31ac0a1120 0x7f31ac0a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:15.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.137+0000 7f31abfff700 1 -- 172.21.15.45:0/1401803345 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f31bc0cc400 con 0x7f31c41036c0 2024-05-10T03:38:15.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.137+0000 7f31c2ffd700 1 --2- 172.21.15.45:0/1401803345 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f31ac0a1120 0x7f31ac0a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:15.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.138+0000 7f31c2ffd700 1 --2- 172.21.15.45:0/1401803345 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f31ac0a1120 0x7f31ac0a3630 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f31b4000f80 tx=0x7f31b40061f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:15.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.141+0000 7f31abfff700 1 -- 172.21.15.45:0/1401803345 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f31bc096030 con 0x7f31c41036c0 2024-05-10T03:38:15.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:14 smithi154 ceph-mon[46565]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:15.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:14 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:15.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:14 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:15.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:14 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:15.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:14 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:15.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:14 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:15.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:14 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:14 smithi106 ceph-mon[46996]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:14 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:14 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:15.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:14 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:15.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:14 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:15.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:14 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:15.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:14 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:15.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.420+0000 7f31c93c9700 1 -- 172.21.15.45:0/1401803345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31c4068730 con 0x7f31c41036c0 2024-05-10T03:38:15.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.421+0000 7f31abfff700 1 -- 172.21.15.45:0/1401803345 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2774 (secure 0 0 0) 0x7f31bc00f5c0 con 0x7f31c41036c0 2024-05-10T03:38:15.426 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:38:15.426 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/378320264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":378320264},{"type":"v1","addr":"172.21.15.45:6835","nonce":378320264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24491,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-05-10T03:38:15.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.428+0000 7f31c93c9700 1 -- 172.21.15.45:0/1401803345 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f31ac0a1120 msgr2=0x7f31ac0a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:15.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.428+0000 7f31c93c9700 1 --2- 172.21.15.45:0/1401803345 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f31ac0a1120 0x7f31ac0a3630 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f31b4000f80 tx=0x7f31b40061f0 comp rx=0 tx=0).stop 2024-05-10T03:38:15.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.428+0000 7f31c93c9700 1 -- 172.21.15.45:0/1401803345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c41036c0 msgr2=0x7f31c4074bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:15.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.428+0000 7f31c93c9700 1 --2- 172.21.15.45:0/1401803345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c41036c0 0x7f31c4074bb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00c900 tx=0x7f31bc00cc10 comp rx=0 tx=0).stop 2024-05-10T03:38:15.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.430+0000 7f31c93c9700 1 -- 172.21.15.45:0/1401803345 shutdown_connections 2024-05-10T03:38:15.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.430+0000 7f31c93c9700 1 --2- 172.21.15.45:0/1401803345 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f31ac0a1120 0x7f31ac0a3630 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:15.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.430+0000 7f31c93c9700 1 --2- 172.21.15.45:0/1401803345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c41036c0 0x7f31c4074bb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:15.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.430+0000 7f31c93c9700 1 --2- 172.21.15.45:0/1401803345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31c4101c00 0x7f31c4075fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:15.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.430+0000 7f31c93c9700 1 --2- 172.21.15.45:0/1401803345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31c4102d20 0x7f31c4074670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:15.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.430+0000 7f31c93c9700 1 -- 172.21.15.45:0/1401803345 >> 172.21.15.45:0/1401803345 conn(0x7f31c40fd210 msgr2=0x7f31c4105f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:15.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.434+0000 7f31c93c9700 1 -- 172.21.15.45:0/1401803345 shutdown_connections 2024-05-10T03:38:15.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:15.434+0000 7f31c93c9700 1 -- 172.21.15.45:0/1401803345 wait complete. 2024-05-10T03:38:15.439 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 4 2024-05-10T03:38:15.962 INFO:journalctl@ceph.mds.d.smithi045.stdout:May 10 03:38:15 smithi045 systemd[1]: Starting Ceph mds.d for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:38:16.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:15 smithi154 ceph-mon[46565]: Deploying daemon mds.d on smithi045 2024-05-10T03:38:16.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:15 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.45:6834/378320264,v1:172.21.15.45:6835/378320264] up:boot 2024-05-10T03:38:16.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:15 smithi154 ceph-mon[46565]: fsmap 3 up:standby 2024-05-10T03:38:16.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:15 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-10T03:38:16.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:15 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1401803345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:16.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:15 smithi045 ceph-mon[42520]: Deploying daemon mds.d on smithi045 2024-05-10T03:38:16.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:15 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.45:6834/378320264,v1:172.21.15.45:6835/378320264] up:boot 2024-05-10T03:38:16.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:15 smithi045 ceph-mon[42520]: fsmap 3 up:standby 2024-05-10T03:38:16.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:15 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-10T03:38:16.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:15 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1401803345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:16.284 INFO:journalctl@ceph.mds.d.smithi045.stdout:May 10 03:38:16 smithi045 ceph-mds[93027]: -- 172.21.15.45:0/2800736761 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a8a6a721a0 con 0x55a8a6ad2d00 2024-05-10T03:38:16.284 INFO:journalctl@ceph.mds.d.smithi045.stdout:May 10 03:38:16 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-d[93004]: starting mds.d at 2024-05-10T03:38:16.285 INFO:journalctl@ceph.mds.d.smithi045.stdout:May 10 03:38:16 smithi045 bash[92989]: c2b005224166d292a17b6f64a905a6baf1e1e6c9d617fdfccf6363c02d1f601d 2024-05-10T03:38:16.285 INFO:journalctl@ceph.mds.d.smithi045.stdout:May 10 03:38:16 smithi045 systemd[1]: Started Ceph mds.d for d2a0bafa-0e7d-11ef-bc98-c7b262605968. 2024-05-10T03:38:16.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:15 smithi106 ceph-mon[46996]: Deploying daemon mds.d on smithi045 2024-05-10T03:38:16.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:15 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.45:6834/378320264,v1:172.21.15.45:6835/378320264] up:boot 2024-05-10T03:38:16.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:15 smithi106 ceph-mon[46996]: fsmap 3 up:standby 2024-05-10T03:38:16.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:15 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-10T03:38:16.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:15 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1401803345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:17.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:16 smithi154 ceph-mon[46565]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:17.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:17.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:17.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:17.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:17.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:17.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:17.231 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:16 smithi106 ceph-mon[46996]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:17.231 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:17.231 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:17.232 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:17.232 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:17.232 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:17.232 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:17.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:16 smithi045 ceph-mon[42520]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:17.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:17.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:17.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:17.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:17.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:17.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:17.453 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:38:17.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.613+0000 7f6136ba0700 1 -- 172.21.15.45:0/4122291004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6130102590 msgr2=0x7f6130108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:17.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.613+0000 7f6136ba0700 1 --2- 172.21.15.45:0/4122291004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6130102590 0x7f6130108e40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f612800b0a0 tx=0x7f612800b3b0 comp rx=0 tx=0).stop 2024-05-10T03:38:17.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.613+0000 7f6136ba0700 1 -- 172.21.15.45:0/4122291004 shutdown_connections 2024-05-10T03:38:17.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.613+0000 7f6136ba0700 1 --2- 172.21.15.45:0/4122291004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6130102590 0x7f6130108e40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:17.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.613+0000 7f6136ba0700 1 --2- 172.21.15.45:0/4122291004 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6130100ad0 0x7f6130100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:17.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.613+0000 7f6136ba0700 1 --2- 172.21.15.45:0/4122291004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6130101bf0 0x7f6130102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:17.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.613+0000 7f6136ba0700 1 -- 172.21.15.45:0/4122291004 >> 172.21.15.45:0/4122291004 conn(0x7f61300fc0c0 msgr2=0x7f61300fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:17.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.614+0000 7f6136ba0700 1 -- 172.21.15.45:0/4122291004 shutdown_connections 2024-05-10T03:38:17.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.614+0000 7f6136ba0700 1 -- 172.21.15.45:0/4122291004 wait complete. 2024-05-10T03:38:17.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.614+0000 7f6136ba0700 1 Processor -- start 2024-05-10T03:38:17.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.614+0000 7f6136ba0700 1 -- start start 2024-05-10T03:38:17.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.614+0000 7f6136ba0700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6130100ad0 0x7f6130104840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:17.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.614+0000 7f6136ba0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6130101bf0 0x7f6130102f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:17.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.614+0000 7f6136ba0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6130102590 0x7f6130103470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:17.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.614+0000 7f6136ba0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6130103b20 con 0x7f6130102590 2024-05-10T03:38:17.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.615+0000 7f6136ba0700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6130103c60 con 0x7f6130100ad0 2024-05-10T03:38:17.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.615+0000 7f6136ba0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61301a2150 con 0x7f6130101bf0 2024-05-10T03:38:17.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.615+0000 7f613513d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6130102590 0x7f6130103470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:17.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.615+0000 7f613493c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6130100ad0 0x7f6130104840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:17.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.615+0000 7f613513d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6130102590 0x7f6130103470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43394/0 (socket says 172.21.15.45:43394) 2024-05-10T03:38:17.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.615+0000 7f613513d700 1 -- 172.21.15.45:0/1986480733 learned_addr learned my addr 172.21.15.45:0/1986480733 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:17.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.615+0000 7f612ffff700 1 --2- 172.21.15.45:0/1986480733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6130101bf0 0x7f6130102f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:17.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.615+0000 7f613493c700 1 -- 172.21.15.45:0/1986480733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6130101bf0 msgr2=0x7f6130102f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:17.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.615+0000 7f613493c700 1 --2- 172.21.15.45:0/1986480733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6130101bf0 0x7f6130102f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:17.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.615+0000 7f613493c700 1 -- 172.21.15.45:0/1986480733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6130102590 msgr2=0x7f6130103470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:17.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.615+0000 7f613493c700 1 --2- 172.21.15.45:0/1986480733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6130102590 0x7f6130103470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:17.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.615+0000 7f613493c700 1 -- 172.21.15.45:0/1986480733 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6128009d00 con 0x7f6130100ad0 2024-05-10T03:38:17.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.615+0000 7f613513d700 1 --2- 172.21.15.45:0/1986480733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6130102590 0x7f6130103470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:38:17.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.615+0000 7f613493c700 1 --2- 172.21.15.45:0/1986480733 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6130100ad0 0x7f6130104840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6130101af0 tx=0x7f612400b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:17.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.615+0000 7f612dffb700 1 -- 172.21.15.45:0/1986480733 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6124011630 con 0x7f6130100ad0 2024-05-10T03:38:17.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.616+0000 7f6136ba0700 1 -- 172.21.15.45:0/1986480733 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61301a2350 con 0x7f6130100ad0 2024-05-10T03:38:17.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.616+0000 7f612dffb700 1 -- 172.21.15.45:0/1986480733 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6124011c70 con 0x7f6130100ad0 2024-05-10T03:38:17.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.616+0000 7f612dffb700 1 -- 172.21.15.45:0/1986480733 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6124010d70 con 0x7f6130100ad0 2024-05-10T03:38:17.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.616+0000 7f6136ba0700 1 -- 172.21.15.45:0/1986480733 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61301a28b0 con 0x7f6130100ad0 2024-05-10T03:38:17.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.617+0000 7f6136ba0700 1 -- 172.21.15.45:0/1986480733 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61300678b0 con 0x7f6130100ad0 2024-05-10T03:38:17.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.618+0000 7f612dffb700 1 -- 172.21.15.45:0/1986480733 <== mon.2 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6124010410 con 0x7f6130100ad0 2024-05-10T03:38:17.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.619+0000 7f612dffb700 1 --2- 172.21.15.45:0/1986480733 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f61200a1120 0x7f61200a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:17.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.619+0000 7f612ffff700 1 --2- 172.21.15.45:0/1986480733 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f61200a1120 0x7f61200a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:17.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.619+0000 7f612dffb700 1 -- 172.21.15.45:0/1986480733 <== mon.2 v2:172.21.15.106:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f61240cbfa0 con 0x7f6130100ad0 2024-05-10T03:38:17.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.619+0000 7f612ffff700 1 --2- 172.21.15.45:0/1986480733 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f61200a1120 0x7f61200a3630 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f61301041e0 tx=0x7f611c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:17.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.622+0000 7f612dffb700 1 -- 172.21.15.45:0/1986480733 <== mon.2 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6124095b30 con 0x7f6130100ad0 2024-05-10T03:38:17.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.892+0000 7f6136ba0700 1 -- 172.21.15.45:0/1986480733 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f613010c580 con 0x7f6130100ad0 2024-05-10T03:38:17.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.895+0000 7f612dffb700 1 -- 172.21.15.45:0/1986480733 <== mon.2 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3531 (secure 0 0 0) 0x7f6124015de0 con 0x7f6130100ad0 2024-05-10T03:38:17.899 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:38:17.899 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/378320264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":378320264},{"type":"v1","addr":"172.21.15.45:6835","nonce":378320264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3032381796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3032381796},{"type":"v1","addr":"172.21.15.45:6837","nonce":3032381796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24491,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-05-10T03:38:17.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.898+0000 7f6136ba0700 1 -- 172.21.15.45:0/1986480733 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f61200a1120 msgr2=0x7f61200a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:17.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.898+0000 7f6136ba0700 1 --2- 172.21.15.45:0/1986480733 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f61200a1120 0x7f61200a3630 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f61301041e0 tx=0x7f611c00b410 comp rx=0 tx=0).stop 2024-05-10T03:38:17.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.898+0000 7f6136ba0700 1 -- 172.21.15.45:0/1986480733 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6130100ad0 msgr2=0x7f6130104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:17.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.898+0000 7f6136ba0700 1 --2- 172.21.15.45:0/1986480733 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6130100ad0 0x7f6130104840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6130101af0 tx=0x7f612400b730 comp rx=0 tx=0).stop 2024-05-10T03:38:17.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.898+0000 7f6136ba0700 1 -- 172.21.15.45:0/1986480733 shutdown_connections 2024-05-10T03:38:17.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.898+0000 7f6136ba0700 1 --2- 172.21.15.45:0/1986480733 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f61200a1120 0x7f61200a3630 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:17.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.898+0000 7f6136ba0700 1 --2- 172.21.15.45:0/1986480733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6130102590 0x7f6130103470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:17.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.898+0000 7f6136ba0700 1 --2- 172.21.15.45:0/1986480733 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6130100ad0 0x7f6130104840 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:17.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.898+0000 7f6136ba0700 1 --2- 172.21.15.45:0/1986480733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6130101bf0 0x7f6130102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:17.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.898+0000 7f6136ba0700 1 -- 172.21.15.45:0/1986480733 >> 172.21.15.45:0/1986480733 conn(0x7f61300fc0c0 msgr2=0x7f61300fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:17.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.898+0000 7f6136ba0700 1 -- 172.21.15.45:0/1986480733 shutdown_connections 2024-05-10T03:38:17.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:17.898+0000 7f6136ba0700 1 -- 172.21.15.45:0/1986480733 wait complete. 2024-05-10T03:38:17.904 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 5 2024-05-10T03:38:18.151 INFO:journalctl@ceph.mds.e.smithi106.stdout:May 10 03:38:17 smithi106 bash[83650]: 84e63105af13268785c455978be63b559648d6869ba7a673c39488b2bb3a3618 2024-05-10T03:38:18.151 INFO:journalctl@ceph.mds.e.smithi106.stdout:May 10 03:38:17 smithi106 systemd[1]: Started Ceph mds.e for d2a0bafa-0e7d-11ef-bc98-c7b262605968. 2024-05-10T03:38:18.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:17 smithi106 ceph-mon[46996]: Deploying daemon mds.e on smithi106 2024-05-10T03:38:18.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:17 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.45:6836/3032381796,v1:172.21.15.45:6837/3032381796] up:boot 2024-05-10T03:38:18.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:17 smithi106 ceph-mon[46996]: fsmap 4 up:standby 2024-05-10T03:38:18.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:17 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-10T03:38:18.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:17 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:18.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:17 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1986480733' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:18.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:17 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:18.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:17 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:18.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:17 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:18.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:17 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:18.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:17 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:18.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:17 smithi045 ceph-mon[42520]: Deploying daemon mds.e on smithi106 2024-05-10T03:38:18.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:17 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.45:6836/3032381796,v1:172.21.15.45:6837/3032381796] up:boot 2024-05-10T03:38:18.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:17 smithi045 ceph-mon[42520]: fsmap 4 up:standby 2024-05-10T03:38:18.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:17 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-10T03:38:18.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:17 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:18.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:17 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1986480733' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:18.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:17 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:18.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:17 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:18.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:17 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:18.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:17 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:18.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:17 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:18.306 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:17 smithi154 ceph-mon[46565]: Deploying daemon mds.e on smithi106 2024-05-10T03:38:18.306 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:17 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.45:6836/3032381796,v1:172.21.15.45:6837/3032381796] up:boot 2024-05-10T03:38:18.306 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:17 smithi154 ceph-mon[46565]: fsmap 4 up:standby 2024-05-10T03:38:18.306 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:17 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-10T03:38:18.306 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:17 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:18.306 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:17 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1986480733' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:18.307 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:17 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:18.307 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:17 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:18.307 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:17 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:18.307 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:17 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:18.307 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:17 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:19.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:18 smithi154 ceph-mon[46565]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:19.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:18 smithi154 ceph-mon[46565]: Deploying daemon mds.f on smithi154 2024-05-10T03:38:19.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:18 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] up:boot 2024-05-10T03:38:19.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:18 smithi154 ceph-mon[46565]: fsmap 5 up:standby 2024-05-10T03:38:19.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:18 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-10T03:38:19.225 INFO:journalctl@ceph.mds.f.smithi154.stdout:May 10 03:38:19 smithi154 systemd[1]: Starting Ceph mds.f for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:38:19.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:18 smithi045 ceph-mon[42520]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:19.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:18 smithi045 ceph-mon[42520]: Deploying daemon mds.f on smithi154 2024-05-10T03:38:19.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:18 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] up:boot 2024-05-10T03:38:19.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:18 smithi045 ceph-mon[42520]: fsmap 5 up:standby 2024-05-10T03:38:19.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:18 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-10T03:38:19.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:18 smithi106 ceph-mon[46996]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:19.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:18 smithi106 ceph-mon[46996]: Deploying daemon mds.f on smithi154 2024-05-10T03:38:19.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:18 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] up:boot 2024-05-10T03:38:19.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:18 smithi106 ceph-mon[46996]: fsmap 5 up:standby 2024-05-10T03:38:19.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:18 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-10T03:38:19.917 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:38:19.974 INFO:journalctl@ceph.mds.f.smithi154.stdout:May 10 03:38:19 smithi154 bash[82710]: 7c3e8f1a87adb708192fce44c0a9ccd8345539d6e6218ba49e4d4f4425911e4d 2024-05-10T03:38:19.974 INFO:journalctl@ceph.mds.f.smithi154.stdout:May 10 03:38:19 smithi154 systemd[1]: Started Ceph mds.f for d2a0bafa-0e7d-11ef-bc98-c7b262605968. 2024-05-10T03:38:19.974 INFO:journalctl@ceph.mds.f.smithi154.stdout:May 10 03:38:19 smithi154 ceph-mds[82747]: -- 172.21.15.154:0/1206369035 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bff89221a0 con 0x55bff8982880 2024-05-10T03:38:19.974 INFO:journalctl@ceph.mds.f.smithi154.stdout:May 10 03:38:19 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-f[82725]: starting mds.f at 2024-05-10T03:38:20.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.076+0000 7fb31ce34700 1 -- 172.21.15.45:0/1606053325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3181026c0 msgr2=0x7fb318104ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:20.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.076+0000 7fb31ce34700 1 --2- 172.21.15.45:0/1606053325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3181026c0 0x7fb318104ae0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb308009990 tx=0x7fb308009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:20.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.076+0000 7fb31ce34700 1 -- 172.21.15.45:0/1606053325 shutdown_connections 2024-05-10T03:38:20.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.076+0000 7fb31ce34700 1 --2- 172.21.15.45:0/1606053325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb318107980 0x7fb318109da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:20.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.076+0000 7fb31ce34700 1 --2- 172.21.15.45:0/1606053325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3181026c0 0x7fb318104ae0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:20.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.076+0000 7fb31ce34700 1 --2- 172.21.15.45:0/1606053325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb318105020 0x7fb318107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:20.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.076+0000 7fb31ce34700 1 -- 172.21.15.45:0/1606053325 >> 172.21.15.45:0/1606053325 conn(0x7fb3180fc0c0 msgr2=0x7fb3180fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:20.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.076+0000 7fb31ce34700 1 -- 172.21.15.45:0/1606053325 shutdown_connections 2024-05-10T03:38:20.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.076+0000 7fb31ce34700 1 -- 172.21.15.45:0/1606053325 wait complete. 2024-05-10T03:38:20.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.077+0000 7fb31ce34700 1 Processor -- start 2024-05-10T03:38:20.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.077+0000 7fb31ce34700 1 -- start start 2024-05-10T03:38:20.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.078+0000 7fb31ce34700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3181026c0 0x7fb3181980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:20.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.078+0000 7fb31ce34700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb318105020 0x7fb318198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:20.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.078+0000 7fb31ce34700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb318107980 0x7fb31819f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:20.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.078+0000 7fb31ce34700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31819fba0 con 0x7fb3181026c0 2024-05-10T03:38:20.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.078+0000 7fb31ce34700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31819fd10 con 0x7fb318105020 2024-05-10T03:38:20.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.078+0000 7fb31ce34700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31819fed0 con 0x7fb318107980 2024-05-10T03:38:20.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.078+0000 7fb31659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3181026c0 0x7fb3181980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:20.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.078+0000 7fb31659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3181026c0 0x7fb3181980c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43416/0 (socket says 172.21.15.45:43416) 2024-05-10T03:38:20.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.078+0000 7fb31659c700 1 -- 172.21.15.45:0/1787164773 learned_addr learned my addr 172.21.15.45:0/1787164773 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:20.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.078+0000 7fb316d9d700 1 --2- 172.21.15.45:0/1787164773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb318107980 0x7fb31819f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:20.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.078+0000 7fb315d9b700 1 --2- 172.21.15.45:0/1787164773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb318105020 0x7fb318198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:20.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.078+0000 7fb31659c700 1 -- 172.21.15.45:0/1787164773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb318107980 msgr2=0x7fb31819f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:20.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.078+0000 7fb31659c700 1 --2- 172.21.15.45:0/1787164773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb318107980 0x7fb31819f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:20.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.078+0000 7fb31659c700 1 -- 172.21.15.45:0/1787164773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb318105020 msgr2=0x7fb318198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:20.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.078+0000 7fb31659c700 1 --2- 172.21.15.45:0/1787164773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb318105020 0x7fb318198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:20.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.078+0000 7fb31659c700 1 -- 172.21.15.45:0/1787164773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3080095f0 con 0x7fb3181026c0 2024-05-10T03:38:20.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.078+0000 7fb315d9b700 1 --2- 172.21.15.45:0/1787164773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb318105020 0x7fb318198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:38:20.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.078+0000 7fb31659c700 1 --2- 172.21.15.45:0/1787164773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3181026c0 0x7fb3181980c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb3080098e0 tx=0x7fb30800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:20.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.078+0000 7fb30f7fe700 1 -- 172.21.15.45:0/1787164773 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30801d070 con 0x7fb3181026c0 2024-05-10T03:38:20.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.078+0000 7fb30f7fe700 1 -- 172.21.15.45:0/1787164773 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb30800fe60 con 0x7fb3181026c0 2024-05-10T03:38:20.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.079+0000 7fb30f7fe700 1 -- 172.21.15.45:0/1787164773 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb308017650 con 0x7fb3181026c0 2024-05-10T03:38:20.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.079+0000 7fb31ce34700 1 -- 172.21.15.45:0/1787164773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3181a0150 con 0x7fb3181026c0 2024-05-10T03:38:20.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.079+0000 7fb31ce34700 1 -- 172.21.15.45:0/1787164773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3181a0520 con 0x7fb3181026c0 2024-05-10T03:38:20.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.080+0000 7fb31ce34700 1 -- 172.21.15.45:0/1787164773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3180fdc70 con 0x7fb3181026c0 2024-05-10T03:38:20.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.081+0000 7fb30f7fe700 1 -- 172.21.15.45:0/1787164773 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb3080177b0 con 0x7fb3181026c0 2024-05-10T03:38:20.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.082+0000 7fb30f7fe700 1 --2- 172.21.15.45:0/1787164773 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb3040a1120 0x7fb3040a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:20.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.082+0000 7fb30f7fe700 1 -- 172.21.15.45:0/1787164773 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb3080cdf90 con 0x7fb3181026c0 2024-05-10T03:38:20.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.082+0000 7fb315d9b700 1 --2- 172.21.15.45:0/1787164773 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb3040a1120 0x7fb3040a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:20.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.082+0000 7fb315d9b700 1 --2- 172.21.15.45:0/1787164773 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb3040a1120 0x7fb3040a3630 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb318199160 tx=0x7fb300009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:20.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.086+0000 7fb30f7fe700 1 -- 172.21.15.45:0/1787164773 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb308097bb0 con 0x7fb3181026c0 2024-05-10T03:38:20.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.355+0000 7fb31ce34700 1 -- 172.21.15.45:0/1787164773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb31810d510 con 0x7fb3181026c0 2024-05-10T03:38:20.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.355+0000 7fb30f7fe700 1 -- 172.21.15.45:0/1787164773 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5051 (secure 0 0 0) 0x7fb30809b1d0 con 0x7fb3181026c0 2024-05-10T03:38:20.359 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:38:20.359 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/378320264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":378320264},{"type":"v1","addr":"172.21.15.45:6835","nonce":378320264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3032381796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3032381796},{"type":"v1","addr":"172.21.15.45:6837","nonce":3032381796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24491,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/4037121210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":4037121210},{"type":"v1","addr":"172.21.15.154:6835","nonce":4037121210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24521,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/4162885659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4162885659},{"type":"v1","addr":"172.21.15.106:6835","nonce":4162885659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[]} 2024-05-10T03:38:20.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.357+0000 7fb31ce34700 1 -- 172.21.15.45:0/1787164773 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb3040a1120 msgr2=0x7fb3040a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:20.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.358+0000 7fb31ce34700 1 --2- 172.21.15.45:0/1787164773 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb3040a1120 0x7fb3040a3630 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb318199160 tx=0x7fb300009260 comp rx=0 tx=0).stop 2024-05-10T03:38:20.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.358+0000 7fb31ce34700 1 -- 172.21.15.45:0/1787164773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3181026c0 msgr2=0x7fb3181980c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:20.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.358+0000 7fb31ce34700 1 --2- 172.21.15.45:0/1787164773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3181026c0 0x7fb3181980c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb3080098e0 tx=0x7fb30800f690 comp rx=0 tx=0).stop 2024-05-10T03:38:20.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.358+0000 7fb31ce34700 1 -- 172.21.15.45:0/1787164773 shutdown_connections 2024-05-10T03:38:20.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.358+0000 7fb31ce34700 1 --2- 172.21.15.45:0/1787164773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb318107980 0x7fb31819f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:20.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.358+0000 7fb31ce34700 1 --2- 172.21.15.45:0/1787164773 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb3040a1120 0x7fb3040a3630 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:20.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.358+0000 7fb31ce34700 1 --2- 172.21.15.45:0/1787164773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3181026c0 0x7fb3181980c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:20.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.358+0000 7fb31ce34700 1 --2- 172.21.15.45:0/1787164773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb318105020 0x7fb318198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:20.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.358+0000 7fb31ce34700 1 -- 172.21.15.45:0/1787164773 >> 172.21.15.45:0/1787164773 conn(0x7fb3180fc0c0 msgr2=0x7fb318103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:20.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.358+0000 7fb31ce34700 1 -- 172.21.15.45:0/1787164773 shutdown_connections 2024-05-10T03:38:20.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:20.358+0000 7fb31ce34700 1 -- 172.21.15.45:0/1787164773 wait complete. 2024-05-10T03:38:20.362 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 7 2024-05-10T03:38:20.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:20 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:20.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:20 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:20.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:20 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:20.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:20 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:20.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:20 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:20.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:20 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:20.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:20 smithi154 ceph-mon[46565]: Deploying daemon mds.c on smithi154 2024-05-10T03:38:20.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:20 smithi154 ceph-mon[46565]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:20.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:20 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.154:6834/4037121210,v1:172.21.15.154:6835/4037121210] up:boot 2024-05-10T03:38:20.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:20 smithi154 ceph-mon[46565]: fsmap 6 up:standby 2024-05-10T03:38:20.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:20 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-10T03:38:20.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:20 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1787164773' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:20.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:20 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:21.273 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:20 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:21.273 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:20 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:21.273 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:20 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:21.273 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:20 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:21.273 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:20 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:21.273 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:20 smithi106 ceph-mon[46996]: Deploying daemon mds.c on smithi154 2024-05-10T03:38:21.274 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:20 smithi106 ceph-mon[46996]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:21.274 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:20 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.154:6834/4037121210,v1:172.21.15.154:6835/4037121210] up:boot 2024-05-10T03:38:21.274 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:20 smithi106 ceph-mon[46996]: fsmap 6 up:standby 2024-05-10T03:38:21.274 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:20 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-10T03:38:21.274 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:20 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1787164773' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:21.275 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:20 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:21.275 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:20 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:21.275 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:20 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:21.275 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:20 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:21.275 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:20 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:21.275 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:20 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:21.275 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:20 smithi045 ceph-mon[42520]: Deploying daemon mds.c on smithi154 2024-05-10T03:38:21.275 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:20 smithi045 ceph-mon[42520]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:21.275 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:20 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.154:6834/4037121210,v1:172.21.15.154:6835/4037121210] up:boot 2024-05-10T03:38:21.275 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:20 smithi045 ceph-mon[42520]: fsmap 6 up:standby 2024-05-10T03:38:21.275 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:20 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-10T03:38:21.276 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:20 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1787164773' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:21.276 INFO:journalctl@ceph.mds.c.smithi154.stdout:May 10 03:38:20 smithi154 systemd[1]: Starting Ceph mds.c for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:38:21.724 INFO:journalctl@ceph.mds.c.smithi154.stdout:May 10 03:38:21 smithi154 ceph-mds[83090]: -- 172.21.15.154:0/1968277365 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558153ac01a0 con 0x558153b20880 2024-05-10T03:38:21.724 INFO:journalctl@ceph.mds.c.smithi154.stdout:May 10 03:38:21 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-c[83067]: starting mds.c at 2024-05-10T03:38:21.724 INFO:journalctl@ceph.mds.c.smithi154.stdout:May 10 03:38:21 smithi154 bash[83052]: 4e880b69dbe1a727babb14aa2a4b9bfe4a27326292116d166483c27f8d71de2b 2024-05-10T03:38:21.724 INFO:journalctl@ceph.mds.c.smithi154.stdout:May 10 03:38:21 smithi154 systemd[1]: Started Ceph mds.c for d2a0bafa-0e7d-11ef-bc98-c7b262605968. 2024-05-10T03:38:22.377 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:38:22.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.537+0000 7f1d50691700 1 -- 172.21.15.45:0/1834765893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d48100ac0 msgr2=0x7f1d48100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:22.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.537+0000 7f1d50691700 1 --2- 172.21.15.45:0/1834765893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d48100ac0 0x7f1d48100ed0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1d44009990 tx=0x7f1d44009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:22.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.537+0000 7f1d50691700 1 -- 172.21.15.45:0/1834765893 shutdown_connections 2024-05-10T03:38:22.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.537+0000 7f1d50691700 1 --2- 172.21.15.45:0/1834765893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d48102580 0x7f1d48108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:22.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.537+0000 7f1d50691700 1 --2- 172.21.15.45:0/1834765893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d48100ac0 0x7f1d48100ed0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:22.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.537+0000 7f1d50691700 1 --2- 172.21.15.45:0/1834765893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d48101be0 0x7f1d48101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:22.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.537+0000 7f1d50691700 1 -- 172.21.15.45:0/1834765893 >> 172.21.15.45:0/1834765893 conn(0x7f1d480fc0d0 msgr2=0x7f1d480fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:22.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.537+0000 7f1d50691700 1 -- 172.21.15.45:0/1834765893 shutdown_connections 2024-05-10T03:38:22.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.537+0000 7f1d50691700 1 -- 172.21.15.45:0/1834765893 wait complete. 2024-05-10T03:38:22.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.538+0000 7f1d50691700 1 Processor -- start 2024-05-10T03:38:22.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.538+0000 7f1d50691700 1 -- start start 2024-05-10T03:38:22.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.538+0000 7f1d50691700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d48100ac0 0x7f1d481980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:22.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.538+0000 7f1d50691700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d48101be0 0x7f1d48198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:22.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.538+0000 7f1d50691700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d48102580 0x7f1d4819f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:22.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.538+0000 7f1d50691700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4819fb60 con 0x7f1d48100ac0 2024-05-10T03:38:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.538+0000 7f1d50691700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4819fcd0 con 0x7f1d48101be0 2024-05-10T03:38:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.538+0000 7f1d50691700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4819fe90 con 0x7f1d48102580 2024-05-10T03:38:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.538+0000 7f1d4e42d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d48100ac0 0x7f1d481980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.538+0000 7f1d4e42d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d48100ac0 0x7f1d481980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43434/0 (socket says 172.21.15.45:43434) 2024-05-10T03:38:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.538+0000 7f1d4e42d700 1 -- 172.21.15.45:0/856079390 learned_addr learned my addr 172.21.15.45:0/856079390 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.538+0000 7f1d4dc2c700 1 --2- 172.21.15.45:0/856079390 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d48101be0 0x7f1d48198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.538+0000 7f1d4ec2e700 1 --2- 172.21.15.45:0/856079390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d48102580 0x7f1d4819f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.539+0000 7f1d4e42d700 1 -- 172.21.15.45:0/856079390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d48102580 msgr2=0x7f1d4819f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.539+0000 7f1d4e42d700 1 --2- 172.21.15.45:0/856079390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d48102580 0x7f1d4819f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.539+0000 7f1d4e42d700 1 -- 172.21.15.45:0/856079390 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d48101be0 msgr2=0x7f1d48198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.539+0000 7f1d4e42d700 1 --2- 172.21.15.45:0/856079390 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d48101be0 0x7f1d48198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.539+0000 7f1d4e42d700 1 -- 172.21.15.45:0/856079390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d440095f0 con 0x7f1d48100ac0 2024-05-10T03:38:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.539+0000 7f1d4ec2e700 1 --2- 172.21.15.45:0/856079390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d48102580 0x7f1d4819f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:38:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.539+0000 7f1d4dc2c700 1 --2- 172.21.15.45:0/856079390 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d48101be0 0x7f1d48198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:38:22.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.539+0000 7f1d4e42d700 1 --2- 172.21.15.45:0/856079390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d48100ac0 0x7f1d481980d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400b5c0 tx=0x7f1d44005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:22.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.539+0000 7f1d3f7fe700 1 -- 172.21.15.45:0/856079390 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4401d070 con 0x7f1d48100ac0 2024-05-10T03:38:22.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.539+0000 7f1d3f7fe700 1 -- 172.21.15.45:0/856079390 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1d4400fbc0 con 0x7f1d48100ac0 2024-05-10T03:38:22.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.539+0000 7f1d50691700 1 -- 172.21.15.45:0/856079390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d481a0110 con 0x7f1d48100ac0 2024-05-10T03:38:22.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.539+0000 7f1d3f7fe700 1 -- 172.21.15.45:0/856079390 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d440173f0 con 0x7f1d48100ac0 2024-05-10T03:38:22.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.539+0000 7f1d50691700 1 -- 172.21.15.45:0/856079390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d481a0590 con 0x7f1d48100ac0 2024-05-10T03:38:22.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.540+0000 7f1d50691700 1 -- 172.21.15.45:0/856079390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d480694d0 con 0x7f1d48100ac0 2024-05-10T03:38:22.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.541+0000 7f1d3f7fe700 1 -- 172.21.15.45:0/856079390 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1d440039d0 con 0x7f1d48100ac0 2024-05-10T03:38:22.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.542+0000 7f1d3f7fe700 1 --2- 172.21.15.45:0/856079390 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1d340a11a0 0x7f1d340a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:22.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.542+0000 7f1d3f7fe700 1 -- 172.21.15.45:0/856079390 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1d440cd750 con 0x7f1d48100ac0 2024-05-10T03:38:22.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.542+0000 7f1d4dc2c700 1 --2- 172.21.15.45:0/856079390 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1d340a11a0 0x7f1d340a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:22.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.543+0000 7f1d4dc2c700 1 --2- 172.21.15.45:0/856079390 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1d340a11a0 0x7f1d340a36b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1d38005950 tx=0x7f1d380058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:22.548 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:22 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:22.549 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:22 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:22.549 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:22 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:22.549 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:22 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:22.549 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:22 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:22.549 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:22 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:22.549 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:22 smithi106 ceph-mon[46996]: Deploying daemon mds.h on smithi106 2024-05-10T03:38:22.549 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:22 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] up:boot 2024-05-10T03:38:22.549 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:22 smithi106 ceph-mon[46996]: fsmap 7 up:standby 2024-05-10T03:38:22.549 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:22 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-10T03:38:22.549 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:22 smithi106 ceph-mon[46996]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:22.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.546+0000 7f1d3f7fe700 1 -- 172.21.15.45:0/856079390 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1d440974a0 con 0x7f1d48100ac0 2024-05-10T03:38:22.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:22 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:22.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:22 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:22.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:22 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:22.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:22 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:22.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:22 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:22.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:22 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:22.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:22 smithi154 ceph-mon[46565]: Deploying daemon mds.h on smithi106 2024-05-10T03:38:22.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:22 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] up:boot 2024-05-10T03:38:22.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:22 smithi154 ceph-mon[46565]: fsmap 7 up:standby 2024-05-10T03:38:22.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:22 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-10T03:38:22.725 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:22 smithi154 ceph-mon[46565]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:22.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:22 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:22.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:22 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:22.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:22 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:22.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:22 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:22.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:22 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:22.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:22 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:22.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:22 smithi045 ceph-mon[42520]: Deploying daemon mds.h on smithi106 2024-05-10T03:38:22.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:22 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] up:boot 2024-05-10T03:38:22.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:22 smithi045 ceph-mon[42520]: fsmap 7 up:standby 2024-05-10T03:38:22.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:22 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-10T03:38:22.785 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:22 smithi045 ceph-mon[42520]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:22.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.813+0000 7f1d50691700 1 -- 172.21.15.45:0/856079390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d4810c3e0 con 0x7f1d48100ac0 2024-05-10T03:38:22.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.814+0000 7f1d3f7fe700 1 -- 172.21.15.45:0/856079390 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5808 (secure 0 0 0) 0x7f1d4409e6c0 con 0x7f1d48100ac0 2024-05-10T03:38:22.817 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:38:22.818 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/378320264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":378320264},{"type":"v1","addr":"172.21.15.45:6835","nonce":378320264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3032381796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3032381796},{"type":"v1","addr":"172.21.15.45:6837","nonce":3032381796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24491,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/4037121210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":4037121210},{"type":"v1","addr":"172.21.15.154:6835","nonce":4037121210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24521,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/4162885659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4162885659},{"type":"v1","addr":"172.21.15.106:6835","nonce":4162885659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/608167481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":608167481},{"type":"v1","addr":"172.21.15.154:6837","nonce":608167481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2024-05-10T03:38:22.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.816+0000 7f1d50691700 1 -- 172.21.15.45:0/856079390 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1d340a11a0 msgr2=0x7f1d340a36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:22.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.816+0000 7f1d50691700 1 --2- 172.21.15.45:0/856079390 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1d340a11a0 0x7f1d340a36b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1d38005950 tx=0x7f1d380058e0 comp rx=0 tx=0).stop 2024-05-10T03:38:22.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.816+0000 7f1d50691700 1 -- 172.21.15.45:0/856079390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d48100ac0 msgr2=0x7f1d481980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:22.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.816+0000 7f1d50691700 1 --2- 172.21.15.45:0/856079390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d48100ac0 0x7f1d481980d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400b5c0 tx=0x7f1d44005f10 comp rx=0 tx=0).stop 2024-05-10T03:38:22.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.816+0000 7f1d50691700 1 -- 172.21.15.45:0/856079390 shutdown_connections 2024-05-10T03:38:22.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.816+0000 7f1d50691700 1 --2- 172.21.15.45:0/856079390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d48102580 0x7f1d4819f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:22.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.816+0000 7f1d50691700 1 --2- 172.21.15.45:0/856079390 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1d340a11a0 0x7f1d340a36b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:22.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.816+0000 7f1d50691700 1 --2- 172.21.15.45:0/856079390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d48100ac0 0x7f1d481980d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:22.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.816+0000 7f1d50691700 1 --2- 172.21.15.45:0/856079390 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d48101be0 0x7f1d48198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:22.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.816+0000 7f1d50691700 1 -- 172.21.15.45:0/856079390 >> 172.21.15.45:0/856079390 conn(0x7f1d480fc0d0 msgr2=0x7f1d480fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:22.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.817+0000 7f1d50691700 1 -- 172.21.15.45:0/856079390 shutdown_connections 2024-05-10T03:38:22.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:22.817+0000 7f1d50691700 1 -- 172.21.15.45:0/856079390 wait complete. 2024-05-10T03:38:22.821 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2024-05-10T03:38:23.051 INFO:journalctl@ceph.mds.h.smithi106.stdout:May 10 03:38:22 smithi106 systemd[1]: Starting Ceph mds.h for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:38:23.651 INFO:journalctl@ceph.mds.h.smithi106.stdout:May 10 03:38:23 smithi106 bash[83990]: c54486f03134845b10c6e4716992cce411e078c9e467497053d998698ebfc39a 2024-05-10T03:38:23.651 INFO:journalctl@ceph.mds.h.smithi106.stdout:May 10 03:38:23 smithi106 systemd[1]: Started Ceph mds.h for d2a0bafa-0e7d-11ef-bc98-c7b262605968. 2024-05-10T03:38:23.651 INFO:journalctl@ceph.mds.h.smithi106.stdout:May 10 03:38:23 smithi106 ceph-mds[84028]: -- 172.21.15.106:0/2405841848 <== mon.2 v2:172.21.15.106:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5561a73481a0 con 0x5561a73a8400 2024-05-10T03:38:23.651 INFO:journalctl@ceph.mds.h.smithi106.stdout:May 10 03:38:23 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-h[84005]: starting mds.h at 2024-05-10T03:38:23.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:23 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/856079390' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:23.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:23 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:23.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:23 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:23.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:23 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:23.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:23 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:23.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:23 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:23.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:23 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:24.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:23 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/856079390' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:24.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:23 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:24.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:23 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:24.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:23 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:24.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:23 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:24.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:23 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:24.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:23 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:24.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:23 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/856079390' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:24.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:23 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:24.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:23 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:24.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:23 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:24.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:23 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:24.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:23 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:24.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:23 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:24.835 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:38:24.836 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:24 smithi154 ceph-mon[46565]: Deploying daemon mds.i on smithi154 2024-05-10T03:38:24.836 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:24 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] up:boot 2024-05-10T03:38:24.836 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:24 smithi154 ceph-mon[46565]: fsmap 8 up:standby 2024-05-10T03:38:24.836 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:24 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-10T03:38:24.836 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:24 smithi154 ceph-mon[46565]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:24.836 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:38:24 smithi154 systemd[1]: Starting Ceph mds.i for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:38:24.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.989+0000 7f543f78a700 1 -- 172.21.15.45:0/2006327758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5438104d80 msgr2=0x7f5438107220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:24.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.989+0000 7f543f78a700 1 --2- 172.21.15.45:0/2006327758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5438104d80 0x7f5438107220 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5428009990 tx=0x7f5428009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:24.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.990+0000 7f543f78a700 1 -- 172.21.15.45:0/2006327758 shutdown_connections 2024-05-10T03:38:24.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.990+0000 7f543f78a700 1 --2- 172.21.15.45:0/2006327758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54381078b0 0x7f5438109dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:24.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.990+0000 7f543f78a700 1 --2- 172.21.15.45:0/2006327758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f543806a790 0x7f54381047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:24.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.990+0000 7f543f78a700 1 --2- 172.21.15.45:0/2006327758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5438104d80 0x7f5438107220 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:24.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.990+0000 7f543f78a700 1 -- 172.21.15.45:0/2006327758 >> 172.21.15.45:0/2006327758 conn(0x7f54380fc100 msgr2=0x7f54380fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:24.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.990+0000 7f543f78a700 1 -- 172.21.15.45:0/2006327758 shutdown_connections 2024-05-10T03:38:24.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.990+0000 7f543f78a700 1 -- 172.21.15.45:0/2006327758 wait complete. 2024-05-10T03:38:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.990+0000 7f543f78a700 1 Processor -- start 2024-05-10T03:38:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.990+0000 7f543f78a700 1 -- start start 2024-05-10T03:38:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.991+0000 7f543f78a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f543806a790 0x7f5438198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.991+0000 7f543f78a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5438104d80 0x7f5438198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.991+0000 7f543f78a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54381078b0 0x7f543819f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.991+0000 7f543f78a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543819fbe0 con 0x7f543806a790 2024-05-10T03:38:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.991+0000 7f543f78a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543819fd50 con 0x7f5438104d80 2024-05-10T03:38:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.991+0000 7f543f78a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543819ff10 con 0x7f54381078b0 2024-05-10T03:38:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.991+0000 7f543d526700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f543806a790 0x7f5438198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.991+0000 7f543d526700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f543806a790 0x7f5438198100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43444/0 (socket says 172.21.15.45:43444) 2024-05-10T03:38:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.991+0000 7f543d526700 1 -- 172.21.15.45:0/3533338221 learned_addr learned my addr 172.21.15.45:0/3533338221 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.991+0000 7f543dd27700 1 --2- 172.21.15.45:0/3533338221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54381078b0 0x7f543819f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.991+0000 7f543cd25700 1 --2- 172.21.15.45:0/3533338221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5438104d80 0x7f5438198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:24.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.991+0000 7f543d526700 1 -- 172.21.15.45:0/3533338221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54381078b0 msgr2=0x7f543819f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:24.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.991+0000 7f543d526700 1 --2- 172.21.15.45:0/3533338221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54381078b0 0x7f543819f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:24.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.991+0000 7f543d526700 1 -- 172.21.15.45:0/3533338221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5438104d80 msgr2=0x7f5438198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:24.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.991+0000 7f543d526700 1 --2- 172.21.15.45:0/3533338221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5438104d80 0x7f5438198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:24.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.991+0000 7f543d526700 1 -- 172.21.15.45:0/3533338221 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54280095f0 con 0x7f543806a790 2024-05-10T03:38:24.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.991+0000 7f543d526700 1 --2- 172.21.15.45:0/3533338221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f543806a790 0x7f5438198100 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f543400e970 tx=0x7f543400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:24.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.992+0000 7f542e7fc700 1 -- 172.21.15.45:0/3533338221 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5434009790 con 0x7f543806a790 2024-05-10T03:38:24.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.992+0000 7f542e7fc700 1 -- 172.21.15.45:0/3533338221 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f543400eec0 con 0x7f543806a790 2024-05-10T03:38:24.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.992+0000 7f543f78a700 1 -- 172.21.15.45:0/3533338221 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54381a01f0 con 0x7f543806a790 2024-05-10T03:38:24.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.992+0000 7f542e7fc700 1 -- 172.21.15.45:0/3533338221 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5434005690 con 0x7f543806a790 2024-05-10T03:38:24.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.992+0000 7f543f78a700 1 -- 172.21.15.45:0/3533338221 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54381a0750 con 0x7f543806a790 2024-05-10T03:38:24.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.993+0000 7f543f78a700 1 -- 172.21.15.45:0/3533338221 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54380fdcb0 con 0x7f543806a790 2024-05-10T03:38:24.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.994+0000 7f542e7fc700 1 -- 172.21.15.45:0/3533338221 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5434004750 con 0x7f543806a790 2024-05-10T03:38:24.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.995+0000 7f542e7fc700 1 --2- 172.21.15.45:0/3533338221 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f54240a11a0 0x7f54240a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:24.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.995+0000 7f543cd25700 1 --2- 172.21.15.45:0/3533338221 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f54240a11a0 0x7f54240a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:24.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.995+0000 7f542e7fc700 1 -- 172.21.15.45:0/3533338221 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5434014070 con 0x7f543806a790 2024-05-10T03:38:24.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.996+0000 7f543cd25700 1 --2- 172.21.15.45:0/3533338221 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f54240a11a0 0x7f54240a36b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f542800b7f0 tx=0x7f542801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:25.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:24.999+0000 7f542e7fc700 1 -- 172.21.15.45:0/3533338221 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5434096480 con 0x7f543806a790 2024-05-10T03:38:25.033 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:24 smithi045 ceph-mon[42520]: Deploying daemon mds.i on smithi154 2024-05-10T03:38:25.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:24 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] up:boot 2024-05-10T03:38:25.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:24 smithi045 ceph-mon[42520]: fsmap 8 up:standby 2024-05-10T03:38:25.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:24 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-10T03:38:25.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:24 smithi045 ceph-mon[42520]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:25.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:24 smithi106 ceph-mon[46996]: Deploying daemon mds.i on smithi154 2024-05-10T03:38:25.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:24 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] up:boot 2024-05-10T03:38:25.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:24 smithi106 ceph-mon[46996]: fsmap 8 up:standby 2024-05-10T03:38:25.151 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:24 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-10T03:38:25.152 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:24 smithi106 ceph-mon[46996]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:25.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:25.277+0000 7f543f78a700 1 -- 172.21.15.45:0/3533338221 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5438068730 con 0x7f543806a790 2024-05-10T03:38:25.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:25.278+0000 7f542e7fc700 1 -- 172.21.15.45:0/3533338221 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6568 (secure 0 0 0) 0x7f5434099aa0 con 0x7f543806a790 2024-05-10T03:38:25.281 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:38:25.281 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/378320264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":378320264},{"type":"v1","addr":"172.21.15.45:6835","nonce":378320264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3032381796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3032381796},{"type":"v1","addr":"172.21.15.45:6837","nonce":3032381796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24491,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/4037121210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":4037121210},{"type":"v1","addr":"172.21.15.154:6835","nonce":4037121210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24521,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/4162885659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4162885659},{"type":"v1","addr":"172.21.15.106:6835","nonce":4162885659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/608167481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":608167481},{"type":"v1","addr":"172.21.15.154:6837","nonce":608167481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24548,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3047487403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":3047487403},{"type":"v1","addr":"172.21.15.106:6837","nonce":3047487403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2024-05-10T03:38:25.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:25.280+0000 7f543f78a700 1 -- 172.21.15.45:0/3533338221 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f54240a11a0 msgr2=0x7f54240a36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:25.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:25.280+0000 7f543f78a700 1 --2- 172.21.15.45:0/3533338221 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f54240a11a0 0x7f54240a36b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f542800b7f0 tx=0x7f542801a040 comp rx=0 tx=0).stop 2024-05-10T03:38:25.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:25.280+0000 7f543f78a700 1 -- 172.21.15.45:0/3533338221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f543806a790 msgr2=0x7f5438198100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:25.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:25.280+0000 7f543f78a700 1 --2- 172.21.15.45:0/3533338221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f543806a790 0x7f5438198100 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f543400e970 tx=0x7f543400ec80 comp rx=0 tx=0).stop 2024-05-10T03:38:25.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:25.280+0000 7f543f78a700 1 -- 172.21.15.45:0/3533338221 shutdown_connections 2024-05-10T03:38:25.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:25.280+0000 7f543f78a700 1 --2- 172.21.15.45:0/3533338221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54381078b0 0x7f543819f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:25.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:25.280+0000 7f543f78a700 1 --2- 172.21.15.45:0/3533338221 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f54240a11a0 0x7f54240a36b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:25.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:25.280+0000 7f543f78a700 1 --2- 172.21.15.45:0/3533338221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f543806a790 0x7f5438198100 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:25.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:25.280+0000 7f543f78a700 1 --2- 172.21.15.45:0/3533338221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5438104d80 0x7f5438198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:25.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:25.280+0000 7f543f78a700 1 -- 172.21.15.45:0/3533338221 >> 172.21.15.45:0/3533338221 conn(0x7f54380fc100 msgr2=0x7f5438102f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:25.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:25.280+0000 7f543f78a700 1 -- 172.21.15.45:0/3533338221 shutdown_connections 2024-05-10T03:38:25.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:25.280+0000 7f543f78a700 1 -- 172.21.15.45:0/3533338221 wait complete. 2024-05-10T03:38:25.285 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 9 2024-05-10T03:38:25.474 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:38:25 smithi154 bash[83391]: 562ff4b73ff591b32c6fe307d65f6d43c7e925a161d118b77ff7f0e2b7738439 2024-05-10T03:38:25.474 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:38:25 smithi154 systemd[1]: Started Ceph mds.i for d2a0bafa-0e7d-11ef-bc98-c7b262605968. 2024-05-10T03:38:25.474 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:38:25 smithi154 ceph-mds[83437]: -- 172.21.15.154:0/292464366 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5636a74f21a0 con 0x5636a7552880 2024-05-10T03:38:25.474 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:38:25 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: starting mds.i at 2024-05-10T03:38:26.233 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:26.234 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:26.234 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:26.234 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:26.234 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:26.234 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:26.234 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:26 smithi045 ceph-mon[42520]: Deploying daemon mds.g on smithi045 2024-05-10T03:38:26.234 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:26 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3533338221' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:26.234 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:26 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] up:boot 2024-05-10T03:38:26.234 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:26 smithi045 ceph-mon[42520]: fsmap 9 up:standby 2024-05-10T03:38:26.234 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-10T03:38:26.234 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:26 smithi045 ceph-mon[42520]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:26.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:26.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:26.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:26.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:26.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:26.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:26.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:26 smithi106 ceph-mon[46996]: Deploying daemon mds.g on smithi045 2024-05-10T03:38:26.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:26 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3533338221' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:26.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:26 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] up:boot 2024-05-10T03:38:26.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:26 smithi106 ceph-mon[46996]: fsmap 9 up:standby 2024-05-10T03:38:26.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-10T03:38:26.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:26 smithi106 ceph-mon[46996]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:26.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:26.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:26.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:26.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:26.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:26.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:26.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:26 smithi154 ceph-mon[46565]: Deploying daemon mds.g on smithi045 2024-05-10T03:38:26.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:26 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3533338221' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:26.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:26 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] up:boot 2024-05-10T03:38:26.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:26 smithi154 ceph-mon[46565]: fsmap 9 up:standby 2024-05-10T03:38:26.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-10T03:38:26.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:26 smithi154 ceph-mon[46565]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:26.533 INFO:journalctl@ceph.mds.g.smithi045.stdout:May 10 03:38:26 smithi045 systemd[1]: Starting Ceph mds.g for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:38:27.284 INFO:journalctl@ceph.mds.g.smithi045.stdout:May 10 03:38:26 smithi045 bash[93514]: e43dfc2f33d20ecb683ff082572ab5e5047d8883628456998c858366d6bbc034 2024-05-10T03:38:27.284 INFO:journalctl@ceph.mds.g.smithi045.stdout:May 10 03:38:26 smithi045 systemd[1]: Started Ceph mds.g for d2a0bafa-0e7d-11ef-bc98-c7b262605968. 2024-05-10T03:38:27.284 INFO:journalctl@ceph.mds.g.smithi045.stdout:May 10 03:38:26 smithi045 ceph-mds[93552]: -- 172.21.15.45:0/1027977737 <== mon.0 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5604bb5921a0 con 0x5604bb5f2400 2024-05-10T03:38:27.284 INFO:journalctl@ceph.mds.g.smithi045.stdout:May 10 03:38:26 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-g[93529]: starting mds.g at 2024-05-10T03:38:27.300 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:38:27.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.469+0000 7f28dc6ca700 1 -- 172.21.15.45:0/1924729340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28d4105040 msgr2=0x7f28d4107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:27.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.469+0000 7f28dc6ca700 1 --2- 172.21.15.45:0/1924729340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28d4105040 0x7f28d4107460 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f28c4009990 tx=0x7f28c4009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:27.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.469+0000 7f28dc6ca700 1 -- 172.21.15.45:0/1924729340 shutdown_connections 2024-05-10T03:38:27.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.469+0000 7f28dc6ca700 1 --2- 172.21.15.45:0/1924729340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d41079a0 0x7f28d4109dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:27.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.469+0000 7f28dc6ca700 1 --2- 172.21.15.45:0/1924729340 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28d41026e0 0x7f28d4104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:27.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.469+0000 7f28dc6ca700 1 --2- 172.21.15.45:0/1924729340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28d4105040 0x7f28d4107460 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:27.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.469+0000 7f28dc6ca700 1 -- 172.21.15.45:0/1924729340 >> 172.21.15.45:0/1924729340 conn(0x7f28d40fc0e0 msgr2=0x7f28d40fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:27.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.469+0000 7f28dc6ca700 1 -- 172.21.15.45:0/1924729340 shutdown_connections 2024-05-10T03:38:27.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.469+0000 7f28dc6ca700 1 -- 172.21.15.45:0/1924729340 wait complete. 2024-05-10T03:38:27.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.470+0000 7f28dc6ca700 1 Processor -- start 2024-05-10T03:38:27.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.471+0000 7f28dc6ca700 1 -- start start 2024-05-10T03:38:27.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.471+0000 7f28dc6ca700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28d41026e0 0x7f28d4198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:27.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.471+0000 7f28dc6ca700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d41079a0 0x7f28d4198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:27.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.471+0000 7f28dc6ca700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28d419d640 0x7f28d419fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:27.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.471+0000 7f28dc6ca700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d41a0140 con 0x7f28d419d640 2024-05-10T03:38:27.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.471+0000 7f28dc6ca700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d41a02b0 con 0x7f28d41026e0 2024-05-10T03:38:27.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.471+0000 7f28dc6ca700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d41a0470 con 0x7f28d41079a0 2024-05-10T03:38:27.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.471+0000 7f28dac67700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28d419d640 0x7f28d419fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:27.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.471+0000 7f28dac67700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28d419d640 0x7f28d419fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58820/0 (socket says 172.21.15.45:58820) 2024-05-10T03:38:27.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.471+0000 7f28dac67700 1 -- 172.21.15.45:0/3388134379 learned_addr learned my addr 172.21.15.45:0/3388134379 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:27.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.471+0000 7f28da466700 1 --2- 172.21.15.45:0/3388134379 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28d41026e0 0x7f28d4198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:27.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.471+0000 7f28d9c65700 1 --2- 172.21.15.45:0/3388134379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d41079a0 0x7f28d4198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:27.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.471+0000 7f28dac67700 1 -- 172.21.15.45:0/3388134379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d41079a0 msgr2=0x7f28d4198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:27.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.471+0000 7f28dac67700 1 --2- 172.21.15.45:0/3388134379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d41079a0 0x7f28d4198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:27.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.471+0000 7f28dac67700 1 -- 172.21.15.45:0/3388134379 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28d41026e0 msgr2=0x7f28d4198180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:27.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.471+0000 7f28dac67700 1 --2- 172.21.15.45:0/3388134379 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28d41026e0 0x7f28d4198180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:27.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.471+0000 7f28dac67700 1 -- 172.21.15.45:0/3388134379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c40095f0 con 0x7f28d419d640 2024-05-10T03:38:27.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.471+0000 7f28da466700 1 --2- 172.21.15.45:0/3388134379 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28d41026e0 0x7f28d4198180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:38:27.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.472+0000 7f28dac67700 1 --2- 172.21.15.45:0/3388134379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28d419d640 0x7f28d419fa60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f28cc00ef90 tx=0x7f28cc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:27.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.472+0000 7f28cb7fe700 1 -- 172.21.15.45:0/3388134379 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc018070 con 0x7f28d419d640 2024-05-10T03:38:27.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.472+0000 7f28cb7fe700 1 -- 172.21.15.45:0/3388134379 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f28cc00f040 con 0x7f28d419d640 2024-05-10T03:38:27.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.472+0000 7f28cb7fe700 1 -- 172.21.15.45:0/3388134379 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc00ce00 con 0x7f28d419d640 2024-05-10T03:38:27.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.476+0000 7f28dc6ca700 1 -- 172.21.15.45:0/3388134379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d41a06f0 con 0x7f28d419d640 2024-05-10T03:38:27.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.476+0000 7f28dc6ca700 1 -- 172.21.15.45:0/3388134379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d41a0b80 con 0x7f28d419d640 2024-05-10T03:38:27.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.477+0000 7f28dc6ca700 1 -- 172.21.15.45:0/3388134379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d40fdc90 con 0x7f28d419d640 2024-05-10T03:38:27.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.478+0000 7f28cb7fe700 1 -- 172.21.15.45:0/3388134379 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f28cc003a00 con 0x7f28d419d640 2024-05-10T03:38:27.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.479+0000 7f28cb7fe700 1 --2- 172.21.15.45:0/3388134379 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f28c00a11a0 0x7f28c00a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:27.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.479+0000 7f28cb7fe700 1 -- 172.21.15.45:0/3388134379 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f28cc0cb7a0 con 0x7f28d419d640 2024-05-10T03:38:27.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.479+0000 7f28da466700 1 --2- 172.21.15.45:0/3388134379 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f28c00a11a0 0x7f28c00a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:27.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.480+0000 7f28da466700 1 --2- 172.21.15.45:0/3388134379 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f28c00a11a0 0x7f28c00a36b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f28d4199220 tx=0x7f28d000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:27.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.484+0000 7f28cb7fe700 1 -- 172.21.15.45:0/3388134379 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f28cc04dd60 con 0x7f28d419d640 2024-05-10T03:38:27.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.766+0000 7f28dc6ca700 1 -- 172.21.15.45:0/3388134379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28d40fd670 con 0x7f28d419d640 2024-05-10T03:38:27.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.767+0000 7f28cb7fe700 1 -- 172.21.15.45:0/3388134379 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8088 (secure 0 0 0) 0x7f28cc095330 con 0x7f28d419d640 2024-05-10T03:38:27.771 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:38:27.771 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/378320264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":378320264},{"type":"v1","addr":"172.21.15.45:6835","nonce":378320264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3032381796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3032381796},{"type":"v1","addr":"172.21.15.45:6837","nonce":3032381796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14625,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/4007419304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":4007419304},{"type":"v1","addr":"172.21.15.45:6839","nonce":4007419304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24491,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/4037121210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":4037121210},{"type":"v1","addr":"172.21.15.154:6835","nonce":4037121210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24521,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/4162885659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4162885659},{"type":"v1","addr":"172.21.15.106:6835","nonce":4162885659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/608167481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":608167481},{"type":"v1","addr":"172.21.15.154:6837","nonce":608167481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24547,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/1506563336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1506563336},{"type":"v1","addr":"172.21.15.154:6839","nonce":1506563336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24548,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3047487403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":3047487403},{"type":"v1","addr":"172.21.15.106:6837","nonce":3047487403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2024-05-10T03:38:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.770+0000 7f28dc6ca700 1 -- 172.21.15.45:0/3388134379 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f28c00a11a0 msgr2=0x7f28c00a36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.770+0000 7f28dc6ca700 1 --2- 172.21.15.45:0/3388134379 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f28c00a11a0 0x7f28c00a36b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f28d4199220 tx=0x7f28d000b410 comp rx=0 tx=0).stop 2024-05-10T03:38:27.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.770+0000 7f28dc6ca700 1 -- 172.21.15.45:0/3388134379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28d419d640 msgr2=0x7f28d419fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:27.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.770+0000 7f28dc6ca700 1 --2- 172.21.15.45:0/3388134379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28d419d640 0x7f28d419fa60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f28cc00ef90 tx=0x7f28cc00c3a0 comp rx=0 tx=0).stop 2024-05-10T03:38:27.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.770+0000 7f28dc6ca700 1 -- 172.21.15.45:0/3388134379 shutdown_connections 2024-05-10T03:38:27.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.770+0000 7f28dc6ca700 1 --2- 172.21.15.45:0/3388134379 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f28c00a11a0 0x7f28c00a36b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:27.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.770+0000 7f28dc6ca700 1 --2- 172.21.15.45:0/3388134379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28d419d640 0x7f28d419fa60 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:27.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.770+0000 7f28dc6ca700 1 --2- 172.21.15.45:0/3388134379 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28d41026e0 0x7f28d4198180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:27.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.770+0000 7f28dc6ca700 1 --2- 172.21.15.45:0/3388134379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d41079a0 0x7f28d4198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:27.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.770+0000 7f28dc6ca700 1 -- 172.21.15.45:0/3388134379 >> 172.21.15.45:0/3388134379 conn(0x7f28d40fc0e0 msgr2=0x7f28d41070c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:27.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.770+0000 7f28dc6ca700 1 -- 172.21.15.45:0/3388134379 shutdown_connections 2024-05-10T03:38:27.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:27.770+0000 7f28dc6ca700 1 -- 172.21.15.45:0/3388134379 wait complete. 2024-05-10T03:38:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 11 2024-05-10T03:38:28.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:28 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:28.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:28 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:28.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:28 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:28.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:28 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:28.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:28 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:28.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:28 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:28.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:28 smithi045 ceph-mon[42520]: Deploying daemon mds.a on smithi045 2024-05-10T03:38:28.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:28 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.45:6838/4007419304,v1:172.21.15.45:6839/4007419304] up:boot 2024-05-10T03:38:28.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:28 smithi045 ceph-mon[42520]: fsmap 10 up:standby 2024-05-10T03:38:28.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:28 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-10T03:38:28.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:28 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3388134379' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:28.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:28 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:28.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:28 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:28.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:28 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:28.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:28 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:28.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:28 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:28.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:28 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:28.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:28 smithi106 ceph-mon[46996]: Deploying daemon mds.a on smithi045 2024-05-10T03:38:28.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:28 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.45:6838/4007419304,v1:172.21.15.45:6839/4007419304] up:boot 2024-05-10T03:38:28.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:28 smithi106 ceph-mon[46996]: fsmap 10 up:standby 2024-05-10T03:38:28.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:28 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-10T03:38:28.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:28 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3388134379' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:28.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:28 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:28.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:28 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:28.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:28 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:28.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:28 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:28.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:28 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:28.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:28 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:28.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:28 smithi154 ceph-mon[46565]: Deploying daemon mds.a on smithi045 2024-05-10T03:38:28.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:28 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.45:6838/4007419304,v1:172.21.15.45:6839/4007419304] up:boot 2024-05-10T03:38:28.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:28 smithi154 ceph-mon[46565]: fsmap 10 up:standby 2024-05-10T03:38:28.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:28 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-10T03:38:28.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:28 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3388134379' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:28.766 INFO:journalctl@ceph.mds.a.smithi045.stdout:May 10 03:38:28 smithi045 systemd[1]: Starting Ceph mds.a for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:38:29.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:29 smithi045 ceph-mon[42520]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:29.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:29 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:29.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:29 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:29.284 INFO:journalctl@ceph.mds.a.smithi045.stdout:May 10 03:38:28 smithi045 ceph-mds[93938]: -- 172.21.15.45:0/675163762 <== mon.0 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5637c338a1a0 con 0x5637c33ea400 2024-05-10T03:38:29.284 INFO:journalctl@ceph.mds.a.smithi045.stdout:May 10 03:38:28 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-a[93915]: starting mds.a at 2024-05-10T03:38:29.284 INFO:journalctl@ceph.mds.a.smithi045.stdout:May 10 03:38:28 smithi045 bash[93900]: 540ad2c9f4614526a35b59cdb05c66907ebbd71a79a0bd16306338d1b51cd8a5 2024-05-10T03:38:29.285 INFO:journalctl@ceph.mds.a.smithi045.stdout:May 10 03:38:28 smithi045 systemd[1]: Started Ceph mds.a for d2a0bafa-0e7d-11ef-bc98-c7b262605968. 2024-05-10T03:38:29.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:29 smithi106 ceph-mon[46996]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:29.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:29 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:29.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:29 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:29.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:29 smithi154 ceph-mon[46565]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:29.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:29 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:29.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:29 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:29.789 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:38:29.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.952+0000 7f1aef73f700 1 -- 172.21.15.45:0/1442315282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae8101d80 msgr2=0x7f1ae8108630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:29.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.952+0000 7f1aef73f700 1 --2- 172.21.15.45:0/1442315282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae8101d80 0x7f1ae8108630 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1ae000b0a0 tx=0x7f1ae000b3b0 comp rx=0 tx=0).stop 2024-05-10T03:38:29.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.952+0000 7f1aef73f700 1 -- 172.21.15.45:0/1442315282 shutdown_connections 2024-05-10T03:38:29.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.952+0000 7f1aef73f700 1 --2- 172.21.15.45:0/1442315282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae8101d80 0x7f1ae8108630 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:29.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.952+0000 7f1aef73f700 1 --2- 172.21.15.45:0/1442315282 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ae81002c0 0x7f1ae81006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:29.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.952+0000 7f1aef73f700 1 --2- 172.21.15.45:0/1442315282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ae81013e0 0x7f1ae81017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:29.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.952+0000 7f1aef73f700 1 -- 172.21.15.45:0/1442315282 >> 172.21.15.45:0/1442315282 conn(0x7f1ae80fb8f0 msgr2=0x7f1ae80fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:29.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.952+0000 7f1aef73f700 1 -- 172.21.15.45:0/1442315282 shutdown_connections 2024-05-10T03:38:29.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.952+0000 7f1aef73f700 1 -- 172.21.15.45:0/1442315282 wait complete. 2024-05-10T03:38:29.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.953+0000 7f1aef73f700 1 Processor -- start 2024-05-10T03:38:29.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.953+0000 7f1aef73f700 1 -- start start 2024-05-10T03:38:29.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.953+0000 7f1aef73f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ae81002c0 0x7f1ae8198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:29.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.953+0000 7f1aef73f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ae81013e0 0x7f1ae8198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:29.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.953+0000 7f1aef73f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae8101d80 0x7f1ae819f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:29.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.953+0000 7f1aef73f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae819fc10 con 0x7f1ae8101d80 2024-05-10T03:38:29.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.953+0000 7f1aef73f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae819fd80 con 0x7f1ae81002c0 2024-05-10T03:38:29.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.953+0000 7f1aef73f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae819ff40 con 0x7f1ae81013e0 2024-05-10T03:38:29.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.953+0000 7f1aedcdc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae8101d80 0x7f1ae819f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:29.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.953+0000 7f1aedcdc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae8101d80 0x7f1ae819f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58852/0 (socket says 172.21.15.45:58852) 2024-05-10T03:38:29.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.953+0000 7f1aedcdc700 1 -- 172.21.15.45:0/2256514971 learned_addr learned my addr 172.21.15.45:0/2256514971 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:29.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.953+0000 7f1aed4db700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ae81002c0 0x7f1ae8198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:29.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.953+0000 7f1aeccda700 1 --2- 172.21.15.45:0/2256514971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ae81013e0 0x7f1ae8198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:29.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.954+0000 7f1aedcdc700 1 -- 172.21.15.45:0/2256514971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ae81013e0 msgr2=0x7f1ae8198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:29.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.954+0000 7f1aedcdc700 1 --2- 172.21.15.45:0/2256514971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ae81013e0 0x7f1ae8198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:29.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.954+0000 7f1aedcdc700 1 -- 172.21.15.45:0/2256514971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ae81002c0 msgr2=0x7f1ae8198130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:29.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.954+0000 7f1aedcdc700 1 --2- 172.21.15.45:0/2256514971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ae81002c0 0x7f1ae8198130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:29.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.954+0000 7f1aedcdc700 1 -- 172.21.15.45:0/2256514971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae0009d00 con 0x7f1ae8101d80 2024-05-10T03:38:29.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.954+0000 7f1aeccda700 1 --2- 172.21.15.45:0/2256514971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ae81013e0 0x7f1ae8198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:38:29.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.954+0000 7f1aedcdc700 1 --2- 172.21.15.45:0/2256514971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae8101d80 0x7f1ae819f600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1ae000b830 tx=0x7f1ae00093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:29.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.954+0000 7f1ade7fc700 1 -- 172.21.15.45:0/2256514971 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae000e040 con 0x7f1ae8101d80 2024-05-10T03:38:29.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.954+0000 7f1ade7fc700 1 -- 172.21.15.45:0/2256514971 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1ae0004ce0 con 0x7f1ae8101d80 2024-05-10T03:38:29.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.954+0000 7f1aef73f700 1 -- 172.21.15.45:0/2256514971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae81a01c0 con 0x7f1ae8101d80 2024-05-10T03:38:29.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.954+0000 7f1ade7fc700 1 -- 172.21.15.45:0/2256514971 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae001d480 con 0x7f1ae8101d80 2024-05-10T03:38:29.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.954+0000 7f1aef73f700 1 -- 172.21.15.45:0/2256514971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae81a0640 con 0x7f1ae8101d80 2024-05-10T03:38:29.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.955+0000 7f1aef73f700 1 -- 172.21.15.45:0/2256514971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae81074d0 con 0x7f1ae8101d80 2024-05-10T03:38:29.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.956+0000 7f1ade7fc700 1 -- 172.21.15.45:0/2256514971 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1ae0004020 con 0x7f1ae8101d80 2024-05-10T03:38:29.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.957+0000 7f1ade7fc700 1 --2- 172.21.15.45:0/2256514971 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1ad40a1120 0x7f1ad40a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:29.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.957+0000 7f1ade7fc700 1 -- 172.21.15.45:0/2256514971 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1ae00cdd30 con 0x7f1ae8101d80 2024-05-10T03:38:29.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.957+0000 7f1aed4db700 1 --2- 172.21.15.45:0/2256514971 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1ad40a1120 0x7f1ad40a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:29.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.958+0000 7f1aed4db700 1 --2- 172.21.15.45:0/2256514971 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1ad40a1120 0x7f1ad40a3630 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1ae81012e0 tx=0x7f1ae400b510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:29.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:29.961+0000 7f1ade7fc700 1 -- 172.21.15.45:0/2256514971 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1ae00979f0 con 0x7f1ae8101d80 2024-05-10T03:38:30.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:30.235+0000 7f1aef73f700 1 -- 172.21.15.45:0/2256514971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ae80678b0 con 0x7f1ae8101d80 2024-05-10T03:38:30.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:30.236+0000 7f1ade7fc700 1 -- 172.21.15.45:0/2256514971 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+8846 (secure 0 0 0) 0x7f1ae009b010 con 0x7f1ae8101d80 2024-05-10T03:38:30.239 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:38:30.239 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/378320264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":378320264},{"type":"v1","addr":"172.21.15.45:6835","nonce":378320264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3032381796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3032381796},{"type":"v1","addr":"172.21.15.45:6837","nonce":3032381796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14625,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/4007419304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":4007419304},{"type":"v1","addr":"172.21.15.45:6839","nonce":4007419304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1355456195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1355456195},{"type":"v1","addr":"172.21.15.45:6841","nonce":1355456195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24491,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/4037121210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":4037121210},{"type":"v1","addr":"172.21.15.154:6835","nonce":4037121210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24521,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/4162885659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4162885659},{"type":"v1","addr":"172.21.15.106:6835","nonce":4162885659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/608167481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":608167481},{"type":"v1","addr":"172.21.15.154:6837","nonce":608167481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24547,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/1506563336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1506563336},{"type":"v1","addr":"172.21.15.154:6839","nonce":1506563336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24548,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3047487403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":3047487403},{"type":"v1","addr":"172.21.15.106:6837","nonce":3047487403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2024-05-10T03:38:30.242 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:30.238+0000 7f1aef73f700 1 -- 172.21.15.45:0/2256514971 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1ad40a1120 msgr2=0x7f1ad40a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:30.242 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:30.238+0000 7f1aef73f700 1 --2- 172.21.15.45:0/2256514971 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1ad40a1120 0x7f1ad40a3630 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1ae81012e0 tx=0x7f1ae400b510 comp rx=0 tx=0).stop 2024-05-10T03:38:30.242 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:30.238+0000 7f1aef73f700 1 -- 172.21.15.45:0/2256514971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae8101d80 msgr2=0x7f1ae819f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:30.242 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:30.238+0000 7f1aef73f700 1 --2- 172.21.15.45:0/2256514971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae8101d80 0x7f1ae819f600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1ae000b830 tx=0x7f1ae00093b0 comp rx=0 tx=0).stop 2024-05-10T03:38:30.242 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:30.238+0000 7f1aef73f700 1 -- 172.21.15.45:0/2256514971 shutdown_connections 2024-05-10T03:38:30.242 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:30.238+0000 7f1aef73f700 1 --2- 172.21.15.45:0/2256514971 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1ad40a1120 0x7f1ad40a3630 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:30.242 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:30.238+0000 7f1aef73f700 1 --2- 172.21.15.45:0/2256514971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae8101d80 0x7f1ae819f600 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:30.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:30.238+0000 7f1aef73f700 1 --2- 172.21.15.45:0/2256514971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ae81002c0 0x7f1ae8198130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:30.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:30.238+0000 7f1aef73f700 1 --2- 172.21.15.45:0/2256514971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ae81013e0 0x7f1ae8198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:30.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:30.238+0000 7f1aef73f700 1 -- 172.21.15.45:0/2256514971 >> 172.21.15.45:0/2256514971 conn(0x7f1ae80fb8f0 msgr2=0x7f1ae8104610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:30.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:30.239+0000 7f1aef73f700 1 -- 172.21.15.45:0/2256514971 shutdown_connections 2024-05-10T03:38:30.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:30.239+0000 7f1aef73f700 1 -- 172.21.15.45:0/2256514971 wait complete. 2024-05-10T03:38:30.243 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 12 2024-05-10T03:38:30.255 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:30 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:30.255 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:30 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:30.255 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:30 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:30.255 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:30 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:30.255 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:30 smithi045 ceph-mon[42520]: Deploying daemon mds.b on smithi106 2024-05-10T03:38:30.256 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:30 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.45:6840/1355456195,v1:172.21.15.45:6841/1355456195] up:boot 2024-05-10T03:38:30.256 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:30 smithi045 ceph-mon[42520]: fsmap 11 up:standby 2024-05-10T03:38:30.256 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:30 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-10T03:38:30.401 INFO:journalctl@ceph.mds.b.smithi106.stdout:May 10 03:38:30 smithi106 systemd[1]: Starting Ceph mds.b for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:38:30.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:30 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:30.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:30 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:30.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:30 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:30.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:30 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:30.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:30 smithi106 ceph-mon[46996]: Deploying daemon mds.b on smithi106 2024-05-10T03:38:30.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:30 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.45:6840/1355456195,v1:172.21.15.45:6841/1355456195] up:boot 2024-05-10T03:38:30.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:30 smithi106 ceph-mon[46996]: fsmap 11 up:standby 2024-05-10T03:38:30.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:30 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-10T03:38:30.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:30 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:30.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:30 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T03:38:30.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:30 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T03:38:30.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:30 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:30.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:30 smithi154 ceph-mon[46565]: Deploying daemon mds.b on smithi106 2024-05-10T03:38:30.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:30 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.45:6840/1355456195,v1:172.21.15.45:6841/1355456195] up:boot 2024-05-10T03:38:30.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:30 smithi154 ceph-mon[46565]: fsmap 11 up:standby 2024-05-10T03:38:30.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:30 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-10T03:38:31.046 INFO:journalctl@ceph.mds.b.smithi106.stdout:May 10 03:38:30 smithi106 ceph-mds[84377]: -- 172.21.15.106:0/3833162656 <== mon.2 v2:172.21.15.106:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558b98bfe1a0 con 0x558b98c5e400 2024-05-10T03:38:31.046 INFO:journalctl@ceph.mds.b.smithi106.stdout:May 10 03:38:30 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-b[84354]: starting mds.b at 2024-05-10T03:38:31.046 INFO:journalctl@ceph.mds.b.smithi106.stdout:May 10 03:38:30 smithi106 bash[84339]: 41c32d8b9b239b08d741b3893f1367980a8e07c066616bcae8f0f3f9da90647d 2024-05-10T03:38:31.046 INFO:journalctl@ceph.mds.b.smithi106.stdout:May 10 03:38:30 smithi106 systemd[1]: Started Ceph mds.b for d2a0bafa-0e7d-11ef-bc98-c7b262605968. 2024-05-10T03:38:31.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:31 smithi106 ceph-mon[46996]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:31.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:31 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2256514971' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:31.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:31 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:31.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:31 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:31.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:31 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:31.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:31 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:31.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:31 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:31.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:31 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:31.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:31 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:38:31.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:31 smithi154 ceph-mon[46565]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:31.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:31 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2256514971' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:31.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:31 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:31.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:31 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:31.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:31 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:31.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:31 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:31.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:31 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:31.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:31 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:31.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:31 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:38:31.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:31 smithi045 ceph-mon[42520]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:31.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:31 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2256514971' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:31.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:31 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:31.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:31 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:31.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:31 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:31.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:31 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:31.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:31 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:31.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:31 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:31.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:31 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:38:32.258 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:38:32.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:32 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] up:boot 2024-05-10T03:38:32.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:32 smithi106 ceph-mon[46996]: fsmap 12 up:standby 2024-05-10T03:38:32.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:32 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-10T03:38:32.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:32 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:32.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.428+0000 7f00be0bf700 1 -- 172.21.15.45:0/455603173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00b8102580 msgr2=0x7f00b8108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:32.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.428+0000 7f00be0bf700 1 --2- 172.21.15.45:0/455603173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00b8102580 0x7f00b8108e30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f00b000b0a0 tx=0x7f00b000b3b0 comp rx=0 tx=0).stop 2024-05-10T03:38:32.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.428+0000 7f00be0bf700 1 -- 172.21.15.45:0/455603173 shutdown_connections 2024-05-10T03:38:32.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.428+0000 7f00be0bf700 1 --2- 172.21.15.45:0/455603173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00b8100ac0 0x7f00b8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:32.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.428+0000 7f00be0bf700 1 --2- 172.21.15.45:0/455603173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00b8102580 0x7f00b8108e30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:32.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.428+0000 7f00be0bf700 1 --2- 172.21.15.45:0/455603173 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00b8101be0 0x7f00b8101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:32.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.428+0000 7f00be0bf700 1 -- 172.21.15.45:0/455603173 >> 172.21.15.45:0/455603173 conn(0x7f00b80fc0d0 msgr2=0x7f00b80fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:32.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.428+0000 7f00be0bf700 1 -- 172.21.15.45:0/455603173 shutdown_connections 2024-05-10T03:38:32.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.428+0000 7f00be0bf700 1 -- 172.21.15.45:0/455603173 wait complete. 2024-05-10T03:38:32.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.429+0000 7f00be0bf700 1 Processor -- start 2024-05-10T03:38:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.429+0000 7f00be0bf700 1 -- start start 2024-05-10T03:38:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.429+0000 7f00be0bf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00b8100ac0 0x7f00b8198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.429+0000 7f00be0bf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00b8101be0 0x7f00b8198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.429+0000 7f00be0bf700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00b8102580 0x7f00b819f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.429+0000 7f00be0bf700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b819fc30 con 0x7f00b8101be0 2024-05-10T03:38:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.429+0000 7f00be0bf700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b819fda0 con 0x7f00b8102580 2024-05-10T03:38:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.429+0000 7f00be0bf700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b819ff60 con 0x7f00b8100ac0 2024-05-10T03:38:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.429+0000 7f00b6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00b8101be0 0x7f00b8198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.430+0000 7f00b6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00b8101be0 0x7f00b8198690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58860/0 (socket says 172.21.15.45:58860) 2024-05-10T03:38:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.430+0000 7f00b6ffd700 1 -- 172.21.15.45:0/699645662 learned_addr learned my addr 172.21.15.45:0/699645662 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.430+0000 7f00b7fff700 1 --2- 172.21.15.45:0/699645662 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00b8102580 0x7f00b819f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:32.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.430+0000 7f00b77fe700 1 --2- 172.21.15.45:0/699645662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00b8100ac0 0x7f00b8198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:32.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.430+0000 7f00b6ffd700 1 -- 172.21.15.45:0/699645662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00b8100ac0 msgr2=0x7f00b8198150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:32.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.430+0000 7f00b6ffd700 1 --2- 172.21.15.45:0/699645662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00b8100ac0 0x7f00b8198150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:32.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.430+0000 7f00b6ffd700 1 -- 172.21.15.45:0/699645662 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00b8102580 msgr2=0x7f00b819f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:32.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.430+0000 7f00b6ffd700 1 --2- 172.21.15.45:0/699645662 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00b8102580 0x7f00b819f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:32.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.430+0000 7f00b6ffd700 1 -- 172.21.15.45:0/699645662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a8009520 con 0x7f00b8101be0 2024-05-10T03:38:32.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.430+0000 7f00b7fff700 1 --2- 172.21.15.45:0/699645662 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00b8102580 0x7f00b819f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:38:32.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.430+0000 7f00b6ffd700 1 --2- 172.21.15.45:0/699645662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00b8101be0 0x7f00b8198690 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00eb30 tx=0x7f00ac00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:32.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.430+0000 7f00b4ff9700 1 -- 172.21.15.45:0/699645662 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac009880 con 0x7f00b8101be0 2024-05-10T03:38:32.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.430+0000 7f00be0bf700 1 -- 172.21.15.45:0/699645662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00ac009520 con 0x7f00b8101be0 2024-05-10T03:38:32.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.430+0000 7f00b4ff9700 1 -- 172.21.15.45:0/699645662 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f00ac004500 con 0x7f00b8101be0 2024-05-10T03:38:32.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.430+0000 7f00b4ff9700 1 -- 172.21.15.45:0/699645662 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac010430 con 0x7f00b8101be0 2024-05-10T03:38:32.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.430+0000 7f00be0bf700 1 -- 172.21.15.45:0/699645662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b0009d00 con 0x7f00b8101be0 2024-05-10T03:38:32.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.432+0000 7f00be0bf700 1 -- 172.21.15.45:0/699645662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b80694d0 con 0x7f00b8101be0 2024-05-10T03:38:32.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.433+0000 7f00b4ff9700 1 -- 172.21.15.45:0/699645662 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f00ac00cc90 con 0x7f00b8101be0 2024-05-10T03:38:32.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.433+0000 7f00b4ff9700 1 --2- 172.21.15.45:0/699645662 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f00a00a1120 0x7f00a00a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:32.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.434+0000 7f00b77fe700 1 --2- 172.21.15.45:0/699645662 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f00a00a1120 0x7f00a00a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:32.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.434+0000 7f00b4ff9700 1 -- 172.21.15.45:0/699645662 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f00ac014070 con 0x7f00b8101be0 2024-05-10T03:38:32.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.434+0000 7f00b77fe700 1 --2- 172.21.15.45:0/699645662 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f00a00a1120 0x7f00a00a3630 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f00b8101ae0 tx=0x7f00a8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:32.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.441+0000 7f00b4ff9700 1 -- 172.21.15.45:0/699645662 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f00ac096460 con 0x7f00b8101be0 2024-05-10T03:38:32.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:32 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] up:boot 2024-05-10T03:38:32.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:32 smithi154 ceph-mon[46565]: fsmap 12 up:standby 2024-05-10T03:38:32.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:32 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-10T03:38:32.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:32 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:32.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:32 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] up:boot 2024-05-10T03:38:32.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:32 smithi045 ceph-mon[42520]: fsmap 12 up:standby 2024-05-10T03:38:32.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:32 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-10T03:38:32.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:32 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:32.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.720+0000 7f00be0bf700 1 -- 172.21.15.45:0/699645662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00b810c410 con 0x7f00b8101be0 2024-05-10T03:38:32.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.721+0000 7f00b4ff9700 1 -- 172.21.15.45:0/699645662 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9607 (secure 0 0 0) 0x7f00ac099a80 con 0x7f00b8101be0 2024-05-10T03:38:32.724 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:38:32.724 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/378320264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":378320264},{"type":"v1","addr":"172.21.15.45:6835","nonce":378320264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3032381796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3032381796},{"type":"v1","addr":"172.21.15.45:6837","nonce":3032381796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14625,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/4007419304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":4007419304},{"type":"v1","addr":"172.21.15.45:6839","nonce":4007419304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1355456195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1355456195},{"type":"v1","addr":"172.21.15.45:6841","nonce":1355456195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24491,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/4037121210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":4037121210},{"type":"v1","addr":"172.21.15.154:6835","nonce":4037121210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24521,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/4162885659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4162885659},{"type":"v1","addr":"172.21.15.106:6835","nonce":4162885659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/608167481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":608167481},{"type":"v1","addr":"172.21.15.154:6837","nonce":608167481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24547,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/1506563336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1506563336},{"type":"v1","addr":"172.21.15.154:6839","nonce":1506563336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24548,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3047487403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":3047487403},{"type":"v1","addr":"172.21.15.106:6837","nonce":3047487403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24590,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6839/3533867856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":3533867856},{"type":"v1","addr":"172.21.15.106:6839","nonce":3533867856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2024-05-10T03:38:32.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.724+0000 7f00be0bf700 1 -- 172.21.15.45:0/699645662 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f00a00a1120 msgr2=0x7f00a00a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.724+0000 7f00be0bf700 1 --2- 172.21.15.45:0/699645662 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f00a00a1120 0x7f00a00a3630 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f00b8101ae0 tx=0x7f00a8009260 comp rx=0 tx=0).stop 2024-05-10T03:38:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.724+0000 7f00be0bf700 1 -- 172.21.15.45:0/699645662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00b8101be0 msgr2=0x7f00b8198690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.724+0000 7f00be0bf700 1 --2- 172.21.15.45:0/699645662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00b8101be0 0x7f00b8198690 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00eb30 tx=0x7f00ac00ee40 comp rx=0 tx=0).stop 2024-05-10T03:38:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.724+0000 7f00be0bf700 1 -- 172.21.15.45:0/699645662 shutdown_connections 2024-05-10T03:38:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.724+0000 7f00be0bf700 1 --2- 172.21.15.45:0/699645662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00b8100ac0 0x7f00b8198150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.724+0000 7f00be0bf700 1 --2- 172.21.15.45:0/699645662 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f00a00a1120 0x7f00a00a3630 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.724+0000 7f00be0bf700 1 --2- 172.21.15.45:0/699645662 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00b8102580 0x7f00b819f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:32.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.724+0000 7f00be0bf700 1 --2- 172.21.15.45:0/699645662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00b8101be0 0x7f00b8198690 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:32.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.724+0000 7f00be0bf700 1 -- 172.21.15.45:0/699645662 >> 172.21.15.45:0/699645662 conn(0x7f00b80fc0d0 msgr2=0x7f00b80fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:32.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.724+0000 7f00be0bf700 1 -- 172.21.15.45:0/699645662 shutdown_connections 2024-05-10T03:38:32.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.724+0000 7f00be0bf700 1 -- 172.21.15.45:0/699645662 wait complete. 2024-05-10T03:38:32.728 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 13 2024-05-10T03:38:32.748 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:38:32.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.897+0000 7fb091c95700 1 -- 172.21.15.45:0/3386774462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08c101be0 msgr2=0x7fb08c101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:32.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.897+0000 7fb091c95700 1 --2- 172.21.15.45:0/3386774462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08c101be0 0x7fb08c101ff0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb080009990 tx=0x7fb080009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:32.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.897+0000 7fb091c95700 1 -- 172.21.15.45:0/3386774462 shutdown_connections 2024-05-10T03:38:32.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.897+0000 7fb091c95700 1 --2- 172.21.15.45:0/3386774462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb08c100ac0 0x7fb08c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:32.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.897+0000 7fb091c95700 1 --2- 172.21.15.45:0/3386774462 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb08c102580 0x7fb08c108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:32.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.897+0000 7fb091c95700 1 --2- 172.21.15.45:0/3386774462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08c101be0 0x7fb08c101ff0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:32.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.897+0000 7fb091c95700 1 -- 172.21.15.45:0/3386774462 >> 172.21.15.45:0/3386774462 conn(0x7fb08c0fc0d0 msgr2=0x7fb08c0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:32.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.898+0000 7fb091c95700 1 -- 172.21.15.45:0/3386774462 shutdown_connections 2024-05-10T03:38:32.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.898+0000 7fb091c95700 1 -- 172.21.15.45:0/3386774462 wait complete. 2024-05-10T03:38:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.898+0000 7fb091c95700 1 Processor -- start 2024-05-10T03:38:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.898+0000 7fb091c95700 1 -- start start 2024-05-10T03:38:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.899+0000 7fb091c95700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb08c100ac0 0x7fb08c068e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.899+0000 7fb091c95700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08c101be0 0x7fb08c19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.899+0000 7fb091c95700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb08c102580 0x7fb08c19f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.899+0000 7fb091c95700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c19fbe0 con 0x7fb08c101be0 2024-05-10T03:38:32.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.899+0000 7fb091c95700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c19fd50 con 0x7fb08c100ac0 2024-05-10T03:38:32.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.899+0000 7fb091c95700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c19ff10 con 0x7fb08c102580 2024-05-10T03:38:32.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.899+0000 7fb08affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08c101be0 0x7fb08c19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:32.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.899+0000 7fb08affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08c101be0 0x7fb08c19ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58868/0 (socket says 172.21.15.45:58868) 2024-05-10T03:38:32.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.899+0000 7fb08affd700 1 -- 172.21.15.45:0/1701432427 learned_addr learned my addr 172.21.15.45:0/1701432427 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:32.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.899+0000 7fb08b7fe700 1 --2- 172.21.15.45:0/1701432427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb08c100ac0 0x7fb08c068e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.899+0000 7fb08bfff700 1 --2- 172.21.15.45:0/1701432427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb08c102580 0x7fb08c19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.899+0000 7fb08affd700 1 -- 172.21.15.45:0/1701432427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb08c102580 msgr2=0x7fb08c19f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.899+0000 7fb08affd700 1 --2- 172.21.15.45:0/1701432427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb08c102580 0x7fb08c19f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.899+0000 7fb08affd700 1 -- 172.21.15.45:0/1701432427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb08c100ac0 msgr2=0x7fb08c068e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.899+0000 7fb08affd700 1 --2- 172.21.15.45:0/1701432427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb08c100ac0 0x7fb08c068e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.899+0000 7fb08affd700 1 -- 172.21.15.45:0/1701432427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0800095f0 con 0x7fb08c101be0 2024-05-10T03:38:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.899+0000 7fb08b7fe700 1 --2- 172.21.15.45:0/1701432427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb08c100ac0 0x7fb08c068e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:38:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.899+0000 7fb08bfff700 1 --2- 172.21.15.45:0/1701432427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb08c102580 0x7fb08c19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:38:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.900+0000 7fb08affd700 1 --2- 172.21.15.45:0/1701432427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08c101be0 0x7fb08c19ce50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb080000c00 tx=0x7fb08000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.900+0000 7fb088ff9700 1 -- 172.21.15.45:0/1701432427 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08001d070 con 0x7fb08c101be0 2024-05-10T03:38:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.900+0000 7fb088ff9700 1 -- 172.21.15.45:0/1701432427 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb08000be70 con 0x7fb08c101be0 2024-05-10T03:38:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.900+0000 7fb091c95700 1 -- 172.21.15.45:0/1701432427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb08c1a0130 con 0x7fb08c101be0 2024-05-10T03:38:32.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.900+0000 7fb088ff9700 1 -- 172.21.15.45:0/1701432427 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0800173f0 con 0x7fb08c101be0 2024-05-10T03:38:32.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.900+0000 7fb091c95700 1 -- 172.21.15.45:0/1701432427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08c1a0550 con 0x7fb08c101be0 2024-05-10T03:38:32.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.901+0000 7fb091c95700 1 -- 172.21.15.45:0/1701432427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08c107cd0 con 0x7fb08c101be0 2024-05-10T03:38:32.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.903+0000 7fb088ff9700 1 -- 172.21.15.45:0/1701432427 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb080021410 con 0x7fb08c101be0 2024-05-10T03:38:32.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.904+0000 7fb088ff9700 1 --2- 172.21.15.45:0/1701432427 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb0740a1120 0x7fb0740a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:32.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.904+0000 7fb088ff9700 1 -- 172.21.15.45:0/1701432427 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb0800cd9f0 con 0x7fb08c101be0 2024-05-10T03:38:32.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.904+0000 7fb08b7fe700 1 --2- 172.21.15.45:0/1701432427 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb0740a1120 0x7fb0740a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:32.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.905+0000 7fb08b7fe700 1 --2- 172.21.15.45:0/1701432427 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb0740a1120 0x7fb0740a3630 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb08c101ae0 tx=0x7fb07c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:32.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:32.908+0000 7fb088ff9700 1 -- 172.21.15.45:0/1701432427 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb0800976b0 con 0x7fb08c101be0 2024-05-10T03:38:33.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.151+0000 7fb091c95700 1 -- 172.21.15.45:0/1701432427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb08c10c450 con 0x7fb08c101be0 2024-05-10T03:38:33.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.152+0000 7fb088ff9700 1 -- 172.21.15.45:0/1701432427 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+18443 (secure 0 0 0) 0x7fb08009acd0 con 0x7fb08c101be0 2024-05-10T03:38:33.155 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:38:33.155 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":77,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:38:02.806163+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:38:33.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.155+0000 7fb091c95700 1 -- 172.21.15.45:0/1701432427 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb0740a1120 msgr2=0x7fb0740a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.155+0000 7fb091c95700 1 --2- 172.21.15.45:0/1701432427 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb0740a1120 0x7fb0740a3630 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb08c101ae0 tx=0x7fb07c009260 comp rx=0 tx=0).stop 2024-05-10T03:38:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.155+0000 7fb091c95700 1 -- 172.21.15.45:0/1701432427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08c101be0 msgr2=0x7fb08c19ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.155+0000 7fb091c95700 1 --2- 172.21.15.45:0/1701432427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08c101be0 0x7fb08c19ce50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb080000c00 tx=0x7fb08000f690 comp rx=0 tx=0).stop 2024-05-10T03:38:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.155+0000 7fb091c95700 1 -- 172.21.15.45:0/1701432427 shutdown_connections 2024-05-10T03:38:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.155+0000 7fb091c95700 1 --2- 172.21.15.45:0/1701432427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb08c102580 0x7fb08c19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.155+0000 7fb091c95700 1 --2- 172.21.15.45:0/1701432427 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb0740a1120 0x7fb0740a3630 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.155+0000 7fb091c95700 1 --2- 172.21.15.45:0/1701432427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb08c100ac0 0x7fb08c068e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.155+0000 7fb091c95700 1 --2- 172.21.15.45:0/1701432427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08c101be0 0x7fb08c19ce50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.155+0000 7fb091c95700 1 -- 172.21.15.45:0/1701432427 >> 172.21.15.45:0/1701432427 conn(0x7fb08c0fc0d0 msgr2=0x7fb08c104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.155+0000 7fb091c95700 1 -- 172.21.15.45:0/1701432427 shutdown_connections 2024-05-10T03:38:33.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.155+0000 7fb091c95700 1 -- 172.21.15.45:0/1701432427 wait complete. 2024-05-10T03:38:33.172 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T03:35:20.339400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T03:38:33.172 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T03:38:33.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.330+0000 7f41a5450700 1 -- 172.21.15.45:0/1524296472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a0101be0 msgr2=0x7f41a0101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:33.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.330+0000 7f41a5450700 1 --2- 172.21.15.45:0/1524296472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a0101be0 0x7f41a0101ff0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4194009990 tx=0x7f4194009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:33.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.330+0000 7f41a5450700 1 -- 172.21.15.45:0/1524296472 shutdown_connections 2024-05-10T03:38:33.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.330+0000 7f41a5450700 1 --2- 172.21.15.45:0/1524296472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41a0100ac0 0x7f41a0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:33.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.330+0000 7f41a5450700 1 --2- 172.21.15.45:0/1524296472 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a0102580 0x7f41a0108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:33.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.330+0000 7f41a5450700 1 --2- 172.21.15.45:0/1524296472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a0101be0 0x7f41a0101ff0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:33.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.330+0000 7f41a5450700 1 -- 172.21.15.45:0/1524296472 >> 172.21.15.45:0/1524296472 conn(0x7f41a00fc0d0 msgr2=0x7f41a00fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:33.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.330+0000 7f41a5450700 1 -- 172.21.15.45:0/1524296472 shutdown_connections 2024-05-10T03:38:33.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.331+0000 7f41a5450700 1 -- 172.21.15.45:0/1524296472 wait complete. 2024-05-10T03:38:33.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.331+0000 7f41a5450700 1 Processor -- start 2024-05-10T03:38:33.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.332+0000 7f41a5450700 1 -- start start 2024-05-10T03:38:33.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.332+0000 7f41a5450700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a0100ac0 0x7f41a0068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:33.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.332+0000 7f41a5450700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41a0101be0 0x7f41a019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:33.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.332+0000 7f41a5450700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a0102580 0x7f41a019f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:33.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.332+0000 7f41a5450700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a019fa40 con 0x7f41a0100ac0 2024-05-10T03:38:33.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.332+0000 7f41a5450700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a019fbb0 con 0x7f41a0102580 2024-05-10T03:38:33.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.332+0000 7f41a5450700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a019fd70 con 0x7f41a0101be0 2024-05-10T03:38:33.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.332+0000 7f419effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a0100ac0 0x7f41a0068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:33.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.332+0000 7f419e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41a0101be0 0x7f41a019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:33.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.332+0000 7f419effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a0100ac0 0x7f41a0068e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58886/0 (socket says 172.21.15.45:58886) 2024-05-10T03:38:33.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.332+0000 7f419effd700 1 -- 172.21.15.45:0/3247494819 learned_addr learned my addr 172.21.15.45:0/3247494819 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:33.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.332+0000 7f419f7fe700 1 --2- 172.21.15.45:0/3247494819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a0102580 0x7f41a019f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:33.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.332+0000 7f419f7fe700 1 -- 172.21.15.45:0/3247494819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41a0101be0 msgr2=0x7f41a019ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:33.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.332+0000 7f419f7fe700 1 --2- 172.21.15.45:0/3247494819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41a0101be0 0x7f41a019ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:33.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.332+0000 7f419f7fe700 1 -- 172.21.15.45:0/3247494819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a0100ac0 msgr2=0x7f41a0068e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:33.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.332+0000 7f419f7fe700 1 --2- 172.21.15.45:0/3247494819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a0100ac0 0x7f41a0068e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:33.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.332+0000 7f419f7fe700 1 -- 172.21.15.45:0/3247494819 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4198009c40 con 0x7f41a0102580 2024-05-10T03:38:33.338 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.332+0000 7f419e7fc700 1 --2- 172.21.15.45:0/3247494819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41a0101be0 0x7f41a019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:38:33.338 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.333+0000 7f419f7fe700 1 --2- 172.21.15.45:0/3247494819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a0102580 0x7f41a019f340 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f419800efb0 tx=0x7f419800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:33.338 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.333+0000 7f4187fff700 1 -- 172.21.15.45:0/3247494819 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4198003a00 con 0x7f41a0102580 2024-05-10T03:38:33.338 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.333+0000 7f41a5450700 1 -- 172.21.15.45:0/3247494819 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41940095f0 con 0x7f41a0102580 2024-05-10T03:38:33.338 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.333+0000 7f4187fff700 1 -- 172.21.15.45:0/3247494819 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f419800f040 con 0x7f41a0102580 2024-05-10T03:38:33.338 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.333+0000 7f4187fff700 1 -- 172.21.15.45:0/3247494819 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41980046a0 con 0x7f41a0102580 2024-05-10T03:38:33.338 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.333+0000 7f41a5450700 1 -- 172.21.15.45:0/3247494819 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a01a02c0 con 0x7f41a0102580 2024-05-10T03:38:33.338 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.334+0000 7f41a5450700 1 -- 172.21.15.45:0/3247494819 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a0107cd0 con 0x7f41a0102580 2024-05-10T03:38:33.339 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.335+0000 7f4187fff700 1 -- 172.21.15.45:0/3247494819 <== mon.2 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4198004bd0 con 0x7f41a0102580 2024-05-10T03:38:33.339 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.336+0000 7f4187fff700 1 --2- 172.21.15.45:0/3247494819 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f41880a11c0 0x7f41880a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:33.339 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.336+0000 7f4187fff700 1 -- 172.21.15.45:0/3247494819 <== mon.2 v2:172.21.15.106:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f41980cbf80 con 0x7f41a0102580 2024-05-10T03:38:33.339 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.336+0000 7f419effd700 1 --2- 172.21.15.45:0/3247494819 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f41880a11c0 0x7f41880a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:33.339 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.337+0000 7f419effd700 1 --2- 172.21.15.45:0/3247494819 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f41880a11c0 0x7f41880a36d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4190005950 tx=0x7f4190007480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:33.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.343+0000 7f4187fff700 1 -- 172.21.15.45:0/3247494819 <== mon.2 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4198095ba0 con 0x7f41a0102580 2024-05-10T03:38:33.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:33 smithi106 ceph-mon[46996]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:33.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:33 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:33.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:33 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:33.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:33 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:33.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:33 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:33.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:33 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:33.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:33 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:33.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:33 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:38:33.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:33 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:33.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:33 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:38:33.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:33 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/699645662' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:33.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:33 smithi154 ceph-mon[46565]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:33.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:33 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:33.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:33 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:33.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:33 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:33.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:33 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:33.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:33 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:33.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:33 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:33.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:33 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:38:33.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:33 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:33.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:33 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:38:33.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:33 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/699645662' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:33.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:33 smithi045 ceph-mon[42520]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:33.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:33 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:33.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:33 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:33.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:33 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:33.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:33 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:33.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:33 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:33.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:33 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:33.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:33 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:38:33.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:33 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:33.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:33 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:38:33.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:33 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/699645662' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:33.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.576+0000 7f41a5450700 1 -- 172.21.15.45:0/3247494819 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f41a010c400 con 0x7f41a0102580 2024-05-10T03:38:33.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.577+0000 7f4187fff700 1 -- 172.21.15.45:0/3247494819 <== mon.2 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7f41980991c0 con 0x7f41a0102580 2024-05-10T03:38:33.579 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-05-10T03:38:33.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.580+0000 7f41a5450700 1 -- 172.21.15.45:0/3247494819 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f41880a11c0 msgr2=0x7f41880a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:33.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.580+0000 7f41a5450700 1 --2- 172.21.15.45:0/3247494819 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f41880a11c0 0x7f41880a36d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4190005950 tx=0x7f4190007480 comp rx=0 tx=0).stop 2024-05-10T03:38:33.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.580+0000 7f41a5450700 1 -- 172.21.15.45:0/3247494819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a0102580 msgr2=0x7f41a019f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:33.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.580+0000 7f41a5450700 1 --2- 172.21.15.45:0/3247494819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a0102580 0x7f41a019f340 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f419800efb0 tx=0x7f419800c3a0 comp rx=0 tx=0).stop 2024-05-10T03:38:33.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.580+0000 7f41a5450700 1 -- 172.21.15.45:0/3247494819 shutdown_connections 2024-05-10T03:38:33.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.580+0000 7f41a5450700 1 --2- 172.21.15.45:0/3247494819 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f41880a11c0 0x7f41880a36d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:33.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.580+0000 7f41a5450700 1 --2- 172.21.15.45:0/3247494819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a0102580 0x7f41a019f340 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:33.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.580+0000 7f41a5450700 1 --2- 172.21.15.45:0/3247494819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a0100ac0 0x7f41a0068e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:33.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.580+0000 7f41a5450700 1 --2- 172.21.15.45:0/3247494819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41a0101be0 0x7f41a019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:33.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.580+0000 7f41a5450700 1 -- 172.21.15.45:0/3247494819 >> 172.21.15.45:0/3247494819 conn(0x7f41a00fc0d0 msgr2=0x7f41a0104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:33.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.580+0000 7f41a5450700 1 -- 172.21.15.45:0/3247494819 shutdown_connections 2024-05-10T03:38:33.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.580+0000 7f41a5450700 1 -- 172.21.15.45:0/3247494819 wait complete. 2024-05-10T03:38:33.598 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-10T03:38:33.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.767+0000 7f1dfec7c700 1 -- 172.21.15.45:0/4175226350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1df8101bf0 msgr2=0x7f1df8102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:33.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.767+0000 7f1dfec7c700 1 --2- 172.21.15.45:0/4175226350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1df8101bf0 0x7f1df8102000 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1de4009990 tx=0x7f1de4009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:33.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.767+0000 7f1dfec7c700 1 -- 172.21.15.45:0/4175226350 shutdown_connections 2024-05-10T03:38:33.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.767+0000 7f1dfec7c700 1 --2- 172.21.15.45:0/4175226350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1df8102590 0x7f1df8108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:33.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.767+0000 7f1dfec7c700 1 --2- 172.21.15.45:0/4175226350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1df8100ad0 0x7f1df8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:33.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.767+0000 7f1dfec7c700 1 --2- 172.21.15.45:0/4175226350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1df8101bf0 0x7f1df8102000 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:33.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.767+0000 7f1dfec7c700 1 -- 172.21.15.45:0/4175226350 >> 172.21.15.45:0/4175226350 conn(0x7f1df80fc0c0 msgr2=0x7f1df80fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:33.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.767+0000 7f1dfec7c700 1 -- 172.21.15.45:0/4175226350 shutdown_connections 2024-05-10T03:38:33.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.767+0000 7f1dfec7c700 1 -- 172.21.15.45:0/4175226350 wait complete. 2024-05-10T03:38:33.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.768+0000 7f1dfec7c700 1 Processor -- start 2024-05-10T03:38:33.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.768+0000 7f1dfec7c700 1 -- start start 2024-05-10T03:38:33.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.769+0000 7f1dfec7c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1df8100ad0 0x7f1df8198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:33.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.769+0000 7f1dfec7c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1df8101bf0 0x7f1df81985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:33.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.769+0000 7f1dfec7c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1df8102590 0x7f1df819f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:33.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.769+0000 7f1dfec7c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df819fb40 con 0x7f1df8101bf0 2024-05-10T03:38:33.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.769+0000 7f1dfec7c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df819fcb0 con 0x7f1df8100ad0 2024-05-10T03:38:33.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.769+0000 7f1dfec7c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df819fe70 con 0x7f1df8102590 2024-05-10T03:38:33.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.769+0000 7f1df7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1df8101bf0 0x7f1df81985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:33.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.769+0000 7f1df7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1df8101bf0 0x7f1df81985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58904/0 (socket says 172.21.15.45:58904) 2024-05-10T03:38:33.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.769+0000 7f1df7fff700 1 -- 172.21.15.45:0/428541383 learned_addr learned my addr 172.21.15.45:0/428541383 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:33.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.769+0000 7f1dfd219700 1 --2- 172.21.15.45:0/428541383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1df8102590 0x7f1df819f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:33.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.769+0000 7f1dfca18700 1 --2- 172.21.15.45:0/428541383 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1df8100ad0 0x7f1df8198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:33.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.769+0000 7f1df7fff700 1 -- 172.21.15.45:0/428541383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1df8102590 msgr2=0x7f1df819f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:33.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.769+0000 7f1df7fff700 1 --2- 172.21.15.45:0/428541383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1df8102590 0x7f1df819f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:33.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.769+0000 7f1df7fff700 1 -- 172.21.15.45:0/428541383 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1df8100ad0 msgr2=0x7f1df8198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:33.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.769+0000 7f1df7fff700 1 --2- 172.21.15.45:0/428541383 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1df8100ad0 0x7f1df8198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:33.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.769+0000 7f1df7fff700 1 -- 172.21.15.45:0/428541383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dec009520 con 0x7f1df8101bf0 2024-05-10T03:38:33.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.769+0000 7f1dfd219700 1 --2- 172.21.15.45:0/428541383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1df8102590 0x7f1df819f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:38:33.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.769+0000 7f1dfca18700 1 --2- 172.21.15.45:0/428541383 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1df8100ad0 0x7f1df8198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:38:33.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.770+0000 7f1df7fff700 1 --2- 172.21.15.45:0/428541383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1df8101bf0 0x7f1df81985a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1de400f690 tx=0x7f1de400f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:33.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.770+0000 7f1df5ffb700 1 -- 172.21.15.45:0/428541383 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de401d070 con 0x7f1df8101bf0 2024-05-10T03:38:33.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.770+0000 7f1dfec7c700 1 -- 172.21.15.45:0/428541383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df0009c40 con 0x7f1df8101bf0 2024-05-10T03:38:33.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.770+0000 7f1df5ffb700 1 -- 172.21.15.45:0/428541383 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1de400be70 con 0x7f1df8101bf0 2024-05-10T03:38:33.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.770+0000 7f1df5ffb700 1 -- 172.21.15.45:0/428541383 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de4017650 con 0x7f1df8101bf0 2024-05-10T03:38:33.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.770+0000 7f1dfec7c700 1 -- 172.21.15.45:0/428541383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de40095f0 con 0x7f1df8101bf0 2024-05-10T03:38:33.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.772+0000 7f1dfec7c700 1 -- 172.21.15.45:0/428541383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df80678b0 con 0x7f1df8101bf0 2024-05-10T03:38:33.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.773+0000 7f1df5ffb700 1 -- 172.21.15.45:0/428541383 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1de4021410 con 0x7f1df8101bf0 2024-05-10T03:38:33.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.773+0000 7f1df5ffb700 1 --2- 172.21.15.45:0/428541383 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1de80a1120 0x7f1de80a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:33.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.774+0000 7f1dfca18700 1 --2- 172.21.15.45:0/428541383 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1de80a1120 0x7f1de80a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:33.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.774+0000 7f1df5ffb700 1 -- 172.21.15.45:0/428541383 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1de40cd820 con 0x7f1df8101bf0 2024-05-10T03:38:33.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.774+0000 7f1dfca18700 1 --2- 172.21.15.45:0/428541383 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1de80a1120 0x7f1de80a3630 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1dec009fd0 tx=0x7f1dec009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:33.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:33.782+0000 7f1df5ffb700 1 -- 172.21.15.45:0/428541383 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1de40974e0 con 0x7f1df8101bf0 2024-05-10T03:38:34.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.010+0000 7f1dfec7c700 1 -- 172.21.15.45:0/428541383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1df81a0470 con 0x7f1df8101bf0 2024-05-10T03:38:34.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.010+0000 7f1df5ffb700 1 -- 172.21.15.45:0/428541383 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1de409ab00 con 0x7f1df8101bf0 2024-05-10T03:38:34.013 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:38:34.014 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2024-05-10T03:38:34.014 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:38:34.014 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2024-05-10T03:38:34.014 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2024-05-10T03:38:34.014 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:38:34.014 INFO:teuthology.orchestra.run.smithi045.stdout:] 2024-05-10T03:38:34.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.013+0000 7f1dfec7c700 1 -- 172.21.15.45:0/428541383 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1de80a1120 msgr2=0x7f1de80a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:34.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.013+0000 7f1dfec7c700 1 --2- 172.21.15.45:0/428541383 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1de80a1120 0x7f1de80a3630 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1dec009fd0 tx=0x7f1dec009260 comp rx=0 tx=0).stop 2024-05-10T03:38:34.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.013+0000 7f1dfec7c700 1 -- 172.21.15.45:0/428541383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1df8101bf0 msgr2=0x7f1df81985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.013+0000 7f1dfec7c700 1 --2- 172.21.15.45:0/428541383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1df8101bf0 0x7f1df81985a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1de400f690 tx=0x7f1de400f6c0 comp rx=0 tx=0).stop 2024-05-10T03:38:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.013+0000 7f1dfec7c700 1 -- 172.21.15.45:0/428541383 shutdown_connections 2024-05-10T03:38:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.013+0000 7f1dfec7c700 1 --2- 172.21.15.45:0/428541383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1df8102590 0x7f1df819f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.013+0000 7f1dfec7c700 1 --2- 172.21.15.45:0/428541383 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1de80a1120 0x7f1de80a3630 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.013+0000 7f1dfec7c700 1 --2- 172.21.15.45:0/428541383 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1df8100ad0 0x7f1df8198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:34.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.013+0000 7f1dfec7c700 1 --2- 172.21.15.45:0/428541383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1df8101bf0 0x7f1df81985a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:34.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.013+0000 7f1dfec7c700 1 -- 172.21.15.45:0/428541383 >> 172.21.15.45:0/428541383 conn(0x7f1df80fc0c0 msgr2=0x7f1df80fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:34.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.013+0000 7f1dfec7c700 1 -- 172.21.15.45:0/428541383 shutdown_connections 2024-05-10T03:38:34.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.013+0000 7f1dfec7c700 1 -- 172.21.15.45:0/428541383 wait complete. 2024-05-10T03:38:34.030 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-10T03:38:34.030 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-10T03:38:34.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.184+0000 7f35401c6700 1 -- 172.21.15.45:0/1136649898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3538100ac0 msgr2=0x7f3538100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:34.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.184+0000 7f35401c6700 1 --2- 172.21.15.45:0/1136649898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3538100ac0 0x7f3538100ed0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3534009990 tx=0x7f3534009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:34.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.184+0000 7f35401c6700 1 -- 172.21.15.45:0/1136649898 shutdown_connections 2024-05-10T03:38:34.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.184+0000 7f35401c6700 1 --2- 172.21.15.45:0/1136649898 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3538102580 0x7f3538108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:34.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.184+0000 7f35401c6700 1 --2- 172.21.15.45:0/1136649898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3538100ac0 0x7f3538100ed0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:34.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.184+0000 7f35401c6700 1 --2- 172.21.15.45:0/1136649898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3538101be0 0x7f3538101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:34.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.184+0000 7f35401c6700 1 -- 172.21.15.45:0/1136649898 >> 172.21.15.45:0/1136649898 conn(0x7f35380fc0d0 msgr2=0x7f35380fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:34.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.185+0000 7f35401c6700 1 -- 172.21.15.45:0/1136649898 shutdown_connections 2024-05-10T03:38:34.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.185+0000 7f35401c6700 1 -- 172.21.15.45:0/1136649898 wait complete. 2024-05-10T03:38:34.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.185+0000 7f35401c6700 1 Processor -- start 2024-05-10T03:38:34.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.185+0000 7f35401c6700 1 -- start start 2024-05-10T03:38:34.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.185+0000 7f35401c6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3538100ac0 0x7f3538198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:34.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.186+0000 7f35401c6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3538101be0 0x7f3538198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:34.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.186+0000 7f35401c6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3538102580 0x7f353819f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:34.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.186+0000 7f35401c6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353819fb10 con 0x7f3538100ac0 2024-05-10T03:38:34.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.186+0000 7f35401c6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353819fc80 con 0x7f3538102580 2024-05-10T03:38:34.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.186+0000 7f35401c6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353819fe40 con 0x7f3538101be0 2024-05-10T03:38:34.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.186+0000 7f353df62700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3538100ac0 0x7f3538198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:34.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.186+0000 7f353df62700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3538100ac0 0x7f3538198030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58908/0 (socket says 172.21.15.45:58908) 2024-05-10T03:38:34.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.186+0000 7f353df62700 1 -- 172.21.15.45:0/1863177698 learned_addr learned my addr 172.21.15.45:0/1863177698 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:34.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.186+0000 7f353d761700 1 --2- 172.21.15.45:0/1863177698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3538101be0 0x7f3538198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:34.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.186+0000 7f353e763700 1 --2- 172.21.15.45:0/1863177698 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3538102580 0x7f353819f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:34.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.186+0000 7f353df62700 1 -- 172.21.15.45:0/1863177698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3538101be0 msgr2=0x7f3538198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:34.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.186+0000 7f353df62700 1 --2- 172.21.15.45:0/1863177698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3538101be0 0x7f3538198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:34.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.186+0000 7f353df62700 1 -- 172.21.15.45:0/1863177698 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3538102580 msgr2=0x7f353819f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:34.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.186+0000 7f353df62700 1 --2- 172.21.15.45:0/1863177698 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3538102580 0x7f353819f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:34.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.186+0000 7f353df62700 1 -- 172.21.15.45:0/1863177698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35340095f0 con 0x7f3538100ac0 2024-05-10T03:38:34.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.186+0000 7f353e763700 1 --2- 172.21.15.45:0/1863177698 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3538102580 0x7f353819f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:38:34.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.186+0000 7f353df62700 1 --2- 172.21.15.45:0/1863177698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3538100ac0 0x7f3538198030 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f35340095c0 tx=0x7f3534003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:34.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.186+0000 7f352affd700 1 -- 172.21.15.45:0/1863177698 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353401d070 con 0x7f3538100ac0 2024-05-10T03:38:34.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.186+0000 7f352affd700 1 -- 172.21.15.45:0/1863177698 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f353400f460 con 0x7f3538100ac0 2024-05-10T03:38:34.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.186+0000 7f35401c6700 1 -- 172.21.15.45:0/1863177698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35381a00c0 con 0x7f3538100ac0 2024-05-10T03:38:34.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.186+0000 7f352affd700 1 -- 172.21.15.45:0/1863177698 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3534017630 con 0x7f3538100ac0 2024-05-10T03:38:34.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.186+0000 7f35401c6700 1 -- 172.21.15.45:0/1863177698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35381a0540 con 0x7f3538100ac0 2024-05-10T03:38:34.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.187+0000 7f35401c6700 1 -- 172.21.15.45:0/1863177698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35380694d0 con 0x7f3538100ac0 2024-05-10T03:38:34.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.189+0000 7f352affd700 1 -- 172.21.15.45:0/1863177698 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f353400f5d0 con 0x7f3538100ac0 2024-05-10T03:38:34.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.190+0000 7f352affd700 1 --2- 172.21.15.45:0/1863177698 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f35240a1240 0x7f35240a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:34.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.190+0000 7f353d761700 1 --2- 172.21.15.45:0/1863177698 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f35240a1240 0x7f35240a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:34.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.190+0000 7f352affd700 1 -- 172.21.15.45:0/1863177698 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f35340cd6f0 con 0x7f3538100ac0 2024-05-10T03:38:34.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.190+0000 7f353d761700 1 --2- 172.21.15.45:0/1863177698 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f35240a1240 0x7f35240a3750 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f35381990d0 tx=0x7f352c0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:34.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.193+0000 7f352affd700 1 -- 172.21.15.45:0/1863177698 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f35340973b0 con 0x7f3538100ac0 2024-05-10T03:38:34.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:34 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1701432427' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:34.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:34 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3247494819' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:38:34.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:34 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:34.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:34 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:34.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:34 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:34.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:34 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:34.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:34 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:34.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:34 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:34.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:34 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:34.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:34 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:38:34.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:34 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:34.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:34 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/428541383' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-10T03:38:34.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:34 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1701432427' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:34.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:34 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3247494819' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:38:34.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:34 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:34.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:34 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:34.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:34 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:34.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:34 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:34.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:34 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:34.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:34 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:34.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:34 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:34.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:34 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:38:34.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:34 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:34.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:34 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/428541383' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-10T03:38:34.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:34.419+0000 7f35401c6700 1 -- 172.21.15.45:0/1863177698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f353810c430 con 0x7f3538100ac0 2024-05-10T03:38:34.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:34 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1701432427' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:34.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:34 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3247494819' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:38:34.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:34 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:34.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:34 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:34.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:34 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:34.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:34 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:34.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:34 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:34.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:34 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:34.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:34 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:38:34.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:34 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:38:34.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:34 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:38:34.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:34 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/428541383' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-10T03:38:35.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.074+0000 7f352affd700 1 -- 172.21.15.45:0/1863177698 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) v1 ==== 138+0+0 (secure 0 0 0) 0x7f353409a9d0 con 0x7f3538100ac0 2024-05-10T03:38:35.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.080+0000 7f35401c6700 1 -- 172.21.15.45:0/1863177698 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f35240a1240 msgr2=0x7f35240a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:35.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.080+0000 7f35401c6700 1 --2- 172.21.15.45:0/1863177698 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f35240a1240 0x7f35240a3750 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f35381990d0 tx=0x7f352c0073d0 comp rx=0 tx=0).stop 2024-05-10T03:38:35.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.080+0000 7f35401c6700 1 -- 172.21.15.45:0/1863177698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3538100ac0 msgr2=0x7f3538198030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:35.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.080+0000 7f35401c6700 1 --2- 172.21.15.45:0/1863177698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3538100ac0 0x7f3538198030 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f35340095c0 tx=0x7f3534003c00 comp rx=0 tx=0).stop 2024-05-10T03:38:35.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.080+0000 7f35401c6700 1 -- 172.21.15.45:0/1863177698 shutdown_connections 2024-05-10T03:38:35.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.080+0000 7f35401c6700 1 --2- 172.21.15.45:0/1863177698 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f35240a1240 0x7f35240a3750 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:35.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.080+0000 7f35401c6700 1 --2- 172.21.15.45:0/1863177698 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3538102580 0x7f353819f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:35.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.080+0000 7f35401c6700 1 --2- 172.21.15.45:0/1863177698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3538100ac0 0x7f3538198030 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:35.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.080+0000 7f35401c6700 1 --2- 172.21.15.45:0/1863177698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3538101be0 0x7f3538198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:35.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.080+0000 7f35401c6700 1 -- 172.21.15.45:0/1863177698 >> 172.21.15.45:0/1863177698 conn(0x7f35380fc0d0 msgr2=0x7f35380fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:35.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.081+0000 7f35401c6700 1 -- 172.21.15.45:0/1863177698 shutdown_connections 2024-05-10T03:38:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.081+0000 7f35401c6700 1 -- 172.21.15.45:0/1863177698 wait complete. 2024-05-10T03:38:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2024-05-10T03:38:35.100 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-10T03:38:35.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.257+0000 7f57f6cb6700 1 -- 172.21.15.45:0/4032874478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57f0102580 msgr2=0x7f57f0108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:35.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.257+0000 7f57f6cb6700 1 --2- 172.21.15.45:0/4032874478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57f0102580 0x7f57f0108e30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f57e800b0a0 tx=0x7f57e800b3b0 comp rx=0 tx=0).stop 2024-05-10T03:38:35.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.257+0000 7f57f6cb6700 1 -- 172.21.15.45:0/4032874478 shutdown_connections 2024-05-10T03:38:35.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.257+0000 7f57f6cb6700 1 --2- 172.21.15.45:0/4032874478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57f0100ac0 0x7f57f0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:35.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.257+0000 7f57f6cb6700 1 --2- 172.21.15.45:0/4032874478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57f0102580 0x7f57f0108e30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:35.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.257+0000 7f57f6cb6700 1 --2- 172.21.15.45:0/4032874478 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57f0101be0 0x7f57f0101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:35.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.257+0000 7f57f6cb6700 1 -- 172.21.15.45:0/4032874478 >> 172.21.15.45:0/4032874478 conn(0x7f57f00fc0d0 msgr2=0x7f57f00fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:35.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.258+0000 7f57f6cb6700 1 -- 172.21.15.45:0/4032874478 shutdown_connections 2024-05-10T03:38:35.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.258+0000 7f57f6cb6700 1 -- 172.21.15.45:0/4032874478 wait complete. 2024-05-10T03:38:35.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.258+0000 7f57f6cb6700 1 Processor -- start 2024-05-10T03:38:35.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.258+0000 7f57f6cb6700 1 -- start start 2024-05-10T03:38:35.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.259+0000 7f57f6cb6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57f0100ac0 0x7f57f01980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:35.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.259+0000 7f57f6cb6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57f0101be0 0x7f57f0198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:35.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.259+0000 7f57f6cb6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57f0102580 0x7f57f019f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:35.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.259+0000 7f57f6cb6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f019fb50 con 0x7f57f0100ac0 2024-05-10T03:38:35.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.259+0000 7f57f6cb6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f019fcc0 con 0x7f57f0101be0 2024-05-10T03:38:35.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.259+0000 7f57f6cb6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f019fe80 con 0x7f57f0102580 2024-05-10T03:38:35.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.259+0000 7f57f4a52700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57f0100ac0 0x7f57f01980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:35.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.259+0000 7f57f4a52700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57f0100ac0 0x7f57f01980c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58930/0 (socket says 172.21.15.45:58930) 2024-05-10T03:38:35.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.259+0000 7f57f4a52700 1 -- 172.21.15.45:0/2120074476 learned_addr learned my addr 172.21.15.45:0/2120074476 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:35.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.259+0000 7f57f5253700 1 --2- 172.21.15.45:0/2120074476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57f0102580 0x7f57f019f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:35.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.259+0000 7f57effff700 1 --2- 172.21.15.45:0/2120074476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57f0101be0 0x7f57f0198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:35.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.259+0000 7f57f4a52700 1 -- 172.21.15.45:0/2120074476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57f0102580 msgr2=0x7f57f019f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:35.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.259+0000 7f57f4a52700 1 --2- 172.21.15.45:0/2120074476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57f0102580 0x7f57f019f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:35.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.259+0000 7f57f4a52700 1 -- 172.21.15.45:0/2120074476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57f0101be0 msgr2=0x7f57f0198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:35.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.259+0000 7f57f4a52700 1 --2- 172.21.15.45:0/2120074476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57f0101be0 0x7f57f0198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:35.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.259+0000 7f57f4a52700 1 -- 172.21.15.45:0/2120074476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e8009d00 con 0x7f57f0100ac0 2024-05-10T03:38:35.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.259+0000 7f57f4a52700 1 --2- 172.21.15.45:0/2120074476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57f0100ac0 0x7f57f01980c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f57e400d950 tx=0x7f57e400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:35.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.259+0000 7f57edffb700 1 -- 172.21.15.45:0/2120074476 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e4004220 con 0x7f57f0100ac0 2024-05-10T03:38:35.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.259+0000 7f57edffb700 1 -- 172.21.15.45:0/2120074476 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f57e4004380 con 0x7f57f0100ac0 2024-05-10T03:38:35.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.260+0000 7f57f6cb6700 1 -- 172.21.15.45:0/2120074476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f01a0160 con 0x7f57f0100ac0 2024-05-10T03:38:35.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.260+0000 7f57edffb700 1 -- 172.21.15.45:0/2120074476 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e4003cb0 con 0x7f57f0100ac0 2024-05-10T03:38:35.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.260+0000 7f57f6cb6700 1 -- 172.21.15.45:0/2120074476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f01a0670 con 0x7f57f0100ac0 2024-05-10T03:38:35.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.261+0000 7f57f6cb6700 1 -- 172.21.15.45:0/2120074476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f00694d0 con 0x7f57f0100ac0 2024-05-10T03:38:35.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.262+0000 7f57edffb700 1 -- 172.21.15.45:0/2120074476 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f57e4009730 con 0x7f57f0100ac0 2024-05-10T03:38:35.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.263+0000 7f57edffb700 1 --2- 172.21.15.45:0/2120074476 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f57e00a11c0 0x7f57e00a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:35.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.263+0000 7f57edffb700 1 -- 172.21.15.45:0/2120074476 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f57e40cc8e0 con 0x7f57f0100ac0 2024-05-10T03:38:35.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.263+0000 7f57effff700 1 --2- 172.21.15.45:0/2120074476 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f57e00a11c0 0x7f57e00a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:35.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.263+0000 7f57effff700 1 --2- 172.21.15.45:0/2120074476 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f57e00a11c0 0x7f57e00a36d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f57f0199110 tx=0x7f57dc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:35.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.267+0000 7f57edffb700 1 -- 172.21.15.45:0/2120074476 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f57e40963a0 con 0x7f57f0100ac0 2024-05-10T03:38:35.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:35 smithi106 ceph-mon[46996]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:35.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:35 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1863177698' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-10T03:38:35.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:35 smithi154 ceph-mon[46565]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:35.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:35 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1863177698' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-10T03:38:35.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:35.485+0000 7f57f6cb6700 1 -- 172.21.15.45:0/2120074476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f57f010c410 con 0x7f57f0100ac0 2024-05-10T03:38:35.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:35 smithi045 ceph-mon[42520]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:35.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:35 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1863177698' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-10T03:38:36.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.079+0000 7f57edffb700 1 -- 172.21.15.45:0/2120074476 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v79) v1 ==== 171+0+0 (secure 0 0 0) 0x7f57e40999c0 con 0x7f57f0100ac0 2024-05-10T03:38:36.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.085+0000 7f57f6cb6700 1 -- 172.21.15.45:0/2120074476 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f57e00a11c0 msgr2=0x7f57e00a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:36.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.085+0000 7f57f6cb6700 1 --2- 172.21.15.45:0/2120074476 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f57e00a11c0 0x7f57e00a36d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f57f0199110 tx=0x7f57dc009260 comp rx=0 tx=0).stop 2024-05-10T03:38:36.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.085+0000 7f57f6cb6700 1 -- 172.21.15.45:0/2120074476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57f0100ac0 msgr2=0x7f57f01980c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:36.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.085+0000 7f57f6cb6700 1 --2- 172.21.15.45:0/2120074476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57f0100ac0 0x7f57f01980c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f57e400d950 tx=0x7f57e400dc60 comp rx=0 tx=0).stop 2024-05-10T03:38:36.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.088+0000 7f57f6cb6700 1 -- 172.21.15.45:0/2120074476 shutdown_connections 2024-05-10T03:38:36.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.088+0000 7f57f6cb6700 1 --2- 172.21.15.45:0/2120074476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57f0102580 0x7f57f019f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:36.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.088+0000 7f57f6cb6700 1 --2- 172.21.15.45:0/2120074476 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f57e00a11c0 0x7f57e00a36d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:36.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.088+0000 7f57f6cb6700 1 --2- 172.21.15.45:0/2120074476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57f0100ac0 0x7f57f01980c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:36.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.088+0000 7f57f6cb6700 1 --2- 172.21.15.45:0/2120074476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57f0101be0 0x7f57f0198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:36.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.088+0000 7f57f6cb6700 1 -- 172.21.15.45:0/2120074476 >> 172.21.15.45:0/2120074476 conn(0x7f57f00fc0d0 msgr2=0x7f57f00fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:36.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.089+0000 7f57f6cb6700 1 -- 172.21.15.45:0/2120074476 shutdown_connections 2024-05-10T03:38:36.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.091+0000 7f57f6cb6700 1 -- 172.21.15.45:0/2120074476 wait complete. 2024-05-10T03:38:36.100 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2024-05-10T03:38:36.118 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-10T03:38:36.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.269+0000 7f1b0cb24700 1 -- 172.21.15.45:0/3752357471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b08104d10 msgr2=0x7f1b081071f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:36.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.269+0000 7f1b0cb24700 1 --2- 172.21.15.45:0/3752357471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b08104d10 0x7f1b081071f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1afc009990 tx=0x7f1afc009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:36.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.269+0000 7f1b0cb24700 1 -- 172.21.15.45:0/3752357471 shutdown_connections 2024-05-10T03:38:36.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.269+0000 7f1b0cb24700 1 --2- 172.21.15.45:0/3752357471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b08069090 0x7f1b08104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:36.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.269+0000 7f1b0cb24700 1 --2- 172.21.15.45:0/3752357471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b08107880 0x7f1b08109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:36.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.269+0000 7f1b0cb24700 1 --2- 172.21.15.45:0/3752357471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b08104d10 0x7f1b081071f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:36.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.269+0000 7f1b0cb24700 1 -- 172.21.15.45:0/3752357471 >> 172.21.15.45:0/3752357471 conn(0x7f1b080fc0d0 msgr2=0x7f1b080fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:36.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.269+0000 7f1b0cb24700 1 -- 172.21.15.45:0/3752357471 shutdown_connections 2024-05-10T03:38:36.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.269+0000 7f1b0cb24700 1 -- 172.21.15.45:0/3752357471 wait complete. 2024-05-10T03:38:36.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.271+0000 7f1b0cb24700 1 Processor -- start 2024-05-10T03:38:36.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.271+0000 7f1b0cb24700 1 -- start start 2024-05-10T03:38:36.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.271+0000 7f1b0cb24700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b08069090 0x7f1b08198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:36.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.271+0000 7f1b0cb24700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b08104d10 0x7f1b08198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:36.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.271+0000 7f1b0cb24700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b08107880 0x7f1b0819f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:36.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.271+0000 7f1b0cb24700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0819fb00 con 0x7f1b08107880 2024-05-10T03:38:36.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.271+0000 7f1b0cb24700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0819fc70 con 0x7f1b08069090 2024-05-10T03:38:36.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.271+0000 7f1b0cb24700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0819fe30 con 0x7f1b08104d10 2024-05-10T03:38:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.271+0000 7f1b06d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b08107880 0x7f1b0819f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.271+0000 7f1b06d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b08107880 0x7f1b0819f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58938/0 (socket says 172.21.15.45:58938) 2024-05-10T03:38:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.271+0000 7f1b06d9d700 1 -- 172.21.15.45:0/3289548142 learned_addr learned my addr 172.21.15.45:0/3289548142 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.271+0000 7f1b0659c700 1 --2- 172.21.15.45:0/3289548142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b08069090 0x7f1b08198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.271+0000 7f1b05d9b700 1 --2- 172.21.15.45:0/3289548142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b08104d10 0x7f1b08198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.272+0000 7f1b06d9d700 1 -- 172.21.15.45:0/3289548142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b08104d10 msgr2=0x7f1b08198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.272+0000 7f1b06d9d700 1 --2- 172.21.15.45:0/3289548142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b08104d10 0x7f1b08198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.272+0000 7f1b06d9d700 1 -- 172.21.15.45:0/3289548142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b08069090 msgr2=0x7f1b08198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.272+0000 7f1b06d9d700 1 --2- 172.21.15.45:0/3289548142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b08069090 0x7f1b08198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.272+0000 7f1b06d9d700 1 -- 172.21.15.45:0/3289548142 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1afc0095f0 con 0x7f1b08107880 2024-05-10T03:38:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.272+0000 7f1b05d9b700 1 --2- 172.21.15.45:0/3289548142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b08104d10 0x7f1b08198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:38:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.272+0000 7f1b0659c700 1 --2- 172.21.15.45:0/3289548142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b08069090 0x7f1b08198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:38:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.272+0000 7f1b06d9d700 1 --2- 172.21.15.45:0/3289548142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b08107880 0x7f1b0819f4f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000ef30 tx=0x7f1b0000c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.272+0000 7f1af77fe700 1 -- 172.21.15.45:0/3289548142 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00018070 con 0x7f1b08107880 2024-05-10T03:38:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.272+0000 7f1b0cb24700 1 -- 172.21.15.45:0/3289548142 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b081a00b0 con 0x7f1b08107880 2024-05-10T03:38:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.272+0000 7f1af77fe700 1 -- 172.21.15.45:0/3289548142 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1b0000f040 con 0x7f1b08107880 2024-05-10T03:38:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.272+0000 7f1af77fe700 1 -- 172.21.15.45:0/3289548142 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00004020 con 0x7f1b08107880 2024-05-10T03:38:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.272+0000 7f1b0cb24700 1 -- 172.21.15.45:0/3289548142 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b081a0570 con 0x7f1b08107880 2024-05-10T03:38:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.273+0000 7f1b0cb24700 1 -- 172.21.15.45:0/3289548142 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b080fdc80 con 0x7f1b08107880 2024-05-10T03:38:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.274+0000 7f1af77fe700 1 -- 172.21.15.45:0/3289548142 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1b0000caa0 con 0x7f1b08107880 2024-05-10T03:38:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.275+0000 7f1af77fe700 1 --2- 172.21.15.45:0/3289548142 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1af00a11c0 0x7f1af00a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.275+0000 7f1b0659c700 1 --2- 172.21.15.45:0/3289548142 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1af00a11c0 0x7f1af00a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.275+0000 7f1af77fe700 1 -- 172.21.15.45:0/3289548142 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f1b000cc390 con 0x7f1b08107880 2024-05-10T03:38:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.276+0000 7f1b0659c700 1 --2- 172.21.15.45:0/3289548142 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1af00a11c0 0x7f1af00a36d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1af8005950 tx=0x7f1af80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:36.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.280+0000 7f1af77fe700 1 -- 172.21.15.45:0/3289548142 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1b00095cc0 con 0x7f1b08107880 2024-05-10T03:38:36.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:36 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1863177698' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-10T03:38:36.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:36 smithi106 ceph-mon[46996]: osdmap e78: 12 total, 12 up, 12 in 2024-05-10T03:38:36.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:36 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2120074476' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-05-10T03:38:36.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:36 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2120074476' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-05-10T03:38:36.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:36 smithi106 ceph-mon[46996]: osdmap e79: 12 total, 12 up, 12 in 2024-05-10T03:38:36.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:36 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1863177698' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-10T03:38:36.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:36 smithi154 ceph-mon[46565]: osdmap e78: 12 total, 12 up, 12 in 2024-05-10T03:38:36.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:36 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2120074476' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-05-10T03:38:36.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:36 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2120074476' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-05-10T03:38:36.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:36 smithi154 ceph-mon[46565]: osdmap e79: 12 total, 12 up, 12 in 2024-05-10T03:38:36.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:36 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1863177698' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-10T03:38:36.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:36 smithi045 ceph-mon[42520]: osdmap e78: 12 total, 12 up, 12 in 2024-05-10T03:38:36.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:36 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2120074476' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-05-10T03:38:36.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:36 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2120074476' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-05-10T03:38:36.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:36 smithi045 ceph-mon[42520]: osdmap e79: 12 total, 12 up, 12 in 2024-05-10T03:38:36.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.553+0000 7f1b0cb24700 1 -- 172.21.15.45:0/3289548142 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1b080694d0 con 0x7f1b08107880 2024-05-10T03:38:36.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.565+0000 7f1af77fe700 1 -- 172.21.15.45:0/3289548142 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f1b000992e0 con 0x7f1b08107880 2024-05-10T03:38:36.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.574+0000 7f1b0cb24700 1 -- 172.21.15.45:0/3289548142 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1af00a11c0 msgr2=0x7f1af00a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:36.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.574+0000 7f1b0cb24700 1 --2- 172.21.15.45:0/3289548142 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1af00a11c0 0x7f1af00a36d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1af8005950 tx=0x7f1af80058e0 comp rx=0 tx=0).stop 2024-05-10T03:38:36.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.574+0000 7f1b0cb24700 1 -- 172.21.15.45:0/3289548142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b08107880 msgr2=0x7f1b0819f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:36.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.574+0000 7f1b0cb24700 1 --2- 172.21.15.45:0/3289548142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b08107880 0x7f1b0819f4f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000ef30 tx=0x7f1b0000c450 comp rx=0 tx=0).stop 2024-05-10T03:38:36.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.575+0000 7f1b0cb24700 1 -- 172.21.15.45:0/3289548142 shutdown_connections 2024-05-10T03:38:36.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.575+0000 7f1b0cb24700 1 --2- 172.21.15.45:0/3289548142 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1af00a11c0 0x7f1af00a36d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:36.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.575+0000 7f1b0cb24700 1 --2- 172.21.15.45:0/3289548142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b08107880 0x7f1b0819f4f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:36.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.575+0000 7f1b0cb24700 1 --2- 172.21.15.45:0/3289548142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b08069090 0x7f1b08198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:36.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.575+0000 7f1b0cb24700 1 --2- 172.21.15.45:0/3289548142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b08104d10 0x7f1b08198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:36.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.575+0000 7f1b0cb24700 1 -- 172.21.15.45:0/3289548142 >> 172.21.15.45:0/3289548142 conn(0x7f1b080fc0d0 msgr2=0x7f1b08102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:36.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.581+0000 7f1b0cb24700 1 -- 172.21.15.45:0/3289548142 shutdown_connections 2024-05-10T03:38:36.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.581+0000 7f1b0cb24700 1 -- 172.21.15.45:0/3289548142 wait complete. 2024-05-10T03:38:36.593 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 2 and data pool 3 2024-05-10T03:38:36.604 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-10T03:38:36.604 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-10T03:38:36.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.757+0000 7fe05e6a6700 1 -- 172.21.15.45:0/387020972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe058104d10 msgr2=0x7fe0581071f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:36.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.757+0000 7fe05e6a6700 1 --2- 172.21.15.45:0/387020972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe058104d10 0x7fe0581071f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009990 tx=0x7fe04c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:36.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.757+0000 7fe05e6a6700 1 -- 172.21.15.45:0/387020972 shutdown_connections 2024-05-10T03:38:36.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.757+0000 7fe05e6a6700 1 --2- 172.21.15.45:0/387020972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe058069090 0x7fe058104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:36.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.757+0000 7fe05e6a6700 1 --2- 172.21.15.45:0/387020972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe058107880 0x7fe058109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:36.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.757+0000 7fe05e6a6700 1 --2- 172.21.15.45:0/387020972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe058104d10 0x7fe0581071f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:36.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.757+0000 7fe05e6a6700 1 -- 172.21.15.45:0/387020972 >> 172.21.15.45:0/387020972 conn(0x7fe0580fc0d0 msgr2=0x7fe0580fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:36.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.757+0000 7fe05e6a6700 1 -- 172.21.15.45:0/387020972 shutdown_connections 2024-05-10T03:38:36.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.757+0000 7fe05e6a6700 1 -- 172.21.15.45:0/387020972 wait complete. 2024-05-10T03:38:36.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.758+0000 7fe05e6a6700 1 Processor -- start 2024-05-10T03:38:36.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.758+0000 7fe05e6a6700 1 -- start start 2024-05-10T03:38:36.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.758+0000 7fe05e6a6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe058069090 0x7fe058198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:36.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.758+0000 7fe05e6a6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe058104d10 0x7fe058198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:36.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.758+0000 7fe05e6a6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe058107880 0x7fe05819f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:36.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.758+0000 7fe05e6a6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05819fb20 con 0x7fe058107880 2024-05-10T03:38:36.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.758+0000 7fe05e6a6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05819fc90 con 0x7fe058069090 2024-05-10T03:38:36.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.758+0000 7fe05e6a6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05819fe50 con 0x7fe058104d10 2024-05-10T03:38:36.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.758+0000 7fe05cc43700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe058107880 0x7fe05819f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:36.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.758+0000 7fe05cc43700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe058107880 0x7fe05819f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58964/0 (socket says 172.21.15.45:58964) 2024-05-10T03:38:36.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.758+0000 7fe05cc43700 1 -- 172.21.15.45:0/3100637904 learned_addr learned my addr 172.21.15.45:0/3100637904 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:36.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.759+0000 7fe057fff700 1 --2- 172.21.15.45:0/3100637904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe058069090 0x7fe058198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:36.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.759+0000 7fe0577fe700 1 --2- 172.21.15.45:0/3100637904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe058104d10 0x7fe058198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:36.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.759+0000 7fe05cc43700 1 -- 172.21.15.45:0/3100637904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe058104d10 msgr2=0x7fe058198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:36.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.759+0000 7fe05cc43700 1 --2- 172.21.15.45:0/3100637904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe058104d10 0x7fe058198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:36.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.759+0000 7fe05cc43700 1 -- 172.21.15.45:0/3100637904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe058069090 msgr2=0x7fe058198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:36.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.759+0000 7fe05cc43700 1 --2- 172.21.15.45:0/3100637904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe058069090 0x7fe058198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:36.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.759+0000 7fe05cc43700 1 -- 172.21.15.45:0/3100637904 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c0095f0 con 0x7fe058107880 2024-05-10T03:38:36.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.759+0000 7fe057fff700 1 --2- 172.21.15.45:0/3100637904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe058069090 0x7fe058198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:38:36.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.759+0000 7fe05cc43700 1 --2- 172.21.15.45:0/3100637904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe058107880 0x7fe05819f510 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe050007ee0 tx=0x7fe05000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:36.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.759+0000 7fe0557fa700 1 -- 172.21.15.45:0/3100637904 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05000ddd0 con 0x7fe058107880 2024-05-10T03:38:36.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.759+0000 7fe0557fa700 1 -- 172.21.15.45:0/3100637904 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe05000f040 con 0x7fe058107880 2024-05-10T03:38:36.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.759+0000 7fe05e6a6700 1 -- 172.21.15.45:0/3100637904 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0581a0130 con 0x7fe058107880 2024-05-10T03:38:36.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.759+0000 7fe0557fa700 1 -- 172.21.15.45:0/3100637904 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe050015400 con 0x7fe058107880 2024-05-10T03:38:36.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.759+0000 7fe05e6a6700 1 -- 172.21.15.45:0/3100637904 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0581a0640 con 0x7fe058107880 2024-05-10T03:38:36.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.760+0000 7fe05e6a6700 1 -- 172.21.15.45:0/3100637904 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0580fdc80 con 0x7fe058107880 2024-05-10T03:38:36.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.762+0000 7fe0557fa700 1 -- 172.21.15.45:0/3100637904 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe050003a00 con 0x7fe058107880 2024-05-10T03:38:36.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.763+0000 7fe0557fa700 1 --2- 172.21.15.45:0/3100637904 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe0400a1240 0x7fe0400a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:36.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.763+0000 7fe057fff700 1 --2- 172.21.15.45:0/3100637904 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe0400a1240 0x7fe0400a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:36.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.763+0000 7fe0557fa700 1 -- 172.21.15.45:0/3100637904 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe0500cc040 con 0x7fe058107880 2024-05-10T03:38:36.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.763+0000 7fe057fff700 1 --2- 172.21.15.45:0/3100637904 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe0400a1240 0x7fe0400a3750 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe048005950 tx=0x7fe0480058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:36.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.768+0000 7fe0557fa700 1 -- 172.21.15.45:0/3100637904 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe050095920 con 0x7fe058107880 2024-05-10T03:38:36.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:36.997+0000 7fe05e6a6700 1 -- 172.21.15.45:0/3100637904 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fe0580694d0 con 0x7fe058107880 2024-05-10T03:38:37.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:37 smithi106 ceph-mon[46996]: pgmap v223: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:37.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:37 smithi106 ceph-mon[46996]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-10T03:38:37.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:37 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3289548142' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-10T03:38:37.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:37 smithi106 ceph-mon[46996]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-10T03:38:37.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:37 smithi106 ceph-mon[46996]: osdmap e80: 12 total, 12 up, 12 in 2024-05-10T03:38:37.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:37 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3289548142' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-10T03:38:37.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:37 smithi106 ceph-mon[46996]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-10T03:38:37.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:37 smithi106 ceph-mon[46996]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-10T03:38:37.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:37 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3100637904' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-05-10T03:38:37.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:37 smithi154 ceph-mon[46565]: pgmap v223: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:37.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:37 smithi154 ceph-mon[46565]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-10T03:38:37.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:37 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3289548142' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-10T03:38:37.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:37 smithi154 ceph-mon[46565]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-10T03:38:37.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:37 smithi154 ceph-mon[46565]: osdmap e80: 12 total, 12 up, 12 in 2024-05-10T03:38:37.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:37 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3289548142' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-10T03:38:37.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:37 smithi154 ceph-mon[46565]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-10T03:38:37.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:37 smithi154 ceph-mon[46565]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-10T03:38:37.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:37 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3100637904' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-05-10T03:38:37.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:37 smithi045 ceph-mon[42520]: pgmap v223: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:38:37.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:37 smithi045 ceph-mon[42520]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-10T03:38:37.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:37 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3289548142' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-10T03:38:37.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:37 smithi045 ceph-mon[42520]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-10T03:38:37.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:37 smithi045 ceph-mon[42520]: osdmap e80: 12 total, 12 up, 12 in 2024-05-10T03:38:37.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:37 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3289548142' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-10T03:38:37.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:37 smithi045 ceph-mon[42520]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-10T03:38:37.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:37 smithi045 ceph-mon[42520]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-10T03:38:37.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:37 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3100637904' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-05-10T03:38:37.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.566+0000 7fe0557fa700 1 -- 172.21.15.45:0/3100637904 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v81) v1 ==== 157+0+0 (secure 0 0 0) 0x7fe0580694d0 con 0x7fe058107880 2024-05-10T03:38:37.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.569+0000 7fe05e6a6700 1 -- 172.21.15.45:0/3100637904 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe0400a1240 msgr2=0x7fe0400a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:37.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.569+0000 7fe05e6a6700 1 --2- 172.21.15.45:0/3100637904 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe0400a1240 0x7fe0400a3750 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe048005950 tx=0x7fe0480058e0 comp rx=0 tx=0).stop 2024-05-10T03:38:37.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.569+0000 7fe05e6a6700 1 -- 172.21.15.45:0/3100637904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe058107880 msgr2=0x7fe05819f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:37.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.569+0000 7fe05e6a6700 1 --2- 172.21.15.45:0/3100637904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe058107880 0x7fe05819f510 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe050007ee0 tx=0x7fe05000d3b0 comp rx=0 tx=0).stop 2024-05-10T03:38:37.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.569+0000 7fe05e6a6700 1 -- 172.21.15.45:0/3100637904 shutdown_connections 2024-05-10T03:38:37.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.569+0000 7fe05e6a6700 1 --2- 172.21.15.45:0/3100637904 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe0400a1240 0x7fe0400a3750 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.569+0000 7fe05e6a6700 1 --2- 172.21.15.45:0/3100637904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe058107880 0x7fe05819f510 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.569+0000 7fe05e6a6700 1 --2- 172.21.15.45:0/3100637904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe058069090 0x7fe058198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.569+0000 7fe05e6a6700 1 --2- 172.21.15.45:0/3100637904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe058104d10 0x7fe058198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.569+0000 7fe05e6a6700 1 -- 172.21.15.45:0/3100637904 >> 172.21.15.45:0/3100637904 conn(0x7fe0580fc0d0 msgr2=0x7fe058103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.570+0000 7fe05e6a6700 1 -- 172.21.15.45:0/3100637904 shutdown_connections 2024-05-10T03:38:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.570+0000 7fe05e6a6700 1 -- 172.21.15.45:0/3100637904 wait complete. 2024-05-10T03:38:37.588 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-10T03:38:37.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.747+0000 7f67b79ea700 1 -- 172.21.15.45:0/4059581720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67b00740f0 msgr2=0x7f67b0104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:37.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.747+0000 7f67b79ea700 1 --2- 172.21.15.45:0/4059581720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67b00740f0 0x7f67b0104770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f67ac009990 tx=0x7f67ac009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:37.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.747+0000 7f67b79ea700 1 -- 172.21.15.45:0/4059581720 shutdown_connections 2024-05-10T03:38:37.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.747+0000 7f67b79ea700 1 --2- 172.21.15.45:0/4059581720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67b01078b0 0x7f67b0109dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:37.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.747+0000 7f67b79ea700 1 --2- 172.21.15.45:0/4059581720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67b00740f0 0x7f67b0104770 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:37.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.747+0000 7f67b79ea700 1 --2- 172.21.15.45:0/4059581720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67b0104d40 0x7f67b0107220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:37.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.747+0000 7f67b79ea700 1 -- 172.21.15.45:0/4059581720 >> 172.21.15.45:0/4059581720 conn(0x7f67b00fc0e0 msgr2=0x7f67b00fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:37.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.748+0000 7f67b79ea700 1 -- 172.21.15.45:0/4059581720 shutdown_connections 2024-05-10T03:38:37.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.748+0000 7f67b79ea700 1 -- 172.21.15.45:0/4059581720 wait complete. 2024-05-10T03:38:37.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.748+0000 7f67b79ea700 1 Processor -- start 2024-05-10T03:38:37.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.749+0000 7f67b79ea700 1 -- start start 2024-05-10T03:38:37.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.749+0000 7f67b79ea700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67b00740f0 0x7f67b0198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:37.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.749+0000 7f67b79ea700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67b0104d40 0x7f67b0198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:37.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.749+0000 7f67b79ea700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67b01078b0 0x7f67b019f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:37.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.749+0000 7f67b79ea700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b019fb10 con 0x7f67b01078b0 2024-05-10T03:38:37.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.749+0000 7f67b79ea700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b019fc80 con 0x7f67b00740f0 2024-05-10T03:38:37.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.749+0000 7f67b79ea700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b019fe40 con 0x7f67b0104d40 2024-05-10T03:38:37.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.749+0000 7f67b5f87700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67b01078b0 0x7f67b019f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:37.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.749+0000 7f67b5f87700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67b01078b0 0x7f67b019f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40496/0 (socket says 172.21.15.45:40496) 2024-05-10T03:38:37.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.749+0000 7f67b5f87700 1 -- 172.21.15.45:0/490549502 learned_addr learned my addr 172.21.15.45:0/490549502 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:37.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.749+0000 7f67b5786700 1 --2- 172.21.15.45:0/490549502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67b00740f0 0x7f67b0198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:37.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.749+0000 7f67b4f85700 1 --2- 172.21.15.45:0/490549502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67b0104d40 0x7f67b0198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:37.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.749+0000 7f67b5f87700 1 -- 172.21.15.45:0/490549502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67b0104d40 msgr2=0x7f67b0198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:37.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.749+0000 7f67b5f87700 1 --2- 172.21.15.45:0/490549502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67b0104d40 0x7f67b0198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:37.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.749+0000 7f67b5f87700 1 -- 172.21.15.45:0/490549502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67b00740f0 msgr2=0x7f67b0198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:37.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.749+0000 7f67b5f87700 1 --2- 172.21.15.45:0/490549502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67b00740f0 0x7f67b0198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:37.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.749+0000 7f67b5f87700 1 -- 172.21.15.45:0/490549502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ac0095f0 con 0x7f67b01078b0 2024-05-10T03:38:37.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.750+0000 7f67b5f87700 1 --2- 172.21.15.45:0/490549502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67b01078b0 0x7f67b019f500 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f67a8007ee0 tx=0x7f67a800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:37.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.750+0000 7f67a27fc700 1 -- 172.21.15.45:0/490549502 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a8017070 con 0x7f67b01078b0 2024-05-10T03:38:37.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.750+0000 7f67a27fc700 1 -- 172.21.15.45:0/490549502 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f67a800f040 con 0x7f67b01078b0 2024-05-10T03:38:37.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.750+0000 7f67b79ea700 1 -- 172.21.15.45:0/490549502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b01a0120 con 0x7f67b01078b0 2024-05-10T03:38:37.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.750+0000 7f67a27fc700 1 -- 172.21.15.45:0/490549502 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a8005760 con 0x7f67b01078b0 2024-05-10T03:38:37.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.750+0000 7f67b79ea700 1 -- 172.21.15.45:0/490549502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b01a05e0 con 0x7f67b01078b0 2024-05-10T03:38:37.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.751+0000 7f67b79ea700 1 -- 172.21.15.45:0/490549502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b00fdc90 con 0x7f67b01078b0 2024-05-10T03:38:37.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.752+0000 7f67a27fc700 1 -- 172.21.15.45:0/490549502 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f67a80058c0 con 0x7f67b01078b0 2024-05-10T03:38:37.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.753+0000 7f67a27fc700 1 --2- 172.21.15.45:0/490549502 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f679c0a1120 0x7f679c0a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:37.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.753+0000 7f67a27fc700 1 -- 172.21.15.45:0/490549502 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8205+0+0 (secure 0 0 0) 0x7f67a80cc680 con 0x7f67b01078b0 2024-05-10T03:38:37.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.753+0000 7f67b5786700 1 --2- 172.21.15.45:0/490549502 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f679c0a1120 0x7f679c0a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:37.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.754+0000 7f67b5786700 1 --2- 172.21.15.45:0/490549502 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f679c0a1120 0x7f679c0a3630 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f67ac006010 tx=0x7f67ac01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:37.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.757+0000 7f67a27fc700 1 -- 172.21.15.45:0/490549502 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f67a8095dd0 con 0x7f67b01078b0 2024-05-10T03:38:37.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:37.973+0000 7f67b79ea700 1 -- 172.21.15.45:0/490549502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f67b010d5c0 con 0x7f67b01078b0 2024-05-10T03:38:38.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:38 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] up:active 2024-05-10T03:38:38.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:38 smithi106 ceph-mon[46996]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-10T03:38:38.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:38 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3100637904' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-05-10T03:38:38.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:38 smithi106 ceph-mon[46996]: osdmap e81: 12 total, 12 up, 12 in 2024-05-10T03:38:38.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:38 smithi106 ceph-mon[46996]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-10T03:38:38.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:38 smithi106 ceph-mon[46996]: pgmap v227: 97 pgs: 12 creating+peering, 61 unknown, 24 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-05-10T03:38:38.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:38 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/490549502' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-10T03:38:38.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:38 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] up:active 2024-05-10T03:38:38.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:38 smithi154 ceph-mon[46565]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-10T03:38:38.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:38 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3100637904' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-05-10T03:38:38.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:38 smithi154 ceph-mon[46565]: osdmap e81: 12 total, 12 up, 12 in 2024-05-10T03:38:38.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:38 smithi154 ceph-mon[46565]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-10T03:38:38.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:38 smithi154 ceph-mon[46565]: pgmap v227: 97 pgs: 12 creating+peering, 61 unknown, 24 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-05-10T03:38:38.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:38 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/490549502' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-10T03:38:39.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:38 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] up:active 2024-05-10T03:38:39.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:38 smithi045 ceph-mon[42520]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-10T03:38:39.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:38 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3100637904' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-05-10T03:38:39.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:38 smithi045 ceph-mon[42520]: osdmap e81: 12 total, 12 up, 12 in 2024-05-10T03:38:39.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:38 smithi045 ceph-mon[42520]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-10T03:38:39.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:38 smithi045 ceph-mon[42520]: pgmap v227: 97 pgs: 12 creating+peering, 61 unknown, 24 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-05-10T03:38:39.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:38 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/490549502' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-10T03:38:39.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.578+0000 7f67a27fc700 1 -- 172.21.15.45:0/490549502 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v83) v1 ==== 228+0+0 (secure 0 0 0) 0x7f67a8009390 con 0x7f67b01078b0 2024-05-10T03:38:39.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.586+0000 7f67b79ea700 1 -- 172.21.15.45:0/490549502 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f679c0a1120 msgr2=0x7f679c0a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:39.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.586+0000 7f67b79ea700 1 --2- 172.21.15.45:0/490549502 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f679c0a1120 0x7f679c0a3630 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f67ac006010 tx=0x7f67ac01a040 comp rx=0 tx=0).stop 2024-05-10T03:38:39.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.586+0000 7f67b79ea700 1 -- 172.21.15.45:0/490549502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67b01078b0 msgr2=0x7f67b019f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:39.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.586+0000 7f67b79ea700 1 --2- 172.21.15.45:0/490549502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67b01078b0 0x7f67b019f500 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f67a8007ee0 tx=0x7f67a800d3b0 comp rx=0 tx=0).stop 2024-05-10T03:38:39.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.586+0000 7f67b79ea700 1 -- 172.21.15.45:0/490549502 shutdown_connections 2024-05-10T03:38:39.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.586+0000 7f67b79ea700 1 --2- 172.21.15.45:0/490549502 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f679c0a1120 0x7f679c0a3630 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:39.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.586+0000 7f67b79ea700 1 --2- 172.21.15.45:0/490549502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67b01078b0 0x7f67b019f500 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:39.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.586+0000 7f67b79ea700 1 --2- 172.21.15.45:0/490549502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67b00740f0 0x7f67b0198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:39.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.586+0000 7f67b79ea700 1 --2- 172.21.15.45:0/490549502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67b0104d40 0x7f67b0198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:39.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.587+0000 7f67b79ea700 1 -- 172.21.15.45:0/490549502 >> 172.21.15.45:0/490549502 conn(0x7f67b00fc0e0 msgr2=0x7f67b0102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:39.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.587+0000 7f67b79ea700 1 -- 172.21.15.45:0/490549502 shutdown_connections 2024-05-10T03:38:39.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.587+0000 7f67b79ea700 1 -- 172.21.15.45:0/490549502 wait complete. 2024-05-10T03:38:39.592 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data_ec' created 2024-05-10T03:38:39.607 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-10T03:38:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.760+0000 7f5fb6924700 1 -- 172.21.15.45:0/3119011700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb0102580 msgr2=0x7f5fb0108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.760+0000 7f5fb6924700 1 --2- 172.21.15.45:0/3119011700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb0102580 0x7f5fb0108e30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800b0a0 tx=0x7f5fa800b3b0 comp rx=0 tx=0).stop 2024-05-10T03:38:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.760+0000 7f5fb6924700 1 -- 172.21.15.45:0/3119011700 shutdown_connections 2024-05-10T03:38:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.760+0000 7f5fb6924700 1 --2- 172.21.15.45:0/3119011700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fb0100ac0 0x7f5fb0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.760+0000 7f5fb6924700 1 --2- 172.21.15.45:0/3119011700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb0102580 0x7f5fb0108e30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.760+0000 7f5fb6924700 1 --2- 172.21.15.45:0/3119011700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fb0101be0 0x7f5fb0101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.760+0000 7f5fb6924700 1 -- 172.21.15.45:0/3119011700 >> 172.21.15.45:0/3119011700 conn(0x7f5fb00fc0d0 msgr2=0x7f5fb00fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:39.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.760+0000 7f5fb6924700 1 -- 172.21.15.45:0/3119011700 shutdown_connections 2024-05-10T03:38:39.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.760+0000 7f5fb6924700 1 -- 172.21.15.45:0/3119011700 wait complete. 2024-05-10T03:38:39.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.761+0000 7f5fb6924700 1 Processor -- start 2024-05-10T03:38:39.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.761+0000 7f5fb6924700 1 -- start start 2024-05-10T03:38:39.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.761+0000 7f5fb6924700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fb0100ac0 0x7f5fb0196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:39.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.761+0000 7f5fb6924700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb0101be0 0x7f5fb01974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:39.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.761+0000 7f5fb6924700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fb0102580 0x7f5fb019e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:39.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.761+0000 7f5fb6924700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb019ea00 con 0x7f5fb0101be0 2024-05-10T03:38:39.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.761+0000 7f5fb6924700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb019eb40 con 0x7f5fb0102580 2024-05-10T03:38:39.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.761+0000 7f5fb6924700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb019ecd0 con 0x7f5fb0100ac0 2024-05-10T03:38:39.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.761+0000 7f5faf7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb0101be0 0x7f5fb01974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:39.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.761+0000 7f5faf7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb0101be0 0x7f5fb01974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40506/0 (socket says 172.21.15.45:40506) 2024-05-10T03:38:39.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.761+0000 7f5faf7fe700 1 -- 172.21.15.45:0/2618514993 learned_addr learned my addr 172.21.15.45:0/2618514993 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:39.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.761+0000 7f5faffff700 1 --2- 172.21.15.45:0/2618514993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fb0100ac0 0x7f5fb0196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:39.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.761+0000 7f5fb4ec1700 1 --2- 172.21.15.45:0/2618514993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fb0102580 0x7f5fb019e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:39.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.762+0000 7f5faf7fe700 1 -- 172.21.15.45:0/2618514993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fb0100ac0 msgr2=0x7f5fb0196f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:39.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.762+0000 7f5faf7fe700 1 --2- 172.21.15.45:0/2618514993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fb0100ac0 0x7f5fb0196f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:39.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.762+0000 7f5faf7fe700 1 -- 172.21.15.45:0/2618514993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fb0102580 msgr2=0x7f5fb019e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:39.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.762+0000 7f5faf7fe700 1 --2- 172.21.15.45:0/2618514993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fb0102580 0x7f5fb019e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:39.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.762+0000 7f5faf7fe700 1 -- 172.21.15.45:0/2618514993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa8009d00 con 0x7f5fb0101be0 2024-05-10T03:38:39.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.762+0000 7f5fb4ec1700 1 --2- 172.21.15.45:0/2618514993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fb0102580 0x7f5fb019e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:38:39.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.762+0000 7f5faf7fe700 1 --2- 172.21.15.45:0/2618514993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb0101be0 0x7f5fb01974a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400c9e0 tx=0x7f5fa400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:39.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.762+0000 7f5fad7fa700 1 -- 172.21.15.45:0/2618514993 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4007ac0 con 0x7f5fb0101be0 2024-05-10T03:38:39.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.762+0000 7f5fad7fa700 1 -- 172.21.15.45:0/2618514993 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5fa4007c20 con 0x7f5fb0101be0 2024-05-10T03:38:39.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.762+0000 7f5fb6924700 1 -- 172.21.15.45:0/2618514993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb019efb0 con 0x7f5fb0101be0 2024-05-10T03:38:39.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.762+0000 7f5fad7fa700 1 -- 172.21.15.45:0/2618514993 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4018640 con 0x7f5fb0101be0 2024-05-10T03:38:39.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.762+0000 7f5fb6924700 1 -- 172.21.15.45:0/2618514993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb019f3e0 con 0x7f5fb0101be0 2024-05-10T03:38:39.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.763+0000 7f5fb6924700 1 -- 172.21.15.45:0/2618514993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb0107cd0 con 0x7f5fb0101be0 2024-05-10T03:38:39.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.765+0000 7f5fad7fa700 1 -- 172.21.15.45:0/2618514993 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5fa400f450 con 0x7f5fb0101be0 2024-05-10T03:38:39.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.765+0000 7f5fad7fa700 1 --2- 172.21.15.45:0/2618514993 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f5f980a11c0 0x7f5f980a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:39.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.766+0000 7f5faffff700 1 --2- 172.21.15.45:0/2618514993 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f5f980a11c0 0x7f5f980a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:39.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.766+0000 7f5fad7fa700 1 -- 172.21.15.45:0/2618514993 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8698+0+0 (secure 0 0 0) 0x7f5fa40ccd10 con 0x7f5fb0101be0 2024-05-10T03:38:39.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.766+0000 7f5faffff700 1 --2- 172.21.15.45:0/2618514993 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f5f980a11c0 0x7f5f980a36d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0101ae0 tx=0x7f5fa000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:39.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.770+0000 7f5fad7fa700 1 -- 172.21.15.45:0/2618514993 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5fa4096360 con 0x7f5fb0101be0 2024-05-10T03:38:39.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:39 smithi106 ceph-mon[46996]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-10T03:38:39.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:39 smithi106 ceph-mon[46996]: Cluster is now healthy 2024-05-10T03:38:39.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:39 smithi106 ceph-mon[46996]: osdmap e82: 12 total, 12 up, 12 in 2024-05-10T03:38:39.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:39 smithi154 ceph-mon[46565]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-10T03:38:39.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:39 smithi154 ceph-mon[46565]: Cluster is now healthy 2024-05-10T03:38:39.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:39 smithi154 ceph-mon[46565]: osdmap e82: 12 total, 12 up, 12 in 2024-05-10T03:38:39.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:39.989+0000 7f5fb6924700 1 -- 172.21.15.45:0/2618514993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f5fb00694d0 con 0x7f5fb0101be0 2024-05-10T03:38:40.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:39 smithi045 ceph-mon[42520]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-10T03:38:40.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:39 smithi045 ceph-mon[42520]: Cluster is now healthy 2024-05-10T03:38:40.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:39 smithi045 ceph-mon[42520]: osdmap e82: 12 total, 12 up, 12 in 2024-05-10T03:38:40.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.597+0000 7f5fad7fa700 1 -- 172.21.15.45:0/2618514993 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v84) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5fa4099980 con 0x7f5fb0101be0 2024-05-10T03:38:40.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.608+0000 7f5fb6924700 1 -- 172.21.15.45:0/2618514993 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f5f980a11c0 msgr2=0x7f5f980a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.608+0000 7f5fb6924700 1 --2- 172.21.15.45:0/2618514993 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f5f980a11c0 0x7f5f980a36d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0101ae0 tx=0x7f5fa000b410 comp rx=0 tx=0).stop 2024-05-10T03:38:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.608+0000 7f5fb6924700 1 -- 172.21.15.45:0/2618514993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb0101be0 msgr2=0x7f5fb01974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.608+0000 7f5fb6924700 1 --2- 172.21.15.45:0/2618514993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb0101be0 0x7f5fb01974a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400c9e0 tx=0x7f5fa400ccf0 comp rx=0 tx=0).stop 2024-05-10T03:38:40.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.612+0000 7f5fb6924700 1 -- 172.21.15.45:0/2618514993 shutdown_connections 2024-05-10T03:38:40.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.612+0000 7f5fb6924700 1 --2- 172.21.15.45:0/2618514993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fb0100ac0 0x7f5fb0196f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:40.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.612+0000 7f5fb6924700 1 --2- 172.21.15.45:0/2618514993 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f5f980a11c0 0x7f5f980a36d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:40.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.612+0000 7f5fb6924700 1 --2- 172.21.15.45:0/2618514993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fb0102580 0x7f5fb019e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:40.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.612+0000 7f5fb6924700 1 --2- 172.21.15.45:0/2618514993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb0101be0 0x7f5fb01974a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:40.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.612+0000 7f5fb6924700 1 -- 172.21.15.45:0/2618514993 >> 172.21.15.45:0/2618514993 conn(0x7f5fb00fc0d0 msgr2=0x7f5fb0104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:40.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.612+0000 7f5fb6924700 1 -- 172.21.15.45:0/2618514993 shutdown_connections 2024-05-10T03:38:40.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.612+0000 7f5fb6924700 1 -- 172.21.15.45:0/2618514993 wait complete. 2024-05-10T03:38:40.616 INFO:teuthology.orchestra.run.smithi045.stderr:set pool 4 allow_ec_overwrites to true 2024-05-10T03:38:40.631 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-10T03:38:40.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.784+0000 7feb06f54700 1 -- 172.21.15.45:0/4039778360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb00102580 msgr2=0x7feb00108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:40.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.784+0000 7feb06f54700 1 --2- 172.21.15.45:0/4039778360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb00102580 0x7feb00108e30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feaf800b0a0 tx=0x7feaf800b3b0 comp rx=0 tx=0).stop 2024-05-10T03:38:40.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.784+0000 7feb06f54700 1 -- 172.21.15.45:0/4039778360 shutdown_connections 2024-05-10T03:38:40.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.784+0000 7feb06f54700 1 --2- 172.21.15.45:0/4039778360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb00100ac0 0x7feb00100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:40.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.784+0000 7feb06f54700 1 --2- 172.21.15.45:0/4039778360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb00102580 0x7feb00108e30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:40.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.784+0000 7feb06f54700 1 --2- 172.21.15.45:0/4039778360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb00101be0 0x7feb00101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:40.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.784+0000 7feb06f54700 1 -- 172.21.15.45:0/4039778360 >> 172.21.15.45:0/4039778360 conn(0x7feb000fc0d0 msgr2=0x7feb000fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:40.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.784+0000 7feb06f54700 1 -- 172.21.15.45:0/4039778360 shutdown_connections 2024-05-10T03:38:40.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.784+0000 7feb06f54700 1 -- 172.21.15.45:0/4039778360 wait complete. 2024-05-10T03:38:40.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.785+0000 7feb06f54700 1 Processor -- start 2024-05-10T03:38:40.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.785+0000 7feb06f54700 1 -- start start 2024-05-10T03:38:40.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.785+0000 7feb06f54700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb00100ac0 0x7feb00068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:40.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.785+0000 7feb06f54700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb00101be0 0x7feb0019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:40.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.785+0000 7feb06f54700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb00102580 0x7feb0019f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:40.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.785+0000 7feb06f54700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0019fb80 con 0x7feb00100ac0 2024-05-10T03:38:40.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.785+0000 7feb06f54700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0019fcf0 con 0x7feb00102580 2024-05-10T03:38:40.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.785+0000 7feb06f54700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0019feb0 con 0x7feb00101be0 2024-05-10T03:38:40.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.785+0000 7feb04cf0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb00100ac0 0x7feb00068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:40.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.786+0000 7feb04cf0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb00100ac0 0x7feb00068e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40526/0 (socket says 172.21.15.45:40526) 2024-05-10T03:38:40.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.786+0000 7feb04cf0700 1 -- 172.21.15.45:0/557229816 learned_addr learned my addr 172.21.15.45:0/557229816 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:40.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.786+0000 7feb054f1700 1 --2- 172.21.15.45:0/557229816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb00102580 0x7feb0019f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:40.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.786+0000 7feafffff700 1 --2- 172.21.15.45:0/557229816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb00101be0 0x7feb0019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:40.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.786+0000 7feb04cf0700 1 -- 172.21.15.45:0/557229816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb00101be0 msgr2=0x7feb0019ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:40.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.786+0000 7feb04cf0700 1 --2- 172.21.15.45:0/557229816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb00101be0 0x7feb0019ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:40.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.786+0000 7feb04cf0700 1 -- 172.21.15.45:0/557229816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb00102580 msgr2=0x7feb0019f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:40.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.786+0000 7feb04cf0700 1 --2- 172.21.15.45:0/557229816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb00102580 0x7feb0019f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:40.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.786+0000 7feb04cf0700 1 -- 172.21.15.45:0/557229816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf8009d00 con 0x7feb00100ac0 2024-05-10T03:38:40.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.786+0000 7feb04cf0700 1 --2- 172.21.15.45:0/557229816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb00100ac0 0x7feb00068e90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feaf400d950 tx=0x7feaf400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:40.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.786+0000 7feafdffb700 1 -- 172.21.15.45:0/557229816 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf4004220 con 0x7feb00100ac0 2024-05-10T03:38:40.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.786+0000 7feafdffb700 1 -- 172.21.15.45:0/557229816 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7feaf4004380 con 0x7feb00100ac0 2024-05-10T03:38:40.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.786+0000 7feafdffb700 1 -- 172.21.15.45:0/557229816 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf4003c50 con 0x7feb00100ac0 2024-05-10T03:38:40.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.786+0000 7feb06f54700 1 -- 172.21.15.45:0/557229816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb001a0190 con 0x7feb00100ac0 2024-05-10T03:38:40.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.787+0000 7feb06f54700 1 -- 172.21.15.45:0/557229816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb001a06a0 con 0x7feb00100ac0 2024-05-10T03:38:40.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.787+0000 7feb06f54700 1 -- 172.21.15.45:0/557229816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb00107cd0 con 0x7feb00100ac0 2024-05-10T03:38:40.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.789+0000 7feafdffb700 1 -- 172.21.15.45:0/557229816 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7feaf400fc70 con 0x7feb00100ac0 2024-05-10T03:38:40.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.789+0000 7feafdffb700 1 --2- 172.21.15.45:0/557229816 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7feaf00a1240 0x7feaf00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:40.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.790+0000 7feafffff700 1 --2- 172.21.15.45:0/557229816 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7feaf00a1240 0x7feaf00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:40.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.790+0000 7feafdffb700 1 -- 172.21.15.45:0/557229816 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8698+0+0 (secure 0 0 0) 0x7feaf40cc4c0 con 0x7feb00100ac0 2024-05-10T03:38:40.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.790+0000 7feafffff700 1 --2- 172.21.15.45:0/557229816 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7feaf00a1240 0x7feaf00a3750 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7feb00068830 tx=0x7feaec009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:40.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:40.794+0000 7feafdffb700 1 -- 172.21.15.45:0/557229816 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7feaf4095a80 con 0x7feb00100ac0 2024-05-10T03:38:40.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:40 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/490549502' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-10T03:38:40.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:40 smithi106 ceph-mon[46996]: osdmap e83: 12 total, 12 up, 12 in 2024-05-10T03:38:40.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:40 smithi106 ceph-mon[46996]: pgmap v230: 129 pgs: 12 creating+peering, 42 unknown, 75 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s wr, 10 op/s 2024-05-10T03:38:40.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:40 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2618514993' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-05-10T03:38:40.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:40 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/490549502' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-10T03:38:40.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:40 smithi154 ceph-mon[46565]: osdmap e83: 12 total, 12 up, 12 in 2024-05-10T03:38:40.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:40 smithi154 ceph-mon[46565]: pgmap v230: 129 pgs: 12 creating+peering, 42 unknown, 75 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s wr, 10 op/s 2024-05-10T03:38:40.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:40 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2618514993' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-05-10T03:38:41.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:40 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/490549502' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-10T03:38:41.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:40 smithi045 ceph-mon[42520]: osdmap e83: 12 total, 12 up, 12 in 2024-05-10T03:38:41.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:40 smithi045 ceph-mon[42520]: pgmap v230: 129 pgs: 12 creating+peering, 42 unknown, 75 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s wr, 10 op/s 2024-05-10T03:38:41.035 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:40 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2618514993' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-05-10T03:38:41.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.066+0000 7feb06f54700 1 -- 172.21.15.45:0/557229816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7feb0010c6c0 con 0x7feb00100ac0 2024-05-10T03:38:41.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.073+0000 7feafdffb700 1 -- 172.21.15.45:0/557229816 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) v1 ==== 137+0+0 (secure 0 0 0) 0x7feaf40990a0 con 0x7feb00100ac0 2024-05-10T03:38:41.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.076+0000 7feb06f54700 1 -- 172.21.15.45:0/557229816 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7feaf00a1240 msgr2=0x7feaf00a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:41.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.076+0000 7feb06f54700 1 --2- 172.21.15.45:0/557229816 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7feaf00a1240 0x7feaf00a3750 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7feb00068830 tx=0x7feaec009260 comp rx=0 tx=0).stop 2024-05-10T03:38:41.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.076+0000 7feb06f54700 1 -- 172.21.15.45:0/557229816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb00100ac0 msgr2=0x7feb00068e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:41.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.076+0000 7feb06f54700 1 --2- 172.21.15.45:0/557229816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb00100ac0 0x7feb00068e90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feaf400d950 tx=0x7feaf400dc60 comp rx=0 tx=0).stop 2024-05-10T03:38:41.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.076+0000 7feb06f54700 1 -- 172.21.15.45:0/557229816 shutdown_connections 2024-05-10T03:38:41.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.076+0000 7feb06f54700 1 --2- 172.21.15.45:0/557229816 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7feaf00a1240 0x7feaf00a3750 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:41.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.076+0000 7feb06f54700 1 --2- 172.21.15.45:0/557229816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb00102580 0x7feb0019f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:41.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.076+0000 7feb06f54700 1 --2- 172.21.15.45:0/557229816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb00100ac0 0x7feb00068e90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:41.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.076+0000 7feb06f54700 1 --2- 172.21.15.45:0/557229816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb00101be0 0x7feb0019ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:41.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.076+0000 7feb06f54700 1 -- 172.21.15.45:0/557229816 >> 172.21.15.45:0/557229816 conn(0x7feb000fc0d0 msgr2=0x7feb00104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:41.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.076+0000 7feb06f54700 1 -- 172.21.15.45:0/557229816 shutdown_connections 2024-05-10T03:38:41.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.076+0000 7feb06f54700 1 -- 172.21.15.45:0/557229816 wait complete. 2024-05-10T03:38:41.093 INFO:teuthology.orchestra.run.smithi045.stderr:added data pool 4 to fsmap 2024-05-10T03:38:41.094 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:38:41.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.246+0000 7fda06a3e700 1 -- 172.21.15.45:0/1281539217 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda00107970 msgr2=0x7fda00109d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:41.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.246+0000 7fda06a3e700 1 --2- 172.21.15.45:0/1281539217 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda00107970 0x7fda00109d90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd9f800b0a0 tx=0x7fd9f800b3b0 comp rx=0 tx=0).stop 2024-05-10T03:38:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.246+0000 7fda06a3e700 1 -- 172.21.15.45:0/1281539217 shutdown_connections 2024-05-10T03:38:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.246+0000 7fda06a3e700 1 --2- 172.21.15.45:0/1281539217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda001026b0 0x7fda00104ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.246+0000 7fda06a3e700 1 --2- 172.21.15.45:0/1281539217 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda00107970 0x7fda00109d90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.246+0000 7fda06a3e700 1 --2- 172.21.15.45:0/1281539217 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda00105010 0x7fda00107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.246+0000 7fda06a3e700 1 -- 172.21.15.45:0/1281539217 >> 172.21.15.45:0/1281539217 conn(0x7fda000fc0d0 msgr2=0x7fda000fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.246+0000 7fda06a3e700 1 -- 172.21.15.45:0/1281539217 shutdown_connections 2024-05-10T03:38:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.246+0000 7fda06a3e700 1 -- 172.21.15.45:0/1281539217 wait complete. 2024-05-10T03:38:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.247+0000 7fda06a3e700 1 Processor -- start 2024-05-10T03:38:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.247+0000 7fda06a3e700 1 -- start start 2024-05-10T03:38:41.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.248+0000 7fda06a3e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda001026b0 0x7fda00101f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:41.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.248+0000 7fda06a3e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda00105010 0x7fda001005c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:41.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.248+0000 7fda06a3e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda00107970 0x7fda00100b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:41.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.248+0000 7fda06a3e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda001011e0 con 0x7fda001026b0 2024-05-10T03:38:41.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.248+0000 7fda06a3e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda00101350 con 0x7fda00105010 2024-05-10T03:38:41.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.248+0000 7fda06a3e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda001a22a0 con 0x7fda00107970 2024-05-10T03:38:41.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.248+0000 7fd9fffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda001026b0 0x7fda00101f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:41.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.248+0000 7fd9fffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda001026b0 0x7fda00101f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40546/0 (socket says 172.21.15.45:40546) 2024-05-10T03:38:41.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.248+0000 7fd9fffff700 1 -- 172.21.15.45:0/3077824409 learned_addr learned my addr 172.21.15.45:0/3077824409 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:41.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.248+0000 7fda04fdb700 1 --2- 172.21.15.45:0/3077824409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda00107970 0x7fda00100b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:41.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.248+0000 7fd9ff7fe700 1 --2- 172.21.15.45:0/3077824409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda00105010 0x7fda001005c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.248+0000 7fd9fffff700 1 -- 172.21.15.45:0/3077824409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda00107970 msgr2=0x7fda00100b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.248+0000 7fd9fffff700 1 --2- 172.21.15.45:0/3077824409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda00107970 0x7fda00100b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.248+0000 7fd9fffff700 1 -- 172.21.15.45:0/3077824409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda00105010 msgr2=0x7fda001005c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.248+0000 7fd9fffff700 1 --2- 172.21.15.45:0/3077824409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda00105010 0x7fda001005c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.248+0000 7fd9fffff700 1 -- 172.21.15.45:0/3077824409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f8009d00 con 0x7fda001026b0 2024-05-10T03:38:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.248+0000 7fd9ff7fe700 1 --2- 172.21.15.45:0/3077824409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda00105010 0x7fda001005c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:38:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.248+0000 7fd9fffff700 1 --2- 172.21.15.45:0/3077824409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda001026b0 0x7fda00101f20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd9f000d980 tx=0x7fd9f000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.248+0000 7fd9fd7fa700 1 -- 172.21.15.45:0/3077824409 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0009930 con 0x7fda001026b0 2024-05-10T03:38:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.248+0000 7fd9fd7fa700 1 -- 172.21.15.45:0/3077824409 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd9f0010460 con 0x7fda001026b0 2024-05-10T03:38:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.248+0000 7fda06a3e700 1 -- 172.21.15.45:0/3077824409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda001a2500 con 0x7fda001026b0 2024-05-10T03:38:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.249+0000 7fd9fd7fa700 1 -- 172.21.15.45:0/3077824409 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f000f620 con 0x7fda001026b0 2024-05-10T03:38:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.249+0000 7fda06a3e700 1 -- 172.21.15.45:0/3077824409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda001a2a30 con 0x7fda001026b0 2024-05-10T03:38:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.250+0000 7fda06a3e700 1 -- 172.21.15.45:0/3077824409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda000fdc80 con 0x7fda001026b0 2024-05-10T03:38:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.251+0000 7fd9fd7fa700 1 -- 172.21.15.45:0/3077824409 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd9f0010960 con 0x7fda001026b0 2024-05-10T03:38:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.252+0000 7fd9fd7fa700 1 --2- 172.21.15.45:0/3077824409 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd9e80a11a0 0x7fd9e80a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.252+0000 7fd9ff7fe700 1 --2- 172.21.15.45:0/3077824409 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd9e80a11a0 0x7fd9e80a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.252+0000 7fd9fd7fa700 1 -- 172.21.15.45:0/3077824409 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fd9f00cc560 con 0x7fda001026b0 2024-05-10T03:38:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.252+0000 7fd9ff7fe700 1 --2- 172.21.15.45:0/3077824409 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd9e80a11a0 0x7fd9e80a36b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fda001018c0 tx=0x7fd9f4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.257+0000 7fd9fd7fa700 1 -- 172.21.15.45:0/3077824409 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd9f0095b00 con 0x7fda001026b0 2024-05-10T03:38:41.402 INFO:journalctl@ceph.mds.b.smithi106.stdout:May 10 03:38:41 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-b[84354]: 2024-05-10T03:38:41.059+0000 7fb8b63e2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T03:38:41.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.527+0000 7fda06a3e700 1 -- 172.21.15.45:0/3077824409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda000694d0 con 0x7fda001026b0 2024-05-10T03:38:41.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.528+0000 7fd9fd7fa700 1 -- 172.21.15.45:0/3077824409 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+10816 (secure 0 0 0) 0x7fd9f0099120 con 0x7fda001026b0 2024-05-10T03:38:41.531 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:38:41.531 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/378320264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":378320264},{"type":"v1","addr":"172.21.15.45:6835","nonce":378320264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3032381796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3032381796},{"type":"v1","addr":"172.21.15.45:6837","nonce":3032381796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14625,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/4007419304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":4007419304},{"type":"v1","addr":"172.21.15.45:6839","nonce":4007419304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1355456195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1355456195},{"type":"v1","addr":"172.21.15.45:6841","nonce":1355456195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24491,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/4037121210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":4037121210},{"type":"v1","addr":"172.21.15.154:6835","nonce":4037121210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24521,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/4162885659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4162885659},{"type":"v1","addr":"172.21.15.106:6835","nonce":4162885659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/608167481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":608167481},{"type":"v1","addr":"172.21.15.154:6837","nonce":608167481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24547,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/1506563336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1506563336},{"type":"v1","addr":"172.21.15.154:6839","nonce":1506563336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24548,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3047487403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":3047487403},{"type":"v1","addr":"172.21.15.106:6837","nonce":3047487403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T03:38:36.555290+0000","modified":"2024-05-10T03:38:41.068137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24590},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6839/3533867856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":3533867856},{"type":"v1","addr":"172.21.15.106:6839","nonce":3533867856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-10T03:38:41.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.530+0000 7fda06a3e700 1 -- 172.21.15.45:0/3077824409 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd9e80a11a0 msgr2=0x7fd9e80a36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:41.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.530+0000 7fda06a3e700 1 --2- 172.21.15.45:0/3077824409 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd9e80a11a0 0x7fd9e80a36b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fda001018c0 tx=0x7fd9f4009260 comp rx=0 tx=0).stop 2024-05-10T03:38:41.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.530+0000 7fda06a3e700 1 -- 172.21.15.45:0/3077824409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda001026b0 msgr2=0x7fda00101f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:41.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.530+0000 7fda06a3e700 1 --2- 172.21.15.45:0/3077824409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda001026b0 0x7fda00101f20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd9f000d980 tx=0x7fd9f000dc90 comp rx=0 tx=0).stop 2024-05-10T03:38:41.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.530+0000 7fda06a3e700 1 -- 172.21.15.45:0/3077824409 shutdown_connections 2024-05-10T03:38:41.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.530+0000 7fda06a3e700 1 --2- 172.21.15.45:0/3077824409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda00107970 0x7fda00100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:41.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.530+0000 7fda06a3e700 1 --2- 172.21.15.45:0/3077824409 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd9e80a11a0 0x7fd9e80a36b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:41.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.530+0000 7fda06a3e700 1 --2- 172.21.15.45:0/3077824409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda001026b0 0x7fda00101f20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:41.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.530+0000 7fda06a3e700 1 --2- 172.21.15.45:0/3077824409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda00105010 0x7fda001005c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:41.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.530+0000 7fda06a3e700 1 -- 172.21.15.45:0/3077824409 >> 172.21.15.45:0/3077824409 conn(0x7fda000fc0d0 msgr2=0x7fda001034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:41.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.530+0000 7fda06a3e700 1 -- 172.21.15.45:0/3077824409 shutdown_connections 2024-05-10T03:38:41.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.530+0000 7fda06a3e700 1 -- 172.21.15.45:0/3077824409 wait complete. 2024-05-10T03:38:41.535 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 17 2024-05-10T03:38:41.549 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:38:41.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.703+0000 7f0c1ab56700 1 -- 172.21.15.45:0/527415928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c14100ac0 msgr2=0x7f0c14100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:41.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.703+0000 7f0c1ab56700 1 --2- 172.21.15.45:0/527415928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c14100ac0 0x7f0c14100ed0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0c10009990 tx=0x7f0c10009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:41.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.703+0000 7f0c1ab56700 1 -- 172.21.15.45:0/527415928 shutdown_connections 2024-05-10T03:38:41.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.703+0000 7f0c1ab56700 1 --2- 172.21.15.45:0/527415928 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c14102580 0x7f0c14108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:41.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.703+0000 7f0c1ab56700 1 --2- 172.21.15.45:0/527415928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c14100ac0 0x7f0c14100ed0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:41.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.703+0000 7f0c1ab56700 1 --2- 172.21.15.45:0/527415928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c14101be0 0x7f0c14101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:41.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.703+0000 7f0c1ab56700 1 -- 172.21.15.45:0/527415928 >> 172.21.15.45:0/527415928 conn(0x7f0c140fc0d0 msgr2=0x7f0c140fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:41.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.703+0000 7f0c1ab56700 1 -- 172.21.15.45:0/527415928 shutdown_connections 2024-05-10T03:38:41.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.703+0000 7f0c1ab56700 1 -- 172.21.15.45:0/527415928 wait complete. 2024-05-10T03:38:41.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.704+0000 7f0c1ab56700 1 Processor -- start 2024-05-10T03:38:41.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.704+0000 7f0c1ab56700 1 -- start start 2024-05-10T03:38:41.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.704+0000 7f0c1ab56700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c14100ac0 0x7f0c141980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:41.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.704+0000 7f0c1ab56700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c14101be0 0x7f0c14198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:41.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.704+0000 7f0c1ab56700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c14102580 0x7f0c1419f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:41.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.704+0000 7f0c1ab56700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1419fbc0 con 0x7f0c14102580 2024-05-10T03:38:41.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.704+0000 7f0c1ab56700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1419fd30 con 0x7f0c14100ac0 2024-05-10T03:38:41.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.704+0000 7f0c1ab56700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1419fef0 con 0x7f0c14101be0 2024-05-10T03:38:41.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.704+0000 7f0c190f3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c14102580 0x7f0c1419f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:41.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.704+0000 7f0c190f3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c14102580 0x7f0c1419f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40556/0 (socket says 172.21.15.45:40556) 2024-05-10T03:38:41.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.704+0000 7f0c190f3700 1 -- 172.21.15.45:0/921712514 learned_addr learned my addr 172.21.15.45:0/921712514 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:41.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.704+0000 7f0c188f2700 1 --2- 172.21.15.45:0/921712514 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c14100ac0 0x7f0c141980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:41.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.704+0000 7f0c0bfff700 1 --2- 172.21.15.45:0/921712514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c14101be0 0x7f0c14198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:41.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.704+0000 7f0c190f3700 1 -- 172.21.15.45:0/921712514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c14101be0 msgr2=0x7f0c14198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:41.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.704+0000 7f0c190f3700 1 --2- 172.21.15.45:0/921712514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c14101be0 0x7f0c14198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:41.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.704+0000 7f0c190f3700 1 -- 172.21.15.45:0/921712514 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c14100ac0 msgr2=0x7f0c141980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:41.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.704+0000 7f0c190f3700 1 --2- 172.21.15.45:0/921712514 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c14100ac0 0x7f0c141980e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:41.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.704+0000 7f0c190f3700 1 -- 172.21.15.45:0/921712514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c100095f0 con 0x7f0c14102580 2024-05-10T03:38:41.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.704+0000 7f0c0bfff700 1 --2- 172.21.15.45:0/921712514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c14101be0 0x7f0c14198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:38:41.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.705+0000 7f0c190f3700 1 --2- 172.21.15.45:0/921712514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c14102580 0x7f0c1419f5b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c007ee0 tx=0x7f0c0c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:41.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.705+0000 7f0c09ffb700 1 -- 172.21.15.45:0/921712514 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c00ddd0 con 0x7f0c14102580 2024-05-10T03:38:41.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.705+0000 7f0c09ffb700 1 -- 172.21.15.45:0/921712514 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0c0c00f040 con 0x7f0c14102580 2024-05-10T03:38:41.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.705+0000 7f0c1ab56700 1 -- 172.21.15.45:0/921712514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c141a01d0 con 0x7f0c14102580 2024-05-10T03:38:41.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.705+0000 7f0c09ffb700 1 -- 172.21.15.45:0/921712514 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c015400 con 0x7f0c14102580 2024-05-10T03:38:41.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.705+0000 7f0c1ab56700 1 -- 172.21.15.45:0/921712514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c141a06e0 con 0x7f0c14102580 2024-05-10T03:38:41.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.706+0000 7f0c1ab56700 1 -- 172.21.15.45:0/921712514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c140694d0 con 0x7f0c14102580 2024-05-10T03:38:41.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.707+0000 7f0c09ffb700 1 -- 172.21.15.45:0/921712514 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0c0c003a00 con 0x7f0c14102580 2024-05-10T03:38:41.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.708+0000 7f0c09ffb700 1 --2- 172.21.15.45:0/921712514 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0bfc0a11a0 0x7f0bfc0a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:41.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.708+0000 7f0c188f2700 1 --2- 172.21.15.45:0/921712514 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0bfc0a11a0 0x7f0bfc0a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:41.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.708+0000 7f0c09ffb700 1 -- 172.21.15.45:0/921712514 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f0c0c0cc2c0 con 0x7f0c14102580 2024-05-10T03:38:41.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.709+0000 7f0c188f2700 1 --2- 172.21.15.45:0/921712514 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0bfc0a11a0 0x7f0bfc0a36b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0c10003930 tx=0x7f0c1001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:41.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.713+0000 7f0c09ffb700 1 -- 172.21.15.45:0/921712514 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0c0c095860 con 0x7f0c14102580 2024-05-10T03:38:41.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:41 smithi106 ceph-mon[46996]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-10T03:38:41.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:41 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2618514993' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-05-10T03:38:41.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:41 smithi106 ceph-mon[46996]: osdmap e84: 12 total, 12 up, 12 in 2024-05-10T03:38:41.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:41 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/557229816' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-05-10T03:38:41.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:41 smithi106 ceph-mon[46996]: osdmap e85: 12 total, 12 up, 12 in 2024-05-10T03:38:41.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:41 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/557229816' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-05-10T03:38:41.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:41 smithi106 ceph-mon[46996]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-10T03:38:41.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:41 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3077824409' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:41.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.934+0000 7f0c1ab56700 1 -- 172.21.15.45:0/921712514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c141a09a0 con 0x7f0c14102580 2024-05-10T03:38:41.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.936+0000 7f0c09ffb700 1 -- 172.21.15.45:0/921712514 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+23994 (secure 0 0 0) 0x7f0c0c098e80 con 0x7f0c14102580 2024-05-10T03:38:41.940 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:38:41.940 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":85,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:38:41.067825+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:38:34.871801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:38:35.935386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T03:38:39.029903+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:38:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.938+0000 7f0c1ab56700 1 -- 172.21.15.45:0/921712514 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0bfc0a11a0 msgr2=0x7f0bfc0a36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.938+0000 7f0c1ab56700 1 --2- 172.21.15.45:0/921712514 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0bfc0a11a0 0x7f0bfc0a36b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0c10003930 tx=0x7f0c1001a040 comp rx=0 tx=0).stop 2024-05-10T03:38:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.938+0000 7f0c1ab56700 1 -- 172.21.15.45:0/921712514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c14102580 msgr2=0x7f0c1419f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.938+0000 7f0c1ab56700 1 --2- 172.21.15.45:0/921712514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c14102580 0x7f0c1419f5b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c007ee0 tx=0x7f0c0c00d3b0 comp rx=0 tx=0).stop 2024-05-10T03:38:41.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.939+0000 7f0c1ab56700 1 -- 172.21.15.45:0/921712514 shutdown_connections 2024-05-10T03:38:41.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.939+0000 7f0c1ab56700 1 --2- 172.21.15.45:0/921712514 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0bfc0a11a0 0x7f0bfc0a36b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:41.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.939+0000 7f0c1ab56700 1 --2- 172.21.15.45:0/921712514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c14102580 0x7f0c1419f5b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:41.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.939+0000 7f0c1ab56700 1 --2- 172.21.15.45:0/921712514 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c14100ac0 0x7f0c141980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:41.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.939+0000 7f0c1ab56700 1 --2- 172.21.15.45:0/921712514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c14101be0 0x7f0c14198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:41.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.939+0000 7f0c1ab56700 1 -- 172.21.15.45:0/921712514 >> 172.21.15.45:0/921712514 conn(0x7f0c140fc0d0 msgr2=0x7f0c140fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:41.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.939+0000 7f0c1ab56700 1 -- 172.21.15.45:0/921712514 shutdown_connections 2024-05-10T03:38:41.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:41.939+0000 7f0c1ab56700 1 -- 172.21.15.45:0/921712514 wait complete. 2024-05-10T03:38:41.954 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:41 smithi045 ceph-mon[42520]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-10T03:38:41.954 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:41 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2618514993' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-05-10T03:38:41.955 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:41 smithi045 ceph-mon[42520]: osdmap e84: 12 total, 12 up, 12 in 2024-05-10T03:38:41.955 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:41 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/557229816' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-05-10T03:38:41.955 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:41 smithi045 ceph-mon[42520]: osdmap e85: 12 total, 12 up, 12 in 2024-05-10T03:38:41.955 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:41 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/557229816' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-05-10T03:38:41.955 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:41 smithi045 ceph-mon[42520]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-10T03:38:41.955 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:41 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3077824409' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:41.956 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:38:41.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:41 smithi154 ceph-mon[46565]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-10T03:38:41.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:41 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2618514993' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-05-10T03:38:41.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:41 smithi154 ceph-mon[46565]: osdmap e84: 12 total, 12 up, 12 in 2024-05-10T03:38:41.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:41 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/557229816' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-05-10T03:38:41.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:41 smithi154 ceph-mon[46565]: osdmap e85: 12 total, 12 up, 12 in 2024-05-10T03:38:41.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:41 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/557229816' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-05-10T03:38:41.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:41 smithi154 ceph-mon[46565]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-10T03:38:41.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:41 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3077824409' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:42.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.106+0000 7f7205cfc700 1 -- 172.21.15.45:0/2654251404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7200100ac0 msgr2=0x7f7200100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:42.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.106+0000 7f7205cfc700 1 --2- 172.21.15.45:0/2654251404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7200100ac0 0x7f7200100ed0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f71f0009990 tx=0x7f71f0009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.106+0000 7f7205cfc700 1 -- 172.21.15.45:0/2654251404 shutdown_connections 2024-05-10T03:38:42.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.106+0000 7f7205cfc700 1 --2- 172.21.15.45:0/2654251404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7200102580 0x7f7200108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.106+0000 7f7205cfc700 1 --2- 172.21.15.45:0/2654251404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7200100ac0 0x7f7200100ed0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.106+0000 7f7205cfc700 1 --2- 172.21.15.45:0/2654251404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7200101be0 0x7f7200101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.106+0000 7f7205cfc700 1 -- 172.21.15.45:0/2654251404 >> 172.21.15.45:0/2654251404 conn(0x7f72000fc0d0 msgr2=0x7f72000fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:42.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.106+0000 7f7205cfc700 1 -- 172.21.15.45:0/2654251404 shutdown_connections 2024-05-10T03:38:42.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.106+0000 7f7205cfc700 1 -- 172.21.15.45:0/2654251404 wait complete. 2024-05-10T03:38:42.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.107+0000 7f7205cfc700 1 Processor -- start 2024-05-10T03:38:42.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.107+0000 7f7205cfc700 1 -- start start 2024-05-10T03:38:42.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.107+0000 7f7205cfc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7200100ac0 0x7f7200068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:42.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.107+0000 7f7205cfc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7200101be0 0x7f720019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:42.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.107+0000 7f7205cfc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7200102580 0x7f720019f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:42.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.107+0000 7f7205cfc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720019fa70 con 0x7f7200101be0 2024-05-10T03:38:42.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.107+0000 7f7205cfc700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720019fbe0 con 0x7f7200100ac0 2024-05-10T03:38:42.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.107+0000 7f7205cfc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720019fda0 con 0x7f7200102580 2024-05-10T03:38:42.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.107+0000 7f71f7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7200101be0 0x7f720019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:42.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.107+0000 7f71f7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7200101be0 0x7f720019cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40574/0 (socket says 172.21.15.45:40574) 2024-05-10T03:38:42.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.107+0000 7f71f7fff700 1 -- 172.21.15.45:0/560915711 learned_addr learned my addr 172.21.15.45:0/560915711 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:42.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.107+0000 7f71fffff700 1 --2- 172.21.15.45:0/560915711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7200102580 0x7f720019f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:42.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.107+0000 7f71ff7fe700 1 --2- 172.21.15.45:0/560915711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7200100ac0 0x7f7200068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:42.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.107+0000 7f71f7fff700 1 -- 172.21.15.45:0/560915711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7200102580 msgr2=0x7f720019f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:42.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.107+0000 7f71f7fff700 1 --2- 172.21.15.45:0/560915711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7200102580 0x7f720019f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.107+0000 7f71f7fff700 1 -- 172.21.15.45:0/560915711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7200100ac0 msgr2=0x7f7200068e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:42.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.107+0000 7f71f7fff700 1 --2- 172.21.15.45:0/560915711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7200100ac0 0x7f7200068e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.107+0000 7f71f7fff700 1 -- 172.21.15.45:0/560915711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f00095f0 con 0x7f7200101be0 2024-05-10T03:38:42.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.107+0000 7f71ff7fe700 1 --2- 172.21.15.45:0/560915711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7200100ac0 0x7f7200068e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:38:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.108+0000 7f71f7fff700 1 --2- 172.21.15.45:0/560915711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7200101be0 0x7f720019cd90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f71e800c9b0 tx=0x7f71e800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.108+0000 7f71fd7fa700 1 -- 172.21.15.45:0/560915711 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8007b00 con 0x7f7200101be0 2024-05-10T03:38:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.108+0000 7f71fd7fa700 1 -- 172.21.15.45:0/560915711 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f71e8007c60 con 0x7f7200101be0 2024-05-10T03:38:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.108+0000 7f7205cfc700 1 -- 172.21.15.45:0/560915711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72001a0080 con 0x7f7200101be0 2024-05-10T03:38:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.108+0000 7f71fd7fa700 1 -- 172.21.15.45:0/560915711 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8018660 con 0x7f7200101be0 2024-05-10T03:38:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.108+0000 7f7205cfc700 1 -- 172.21.15.45:0/560915711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72001a05e0 con 0x7f7200101be0 2024-05-10T03:38:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.109+0000 7f7205cfc700 1 -- 172.21.15.45:0/560915711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7200107cd0 con 0x7f7200101be0 2024-05-10T03:38:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.110+0000 7f71fd7fa700 1 -- 172.21.15.45:0/560915711 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f71e800f450 con 0x7f7200101be0 2024-05-10T03:38:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.111+0000 7f71fd7fa700 1 --2- 172.21.15.45:0/560915711 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f71ec0a11a0 0x7f71ec0a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.111+0000 7f71ff7fe700 1 --2- 172.21.15.45:0/560915711 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f71ec0a11a0 0x7f71ec0a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.111+0000 7f71fd7fa700 1 -- 172.21.15.45:0/560915711 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f71e80ccdb0 con 0x7f7200101be0 2024-05-10T03:38:42.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.112+0000 7f71ff7fe700 1 --2- 172.21.15.45:0/560915711 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f71ec0a11a0 0x7f71ec0a36b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f71f0003930 tx=0x7f71f0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:42.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.115+0000 7f71fd7fa700 1 -- 172.21.15.45:0/560915711 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f71e8096400 con 0x7f7200101be0 2024-05-10T03:38:42.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.338+0000 7f7205cfc700 1 -- 172.21.15.45:0/560915711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72000694b0 con 0x7f7200101be0 2024-05-10T03:38:42.342 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.340+0000 7f71fd7fa700 1 -- 172.21.15.45:0/560915711 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+23981 (secure 0 0 0) 0x7f71e8099a20 con 0x7f7200101be0 2024-05-10T03:38:42.343 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:38:42.344 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":86,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:38:42.069624+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:38:34.871801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:38:35.935386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T03:38:39.029903+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:38:42.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.342+0000 7f7205cfc700 1 -- 172.21.15.45:0/560915711 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f71ec0a11a0 msgr2=0x7f71ec0a36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:42.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.342+0000 7f7205cfc700 1 --2- 172.21.15.45:0/560915711 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f71ec0a11a0 0x7f71ec0a36b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f71f0003930 tx=0x7f71f0005fb0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.342+0000 7f7205cfc700 1 -- 172.21.15.45:0/560915711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7200101be0 msgr2=0x7f720019cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:42.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.342+0000 7f7205cfc700 1 --2- 172.21.15.45:0/560915711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7200101be0 0x7f720019cd90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f71e800c9b0 tx=0x7f71e800ccc0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.342+0000 7f7205cfc700 1 -- 172.21.15.45:0/560915711 shutdown_connections 2024-05-10T03:38:42.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.342+0000 7f7205cfc700 1 --2- 172.21.15.45:0/560915711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7200102580 0x7f720019f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.342+0000 7f7205cfc700 1 --2- 172.21.15.45:0/560915711 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f71ec0a11a0 0x7f71ec0a36b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.342+0000 7f7205cfc700 1 --2- 172.21.15.45:0/560915711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7200100ac0 0x7f7200068e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.342+0000 7f7205cfc700 1 --2- 172.21.15.45:0/560915711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7200101be0 0x7f720019cd90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.342+0000 7f7205cfc700 1 -- 172.21.15.45:0/560915711 >> 172.21.15.45:0/560915711 conn(0x7f72000fc0d0 msgr2=0x7f7200104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:42.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.343+0000 7f7205cfc700 1 -- 172.21.15.45:0/560915711 shutdown_connections 2024-05-10T03:38:42.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.343+0000 7f7205cfc700 1 -- 172.21.15.45:0/560915711 wait complete. 2024-05-10T03:38:42.377 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:38:42.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.524+0000 7f3aa7720700 1 -- 172.21.15.45:0/2948611627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3aa0100b70 msgr2=0x7f3aa0100f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:42.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.524+0000 7f3aa7720700 1 --2- 172.21.15.45:0/2948611627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3aa0100b70 0x7f3aa0100f80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c00b0a0 tx=0x7f3a9c00b3b0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.524+0000 7f3aa7720700 1 -- 172.21.15.45:0/2948611627 shutdown_connections 2024-05-10T03:38:42.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.524+0000 7f3aa7720700 1 --2- 172.21.15.45:0/2948611627 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3aa0102630 0x7f3aa0108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.524+0000 7f3aa7720700 1 --2- 172.21.15.45:0/2948611627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3aa0100b70 0x7f3aa0100f80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.524+0000 7f3aa7720700 1 --2- 172.21.15.45:0/2948611627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3aa0101c90 0x7f3aa01020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.524+0000 7f3aa7720700 1 -- 172.21.15.45:0/2948611627 >> 172.21.15.45:0/2948611627 conn(0x7f3aa00fc180 msgr2=0x7f3aa00fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:42.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.525+0000 7f3aa7720700 1 -- 172.21.15.45:0/2948611627 shutdown_connections 2024-05-10T03:38:42.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.525+0000 7f3aa7720700 1 -- 172.21.15.45:0/2948611627 wait complete. 2024-05-10T03:38:42.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.525+0000 7f3aa7720700 1 Processor -- start 2024-05-10T03:38:42.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.525+0000 7f3aa7720700 1 -- start start 2024-05-10T03:38:42.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.526+0000 7f3aa7720700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3aa0100b70 0x7f3aa0198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:42.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.526+0000 7f3aa7720700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3aa0101c90 0x7f3aa0198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:42.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.526+0000 7f3aa7720700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3aa0102630 0x7f3aa019f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:42.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.526+0000 7f3aa7720700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa019fd00 con 0x7f3aa0101c90 2024-05-10T03:38:42.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.526+0000 7f3aa7720700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa019fe70 con 0x7f3aa0100b70 2024-05-10T03:38:42.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.526+0000 7f3aa7720700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa01a0030 con 0x7f3aa0102630 2024-05-10T03:38:42.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.526+0000 7f3aa4cbb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3aa0101c90 0x7f3aa0198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:42.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.526+0000 7f3aa4cbb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3aa0101c90 0x7f3aa0198760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40598/0 (socket says 172.21.15.45:40598) 2024-05-10T03:38:42.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.526+0000 7f3aa4cbb700 1 -- 172.21.15.45:0/2010357135 learned_addr learned my addr 172.21.15.45:0/2010357135 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:42.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.526+0000 7f3aa54bc700 1 --2- 172.21.15.45:0/2010357135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3aa0100b70 0x7f3aa0198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:42.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.526+0000 7f3aa5cbd700 1 --2- 172.21.15.45:0/2010357135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3aa0102630 0x7f3aa019f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:42.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.526+0000 7f3aa4cbb700 1 -- 172.21.15.45:0/2010357135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3aa0102630 msgr2=0x7f3aa019f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:42.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.526+0000 7f3aa4cbb700 1 --2- 172.21.15.45:0/2010357135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3aa0102630 0x7f3aa019f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.526+0000 7f3aa4cbb700 1 -- 172.21.15.45:0/2010357135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3aa0100b70 msgr2=0x7f3aa0198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:42.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.526+0000 7f3aa4cbb700 1 --2- 172.21.15.45:0/2010357135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3aa0100b70 0x7f3aa0198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.526+0000 7f3aa4cbb700 1 -- 172.21.15.45:0/2010357135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9c009d00 con 0x7f3aa0101c90 2024-05-10T03:38:42.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.526+0000 7f3aa4cbb700 1 --2- 172.21.15.45:0/2010357135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3aa0101c90 0x7f3aa0198760 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3a9000e9a0 tx=0x7f3a9000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:42.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.526+0000 7f3a967fc700 1 -- 172.21.15.45:0/2010357135 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a90009790 con 0x7f3aa0101c90 2024-05-10T03:38:42.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.526+0000 7f3a967fc700 1 -- 172.21.15.45:0/2010357135 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3a90010430 con 0x7f3aa0101c90 2024-05-10T03:38:42.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.527+0000 7f3aa7720700 1 -- 172.21.15.45:0/2010357135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa01a0310 con 0x7f3aa0101c90 2024-05-10T03:38:42.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.527+0000 7f3a967fc700 1 -- 172.21.15.45:0/2010357135 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a90018680 con 0x7f3aa0101c90 2024-05-10T03:38:42.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.527+0000 7f3aa7720700 1 -- 172.21.15.45:0/2010357135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa01a0820 con 0x7f3aa0101c90 2024-05-10T03:38:42.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.528+0000 7f3aa7720700 1 -- 172.21.15.45:0/2010357135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa00678b0 con 0x7f3aa0101c90 2024-05-10T03:38:42.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.529+0000 7f3a967fc700 1 -- 172.21.15.45:0/2010357135 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3a90010910 con 0x7f3aa0101c90 2024-05-10T03:38:42.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.530+0000 7f3a967fc700 1 --2- 172.21.15.45:0/2010357135 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3a8c0a1120 0x7f3a8c0a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:42.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.530+0000 7f3aa54bc700 1 --2- 172.21.15.45:0/2010357135 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3a8c0a1120 0x7f3a8c0a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:42.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.530+0000 7f3a967fc700 1 -- 172.21.15.45:0/2010357135 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f3a90014070 con 0x7f3aa0101c90 2024-05-10T03:38:42.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.530+0000 7f3aa54bc700 1 --2- 172.21.15.45:0/2010357135 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3a8c0a1120 0x7f3a8c0a3630 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c000f80 tx=0x7f3a9c0060c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:42.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.533+0000 7f3a967fc700 1 -- 172.21.15.45:0/2010357135 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3a90096700 con 0x7f3aa0101c90 2024-05-10T03:38:42.783 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:42 smithi045 ceph-mon[42520]: pgmap v233: 129 pgs: 2 creating+activating, 1 creating+peering, 16 unknown, 110 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 10 op/s 2024-05-10T03:38:42.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:42 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/921712514' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:42.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:42 smithi045 ceph-mon[42520]: osdmap e86: 12 total, 12 up, 12 in 2024-05-10T03:38:42.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:42 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/560915711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:42.803 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.800+0000 7f3aa7720700 1 -- 172.21.15.45:0/2010357135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3aa010c420 con 0x7f3aa0101c90 2024-05-10T03:38:42.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.801+0000 7f3a967fc700 1 -- 172.21.15.45:0/2010357135 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+10816 (secure 0 0 0) 0x7f3a900105a0 con 0x7f3aa0101c90 2024-05-10T03:38:42.804 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:38:42.804 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/378320264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":378320264},{"type":"v1","addr":"172.21.15.45:6835","nonce":378320264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3032381796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3032381796},{"type":"v1","addr":"172.21.15.45:6837","nonce":3032381796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14625,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/4007419304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":4007419304},{"type":"v1","addr":"172.21.15.45:6839","nonce":4007419304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1355456195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1355456195},{"type":"v1","addr":"172.21.15.45:6841","nonce":1355456195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24491,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/4037121210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":4037121210},{"type":"v1","addr":"172.21.15.154:6835","nonce":4037121210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24521,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/4162885659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4162885659},{"type":"v1","addr":"172.21.15.106:6835","nonce":4162885659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/608167481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":608167481},{"type":"v1","addr":"172.21.15.154:6837","nonce":608167481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24547,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/1506563336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1506563336},{"type":"v1","addr":"172.21.15.154:6839","nonce":1506563336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24548,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3047487403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":3047487403},{"type":"v1","addr":"172.21.15.106:6837","nonce":3047487403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T03:38:36.555290+0000","modified":"2024-05-10T03:38:41.068137+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24590},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6839/3533867856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":3533867856},{"type":"v1","addr":"172.21.15.106:6839","nonce":3533867856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-10T03:38:42.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.804+0000 7f3aa7720700 1 -- 172.21.15.45:0/2010357135 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3a8c0a1120 msgr2=0x7f3a8c0a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:42.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.804+0000 7f3aa7720700 1 --2- 172.21.15.45:0/2010357135 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3a8c0a1120 0x7f3a8c0a3630 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c000f80 tx=0x7f3a9c0060c0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.804+0000 7f3aa7720700 1 -- 172.21.15.45:0/2010357135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3aa0101c90 msgr2=0x7f3aa0198760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:42.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.804+0000 7f3aa7720700 1 --2- 172.21.15.45:0/2010357135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3aa0101c90 0x7f3aa0198760 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3a9000e9a0 tx=0x7f3a9000ecb0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.804+0000 7f3aa7720700 1 -- 172.21.15.45:0/2010357135 shutdown_connections 2024-05-10T03:38:42.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.804+0000 7f3aa7720700 1 --2- 172.21.15.45:0/2010357135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3aa0102630 0x7f3aa019f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.804+0000 7f3aa7720700 1 --2- 172.21.15.45:0/2010357135 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3a8c0a1120 0x7f3a8c0a3630 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.804+0000 7f3aa7720700 1 --2- 172.21.15.45:0/2010357135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3aa0100b70 0x7f3aa0198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.804+0000 7f3aa7720700 1 --2- 172.21.15.45:0/2010357135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3aa0101c90 0x7f3aa0198760 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.804+0000 7f3aa7720700 1 -- 172.21.15.45:0/2010357135 >> 172.21.15.45:0/2010357135 conn(0x7f3aa00fc180 msgr2=0x7f3aa00fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:42.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.804+0000 7f3aa7720700 1 -- 172.21.15.45:0/2010357135 shutdown_connections 2024-05-10T03:38:42.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.804+0000 7f3aa7720700 1 -- 172.21.15.45:0/2010357135 wait complete. 2024-05-10T03:38:42.808 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 17 2024-05-10T03:38:42.821 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:38:42.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:42 smithi106 ceph-mon[46996]: pgmap v233: 129 pgs: 2 creating+activating, 1 creating+peering, 16 unknown, 110 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 10 op/s 2024-05-10T03:38:42.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:42 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/921712514' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:42.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:42 smithi106 ceph-mon[46996]: osdmap e86: 12 total, 12 up, 12 in 2024-05-10T03:38:42.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:42 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/560915711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:42.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.967+0000 7fd029876700 1 -- 172.21.15.45:0/541776091 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd024102580 msgr2=0x7fd024108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:42.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.967+0000 7fd029876700 1 --2- 172.21.15.45:0/541776091 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd024102580 0x7fd024108e30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd01c00b0a0 tx=0x7fd01c00b3b0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.967+0000 7fd029876700 1 -- 172.21.15.45:0/541776091 shutdown_connections 2024-05-10T03:38:42.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.967+0000 7fd029876700 1 --2- 172.21.15.45:0/541776091 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd024102580 0x7fd024108e30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.967+0000 7fd029876700 1 --2- 172.21.15.45:0/541776091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd024100ac0 0x7fd024100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.967+0000 7fd029876700 1 --2- 172.21.15.45:0/541776091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd024101be0 0x7fd024101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.967+0000 7fd029876700 1 -- 172.21.15.45:0/541776091 >> 172.21.15.45:0/541776091 conn(0x7fd0240fc0d0 msgr2=0x7fd0240fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:42.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.967+0000 7fd029876700 1 -- 172.21.15.45:0/541776091 shutdown_connections 2024-05-10T03:38:42.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.967+0000 7fd029876700 1 -- 172.21.15.45:0/541776091 wait complete. 2024-05-10T03:38:42.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.968+0000 7fd029876700 1 Processor -- start 2024-05-10T03:38:42.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.968+0000 7fd029876700 1 -- start start 2024-05-10T03:38:42.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.968+0000 7fd029876700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd024100ac0 0x7fd024197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:42.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.968+0000 7fd029876700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd024101be0 0x7fd0241975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:42.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.968+0000 7fd029876700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd024102580 0x7fd02419e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:42.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.968+0000 7fd029876700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02419eb20 con 0x7fd024101be0 2024-05-10T03:38:42.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.968+0000 7fd029876700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02419ec90 con 0x7fd024100ac0 2024-05-10T03:38:42.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.968+0000 7fd029876700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02419ee50 con 0x7fd024102580 2024-05-10T03:38:42.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.969+0000 7fd0227fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd024101be0 0x7fd0241975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:42.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.969+0000 7fd0227fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd024101be0 0x7fd0241975d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40610/0 (socket says 172.21.15.45:40610) 2024-05-10T03:38:42.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.969+0000 7fd0227fc700 1 -- 172.21.15.45:0/2093262812 learned_addr learned my addr 172.21.15.45:0/2093262812 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:42.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.969+0000 7fd0237fe700 1 --2- 172.21.15.45:0/2093262812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd024102580 0x7fd02419e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:42.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.969+0000 7fd022ffd700 1 --2- 172.21.15.45:0/2093262812 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd024100ac0 0x7fd024197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:42.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.969+0000 7fd0227fc700 1 -- 172.21.15.45:0/2093262812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd024102580 msgr2=0x7fd02419e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:42.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.969+0000 7fd0227fc700 1 --2- 172.21.15.45:0/2093262812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd024102580 0x7fd02419e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.969+0000 7fd0227fc700 1 -- 172.21.15.45:0/2093262812 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd024100ac0 msgr2=0x7fd024197090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:42.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.969+0000 7fd0227fc700 1 --2- 172.21.15.45:0/2093262812 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd024100ac0 0x7fd024197090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:42.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.969+0000 7fd0227fc700 1 -- 172.21.15.45:0/2093262812 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01c009d00 con 0x7fd024101be0 2024-05-10T03:38:42.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.969+0000 7fd022ffd700 1 --2- 172.21.15.45:0/2093262812 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd024100ac0 0x7fd024197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:38:42.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.969+0000 7fd0227fc700 1 --2- 172.21.15.45:0/2093262812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd024101be0 0x7fd0241975d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd01800e9a0 tx=0x7fd01800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:42.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.969+0000 7fd028874700 1 -- 172.21.15.45:0/2093262812 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd018009790 con 0x7fd024101be0 2024-05-10T03:38:42.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.969+0000 7fd028874700 1 -- 172.21.15.45:0/2093262812 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd01800cbd0 con 0x7fd024101be0 2024-05-10T03:38:42.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.969+0000 7fd029876700 1 -- 172.21.15.45:0/2093262812 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd02419f130 con 0x7fd024101be0 2024-05-10T03:38:42.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.969+0000 7fd028874700 1 -- 172.21.15.45:0/2093262812 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd018018680 con 0x7fd024101be0 2024-05-10T03:38:42.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.969+0000 7fd029876700 1 -- 172.21.15.45:0/2093262812 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd024068600 con 0x7fd024101be0 2024-05-10T03:38:42.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.970+0000 7fd029876700 1 -- 172.21.15.45:0/2093262812 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd02410c410 con 0x7fd024101be0 2024-05-10T03:38:42.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:42 smithi154 ceph-mon[46565]: pgmap v233: 129 pgs: 2 creating+activating, 1 creating+peering, 16 unknown, 110 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 10 op/s 2024-05-10T03:38:42.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:42 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/921712514' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:42.976 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:42 smithi154 ceph-mon[46565]: osdmap e86: 12 total, 12 up, 12 in 2024-05-10T03:38:42.976 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:42 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/560915711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:42.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.972+0000 7fd028874700 1 -- 172.21.15.45:0/2093262812 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd0180188a0 con 0x7fd024101be0 2024-05-10T03:38:42.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.972+0000 7fd028874700 1 --2- 172.21.15.45:0/2093262812 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd00c0a1120 0x7fd00c0a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:42.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.973+0000 7fd022ffd700 1 --2- 172.21.15.45:0/2093262812 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd00c0a1120 0x7fd00c0a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:42.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.973+0000 7fd028874700 1 -- 172.21.15.45:0/2093262812 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fd018014070 con 0x7fd024101be0 2024-05-10T03:38:42.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.973+0000 7fd022ffd700 1 --2- 172.21.15.45:0/2093262812 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd00c0a1120 0x7fd00c0a3630 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd024101ae0 tx=0x7fd01400b670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:42.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:42.976+0000 7fd028874700 1 -- 172.21.15.45:0/2093262812 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd018096780 con 0x7fd024101be0 2024-05-10T03:38:43.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.194+0000 7fd029876700 1 -- 172.21.15.45:0/2093262812 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd024068ff0 con 0x7fd024101be0 2024-05-10T03:38:43.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.195+0000 7fd028874700 1 -- 172.21.15.45:0/2093262812 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+23981 (secure 0 0 0) 0x7fd018099da0 con 0x7fd024101be0 2024-05-10T03:38:43.198 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:38:43.199 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":86,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:38:42.069624+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:38:34.871801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:38:35.935386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T03:38:39.029903+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:38:43.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.198+0000 7fd029876700 1 -- 172.21.15.45:0/2093262812 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd00c0a1120 msgr2=0x7fd00c0a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:43.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.198+0000 7fd029876700 1 --2- 172.21.15.45:0/2093262812 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd00c0a1120 0x7fd00c0a3630 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd024101ae0 tx=0x7fd01400b670 comp rx=0 tx=0).stop 2024-05-10T03:38:43.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.198+0000 7fd029876700 1 -- 172.21.15.45:0/2093262812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd024101be0 msgr2=0x7fd0241975d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:43.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.198+0000 7fd029876700 1 --2- 172.21.15.45:0/2093262812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd024101be0 0x7fd0241975d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd01800e9a0 tx=0x7fd01800ecb0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.198+0000 7fd029876700 1 -- 172.21.15.45:0/2093262812 shutdown_connections 2024-05-10T03:38:43.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.198+0000 7fd029876700 1 --2- 172.21.15.45:0/2093262812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd024102580 0x7fd02419e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.198+0000 7fd029876700 1 --2- 172.21.15.45:0/2093262812 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd00c0a1120 0x7fd00c0a3630 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.198+0000 7fd029876700 1 --2- 172.21.15.45:0/2093262812 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd024100ac0 0x7fd024197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.198+0000 7fd029876700 1 --2- 172.21.15.45:0/2093262812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd024101be0 0x7fd0241975d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.198+0000 7fd029876700 1 -- 172.21.15.45:0/2093262812 >> 172.21.15.45:0/2093262812 conn(0x7fd0240fc0d0 msgr2=0x7fd024104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:43.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.198+0000 7fd029876700 1 -- 172.21.15.45:0/2093262812 shutdown_connections 2024-05-10T03:38:43.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.198+0000 7fd029876700 1 -- 172.21.15.45:0/2093262812 wait complete. 2024-05-10T03:38:43.216 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T03:38:36.555290+0000', 'modified': '2024-05-10T03:38:41.068137+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24590}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24590': {'gid': 24590, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.106:6839/3533867856', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6838', 'nonce': 3533867856}, {'type': 'v1', 'addr': '172.21.15.106:6839', 'nonce': 3533867856}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-05-10T03:38:43.216 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T03:38:43.216 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-10T03:38:43.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.363+0000 7ff47f5ec700 1 -- 172.21.15.45:0/1080477990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff478100ac0 msgr2=0x7ff478100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:43.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.363+0000 7ff47f5ec700 1 --2- 172.21.15.45:0/1080477990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff478100ac0 0x7ff478100ed0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff474009990 tx=0x7ff474009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.363+0000 7ff47f5ec700 1 -- 172.21.15.45:0/1080477990 shutdown_connections 2024-05-10T03:38:43.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.364+0000 7ff47f5ec700 1 --2- 172.21.15.45:0/1080477990 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff478102580 0x7ff478108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.364+0000 7ff47f5ec700 1 --2- 172.21.15.45:0/1080477990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff478100ac0 0x7ff478100ed0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.364+0000 7ff47f5ec700 1 --2- 172.21.15.45:0/1080477990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff478101be0 0x7ff478101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.364+0000 7ff47f5ec700 1 -- 172.21.15.45:0/1080477990 >> 172.21.15.45:0/1080477990 conn(0x7ff4780fc0d0 msgr2=0x7ff4780fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:43.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.364+0000 7ff47f5ec700 1 -- 172.21.15.45:0/1080477990 shutdown_connections 2024-05-10T03:38:43.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.364+0000 7ff47f5ec700 1 -- 172.21.15.45:0/1080477990 wait complete. 2024-05-10T03:38:43.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.365+0000 7ff47f5ec700 1 Processor -- start 2024-05-10T03:38:43.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.365+0000 7ff47f5ec700 1 -- start start 2024-05-10T03:38:43.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.365+0000 7ff47f5ec700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff478100ac0 0x7ff478196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:43.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.365+0000 7ff47f5ec700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff478101be0 0x7ff478197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:43.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.365+0000 7ff47f5ec700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff478102580 0x7ff47819e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:43.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.365+0000 7ff47f5ec700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47819e9a0 con 0x7ff478101be0 2024-05-10T03:38:43.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.365+0000 7ff47f5ec700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47819eb10 con 0x7ff478100ac0 2024-05-10T03:38:43.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.365+0000 7ff47f5ec700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47819ecd0 con 0x7ff478102580 2024-05-10T03:38:43.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.365+0000 7ff47cb87700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff478101be0 0x7ff478197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:43.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.365+0000 7ff47cb87700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff478101be0 0x7ff478197400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40630/0 (socket says 172.21.15.45:40630) 2024-05-10T03:38:43.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.365+0000 7ff47cb87700 1 -- 172.21.15.45:0/483097833 learned_addr learned my addr 172.21.15.45:0/483097833 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:43.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.365+0000 7ff47d388700 1 --2- 172.21.15.45:0/483097833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff478100ac0 0x7ff478196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:43.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.365+0000 7ff47db89700 1 --2- 172.21.15.45:0/483097833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff478102580 0x7ff47819e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:43.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.366+0000 7ff47cb87700 1 -- 172.21.15.45:0/483097833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff478102580 msgr2=0x7ff47819e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:43.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.366+0000 7ff47cb87700 1 --2- 172.21.15.45:0/483097833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff478102580 0x7ff47819e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.366+0000 7ff47cb87700 1 -- 172.21.15.45:0/483097833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff478100ac0 msgr2=0x7ff478196ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:43.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.366+0000 7ff47cb87700 1 --2- 172.21.15.45:0/483097833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff478100ac0 0x7ff478196ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.366+0000 7ff47cb87700 1 -- 172.21.15.45:0/483097833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4740095f0 con 0x7ff478101be0 2024-05-10T03:38:43.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.366+0000 7ff47d388700 1 --2- 172.21.15.45:0/483097833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff478100ac0 0x7ff478196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:38:43.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.366+0000 7ff47cb87700 1 --2- 172.21.15.45:0/483097833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff478101be0 0x7ff478197400 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff46800d950 tx=0x7ff46800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:43.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.366+0000 7ff46e7fc700 1 -- 172.21.15.45:0/483097833 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46800f890 con 0x7ff478101be0 2024-05-10T03:38:43.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.366+0000 7ff46e7fc700 1 -- 172.21.15.45:0/483097833 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff468010460 con 0x7ff478101be0 2024-05-10T03:38:43.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.366+0000 7ff47f5ec700 1 -- 172.21.15.45:0/483097833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47819efb0 con 0x7ff478101be0 2024-05-10T03:38:43.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.366+0000 7ff46e7fc700 1 -- 172.21.15.45:0/483097833 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46800e610 con 0x7ff478101be0 2024-05-10T03:38:43.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.366+0000 7ff47f5ec700 1 -- 172.21.15.45:0/483097833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47819f430 con 0x7ff478101be0 2024-05-10T03:38:43.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.368+0000 7ff46e7fc700 1 -- 172.21.15.45:0/483097833 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff468010960 con 0x7ff478101be0 2024-05-10T03:38:43.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.369+0000 7ff46e7fc700 1 --2- 172.21.15.45:0/483097833 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4640a1240 0x7ff4640a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:43.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.369+0000 7ff46e7fc700 1 -- 172.21.15.45:0/483097833 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ff4680cc7f0 con 0x7ff478101be0 2024-05-10T03:38:43.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.369+0000 7ff47d388700 1 --2- 172.21.15.45:0/483097833 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4640a1240 0x7ff4640a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:43.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.370+0000 7ff47d388700 1 --2- 172.21.15.45:0/483097833 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4640a1240 0x7ff4640a3750 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff474006010 tx=0x7ff47401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:43.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.370+0000 7ff48f930b80 1 Processor -- start 2024-05-10T03:38:43.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.370+0000 7ff48f930b80 1 -- start start 2024-05-10T03:38:43.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.371+0000 7ff48f930b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9943e7650 0x55a9943e7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:43.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.371+0000 7ff48f930b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9943e8520 0x55a9943e8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:43.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.371+0000 7ff48f930b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e8e70 0x55a9943ef770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:43.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.371+0000 7ff48f930b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a99430e100 con 0x55a9943e8e70 2024-05-10T03:38:43.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.371+0000 7ff48f930b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a99430bac0 con 0x55a9943e8520 2024-05-10T03:38:43.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.371+0000 7ff48f930b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9943073b0 con 0x55a9943e7650 2024-05-10T03:38:43.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.371+0000 7ff47db89700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e8e70 0x55a9943ef770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:43.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.371+0000 7ff47d388700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9943e7650 0x55a9943e7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:43.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.371+0000 7ff47db89700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e8e70 0x55a9943ef770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40634/0 (socket says 172.21.15.45:40634) 2024-05-10T03:38:43.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.371+0000 7ff47db89700 1 -- 172.21.15.45:0/3978795410 learned_addr learned my addr 172.21.15.45:0/3978795410 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:43.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.371+0000 7ff47cb87700 1 --2- 172.21.15.45:0/3978795410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9943e8520 0x55a9943e8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:43.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.371+0000 7ff47db89700 1 -- 172.21.15.45:0/3978795410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9943e7650 msgr2=0x55a9943e7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:38:43.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.371+0000 7ff47db89700 1 --2- 172.21.15.45:0/3978795410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9943e7650 0x55a9943e7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.371+0000 7ff47db89700 1 -- 172.21.15.45:0/3978795410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9943e8520 msgr2=0x55a9943e8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:38:43.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.371+0000 7ff47db89700 1 --2- 172.21.15.45:0/3978795410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9943e8520 0x55a9943e8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.371+0000 7ff47db89700 1 -- 172.21.15.45:0/3978795410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a994188360 con 0x55a9943e8e70 2024-05-10T03:38:43.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.371+0000 7ff47d388700 1 --2- 172.21.15.45:0/3978795410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9943e7650 0x55a9943e7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:38:43.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.371+0000 7ff47db89700 1 --2- 172.21.15.45:0/3978795410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e8e70 0x55a9943ef770 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff4700115d0 tx=0x7ff470009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78007716ed3f450 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:43.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.372+0000 7ff4637fe700 1 -- 172.21.15.45:0/3978795410 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47000e040 con 0x55a9943e8e70 2024-05-10T03:38:43.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.372+0000 7ff4637fe700 1 -- 172.21.15.45:0/3978795410 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff47000f040 con 0x55a9943e8e70 2024-05-10T03:38:43.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.372+0000 7ff4637fe700 1 -- 172.21.15.45:0/3978795410 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff470004650 con 0x55a9943e8e70 2024-05-10T03:38:43.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.373+0000 7ff48f930b80 1 -- 172.21.15.45:0/3978795410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e8e70 msgr2=0x55a9943ef770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:43.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.373+0000 7ff48f930b80 1 --2- 172.21.15.45:0/3978795410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e8e70 0x55a9943ef770 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff4700115d0 tx=0x7ff470009920 comp rx=0 tx=0).stop 2024-05-10T03:38:43.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.373+0000 7ff48f930b80 1 -- 172.21.15.45:0/3978795410 shutdown_connections 2024-05-10T03:38:43.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.373+0000 7ff48f930b80 1 --2- 172.21.15.45:0/3978795410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9943e7650 0x55a9943e7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.373+0000 7ff48f930b80 1 --2- 172.21.15.45:0/3978795410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e8e70 0x55a9943ef770 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.373+0000 7ff48f930b80 1 --2- 172.21.15.45:0/3978795410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9943e8520 0x55a9943e8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.373+0000 7ff48f930b80 1 -- 172.21.15.45:0/3978795410 >> 172.21.15.45:0/3978795410 conn(0x55a994349a10 msgr2=0x55a9943e1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:43.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.373+0000 7ff48f930b80 1 -- 172.21.15.45:0/3978795410 shutdown_connections 2024-05-10T03:38:43.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.373+0000 7ff48f930b80 1 -- 172.21.15.45:0/3978795410 wait complete. 2024-05-10T03:38:43.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.373+0000 7ff48f930b80 1 -- start start 2024-05-10T03:38:43.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.373+0000 7ff48f930b80 1 Processor -- start 2024-05-10T03:38:43.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.374+0000 7ff48f930b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9943e7650 0x55a9943f1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:43.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.374+0000 7ff48f930b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e8520 0x55a9943f1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:43.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.374+0000 7ff48f930b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9943e8e70 0x55a9943f8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:43.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.374+0000 7ff48f930b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9942a3510 con 0x55a9943e8520 2024-05-10T03:38:43.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.374+0000 7ff48f930b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9942a31b0 con 0x55a9943e8e70 2024-05-10T03:38:43.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.374+0000 7ff48f930b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a99418a650 con 0x55a9943e7650 2024-05-10T03:38:43.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.374+0000 7ff47cb87700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e8520 0x55a9943f1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:43.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.374+0000 7ff48f930b80 10 client.0 _ll_register_callbacks cb 0x55a9942acae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:38:43.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.374+0000 7ff47cb87700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e8520 0x55a9943f1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40644/0 (socket says 172.21.15.45:40644) 2024-05-10T03:38:43.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.374+0000 7ff47cb87700 1 -- 172.21.15.45:0/354584145 learned_addr learned my addr 172.21.15.45:0/354584145 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:43.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.374+0000 7ff47d388700 1 --2- 172.21.15.45:0/354584145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9943e7650 0x55a9943f1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:43.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.374+0000 7ff47cb87700 1 -- 172.21.15.45:0/354584145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9943e7650 msgr2=0x55a9943f1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:38:43.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.374+0000 7ff47cb87700 1 --2- 172.21.15.45:0/354584145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9943e7650 0x55a9943f1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.374+0000 7ff47cb87700 1 -- 172.21.15.45:0/354584145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9943e8e70 msgr2=0x55a9943f8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:38:43.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.374+0000 7ff47db89700 1 --2- 172.21.15.45:0/354584145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9943e8e70 0x55a9943f8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:43.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.374+0000 7ff47cb87700 1 --2- 172.21.15.45:0/354584145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9943e8e70 0x55a9943f8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.374+0000 7ff47cb87700 1 -- 172.21.15.45:0/354584145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4781098c0 con 0x55a9943e8520 2024-05-10T03:38:43.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.374+0000 7ff47db89700 1 --2- 172.21.15.45:0/354584145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9943e8e70 0x55a9943f8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:38:43.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.374+0000 7ff47cb87700 1 --2- 172.21.15.45:0/354584145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e8520 0x55a9943f1bc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff4680ca100 tx=0x7ff46809a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16aef794177ccec server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:43.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.374+0000 7ff460ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:38:43.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.375+0000 7ff460ff9700 1 -- 172.21.15.45:0/354584145 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff468099eb0 con 0x55a9943e8520 2024-05-10T03:38:43.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.375+0000 7ff460ff9700 1 -- 172.21.15.45:0/354584145 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ff468098f40 con 0x55a9943e8520 2024-05-10T03:38:43.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.375+0000 7ff48f930b80 1 -- 172.21.15.45:0/354584145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a994260220 con 0x55a9943e8520 2024-05-10T03:38:43.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.375+0000 7ff460ff9700 1 -- 172.21.15.45:0/354584145 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff468099100 con 0x55a9943e8520 2024-05-10T03:38:43.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.375+0000 7ff48f930b80 10 client.14757 fetch_fsmap learned FSMap version 17 2024-05-10T03:38:43.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.375+0000 7ff48f930b80 1 -- 172.21.15.45:0/354584145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x7ff4700112b0 con 0x55a9943e8520 2024-05-10T03:38:43.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.375+0000 7ff460ff9700 1 -- 172.21.15.45:0/354584145 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55a994260220 con 0x55a9943e8520 2024-05-10T03:38:43.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.375+0000 7ff460ff9700 1 -- 172.21.15.45:0/354584145 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 17) v1 ==== 7482+0+0 (secure 0 0 0) 0x7ff4680a1ad0 con 0x55a9943e8520 2024-05-10T03:38:43.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.375+0000 7ff48f930b80 10 client.14757 fetch_fsmap finished waiting for FSMap version 17 2024-05-10T03:38:43.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.375+0000 7ff48f930b80 10 client.14757 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T03:38:43.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.375+0000 7ff48f930b80 20 client.14757 populate_metadata read hostname 'smithi045' 2024-05-10T03:38:43.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.375+0000 7ff48f930b80 1 --2- 172.21.15.45:0/354584145 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55a9943fc590 0x55a994401890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:43.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.375+0000 7ff48f930b80 4 client.14757 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:38:43.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.375+0000 7ff48f930b80 1 -- 172.21.15.45:0/354584145 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a9943b6730 con 0x55a9943fc590 2024-05-10T03:38:43.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.376+0000 7ff47d388700 1 --2- 172.21.15.45:0/354584145 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55a9943fc590 0x55a994401890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:43.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.376+0000 7ff47d388700 1 --2- 172.21.15.45:0/354584145 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55a9943fc590 0x55a994401890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d97309d6b94d4cb0 server_cookie=3899bf6c89669838 in_seq=0 out_seq=0 2024-05-10T03:38:43.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.376+0000 7ff460ff9700 10 client.14757 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:38:43.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.377+0000 7ff460ff9700 1 -- 172.21.15.45:0/354584145 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a9943b6730 con 0x55a9943fc590 2024-05-10T03:38:43.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.377+0000 7ff460ff9700 10 client.14757 handle_command_reply: tid=0 2024-05-10T03:38:43.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.377+0000 7ff48f930b80 1 client.14757 shutdown 2024-05-10T03:38:43.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.377+0000 7ff48f930b80 1 -- 172.21.15.45:0/354584145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e8520 msgr2=0x55a9943f1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:43.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.377+0000 7ff48f930b80 1 --2- 172.21.15.45:0/354584145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e8520 0x55a9943f1bc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff4680ca100 tx=0x7ff46809a290 comp rx=0 tx=0).stop 2024-05-10T03:38:43.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.377+0000 7ff48f930b80 1 -- 172.21.15.45:0/354584145 shutdown_connections 2024-05-10T03:38:43.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.377+0000 7ff48f930b80 1 --2- 172.21.15.45:0/354584145 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55a9943fc590 0x55a994401890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.377+0000 7ff48f930b80 1 --2- 172.21.15.45:0/354584145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9943e7650 0x55a9943f1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.377+0000 7ff48f930b80 1 --2- 172.21.15.45:0/354584145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9943e8e70 0x55a9943f8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.377+0000 7ff460ff9700 0 client.14757 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:38:43.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.377+0000 7ff48f930b80 1 --2- 172.21.15.45:0/354584145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e8520 0x55a9943f1bc0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.377+0000 7ff48f930b80 1 -- 172.21.15.45:0/354584145 >> 172.21.15.45:0/354584145 conn(0x55a994349a10 msgr2=0x55a9943e1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:43.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.378+0000 7ff48f930b80 1 -- 172.21.15.45:0/354584145 shutdown_connections 2024-05-10T03:38:43.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.378+0000 7ff48f930b80 1 -- 172.21.15.45:0/354584145 wait complete. 2024-05-10T03:38:43.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.378+0000 7ff48f930b80 20 client.14757 trim_cache size 0 max 16384 2024-05-10T03:38:43.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.397+0000 7ff48f930b80 1 Processor -- start 2024-05-10T03:38:43.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.397+0000 7ff48f930b80 1 -- start start 2024-05-10T03:38:43.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.397+0000 7ff48f930b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9943e7650 0x55a9943e8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:43.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.397+0000 7ff48f930b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e8520 0x55a9943f0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:43.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.397+0000 7ff48f930b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9943e8e70 0x55a9943f6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:43.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.397+0000 7ff48f930b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9943b6730 con 0x55a9943e8520 2024-05-10T03:38:43.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.397+0000 7ff48f930b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a994260220 con 0x55a9943e7650 2024-05-10T03:38:43.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.397+0000 7ff48f930b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9942c52b0 con 0x55a9943e8e70 2024-05-10T03:38:43.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.397+0000 7ff47cb87700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e8520 0x55a9943f0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:43.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.397+0000 7ff47cb87700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e8520 0x55a9943f0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40658/0 (socket says 172.21.15.45:40658) 2024-05-10T03:38:43.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.397+0000 7ff47cb87700 1 -- 172.21.15.45:0/751509272 learned_addr learned my addr 172.21.15.45:0/751509272 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:43.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.397+0000 7ff47db89700 1 --2- 172.21.15.45:0/751509272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9943e8e70 0x55a9943f6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:43.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.397+0000 7ff47d388700 1 --2- 172.21.15.45:0/751509272 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9943e7650 0x55a9943e8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:43.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.398+0000 7ff47cb87700 1 -- 172.21.15.45:0/751509272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9943e8e70 msgr2=0x55a9943f6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:38:43.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.398+0000 7ff47cb87700 1 --2- 172.21.15.45:0/751509272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9943e8e70 0x55a9943f6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.398+0000 7ff47cb87700 1 -- 172.21.15.45:0/751509272 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9943e7650 msgr2=0x55a9943e8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:38:43.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.398+0000 7ff47cb87700 1 --2- 172.21.15.45:0/751509272 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9943e7650 0x55a9943e8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.398+0000 7ff47cb87700 1 -- 172.21.15.45:0/751509272 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a994134b10 con 0x55a9943e8520 2024-05-10T03:38:43.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.398+0000 7ff47db89700 1 --2- 172.21.15.45:0/751509272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9943e8e70 0x55a9943f6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:38:43.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.398+0000 7ff47cb87700 1 --2- 172.21.15.45:0/751509272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e8520 0x55a9943f0bf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff468097da0 tx=0x7ff468098000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc4e6f26318ff50a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:43.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.398+0000 7ff463fff700 1 -- 172.21.15.45:0/751509272 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4680a1c40 con 0x55a9943e8520 2024-05-10T03:38:43.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.398+0000 7ff463fff700 1 -- 172.21.15.45:0/751509272 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff468099820 con 0x55a9943e8520 2024-05-10T03:38:43.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.398+0000 7ff463fff700 1 -- 172.21.15.45:0/751509272 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff468099cb0 con 0x55a9943e8520 2024-05-10T03:38:43.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.399+0000 7ff48f930b80 1 -- 172.21.15.45:0/751509272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e8520 msgr2=0x55a9943f0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:43.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.399+0000 7ff48f930b80 1 --2- 172.21.15.45:0/751509272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e8520 0x55a9943f0bf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff468097da0 tx=0x7ff468098000 comp rx=0 tx=0).stop 2024-05-10T03:38:43.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.399+0000 7ff48f930b80 1 -- 172.21.15.45:0/751509272 shutdown_connections 2024-05-10T03:38:43.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.399+0000 7ff48f930b80 1 --2- 172.21.15.45:0/751509272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9943e8e70 0x55a9943f6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.399+0000 7ff48f930b80 1 --2- 172.21.15.45:0/751509272 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9943e7650 0x55a9943e8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.399+0000 7ff48f930b80 1 --2- 172.21.15.45:0/751509272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e8520 0x55a9943f0bf0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.399+0000 7ff48f930b80 1 -- 172.21.15.45:0/751509272 >> 172.21.15.45:0/751509272 conn(0x55a994349a10 msgr2=0x55a9943e1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:43.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.399+0000 7ff48f930b80 1 -- 172.21.15.45:0/751509272 shutdown_connections 2024-05-10T03:38:43.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.399+0000 7ff48f930b80 1 -- 172.21.15.45:0/751509272 wait complete. 2024-05-10T03:38:43.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.399+0000 7ff48f930b80 1 -- start start 2024-05-10T03:38:43.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.399+0000 7ff48f930b80 1 Processor -- start 2024-05-10T03:38:43.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.400+0000 7ff48f930b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e7650 0x55a9943f4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:43.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.400+0000 7ff48f930b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9943e8520 0x55a9943f5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:43.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.400+0000 7ff48f930b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9943e8e70 0x55a9943f6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:43.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.400+0000 7ff48f930b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9943f66c0 con 0x55a9943e7650 2024-05-10T03:38:43.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.400+0000 7ff48f930b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9943f6830 con 0x55a9943e8e70 2024-05-10T03:38:43.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.400+0000 7ff48f930b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9943f69f0 con 0x55a9943e8520 2024-05-10T03:38:43.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.400+0000 7ff48f930b80 10 client.0 _ll_register_callbacks cb 0x55a9942acae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:38:43.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.400+0000 7ff47d388700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e7650 0x55a9943f4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:43.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.400+0000 7ff47d388700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e7650 0x55a9943f4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40674/0 (socket says 172.21.15.45:40674) 2024-05-10T03:38:43.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.400+0000 7ff47d388700 1 -- 172.21.15.45:0/1673417353 learned_addr learned my addr 172.21.15.45:0/1673417353 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:43.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.400+0000 7ff47db89700 1 --2- 172.21.15.45:0/1673417353 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9943e8e70 0x55a9943f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:43.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.400+0000 7ff47cb87700 1 --2- 172.21.15.45:0/1673417353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9943e8520 0x55a9943f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:43.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.400+0000 7ff47d388700 1 -- 172.21.15.45:0/1673417353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9943e8520 msgr2=0x55a9943f5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:38:43.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.400+0000 7ff47d388700 1 --2- 172.21.15.45:0/1673417353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9943e8520 0x55a9943f5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.400+0000 7ff47d388700 1 -- 172.21.15.45:0/1673417353 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9943e8e70 msgr2=0x55a9943f6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:38:43.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.400+0000 7ff47d388700 1 --2- 172.21.15.45:0/1673417353 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9943e8e70 0x55a9943f6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.400+0000 7ff47d388700 1 -- 172.21.15.45:0/1673417353 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4700112b0 con 0x55a9943e7650 2024-05-10T03:38:43.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.400+0000 7ff47d388700 1 --2- 172.21.15.45:0/1673417353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e7650 0x55a9943f4d10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff4781007b0 tx=0x7ff474009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d309db120bf6f22a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.400+0000 7ff460ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:38:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.401+0000 7ff460ff9700 1 -- 172.21.15.45:0/1673417353 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47402d040 con 0x55a9943e7650 2024-05-10T03:38:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.401+0000 7ff460ff9700 1 -- 172.21.15.45:0/1673417353 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ff474033410 con 0x55a9943e7650 2024-05-10T03:38:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.401+0000 7ff48f930b80 1 -- 172.21.15.45:0/1673417353 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff47000f040 con 0x55a9943e7650 2024-05-10T03:38:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.401+0000 7ff460ff9700 1 -- 172.21.15.45:0/1673417353 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff474026ea0 con 0x55a9943e7650 2024-05-10T03:38:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.401+0000 7ff48f930b80 10 client.14763 fetch_fsmap learned FSMap version 17 2024-05-10T03:38:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.401+0000 7ff48f930b80 1 -- 172.21.15.45:0/1673417353 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x55a9942cd510 con 0x55a9943e7650 2024-05-10T03:38:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.401+0000 7ff460ff9700 1 -- 172.21.15.45:0/1673417353 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff47000f040 con 0x55a9943e7650 2024-05-10T03:38:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.401+0000 7ff460ff9700 1 -- 172.21.15.45:0/1673417353 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 17) v1 ==== 7482+0+0 (secure 0 0 0) 0x7ff4740050b0 con 0x55a9943e7650 2024-05-10T03:38:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.401+0000 7ff48f930b80 10 client.14763 fetch_fsmap finished waiting for FSMap version 17 2024-05-10T03:38:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.401+0000 7ff48f930b80 10 client.14763 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T03:38:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.401+0000 7ff48f930b80 20 client.14763 populate_metadata read hostname 'smithi045' 2024-05-10T03:38:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.401+0000 7ff48f930b80 1 --2- 172.21.15.45:0/1673417353 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55a9943fc590 0x55a994453f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.401+0000 7ff48f930b80 4 client.14763 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T03:38:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.401+0000 7ff48f930b80 1 -- 172.21.15.45:0/1673417353 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a9942ffe70 con 0x55a9943fc590 2024-05-10T03:38:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.402+0000 7ff47cb87700 1 --2- 172.21.15.45:0/1673417353 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55a9943fc590 0x55a994453f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.402+0000 7ff460ff9700 10 client.14763 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:38:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.402+0000 7ff47cb87700 1 --2- 172.21.15.45:0/1673417353 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55a9943fc590 0x55a994453f90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=534a1ed88137101d server_cookie=18fbdda19b381076 in_seq=0 out_seq=0 2024-05-10T03:38:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.402+0000 7ff460ff9700 1 -- 172.21.15.45:0/1673417353 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55a9942ffe70 con 0x55a9943fc590 2024-05-10T03:38:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.402+0000 7ff460ff9700 10 client.14763 handle_command_reply: tid=0 2024-05-10T03:38:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.402+0000 7ff48f930b80 1 client.14763 shutdown 2024-05-10T03:38:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.402+0000 7ff48f930b80 1 -- 172.21.15.45:0/1673417353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e7650 msgr2=0x55a9943f4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.402+0000 7ff48f930b80 1 --2- 172.21.15.45:0/1673417353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e7650 0x55a9943f4d10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff4781007b0 tx=0x7ff474009310 comp rx=0 tx=0).stop 2024-05-10T03:38:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.402+0000 7ff48f930b80 1 -- 172.21.15.45:0/1673417353 shutdown_connections 2024-05-10T03:38:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.402+0000 7ff48f930b80 1 --2- 172.21.15.45:0/1673417353 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55a9943fc590 0x55a994453f90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.402+0000 7ff48f930b80 1 --2- 172.21.15.45:0/1673417353 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9943e8e70 0x55a9943f6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.402+0000 7ff460ff9700 0 client.14763 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:38:43.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.402+0000 7ff48f930b80 1 --2- 172.21.15.45:0/1673417353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9943e7650 0x55a9943f4d10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.402+0000 7ff48f930b80 1 --2- 172.21.15.45:0/1673417353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a9943e8520 0x55a9943f5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.402+0000 7ff48f930b80 1 -- 172.21.15.45:0/1673417353 >> 172.21.15.45:0/1673417353 conn(0x55a994349a10 msgr2=0x55a9943ef850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:43.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.403+0000 7ff48f930b80 1 -- 172.21.15.45:0/1673417353 shutdown_connections 2024-05-10T03:38:43.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.403+0000 7ff48f930b80 1 -- 172.21.15.45:0/1673417353 wait complete. 2024-05-10T03:38:43.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.403+0000 7ff48f930b80 20 client.14763 trim_cache size 0 max 16384 2024-05-10T03:38:43.413 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:38:43.414 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "d2a0bafa-0e7d-11ef-bc98-c7b262605968", 2024-05-10T03:38:43.414 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2024-05-10T03:38:43.414 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 24590, 2024-05-10T03:38:43.414 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2024-05-10T03:38:43.414 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2024-05-10T03:38:43.414 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2024-05-10T03:38:43.414 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 6.8444965499999997, 2024-05-10T03:38:43.414 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 17, 2024-05-10T03:38:43.414 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 86, 2024-05-10T03:38:43.414 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 84, 2024-05-10T03:38:43.414 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 12.700723642 2024-05-10T03:38:43.414 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:38:43.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.403+0000 7ff47f5ec700 1 -- 172.21.15.45:0/483097833 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4640a1240 msgr2=0x7ff4640a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:43.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.403+0000 7ff47f5ec700 1 --2- 172.21.15.45:0/483097833 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4640a1240 0x7ff4640a3750 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff474006010 tx=0x7ff47401a040 comp rx=0 tx=0).stop 2024-05-10T03:38:43.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.403+0000 7ff47f5ec700 1 -- 172.21.15.45:0/483097833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff478101be0 msgr2=0x7ff478197400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:43.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.403+0000 7ff47f5ec700 1 --2- 172.21.15.45:0/483097833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff478101be0 0x7ff478197400 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff46800d950 tx=0x7ff46800dc60 comp rx=0 tx=0).stop 2024-05-10T03:38:43.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.403+0000 7ff47f5ec700 1 -- 172.21.15.45:0/483097833 shutdown_connections 2024-05-10T03:38:43.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.403+0000 7ff47f5ec700 1 --2- 172.21.15.45:0/483097833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff478102580 0x7ff47819e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.403+0000 7ff47f5ec700 1 --2- 172.21.15.45:0/483097833 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4640a1240 0x7ff4640a3750 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.403+0000 7ff47f5ec700 1 --2- 172.21.15.45:0/483097833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff478100ac0 0x7ff478196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.403+0000 7ff47f5ec700 1 --2- 172.21.15.45:0/483097833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff478101be0 0x7ff478197400 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:43.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.403+0000 7ff47f5ec700 1 -- 172.21.15.45:0/483097833 >> 172.21.15.45:0/483097833 conn(0x7ff4780fc0d0 msgr2=0x7ff478104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:43.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.403+0000 7ff47f5ec700 1 -- 172.21.15.45:0/483097833 shutdown_connections 2024-05-10T03:38:43.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:43.403+0000 7ff47f5ec700 1 -- 172.21.15.45:0/483097833 wait complete. 2024-05-10T03:38:43.421 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T03:38:43.421 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-10T03:38:43.421 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph fs ls 2024-05-10T03:38:43.666 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:38:43.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:43 smithi106 ceph-mon[46996]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-10T03:38:43.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:43 smithi106 ceph-mon[46996]: Cluster is now healthy 2024-05-10T03:38:43.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:43 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2010357135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:43.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:43 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2093262812' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:43.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:43 smithi154 ceph-mon[46565]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-10T03:38:43.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:43 smithi154 ceph-mon[46565]: Cluster is now healthy 2024-05-10T03:38:43.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:43 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2010357135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:43.975 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:43 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2093262812' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:43.992 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:43 smithi045 ceph-mon[42520]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-10T03:38:43.992 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:43 smithi045 ceph-mon[42520]: Cluster is now healthy 2024-05-10T03:38:43.992 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:43 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2010357135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:38:43.992 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:43 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2093262812' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:44.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.740+0000 7fb8fe1a6700 1 -- 172.21.15.45:0/1320791790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f8100a20 msgr2=0x7fb8f8100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:44.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.740+0000 7fb8fe1a6700 1 --2- 172.21.15.45:0/1320791790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f8100a20 0x7fb8f8100e30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8009990 tx=0x7fb8e8009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:44.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.740+0000 7fb8fe1a6700 1 -- 172.21.15.45:0/1320791790 shutdown_connections 2024-05-10T03:38:44.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.740+0000 7fb8fe1a6700 1 --2- 172.21.15.45:0/1320791790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f810e5d0 0x7fb8f81109f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:44.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.740+0000 7fb8fe1a6700 1 --2- 172.21.15.45:0/1320791790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f8100a20 0x7fb8f8100e30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:44.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.740+0000 7fb8fe1a6700 1 --2- 172.21.15.45:0/1320791790 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8f8101370 0x7fb8f810e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:44.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.740+0000 7fb8fe1a6700 1 -- 172.21.15.45:0/1320791790 >> 172.21.15.45:0/1320791790 conn(0x7fb8f80fc7a0 msgr2=0x7fb8f80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:44.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.740+0000 7fb8fe1a6700 1 -- 172.21.15.45:0/1320791790 shutdown_connections 2024-05-10T03:38:44.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.740+0000 7fb8fe1a6700 1 -- 172.21.15.45:0/1320791790 wait complete. 2024-05-10T03:38:44.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.741+0000 7fb8fe1a6700 1 Processor -- start 2024-05-10T03:38:44.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.741+0000 7fb8fe1a6700 1 -- start start 2024-05-10T03:38:44.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.742+0000 7fb8fe1a6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f8100a20 0x7fb8f81a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:44.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.742+0000 7fb8fe1a6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8f8101370 0x7fb8f81a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:44.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.742+0000 7fb8fe1a6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f810e5d0 0x7fb8f819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:44.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.742+0000 7fb8fe1a6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f819aba0 con 0x7fb8f8100a20 2024-05-10T03:38:44.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.742+0000 7fb8fe1a6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f819ad10 con 0x7fb8f8101370 2024-05-10T03:38:44.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.742+0000 7fb8fe1a6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f819aed0 con 0x7fb8f810e5d0 2024-05-10T03:38:44.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.742+0000 7fb8f77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f8100a20 0x7fb8f81a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:44.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.742+0000 7fb8f77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f8100a20 0x7fb8f81a05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40684/0 (socket says 172.21.15.45:40684) 2024-05-10T03:38:44.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.742+0000 7fb8f77fe700 1 -- 172.21.15.45:0/1029614141 learned_addr learned my addr 172.21.15.45:0/1029614141 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:44.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.742+0000 7fb8f6ffd700 1 --2- 172.21.15.45:0/1029614141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8f8101370 0x7fb8f81a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:44.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.742+0000 7fb8f7fff700 1 --2- 172.21.15.45:0/1029614141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f810e5d0 0x7fb8f819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:44.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.742+0000 7fb8f77fe700 1 -- 172.21.15.45:0/1029614141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f810e5d0 msgr2=0x7fb8f819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:44.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.742+0000 7fb8f77fe700 1 --2- 172.21.15.45:0/1029614141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f810e5d0 0x7fb8f819a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:44.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.742+0000 7fb8f77fe700 1 -- 172.21.15.45:0/1029614141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8f8101370 msgr2=0x7fb8f81a0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:44.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.742+0000 7fb8f77fe700 1 --2- 172.21.15.45:0/1029614141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8f8101370 0x7fb8f81a0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:44.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.742+0000 7fb8f77fe700 1 -- 172.21.15.45:0/1029614141 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e80095f0 con 0x7fb8f8100a20 2024-05-10T03:38:44.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.742+0000 7fb8f77fe700 1 --2- 172.21.15.45:0/1029614141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f8100a20 0x7fb8f81a05e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80098e0 tx=0x7fb8e800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:44.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.743+0000 7fb8f4ff9700 1 -- 172.21.15.45:0/1029614141 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e801d070 con 0x7fb8f8100a20 2024-05-10T03:38:44.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.743+0000 7fb8f4ff9700 1 -- 172.21.15.45:0/1029614141 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb8e8003680 con 0x7fb8f8100a20 2024-05-10T03:38:44.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.743+0000 7fb8fe1a6700 1 -- 172.21.15.45:0/1029614141 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f819b150 con 0x7fb8f8100a20 2024-05-10T03:38:44.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.743+0000 7fb8f4ff9700 1 -- 172.21.15.45:0/1029614141 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e80173f0 con 0x7fb8f8100a20 2024-05-10T03:38:44.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.743+0000 7fb8fe1a6700 1 -- 172.21.15.45:0/1029614141 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f81a7610 con 0x7fb8f8100a20 2024-05-10T03:38:44.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.744+0000 7fb8fe1a6700 1 -- 172.21.15.45:0/1029614141 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f81097f0 con 0x7fb8f8100a20 2024-05-10T03:38:44.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.745+0000 7fb8f4ff9700 1 -- 172.21.15.45:0/1029614141 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb8e80226e0 con 0x7fb8f8100a20 2024-05-10T03:38:44.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.746+0000 7fb8f4ff9700 1 --2- 172.21.15.45:0/1029614141 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb8e00a11a0 0x7fb8e00a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:44.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.746+0000 7fb8f6ffd700 1 --2- 172.21.15.45:0/1029614141 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb8e00a11a0 0x7fb8e00a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:44.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.746+0000 7fb8f4ff9700 1 -- 172.21.15.45:0/1029614141 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fb8e80cdf20 con 0x7fb8f8100a20 2024-05-10T03:38:44.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.747+0000 7fb8f6ffd700 1 --2- 172.21.15.45:0/1029614141 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb8e00a11a0 0x7fb8e00a36b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb8f810fbb0 tx=0x7fb8ec0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:44.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:44.750+0000 7fb8f4ff9700 1 -- 172.21.15.45:0/1029614141 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb8e8097550 con 0x7fb8f8100a20 2024-05-10T03:38:44.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:44 smithi106 ceph-mon[46996]: pgmap v235: 129 pgs: 2 creating+activating, 1 creating+peering, 6 unknown, 120 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 714 B/s wr, 2 op/s 2024-05-10T03:38:44.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:44 smithi154 ceph-mon[46565]: pgmap v235: 129 pgs: 2 creating+activating, 1 creating+peering, 6 unknown, 120 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 714 B/s wr, 2 op/s 2024-05-10T03:38:45.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:45.012+0000 7fb8fe1a6700 1 -- 172.21.15.45:0/1029614141 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb8f819bcc0 con 0x7fb8f8100a20 2024-05-10T03:38:45.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:45.012+0000 7fb8f4ff9700 1 -- 172.21.15.45:0/1029614141 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb8e809ab70 con 0x7fb8f8100a20 2024-05-10T03:38:45.015 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-10T03:38:45.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:45.014+0000 7fb8fe1a6700 1 -- 172.21.15.45:0/1029614141 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb8e00a11a0 msgr2=0x7fb8e00a36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:45.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:45.014+0000 7fb8fe1a6700 1 --2- 172.21.15.45:0/1029614141 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb8e00a11a0 0x7fb8e00a36b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb8f810fbb0 tx=0x7fb8ec0073d0 comp rx=0 tx=0).stop 2024-05-10T03:38:45.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:45.015+0000 7fb8fe1a6700 1 -- 172.21.15.45:0/1029614141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f8100a20 msgr2=0x7fb8f81a05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:45.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:45.015+0000 7fb8fe1a6700 1 --2- 172.21.15.45:0/1029614141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f8100a20 0x7fb8f81a05e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80098e0 tx=0x7fb8e800f690 comp rx=0 tx=0).stop 2024-05-10T03:38:45.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:45.015+0000 7fb8fe1a6700 1 -- 172.21.15.45:0/1029614141 shutdown_connections 2024-05-10T03:38:45.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:45.015+0000 7fb8fe1a6700 1 --2- 172.21.15.45:0/1029614141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f810e5d0 0x7fb8f819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:45.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:45.015+0000 7fb8fe1a6700 1 --2- 172.21.15.45:0/1029614141 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb8e00a11a0 0x7fb8e00a36b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:45.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:45.015+0000 7fb8fe1a6700 1 --2- 172.21.15.45:0/1029614141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8f8100a20 0x7fb8f81a05e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:45.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:45.015+0000 7fb8fe1a6700 1 --2- 172.21.15.45:0/1029614141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8f8101370 0x7fb8f81a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:45.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:45.015+0000 7fb8fe1a6700 1 -- 172.21.15.45:0/1029614141 >> 172.21.15.45:0/1029614141 conn(0x7fb8f80fc7a0 msgr2=0x7fb8f810ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:45.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:45.015+0000 7fb8fe1a6700 1 -- 172.21.15.45:0/1029614141 shutdown_connections 2024-05-10T03:38:45.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:45.015+0000 7fb8fe1a6700 1 -- 172.21.15.45:0/1029614141 wait complete. 2024-05-10T03:38:45.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:44 smithi045 ceph-mon[42520]: pgmap v235: 129 pgs: 2 creating+activating, 1 creating+peering, 6 unknown, 120 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 714 B/s wr, 2 op/s 2024-05-10T03:38:45.419 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T03:38:45.419 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T03:38:45.419 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2024-05-10T03:38:45.419 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-10T03:38:45.419 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-10T03:38:45.419 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T03:38:45.419 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T03:38:45.419 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T03:38:45.419 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-10T03:38:45.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:38:45.420 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2024-05-10T03:38:45.442 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T03:38:45.443 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T03:38:45.443 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T03:38:45.443 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:38:45.443 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2024-05-10T03:38:45.443 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:38:45.443 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T03:38:45.443 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2024-05-10T03:38:45.443 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2024-05-10T03:38:45.443 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T03:38:45.443 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2024-05-10T03:38:45.443 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2024-05-10T03:38:45.443 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T03:38:45.443 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2024-05-10T03:38:45.443 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2024-05-10T03:38:45.444 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-10T03:38:45.444 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 41802sec preferred_lft 41802sec 2024-05-10T03:38:45.444 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2024-05-10T03:38:45.444 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:38:45.444 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T03:38:45.444 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2024-05-10T03:38:45.444 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2024-05-10T03:38:45.444 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-10T03:38:45.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:38:45.445 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2024-05-10T03:38:45.445 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-05-10T03:38:45.445 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add name ceph-brx type bridge 2024-05-10T03:38:45.445 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr flush dev ceph-brx 2024-05-10T03:38:45.445 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set ceph-brx up 2024-05-10T03:38:45.445 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-10T03:38:45.445 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-05-10T03:38:45.619 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:45 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1029614141' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-10T03:38:45.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:38:45.652 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T03:38:45.685 INFO:teuthology.orchestra.run.smithi045.stdout:1 2024-05-10T03:38:45.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:38:45.687 DEBUG:teuthology.orchestra.run.smithi045:> route 2024-05-10T03:38:45.762 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2024-05-10T03:38:45.763 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T03:38:45.763 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-10T03:38:45.763 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-10T03:38:45.763 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T03:38:45.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:38:45.763 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2024-05-10T03:38:45.764 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-05-10T03:38:45.764 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-10T03:38:45.764 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-10T03:38:45.764 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-10T03:38:45.764 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-05-10T03:38:45.901 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:45 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1029614141' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-10T03:38:45.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:45 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1029614141' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-10T03:38:46.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:38:46.050 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2024-05-10T03:38:46.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:38:46.073 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2024-05-10T03:38:46.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:38:46.136 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2024-05-10T03:38:46.136 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-05-10T03:38:46.136 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-10T03:38:46.137 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-10T03:38:46.137 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-05-10T03:38:46.249 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-10T03:38:46.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:38:46.249 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2024-05-10T03:38:46.249 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-05-10T03:38:46.249 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-10T03:38:46.249 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-10T03:38:46.249 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-10T03:38:46.249 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-10T03:38:46.249 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-10T03:38:46.250 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-05-10T03:38:46.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:38:46.491 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2024-05-10T03:38:46.491 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-05-10T03:38:46.491 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2024-05-10T03:38:46.491 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.0 master ceph-brx 2024-05-10T03:38:46.491 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-05-10T03:38:46.603 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-10T03:38:46.604 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T03:38:46.604 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-10T03:38:46.623 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-10T03:38:46.623 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T03:38:46.624 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-10T03:38:46.684 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2024-05-10T03:38:46.756 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:46 smithi045 ceph-mon[42520]: pgmap v236: 129 pgs: 2 creating+activating, 127 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-05-10T03:38:46.761 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-10T03:38:46.761 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-10T03:38:46.837 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-10T03:38:46.838 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-10T03:38:46.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:38:46.839 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2024-05-10T03:38:46.901 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-10T03:38:46.902 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-10T03:38:46.902 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:46 smithi106 ceph-mon[46996]: pgmap v236: 129 pgs: 2 creating+activating, 127 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-05-10T03:38:46.945 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2024-05-10T03:38:46.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:46 smithi154 ceph-mon[46565]: pgmap v236: 129 pgs: 2 creating+activating, 127 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-05-10T03:38:46.981 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-10T03:38:46.981 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-10T03:38:47.054 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-10T03:38:47.056 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-10T03:38:47.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:38:47.056 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2024-05-10T03:38:47.067 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi045.stderr:2024-05-10T03:38:47.064+0000 7f14a94c45c0 -1 init, newargv = 0x7f1490004ba0 newargc=15 2024-05-10T03:38:47.067 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi045.stderr:ceph-fuse[96339]: starting ceph client 2024-05-10T03:38:47.074 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi045.stderr:ceph-fuse[96339]: starting fuse 2024-05-10T03:38:47.087 INFO:teuthology.orchestra.run.smithi045.stdout:124 2024-05-10T03:38:47.088 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [124] 2024-05-10T03:38:47.088 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-05-10T03:38:47.088 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2024-05-10T03:38:47.088 DEBUG:teuthology.orchestra.run.smithi045:> import re 2024-05-10T03:38:47.088 DEBUG:teuthology.orchestra.run.smithi045:> import os 2024-05-10T03:38:47.088 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2024-05-10T03:38:47.088 DEBUG:teuthology.orchestra.run.smithi045:> 2024-05-10T03:38:47.088 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2024-05-10T03:38:47.088 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-10T03:38:47.088 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2024-05-10T03:38:47.089 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-10T03:38:47.089 DEBUG:teuthology.orchestra.run.smithi045:> 2024-05-10T03:38:47.089 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2024-05-10T03:38:47.089 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2024-05-10T03:38:47.089 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2024-05-10T03:38:47.089 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2024-05-10T03:38:47.089 DEBUG:teuthology.orchestra.run.smithi045:> 2024-05-10T03:38:47.089 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2024-05-10T03:38:47.089 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-10T03:38:47.089 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-10T03:38:47.089 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-10T03:38:47.089 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2024-05-10T03:38:47.089 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2024-05-10T03:38:47.089 DEBUG:teuthology.orchestra.run.smithi045:> return f 2024-05-10T03:38:47.089 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-10T03:38:47.090 DEBUG:teuthology.orchestra.run.smithi045:> 2024-05-10T03:38:47.090 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.admin")) 2024-05-10T03:38:47.090 DEBUG:teuthology.orchestra.run.smithi045:> ' 2024-05-10T03:38:47.228 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.admin.96339.asok 2024-05-10T03:38:47.409 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.96339.asok 2024-05-10T03:38:47.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:38:47.410 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.96339.asok status 2024-05-10T03:38:47.600 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:38:47.600 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2024-05-10T03:38:47.600 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "50174015a7e79f951b988949abe236791f52d4da", 2024-05-10T03:38:47.600 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.2.2-1330-g50174015 (50174015a7e79f951b988949abe236791f52d4da) reef (stable)", 2024-05-10T03:38:47.600 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "admin", 2024-05-10T03:38:47.600 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2024-05-10T03:38:47.600 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-10T03:38:47.600 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "96339", 2024-05-10T03:38:47.600 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2024-05-10T03:38:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:38:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2024-05-10T03:38:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2024-05-10T03:38:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 14775, 2024-05-10T03:38:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2024-05-10T03:38:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2024-05-10T03:38:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2024-05-10T03:38:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 14775 2024-05-10T03:38:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:38:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2024-05-10T03:38:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-05-10T03:38:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2024-05-10T03:38:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1042771510 2024-05-10T03:38:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:38:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:38:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2024-05-10T03:38:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-05-10T03:38:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2024-05-10T03:38:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1042771510 2024-05-10T03:38:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:38:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.14775 192.168.0.1:0/1042771510", 2024-05-10T03:38:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.1:0/1042771510", 2024-05-10T03:38:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2024-05-10T03:38:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 17, 2024-05-10T03:38:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 86, 2024-05-10T03:38:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2024-05-10T03:38:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2024-05-10T03:38:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2024-05-10T03:38:47.603 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:38:47.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:38:47.612 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2024-05-10T03:38:47.612 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-10T03:38:47.631 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2024-05-10T03:38:47.631 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-10T03:38:47.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:38:47.632 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-10T03:38:47.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:38:47.706 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-10T03:38:47.824 INFO:teuthology.orchestra.run.smithi045.stdout:# file: . 2024-05-10T03:38:47.824 INFO:teuthology.orchestra.run.smithi045.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-10T03:38:47.824 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:38:47.825 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-10T03:38:47.825 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:38:47.848 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:38:48.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.045+0000 7f11aaa27700 1 -- 172.21.15.45:0/2131720813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11a41026c0 msgr2=0x7f11a4104ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:48.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.045+0000 7f11aaa27700 1 --2- 172.21.15.45:0/2131720813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11a41026c0 0x7f11a4104ae0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1194009990 tx=0x7f1194009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.045+0000 7f11aaa27700 1 -- 172.21.15.45:0/2131720813 shutdown_connections 2024-05-10T03:38:48.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.045+0000 7f11aaa27700 1 --2- 172.21.15.45:0/2131720813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11a4107980 0x7f11a4109da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.045+0000 7f11aaa27700 1 --2- 172.21.15.45:0/2131720813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11a41026c0 0x7f11a4104ae0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.045+0000 7f11aaa27700 1 --2- 172.21.15.45:0/2131720813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11a4105020 0x7f11a4107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.045+0000 7f11aaa27700 1 -- 172.21.15.45:0/2131720813 >> 172.21.15.45:0/2131720813 conn(0x7f11a40fc0c0 msgr2=0x7f11a40fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:48.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.045+0000 7f11aaa27700 1 -- 172.21.15.45:0/2131720813 shutdown_connections 2024-05-10T03:38:48.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.045+0000 7f11aaa27700 1 -- 172.21.15.45:0/2131720813 wait complete. 2024-05-10T03:38:48.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.046+0000 7f11aaa27700 1 Processor -- start 2024-05-10T03:38:48.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.046+0000 7f11aaa27700 1 -- start start 2024-05-10T03:38:48.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.046+0000 7f11aaa27700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11a41026c0 0x7f11a4101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:48.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.046+0000 7f11aaa27700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11a4105020 0x7f11a41005d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:48.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.046+0000 7f11aaa27700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11a4107980 0x7f11a4100b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:48.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.046+0000 7f11aaa27700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a4101170 con 0x7f11a4105020 2024-05-10T03:38:48.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.046+0000 7f11aaa27700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a41012e0 con 0x7f11a4107980 2024-05-10T03:38:48.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.046+0000 7f11aaa27700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a41014a0 con 0x7f11a41026c0 2024-05-10T03:38:48.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.047+0000 7f11a37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11a4105020 0x7f11a41005d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:48.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.047+0000 7f11a37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11a4105020 0x7f11a41005d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55878/0 (socket says 172.21.15.45:55878) 2024-05-10T03:38:48.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.047+0000 7f11a3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11a41026c0 0x7f11a4101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:48.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.047+0000 7f11a37fe700 1 -- 172.21.15.45:0/960968702 learned_addr learned my addr 172.21.15.45:0/960968702 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:48.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.047+0000 7f11a8fc4700 1 --2- 172.21.15.45:0/960968702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11a4107980 0x7f11a4100b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:48.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.047+0000 7f11a37fe700 1 -- 172.21.15.45:0/960968702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11a41026c0 msgr2=0x7f11a4101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:48.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.047+0000 7f11a37fe700 1 --2- 172.21.15.45:0/960968702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11a41026c0 0x7f11a4101f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.047+0000 7f11a37fe700 1 -- 172.21.15.45:0/960968702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11a4107980 msgr2=0x7f11a4100b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:48.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.047+0000 7f11a37fe700 1 --2- 172.21.15.45:0/960968702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11a4107980 0x7f11a4100b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.047+0000 7f11a37fe700 1 -- 172.21.15.45:0/960968702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11940095f0 con 0x7f11a4105020 2024-05-10T03:38:48.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.047+0000 7f11a37fe700 1 --2- 172.21.15.45:0/960968702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11a4105020 0x7f11a41005d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f118c00d950 tx=0x7f118c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:48.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.047+0000 7f11a17fa700 1 -- 172.21.15.45:0/960968702 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c00f890 con 0x7f11a4105020 2024-05-10T03:38:48.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.047+0000 7f11a17fa700 1 -- 172.21.15.45:0/960968702 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f118c010460 con 0x7f11a4105020 2024-05-10T03:38:48.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.047+0000 7f11a17fa700 1 -- 172.21.15.45:0/960968702 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c00e610 con 0x7f11a4105020 2024-05-10T03:38:48.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.047+0000 7f11aaa27700 1 -- 172.21.15.45:0/960968702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a41a2320 con 0x7f11a4105020 2024-05-10T03:38:48.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.047+0000 7f11aaa27700 1 -- 172.21.15.45:0/960968702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a41a27e0 con 0x7f11a4105020 2024-05-10T03:38:48.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.049+0000 7f11aaa27700 1 -- 172.21.15.45:0/960968702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a40fdc70 con 0x7f11a4105020 2024-05-10T03:38:48.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.050+0000 7f11a17fa700 1 -- 172.21.15.45:0/960968702 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f118c010960 con 0x7f11a4105020 2024-05-10T03:38:48.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.051+0000 7f11a17fa700 1 --2- 172.21.15.45:0/960968702 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f11900a1120 0x7f11900a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:48.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.051+0000 7f11a17fa700 1 -- 172.21.15.45:0/960968702 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f118c0cc8e0 con 0x7f11a4105020 2024-05-10T03:38:48.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.051+0000 7f11a3fff700 1 --2- 172.21.15.45:0/960968702 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f11900a1120 0x7f11900a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:48.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.051+0000 7f11a3fff700 1 --2- 172.21.15.45:0/960968702 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f11900a1120 0x7f11900a3630 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1194006010 tx=0x7f119401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:48.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.055+0000 7f11a17fa700 1 -- 172.21.15.45:0/960968702 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f118c095e80 con 0x7f11a4105020 2024-05-10T03:38:48.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.275+0000 7f11aaa27700 1 -- 172.21.15.45:0/960968702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11a40678b0 con 0x7f11a4105020 2024-05-10T03:38:48.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.277+0000 7f11a17fa700 1 -- 172.21.15.45:0/960968702 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+23981 (secure 0 0 0) 0x7f118c016090 con 0x7f11a4105020 2024-05-10T03:38:48.280 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:38:48.280 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":86,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:38:42.069624+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:38:34.871801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:38:35.935386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T03:38:39.029903+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:38:48.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.279+0000 7f11aaa27700 1 -- 172.21.15.45:0/960968702 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f11900a1120 msgr2=0x7f11900a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:48.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.279+0000 7f11aaa27700 1 --2- 172.21.15.45:0/960968702 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f11900a1120 0x7f11900a3630 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1194006010 tx=0x7f119401a040 comp rx=0 tx=0).stop 2024-05-10T03:38:48.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.279+0000 7f11aaa27700 1 -- 172.21.15.45:0/960968702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11a4105020 msgr2=0x7f11a41005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:48.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.279+0000 7f11aaa27700 1 --2- 172.21.15.45:0/960968702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11a4105020 0x7f11a41005d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f118c00d950 tx=0x7f118c00dc60 comp rx=0 tx=0).stop 2024-05-10T03:38:48.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.280+0000 7f11aaa27700 1 -- 172.21.15.45:0/960968702 shutdown_connections 2024-05-10T03:38:48.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.280+0000 7f11aaa27700 1 --2- 172.21.15.45:0/960968702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11a41026c0 0x7f11a4101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.280+0000 7f11aaa27700 1 --2- 172.21.15.45:0/960968702 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f11900a1120 0x7f11900a3630 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.280+0000 7f11aaa27700 1 --2- 172.21.15.45:0/960968702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11a4107980 0x7f11a4100b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.280+0000 7f11aaa27700 1 --2- 172.21.15.45:0/960968702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11a4105020 0x7f11a41005d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.280+0000 7f11aaa27700 1 -- 172.21.15.45:0/960968702 >> 172.21.15.45:0/960968702 conn(0x7f11a40fc0c0 msgr2=0x7f11a4103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:48.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.280+0000 7f11aaa27700 1 -- 172.21.15.45:0/960968702 shutdown_connections 2024-05-10T03:38:48.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.280+0000 7f11aaa27700 1 -- 172.21.15.45:0/960968702 wait complete. 2024-05-10T03:38:48.297 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T03:35:20.339400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T03:38:34.871801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T03:38:35.935386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-10T03:38:39.029903+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-10T03:38:48.297 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T03:38:48.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.448+0000 7f8057641700 1 -- 172.21.15.45:0/2575430913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8050105040 msgr2=0x7f8050107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:48.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.448+0000 7f8057641700 1 --2- 172.21.15.45:0/2575430913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8050105040 0x7f8050107460 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f804c009990 tx=0x7f804c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.448+0000 7f8057641700 1 -- 172.21.15.45:0/2575430913 shutdown_connections 2024-05-10T03:38:48.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.448+0000 7f8057641700 1 --2- 172.21.15.45:0/2575430913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80501079a0 0x7f8050109dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.448+0000 7f8057641700 1 --2- 172.21.15.45:0/2575430913 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80501026e0 0x7f8050104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.448+0000 7f8057641700 1 --2- 172.21.15.45:0/2575430913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8050105040 0x7f8050107460 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.448+0000 7f8057641700 1 -- 172.21.15.45:0/2575430913 >> 172.21.15.45:0/2575430913 conn(0x7f80500fc0e0 msgr2=0x7f80500fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:48.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.448+0000 7f8057641700 1 -- 172.21.15.45:0/2575430913 shutdown_connections 2024-05-10T03:38:48.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.448+0000 7f8057641700 1 -- 172.21.15.45:0/2575430913 wait complete. 2024-05-10T03:38:48.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.449+0000 7f8057641700 1 Processor -- start 2024-05-10T03:38:48.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.449+0000 7f8057641700 1 -- start start 2024-05-10T03:38:48.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.449+0000 7f8057641700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80501026e0 0x7f8050197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:48.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.449+0000 7f8057641700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8050105040 0x7f8050198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:48.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.449+0000 7f8057641700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80501079a0 0x7f805019f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:48.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.449+0000 7f8057641700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805019faa0 con 0x7f8050105040 2024-05-10T03:38:48.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.449+0000 7f8057641700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805019fc10 con 0x7f80501026e0 2024-05-10T03:38:48.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.449+0000 7f8057641700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805019fdd0 con 0x7f80501079a0 2024-05-10T03:38:48.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.449+0000 7f8054bdc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8050105040 0x7f8050198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:48.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.449+0000 7f80553dd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80501026e0 0x7f8050197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:48.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.449+0000 7f8054bdc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8050105040 0x7f8050198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55892/0 (socket says 172.21.15.45:55892) 2024-05-10T03:38:48.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.449+0000 7f8054bdc700 1 -- 172.21.15.45:0/3214256992 learned_addr learned my addr 172.21.15.45:0/3214256992 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:48.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.449+0000 7f8055bde700 1 --2- 172.21.15.45:0/3214256992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80501079a0 0x7f805019f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:48.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.449+0000 7f80553dd700 1 -- 172.21.15.45:0/3214256992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80501079a0 msgr2=0x7f805019f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:48.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.449+0000 7f80553dd700 1 --2- 172.21.15.45:0/3214256992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80501079a0 0x7f805019f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.449+0000 7f80553dd700 1 -- 172.21.15.45:0/3214256992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8050105040 msgr2=0x7f8050198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:48.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.449+0000 7f80553dd700 1 --2- 172.21.15.45:0/3214256992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8050105040 0x7f8050198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.449+0000 7f80553dd700 1 -- 172.21.15.45:0/3214256992 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c0095f0 con 0x7f80501026e0 2024-05-10T03:38:48.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.449+0000 7f8054bdc700 1 --2- 172.21.15.45:0/3214256992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8050105040 0x7f8050198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:38:48.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.450+0000 7f80553dd700 1 --2- 172.21.15.45:0/3214256992 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80501026e0 0x7f8050197fc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8050073e60 tx=0x7f804400dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:48.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.450+0000 7f80427fc700 1 -- 172.21.15.45:0/3214256992 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804400f890 con 0x7f80501026e0 2024-05-10T03:38:48.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.450+0000 7f8057641700 1 -- 172.21.15.45:0/3214256992 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80501a00b0 con 0x7f80501026e0 2024-05-10T03:38:48.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.450+0000 7f80427fc700 1 -- 172.21.15.45:0/3214256992 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8044010460 con 0x7f80501026e0 2024-05-10T03:38:48.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.450+0000 7f80427fc700 1 -- 172.21.15.45:0/3214256992 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804400e610 con 0x7f80501026e0 2024-05-10T03:38:48.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.450+0000 7f8057641700 1 -- 172.21.15.45:0/3214256992 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80501a05c0 con 0x7f80501026e0 2024-05-10T03:38:48.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.451+0000 7f8057641700 1 -- 172.21.15.45:0/3214256992 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80500fdc90 con 0x7f80501026e0 2024-05-10T03:38:48.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.453+0000 7f80427fc700 1 -- 172.21.15.45:0/3214256992 <== mon.2 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f80440108d0 con 0x7f80501026e0 2024-05-10T03:38:48.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.453+0000 7f80427fc700 1 --2- 172.21.15.45:0/3214256992 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f803c0a11c0 0x7f803c0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:48.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.453+0000 7f8054bdc700 1 --2- 172.21.15.45:0/3214256992 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f803c0a11c0 0x7f803c0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:48.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.453+0000 7f80427fc700 1 -- 172.21.15.45:0/3214256992 <== mon.2 v2:172.21.15.106:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f80440ccbe0 con 0x7f80501026e0 2024-05-10T03:38:48.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.454+0000 7f8054bdc700 1 --2- 172.21.15.45:0/3214256992 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f803c0a11c0 0x7f803c0a36d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f804c006010 tx=0x7f804c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:48.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.457+0000 7f80427fc700 1 -- 172.21.15.45:0/3214256992 <== mon.2 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8044096180 con 0x7f80501026e0 2024-05-10T03:38:48.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.675+0000 7f8057641700 1 -- 172.21.15.45:0/3214256992 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f805010d550 con 0x7f80501026e0 2024-05-10T03:38:48.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.676+0000 7f80427fc700 1 -- 172.21.15.45:0/3214256992 <== mon.2 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f80440160a0 con 0x7f80501026e0 2024-05-10T03:38:48.678 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-05-10T03:38:48.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.678+0000 7f8057641700 1 -- 172.21.15.45:0/3214256992 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f803c0a11c0 msgr2=0x7f803c0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:48.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.678+0000 7f8057641700 1 --2- 172.21.15.45:0/3214256992 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f803c0a11c0 0x7f803c0a36d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f804c006010 tx=0x7f804c01a040 comp rx=0 tx=0).stop 2024-05-10T03:38:48.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.678+0000 7f8057641700 1 -- 172.21.15.45:0/3214256992 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80501026e0 msgr2=0x7f8050197fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:48.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.678+0000 7f8057641700 1 --2- 172.21.15.45:0/3214256992 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80501026e0 0x7f8050197fc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8050073e60 tx=0x7f804400dc30 comp rx=0 tx=0).stop 2024-05-10T03:38:48.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.678+0000 7f8057641700 1 -- 172.21.15.45:0/3214256992 shutdown_connections 2024-05-10T03:38:48.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.678+0000 7f8057641700 1 --2- 172.21.15.45:0/3214256992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80501079a0 0x7f805019f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.678+0000 7f8057641700 1 --2- 172.21.15.45:0/3214256992 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f803c0a11c0 0x7f803c0a36d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.678+0000 7f8057641700 1 --2- 172.21.15.45:0/3214256992 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80501026e0 0x7f8050197fc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.678+0000 7f8057641700 1 --2- 172.21.15.45:0/3214256992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8050105040 0x7f8050198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.679+0000 7f8057641700 1 -- 172.21.15.45:0/3214256992 >> 172.21.15.45:0/3214256992 conn(0x7f80500fc0e0 msgr2=0x7f8050103170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:48.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.679+0000 7f8057641700 1 -- 172.21.15.45:0/3214256992 shutdown_connections 2024-05-10T03:38:48.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.679+0000 7f8057641700 1 -- 172.21.15.45:0/3214256992 wait complete. 2024-05-10T03:38:48.695 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T03:38:48.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.845+0000 7ff184ae8700 1 -- 172.21.15.45:0/4172230646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff180100ae0 msgr2=0x7ff180100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:48.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.845+0000 7ff184ae8700 1 --2- 172.21.15.45:0/4172230646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff180100ae0 0x7ff180100ef0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff170009990 tx=0x7ff170009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.845+0000 7ff184ae8700 1 -- 172.21.15.45:0/4172230646 shutdown_connections 2024-05-10T03:38:48.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.845+0000 7ff184ae8700 1 --2- 172.21.15.45:0/4172230646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1801025a0 0x7ff180108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.845+0000 7ff184ae8700 1 --2- 172.21.15.45:0/4172230646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff180100ae0 0x7ff180100ef0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.845+0000 7ff184ae8700 1 --2- 172.21.15.45:0/4172230646 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff180101c00 0x7ff180102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.845+0000 7ff184ae8700 1 -- 172.21.15.45:0/4172230646 >> 172.21.15.45:0/4172230646 conn(0x7ff1800fc0f0 msgr2=0x7ff1800fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.845+0000 7ff184ae8700 1 -- 172.21.15.45:0/4172230646 shutdown_connections 2024-05-10T03:38:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.845+0000 7ff184ae8700 1 -- 172.21.15.45:0/4172230646 wait complete. 2024-05-10T03:38:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.846+0000 7ff184ae8700 1 Processor -- start 2024-05-10T03:38:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.846+0000 7ff184ae8700 1 -- start start 2024-05-10T03:38:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.846+0000 7ff184ae8700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff180100ae0 0x7ff180198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.846+0000 7ff184ae8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff180101c00 0x7ff1801985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.846+0000 7ff184ae8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1801025a0 0x7ff18019f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.846+0000 7ff184ae8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18019faf0 con 0x7ff180101c00 2024-05-10T03:38:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.846+0000 7ff184ae8700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18019fc60 con 0x7ff180100ae0 2024-05-10T03:38:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.846+0000 7ff184ae8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18019fe20 con 0x7ff1801025a0 2024-05-10T03:38:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.846+0000 7ff17dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff180101c00 0x7ff1801985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.846+0000 7ff17dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff180101c00 0x7ff1801985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55900/0 (socket says 172.21.15.45:55900) 2024-05-10T03:38:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.846+0000 7ff17dd9b700 1 -- 172.21.15.45:0/67884057 learned_addr learned my addr 172.21.15.45:0/67884057 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.846+0000 7ff17ed9d700 1 --2- 172.21.15.45:0/67884057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1801025a0 0x7ff18019f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.846+0000 7ff17e59c700 1 --2- 172.21.15.45:0/67884057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff180100ae0 0x7ff180198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.847+0000 7ff17dd9b700 1 -- 172.21.15.45:0/67884057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1801025a0 msgr2=0x7ff18019f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.847+0000 7ff17dd9b700 1 --2- 172.21.15.45:0/67884057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1801025a0 0x7ff18019f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.847+0000 7ff17dd9b700 1 -- 172.21.15.45:0/67884057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff180100ae0 msgr2=0x7ff180198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.847+0000 7ff17dd9b700 1 --2- 172.21.15.45:0/67884057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff180100ae0 0x7ff180198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.847+0000 7ff17dd9b700 1 -- 172.21.15.45:0/67884057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1700095f0 con 0x7ff180101c00 2024-05-10T03:38:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.847+0000 7ff17dd9b700 1 --2- 172.21.15.45:0/67884057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff180101c00 0x7ff1801985a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff17400e9a0 tx=0x7ff17400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.847+0000 7ff16f7fe700 1 -- 172.21.15.45:0/67884057 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff174009790 con 0x7ff180101c00 2024-05-10T03:38:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.847+0000 7ff16f7fe700 1 -- 172.21.15.45:0/67884057 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff174010430 con 0x7ff180101c00 2024-05-10T03:38:48.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.847+0000 7ff184ae8700 1 -- 172.21.15.45:0/67884057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1801a0100 con 0x7ff180101c00 2024-05-10T03:38:48.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.847+0000 7ff16f7fe700 1 -- 172.21.15.45:0/67884057 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff174018680 con 0x7ff180101c00 2024-05-10T03:38:48.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.847+0000 7ff184ae8700 1 -- 172.21.15.45:0/67884057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1801a0610 con 0x7ff180101c00 2024-05-10T03:38:48.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.848+0000 7ff184ae8700 1 -- 172.21.15.45:0/67884057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff180068730 con 0x7ff180101c00 2024-05-10T03:38:48.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.850+0000 7ff16f7fe700 1 -- 172.21.15.45:0/67884057 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff174010910 con 0x7ff180101c00 2024-05-10T03:38:48.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.850+0000 7ff16f7fe700 1 --2- 172.21.15.45:0/67884057 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff1680a11c0 0x7ff1680a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:48.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.851+0000 7ff16f7fe700 1 -- 172.21.15.45:0/67884057 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ff174014070 con 0x7ff180101c00 2024-05-10T03:38:48.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.851+0000 7ff17e59c700 1 --2- 172.21.15.45:0/67884057 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff1680a11c0 0x7ff1680a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:48.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.851+0000 7ff17e59c700 1 --2- 172.21.15.45:0/67884057 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff1680a11c0 0x7ff1680a36d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff170006010 tx=0x7ff17001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:48.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:48.855+0000 7ff16f7fe700 1 -- 172.21.15.45:0/67884057 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff174096700 con 0x7ff180101c00 2024-05-10T03:38:49.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.076+0000 7ff184ae8700 1 -- 172.21.15.45:0/67884057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff1801a0970 con 0x7ff180101c00 2024-05-10T03:38:49.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.076+0000 7ff16f7fe700 1 -- 172.21.15.45:0/67884057 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff1740105a0 con 0x7ff180101c00 2024-05-10T03:38:49.079 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-05-10T03:38:49.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.079+0000 7ff184ae8700 1 -- 172.21.15.45:0/67884057 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff1680a11c0 msgr2=0x7ff1680a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:49.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.079+0000 7ff184ae8700 1 --2- 172.21.15.45:0/67884057 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff1680a11c0 0x7ff1680a36d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff170006010 tx=0x7ff17001a040 comp rx=0 tx=0).stop 2024-05-10T03:38:49.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.079+0000 7ff184ae8700 1 -- 172.21.15.45:0/67884057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff180101c00 msgr2=0x7ff1801985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.079+0000 7ff184ae8700 1 --2- 172.21.15.45:0/67884057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff180101c00 0x7ff1801985a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff17400e9a0 tx=0x7ff17400ecb0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.079+0000 7ff184ae8700 1 -- 172.21.15.45:0/67884057 shutdown_connections 2024-05-10T03:38:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.079+0000 7ff184ae8700 1 --2- 172.21.15.45:0/67884057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1801025a0 0x7ff18019f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.079+0000 7ff184ae8700 1 --2- 172.21.15.45:0/67884057 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff1680a11c0 0x7ff1680a36d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.079+0000 7ff184ae8700 1 --2- 172.21.15.45:0/67884057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff180100ae0 0x7ff180198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.079+0000 7ff184ae8700 1 --2- 172.21.15.45:0/67884057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff180101c00 0x7ff1801985a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.079+0000 7ff184ae8700 1 -- 172.21.15.45:0/67884057 >> 172.21.15.45:0/67884057 conn(0x7ff1800fc0f0 msgr2=0x7ff1800fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.079+0000 7ff184ae8700 1 -- 172.21.15.45:0/67884057 shutdown_connections 2024-05-10T03:38:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.079+0000 7ff184ae8700 1 -- 172.21.15.45:0/67884057 wait complete. 2024-05-10T03:38:49.095 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T03:38:49.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:48 smithi154 ceph-mon[46565]: pgmap v237: 129 pgs: 129 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-05-10T03:38:49.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:48 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/960968702' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:49.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:48 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3214256992' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:38:49.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.246+0000 7ff06cb44700 1 -- 172.21.15.45:0/1379752518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff068101c00 msgr2=0x7ff068102010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:49.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.246+0000 7ff06cb44700 1 --2- 172.21.15.45:0/1379752518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff068101c00 0x7ff068102010 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff058009990 tx=0x7ff058009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.247+0000 7ff06cb44700 1 -- 172.21.15.45:0/1379752518 shutdown_connections 2024-05-10T03:38:49.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.247+0000 7ff06cb44700 1 --2- 172.21.15.45:0/1379752518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0681036c0 0x7ff068109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.247+0000 7ff06cb44700 1 --2- 172.21.15.45:0/1379752518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff068101c00 0x7ff068102010 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.247+0000 7ff06cb44700 1 --2- 172.21.15.45:0/1379752518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff068102d20 0x7ff068103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.247+0000 7ff06cb44700 1 -- 172.21.15.45:0/1379752518 >> 172.21.15.45:0/1379752518 conn(0x7ff0680fd210 msgr2=0x7ff0680ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:49.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.247+0000 7ff06cb44700 1 -- 172.21.15.45:0/1379752518 shutdown_connections 2024-05-10T03:38:49.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.247+0000 7ff06cb44700 1 -- 172.21.15.45:0/1379752518 wait complete. 2024-05-10T03:38:49.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.248+0000 7ff06cb44700 1 Processor -- start 2024-05-10T03:38:49.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.248+0000 7ff06cb44700 1 -- start start 2024-05-10T03:38:49.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.248+0000 7ff06cb44700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff068101c00 0x7ff068198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:49.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.248+0000 7ff06cb44700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff068102d20 0x7ff068198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:49.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.248+0000 7ff06cb44700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0681036c0 0x7ff06819f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:49.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.248+0000 7ff06cb44700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06819fae0 con 0x7ff0681036c0 2024-05-10T03:38:49.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.248+0000 7ff06cb44700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06819fc50 con 0x7ff068101c00 2024-05-10T03:38:49.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.248+0000 7ff06cb44700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06819fe10 con 0x7ff068102d20 2024-05-10T03:38:49.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.248+0000 7ff066d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0681036c0 0x7ff06819f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:49.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.248+0000 7ff066d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0681036c0 0x7ff06819f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55914/0 (socket says 172.21.15.45:55914) 2024-05-10T03:38:49.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.248+0000 7ff066d9d700 1 -- 172.21.15.45:0/766104412 learned_addr learned my addr 172.21.15.45:0/766104412 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:49.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.249+0000 7ff06659c700 1 --2- 172.21.15.45:0/766104412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff068101c00 0x7ff068198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:49.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.249+0000 7ff065d9b700 1 --2- 172.21.15.45:0/766104412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff068102d20 0x7ff068198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:49.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.249+0000 7ff066d9d700 1 -- 172.21.15.45:0/766104412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff068102d20 msgr2=0x7ff068198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:49.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.249+0000 7ff066d9d700 1 --2- 172.21.15.45:0/766104412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff068102d20 0x7ff068198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.249+0000 7ff066d9d700 1 -- 172.21.15.45:0/766104412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff068101c00 msgr2=0x7ff068198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:49.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.249+0000 7ff066d9d700 1 --2- 172.21.15.45:0/766104412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff068101c00 0x7ff068198000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.249+0000 7ff066d9d700 1 -- 172.21.15.45:0/766104412 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0580095f0 con 0x7ff0681036c0 2024-05-10T03:38:49.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.249+0000 7ff066d9d700 1 --2- 172.21.15.45:0/766104412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0681036c0 0x7ff06819f4d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff060007ee0 tx=0x7ff06000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:49.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.249+0000 7ff05f7fe700 1 -- 172.21.15.45:0/766104412 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06000dd20 con 0x7ff0681036c0 2024-05-10T03:38:49.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.249+0000 7ff06cb44700 1 -- 172.21.15.45:0/766104412 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0681a00f0 con 0x7ff0681036c0 2024-05-10T03:38:49.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.249+0000 7ff05f7fe700 1 -- 172.21.15.45:0/766104412 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff06000f040 con 0x7ff0681036c0 2024-05-10T03:38:49.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.249+0000 7ff05f7fe700 1 -- 172.21.15.45:0/766104412 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff060015400 con 0x7ff0681036c0 2024-05-10T03:38:49.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.249+0000 7ff06cb44700 1 -- 172.21.15.45:0/766104412 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0681a05b0 con 0x7ff0681036c0 2024-05-10T03:38:49.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.250+0000 7ff06cb44700 1 -- 172.21.15.45:0/766104412 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff068108e10 con 0x7ff0681036c0 2024-05-10T03:38:49.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.252+0000 7ff05f7fe700 1 -- 172.21.15.45:0/766104412 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff060003a00 con 0x7ff0681036c0 2024-05-10T03:38:49.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.252+0000 7ff05f7fe700 1 --2- 172.21.15.45:0/766104412 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff0540a11c0 0x7ff0540a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:49.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.253+0000 7ff05f7fe700 1 -- 172.21.15.45:0/766104412 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ff0600ccae0 con 0x7ff0681036c0 2024-05-10T03:38:49.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.253+0000 7ff06659c700 1 --2- 172.21.15.45:0/766104412 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff0540a11c0 0x7ff0540a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:49.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.253+0000 7ff06659c700 1 --2- 172.21.15.45:0/766104412 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff0540a11c0 0x7ff0540a36d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff058006010 tx=0x7ff05801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:49.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.256+0000 7ff05f7fe700 1 -- 172.21.15.45:0/766104412 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff060096020 con 0x7ff0681036c0 2024-05-10T03:38:49.283 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:48 smithi045 ceph-mon[42520]: pgmap v237: 129 pgs: 129 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-05-10T03:38:49.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:48 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/960968702' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:49.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:48 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3214256992' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:38:49.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:48 smithi106 ceph-mon[46996]: pgmap v237: 129 pgs: 129 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-05-10T03:38:49.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:48 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/960968702' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:49.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:48 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3214256992' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:38:49.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.476+0000 7ff06cb44700 1 -- 172.21.15.45:0/766104412 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff06810d520 con 0x7ff0681036c0 2024-05-10T03:38:49.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.477+0000 7ff05f7fe700 1 -- 172.21.15.45:0/766104412 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff0600230a0 con 0x7ff0681036c0 2024-05-10T03:38:49.479 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2024-05-10T03:38:49.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.479+0000 7ff06cb44700 1 -- 172.21.15.45:0/766104412 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff0540a11c0 msgr2=0x7ff0540a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:49.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.479+0000 7ff06cb44700 1 --2- 172.21.15.45:0/766104412 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff0540a11c0 0x7ff0540a36d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff058006010 tx=0x7ff05801a040 comp rx=0 tx=0).stop 2024-05-10T03:38:49.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.479+0000 7ff06cb44700 1 -- 172.21.15.45:0/766104412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0681036c0 msgr2=0x7ff06819f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:49.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.479+0000 7ff06cb44700 1 --2- 172.21.15.45:0/766104412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0681036c0 0x7ff06819f4d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff060007ee0 tx=0x7ff06000d3b0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.479+0000 7ff06cb44700 1 -- 172.21.15.45:0/766104412 shutdown_connections 2024-05-10T03:38:49.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.479+0000 7ff06cb44700 1 --2- 172.21.15.45:0/766104412 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff0540a11c0 0x7ff0540a36d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.479+0000 7ff06cb44700 1 --2- 172.21.15.45:0/766104412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0681036c0 0x7ff06819f4d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.479+0000 7ff06cb44700 1 --2- 172.21.15.45:0/766104412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff068101c00 0x7ff068198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.479+0000 7ff06cb44700 1 --2- 172.21.15.45:0/766104412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff068102d20 0x7ff068198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.479+0000 7ff06cb44700 1 -- 172.21.15.45:0/766104412 >> 172.21.15.45:0/766104412 conn(0x7ff0680fd210 msgr2=0x7ff068105f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:49.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.480+0000 7ff06cb44700 1 -- 172.21.15.45:0/766104412 shutdown_connections 2024-05-10T03:38:49.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.480+0000 7ff06cb44700 1 -- 172.21.15.45:0/766104412 wait complete. 2024-05-10T03:38:49.496 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-10T03:38:49.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.645+0000 7f8019500700 1 -- 172.21.15.45:0/2120360292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80141036c0 msgr2=0x7f8014109f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:49.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.645+0000 7f8019500700 1 --2- 172.21.15.45:0/2120360292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80141036c0 0x7f8014109f70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f800c00b0a0 tx=0x7f800c00b3b0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.645+0000 7f8019500700 1 -- 172.21.15.45:0/2120360292 shutdown_connections 2024-05-10T03:38:49.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.645+0000 7f8019500700 1 --2- 172.21.15.45:0/2120360292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80141036c0 0x7f8014109f70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.645+0000 7f8019500700 1 --2- 172.21.15.45:0/2120360292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8014101c00 0x7f8014102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.645+0000 7f8019500700 1 --2- 172.21.15.45:0/2120360292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8014102d20 0x7f8014103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.645+0000 7f8019500700 1 -- 172.21.15.45:0/2120360292 >> 172.21.15.45:0/2120360292 conn(0x7f80140fd210 msgr2=0x7f80140ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:49.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.645+0000 7f8019500700 1 -- 172.21.15.45:0/2120360292 shutdown_connections 2024-05-10T03:38:49.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.645+0000 7f8019500700 1 -- 172.21.15.45:0/2120360292 wait complete. 2024-05-10T03:38:49.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.646+0000 7f8019500700 1 Processor -- start 2024-05-10T03:38:49.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.646+0000 7f8019500700 1 -- start start 2024-05-10T03:38:49.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.646+0000 7f8019500700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8014101c00 0x7f80141980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:49.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.646+0000 7f8019500700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8014102d20 0x7f8014198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:49.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.646+0000 7f8019500700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80141036c0 0x7f801419f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:49.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.646+0000 7f8019500700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801419fbb0 con 0x7f8014102d20 2024-05-10T03:38:49.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.646+0000 7f8019500700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801419fd20 con 0x7f80141036c0 2024-05-10T03:38:49.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.646+0000 7f8019500700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801419fee0 con 0x7f8014101c00 2024-05-10T03:38:49.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.646+0000 7f80127fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8014102d20 0x7f8014198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:49.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.646+0000 7f80127fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8014102d20 0x7f8014198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55922/0 (socket says 172.21.15.45:55922) 2024-05-10T03:38:49.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.646+0000 7f80127fc700 1 -- 172.21.15.45:0/584405257 learned_addr learned my addr 172.21.15.45:0/584405257 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:49.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.647+0000 7f80137fe700 1 --2- 172.21.15.45:0/584405257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80141036c0 0x7f801419f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:49.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.647+0000 7f8012ffd700 1 --2- 172.21.15.45:0/584405257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8014101c00 0x7f80141980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:49.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.647+0000 7f80127fc700 1 -- 172.21.15.45:0/584405257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8014101c00 msgr2=0x7f80141980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:49.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.647+0000 7f80127fc700 1 --2- 172.21.15.45:0/584405257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8014101c00 0x7f80141980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.647+0000 7f80127fc700 1 -- 172.21.15.45:0/584405257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80141036c0 msgr2=0x7f801419f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:49.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.647+0000 7f80127fc700 1 --2- 172.21.15.45:0/584405257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80141036c0 0x7f801419f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.647+0000 7f80127fc700 1 -- 172.21.15.45:0/584405257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800c009d00 con 0x7f8014102d20 2024-05-10T03:38:49.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.647+0000 7f8012ffd700 1 --2- 172.21.15.45:0/584405257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8014101c00 0x7f80141980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:38:49.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.647+0000 7f80127fc700 1 --2- 172.21.15.45:0/584405257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8014102d20 0x7f8014198610 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f800800e9a0 tx=0x7f800800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:49.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.647+0000 7f7ffbfff700 1 -- 172.21.15.45:0/584405257 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8008009790 con 0x7f8014102d20 2024-05-10T03:38:49.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.647+0000 7f7ffbfff700 1 -- 172.21.15.45:0/584405257 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f800800cbd0 con 0x7f8014102d20 2024-05-10T03:38:49.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.647+0000 7f8019500700 1 -- 172.21.15.45:0/584405257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80141a01c0 con 0x7f8014102d20 2024-05-10T03:38:49.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.647+0000 7f7ffbfff700 1 -- 172.21.15.45:0/584405257 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8008018680 con 0x7f8014102d20 2024-05-10T03:38:49.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.647+0000 7f8019500700 1 -- 172.21.15.45:0/584405257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80141a06d0 con 0x7f8014102d20 2024-05-10T03:38:49.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.648+0000 7f8019500700 1 -- 172.21.15.45:0/584405257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8014108e10 con 0x7f8014102d20 2024-05-10T03:38:49.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.650+0000 7f7ffbfff700 1 -- 172.21.15.45:0/584405257 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f80080188a0 con 0x7f8014102d20 2024-05-10T03:38:49.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.650+0000 7f7ffbfff700 1 --2- 172.21.15.45:0/584405257 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7ffc0a11c0 0x7f7ffc0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:49.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.650+0000 7f7ffbfff700 1 -- 172.21.15.45:0/584405257 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8008014070 con 0x7f8014102d20 2024-05-10T03:38:49.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.650+0000 7f8012ffd700 1 --2- 172.21.15.45:0/584405257 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7ffc0a11c0 0x7f7ffc0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:49.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.651+0000 7f8012ffd700 1 --2- 172.21.15.45:0/584405257 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7ffc0a11c0 0x7f7ffc0a36d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8004005950 tx=0x7f80040058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:49.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.654+0000 7f7ffbfff700 1 -- 172.21.15.45:0/584405257 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f80080967e0 con 0x7f8014102d20 2024-05-10T03:38:49.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.872+0000 7f8019500700 1 -- 172.21.15.45:0/584405257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f801410d550 con 0x7f8014102d20 2024-05-10T03:38:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.872+0000 7f7ffbfff700 1 -- 172.21.15.45:0/584405257 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v86) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8008099e00 con 0x7f8014102d20 2024-05-10T03:38:49.875 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-05-10T03:38:49.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.875+0000 7f8019500700 1 -- 172.21.15.45:0/584405257 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7ffc0a11c0 msgr2=0x7f7ffc0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:49.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.875+0000 7f8019500700 1 --2- 172.21.15.45:0/584405257 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7ffc0a11c0 0x7f7ffc0a36d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8004005950 tx=0x7f80040058e0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.875+0000 7f8019500700 1 -- 172.21.15.45:0/584405257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8014102d20 msgr2=0x7f8014198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:49.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.875+0000 7f8019500700 1 --2- 172.21.15.45:0/584405257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8014102d20 0x7f8014198610 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f800800e9a0 tx=0x7f800800ecb0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.875+0000 7f8019500700 1 -- 172.21.15.45:0/584405257 shutdown_connections 2024-05-10T03:38:49.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.875+0000 7f8019500700 1 --2- 172.21.15.45:0/584405257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8014101c00 0x7f80141980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.875+0000 7f8019500700 1 --2- 172.21.15.45:0/584405257 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7ffc0a11c0 0x7f7ffc0a36d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.875+0000 7f8019500700 1 --2- 172.21.15.45:0/584405257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80141036c0 0x7f801419f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.875+0000 7f8019500700 1 --2- 172.21.15.45:0/584405257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8014102d20 0x7f8014198610 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:49.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.875+0000 7f8019500700 1 -- 172.21.15.45:0/584405257 >> 172.21.15.45:0/584405257 conn(0x7f80140fd210 msgr2=0x7f8014105f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:49.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.875+0000 7f8019500700 1 -- 172.21.15.45:0/584405257 shutdown_connections 2024-05-10T03:38:49.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:49.875+0000 7f8019500700 1 -- 172.21.15.45:0/584405257 wait complete. 2024-05-10T03:38:49.892 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T03:38:50.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.039+0000 7f6b3590f700 1 -- 172.21.15.45:0/2301292045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b30102910 msgr2=0x7f6b30109210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:50.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.039+0000 7f6b3590f700 1 --2- 172.21.15.45:0/2301292045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b30102910 0x7f6b30109210 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6b2800b0a0 tx=0x7f6b2800b3b0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.040+0000 7f6b3590f700 1 -- 172.21.15.45:0/2301292045 shutdown_connections 2024-05-10T03:38:50.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.040+0000 7f6b3590f700 1 --2- 172.21.15.45:0/2301292045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b30102910 0x7f6b30109210 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.040+0000 7f6b3590f700 1 --2- 172.21.15.45:0/2301292045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b301010d0 0x7f6b301014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.040+0000 7f6b3590f700 1 --2- 172.21.15.45:0/2301292045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b30101fc0 0x7f6b301023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.040+0000 7f6b3590f700 1 -- 172.21.15.45:0/2301292045 >> 172.21.15.45:0/2301292045 conn(0x7f6b300fb8b0 msgr2=0x7f6b300fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:50.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.040+0000 7f6b3590f700 1 -- 172.21.15.45:0/2301292045 shutdown_connections 2024-05-10T03:38:50.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.040+0000 7f6b3590f700 1 -- 172.21.15.45:0/2301292045 wait complete. 2024-05-10T03:38:50.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.040+0000 7f6b3590f700 1 Processor -- start 2024-05-10T03:38:50.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.040+0000 7f6b3590f700 1 -- start start 2024-05-10T03:38:50.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.041+0000 7f6b3590f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b301010d0 0x7f6b30104c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:50.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.041+0000 7f6b3590f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b30101fc0 0x7f6b30103300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:50.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.041+0000 7f6b3590f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b30102910 0x7f6b30103840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:50.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.041+0000 7f6b3590f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b30103f20 con 0x7f6b301010d0 2024-05-10T03:38:50.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.041+0000 7f6b3590f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b30104090 con 0x7f6b30102910 2024-05-10T03:38:50.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.041+0000 7f6b3590f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b301a23e0 con 0x7f6b30101fc0 2024-05-10T03:38:50.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.041+0000 7f6b2effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b301010d0 0x7f6b30104c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:50.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.041+0000 7f6b2effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b301010d0 0x7f6b30104c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55936/0 (socket says 172.21.15.45:55936) 2024-05-10T03:38:50.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.041+0000 7f6b2effd700 1 -- 172.21.15.45:0/1751129808 learned_addr learned my addr 172.21.15.45:0/1751129808 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:50.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.041+0000 7f6b2f7fe700 1 --2- 172.21.15.45:0/1751129808 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b30102910 0x7f6b30103840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:50.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.041+0000 7f6b267fc700 1 --2- 172.21.15.45:0/1751129808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b30101fc0 0x7f6b30103300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:50.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.041+0000 7f6b2effd700 1 -- 172.21.15.45:0/1751129808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b30101fc0 msgr2=0x7f6b30103300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:50.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.041+0000 7f6b2effd700 1 --2- 172.21.15.45:0/1751129808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b30101fc0 0x7f6b30103300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.041+0000 7f6b2effd700 1 -- 172.21.15.45:0/1751129808 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b30102910 msgr2=0x7f6b30103840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:50.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.041+0000 7f6b2effd700 1 --2- 172.21.15.45:0/1751129808 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b30102910 0x7f6b30103840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.041+0000 7f6b2effd700 1 -- 172.21.15.45:0/1751129808 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b28009d00 con 0x7f6b301010d0 2024-05-10T03:38:50.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.041+0000 7f6b2effd700 1 --2- 172.21.15.45:0/1751129808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b301010d0 0x7f6b30104c60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000d950 tx=0x7f6b2000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:50.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.042+0000 7f6b3490d700 1 -- 172.21.15.45:0/1751129808 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b20004220 con 0x7f6b301010d0 2024-05-10T03:38:50.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.042+0000 7f6b3490d700 1 -- 172.21.15.45:0/1751129808 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6b20007620 con 0x7f6b301010d0 2024-05-10T03:38:50.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.042+0000 7f6b3590f700 1 -- 172.21.15.45:0/1751129808 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b301a2640 con 0x7f6b301010d0 2024-05-10T03:38:50.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.042+0000 7f6b3490d700 1 -- 172.21.15.45:0/1751129808 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b20005700 con 0x7f6b301010d0 2024-05-10T03:38:50.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.042+0000 7f6b3590f700 1 -- 172.21.15.45:0/1751129808 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b301a2b70 con 0x7f6b301010d0 2024-05-10T03:38:50.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.043+0000 7f6b3590f700 1 -- 172.21.15.45:0/1751129808 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b30068730 con 0x7f6b301010d0 2024-05-10T03:38:50.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.044+0000 7f6b3490d700 1 -- 172.21.15.45:0/1751129808 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6b20004380 con 0x7f6b301010d0 2024-05-10T03:38:50.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.045+0000 7f6b3490d700 1 --2- 172.21.15.45:0/1751129808 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6b1c0a1240 0x7f6b1c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:50.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.045+0000 7f6b267fc700 1 --2- 172.21.15.45:0/1751129808 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6b1c0a1240 0x7f6b1c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:50.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.045+0000 7f6b3490d700 1 -- 172.21.15.45:0/1751129808 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f6b200ccd90 con 0x7f6b301010d0 2024-05-10T03:38:50.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.046+0000 7f6b267fc700 1 --2- 172.21.15.45:0/1751129808 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6b1c0a1240 0x7f6b1c0a3750 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6b30104600 tx=0x7f6b1800b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:50.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.049+0000 7f6b3490d700 1 -- 172.21.15.45:0/1751129808 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6b200962d0 con 0x7f6b301010d0 2024-05-10T03:38:50.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:49 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/67884057' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:38:50.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:49 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/766104412' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:38:50.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:49 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/584405257' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:38:50.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:49 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/67884057' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:38:50.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:49 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/766104412' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:38:50.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:49 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/584405257' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:38:50.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.283+0000 7f6b3590f700 1 -- 172.21.15.45:0/1751129808 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6b3010c870 con 0x7f6b301010d0 2024-05-10T03:38:50.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.283+0000 7f6b3490d700 1 -- 172.21.15.45:0/1751129808 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v86) v1 ==== 81+0+587 (secure 0 0 0) 0x7f6b20016070 con 0x7f6b301010d0 2024-05-10T03:38:50.285 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6801/485502847 2024-05-11T03:33:25.801965+0000 2024-05-10T03:38:50.286 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6800/485502847 2024-05-11T03:33:25.801965+0000 2024-05-10T03:38:50.286 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/477110319 2024-05-11T03:33:25.801965+0000 2024-05-10T03:38:50.286 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6800/534860598 2024-05-11T03:33:02.846802+0000 2024-05-10T03:38:50.286 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/2249239510 2024-05-11T03:33:25.801965+0000 2024-05-10T03:38:50.286 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/2903615785 2024-05-11T03:33:02.846802+0000 2024-05-10T03:38:50.286 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6801/534860598 2024-05-11T03:33:02.846802+0000 2024-05-10T03:38:50.286 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/2125492352 2024-05-11T03:33:02.846802+0000 2024-05-10T03:38:50.286 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/3226767328 2024-05-11T03:33:02.846802+0000 2024-05-10T03:38:50.286 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/4077940265 2024-05-11T03:33:25.801965+0000 2024-05-10T03:38:50.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.285+0000 7f6b3590f700 1 -- 172.21.15.45:0/1751129808 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6b1c0a1240 msgr2=0x7f6b1c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:50.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.285+0000 7f6b3590f700 1 --2- 172.21.15.45:0/1751129808 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6b1c0a1240 0x7f6b1c0a3750 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6b30104600 tx=0x7f6b1800b5b0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.285+0000 7f6b3590f700 1 -- 172.21.15.45:0/1751129808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b301010d0 msgr2=0x7f6b30104c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:50.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.285+0000 7f6b3590f700 1 --2- 172.21.15.45:0/1751129808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b301010d0 0x7f6b30104c60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000d950 tx=0x7f6b2000dc60 comp rx=0 tx=0).stop 2024-05-10T03:38:50.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.285+0000 7f6b3590f700 1 -- 172.21.15.45:0/1751129808 shutdown_connections 2024-05-10T03:38:50.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.285+0000 7f6b3590f700 1 --2- 172.21.15.45:0/1751129808 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6b1c0a1240 0x7f6b1c0a3750 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.285+0000 7f6b3590f700 1 --2- 172.21.15.45:0/1751129808 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b30102910 0x7f6b30103840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.285+0000 7f6b3590f700 1 --2- 172.21.15.45:0/1751129808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b301010d0 0x7f6b30104c60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.285+0000 7f6b3590f700 1 --2- 172.21.15.45:0/1751129808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b30101fc0 0x7f6b30103300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.285+0000 7f6b3590f700 1 -- 172.21.15.45:0/1751129808 >> 172.21.15.45:0/1751129808 conn(0x7f6b300fb8b0 msgr2=0x7f6b300fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:50.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.286+0000 7f6b3590f700 1 -- 172.21.15.45:0/1751129808 shutdown_connections 2024-05-10T03:38:50.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.286+0000 7f6b3590f700 1 -- 172.21.15.45:0/1751129808 wait complete. 2024-05-10T03:38:50.289 INFO:teuthology.orchestra.run.smithi045.stderr:listed 10 entries 2024-05-10T03:38:50.302 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-10T03:38:50.302 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:38:50.322 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:38:50.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:49 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/67884057' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:38:50.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:49 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/766104412' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:38:50.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:49 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/584405257' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:38:50.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.512+0000 7fc5322ab700 1 -- 172.21.15.45:0/372626601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc52c102580 msgr2=0x7fc52c108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:50.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.512+0000 7fc5322ab700 1 --2- 172.21.15.45:0/372626601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc52c102580 0x7fc52c108e30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc52400b0a0 tx=0x7fc52400b3b0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.512+0000 7fc5322ab700 1 -- 172.21.15.45:0/372626601 shutdown_connections 2024-05-10T03:38:50.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.513+0000 7fc5322ab700 1 --2- 172.21.15.45:0/372626601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc52c102580 0x7fc52c108e30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.513+0000 7fc5322ab700 1 --2- 172.21.15.45:0/372626601 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc52c100ac0 0x7fc52c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.513+0000 7fc5322ab700 1 --2- 172.21.15.45:0/372626601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc52c101be0 0x7fc52c101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.513+0000 7fc5322ab700 1 -- 172.21.15.45:0/372626601 >> 172.21.15.45:0/372626601 conn(0x7fc52c0fc0d0 msgr2=0x7fc52c0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:50.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.513+0000 7fc5322ab700 1 -- 172.21.15.45:0/372626601 shutdown_connections 2024-05-10T03:38:50.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.513+0000 7fc5322ab700 1 -- 172.21.15.45:0/372626601 wait complete. 2024-05-10T03:38:50.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.513+0000 7fc5322ab700 1 Processor -- start 2024-05-10T03:38:50.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.514+0000 7fc5322ab700 1 -- start start 2024-05-10T03:38:50.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.514+0000 7fc5322ab700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc52c100ac0 0x7fc52c068e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:50.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.514+0000 7fc5322ab700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc52c101be0 0x7fc52c19cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:50.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.514+0000 7fc5322ab700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc52c102580 0x7fc52c19f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:50.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.514+0000 7fc5322ab700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c19fc50 con 0x7fc52c100ac0 2024-05-10T03:38:50.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.514+0000 7fc5322ab700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c19fdc0 con 0x7fc52c101be0 2024-05-10T03:38:50.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.514+0000 7fc5322ab700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c19ff80 con 0x7fc52c102580 2024-05-10T03:38:50.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.514+0000 7fc52bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc52c100ac0 0x7fc52c068e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:50.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.514+0000 7fc52bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc52c100ac0 0x7fc52c068e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55958/0 (socket says 172.21.15.45:55958) 2024-05-10T03:38:50.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.514+0000 7fc52bfff700 1 -- 172.21.15.45:0/2424548724 learned_addr learned my addr 172.21.15.45:0/2424548724 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:50.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.514+0000 7fc52b7fe700 1 --2- 172.21.15.45:0/2424548724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc52c101be0 0x7fc52c19cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:50.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.515+0000 7fc530848700 1 --2- 172.21.15.45:0/2424548724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc52c102580 0x7fc52c19f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:50.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.515+0000 7fc52bfff700 1 -- 172.21.15.45:0/2424548724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc52c102580 msgr2=0x7fc52c19f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:50.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.515+0000 7fc52bfff700 1 --2- 172.21.15.45:0/2424548724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc52c102580 0x7fc52c19f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.515+0000 7fc52bfff700 1 -- 172.21.15.45:0/2424548724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc52c101be0 msgr2=0x7fc52c19cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:50.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.515+0000 7fc52bfff700 1 --2- 172.21.15.45:0/2424548724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc52c101be0 0x7fc52c19cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.515+0000 7fc52bfff700 1 -- 172.21.15.45:0/2424548724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51c009520 con 0x7fc52c100ac0 2024-05-10T03:38:50.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.515+0000 7fc52b7fe700 1 --2- 172.21.15.45:0/2424548724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc52c101be0 0x7fc52c19cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:38:50.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.515+0000 7fc52bfff700 1 --2- 172.21.15.45:0/2424548724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc52c100ac0 0x7fc52c068e50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc51c00ea10 tx=0x7fc51c00edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:50.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.515+0000 7fc5297fa700 1 -- 172.21.15.45:0/2424548724 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c00cc90 con 0x7fc52c100ac0 2024-05-10T03:38:50.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.515+0000 7fc5297fa700 1 -- 172.21.15.45:0/2424548724 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc51c00cdf0 con 0x7fc52c100ac0 2024-05-10T03:38:50.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.515+0000 7fc5322ab700 1 -- 172.21.15.45:0/2424548724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc524009d00 con 0x7fc52c100ac0 2024-05-10T03:38:50.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.515+0000 7fc5297fa700 1 -- 172.21.15.45:0/2424548724 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c0187a0 con 0x7fc52c100ac0 2024-05-10T03:38:50.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.515+0000 7fc5322ab700 1 -- 172.21.15.45:0/2424548724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52c1a0580 con 0x7fc52c100ac0 2024-05-10T03:38:50.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.516+0000 7fc5322ab700 1 -- 172.21.15.45:0/2424548724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc52c107cd0 con 0x7fc52c100ac0 2024-05-10T03:38:50.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.518+0000 7fc5297fa700 1 -- 172.21.15.45:0/2424548724 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc51c010aa0 con 0x7fc52c100ac0 2024-05-10T03:38:50.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.518+0000 7fc5297fa700 1 --2- 172.21.15.45:0/2424548724 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc5140a1120 0x7fc5140a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:50.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.518+0000 7fc52b7fe700 1 --2- 172.21.15.45:0/2424548724 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc5140a1120 0x7fc5140a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:50.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.518+0000 7fc5297fa700 1 -- 172.21.15.45:0/2424548724 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc51c014070 con 0x7fc52c100ac0 2024-05-10T03:38:50.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.519+0000 7fc52b7fe700 1 --2- 172.21.15.45:0/2424548724 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc5140a1120 0x7fc5140a3630 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc52c0687f0 tx=0x7fc520009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:50.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.522+0000 7fc5297fa700 1 -- 172.21.15.45:0/2424548724 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc51c096830 con 0x7fc52c100ac0 2024-05-10T03:38:50.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.739+0000 7fc5322ab700 1 -- 172.21.15.45:0/2424548724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc52c069470 con 0x7fc52c100ac0 2024-05-10T03:38:50.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.741+0000 7fc5297fa700 1 -- 172.21.15.45:0/2424548724 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+23981 (secure 0 0 0) 0x7fc51c099e50 con 0x7fc52c100ac0 2024-05-10T03:38:50.744 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:38:50.744 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":86,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:38:42.069624+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:38:34.871801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:38:35.935386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T03:38:39.029903+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:38:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.743+0000 7fc5322ab700 1 -- 172.21.15.45:0/2424548724 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc5140a1120 msgr2=0x7fc5140a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.743+0000 7fc5322ab700 1 --2- 172.21.15.45:0/2424548724 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc5140a1120 0x7fc5140a3630 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc52c0687f0 tx=0x7fc520009260 comp rx=0 tx=0).stop 2024-05-10T03:38:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.743+0000 7fc5322ab700 1 -- 172.21.15.45:0/2424548724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc52c100ac0 msgr2=0x7fc52c068e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.743+0000 7fc5322ab700 1 --2- 172.21.15.45:0/2424548724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc52c100ac0 0x7fc52c068e50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc51c00ea10 tx=0x7fc51c00edd0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.743+0000 7fc5322ab700 1 -- 172.21.15.45:0/2424548724 shutdown_connections 2024-05-10T03:38:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.743+0000 7fc5322ab700 1 --2- 172.21.15.45:0/2424548724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc52c102580 0x7fc52c19f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.743+0000 7fc5322ab700 1 --2- 172.21.15.45:0/2424548724 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc5140a1120 0x7fc5140a3630 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.743+0000 7fc5322ab700 1 --2- 172.21.15.45:0/2424548724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc52c100ac0 0x7fc52c068e50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.743+0000 7fc5322ab700 1 --2- 172.21.15.45:0/2424548724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc52c101be0 0x7fc52c19cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.743+0000 7fc5322ab700 1 -- 172.21.15.45:0/2424548724 >> 172.21.15.45:0/2424548724 conn(0x7fc52c0fc0d0 msgr2=0x7fc52c104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:50.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.743+0000 7fc5322ab700 1 -- 172.21.15.45:0/2424548724 shutdown_connections 2024-05-10T03:38:50.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.743+0000 7fc5322ab700 1 -- 172.21.15.45:0/2424548724 wait complete. 2024-05-10T03:38:50.760 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T03:35:20.339400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T03:38:34.871801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T03:38:35.935386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-10T03:38:39.029903+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-10T03:38:50.761 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T03:38:50.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.909+0000 7f67c39f0700 1 -- 172.21.15.45:0/1309476775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67bc102580 msgr2=0x7f67bc108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:50.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.909+0000 7f67c39f0700 1 --2- 172.21.15.45:0/1309476775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67bc102580 0x7f67bc108e30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f67b400b0a0 tx=0x7f67b400b3b0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.910+0000 7f67c39f0700 1 -- 172.21.15.45:0/1309476775 shutdown_connections 2024-05-10T03:38:50.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.910+0000 7f67c39f0700 1 --2- 172.21.15.45:0/1309476775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67bc102580 0x7f67bc108e30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.910+0000 7f67c39f0700 1 --2- 172.21.15.45:0/1309476775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67bc100ac0 0x7f67bc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.910+0000 7f67c39f0700 1 --2- 172.21.15.45:0/1309476775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67bc101be0 0x7f67bc101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.910+0000 7f67c39f0700 1 -- 172.21.15.45:0/1309476775 >> 172.21.15.45:0/1309476775 conn(0x7f67bc0fc0d0 msgr2=0x7f67bc0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:50.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.910+0000 7f67c39f0700 1 -- 172.21.15.45:0/1309476775 shutdown_connections 2024-05-10T03:38:50.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.910+0000 7f67c39f0700 1 -- 172.21.15.45:0/1309476775 wait complete. 2024-05-10T03:38:50.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.910+0000 7f67c39f0700 1 Processor -- start 2024-05-10T03:38:50.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.910+0000 7f67c39f0700 1 -- start start 2024-05-10T03:38:50.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.911+0000 7f67c39f0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67bc100ac0 0x7f67bc198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:50.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.911+0000 7f67c39f0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67bc101be0 0x7f67bc1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:50.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.911+0000 7f67c39f0700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67bc102580 0x7f67bc19f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:50.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.911+0000 7f67c39f0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc19fb50 con 0x7f67bc101be0 2024-05-10T03:38:50.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.911+0000 7f67c39f0700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc19fcc0 con 0x7f67bc102580 2024-05-10T03:38:50.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.911+0000 7f67c39f0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc19fe80 con 0x7f67bc100ac0 2024-05-10T03:38:50.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.911+0000 7f67c0f8b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67bc101be0 0x7f67bc1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:50.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.911+0000 7f67c0f8b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67bc101be0 0x7f67bc1985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55976/0 (socket says 172.21.15.45:55976) 2024-05-10T03:38:50.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.911+0000 7f67c0f8b700 1 -- 172.21.15.45:0/4133336539 learned_addr learned my addr 172.21.15.45:0/4133336539 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:50.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.911+0000 7f67c1f8d700 1 --2- 172.21.15.45:0/4133336539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67bc102580 0x7f67bc19f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:50.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.911+0000 7f67c178c700 1 --2- 172.21.15.45:0/4133336539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67bc100ac0 0x7f67bc198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:50.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.911+0000 7f67c0f8b700 1 -- 172.21.15.45:0/4133336539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67bc100ac0 msgr2=0x7f67bc198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:50.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.911+0000 7f67c0f8b700 1 --2- 172.21.15.45:0/4133336539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67bc100ac0 0x7f67bc198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.911+0000 7f67c0f8b700 1 -- 172.21.15.45:0/4133336539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67bc102580 msgr2=0x7f67bc19f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:50.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.911+0000 7f67c0f8b700 1 --2- 172.21.15.45:0/4133336539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67bc102580 0x7f67bc19f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:50.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.911+0000 7f67c0f8b700 1 -- 172.21.15.45:0/4133336539 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b4009d00 con 0x7f67bc101be0 2024-05-10T03:38:50.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.911+0000 7f67c0f8b700 1 --2- 172.21.15.45:0/4133336539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67bc101be0 0x7f67bc1985b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f67b000e9a0 tx=0x7f67b000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:50.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.912+0000 7f67ae7fc700 1 -- 172.21.15.45:0/4133336539 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b0009790 con 0x7f67bc101be0 2024-05-10T03:38:50.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.912+0000 7f67ae7fc700 1 -- 172.21.15.45:0/4133336539 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f67b000cbd0 con 0x7f67bc101be0 2024-05-10T03:38:50.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.912+0000 7f67c39f0700 1 -- 172.21.15.45:0/4133336539 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67bc1a0160 con 0x7f67bc101be0 2024-05-10T03:38:50.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.912+0000 7f67ae7fc700 1 -- 172.21.15.45:0/4133336539 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b0018680 con 0x7f67bc101be0 2024-05-10T03:38:50.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.912+0000 7f67c39f0700 1 -- 172.21.15.45:0/4133336539 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67bc1a06c0 con 0x7f67bc101be0 2024-05-10T03:38:50.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.913+0000 7f67c39f0700 1 -- 172.21.15.45:0/4133336539 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67bc0694d0 con 0x7f67bc101be0 2024-05-10T03:38:50.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.915+0000 7f67ae7fc700 1 -- 172.21.15.45:0/4133336539 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f67b00188a0 con 0x7f67bc101be0 2024-05-10T03:38:50.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.915+0000 7f67ae7fc700 1 --2- 172.21.15.45:0/4133336539 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f67a80a1240 0x7f67a80a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:50.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.916+0000 7f67ae7fc700 1 -- 172.21.15.45:0/4133336539 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f67b0014070 con 0x7f67bc101be0 2024-05-10T03:38:50.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.916+0000 7f67c178c700 1 --2- 172.21.15.45:0/4133336539 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f67a80a1240 0x7f67a80a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:50.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.916+0000 7f67c178c700 1 --2- 172.21.15.45:0/4133336539 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f67a80a1240 0x7f67a80a3750 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f67b8005950 tx=0x7f67b80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:50.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:50.919+0000 7f67ae7fc700 1 -- 172.21.15.45:0/4133336539 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f67b0096760 con 0x7f67bc101be0 2024-05-10T03:38:51.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:50 smithi045 ceph-mon[42520]: pgmap v238: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 348 B/s wr, 0 op/s 2024-05-10T03:38:51.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:50 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1751129808' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-10T03:38:51.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:50 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2424548724' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:51.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.152+0000 7f67c39f0700 1 -- 172.21.15.45:0/4133336539 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f67bc1a09e0 con 0x7f67bc101be0 2024-05-10T03:38:51.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.152+0000 7f67ae7fc700 1 -- 172.21.15.45:0/4133336539 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f67b00260a0 con 0x7f67bc101be0 2024-05-10T03:38:51.155 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-05-10T03:38:51.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.154+0000 7f67c39f0700 1 -- 172.21.15.45:0/4133336539 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f67a80a1240 msgr2=0x7f67a80a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:51.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.154+0000 7f67c39f0700 1 --2- 172.21.15.45:0/4133336539 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f67a80a1240 0x7f67a80a3750 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f67b8005950 tx=0x7f67b80058e0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.154+0000 7f67c39f0700 1 -- 172.21.15.45:0/4133336539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67bc101be0 msgr2=0x7f67bc1985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:51.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.154+0000 7f67c39f0700 1 --2- 172.21.15.45:0/4133336539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67bc101be0 0x7f67bc1985b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f67b000e9a0 tx=0x7f67b000ecb0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.155+0000 7f67c39f0700 1 -- 172.21.15.45:0/4133336539 shutdown_connections 2024-05-10T03:38:51.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.155+0000 7f67c39f0700 1 --2- 172.21.15.45:0/4133336539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67bc100ac0 0x7f67bc198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.155+0000 7f67c39f0700 1 --2- 172.21.15.45:0/4133336539 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f67a80a1240 0x7f67a80a3750 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.155+0000 7f67c39f0700 1 --2- 172.21.15.45:0/4133336539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67bc102580 0x7f67bc19f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.155+0000 7f67c39f0700 1 --2- 172.21.15.45:0/4133336539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67bc101be0 0x7f67bc1985b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.155+0000 7f67c39f0700 1 -- 172.21.15.45:0/4133336539 >> 172.21.15.45:0/4133336539 conn(0x7f67bc0fc0d0 msgr2=0x7f67bc0fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:51.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.155+0000 7f67c39f0700 1 -- 172.21.15.45:0/4133336539 shutdown_connections 2024-05-10T03:38:51.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.155+0000 7f67c39f0700 1 -- 172.21.15.45:0/4133336539 wait complete. 2024-05-10T03:38:51.171 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T03:38:51.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:50 smithi154 ceph-mon[46565]: pgmap v238: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 348 B/s wr, 0 op/s 2024-05-10T03:38:51.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:50 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1751129808' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-10T03:38:51.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:50 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2424548724' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:51.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.320+0000 7f1bfbecf700 1 -- 172.21.15.45:0/1879897684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bf41004a0 msgr2=0x7f1bf41008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:51.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.320+0000 7f1bfbecf700 1 --2- 172.21.15.45:0/1879897684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bf41004a0 0x7f1bf41008b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0009990 tx=0x7f1bf0009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.320+0000 7f1bfbecf700 1 -- 172.21.15.45:0/1879897684 shutdown_connections 2024-05-10T03:38:51.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.320+0000 7f1bfbecf700 1 --2- 172.21.15.45:0/1879897684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bf4101740 0x7f1bf4101b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.320+0000 7f1bfbecf700 1 --2- 172.21.15.45:0/1879897684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bf41004a0 0x7f1bf41008b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.320+0000 7f1bfbecf700 1 --2- 172.21.15.45:0/1879897684 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bf4100df0 0x7f1bf4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.320+0000 7f1bfbecf700 1 -- 172.21.15.45:0/1879897684 >> 172.21.15.45:0/1879897684 conn(0x7f1bf40fc0d0 msgr2=0x7f1bf40fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:51.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.321+0000 7f1bfbecf700 1 -- 172.21.15.45:0/1879897684 shutdown_connections 2024-05-10T03:38:51.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.321+0000 7f1bfbecf700 1 -- 172.21.15.45:0/1879897684 wait complete. 2024-05-10T03:38:51.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.321+0000 7f1bfbecf700 1 Processor -- start 2024-05-10T03:38:51.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.321+0000 7f1bfbecf700 1 -- start start 2024-05-10T03:38:51.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.322+0000 7f1bfbecf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bf41004a0 0x7f1bf419a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:51.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.322+0000 7f1bfbecf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bf4100df0 0x7f1bf419a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:51.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.322+0000 7f1bfbecf700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bf4101740 0x7f1bf41a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:51.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.322+0000 7f1bfbecf700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf41a1c70 con 0x7f1bf41004a0 2024-05-10T03:38:51.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.322+0000 7f1bfbecf700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf41a1de0 con 0x7f1bf4101740 2024-05-10T03:38:51.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.322+0000 7f1bfbecf700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf41a1fa0 con 0x7f1bf4100df0 2024-05-10T03:38:51.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.322+0000 7f1bf9c6b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bf41004a0 0x7f1bf419a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:51.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.322+0000 7f1bf9c6b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bf41004a0 0x7f1bf419a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56002/0 (socket says 172.21.15.45:56002) 2024-05-10T03:38:51.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.322+0000 7f1bf9c6b700 1 -- 172.21.15.45:0/1934578298 learned_addr learned my addr 172.21.15.45:0/1934578298 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:51.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.322+0000 7f1bfa46c700 1 --2- 172.21.15.45:0/1934578298 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bf4101740 0x7f1bf41a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:51.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.322+0000 7f1bf946a700 1 --2- 172.21.15.45:0/1934578298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bf4100df0 0x7f1bf419a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:51.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.322+0000 7f1bf9c6b700 1 -- 172.21.15.45:0/1934578298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bf4100df0 msgr2=0x7f1bf419a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:51.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.322+0000 7f1bf9c6b700 1 --2- 172.21.15.45:0/1934578298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bf4100df0 0x7f1bf419a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.322+0000 7f1bf9c6b700 1 -- 172.21.15.45:0/1934578298 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bf4101740 msgr2=0x7f1bf41a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:51.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.322+0000 7f1bf9c6b700 1 --2- 172.21.15.45:0/1934578298 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bf4101740 0x7f1bf41a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.322+0000 7f1bf9c6b700 1 -- 172.21.15.45:0/1934578298 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf00095f0 con 0x7f1bf41004a0 2024-05-10T03:38:51.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.322+0000 7f1bf946a700 1 --2- 172.21.15.45:0/1934578298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bf4100df0 0x7f1bf419a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:38:51.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.322+0000 7f1bf9c6b700 1 --2- 172.21.15.45:0/1934578298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bf41004a0 0x7f1bf419a190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00098e0 tx=0x7f1bf000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:51.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.323+0000 7f1beaffd700 1 -- 172.21.15.45:0/1934578298 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf001d070 con 0x7f1bf41004a0 2024-05-10T03:38:51.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.323+0000 7f1beaffd700 1 -- 172.21.15.45:0/1934578298 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1bf000fe60 con 0x7f1bf41004a0 2024-05-10T03:38:51.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.323+0000 7f1bfbecf700 1 -- 172.21.15.45:0/1934578298 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf41a2220 con 0x7f1bf41004a0 2024-05-10T03:38:51.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.323+0000 7f1beaffd700 1 -- 172.21.15.45:0/1934578298 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf00173f0 con 0x7f1bf41004a0 2024-05-10T03:38:51.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.323+0000 7f1bfbecf700 1 -- 172.21.15.45:0/1934578298 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf41a26a0 con 0x7f1bf41004a0 2024-05-10T03:38:51.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.324+0000 7f1bfbecf700 1 -- 172.21.15.45:0/1934578298 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bf410b990 con 0x7f1bf41004a0 2024-05-10T03:38:51.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.325+0000 7f1beaffd700 1 -- 172.21.15.45:0/1934578298 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1bf0021410 con 0x7f1bf41004a0 2024-05-10T03:38:51.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.326+0000 7f1beaffd700 1 --2- 172.21.15.45:0/1934578298 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1be00a1240 0x7f1be00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:51.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.326+0000 7f1beaffd700 1 -- 172.21.15.45:0/1934578298 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f1bf00ce020 con 0x7f1bf41004a0 2024-05-10T03:38:51.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.326+0000 7f1bf946a700 1 --2- 172.21.15.45:0/1934578298 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1be00a1240 0x7f1be00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:51.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.326+0000 7f1bf946a700 1 --2- 172.21.15.45:0/1934578298 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1be00a1240 0x7f1be00a3750 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1bf419b230 tx=0x7f1be4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:51.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.329+0000 7f1beaffd700 1 -- 172.21.15.45:0/1934578298 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1bf0097650 con 0x7f1bf41004a0 2024-05-10T03:38:51.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:50 smithi106 ceph-mon[46996]: pgmap v238: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 348 B/s wr, 0 op/s 2024-05-10T03:38:51.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:50 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1751129808' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-10T03:38:51.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:50 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2424548724' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:51.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.549+0000 7f1bfbecf700 1 -- 172.21.15.45:0/1934578298 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1bf410f700 con 0x7f1bf41004a0 2024-05-10T03:38:51.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.549+0000 7f1beaffd700 1 -- 172.21.15.45:0/1934578298 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1bf009ac70 con 0x7f1bf41004a0 2024-05-10T03:38:51.552 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-05-10T03:38:51.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.551+0000 7f1bfbecf700 1 -- 172.21.15.45:0/1934578298 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1be00a1240 msgr2=0x7f1be00a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:51.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.551+0000 7f1bfbecf700 1 --2- 172.21.15.45:0/1934578298 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1be00a1240 0x7f1be00a3750 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1bf419b230 tx=0x7f1be4009260 comp rx=0 tx=0).stop 2024-05-10T03:38:51.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.551+0000 7f1bfbecf700 1 -- 172.21.15.45:0/1934578298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bf41004a0 msgr2=0x7f1bf419a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:51.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.551+0000 7f1bfbecf700 1 --2- 172.21.15.45:0/1934578298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bf41004a0 0x7f1bf419a190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00098e0 tx=0x7f1bf000f690 comp rx=0 tx=0).stop 2024-05-10T03:38:51.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.551+0000 7f1bfbecf700 1 -- 172.21.15.45:0/1934578298 shutdown_connections 2024-05-10T03:38:51.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.551+0000 7f1bfbecf700 1 --2- 172.21.15.45:0/1934578298 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1be00a1240 0x7f1be00a3750 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.551+0000 7f1bfbecf700 1 --2- 172.21.15.45:0/1934578298 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bf4101740 0x7f1bf41a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.551+0000 7f1bfbecf700 1 --2- 172.21.15.45:0/1934578298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bf41004a0 0x7f1bf419a190 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.551+0000 7f1bfbecf700 1 --2- 172.21.15.45:0/1934578298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bf4100df0 0x7f1bf419a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.551+0000 7f1bfbecf700 1 -- 172.21.15.45:0/1934578298 >> 172.21.15.45:0/1934578298 conn(0x7f1bf40fc0d0 msgr2=0x7f1bf4108ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:51.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.552+0000 7f1bfbecf700 1 -- 172.21.15.45:0/1934578298 shutdown_connections 2024-05-10T03:38:51.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.552+0000 7f1bfbecf700 1 -- 172.21.15.45:0/1934578298 wait complete. 2024-05-10T03:38:51.568 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T03:38:51.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.718+0000 7f56d2e9c700 1 -- 172.21.15.45:0/754945784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56cc069090 msgr2=0x7f56cc104720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:51.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.718+0000 7f56d2e9c700 1 --2- 172.21.15.45:0/754945784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56cc069090 0x7f56cc104720 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009990 tx=0x7f56c8009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.718+0000 7f56d2e9c700 1 -- 172.21.15.45:0/754945784 shutdown_connections 2024-05-10T03:38:51.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.718+0000 7f56d2e9c700 1 --2- 172.21.15.45:0/754945784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56cc107880 0x7f56cc109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.718+0000 7f56d2e9c700 1 --2- 172.21.15.45:0/754945784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56cc069090 0x7f56cc104720 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.718+0000 7f56d2e9c700 1 --2- 172.21.15.45:0/754945784 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56cc104d10 0x7f56cc1071f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.718+0000 7f56d2e9c700 1 -- 172.21.15.45:0/754945784 >> 172.21.15.45:0/754945784 conn(0x7f56cc0fc0d0 msgr2=0x7f56cc0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:51.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.718+0000 7f56d2e9c700 1 -- 172.21.15.45:0/754945784 shutdown_connections 2024-05-10T03:38:51.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.718+0000 7f56d2e9c700 1 -- 172.21.15.45:0/754945784 wait complete. 2024-05-10T03:38:51.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.719+0000 7f56d2e9c700 1 Processor -- start 2024-05-10T03:38:51.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.719+0000 7f56d2e9c700 1 -- start start 2024-05-10T03:38:51.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.719+0000 7f56d2e9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56cc069090 0x7f56cc197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:51.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.719+0000 7f56d2e9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56cc104d10 0x7f56cc198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:51.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.719+0000 7f56d2e9c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56cc107880 0x7f56cc19f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:51.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.719+0000 7f56d2e9c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc19faa0 con 0x7f56cc104d10 2024-05-10T03:38:51.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.719+0000 7f56d2e9c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc19fc10 con 0x7f56cc107880 2024-05-10T03:38:51.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.719+0000 7f56d2e9c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc19fdd0 con 0x7f56cc069090 2024-05-10T03:38:51.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.719+0000 7f56c3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56cc104d10 0x7f56cc198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:51.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.719+0000 7f56c3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56cc104d10 0x7f56cc198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56014/0 (socket says 172.21.15.45:56014) 2024-05-10T03:38:51.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.719+0000 7f56c3fff700 1 -- 172.21.15.45:0/17767344 learned_addr learned my addr 172.21.15.45:0/17767344 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:51.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.719+0000 7f56d1439700 1 --2- 172.21.15.45:0/17767344 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56cc107880 0x7f56cc19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:51.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.719+0000 7f56d0c38700 1 --2- 172.21.15.45:0/17767344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56cc069090 0x7f56cc197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:51.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.719+0000 7f56c3fff700 1 -- 172.21.15.45:0/17767344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56cc069090 msgr2=0x7f56cc197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:51.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.719+0000 7f56c3fff700 1 --2- 172.21.15.45:0/17767344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56cc069090 0x7f56cc197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.719+0000 7f56c3fff700 1 -- 172.21.15.45:0/17767344 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56cc107880 msgr2=0x7f56cc19f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:51.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.719+0000 7f56c3fff700 1 --2- 172.21.15.45:0/17767344 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56cc107880 0x7f56cc19f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.720+0000 7f56c3fff700 1 -- 172.21.15.45:0/17767344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c80095f0 con 0x7f56cc104d10 2024-05-10T03:38:51.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.720+0000 7f56d0c38700 1 --2- 172.21.15.45:0/17767344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56cc069090 0x7f56cc197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:38:51.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.720+0000 7f56c3fff700 1 --2- 172.21.15.45:0/17767344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56cc104d10 0x7f56cc198500 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f56bc00e9a0 tx=0x7f56bc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:51.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.720+0000 7f56c1ffb700 1 -- 172.21.15.45:0/17767344 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc009790 con 0x7f56cc104d10 2024-05-10T03:38:51.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.720+0000 7f56c1ffb700 1 -- 172.21.15.45:0/17767344 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f56bc00cbd0 con 0x7f56cc104d10 2024-05-10T03:38:51.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.720+0000 7f56d2e9c700 1 -- 172.21.15.45:0/17767344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56cc1a00b0 con 0x7f56cc104d10 2024-05-10T03:38:51.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.720+0000 7f56c1ffb700 1 -- 172.21.15.45:0/17767344 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc018680 con 0x7f56cc104d10 2024-05-10T03:38:51.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.720+0000 7f56d2e9c700 1 -- 172.21.15.45:0/17767344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56cc1a0610 con 0x7f56cc104d10 2024-05-10T03:38:51.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.721+0000 7f56d2e9c700 1 -- 172.21.15.45:0/17767344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56cc0fdc80 con 0x7f56cc104d10 2024-05-10T03:38:51.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.723+0000 7f56c1ffb700 1 -- 172.21.15.45:0/17767344 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f56bc0188a0 con 0x7f56cc104d10 2024-05-10T03:38:51.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.723+0000 7f56c1ffb700 1 --2- 172.21.15.45:0/17767344 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f56b40a1240 0x7f56b40a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:51.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.724+0000 7f56c1ffb700 1 -- 172.21.15.45:0/17767344 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f56bc014070 con 0x7f56cc104d10 2024-05-10T03:38:51.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.724+0000 7f56d0c38700 1 --2- 172.21.15.45:0/17767344 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f56b40a1240 0x7f56b40a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:51.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.724+0000 7f56d0c38700 1 --2- 172.21.15.45:0/17767344 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f56b40a1240 0x7f56b40a3750 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f56c800b8b0 tx=0x7f56c801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:51.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.727+0000 7f56c1ffb700 1 -- 172.21.15.45:0/17767344 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f56bc096760 con 0x7f56cc104d10 2024-05-10T03:38:51.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.945+0000 7f56d2e9c700 1 -- 172.21.15.45:0/17767344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f56cc10d700 con 0x7f56cc104d10 2024-05-10T03:38:51.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.945+0000 7f56c1ffb700 1 -- 172.21.15.45:0/17767344 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56bc0260a0 con 0x7f56cc104d10 2024-05-10T03:38:51.948 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2024-05-10T03:38:51.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.948+0000 7f56d2e9c700 1 -- 172.21.15.45:0/17767344 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f56b40a1240 msgr2=0x7f56b40a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:51.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.948+0000 7f56d2e9c700 1 --2- 172.21.15.45:0/17767344 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f56b40a1240 0x7f56b40a3750 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f56c800b8b0 tx=0x7f56c801a040 comp rx=0 tx=0).stop 2024-05-10T03:38:51.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.948+0000 7f56d2e9c700 1 -- 172.21.15.45:0/17767344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56cc104d10 msgr2=0x7f56cc198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:51.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.948+0000 7f56d2e9c700 1 --2- 172.21.15.45:0/17767344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56cc104d10 0x7f56cc198500 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f56bc00e9a0 tx=0x7f56bc00ecb0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.948+0000 7f56d2e9c700 1 -- 172.21.15.45:0/17767344 shutdown_connections 2024-05-10T03:38:51.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.948+0000 7f56d2e9c700 1 --2- 172.21.15.45:0/17767344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56cc069090 0x7f56cc197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.948+0000 7f56d2e9c700 1 --2- 172.21.15.45:0/17767344 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f56b40a1240 0x7f56b40a3750 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.948+0000 7f56d2e9c700 1 --2- 172.21.15.45:0/17767344 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56cc107880 0x7f56cc19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.948+0000 7f56d2e9c700 1 --2- 172.21.15.45:0/17767344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56cc104d10 0x7f56cc198500 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:51.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.948+0000 7f56d2e9c700 1 -- 172.21.15.45:0/17767344 >> 172.21.15.45:0/17767344 conn(0x7f56cc0fc0d0 msgr2=0x7f56cc102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:51.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.948+0000 7f56d2e9c700 1 -- 172.21.15.45:0/17767344 shutdown_connections 2024-05-10T03:38:51.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:51.948+0000 7f56d2e9c700 1 -- 172.21.15.45:0/17767344 wait complete. 2024-05-10T03:38:51.965 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-10T03:38:52.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.116+0000 7f42294c1700 1 -- 172.21.15.45:0/290162614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4224102d20 msgr2=0x7f4224103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:52.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.116+0000 7f42294c1700 1 --2- 172.21.15.45:0/290162614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4224102d20 0x7f4224103130 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f420c009990 tx=0x7f420c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:52.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.116+0000 7f42294c1700 1 -- 172.21.15.45:0/290162614 shutdown_connections 2024-05-10T03:38:52.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.116+0000 7f42294c1700 1 --2- 172.21.15.45:0/290162614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42241036c0 0x7f4224109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:52.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.116+0000 7f42294c1700 1 --2- 172.21.15.45:0/290162614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4224101c00 0x7f4224102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:52.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.116+0000 7f42294c1700 1 --2- 172.21.15.45:0/290162614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4224102d20 0x7f4224103130 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:52.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.116+0000 7f42294c1700 1 -- 172.21.15.45:0/290162614 >> 172.21.15.45:0/290162614 conn(0x7f42240fd210 msgr2=0x7f42240ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:52.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.116+0000 7f42294c1700 1 -- 172.21.15.45:0/290162614 shutdown_connections 2024-05-10T03:38:52.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.116+0000 7f42294c1700 1 -- 172.21.15.45:0/290162614 wait complete. 2024-05-10T03:38:52.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.117+0000 7f42294c1700 1 Processor -- start 2024-05-10T03:38:52.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.117+0000 7f42294c1700 1 -- start start 2024-05-10T03:38:52.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.117+0000 7f42294c1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4224101c00 0x7f4224075fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:52.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.117+0000 7f42294c1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4224102d20 0x7f4224074670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:52.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.117+0000 7f42294c1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42241036c0 0x7f4224074bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:52.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.117+0000 7f42294c1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4224075290 con 0x7f4224102d20 2024-05-10T03:38:52.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.117+0000 7f42294c1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4224075400 con 0x7f4224101c00 2024-05-10T03:38:52.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.117+0000 7f42294c1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42241a2040 con 0x7f42241036c0 2024-05-10T03:38:52.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.117+0000 7f42227fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4224102d20 0x7f4224074670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:52.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.117+0000 7f42227fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4224102d20 0x7f4224074670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56036/0 (socket says 172.21.15.45:56036) 2024-05-10T03:38:52.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.117+0000 7f42227fc700 1 -- 172.21.15.45:0/4046653426 learned_addr learned my addr 172.21.15.45:0/4046653426 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:52.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.117+0000 7f4222ffd700 1 --2- 172.21.15.45:0/4046653426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4224101c00 0x7f4224075fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:52.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.118+0000 7f42237fe700 1 --2- 172.21.15.45:0/4046653426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42241036c0 0x7f4224074bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:52.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.118+0000 7f42227fc700 1 -- 172.21.15.45:0/4046653426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42241036c0 msgr2=0x7f4224074bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:52.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.118+0000 7f42227fc700 1 --2- 172.21.15.45:0/4046653426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42241036c0 0x7f4224074bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:52.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.118+0000 7f42227fc700 1 -- 172.21.15.45:0/4046653426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4224101c00 msgr2=0x7f4224075fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:52.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.118+0000 7f42227fc700 1 --2- 172.21.15.45:0/4046653426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4224101c00 0x7f4224075fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:52.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.118+0000 7f42227fc700 1 -- 172.21.15.45:0/4046653426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c0095f0 con 0x7f4224102d20 2024-05-10T03:38:52.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.118+0000 7f42237fe700 1 --2- 172.21.15.45:0/4046653426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42241036c0 0x7f4224074bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:38:52.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.118+0000 7f4222ffd700 1 --2- 172.21.15.45:0/4046653426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4224101c00 0x7f4224075fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:38:52.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.118+0000 7f42227fc700 1 --2- 172.21.15.45:0/4046653426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4224102d20 0x7f4224074670 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f420c0098e0 tx=0x7f420c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:52.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.118+0000 7f421bfff700 1 -- 172.21.15.45:0/4046653426 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c01d070 con 0x7f4224102d20 2024-05-10T03:38:52.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.118+0000 7f421bfff700 1 -- 172.21.15.45:0/4046653426 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f420c00fe60 con 0x7f4224102d20 2024-05-10T03:38:52.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.118+0000 7f421bfff700 1 -- 172.21.15.45:0/4046653426 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c017650 con 0x7f4224102d20 2024-05-10T03:38:52.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.118+0000 7f42294c1700 1 -- 172.21.15.45:0/4046653426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42241a2240 con 0x7f4224102d20 2024-05-10T03:38:52.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.118+0000 7f42294c1700 1 -- 172.21.15.45:0/4046653426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42241a2660 con 0x7f4224102d20 2024-05-10T03:38:52.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.119+0000 7f42294c1700 1 -- 172.21.15.45:0/4046653426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4224108e10 con 0x7f4224102d20 2024-05-10T03:38:52.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.121+0000 7f421bfff700 1 -- 172.21.15.45:0/4046653426 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f420c021410 con 0x7f4224102d20 2024-05-10T03:38:52.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.122+0000 7f421bfff700 1 --2- 172.21.15.45:0/4046653426 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f42100a1240 0x7f42100a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:52.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.122+0000 7f4222ffd700 1 --2- 172.21.15.45:0/4046653426 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f42100a1240 0x7f42100a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:52.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.122+0000 7f421bfff700 1 -- 172.21.15.45:0/4046653426 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f420c0ce4e0 con 0x7f4224102d20 2024-05-10T03:38:52.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.123+0000 7f4222ffd700 1 --2- 172.21.15.45:0/4046653426 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f42100a1240 0x7f42100a3750 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4224102c20 tx=0x7f4214009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:52.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.126+0000 7f421bfff700 1 -- 172.21.15.45:0/4046653426 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f420c097b10 con 0x7f4224102d20 2024-05-10T03:38:52.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:51 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/4133336539' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:38:52.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:51 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1934578298' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:38:52.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:51 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/4133336539' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:38:52.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:51 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1934578298' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:38:52.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.342+0000 7f42294c1700 1 -- 172.21.15.45:0/4046653426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f422410d540 con 0x7f4224102d20 2024-05-10T03:38:52.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.343+0000 7f421bfff700 1 -- 172.21.15.45:0/4046653426 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v86) v1 ==== 103+0+11 (secure 0 0 0) 0x7f420c09b130 con 0x7f4224102d20 2024-05-10T03:38:52.345 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-05-10T03:38:52.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.345+0000 7f42294c1700 1 -- 172.21.15.45:0/4046653426 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f42100a1240 msgr2=0x7f42100a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:52.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.345+0000 7f42294c1700 1 --2- 172.21.15.45:0/4046653426 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f42100a1240 0x7f42100a3750 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4224102c20 tx=0x7f4214009260 comp rx=0 tx=0).stop 2024-05-10T03:38:52.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.345+0000 7f42294c1700 1 -- 172.21.15.45:0/4046653426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4224102d20 msgr2=0x7f4224074670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:52.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.345+0000 7f42294c1700 1 --2- 172.21.15.45:0/4046653426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4224102d20 0x7f4224074670 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f420c0098e0 tx=0x7f420c00f690 comp rx=0 tx=0).stop 2024-05-10T03:38:52.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.345+0000 7f42294c1700 1 -- 172.21.15.45:0/4046653426 shutdown_connections 2024-05-10T03:38:52.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.345+0000 7f42294c1700 1 --2- 172.21.15.45:0/4046653426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42241036c0 0x7f4224074bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:52.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.345+0000 7f42294c1700 1 --2- 172.21.15.45:0/4046653426 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f42100a1240 0x7f42100a3750 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:52.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.345+0000 7f42294c1700 1 --2- 172.21.15.45:0/4046653426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4224101c00 0x7f4224075fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:52.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.345+0000 7f42294c1700 1 --2- 172.21.15.45:0/4046653426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4224102d20 0x7f4224074670 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:52.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.345+0000 7f42294c1700 1 -- 172.21.15.45:0/4046653426 >> 172.21.15.45:0/4046653426 conn(0x7f42240fd210 msgr2=0x7f4224105f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:52.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.346+0000 7f42294c1700 1 -- 172.21.15.45:0/4046653426 shutdown_connections 2024-05-10T03:38:52.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.346+0000 7f42294c1700 1 -- 172.21.15.45:0/4046653426 wait complete. 2024-05-10T03:38:52.362 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T03:38:52.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:51 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/4133336539' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:38:52.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:51 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1934578298' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:38:52.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.510+0000 7f554d9a6700 1 -- 172.21.15.45:0/3688323667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5548100af0 msgr2=0x7f5548100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:52.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.510+0000 7f554d9a6700 1 --2- 172.21.15.45:0/3688323667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5548100af0 0x7f5548100f00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5538009990 tx=0x7f5538009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:52.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.510+0000 7f554d9a6700 1 -- 172.21.15.45:0/3688323667 shutdown_connections 2024-05-10T03:38:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.510+0000 7f554d9a6700 1 --2- 172.21.15.45:0/3688323667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55481025b0 0x7f5548108e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.510+0000 7f554d9a6700 1 --2- 172.21.15.45:0/3688323667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5548100af0 0x7f5548100f00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.510+0000 7f554d9a6700 1 --2- 172.21.15.45:0/3688323667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5548101c10 0x7f5548102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.510+0000 7f554d9a6700 1 -- 172.21.15.45:0/3688323667 >> 172.21.15.45:0/3688323667 conn(0x7f55480fc0e0 msgr2=0x7f55480fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.510+0000 7f554d9a6700 1 -- 172.21.15.45:0/3688323667 shutdown_connections 2024-05-10T03:38:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.510+0000 7f554d9a6700 1 -- 172.21.15.45:0/3688323667 wait complete. 2024-05-10T03:38:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.511+0000 7f554d9a6700 1 Processor -- start 2024-05-10T03:38:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.511+0000 7f554d9a6700 1 -- start start 2024-05-10T03:38:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.511+0000 7f554d9a6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5548100af0 0x7f55481048b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.511+0000 7f554d9a6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5548101c10 0x7f5548102f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.511+0000 7f554d9a6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55481025b0 0x7f5548103490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.511+0000 7f554d9a6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5548103b70 con 0x7f55481025b0 2024-05-10T03:38:52.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.511+0000 7f554d9a6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5548103ce0 con 0x7f5548100af0 2024-05-10T03:38:52.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.511+0000 7f554d9a6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55481a20c0 con 0x7f5548101c10 2024-05-10T03:38:52.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.511+0000 7f55477fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55481025b0 0x7f5548103490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:52.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.511+0000 7f55477fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55481025b0 0x7f5548103490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56052/0 (socket says 172.21.15.45:56052) 2024-05-10T03:38:52.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.511+0000 7f55477fe700 1 -- 172.21.15.45:0/3213248600 learned_addr learned my addr 172.21.15.45:0/3213248600 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:52.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.511+0000 7f5546ffd700 1 --2- 172.21.15.45:0/3213248600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5548100af0 0x7f55481048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:52.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.511+0000 7f55467fc700 1 --2- 172.21.15.45:0/3213248600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5548101c10 0x7f5548102f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:52.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.512+0000 7f55477fe700 1 -- 172.21.15.45:0/3213248600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5548101c10 msgr2=0x7f5548102f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:52.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.512+0000 7f55477fe700 1 --2- 172.21.15.45:0/3213248600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5548101c10 0x7f5548102f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:52.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.512+0000 7f55477fe700 1 -- 172.21.15.45:0/3213248600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5548100af0 msgr2=0x7f55481048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:52.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.512+0000 7f55477fe700 1 --2- 172.21.15.45:0/3213248600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5548100af0 0x7f55481048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:52.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.512+0000 7f55477fe700 1 -- 172.21.15.45:0/3213248600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55380095f0 con 0x7f55481025b0 2024-05-10T03:38:52.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.512+0000 7f55477fe700 1 --2- 172.21.15.45:0/3213248600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55481025b0 0x7f5548103490 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5540007ee0 tx=0x7f554000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:52.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.512+0000 7f554c9a4700 1 -- 172.21.15.45:0/3213248600 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554000dd20 con 0x7f55481025b0 2024-05-10T03:38:52.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.512+0000 7f554c9a4700 1 -- 172.21.15.45:0/3213248600 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f554000f040 con 0x7f55481025b0 2024-05-10T03:38:52.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.512+0000 7f554d9a6700 1 -- 172.21.15.45:0/3213248600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55481a2320 con 0x7f55481025b0 2024-05-10T03:38:52.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.512+0000 7f554c9a4700 1 -- 172.21.15.45:0/3213248600 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5540015400 con 0x7f55481025b0 2024-05-10T03:38:52.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.512+0000 7f554d9a6700 1 -- 172.21.15.45:0/3213248600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55481a27b0 con 0x7f55481025b0 2024-05-10T03:38:52.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.513+0000 7f554d9a6700 1 -- 172.21.15.45:0/3213248600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5548068730 con 0x7f55481025b0 2024-05-10T03:38:52.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.514+0000 7f554c9a4700 1 -- 172.21.15.45:0/3213248600 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5540003a00 con 0x7f55481025b0 2024-05-10T03:38:52.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.515+0000 7f554c9a4700 1 --2- 172.21.15.45:0/3213248600 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f55340a11c0 0x7f55340a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:52.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.516+0000 7f5546ffd700 1 --2- 172.21.15.45:0/3213248600 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f55340a11c0 0x7f55340a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:52.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.516+0000 7f554c9a4700 1 -- 172.21.15.45:0/3213248600 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f55400cca90 con 0x7f55481025b0 2024-05-10T03:38:52.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.516+0000 7f5546ffd700 1 --2- 172.21.15.45:0/3213248600 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f55340a11c0 0x7f55340a36d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f553800b5c0 tx=0x7f553801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:52.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.519+0000 7f554c9a4700 1 -- 172.21.15.45:0/3213248600 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5540096030 con 0x7f55481025b0 2024-05-10T03:38:52.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.758+0000 7f554d9a6700 1 -- 172.21.15.45:0/3213248600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f554810c410 con 0x7f55481025b0 2024-05-10T03:38:52.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.758+0000 7f554c9a4700 1 -- 172.21.15.45:0/3213248600 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v86) v1 ==== 81+0+587 (secure 0 0 0) 0x7f5540099650 con 0x7f55481025b0 2024-05-10T03:38:52.761 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6801/485502847 2024-05-11T03:33:25.801965+0000 2024-05-10T03:38:52.761 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6800/485502847 2024-05-11T03:33:25.801965+0000 2024-05-10T03:38:52.761 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/477110319 2024-05-11T03:33:25.801965+0000 2024-05-10T03:38:52.761 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6800/534860598 2024-05-11T03:33:02.846802+0000 2024-05-10T03:38:52.761 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/2249239510 2024-05-11T03:33:25.801965+0000 2024-05-10T03:38:52.761 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/2903615785 2024-05-11T03:33:02.846802+0000 2024-05-10T03:38:52.762 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6801/534860598 2024-05-11T03:33:02.846802+0000 2024-05-10T03:38:52.762 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/2125492352 2024-05-11T03:33:02.846802+0000 2024-05-10T03:38:52.762 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/3226767328 2024-05-11T03:33:02.846802+0000 2024-05-10T03:38:52.762 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/4077940265 2024-05-11T03:33:25.801965+0000 2024-05-10T03:38:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.761+0000 7f554d9a6700 1 -- 172.21.15.45:0/3213248600 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f55340a11c0 msgr2=0x7f55340a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.761+0000 7f554d9a6700 1 --2- 172.21.15.45:0/3213248600 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f55340a11c0 0x7f55340a36d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f553800b5c0 tx=0x7f553801a040 comp rx=0 tx=0).stop 2024-05-10T03:38:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.761+0000 7f554d9a6700 1 -- 172.21.15.45:0/3213248600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55481025b0 msgr2=0x7f5548103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:52.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.761+0000 7f554d9a6700 1 --2- 172.21.15.45:0/3213248600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55481025b0 0x7f5548103490 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5540007ee0 tx=0x7f554000d3b0 comp rx=0 tx=0).stop 2024-05-10T03:38:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.761+0000 7f554d9a6700 1 -- 172.21.15.45:0/3213248600 shutdown_connections 2024-05-10T03:38:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.761+0000 7f554d9a6700 1 --2- 172.21.15.45:0/3213248600 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f55340a11c0 0x7f55340a36d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.761+0000 7f554d9a6700 1 --2- 172.21.15.45:0/3213248600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55481025b0 0x7f5548103490 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.761+0000 7f554d9a6700 1 --2- 172.21.15.45:0/3213248600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5548100af0 0x7f55481048b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.761+0000 7f554d9a6700 1 --2- 172.21.15.45:0/3213248600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5548101c10 0x7f5548102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.761+0000 7f554d9a6700 1 -- 172.21.15.45:0/3213248600 >> 172.21.15.45:0/3213248600 conn(0x7f55480fc0e0 msgr2=0x7f55480fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.761+0000 7f554d9a6700 1 -- 172.21.15.45:0/3213248600 shutdown_connections 2024-05-10T03:38:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:52.761+0000 7f554d9a6700 1 -- 172.21.15.45:0/3213248600 wait complete. 2024-05-10T03:38:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:listed 10 entries 2024-05-10T03:38:52.777 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2024-05-10T03:38:52.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:38:52.778 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-10T03:38:52.821 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi045.stderr:ceph-fuse[96339]: fuse finished with error 0 and tester_r 0 2024-05-10T03:38:52.823 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T03:38:52.847 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2024-05-10T03:38:52.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:38:52.848 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-10T03:38:52.919 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:38:53.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:52 smithi045 ceph-mon[42520]: pgmap v239: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 307 B/s wr, 0 op/s 2024-05-10T03:38:53.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:52 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/17767344' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:38:53.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:52 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/4046653426' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:38:53.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:52 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3213248600' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-10T03:38:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.114+0000 7f8c324e4700 1 -- 172.21.15.45:0/3270458495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c2c100ac0 msgr2=0x7f8c2c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.114+0000 7f8c324e4700 1 --2- 172.21.15.45:0/3270458495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c2c100ac0 0x7f8c2c100ed0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009990 tx=0x7f8c1c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.114+0000 7f8c324e4700 1 -- 172.21.15.45:0/3270458495 shutdown_connections 2024-05-10T03:38:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.114+0000 7f8c324e4700 1 --2- 172.21.15.45:0/3270458495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c2c102580 0x7f8c2c108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.114+0000 7f8c324e4700 1 --2- 172.21.15.45:0/3270458495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c2c100ac0 0x7f8c2c100ed0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.114+0000 7f8c324e4700 1 --2- 172.21.15.45:0/3270458495 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c2c101be0 0x7f8c2c101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.114+0000 7f8c324e4700 1 -- 172.21.15.45:0/3270458495 >> 172.21.15.45:0/3270458495 conn(0x7f8c2c0fc0d0 msgr2=0x7f8c2c0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.114+0000 7f8c324e4700 1 -- 172.21.15.45:0/3270458495 shutdown_connections 2024-05-10T03:38:53.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.114+0000 7f8c324e4700 1 -- 172.21.15.45:0/3270458495 wait complete. 2024-05-10T03:38:53.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.115+0000 7f8c324e4700 1 Processor -- start 2024-05-10T03:38:53.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.115+0000 7f8c324e4700 1 -- start start 2024-05-10T03:38:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.116+0000 7f8c324e4700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c2c100ac0 0x7f8c2c1980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.116+0000 7f8c324e4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c2c101be0 0x7f8c2c198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.116+0000 7f8c324e4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c2c102580 0x7f8c2c19f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.116+0000 7f8c324e4700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c19fb60 con 0x7f8c2c102580 2024-05-10T03:38:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.116+0000 7f8c324e4700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c19fcd0 con 0x7f8c2c100ac0 2024-05-10T03:38:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.116+0000 7f8c324e4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c19fe90 con 0x7f8c2c101be0 2024-05-10T03:38:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.116+0000 7f8c30a81700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c2c102580 0x7f8c2c19f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.116+0000 7f8c30a81700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c2c102580 0x7f8c2c19f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56074/0 (socket says 172.21.15.45:56074) 2024-05-10T03:38:53.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.116+0000 7f8c30a81700 1 -- 172.21.15.45:0/705980578 learned_addr learned my addr 172.21.15.45:0/705980578 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:53.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.116+0000 7f8c2b7fe700 1 --2- 172.21.15.45:0/705980578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c2c101be0 0x7f8c2c198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:53.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.116+0000 7f8c2bfff700 1 --2- 172.21.15.45:0/705980578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c2c100ac0 0x7f8c2c1980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:53.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.116+0000 7f8c30a81700 1 -- 172.21.15.45:0/705980578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c2c101be0 msgr2=0x7f8c2c198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:53.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.116+0000 7f8c30a81700 1 --2- 172.21.15.45:0/705980578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c2c101be0 0x7f8c2c198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.116+0000 7f8c30a81700 1 -- 172.21.15.45:0/705980578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c2c100ac0 msgr2=0x7f8c2c1980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:53.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.116+0000 7f8c30a81700 1 --2- 172.21.15.45:0/705980578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c2c100ac0 0x7f8c2c1980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.116+0000 7f8c30a81700 1 -- 172.21.15.45:0/705980578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c0095f0 con 0x7f8c2c102580 2024-05-10T03:38:53.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.116+0000 7f8c2bfff700 1 --2- 172.21.15.45:0/705980578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c2c100ac0 0x7f8c2c1980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:38:53.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.116+0000 7f8c30a81700 1 --2- 172.21.15.45:0/705980578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c2c102580 0x7f8c2c19f550 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8c24007ee0 tx=0x7f8c2400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:53.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.117+0000 7f8c297fa700 1 -- 172.21.15.45:0/705980578 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c24017070 con 0x7f8c2c102580 2024-05-10T03:38:53.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.117+0000 7f8c324e4700 1 -- 172.21.15.45:0/705980578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c2c1a0170 con 0x7f8c2c102580 2024-05-10T03:38:53.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.117+0000 7f8c297fa700 1 -- 172.21.15.45:0/705980578 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8c2400f040 con 0x7f8c2c102580 2024-05-10T03:38:53.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.117+0000 7f8c297fa700 1 -- 172.21.15.45:0/705980578 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c24005610 con 0x7f8c2c102580 2024-05-10T03:38:53.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.117+0000 7f8c324e4700 1 -- 172.21.15.45:0/705980578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2c1a0630 con 0x7f8c2c102580 2024-05-10T03:38:53.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.118+0000 7f8c324e4700 1 -- 172.21.15.45:0/705980578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c2c0694d0 con 0x7f8c2c102580 2024-05-10T03:38:53.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.119+0000 7f8c297fa700 1 -- 172.21.15.45:0/705980578 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8c24005790 con 0x7f8c2c102580 2024-05-10T03:38:53.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.120+0000 7f8c297fa700 1 --2- 172.21.15.45:0/705980578 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8c140a1120 0x7f8c140a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.120+0000 7f8c2bfff700 1 --2- 172.21.15.45:0/705980578 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8c140a1120 0x7f8c140a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.120+0000 7f8c297fa700 1 -- 172.21.15.45:0/705980578 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8c240cc1e0 con 0x7f8c2c102580 2024-05-10T03:38:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.120+0000 7f8c2bfff700 1 --2- 172.21.15.45:0/705980578 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8c140a1120 0x7f8c140a3630 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c006010 tx=0x7f8c1c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:53.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.125+0000 7f8c297fa700 1 -- 172.21.15.45:0/705980578 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8c24095720 con 0x7f8c2c102580 2024-05-10T03:38:53.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:52 smithi154 ceph-mon[46565]: pgmap v239: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 307 B/s wr, 0 op/s 2024-05-10T03:38:53.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:52 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/17767344' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:38:53.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:52 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/4046653426' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:38:53.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:52 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3213248600' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-10T03:38:53.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.344+0000 7f8c324e4700 1 -- 172.21.15.45:0/705980578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c2c1a0990 con 0x7f8c2c102580 2024-05-10T03:38:53.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.345+0000 7f8c297fa700 1 -- 172.21.15.45:0/705980578 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+23981 (secure 0 0 0) 0x7f8c24009390 con 0x7f8c2c102580 2024-05-10T03:38:53.348 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:38:53.348 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":86,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:38:42.069624+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:38:34.871801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:38:35.935386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T03:38:39.029903+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:38:53.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.348+0000 7f8c324e4700 1 -- 172.21.15.45:0/705980578 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8c140a1120 msgr2=0x7f8c140a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:53.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.348+0000 7f8c324e4700 1 --2- 172.21.15.45:0/705980578 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8c140a1120 0x7f8c140a3630 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c006010 tx=0x7f8c1c01a040 comp rx=0 tx=0).stop 2024-05-10T03:38:53.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.348+0000 7f8c324e4700 1 -- 172.21.15.45:0/705980578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c2c102580 msgr2=0x7f8c2c19f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:53.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.348+0000 7f8c324e4700 1 --2- 172.21.15.45:0/705980578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c2c102580 0x7f8c2c19f550 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8c24007ee0 tx=0x7f8c2400d3b0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.348+0000 7f8c324e4700 1 -- 172.21.15.45:0/705980578 shutdown_connections 2024-05-10T03:38:53.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.348+0000 7f8c324e4700 1 --2- 172.21.15.45:0/705980578 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8c140a1120 0x7f8c140a3630 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.348+0000 7f8c324e4700 1 --2- 172.21.15.45:0/705980578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c2c102580 0x7f8c2c19f550 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.348+0000 7f8c324e4700 1 --2- 172.21.15.45:0/705980578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c2c100ac0 0x7f8c2c1980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.348+0000 7f8c324e4700 1 --2- 172.21.15.45:0/705980578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c2c101be0 0x7f8c2c198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.348+0000 7f8c324e4700 1 -- 172.21.15.45:0/705980578 >> 172.21.15.45:0/705980578 conn(0x7f8c2c0fc0d0 msgr2=0x7f8c2c0fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:53.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.348+0000 7f8c324e4700 1 -- 172.21.15.45:0/705980578 shutdown_connections 2024-05-10T03:38:53.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.348+0000 7f8c324e4700 1 -- 172.21.15.45:0/705980578 wait complete. 2024-05-10T03:38:53.366 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:38:53.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:52 smithi106 ceph-mon[46996]: pgmap v239: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 307 B/s wr, 0 op/s 2024-05-10T03:38:53.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:52 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/17767344' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:38:53.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:52 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/4046653426' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:38:53.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:52 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3213248600' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-10T03:38:53.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.512+0000 7f3aa4312700 1 -- 172.21.15.45:0/1781625148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a9c104dc0 msgr2=0x7f3a9c1072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:53.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.512+0000 7f3aa4312700 1 --2- 172.21.15.45:0/1781625148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a9c104dc0 0x7f3a9c1072a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3a90009990 tx=0x7f3a90009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.512+0000 7f3aa4312700 1 -- 172.21.15.45:0/1781625148 shutdown_connections 2024-05-10T03:38:53.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.512+0000 7f3aa4312700 1 --2- 172.21.15.45:0/1781625148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a9c06a470 0x7f3a9c1047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.512+0000 7f3aa4312700 1 --2- 172.21.15.45:0/1781625148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a9c107930 0x7f3a9c109e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.512+0000 7f3aa4312700 1 --2- 172.21.15.45:0/1781625148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a9c104dc0 0x7f3a9c1072a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.512+0000 7f3aa4312700 1 -- 172.21.15.45:0/1781625148 >> 172.21.15.45:0/1781625148 conn(0x7f3a9c0fc180 msgr2=0x7f3a9c0fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:53.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.512+0000 7f3aa4312700 1 -- 172.21.15.45:0/1781625148 shutdown_connections 2024-05-10T03:38:53.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.513+0000 7f3aa4312700 1 -- 172.21.15.45:0/1781625148 wait complete. 2024-05-10T03:38:53.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.513+0000 7f3aa4312700 1 Processor -- start 2024-05-10T03:38:53.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.513+0000 7f3aa4312700 1 -- start start 2024-05-10T03:38:53.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.514+0000 7f3aa4312700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a9c06a470 0x7f3a9c198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:53.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.514+0000 7f3aa4312700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a9c104dc0 0x7f3a9c1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:53.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.514+0000 7f3aa4312700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a9c107930 0x7f3a9c19f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:53.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.514+0000 7f3aa4312700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9c19fb60 con 0x7f3a9c107930 2024-05-10T03:38:53.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.514+0000 7f3aa4312700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9c19fcd0 con 0x7f3a9c104dc0 2024-05-10T03:38:53.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.514+0000 7f3aa4312700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9c19fe90 con 0x7f3a9c06a470 2024-05-10T03:38:53.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.514+0000 7f3aa28af700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a9c107930 0x7f3a9c19f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:53.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.514+0000 7f3aa28af700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a9c107930 0x7f3a9c19f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56092/0 (socket says 172.21.15.45:56092) 2024-05-10T03:38:53.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.514+0000 7f3aa28af700 1 -- 172.21.15.45:0/1018128695 learned_addr learned my addr 172.21.15.45:0/1018128695 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:53.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.514+0000 7f3aa20ae700 1 --2- 172.21.15.45:0/1018128695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a9c06a470 0x7f3a9c198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:53.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.514+0000 7f3aa18ad700 1 --2- 172.21.15.45:0/1018128695 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a9c104dc0 0x7f3a9c1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:53.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.514+0000 7f3aa28af700 1 -- 172.21.15.45:0/1018128695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a9c06a470 msgr2=0x7f3a9c198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:53.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.514+0000 7f3aa28af700 1 --2- 172.21.15.45:0/1018128695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a9c06a470 0x7f3a9c198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.514+0000 7f3aa28af700 1 -- 172.21.15.45:0/1018128695 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a9c104dc0 msgr2=0x7f3a9c1985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:53.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.514+0000 7f3aa28af700 1 --2- 172.21.15.45:0/1018128695 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a9c104dc0 0x7f3a9c1985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.514+0000 7f3aa28af700 1 -- 172.21.15.45:0/1018128695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a900095f0 con 0x7f3a9c107930 2024-05-10T03:38:53.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.514+0000 7f3aa20ae700 1 --2- 172.21.15.45:0/1018128695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a9c06a470 0x7f3a9c198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:38:53.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.514+0000 7f3aa18ad700 1 --2- 172.21.15.45:0/1018128695 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a9c104dc0 0x7f3a9c1985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:38:53.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.515+0000 7f3aa28af700 1 --2- 172.21.15.45:0/1018128695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a9c107930 0x7f3a9c19f550 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3a9400ef30 tx=0x7f3a9400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:53.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.515+0000 7f3a8f7fe700 1 -- 172.21.15.45:0/1018128695 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a94018070 con 0x7f3a9c107930 2024-05-10T03:38:53.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.515+0000 7f3aa4312700 1 -- 172.21.15.45:0/1018128695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a9c1a0110 con 0x7f3a9c107930 2024-05-10T03:38:53.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.515+0000 7f3a8f7fe700 1 -- 172.21.15.45:0/1018128695 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3a9400f040 con 0x7f3a9c107930 2024-05-10T03:38:53.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.515+0000 7f3a8f7fe700 1 -- 172.21.15.45:0/1018128695 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a94004020 con 0x7f3a9c107930 2024-05-10T03:38:53.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.515+0000 7f3aa4312700 1 -- 172.21.15.45:0/1018128695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a9c1a0620 con 0x7f3a9c107930 2024-05-10T03:38:53.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.516+0000 7f3aa4312700 1 -- 172.21.15.45:0/1018128695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a9c0fdd30 con 0x7f3a9c107930 2024-05-10T03:38:53.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.518+0000 7f3a8f7fe700 1 -- 172.21.15.45:0/1018128695 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3a9400caa0 con 0x7f3a9c107930 2024-05-10T03:38:53.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.518+0000 7f3a8f7fe700 1 --2- 172.21.15.45:0/1018128695 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3a880a1120 0x7f3a880a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:53.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.518+0000 7f3aa20ae700 1 --2- 172.21.15.45:0/1018128695 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3a880a1120 0x7f3a880a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:53.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.518+0000 7f3a8f7fe700 1 -- 172.21.15.45:0/1018128695 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f3a940cd060 con 0x7f3a9c107930 2024-05-10T03:38:53.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.519+0000 7f3aa20ae700 1 --2- 172.21.15.45:0/1018128695 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3a880a1120 0x7f3a880a3630 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c06a880 tx=0x7f3a98009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:53.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.521+0000 7f3a8f7fe700 1 -- 172.21.15.45:0/1018128695 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3a94096690 con 0x7f3a9c107930 2024-05-10T03:38:53.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.742+0000 7f3aa4312700 1 -- 172.21.15.45:0/1018128695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a9c10d650 con 0x7f3a9c107930 2024-05-10T03:38:53.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.743+0000 7f3a8f7fe700 1 -- 172.21.15.45:0/1018128695 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+23981 (secure 0 0 0) 0x7f3a94099cb0 con 0x7f3a9c107930 2024-05-10T03:38:53.746 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:38:53.747 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":86,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:38:42.069624+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:38:34.871801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:38:35.935386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T03:38:39.029903+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:38:53.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.746+0000 7f3aa4312700 1 -- 172.21.15.45:0/1018128695 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3a880a1120 msgr2=0x7f3a880a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:53.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.746+0000 7f3aa4312700 1 --2- 172.21.15.45:0/1018128695 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3a880a1120 0x7f3a880a3630 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c06a880 tx=0x7f3a98009260 comp rx=0 tx=0).stop 2024-05-10T03:38:53.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.746+0000 7f3aa4312700 1 -- 172.21.15.45:0/1018128695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a9c107930 msgr2=0x7f3a9c19f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:53.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.746+0000 7f3aa4312700 1 --2- 172.21.15.45:0/1018128695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a9c107930 0x7f3a9c19f550 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3a9400ef30 tx=0x7f3a9400c450 comp rx=0 tx=0).stop 2024-05-10T03:38:53.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.746+0000 7f3aa4312700 1 -- 172.21.15.45:0/1018128695 shutdown_connections 2024-05-10T03:38:53.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.746+0000 7f3aa4312700 1 --2- 172.21.15.45:0/1018128695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a9c06a470 0x7f3a9c198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.746+0000 7f3aa4312700 1 --2- 172.21.15.45:0/1018128695 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3a880a1120 0x7f3a880a3630 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.746+0000 7f3aa4312700 1 --2- 172.21.15.45:0/1018128695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a9c107930 0x7f3a9c19f550 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.746+0000 7f3aa4312700 1 --2- 172.21.15.45:0/1018128695 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a9c104dc0 0x7f3a9c1985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.746+0000 7f3aa4312700 1 -- 172.21.15.45:0/1018128695 >> 172.21.15.45:0/1018128695 conn(0x7f3a9c0fc180 msgr2=0x7f3a9c103040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:53.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.746+0000 7f3aa4312700 1 -- 172.21.15.45:0/1018128695 shutdown_connections 2024-05-10T03:38:53.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.746+0000 7f3aa4312700 1 -- 172.21.15.45:0/1018128695 wait complete. 2024-05-10T03:38:53.763 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-10T03:38:53.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.913+0000 7f0bc7c3b700 1 -- 172.21.15.45:0/4047165565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bc0100ac0 msgr2=0x7f0bc0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:53.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.913+0000 7f0bc7c3b700 1 --2- 172.21.15.45:0/4047165565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bc0100ac0 0x7f0bc0100ed0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc009990 tx=0x7f0bbc009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.913+0000 7f0bc7c3b700 1 -- 172.21.15.45:0/4047165565 shutdown_connections 2024-05-10T03:38:53.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.913+0000 7f0bc7c3b700 1 --2- 172.21.15.45:0/4047165565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bc0102580 0x7f0bc0108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.913+0000 7f0bc7c3b700 1 --2- 172.21.15.45:0/4047165565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bc0100ac0 0x7f0bc0100ed0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.913+0000 7f0bc7c3b700 1 --2- 172.21.15.45:0/4047165565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bc0101be0 0x7f0bc0101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.913+0000 7f0bc7c3b700 1 -- 172.21.15.45:0/4047165565 >> 172.21.15.45:0/4047165565 conn(0x7f0bc00fc0d0 msgr2=0x7f0bc00fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:53.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.913+0000 7f0bc7c3b700 1 -- 172.21.15.45:0/4047165565 shutdown_connections 2024-05-10T03:38:53.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.913+0000 7f0bc7c3b700 1 -- 172.21.15.45:0/4047165565 wait complete. 2024-05-10T03:38:53.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.914+0000 7f0bc7c3b700 1 Processor -- start 2024-05-10T03:38:53.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.914+0000 7f0bc7c3b700 1 -- start start 2024-05-10T03:38:53.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.914+0000 7f0bc7c3b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bc0100ac0 0x7f0bc0104880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:53.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.914+0000 7f0bc7c3b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bc0101be0 0x7f0bc0102f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:53.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.914+0000 7f0bc7c3b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bc0102580 0x7f0bc0103460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:53.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.914+0000 7f0bc7c3b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc0103b40 con 0x7f0bc0100ac0 2024-05-10T03:38:53.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.914+0000 7f0bc7c3b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc0103cb0 con 0x7f0bc0101be0 2024-05-10T03:38:53.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.914+0000 7f0bc7c3b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc01a2060 con 0x7f0bc0102580 2024-05-10T03:38:53.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.914+0000 7f0bc59d7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bc0100ac0 0x7f0bc0104880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:53.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.914+0000 7f0bc59d7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bc0100ac0 0x7f0bc0104880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56116/0 (socket says 172.21.15.45:56116) 2024-05-10T03:38:53.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.914+0000 7f0bc59d7700 1 -- 172.21.15.45:0/921767499 learned_addr learned my addr 172.21.15.45:0/921767499 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:53.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.914+0000 7f0bc51d6700 1 --2- 172.21.15.45:0/921767499 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bc0101be0 0x7f0bc0102f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:53.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.915+0000 7f0bc61d8700 1 --2- 172.21.15.45:0/921767499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bc0102580 0x7f0bc0103460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:53.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.915+0000 7f0bc59d7700 1 -- 172.21.15.45:0/921767499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bc0102580 msgr2=0x7f0bc0103460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:53.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.915+0000 7f0bc59d7700 1 --2- 172.21.15.45:0/921767499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bc0102580 0x7f0bc0103460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.915+0000 7f0bc59d7700 1 -- 172.21.15.45:0/921767499 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bc0101be0 msgr2=0x7f0bc0102f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:53.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.915+0000 7f0bc59d7700 1 --2- 172.21.15.45:0/921767499 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bc0101be0 0x7f0bc0102f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:53.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.915+0000 7f0bc59d7700 1 -- 172.21.15.45:0/921767499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc0095f0 con 0x7f0bc0100ac0 2024-05-10T03:38:53.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.915+0000 7f0bc59d7700 1 --2- 172.21.15.45:0/921767499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bc0100ac0 0x7f0bc0104880 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc0098e0 tx=0x7f0bbc005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:53.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.915+0000 7f0bb6ffd700 1 -- 172.21.15.45:0/921767499 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc01d070 con 0x7f0bc0100ac0 2024-05-10T03:38:53.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.915+0000 7f0bc7c3b700 1 -- 172.21.15.45:0/921767499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc01a2260 con 0x7f0bc0100ac0 2024-05-10T03:38:53.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.915+0000 7f0bb6ffd700 1 -- 172.21.15.45:0/921767499 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0bbc00be70 con 0x7f0bc0100ac0 2024-05-10T03:38:53.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.915+0000 7f0bb6ffd700 1 -- 172.21.15.45:0/921767499 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc017650 con 0x7f0bc0100ac0 2024-05-10T03:38:53.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.915+0000 7f0bc7c3b700 1 -- 172.21.15.45:0/921767499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc01a2680 con 0x7f0bc0100ac0 2024-05-10T03:38:53.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.916+0000 7f0bc7c3b700 1 -- 172.21.15.45:0/921767499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc00694d0 con 0x7f0bc0100ac0 2024-05-10T03:38:53.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.918+0000 7f0bb6ffd700 1 -- 172.21.15.45:0/921767499 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0bbc021410 con 0x7f0bc0100ac0 2024-05-10T03:38:53.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.918+0000 7f0bb6ffd700 1 --2- 172.21.15.45:0/921767499 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0bac0a11c0 0x7f0bac0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:53.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.918+0000 7f0bc51d6700 1 --2- 172.21.15.45:0/921767499 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0bac0a11c0 0x7f0bac0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:53.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.918+0000 7f0bb6ffd700 1 -- 172.21.15.45:0/921767499 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f0bbc0cdff0 con 0x7f0bc0100ac0 2024-05-10T03:38:53.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.919+0000 7f0bc51d6700 1 --2- 172.21.15.45:0/921767499 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0bac0a11c0 0x7f0bac0a36d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0104220 tx=0x7f0bb0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:53.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:53.923+0000 7f0bb6ffd700 1 -- 172.21.15.45:0/921767499 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0bbc097620 con 0x7f0bc0100ac0 2024-05-10T03:38:54.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:53 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/705980578' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:54.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:53 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1018128695' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:54.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:54.196+0000 7f0bc7c3b700 1 -- 172.21.15.45:0/921767499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0bc010c3e0 con 0x7f0bc0100ac0 2024-05-10T03:38:54.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:53 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/705980578' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:54.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:53 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1018128695' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:54.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:53 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/705980578' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:54.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:53 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1018128695' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:38:54.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:54.954+0000 7f0bb6ffd700 1 -- 172.21.15.45:0/921767499 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0bbc09ac40 con 0x7f0bc0100ac0 2024-05-10T03:38:54.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:54.957+0000 7f0bc7c3b700 1 -- 172.21.15.45:0/921767499 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0bac0a11c0 msgr2=0x7f0bac0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:54.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:54.957+0000 7f0bc7c3b700 1 --2- 172.21.15.45:0/921767499 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0bac0a11c0 0x7f0bac0a36d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0104220 tx=0x7f0bb0009260 comp rx=0 tx=0).stop 2024-05-10T03:38:54.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:54.957+0000 7f0bc7c3b700 1 -- 172.21.15.45:0/921767499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bc0100ac0 msgr2=0x7f0bc0104880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:54.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:54.957+0000 7f0bc7c3b700 1 --2- 172.21.15.45:0/921767499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bc0100ac0 0x7f0bc0104880 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc0098e0 tx=0x7f0bbc005b00 comp rx=0 tx=0).stop 2024-05-10T03:38:54.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:54.957+0000 7f0bc7c3b700 1 -- 172.21.15.45:0/921767499 shutdown_connections 2024-05-10T03:38:54.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:54.957+0000 7f0bc7c3b700 1 --2- 172.21.15.45:0/921767499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bc0102580 0x7f0bc0103460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:54.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:54.957+0000 7f0bc7c3b700 1 --2- 172.21.15.45:0/921767499 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0bac0a11c0 0x7f0bac0a36d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:54.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:54.957+0000 7f0bc7c3b700 1 --2- 172.21.15.45:0/921767499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bc0100ac0 0x7f0bc0104880 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:54.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:54.957+0000 7f0bc7c3b700 1 --2- 172.21.15.45:0/921767499 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bc0101be0 0x7f0bc0102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:54.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:54.958+0000 7f0bc7c3b700 1 -- 172.21.15.45:0/921767499 >> 172.21.15.45:0/921767499 conn(0x7f0bc00fc0d0 msgr2=0x7f0bc00fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:54.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:54.958+0000 7f0bc7c3b700 1 -- 172.21.15.45:0/921767499 shutdown_connections 2024-05-10T03:38:54.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:54.958+0000 7f0bc7c3b700 1 -- 172.21.15.45:0/921767499 wait complete. 2024-05-10T03:38:54.977 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-05-10T03:38:54.977 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-05-10T03:38:55.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.131+0000 7fce692e1700 1 -- 172.21.15.45:0/4228363312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce64105040 msgr2=0x7fce64107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:55.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.132+0000 7fce692e1700 1 --2- 172.21.15.45:0/4228363312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce64105040 0x7fce64107460 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fce4c009990 tx=0x7fce4c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:55.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.132+0000 7fce692e1700 1 -- 172.21.15.45:0/4228363312 shutdown_connections 2024-05-10T03:38:55.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.132+0000 7fce692e1700 1 --2- 172.21.15.45:0/4228363312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce640fff60 0x7fce641003b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:55.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.132+0000 7fce692e1700 1 --2- 172.21.15.45:0/4228363312 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce641079a0 0x7fce64109dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:55.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.132+0000 7fce692e1700 1 --2- 172.21.15.45:0/4228363312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce64105040 0x7fce64107460 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:55.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.132+0000 7fce692e1700 1 -- 172.21.15.45:0/4228363312 >> 172.21.15.45:0/4228363312 conn(0x7fce640fb8b0 msgr2=0x7fce640fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:55.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.132+0000 7fce692e1700 1 -- 172.21.15.45:0/4228363312 shutdown_connections 2024-05-10T03:38:55.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.132+0000 7fce692e1700 1 -- 172.21.15.45:0/4228363312 wait complete. 2024-05-10T03:38:55.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.132+0000 7fce692e1700 1 Processor -- start 2024-05-10T03:38:55.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.133+0000 7fce692e1700 1 -- start start 2024-05-10T03:38:55.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.133+0000 7fce692e1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce640fff60 0x7fce64197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:55.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.133+0000 7fce692e1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce64105040 0x7fce64198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:55.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.133+0000 7fce692e1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce641079a0 0x7fce6419f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:55.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.133+0000 7fce692e1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6419fab0 con 0x7fce64105040 2024-05-10T03:38:55.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.133+0000 7fce692e1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6419fc20 con 0x7fce640fff60 2024-05-10T03:38:55.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.133+0000 7fce692e1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6419fde0 con 0x7fce641079a0 2024-05-10T03:38:55.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.133+0000 7fce5a7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce64105040 0x7fce64198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:55.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.133+0000 7fce5a7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce64105040 0x7fce64198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56124/0 (socket says 172.21.15.45:56124) 2024-05-10T03:38:55.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.133+0000 7fce5a7fc700 1 -- 172.21.15.45:0/1356635548 learned_addr learned my addr 172.21.15.45:0/1356635548 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:55.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.133+0000 7fce62ffd700 1 --2- 172.21.15.45:0/1356635548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce640fff60 0x7fce64197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:55.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.133+0000 7fce637fe700 1 --2- 172.21.15.45:0/1356635548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce641079a0 0x7fce6419f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:55.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.133+0000 7fce5a7fc700 1 -- 172.21.15.45:0/1356635548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce641079a0 msgr2=0x7fce6419f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:55.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.133+0000 7fce5a7fc700 1 --2- 172.21.15.45:0/1356635548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce641079a0 0x7fce6419f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:55.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.133+0000 7fce5a7fc700 1 -- 172.21.15.45:0/1356635548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce640fff60 msgr2=0x7fce64197fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:55.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.133+0000 7fce5a7fc700 1 --2- 172.21.15.45:0/1356635548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce640fff60 0x7fce64197fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:55.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.133+0000 7fce5a7fc700 1 -- 172.21.15.45:0/1356635548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c0095f0 con 0x7fce64105040 2024-05-10T03:38:55.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.133+0000 7fce637fe700 1 --2- 172.21.15.45:0/1356635548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce641079a0 0x7fce6419f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:38:55.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.134+0000 7fce5a7fc700 1 --2- 172.21.15.45:0/1356635548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce64105040 0x7fce64198510 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0095c0 tx=0x7fce4c00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:55.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.134+0000 7fce60ff9700 1 -- 172.21.15.45:0/1356635548 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c01d070 con 0x7fce64105040 2024-05-10T03:38:55.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.134+0000 7fce60ff9700 1 -- 172.21.15.45:0/1356635548 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fce4c005500 con 0x7fce64105040 2024-05-10T03:38:55.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.134+0000 7fce692e1700 1 -- 172.21.15.45:0/1356635548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce641a0060 con 0x7fce64105040 2024-05-10T03:38:55.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.134+0000 7fce60ff9700 1 -- 172.21.15.45:0/1356635548 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c004c10 con 0x7fce64105040 2024-05-10T03:38:55.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.134+0000 7fce692e1700 1 -- 172.21.15.45:0/1356635548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce641a0420 con 0x7fce64105040 2024-05-10T03:38:55.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.135+0000 7fce692e1700 1 -- 172.21.15.45:0/1356635548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce640fd460 con 0x7fce64105040 2024-05-10T03:38:55.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.136+0000 7fce60ff9700 1 -- 172.21.15.45:0/1356635548 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fce4c00fc30 con 0x7fce64105040 2024-05-10T03:38:55.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.137+0000 7fce60ff9700 1 --2- 172.21.15.45:0/1356635548 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fce500a11c0 0x7fce500a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:55.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.137+0000 7fce60ff9700 1 -- 172.21.15.45:0/1356635548 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fce4c0cdb90 con 0x7fce64105040 2024-05-10T03:38:55.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.137+0000 7fce62ffd700 1 --2- 172.21.15.45:0/1356635548 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fce500a11c0 0x7fce500a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:55.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.138+0000 7fce62ffd700 1 --2- 172.21.15.45:0/1356635548 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fce500a11c0 0x7fce500a36d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fce5400bbd0 tx=0x7fce5400b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:55.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.141+0000 7fce60ff9700 1 -- 172.21.15.45:0/1356635548 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fce4c0971c0 con 0x7fce64105040 2024-05-10T03:38:55.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:54 smithi154 ceph-mon[46565]: pgmap v240: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 260 B/s wr, 0 op/s 2024-05-10T03:38:55.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:54 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/921767499' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-10T03:38:55.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:54 smithi045 ceph-mon[42520]: pgmap v240: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 260 B/s wr, 0 op/s 2024-05-10T03:38:55.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:54 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/921767499' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-10T03:38:55.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:54 smithi106 ceph-mon[46996]: pgmap v240: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 260 B/s wr, 0 op/s 2024-05-10T03:38:55.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:54 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/921767499' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-10T03:38:55.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.409+0000 7fce692e1700 1 -- 172.21.15.45:0/1356635548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7fce6410d590 con 0x7fce64105040 2024-05-10T03:38:55.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.947+0000 7fce60ff9700 1 -- 172.21.15.45:0/1356635548 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) v1 ==== 105+0+0 (secure 0 0 0) 0x7fce4c016e80 con 0x7fce64105040 2024-05-10T03:38:55.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.951+0000 7fce692e1700 1 -- 172.21.15.45:0/1356635548 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fce500a11c0 msgr2=0x7fce500a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:55.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.951+0000 7fce692e1700 1 --2- 172.21.15.45:0/1356635548 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fce500a11c0 0x7fce500a36d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fce5400bbd0 tx=0x7fce5400b5b0 comp rx=0 tx=0).stop 2024-05-10T03:38:55.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.951+0000 7fce692e1700 1 -- 172.21.15.45:0/1356635548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce64105040 msgr2=0x7fce64198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:55.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.951+0000 7fce692e1700 1 --2- 172.21.15.45:0/1356635548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce64105040 0x7fce64198510 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0095c0 tx=0x7fce4c00f740 comp rx=0 tx=0).stop 2024-05-10T03:38:55.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.951+0000 7fce692e1700 1 -- 172.21.15.45:0/1356635548 shutdown_connections 2024-05-10T03:38:55.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.951+0000 7fce692e1700 1 --2- 172.21.15.45:0/1356635548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce641079a0 0x7fce6419f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:55.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.951+0000 7fce692e1700 1 --2- 172.21.15.45:0/1356635548 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fce500a11c0 0x7fce500a36d0 secure :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fce5400bbd0 tx=0x7fce5400b5b0 comp rx=0 tx=0).stop 2024-05-10T03:38:55.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.951+0000 7fce692e1700 1 --2- 172.21.15.45:0/1356635548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce640fff60 0x7fce64197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:55.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.951+0000 7fce692e1700 1 --2- 172.21.15.45:0/1356635548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce64105040 0x7fce64198510 secure :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0095c0 tx=0x7fce4c00f740 comp rx=0 tx=0).stop 2024-05-10T03:38:55.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.951+0000 7fce692e1700 1 -- 172.21.15.45:0/1356635548 >> 172.21.15.45:0/1356635548 conn(0x7fce640fb8b0 msgr2=0x7fce64105e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:55.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.952+0000 7fce692e1700 1 -- 172.21.15.45:0/1356635548 shutdown_connections 2024-05-10T03:38:55.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:55.953+0000 7fce692e1700 1 -- 172.21.15.45:0/1356635548 wait complete. 2024-05-10T03:38:55.977 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-05-10T03:38:56.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.131+0000 7f81d1f29700 1 -- 172.21.15.45:0/811737005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81cc102630 msgr2=0x7f81cc108ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:56.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.131+0000 7f81d1f29700 1 --2- 172.21.15.45:0/811737005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81cc102630 0x7f81cc108ee0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f81c400b0a0 tx=0x7f81c400b3b0 comp rx=0 tx=0).stop 2024-05-10T03:38:56.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.131+0000 7f81d1f29700 1 -- 172.21.15.45:0/811737005 shutdown_connections 2024-05-10T03:38:56.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.131+0000 7f81d1f29700 1 --2- 172.21.15.45:0/811737005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81cc102630 0x7f81cc108ee0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:56.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.131+0000 7f81d1f29700 1 --2- 172.21.15.45:0/811737005 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81cc100b70 0x7f81cc100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:56.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.131+0000 7f81d1f29700 1 --2- 172.21.15.45:0/811737005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81cc101c90 0x7f81cc1020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:56.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.131+0000 7f81d1f29700 1 -- 172.21.15.45:0/811737005 >> 172.21.15.45:0/811737005 conn(0x7f81cc0fc180 msgr2=0x7f81cc0fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:56.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.131+0000 7f81d1f29700 1 -- 172.21.15.45:0/811737005 shutdown_connections 2024-05-10T03:38:56.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.132+0000 7f81d1f29700 1 -- 172.21.15.45:0/811737005 wait complete. 2024-05-10T03:38:56.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.132+0000 7f81d1f29700 1 Processor -- start 2024-05-10T03:38:56.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.133+0000 7f81d1f29700 1 -- start start 2024-05-10T03:38:56.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.133+0000 7f81d1f29700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81cc100b70 0x7f81cc06a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:56.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.133+0000 7f81d1f29700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81cc101c90 0x7f81cc19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:56.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.133+0000 7f81d1f29700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81cc102630 0x7f81cc19f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:56.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.133+0000 7f81d1f29700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc19fc20 con 0x7f81cc100b70 2024-05-10T03:38:56.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.133+0000 7f81d1f29700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc19fd90 con 0x7f81cc101c90 2024-05-10T03:38:56.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.133+0000 7f81d1f29700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc19ff50 con 0x7f81cc102630 2024-05-10T03:38:56.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.133+0000 7f81cb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81cc100b70 0x7f81cc06a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:56.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.133+0000 7f81cb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81cc100b70 0x7f81cc06a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56134/0 (socket says 172.21.15.45:56134) 2024-05-10T03:38:56.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.133+0000 7f81cb7fe700 1 -- 172.21.15.45:0/1336125223 learned_addr learned my addr 172.21.15.45:0/1336125223 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:56.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.133+0000 7f81caffd700 1 --2- 172.21.15.45:0/1336125223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81cc101c90 0x7f81cc19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:56.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.133+0000 7f81cbfff700 1 --2- 172.21.15.45:0/1336125223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81cc102630 0x7f81cc19f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:56.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.134+0000 7f81cb7fe700 1 -- 172.21.15.45:0/1336125223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81cc102630 msgr2=0x7f81cc19f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:56.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.134+0000 7f81cb7fe700 1 --2- 172.21.15.45:0/1336125223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81cc102630 0x7f81cc19f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:56.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.134+0000 7f81cb7fe700 1 -- 172.21.15.45:0/1336125223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81cc101c90 msgr2=0x7f81cc19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:56.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.134+0000 7f81cb7fe700 1 --2- 172.21.15.45:0/1336125223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81cc101c90 0x7f81cc19ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:56.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.134+0000 7f81cb7fe700 1 -- 172.21.15.45:0/1336125223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c4009d00 con 0x7f81cc100b70 2024-05-10T03:38:56.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.134+0000 7f81cb7fe700 1 --2- 172.21.15.45:0/1336125223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81cc100b70 0x7f81cc06a210 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f81bc00e940 tx=0x7f81bc00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:56.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.134+0000 7f81c8ff9700 1 -- 172.21.15.45:0/1336125223 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc00cbd0 con 0x7f81cc100b70 2024-05-10T03:38:56.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.134+0000 7f81c8ff9700 1 -- 172.21.15.45:0/1336125223 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f81bc00ee90 con 0x7f81cc100b70 2024-05-10T03:38:56.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.134+0000 7f81d1f29700 1 -- 172.21.15.45:0/1336125223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81cc1a01d0 con 0x7f81cc100b70 2024-05-10T03:38:56.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.134+0000 7f81c8ff9700 1 -- 172.21.15.45:0/1336125223 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc003e30 con 0x7f81cc100b70 2024-05-10T03:38:56.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.134+0000 7f81d1f29700 1 -- 172.21.15.45:0/1336125223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81cc1a06e0 con 0x7f81cc100b70 2024-05-10T03:38:56.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.135+0000 7f81d1f29700 1 -- 172.21.15.45:0/1336125223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81cc107d80 con 0x7f81cc100b70 2024-05-10T03:38:56.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.136+0000 7f81c8ff9700 1 -- 172.21.15.45:0/1336125223 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f81bc003f90 con 0x7f81cc100b70 2024-05-10T03:38:56.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.137+0000 7f81c8ff9700 1 --2- 172.21.15.45:0/1336125223 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f81b40a11c0 0x7f81b40a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:56.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.137+0000 7f81c8ff9700 1 -- 172.21.15.45:0/1336125223 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f81bc014070 con 0x7f81cc100b70 2024-05-10T03:38:56.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.137+0000 7f81caffd700 1 --2- 172.21.15.45:0/1336125223 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f81b40a11c0 0x7f81b40a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:56.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.138+0000 7f81caffd700 1 --2- 172.21.15.45:0/1336125223 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f81b40a11c0 0x7f81b40a36d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f81cc069bb0 tx=0x7f81c0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:56.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.141+0000 7f81c8ff9700 1 -- 172.21.15.45:0/1336125223 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f81bc096510 con 0x7f81cc100b70 2024-05-10T03:38:56.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:55 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/921767499' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-10T03:38:56.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:55 smithi154 ceph-mon[46565]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-10T03:38:56.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:55 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1356635548' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-10T03:38:56.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:55 smithi154 ceph-mon[46565]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-10T03:38:56.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:55 smithi154 ceph-mon[46565]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-10T03:38:56.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:55 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1356635548' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-10T03:38:56.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:55 smithi154 ceph-mon[46565]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-05-10T03:38:56.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:55 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/921767499' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-10T03:38:56.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:55 smithi045 ceph-mon[42520]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-10T03:38:56.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:55 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1356635548' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-10T03:38:56.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:55 smithi045 ceph-mon[42520]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-10T03:38:56.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:55 smithi045 ceph-mon[42520]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-10T03:38:56.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:55 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1356635548' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-10T03:38:56.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:55 smithi045 ceph-mon[42520]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-05-10T03:38:56.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:55 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/921767499' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-10T03:38:56.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:55 smithi106 ceph-mon[46996]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-10T03:38:56.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:55 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1356635548' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-10T03:38:56.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:55 smithi106 ceph-mon[46996]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-10T03:38:56.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:55 smithi106 ceph-mon[46996]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-10T03:38:56.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:55 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1356635548' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-10T03:38:56.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:55 smithi106 ceph-mon[46996]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-05-10T03:38:56.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.417+0000 7f81d1f29700 1 -- 172.21.15.45:0/1336125223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f81cc0678b0 con 0x7f81cc100b70 2024-05-10T03:38:56.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.963+0000 7f81c8ff9700 1 -- 172.21.15.45:0/1336125223 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7f81bc099b30 con 0x7f81cc100b70 2024-05-10T03:38:56.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.966+0000 7f81d1f29700 1 -- 172.21.15.45:0/1336125223 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f81b40a11c0 msgr2=0x7f81b40a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:56.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.966+0000 7f81d1f29700 1 --2- 172.21.15.45:0/1336125223 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f81b40a11c0 0x7f81b40a36d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f81cc069bb0 tx=0x7f81c0009260 comp rx=0 tx=0).stop 2024-05-10T03:38:56.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.966+0000 7f81d1f29700 1 -- 172.21.15.45:0/1336125223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81cc100b70 msgr2=0x7f81cc06a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:56.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.966+0000 7f81d1f29700 1 --2- 172.21.15.45:0/1336125223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81cc100b70 0x7f81cc06a210 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f81bc00e940 tx=0x7f81bc00ec50 comp rx=0 tx=0).stop 2024-05-10T03:38:56.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.966+0000 7f81d1f29700 1 -- 172.21.15.45:0/1336125223 shutdown_connections 2024-05-10T03:38:56.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.966+0000 7f81d1f29700 1 --2- 172.21.15.45:0/1336125223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81cc102630 0x7f81cc19f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:56.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.966+0000 7f81d1f29700 1 --2- 172.21.15.45:0/1336125223 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f81b40a11c0 0x7f81b40a36d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:56.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.966+0000 7f81d1f29700 1 --2- 172.21.15.45:0/1336125223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81cc100b70 0x7f81cc06a210 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:56.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.966+0000 7f81d1f29700 1 --2- 172.21.15.45:0/1336125223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81cc101c90 0x7f81cc19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:56.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.966+0000 7f81d1f29700 1 -- 172.21.15.45:0/1336125223 >> 172.21.15.45:0/1336125223 conn(0x7f81cc0fc180 msgr2=0x7f81cc104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:56.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.967+0000 7f81d1f29700 1 -- 172.21.15.45:0/1336125223 shutdown_connections 2024-05-10T03:38:56.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:56.967+0000 7f81d1f29700 1 -- 172.21.15.45:0/1336125223 wait complete. 2024-05-10T03:38:56.990 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-05-10T03:38:57.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.143+0000 7f91b25aa700 1 -- 172.21.15.45:0/1841163219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91ac1036c0 msgr2=0x7f91ac109f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:57.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.143+0000 7f91b25aa700 1 --2- 172.21.15.45:0/1841163219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91ac1036c0 0x7f91ac109f70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f91a400b0a0 tx=0x7f91a400b3b0 comp rx=0 tx=0).stop 2024-05-10T03:38:57.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.143+0000 7f91b25aa700 1 -- 172.21.15.45:0/1841163219 shutdown_connections 2024-05-10T03:38:57.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.143+0000 7f91b25aa700 1 --2- 172.21.15.45:0/1841163219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91ac101c00 0x7f91ac102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:57.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.143+0000 7f91b25aa700 1 --2- 172.21.15.45:0/1841163219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91ac1036c0 0x7f91ac109f70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:57.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.143+0000 7f91b25aa700 1 --2- 172.21.15.45:0/1841163219 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91ac102d20 0x7f91ac103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:57.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.143+0000 7f91b25aa700 1 -- 172.21.15.45:0/1841163219 >> 172.21.15.45:0/1841163219 conn(0x7f91ac0fd210 msgr2=0x7f91ac0ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:57.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.143+0000 7f91b25aa700 1 -- 172.21.15.45:0/1841163219 shutdown_connections 2024-05-10T03:38:57.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.143+0000 7f91b25aa700 1 -- 172.21.15.45:0/1841163219 wait complete. 2024-05-10T03:38:57.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.143+0000 7f91b25aa700 1 Processor -- start 2024-05-10T03:38:57.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.143+0000 7f91b25aa700 1 -- start start 2024-05-10T03:38:57.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.144+0000 7f91b25aa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91ac101c00 0x7f91ac198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:57.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.144+0000 7f91b25aa700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91ac102d20 0x7f91ac198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:57.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.144+0000 7f91b25aa700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91ac1036c0 0x7f91ac19f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:57.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.144+0000 7f91b25aa700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac19fbe0 con 0x7f91ac101c00 2024-05-10T03:38:57.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.144+0000 7f91b25aa700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac19fd50 con 0x7f91ac1036c0 2024-05-10T03:38:57.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.144+0000 7f91b25aa700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac19ff10 con 0x7f91ac102d20 2024-05-10T03:38:57.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.144+0000 7f91abfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91ac101c00 0x7f91ac198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:57.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.144+0000 7f91abfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91ac101c00 0x7f91ac198100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56144/0 (socket says 172.21.15.45:56144) 2024-05-10T03:38:57.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.144+0000 7f91abfff700 1 -- 172.21.15.45:0/2183781003 learned_addr learned my addr 172.21.15.45:0/2183781003 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:57.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.144+0000 7f91ab7fe700 1 --2- 172.21.15.45:0/2183781003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91ac102d20 0x7f91ac198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:57.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.144+0000 7f91b0b47700 1 --2- 172.21.15.45:0/2183781003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91ac1036c0 0x7f91ac19f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:57.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.144+0000 7f91abfff700 1 -- 172.21.15.45:0/2183781003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91ac102d20 msgr2=0x7f91ac198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:57.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.144+0000 7f91abfff700 1 --2- 172.21.15.45:0/2183781003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91ac102d20 0x7f91ac198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:57.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.144+0000 7f91abfff700 1 -- 172.21.15.45:0/2183781003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91ac1036c0 msgr2=0x7f91ac19f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:57.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.144+0000 7f91abfff700 1 --2- 172.21.15.45:0/2183781003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91ac1036c0 0x7f91ac19f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:57.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.144+0000 7f91abfff700 1 -- 172.21.15.45:0/2183781003 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a4009d00 con 0x7f91ac101c00 2024-05-10T03:38:57.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.144+0000 7f91b0b47700 1 --2- 172.21.15.45:0/2183781003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91ac1036c0 0x7f91ac19f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:38:57.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.144+0000 7f91ab7fe700 1 --2- 172.21.15.45:0/2183781003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91ac102d20 0x7f91ac198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:38:57.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.145+0000 7f91abfff700 1 --2- 172.21.15.45:0/2183781003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91ac101c00 0x7f91ac198100 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f919c00e940 tx=0x7f919c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:57.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.145+0000 7f91a97fa700 1 -- 172.21.15.45:0/2183781003 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c00cbd0 con 0x7f91ac101c00 2024-05-10T03:38:57.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.145+0000 7f91a97fa700 1 -- 172.21.15.45:0/2183781003 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f919c004500 con 0x7f91ac101c00 2024-05-10T03:38:57.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.145+0000 7f91b25aa700 1 -- 172.21.15.45:0/2183781003 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91ac1a01f0 con 0x7f91ac101c00 2024-05-10T03:38:57.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.145+0000 7f91a97fa700 1 -- 172.21.15.45:0/2183781003 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c003e30 con 0x7f91ac101c00 2024-05-10T03:38:57.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.145+0000 7f91b25aa700 1 -- 172.21.15.45:0/2183781003 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ac1a0700 con 0x7f91ac101c00 2024-05-10T03:38:57.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.146+0000 7f91b25aa700 1 -- 172.21.15.45:0/2183781003 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91ac108e10 con 0x7f91ac101c00 2024-05-10T03:38:57.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.147+0000 7f91a97fa700 1 -- 172.21.15.45:0/2183781003 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f919c004020 con 0x7f91ac101c00 2024-05-10T03:38:57.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.148+0000 7f91a97fa700 1 --2- 172.21.15.45:0/2183781003 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f91940a11c0 0x7f91940a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:57.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.148+0000 7f91ab7fe700 1 --2- 172.21.15.45:0/2183781003 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f91940a11c0 0x7f91940a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:57.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.148+0000 7f91a97fa700 1 -- 172.21.15.45:0/2183781003 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f919c014070 con 0x7f91ac101c00 2024-05-10T03:38:57.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.149+0000 7f91ab7fe700 1 --2- 172.21.15.45:0/2183781003 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f91940a11c0 0x7f91940a36d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f91ac1991a0 tx=0x7f91a0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:57.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.153+0000 7f91a97fa700 1 -- 172.21.15.45:0/2183781003 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f919c0964d0 con 0x7f91ac101c00 2024-05-10T03:38:57.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:56 smithi154 ceph-mon[46565]: pgmap v241: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-05-10T03:38:57.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:56 smithi154 ceph-mon[46565]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-05-10T03:38:57.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:56 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1336125223' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-10T03:38:57.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:56 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] up:active 2024-05-10T03:38:57.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:56 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1336125223' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-10T03:38:57.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:56 smithi045 ceph-mon[42520]: pgmap v241: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-05-10T03:38:57.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:56 smithi045 ceph-mon[42520]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-05-10T03:38:57.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:56 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1336125223' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-10T03:38:57.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:56 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] up:active 2024-05-10T03:38:57.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:56 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1336125223' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-10T03:38:57.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:56 smithi106 ceph-mon[46996]: pgmap v241: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-05-10T03:38:57.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:56 smithi106 ceph-mon[46996]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-05-10T03:38:57.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:56 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1336125223' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-10T03:38:57.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:56 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] up:active 2024-05-10T03:38:57.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:56 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1336125223' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-10T03:38:57.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.430+0000 7f91b25aa700 1 -- 172.21.15.45:0/2183781003 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f91ac068730 con 0x7f91ac101c00 2024-05-10T03:38:57.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.980+0000 7f91a97fa700 1 -- 172.21.15.45:0/2183781003 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v22) v1 ==== 115+0+0 (secure 0 0 0) 0x7f91ac068730 con 0x7f91ac101c00 2024-05-10T03:38:57.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.984+0000 7f91b25aa700 1 -- 172.21.15.45:0/2183781003 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f91940a11c0 msgr2=0x7f91940a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:57.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.984+0000 7f91b25aa700 1 --2- 172.21.15.45:0/2183781003 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f91940a11c0 0x7f91940a36d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f91ac1991a0 tx=0x7f91a0009260 comp rx=0 tx=0).stop 2024-05-10T03:38:57.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.984+0000 7f91b25aa700 1 -- 172.21.15.45:0/2183781003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91ac101c00 msgr2=0x7f91ac198100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:57.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.984+0000 7f91b25aa700 1 --2- 172.21.15.45:0/2183781003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91ac101c00 0x7f91ac198100 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f919c00e940 tx=0x7f919c00ed00 comp rx=0 tx=0).stop 2024-05-10T03:38:57.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.984+0000 7f91b25aa700 1 -- 172.21.15.45:0/2183781003 shutdown_connections 2024-05-10T03:38:57.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.984+0000 7f91b25aa700 1 --2- 172.21.15.45:0/2183781003 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f91940a11c0 0x7f91940a36d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:57.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.984+0000 7f91b25aa700 1 --2- 172.21.15.45:0/2183781003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91ac1036c0 0x7f91ac19f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:57.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.984+0000 7f91b25aa700 1 --2- 172.21.15.45:0/2183781003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91ac101c00 0x7f91ac198100 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:57.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.984+0000 7f91b25aa700 1 --2- 172.21.15.45:0/2183781003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91ac102d20 0x7f91ac198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:57.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.984+0000 7f91b25aa700 1 -- 172.21.15.45:0/2183781003 >> 172.21.15.45:0/2183781003 conn(0x7f91ac0fd210 msgr2=0x7f91ac105f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:57.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.984+0000 7f91b25aa700 1 -- 172.21.15.45:0/2183781003 shutdown_connections 2024-05-10T03:38:57.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:57.984+0000 7f91b25aa700 1 -- 172.21.15.45:0/2183781003 wait complete. 2024-05-10T03:38:58.007 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-05-10T03:38:58.007 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-05-10T03:38:58.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.161+0000 7fba4e45c700 1 -- 172.21.15.45:0/2464150516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba48102d20 msgr2=0x7fba48103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:58.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.161+0000 7fba4e45c700 1 --2- 172.21.15.45:0/2464150516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba48102d20 0x7fba48103130 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fba3c009990 tx=0x7fba3c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:58.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.161+0000 7fba4e45c700 1 -- 172.21.15.45:0/2464150516 shutdown_connections 2024-05-10T03:38:58.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.161+0000 7fba4e45c700 1 --2- 172.21.15.45:0/2464150516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba48101c00 0x7fba48102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:58.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.161+0000 7fba4e45c700 1 --2- 172.21.15.45:0/2464150516 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba481036c0 0x7fba48109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:58.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.161+0000 7fba4e45c700 1 --2- 172.21.15.45:0/2464150516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba48102d20 0x7fba48103130 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:58.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.161+0000 7fba4e45c700 1 -- 172.21.15.45:0/2464150516 >> 172.21.15.45:0/2464150516 conn(0x7fba480fd210 msgr2=0x7fba480ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:58.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.161+0000 7fba4e45c700 1 -- 172.21.15.45:0/2464150516 shutdown_connections 2024-05-10T03:38:58.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.161+0000 7fba4e45c700 1 -- 172.21.15.45:0/2464150516 wait complete. 2024-05-10T03:38:58.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.162+0000 7fba4e45c700 1 Processor -- start 2024-05-10T03:38:58.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.162+0000 7fba4e45c700 1 -- start start 2024-05-10T03:38:58.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.162+0000 7fba4e45c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba48101c00 0x7fba48198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:58.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.162+0000 7fba4e45c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba48102d20 0x7fba48198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:58.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.162+0000 7fba4e45c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba481036c0 0x7fba4819f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:58.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.162+0000 7fba4e45c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4819faf0 con 0x7fba48101c00 2024-05-10T03:38:58.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.162+0000 7fba4e45c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4819fc60 con 0x7fba48102d20 2024-05-10T03:38:58.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.162+0000 7fba4e45c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4819fe20 con 0x7fba481036c0 2024-05-10T03:38:58.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.162+0000 7fba47fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba48101c00 0x7fba48198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:58.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.163+0000 7fba47fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba48101c00 0x7fba48198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59932/0 (socket says 172.21.15.45:59932) 2024-05-10T03:38:58.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.163+0000 7fba47fff700 1 -- 172.21.15.45:0/670919886 learned_addr learned my addr 172.21.15.45:0/670919886 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:58.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.163+0000 7fba477fe700 1 --2- 172.21.15.45:0/670919886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba48102d20 0x7fba48198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:58.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.163+0000 7fba4c9f9700 1 --2- 172.21.15.45:0/670919886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba481036c0 0x7fba4819f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:58.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.163+0000 7fba47fff700 1 -- 172.21.15.45:0/670919886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba481036c0 msgr2=0x7fba4819f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:58.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.163+0000 7fba47fff700 1 --2- 172.21.15.45:0/670919886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba481036c0 0x7fba4819f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:58.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.163+0000 7fba47fff700 1 -- 172.21.15.45:0/670919886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba48102d20 msgr2=0x7fba48198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:58.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.163+0000 7fba47fff700 1 --2- 172.21.15.45:0/670919886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba48102d20 0x7fba48198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:58.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.163+0000 7fba47fff700 1 -- 172.21.15.45:0/670919886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3c0095f0 con 0x7fba48101c00 2024-05-10T03:38:58.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.163+0000 7fba47fff700 1 --2- 172.21.15.45:0/670919886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba48101c00 0x7fba48198010 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fba3800e9f0 tx=0x7fba3800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:58.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.163+0000 7fba457fa700 1 -- 172.21.15.45:0/670919886 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba38004230 con 0x7fba48101c00 2024-05-10T03:38:58.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.163+0000 7fba4e45c700 1 -- 172.21.15.45:0/670919886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba481a0100 con 0x7fba48101c00 2024-05-10T03:38:58.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.163+0000 7fba457fa700 1 -- 172.21.15.45:0/670919886 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fba38004390 con 0x7fba48101c00 2024-05-10T03:38:58.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.163+0000 7fba457fa700 1 -- 172.21.15.45:0/670919886 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba38003d40 con 0x7fba48101c00 2024-05-10T03:38:58.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.163+0000 7fba4e45c700 1 -- 172.21.15.45:0/670919886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba481a0610 con 0x7fba48101c00 2024-05-10T03:38:58.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.164+0000 7fba4e45c700 1 -- 172.21.15.45:0/670919886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba48108e10 con 0x7fba48101c00 2024-05-10T03:38:58.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.166+0000 7fba457fa700 1 -- 172.21.15.45:0/670919886 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fba3800c7c0 con 0x7fba48101c00 2024-05-10T03:38:58.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.167+0000 7fba457fa700 1 --2- 172.21.15.45:0/670919886 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fba300a11c0 0x7fba300a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:58.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.167+0000 7fba477fe700 1 --2- 172.21.15.45:0/670919886 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fba300a11c0 0x7fba300a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:58.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.167+0000 7fba457fa700 1 -- 172.21.15.45:0/670919886 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fba38014070 con 0x7fba48101c00 2024-05-10T03:38:58.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.167+0000 7fba477fe700 1 --2- 172.21.15.45:0/670919886 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fba300a11c0 0x7fba300a36d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00b2e0 tx=0x7fba3c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:58.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.170+0000 7fba457fa700 1 -- 172.21.15.45:0/670919886 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fba380963b0 con 0x7fba48101c00 2024-05-10T03:38:58.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:57 smithi045 ceph-mon[42520]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-10T03:38:58.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:57 smithi045 ceph-mon[42520]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-05-10T03:38:58.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:57 smithi045 ceph-mon[42520]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-05-10T03:38:58.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:57 smithi045 ceph-mon[42520]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-05-10T03:38:58.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:57 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2183781003' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-10T03:38:58.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:57 smithi106 ceph-mon[46996]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-10T03:38:58.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:57 smithi106 ceph-mon[46996]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-05-10T03:38:58.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:57 smithi106 ceph-mon[46996]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-05-10T03:38:58.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:57 smithi106 ceph-mon[46996]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-05-10T03:38:58.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:57 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2183781003' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-10T03:38:58.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.429+0000 7fba4e45c700 1 -- 172.21.15.45:0/670919886 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fba48061650 con 0x7fba300a11c0 2024-05-10T03:38:58.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.457+0000 7fba457fa700 1 -- 172.21.15.45:0/670919886 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fba48061650 con 0x7fba300a11c0 2024-05-10T03:38:58.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.459+0000 7fba4e45c700 1 -- 172.21.15.45:0/670919886 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fba300a11c0 msgr2=0x7fba300a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:58.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.459+0000 7fba4e45c700 1 --2- 172.21.15.45:0/670919886 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fba300a11c0 0x7fba300a36d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00b2e0 tx=0x7fba3c01a040 comp rx=0 tx=0).stop 2024-05-10T03:38:58.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.459+0000 7fba4e45c700 1 -- 172.21.15.45:0/670919886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba48101c00 msgr2=0x7fba48198010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:58.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.459+0000 7fba4e45c700 1 --2- 172.21.15.45:0/670919886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba48101c00 0x7fba48198010 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fba3800e9f0 tx=0x7fba3800ed00 comp rx=0 tx=0).stop 2024-05-10T03:38:58.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.459+0000 7fba4e45c700 1 -- 172.21.15.45:0/670919886 shutdown_connections 2024-05-10T03:38:58.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.459+0000 7fba4e45c700 1 --2- 172.21.15.45:0/670919886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba481036c0 0x7fba4819f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:58.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.459+0000 7fba4e45c700 1 --2- 172.21.15.45:0/670919886 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fba300a11c0 0x7fba300a36d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:58.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.459+0000 7fba4e45c700 1 --2- 172.21.15.45:0/670919886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba48101c00 0x7fba48198010 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:58.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.459+0000 7fba4e45c700 1 --2- 172.21.15.45:0/670919886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba48102d20 0x7fba48198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:58.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.459+0000 7fba4e45c700 1 -- 172.21.15.45:0/670919886 >> 172.21.15.45:0/670919886 conn(0x7fba480fd210 msgr2=0x7fba48105f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:58.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.459+0000 7fba4e45c700 1 -- 172.21.15.45:0/670919886 shutdown_connections 2024-05-10T03:38:58.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.459+0000 7fba4e45c700 1 -- 172.21.15.45:0/670919886 wait complete. 2024-05-10T03:38:58.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:57 smithi154 ceph-mon[46565]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-10T03:38:58.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:57 smithi154 ceph-mon[46565]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-05-10T03:38:58.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:57 smithi154 ceph-mon[46565]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-05-10T03:38:58.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:57 smithi154 ceph-mon[46565]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-05-10T03:38:58.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:57 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2183781003' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-10T03:38:58.477 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-05-10T03:38:58.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.630+0000 7fccb898e700 1 -- 172.21.15.45:0/460899995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccb4069030 msgr2=0x7fccb4104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:58.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.630+0000 7fccb898e700 1 --2- 172.21.15.45:0/460899995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccb4069030 0x7fccb4104780 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009990 tx=0x7fcca4009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:58.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.631+0000 7fccb898e700 1 -- 172.21.15.45:0/460899995 shutdown_connections 2024-05-10T03:38:58.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.631+0000 7fccb898e700 1 --2- 172.21.15.45:0/460899995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccb4107880 0x7fccb4109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:58.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.631+0000 7fccb898e700 1 --2- 172.21.15.45:0/460899995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccb4069030 0x7fccb4104780 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:58.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.631+0000 7fccb898e700 1 --2- 172.21.15.45:0/460899995 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccb4104d50 0x7fccb41071f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:58.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.631+0000 7fccb898e700 1 -- 172.21.15.45:0/460899995 >> 172.21.15.45:0/460899995 conn(0x7fccb40fc0d0 msgr2=0x7fccb40fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:58.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.631+0000 7fccb898e700 1 -- 172.21.15.45:0/460899995 shutdown_connections 2024-05-10T03:38:58.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.631+0000 7fccb898e700 1 -- 172.21.15.45:0/460899995 wait complete. 2024-05-10T03:38:58.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.632+0000 7fccb898e700 1 Processor -- start 2024-05-10T03:38:58.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.632+0000 7fccb898e700 1 -- start start 2024-05-10T03:38:58.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.632+0000 7fccb898e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccb4069030 0x7fccb4197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:58.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.632+0000 7fccb898e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccb4104d50 0x7fccb4198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:58.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.632+0000 7fccb898e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccb4107880 0x7fccb419f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:58.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.632+0000 7fccb898e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb419fad0 con 0x7fccb4104d50 2024-05-10T03:38:58.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.632+0000 7fccb898e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb419fc40 con 0x7fccb4107880 2024-05-10T03:38:58.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.632+0000 7fccb898e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb419fe00 con 0x7fccb4069030 2024-05-10T03:38:58.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.632+0000 7fccb1d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccb4104d50 0x7fccb4198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:58.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.632+0000 7fccb1d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccb4104d50 0x7fccb4198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59972/0 (socket says 172.21.15.45:59972) 2024-05-10T03:38:58.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.632+0000 7fccb1d9b700 1 -- 172.21.15.45:0/3052038778 learned_addr learned my addr 172.21.15.45:0/3052038778 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:58.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.632+0000 7fccb259c700 1 --2- 172.21.15.45:0/3052038778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccb4069030 0x7fccb4197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:58.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.632+0000 7fccb2d9d700 1 --2- 172.21.15.45:0/3052038778 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccb4107880 0x7fccb419f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:58.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.632+0000 7fccb1d9b700 1 -- 172.21.15.45:0/3052038778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccb4069030 msgr2=0x7fccb4197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:58.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.632+0000 7fccb1d9b700 1 --2- 172.21.15.45:0/3052038778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccb4069030 0x7fccb4197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:58.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.632+0000 7fccb1d9b700 1 -- 172.21.15.45:0/3052038778 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccb4107880 msgr2=0x7fccb419f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:58.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.632+0000 7fccb1d9b700 1 --2- 172.21.15.45:0/3052038778 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccb4107880 0x7fccb419f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:58.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.632+0000 7fccb1d9b700 1 -- 172.21.15.45:0/3052038778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca40095f0 con 0x7fccb4104d50 2024-05-10T03:38:58.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.633+0000 7fccb1d9b700 1 --2- 172.21.15.45:0/3052038778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccb4104d50 0x7fccb4198530 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcca800e9a0 tx=0x7fcca800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:58.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.633+0000 7fcca37fe700 1 -- 172.21.15.45:0/3052038778 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca8009790 con 0x7fccb4104d50 2024-05-10T03:38:58.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.633+0000 7fccb898e700 1 -- 172.21.15.45:0/3052038778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb41a00e0 con 0x7fccb4104d50 2024-05-10T03:38:58.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.633+0000 7fcca37fe700 1 -- 172.21.15.45:0/3052038778 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcca800cbd0 con 0x7fccb4104d50 2024-05-10T03:38:58.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.633+0000 7fcca37fe700 1 -- 172.21.15.45:0/3052038778 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca8018680 con 0x7fccb4104d50 2024-05-10T03:38:58.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.633+0000 7fccb898e700 1 -- 172.21.15.45:0/3052038778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb41a05f0 con 0x7fccb4104d50 2024-05-10T03:38:58.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.634+0000 7fccb898e700 1 -- 172.21.15.45:0/3052038778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb40fdc80 con 0x7fccb4104d50 2024-05-10T03:38:58.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.635+0000 7fcca37fe700 1 -- 172.21.15.45:0/3052038778 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fcca80188a0 con 0x7fccb4104d50 2024-05-10T03:38:58.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.636+0000 7fcca37fe700 1 --2- 172.21.15.45:0/3052038778 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcc9c0a11c0 0x7fcc9c0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:58.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.636+0000 7fcca37fe700 1 -- 172.21.15.45:0/3052038778 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fcca8014070 con 0x7fccb4104d50 2024-05-10T03:38:58.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.636+0000 7fccb259c700 1 --2- 172.21.15.45:0/3052038778 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcc9c0a11c0 0x7fcc9c0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:58.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.637+0000 7fccb259c700 1 --2- 172.21.15.45:0/3052038778 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcc9c0a11c0 0x7fcc9c0a36d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcca400b2e0 tx=0x7fcca401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:58.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.640+0000 7fcca37fe700 1 -- 172.21.15.45:0/3052038778 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fcca80967e0 con 0x7fccb4104d50 2024-05-10T03:38:58.783 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:38:58 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:38:58.435+0000 7f0f1a973700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-10T03:38:58.784 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:38:58 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:38:58.435+0000 7f0f1a973700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-10T03:38:58.784 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:38:58 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:38:58.435+0000 7f0f1a973700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-10T03:38:58.784 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:38:58 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:38:58.435+0000 7f0f1a973700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-10T03:38:58.784 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:38:58 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:38:58.435+0000 7f0f1a973700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-10T03:38:58.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.902+0000 7fccb898e700 1 -- 172.21.15.45:0/3052038778 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fccb4061650 con 0x7fcc9c0a11c0 2024-05-10T03:38:58.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.926+0000 7fcca37fe700 1 -- 172.21.15.45:0/3052038778 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fccb4061650 con 0x7fcc9c0a11c0 2024-05-10T03:38:58.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.928+0000 7fccb898e700 1 -- 172.21.15.45:0/3052038778 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcc9c0a11c0 msgr2=0x7fcc9c0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:58.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.928+0000 7fccb898e700 1 --2- 172.21.15.45:0/3052038778 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcc9c0a11c0 0x7fcc9c0a36d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcca400b2e0 tx=0x7fcca401a040 comp rx=0 tx=0).stop 2024-05-10T03:38:58.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.928+0000 7fccb898e700 1 -- 172.21.15.45:0/3052038778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccb4104d50 msgr2=0x7fccb4198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:58.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.928+0000 7fccb898e700 1 --2- 172.21.15.45:0/3052038778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccb4104d50 0x7fccb4198530 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcca800e9a0 tx=0x7fcca800ecb0 comp rx=0 tx=0).stop 2024-05-10T03:38:58.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.928+0000 7fccb898e700 1 -- 172.21.15.45:0/3052038778 shutdown_connections 2024-05-10T03:38:58.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.928+0000 7fccb898e700 1 --2- 172.21.15.45:0/3052038778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccb4069030 0x7fccb4197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:58.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.928+0000 7fccb898e700 1 --2- 172.21.15.45:0/3052038778 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcc9c0a11c0 0x7fcc9c0a36d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:58.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.928+0000 7fccb898e700 1 --2- 172.21.15.45:0/3052038778 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccb4107880 0x7fccb419f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:58.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.928+0000 7fccb898e700 1 --2- 172.21.15.45:0/3052038778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccb4104d50 0x7fccb4198530 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:58.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.928+0000 7fccb898e700 1 -- 172.21.15.45:0/3052038778 >> 172.21.15.45:0/3052038778 conn(0x7fccb40fc0d0 msgr2=0x7fccb41032a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:58.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.929+0000 7fccb898e700 1 -- 172.21.15.45:0/3052038778 shutdown_connections 2024-05-10T03:38:58.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:58.929+0000 7fccb898e700 1 -- 172.21.15.45:0/3052038778 wait complete. 2024-05-10T03:38:58.946 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-05-10T03:38:59.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.103+0000 7fa765d93700 1 -- 172.21.15.45:0/1458923901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa760105040 msgr2=0x7fa760107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:59.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.103+0000 7fa765d93700 1 --2- 172.21.15.45:0/1458923901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa760105040 0x7fa760107460 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa754009990 tx=0x7fa754009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:59.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.103+0000 7fa765d93700 1 -- 172.21.15.45:0/1458923901 shutdown_connections 2024-05-10T03:38:59.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.103+0000 7fa765d93700 1 --2- 172.21.15.45:0/1458923901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7601079a0 0x7fa760109dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:59.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.103+0000 7fa765d93700 1 --2- 172.21.15.45:0/1458923901 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7601026e0 0x7fa760104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:59.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.103+0000 7fa765d93700 1 --2- 172.21.15.45:0/1458923901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa760105040 0x7fa760107460 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:59.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.103+0000 7fa765d93700 1 -- 172.21.15.45:0/1458923901 >> 172.21.15.45:0/1458923901 conn(0x7fa7600fc100 msgr2=0x7fa7600fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:59.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.103+0000 7fa765d93700 1 -- 172.21.15.45:0/1458923901 shutdown_connections 2024-05-10T03:38:59.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.103+0000 7fa765d93700 1 -- 172.21.15.45:0/1458923901 wait complete. 2024-05-10T03:38:59.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.103+0000 7fa765d93700 1 Processor -- start 2024-05-10T03:38:59.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.104+0000 7fa765d93700 1 -- start start 2024-05-10T03:38:59.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.104+0000 7fa765d93700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7601026e0 0x7fa760197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:59.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.104+0000 7fa765d93700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa760105040 0x7fa760198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:59.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.104+0000 7fa765d93700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7601079a0 0x7fa76019f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:59.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.104+0000 7fa765d93700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76019fad0 con 0x7fa7601026e0 2024-05-10T03:38:59.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.104+0000 7fa765d93700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76019fc40 con 0x7fa760105040 2024-05-10T03:38:59.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.104+0000 7fa765d93700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76019fe00 con 0x7fa7601079a0 2024-05-10T03:38:59.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.104+0000 7fa75f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7601026e0 0x7fa760197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:59.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.104+0000 7fa75f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7601026e0 0x7fa760197ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59976/0 (socket says 172.21.15.45:59976) 2024-05-10T03:38:59.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.104+0000 7fa75f7fe700 1 -- 172.21.15.45:0/2161063898 learned_addr learned my addr 172.21.15.45:0/2161063898 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:59.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.104+0000 7fa75ffff700 1 --2- 172.21.15.45:0/2161063898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7601079a0 0x7fa76019f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:59.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.104+0000 7fa75effd700 1 --2- 172.21.15.45:0/2161063898 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa760105040 0x7fa760198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:59.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.104+0000 7fa75f7fe700 1 -- 172.21.15.45:0/2161063898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7601079a0 msgr2=0x7fa76019f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:59.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.104+0000 7fa75f7fe700 1 --2- 172.21.15.45:0/2161063898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7601079a0 0x7fa76019f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:59.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.104+0000 7fa75f7fe700 1 -- 172.21.15.45:0/2161063898 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa760105040 msgr2=0x7fa760198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:59.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.104+0000 7fa75f7fe700 1 --2- 172.21.15.45:0/2161063898 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa760105040 0x7fa760198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:59.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.105+0000 7fa75f7fe700 1 -- 172.21.15.45:0/2161063898 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7540095f0 con 0x7fa7601026e0 2024-05-10T03:38:59.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.105+0000 7fa75effd700 1 --2- 172.21.15.45:0/2161063898 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa760105040 0x7fa760198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:38:59.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.105+0000 7fa75f7fe700 1 --2- 172.21.15.45:0/2161063898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7601026e0 0x7fa760197ff0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa75000d950 tx=0x7fa75000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:59.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.105+0000 7fa75cff9700 1 -- 172.21.15.45:0/2161063898 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa750004220 con 0x7fa7601026e0 2024-05-10T03:38:59.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.105+0000 7fa75cff9700 1 -- 172.21.15.45:0/2161063898 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa750007620 con 0x7fa7601026e0 2024-05-10T03:38:59.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.105+0000 7fa765d93700 1 -- 172.21.15.45:0/2161063898 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7601a00e0 con 0x7fa7601026e0 2024-05-10T03:38:59.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.105+0000 7fa75cff9700 1 -- 172.21.15.45:0/2161063898 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa750005700 con 0x7fa7601026e0 2024-05-10T03:38:59.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.105+0000 7fa765d93700 1 -- 172.21.15.45:0/2161063898 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7601a05f0 con 0x7fa7601026e0 2024-05-10T03:38:59.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.106+0000 7fa765d93700 1 -- 172.21.15.45:0/2161063898 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7600fdcb0 con 0x7fa7601026e0 2024-05-10T03:38:59.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.107+0000 7fa75cff9700 1 -- 172.21.15.45:0/2161063898 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa750004380 con 0x7fa7601026e0 2024-05-10T03:38:59.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.108+0000 7fa75cff9700 1 --2- 172.21.15.45:0/2161063898 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa7480a11c0 0x7fa7480a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:59.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.108+0000 7fa75effd700 1 --2- 172.21.15.45:0/2161063898 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa7480a11c0 0x7fa7480a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:59.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.108+0000 7fa75cff9700 1 -- 172.21.15.45:0/2161063898 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fa7500cc8d0 con 0x7fa7601026e0 2024-05-10T03:38:59.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.109+0000 7fa75effd700 1 --2- 172.21.15.45:0/2161063898 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa7480a11c0 0x7fa7480a36d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa75400b8b0 tx=0x7fa754005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:59.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.113+0000 7fa75cff9700 1 -- 172.21.15.45:0/2161063898 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa750095e70 con 0x7fa7601026e0 2024-05-10T03:38:59.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:58 smithi045 ceph-mon[42520]: pgmap v242: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 1 op/s 2024-05-10T03:38:59.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:58 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] up:active 2024-05-10T03:38:59.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:58 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2183781003' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-10T03:38:59.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:58 smithi045 ceph-mon[42520]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-10T03:38:59.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:58 smithi045 ceph-mon[42520]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-05-10T03:38:59.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:58 smithi045 ceph-mon[42520]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=c=up:creating} 8 up:standby 2024-05-10T03:38:59.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:58 smithi045 ceph-mon[42520]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-05-10T03:38:59.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.369+0000 7fa765d93700 1 -- 172.21.15.45:0/2161063898 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7fa760061650 con 0x7fa7480a11c0 2024-05-10T03:38:59.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.374+0000 7fa75cff9700 1 -- 172.21.15.45:0/2161063898 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7fa760061650 con 0x7fa7480a11c0 2024-05-10T03:38:59.376 INFO:teuthology.orchestra.run.smithi045.stdout:/volumes/qa/sv_0/d4bae522-32af-4b6a-ad1f-3b4566e469a4 2024-05-10T03:38:59.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.376+0000 7fa765d93700 1 -- 172.21.15.45:0/2161063898 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa7480a11c0 msgr2=0x7fa7480a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:59.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.376+0000 7fa765d93700 1 --2- 172.21.15.45:0/2161063898 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa7480a11c0 0x7fa7480a36d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa75400b8b0 tx=0x7fa754005fb0 comp rx=0 tx=0).stop 2024-05-10T03:38:59.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.376+0000 7fa765d93700 1 -- 172.21.15.45:0/2161063898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7601026e0 msgr2=0x7fa760197ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:59.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.376+0000 7fa765d93700 1 --2- 172.21.15.45:0/2161063898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7601026e0 0x7fa760197ff0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa75000d950 tx=0x7fa75000dc60 comp rx=0 tx=0).stop 2024-05-10T03:38:59.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.376+0000 7fa765d93700 1 -- 172.21.15.45:0/2161063898 shutdown_connections 2024-05-10T03:38:59.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.376+0000 7fa765d93700 1 --2- 172.21.15.45:0/2161063898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7601079a0 0x7fa76019f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:59.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.376+0000 7fa765d93700 1 --2- 172.21.15.45:0/2161063898 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa7480a11c0 0x7fa7480a36d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:59.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.376+0000 7fa765d93700 1 --2- 172.21.15.45:0/2161063898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7601026e0 0x7fa760197ff0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:59.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.376+0000 7fa765d93700 1 --2- 172.21.15.45:0/2161063898 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa760105040 0x7fa760198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:59.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.376+0000 7fa765d93700 1 -- 172.21.15.45:0/2161063898 >> 172.21.15.45:0/2161063898 conn(0x7fa7600fc100 msgr2=0x7fa760103210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:59.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.376+0000 7fa765d93700 1 -- 172.21.15.45:0/2161063898 shutdown_connections 2024-05-10T03:38:59.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.376+0000 7fa765d93700 1 -- 172.21.15.45:0/2161063898 wait complete. 2024-05-10T03:38:59.393 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-05-10T03:38:59.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:58 smithi106 ceph-mon[46996]: pgmap v242: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 1 op/s 2024-05-10T03:38:59.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:58 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] up:active 2024-05-10T03:38:59.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:58 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2183781003' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-10T03:38:59.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:58 smithi106 ceph-mon[46996]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-10T03:38:59.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:58 smithi106 ceph-mon[46996]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-05-10T03:38:59.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:58 smithi106 ceph-mon[46996]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=c=up:creating} 8 up:standby 2024-05-10T03:38:59.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:58 smithi106 ceph-mon[46996]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-05-10T03:38:59.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:58 smithi154 ceph-mon[46565]: pgmap v242: 129 pgs: 129 active+clean; 581 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 1 op/s 2024-05-10T03:38:59.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:58 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] up:active 2024-05-10T03:38:59.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:58 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2183781003' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-10T03:38:59.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:58 smithi154 ceph-mon[46565]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-10T03:38:59.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:58 smithi154 ceph-mon[46565]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-05-10T03:38:59.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:58 smithi154 ceph-mon[46565]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=c=up:creating} 8 up:standby 2024-05-10T03:38:59.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:58 smithi154 ceph-mon[46565]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-05-10T03:38:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.546+0000 7fb2e1e75700 1 -- 172.21.15.45:0/4034315636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2dc101be0 msgr2=0x7fb2dc101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.546+0000 7fb2e1e75700 1 --2- 172.21.15.45:0/4034315636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2dc101be0 0x7fb2dc101ff0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009990 tx=0x7fb2d0009ca0 comp rx=0 tx=0).stop 2024-05-10T03:38:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.546+0000 7fb2e1e75700 1 -- 172.21.15.45:0/4034315636 shutdown_connections 2024-05-10T03:38:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.546+0000 7fb2e1e75700 1 --2- 172.21.15.45:0/4034315636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2dc100ac0 0x7fb2dc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.546+0000 7fb2e1e75700 1 --2- 172.21.15.45:0/4034315636 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2dc102580 0x7fb2dc108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.546+0000 7fb2e1e75700 1 --2- 172.21.15.45:0/4034315636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2dc101be0 0x7fb2dc101ff0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.546+0000 7fb2e1e75700 1 -- 172.21.15.45:0/4034315636 >> 172.21.15.45:0/4034315636 conn(0x7fb2dc0fc0d0 msgr2=0x7fb2dc0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.546+0000 7fb2e1e75700 1 -- 172.21.15.45:0/4034315636 shutdown_connections 2024-05-10T03:38:59.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.546+0000 7fb2e1e75700 1 -- 172.21.15.45:0/4034315636 wait complete. 2024-05-10T03:38:59.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.547+0000 7fb2e1e75700 1 Processor -- start 2024-05-10T03:38:59.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.547+0000 7fb2e1e75700 1 -- start start 2024-05-10T03:38:59.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.547+0000 7fb2e1e75700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2dc100ac0 0x7fb2dc068e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:59.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.547+0000 7fb2e1e75700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2dc101be0 0x7fb2dc19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:59.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.547+0000 7fb2e1e75700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2dc102580 0x7fb2dc19f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:59.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.547+0000 7fb2e1e75700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc19fa50 con 0x7fb2dc101be0 2024-05-10T03:38:59.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.547+0000 7fb2e1e75700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc19fbc0 con 0x7fb2dc102580 2024-05-10T03:38:59.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.547+0000 7fb2e1e75700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc19fd80 con 0x7fb2dc100ac0 2024-05-10T03:38:59.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.547+0000 7fb2daffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2dc101be0 0x7fb2dc19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:59.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.547+0000 7fb2daffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2dc101be0 0x7fb2dc19cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59992/0 (socket says 172.21.15.45:59992) 2024-05-10T03:38:59.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.547+0000 7fb2daffd700 1 -- 172.21.15.45:0/1379029310 learned_addr learned my addr 172.21.15.45:0/1379029310 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:38:59.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.548+0000 7fb2dbfff700 1 --2- 172.21.15.45:0/1379029310 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2dc102580 0x7fb2dc19f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:59.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.548+0000 7fb2db7fe700 1 --2- 172.21.15.45:0/1379029310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2dc100ac0 0x7fb2dc068e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:59.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.548+0000 7fb2daffd700 1 -- 172.21.15.45:0/1379029310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2dc100ac0 msgr2=0x7fb2dc068e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:59.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.548+0000 7fb2daffd700 1 --2- 172.21.15.45:0/1379029310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2dc100ac0 0x7fb2dc068e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:59.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.548+0000 7fb2daffd700 1 -- 172.21.15.45:0/1379029310 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2dc102580 msgr2=0x7fb2dc19f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:59.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.548+0000 7fb2daffd700 1 --2- 172.21.15.45:0/1379029310 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2dc102580 0x7fb2dc19f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:59.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.548+0000 7fb2daffd700 1 -- 172.21.15.45:0/1379029310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d00095f0 con 0x7fb2dc101be0 2024-05-10T03:38:59.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.548+0000 7fb2daffd700 1 --2- 172.21.15.45:0/1379029310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2dc101be0 0x7fb2dc19cd40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb2d00098e0 tx=0x7fb2d000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:59.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.548+0000 7fb2d8ff9700 1 -- 172.21.15.45:0/1379029310 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d001d070 con 0x7fb2dc101be0 2024-05-10T03:38:59.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.548+0000 7fb2d8ff9700 1 -- 172.21.15.45:0/1379029310 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb2d000fe60 con 0x7fb2dc101be0 2024-05-10T03:38:59.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.548+0000 7fb2e1e75700 1 -- 172.21.15.45:0/1379029310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2dc1a0000 con 0x7fb2dc101be0 2024-05-10T03:38:59.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.548+0000 7fb2d8ff9700 1 -- 172.21.15.45:0/1379029310 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0017650 con 0x7fb2dc101be0 2024-05-10T03:38:59.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.548+0000 7fb2e1e75700 1 -- 172.21.15.45:0/1379029310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2dc1a0480 con 0x7fb2dc101be0 2024-05-10T03:38:59.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.549+0000 7fb2e1e75700 1 -- 172.21.15.45:0/1379029310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2dc107cd0 con 0x7fb2dc101be0 2024-05-10T03:38:59.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.551+0000 7fb2d8ff9700 1 -- 172.21.15.45:0/1379029310 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb2d00177b0 con 0x7fb2dc101be0 2024-05-10T03:38:59.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.551+0000 7fb2d8ff9700 1 --2- 172.21.15.45:0/1379029310 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb2c40a1240 0x7fb2c40a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:38:59.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.552+0000 7fb2db7fe700 1 --2- 172.21.15.45:0/1379029310 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb2c40a1240 0x7fb2c40a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:38:59.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.552+0000 7fb2d8ff9700 1 -- 172.21.15.45:0/1379029310 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fb2d00ce4e0 con 0x7fb2dc101be0 2024-05-10T03:38:59.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.552+0000 7fb2db7fe700 1 --2- 172.21.15.45:0/1379029310 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb2c40a1240 0x7fb2c40a3750 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc101ae0 tx=0x7fb2cc00b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:38:59.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.555+0000 7fb2d8ff9700 1 -- 172.21.15.45:0/1379029310 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb2d0097b10 con 0x7fb2dc101be0 2024-05-10T03:38:59.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.810+0000 7fb2e1e75700 1 -- 172.21.15.45:0/1379029310 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2dc061650 con 0x7fb2c40a1240 2024-05-10T03:38:59.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.836+0000 7fb2d8ff9700 1 -- 172.21.15.45:0/1379029310 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb2dc061650 con 0x7fb2c40a1240 2024-05-10T03:38:59.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.839+0000 7fb2e1e75700 1 -- 172.21.15.45:0/1379029310 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb2c40a1240 msgr2=0x7fb2c40a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:59.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.839+0000 7fb2e1e75700 1 --2- 172.21.15.45:0/1379029310 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb2c40a1240 0x7fb2c40a3750 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc101ae0 tx=0x7fb2cc00b5b0 comp rx=0 tx=0).stop 2024-05-10T03:38:59.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.839+0000 7fb2e1e75700 1 -- 172.21.15.45:0/1379029310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2dc101be0 msgr2=0x7fb2dc19cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:38:59.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.839+0000 7fb2e1e75700 1 --2- 172.21.15.45:0/1379029310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2dc101be0 0x7fb2dc19cd40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb2d00098e0 tx=0x7fb2d000f690 comp rx=0 tx=0).stop 2024-05-10T03:38:59.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.839+0000 7fb2e1e75700 1 -- 172.21.15.45:0/1379029310 shutdown_connections 2024-05-10T03:38:59.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.839+0000 7fb2e1e75700 1 --2- 172.21.15.45:0/1379029310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2dc100ac0 0x7fb2dc068e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:59.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.839+0000 7fb2e1e75700 1 --2- 172.21.15.45:0/1379029310 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb2c40a1240 0x7fb2c40a3750 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:59.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.839+0000 7fb2e1e75700 1 --2- 172.21.15.45:0/1379029310 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2dc102580 0x7fb2dc19f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:59.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.839+0000 7fb2e1e75700 1 --2- 172.21.15.45:0/1379029310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2dc101be0 0x7fb2dc19cd40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:38:59.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.839+0000 7fb2e1e75700 1 -- 172.21.15.45:0/1379029310 >> 172.21.15.45:0/1379029310 conn(0x7fb2dc0fc0d0 msgr2=0x7fb2dc104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:38:59.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.839+0000 7fb2e1e75700 1 -- 172.21.15.45:0/1379029310 shutdown_connections 2024-05-10T03:38:59.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:38:59.839+0000 7fb2e1e75700 1 -- 172.21.15.45:0/1379029310 wait complete. 2024-05-10T03:38:59.856 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-05-10T03:39:00.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.017+0000 7f8ee3e37700 1 -- 172.21.15.45:0/1410267931 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8edc109cd0 msgr2=0x7f8edc110580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:00.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.017+0000 7f8ee3e37700 1 --2- 172.21.15.45:0/1410267931 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8edc109cd0 0x7f8edc110580 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400b0a0 tx=0x7f8ed400b3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.018+0000 7f8ee3e37700 1 -- 172.21.15.45:0/1410267931 shutdown_connections 2024-05-10T03:39:00.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.018+0000 7f8ee3e37700 1 --2- 172.21.15.45:0/1410267931 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8edc109cd0 0x7f8edc110580 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.018+0000 7f8ee3e37700 1 --2- 172.21.15.45:0/1410267931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8edc108210 0x7f8edc108620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.018+0000 7f8ee3e37700 1 --2- 172.21.15.45:0/1410267931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8edc109330 0x7f8edc109740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.018+0000 7f8ee3e37700 1 -- 172.21.15.45:0/1410267931 >> 172.21.15.45:0/1410267931 conn(0x7f8edc077280 msgr2=0x7f8edc106030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:00.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.018+0000 7f8ee3e37700 1 -- 172.21.15.45:0/1410267931 shutdown_connections 2024-05-10T03:39:00.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.018+0000 7f8ee3e37700 1 -- 172.21.15.45:0/1410267931 wait complete. 2024-05-10T03:39:00.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.019+0000 7f8ee3e37700 1 Processor -- start 2024-05-10T03:39:00.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.019+0000 7f8ee3e37700 1 -- start start 2024-05-10T03:39:00.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.019+0000 7f8ee3e37700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8edc108210 0x7f8edc19e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:00.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.019+0000 7f8ee3e37700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8edc109330 0x7f8edc19ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:00.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.019+0000 7f8ee3e37700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8edc109cd0 0x7f8edc1a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:00.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.019+0000 7f8ee3e37700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc1a6200 con 0x7f8edc109330 2024-05-10T03:39:00.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.019+0000 7f8ee3e37700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc1a6370 con 0x7f8edc109cd0 2024-05-10T03:39:00.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.019+0000 7f8ee3e37700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc1a6530 con 0x7f8edc108210 2024-05-10T03:39:00.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.019+0000 7f8ee1bd3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8edc108210 0x7f8edc19e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:00.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.019+0000 7f8ee13d2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8edc109330 0x7f8edc19ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:00.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.019+0000 7f8ee1bd3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8edc108210 0x7f8edc19e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:60198/0 (socket says 172.21.15.45:60198) 2024-05-10T03:39:00.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.019+0000 7f8ee1bd3700 1 -- 172.21.15.45:0/3450042601 learned_addr learned my addr 172.21.15.45:0/3450042601 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:00.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.020+0000 7f8ee23d4700 1 --2- 172.21.15.45:0/3450042601 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8edc109cd0 0x7f8edc1a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:00.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.019+0000 7f8ee13d2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8edc109330 0x7f8edc19ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60020/0 (socket says 172.21.15.45:60020) 2024-05-10T03:39:00.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.020+0000 7f8ee23d4700 1 -- 172.21.15.45:0/3450042601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8edc108210 msgr2=0x7f8edc19e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:00.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.020+0000 7f8ee23d4700 1 --2- 172.21.15.45:0/3450042601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8edc108210 0x7f8edc19e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.020+0000 7f8ee23d4700 1 -- 172.21.15.45:0/3450042601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8edc109330 msgr2=0x7f8edc19ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:00.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.020+0000 7f8ee23d4700 1 --2- 172.21.15.45:0/3450042601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8edc109330 0x7f8edc19ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.020+0000 7f8ee23d4700 1 -- 172.21.15.45:0/3450042601 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed4009d00 con 0x7f8edc109cd0 2024-05-10T03:39:00.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.020+0000 7f8ee1bd3700 1 --2- 172.21.15.45:0/3450042601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8edc108210 0x7f8edc19e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:39:00.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.020+0000 7f8ee23d4700 1 --2- 172.21.15.45:0/3450042601 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8edc109cd0 0x7f8edc1a5bf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4007c30 tx=0x7f8ed4008f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:00.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.020+0000 7f8ed2ffd700 1 -- 172.21.15.45:0/3450042601 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed400e040 con 0x7f8edc109cd0 2024-05-10T03:39:00.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.021+0000 7f8ed2ffd700 1 -- 172.21.15.45:0/3450042601 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8ed401d470 con 0x7f8edc109cd0 2024-05-10T03:39:00.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.021+0000 7f8ee3e37700 1 -- 172.21.15.45:0/3450042601 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8edc1a67b0 con 0x7f8edc109cd0 2024-05-10T03:39:00.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.021+0000 7f8ed2ffd700 1 -- 172.21.15.45:0/3450042601 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed401b6e0 con 0x7f8edc109cd0 2024-05-10T03:39:00.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.021+0000 7f8ee3e37700 1 -- 172.21.15.45:0/3450042601 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8edc1a6c30 con 0x7f8edc109cd0 2024-05-10T03:39:00.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.022+0000 7f8ee3e37700 1 -- 172.21.15.45:0/3450042601 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8edc10f420 con 0x7f8edc109cd0 2024-05-10T03:39:00.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.024+0000 7f8ed2ffd700 1 -- 172.21.15.45:0/3450042601 <== mon.2 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f8ed401d950 con 0x7f8edc109cd0 2024-05-10T03:39:00.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.025+0000 7f8ed2ffd700 1 --2- 172.21.15.45:0/3450042601 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8ec80a12e0 0x7f8ec80a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:00.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.025+0000 7f8ee1bd3700 1 --2- 172.21.15.45:0/3450042601 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8ec80a12e0 0x7f8ec80a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:00.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.025+0000 7f8ed2ffd700 1 -- 172.21.15.45:0/3450042601 <== mon.2 v2:172.21.15.106:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8ed40cdcc0 con 0x7f8edc109cd0 2024-05-10T03:39:00.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.025+0000 7f8ee1bd3700 1 --2- 172.21.15.45:0/3450042601 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8ec80a12e0 0x7f8ec80a37f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8011550 tx=0x7f8ed8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:00.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.028+0000 7f8ed2ffd700 1 -- 172.21.15.45:0/3450042601 <== mon.2 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8ed40971b0 con 0x7f8edc109cd0 2024-05-10T03:39:00.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:59 smithi045 ceph-mon[42520]: from='client.14889 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:00.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:59 smithi045 ceph-mon[42520]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:00.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:59 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] up:active 2024-05-10T03:39:00.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:59 smithi045 ceph-mon[42520]: daemon mds.e assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-10T03:39:00.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:59 smithi045 ceph-mon[42520]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-10T03:39:00.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:59 smithi045 ceph-mon[42520]: Cluster is now healthy 2024-05-10T03:39:00.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:59 smithi045 ceph-mon[42520]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=c=up:active} 8 up:standby 2024-05-10T03:39:00.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:59 smithi045 ceph-mon[42520]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-10T03:39:00.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:38:59 smithi045 ceph-mon[42520]: daemon mds.e is now active in filesystem cephfs as rank 4 2024-05-10T03:39:00.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.288+0000 7f8ee3e37700 1 -- 172.21.15.45:0/3450042601 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8edc061650 con 0x7f8ec80a12e0 2024-05-10T03:39:00.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.292+0000 7f8ed2ffd700 1 -- 172.21.15.45:0/3450042601 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7f8edc061650 con 0x7f8ec80a12e0 2024-05-10T03:39:00.295 INFO:teuthology.orchestra.run.smithi045.stdout:/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb 2024-05-10T03:39:00.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.295+0000 7f8ee3e37700 1 -- 172.21.15.45:0/3450042601 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8ec80a12e0 msgr2=0x7f8ec80a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:00.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.295+0000 7f8ee3e37700 1 --2- 172.21.15.45:0/3450042601 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8ec80a12e0 0x7f8ec80a37f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8011550 tx=0x7f8ed8009260 comp rx=0 tx=0).stop 2024-05-10T03:39:00.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.295+0000 7f8ee3e37700 1 -- 172.21.15.45:0/3450042601 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8edc109cd0 msgr2=0x7f8edc1a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:00.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.295+0000 7f8ee3e37700 1 --2- 172.21.15.45:0/3450042601 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8edc109cd0 0x7f8edc1a5bf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4007c30 tx=0x7f8ed4008f10 comp rx=0 tx=0).stop 2024-05-10T03:39:00.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.295+0000 7f8ee3e37700 1 -- 172.21.15.45:0/3450042601 shutdown_connections 2024-05-10T03:39:00.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.295+0000 7f8ee3e37700 1 --2- 172.21.15.45:0/3450042601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8edc108210 0x7f8edc19e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.295+0000 7f8ee3e37700 1 --2- 172.21.15.45:0/3450042601 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8ec80a12e0 0x7f8ec80a37f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.295+0000 7f8ee3e37700 1 --2- 172.21.15.45:0/3450042601 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8edc109cd0 0x7f8edc1a5bf0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.295+0000 7f8ee3e37700 1 --2- 172.21.15.45:0/3450042601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8edc109330 0x7f8edc19ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.295+0000 7f8ee3e37700 1 -- 172.21.15.45:0/3450042601 >> 172.21.15.45:0/3450042601 conn(0x7f8edc077280 msgr2=0x7f8edc10c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:00.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.295+0000 7f8ee3e37700 1 -- 172.21.15.45:0/3450042601 shutdown_connections 2024-05-10T03:39:00.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.295+0000 7f8ee3e37700 1 -- 172.21.15.45:0/3450042601 wait complete. 2024-05-10T03:39:00.312 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:39:00.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:59 smithi106 ceph-mon[46996]: from='client.14889 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:00.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:59 smithi106 ceph-mon[46996]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:00.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:59 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] up:active 2024-05-10T03:39:00.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:59 smithi106 ceph-mon[46996]: daemon mds.e assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-10T03:39:00.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:59 smithi106 ceph-mon[46996]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-10T03:39:00.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:59 smithi106 ceph-mon[46996]: Cluster is now healthy 2024-05-10T03:39:00.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:59 smithi106 ceph-mon[46996]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=c=up:active} 8 up:standby 2024-05-10T03:39:00.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:59 smithi106 ceph-mon[46996]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-10T03:39:00.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:38:59 smithi106 ceph-mon[46996]: daemon mds.e is now active in filesystem cephfs as rank 4 2024-05-10T03:39:00.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.458+0000 7ff4b426a700 1 -- 172.21.15.45:0/2526669124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4ac100af0 msgr2=0x7ff4ac100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:00.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.458+0000 7ff4b426a700 1 --2- 172.21.15.45:0/2526669124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4ac100af0 0x7ff4ac100f00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009990 tx=0x7ff4a8009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.458+0000 7ff4b426a700 1 -- 172.21.15.45:0/2526669124 shutdown_connections 2024-05-10T03:39:00.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.458+0000 7ff4b426a700 1 --2- 172.21.15.45:0/2526669124 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4ac1025b0 0x7ff4ac108e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.458+0000 7ff4b426a700 1 --2- 172.21.15.45:0/2526669124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4ac100af0 0x7ff4ac100f00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.458+0000 7ff4b426a700 1 --2- 172.21.15.45:0/2526669124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4ac101c10 0x7ff4ac102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.458+0000 7ff4b426a700 1 -- 172.21.15.45:0/2526669124 >> 172.21.15.45:0/2526669124 conn(0x7ff4ac0fc0e0 msgr2=0x7ff4ac0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:00.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.459+0000 7ff4b426a700 1 -- 172.21.15.45:0/2526669124 shutdown_connections 2024-05-10T03:39:00.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.459+0000 7ff4b426a700 1 -- 172.21.15.45:0/2526669124 wait complete. 2024-05-10T03:39:00.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.459+0000 7ff4b426a700 1 Processor -- start 2024-05-10T03:39:00.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.459+0000 7ff4b426a700 1 -- start start 2024-05-10T03:39:00.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.460+0000 7ff4b426a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4ac100af0 0x7ff4ac196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:00.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.460+0000 7ff4b426a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4ac101c10 0x7ff4ac1974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:00.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.460+0000 7ff4b426a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4ac1025b0 0x7ff4ac19e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.460+0000 7ff4b426a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac19ea40 con 0x7ff4ac100af0 2024-05-10T03:39:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.460+0000 7ff4b426a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac19ebb0 con 0x7ff4ac1025b0 2024-05-10T03:39:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.460+0000 7ff4b426a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac19ed70 con 0x7ff4ac101c10 2024-05-10T03:39:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.460+0000 7ff4b2006700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4ac100af0 0x7ff4ac196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.460+0000 7ff4b2006700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4ac100af0 0x7ff4ac196f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60030/0 (socket says 172.21.15.45:60030) 2024-05-10T03:39:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.460+0000 7ff4b2006700 1 -- 172.21.15.45:0/1853739944 learned_addr learned my addr 172.21.15.45:0/1853739944 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.460+0000 7ff4b1805700 1 --2- 172.21.15.45:0/1853739944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4ac101c10 0x7ff4ac1974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.460+0000 7ff4b2807700 1 --2- 172.21.15.45:0/1853739944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4ac1025b0 0x7ff4ac19e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.460+0000 7ff4b2006700 1 -- 172.21.15.45:0/1853739944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4ac101c10 msgr2=0x7ff4ac1974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.460+0000 7ff4b2006700 1 --2- 172.21.15.45:0/1853739944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4ac101c10 0x7ff4ac1974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.460+0000 7ff4b2006700 1 -- 172.21.15.45:0/1853739944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4ac1025b0 msgr2=0x7ff4ac19e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:00.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.460+0000 7ff4b2006700 1 --2- 172.21.15.45:0/1853739944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4ac1025b0 0x7ff4ac19e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.460+0000 7ff4b2006700 1 -- 172.21.15.45:0/1853739944 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a80095f0 con 0x7ff4ac100af0 2024-05-10T03:39:00.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.460+0000 7ff4b2807700 1 --2- 172.21.15.45:0/1853739944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4ac1025b0 0x7ff4ac19e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:00.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.460+0000 7ff4b2006700 1 --2- 172.21.15.45:0/1853739944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4ac100af0 0x7ff4ac196f60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80098e0 tx=0x7ff4a8005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:00.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.460+0000 7ff4a37fe700 1 -- 172.21.15.45:0/1853739944 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a801d070 con 0x7ff4ac100af0 2024-05-10T03:39:00.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.460+0000 7ff4a37fe700 1 -- 172.21.15.45:0/1853739944 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff4a800be70 con 0x7ff4ac100af0 2024-05-10T03:39:00.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.460+0000 7ff4b426a700 1 -- 172.21.15.45:0/1853739944 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4ac19eff0 con 0x7ff4ac100af0 2024-05-10T03:39:00.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.461+0000 7ff4a37fe700 1 -- 172.21.15.45:0/1853739944 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8017650 con 0x7ff4ac100af0 2024-05-10T03:39:00.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.461+0000 7ff4b426a700 1 -- 172.21.15.45:0/1853739944 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ac19f360 con 0x7ff4ac100af0 2024-05-10T03:39:00.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.461+0000 7ff4b426a700 1 -- 172.21.15.45:0/1853739944 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4ac107d00 con 0x7ff4ac100af0 2024-05-10T03:39:00.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.463+0000 7ff4a37fe700 1 -- 172.21.15.45:0/1853739944 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ff4a8021410 con 0x7ff4ac100af0 2024-05-10T03:39:00.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.463+0000 7ff4a37fe700 1 --2- 172.21.15.45:0/1853739944 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4980a11b0 0x7ff4980a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:00.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.464+0000 7ff4b1805700 1 --2- 172.21.15.45:0/1853739944 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4980a11b0 0x7ff4980a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:00.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.464+0000 7ff4a37fe700 1 -- 172.21.15.45:0/1853739944 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ff4a80ce790 con 0x7ff4ac100af0 2024-05-10T03:39:00.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.464+0000 7ff4b1805700 1 --2- 172.21.15.45:0/1853739944 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4980a11b0 0x7ff4980a36c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac198000 tx=0x7ff49c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:00.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.467+0000 7ff4a37fe700 1 -- 172.21.15.45:0/1853739944 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff4a8097c00 con 0x7ff4ac100af0 2024-05-10T03:39:00.473 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:59 smithi154 ceph-mon[46565]: from='client.14889 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:00.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:59 smithi154 ceph-mon[46565]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:00.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:59 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] up:active 2024-05-10T03:39:00.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:59 smithi154 ceph-mon[46565]: daemon mds.e assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-10T03:39:00.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:59 smithi154 ceph-mon[46565]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-10T03:39:00.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:59 smithi154 ceph-mon[46565]: Cluster is now healthy 2024-05-10T03:39:00.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:59 smithi154 ceph-mon[46565]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=c=up:active} 8 up:standby 2024-05-10T03:39:00.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:59 smithi154 ceph-mon[46565]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-10T03:39:00.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:38:59 smithi154 ceph-mon[46565]: daemon mds.e is now active in filesystem cephfs as rank 4 2024-05-10T03:39:00.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.739+0000 7ff4b426a700 1 -- 172.21.15.45:0/1853739944 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4ac068730 con 0x7ff4ac100af0 2024-05-10T03:39:00.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.740+0000 7ff4a37fe700 1 -- 172.21.15.45:0/1853739944 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10926 (secure 0 0 0) 0x7ff4a809b220 con 0x7ff4ac100af0 2024-05-10T03:39:00.742 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:39:00.743 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/378320264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":378320264},{"type":"v1","addr":"172.21.15.45:6835","nonce":378320264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3032381796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3032381796},{"type":"v1","addr":"172.21.15.45:6837","nonce":3032381796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T03:38:36.555290+0000","modified":"2024-05-10T03:39:00.010786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24548,"mds_2":24547,"mds_3":24526,"mds_4":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14625":{"gid":14625,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6839/4007419304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":4007419304},{"type":"v1","addr":"172.21.15.45:6839","nonce":4007419304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14637":{"gid":14637,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6841/1355456195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1355456195},{"type":"v1","addr":"172.21.15.45:6841","nonce":1355456195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/4037121210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":4037121210},{"type":"v1","addr":"172.21.15.154:6835","nonce":4037121210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24521":{"gid":24521,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.106:6835/4162885659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4162885659},{"type":"v1","addr":"172.21.15.106:6835","nonce":4162885659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.154:6837/608167481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":608167481},{"type":"v1","addr":"172.21.15.154:6837","nonce":608167481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/1506563336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1506563336},{"type":"v1","addr":"172.21.15.154:6839","nonce":1506563336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.106:6837/3047487403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":3047487403},{"type":"v1","addr":"172.21.15.106:6837","nonce":3047487403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6839/3533867856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":3533867856},{"type":"v1","addr":"172.21.15.106:6839","nonce":3533867856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T03:39:00.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.742+0000 7ff4b426a700 1 -- 172.21.15.45:0/1853739944 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4980a11b0 msgr2=0x7ff4980a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:00.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.742+0000 7ff4b426a700 1 --2- 172.21.15.45:0/1853739944 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4980a11b0 0x7ff4980a36c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac198000 tx=0x7ff49c009260 comp rx=0 tx=0).stop 2024-05-10T03:39:00.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.742+0000 7ff4b426a700 1 -- 172.21.15.45:0/1853739944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4ac100af0 msgr2=0x7ff4ac196f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:00.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.742+0000 7ff4b426a700 1 --2- 172.21.15.45:0/1853739944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4ac100af0 0x7ff4ac196f60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80098e0 tx=0x7ff4a8005b00 comp rx=0 tx=0).stop 2024-05-10T03:39:00.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.742+0000 7ff4b426a700 1 -- 172.21.15.45:0/1853739944 shutdown_connections 2024-05-10T03:39:00.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.742+0000 7ff4b426a700 1 --2- 172.21.15.45:0/1853739944 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4980a11b0 0x7ff4980a36c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.742+0000 7ff4b426a700 1 --2- 172.21.15.45:0/1853739944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4ac1025b0 0x7ff4ac19e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.742+0000 7ff4b426a700 1 --2- 172.21.15.45:0/1853739944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4ac100af0 0x7ff4ac196f60 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.742+0000 7ff4b426a700 1 --2- 172.21.15.45:0/1853739944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4ac101c10 0x7ff4ac1974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.742+0000 7ff4b426a700 1 -- 172.21.15.45:0/1853739944 >> 172.21.15.45:0/1853739944 conn(0x7ff4ac0fc0e0 msgr2=0x7ff4ac104e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:00.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.742+0000 7ff4b426a700 1 -- 172.21.15.45:0/1853739944 shutdown_connections 2024-05-10T03:39:00.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.742+0000 7ff4b426a700 1 -- 172.21.15.45:0/1853739944 wait complete. 2024-05-10T03:39:00.747 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 27 2024-05-10T03:39:00.760 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:39:00.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.907+0000 7f12f250d700 1 -- 172.21.15.45:0/806062320 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12ec100ac0 msgr2=0x7f12ec100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:00.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.907+0000 7f12f250d700 1 --2- 172.21.15.45:0/806062320 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12ec100ac0 0x7f12ec100ed0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f12dc009990 tx=0x7f12dc009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.907+0000 7f12f250d700 1 -- 172.21.15.45:0/806062320 shutdown_connections 2024-05-10T03:39:00.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.907+0000 7f12f250d700 1 --2- 172.21.15.45:0/806062320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12ec102580 0x7f12ec108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.907+0000 7f12f250d700 1 --2- 172.21.15.45:0/806062320 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12ec100ac0 0x7f12ec100ed0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.907+0000 7f12f250d700 1 --2- 172.21.15.45:0/806062320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12ec101be0 0x7f12ec101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.907+0000 7f12f250d700 1 -- 172.21.15.45:0/806062320 >> 172.21.15.45:0/806062320 conn(0x7f12ec0fc0d0 msgr2=0x7f12ec0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:00.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.907+0000 7f12f250d700 1 -- 172.21.15.45:0/806062320 shutdown_connections 2024-05-10T03:39:00.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.907+0000 7f12f250d700 1 -- 172.21.15.45:0/806062320 wait complete. 2024-05-10T03:39:00.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.908+0000 7f12f250d700 1 Processor -- start 2024-05-10T03:39:00.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.908+0000 7f12f250d700 1 -- start start 2024-05-10T03:39:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.908+0000 7f12f250d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12ec100ac0 0x7f12ec1980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.908+0000 7f12f250d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12ec101be0 0x7f12ec198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.908+0000 7f12f250d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12ec102580 0x7f12ec19f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:00.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.908+0000 7f12f250d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec19fbc0 con 0x7f12ec101be0 2024-05-10T03:39:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.908+0000 7f12f250d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec19fd30 con 0x7f12ec100ac0 2024-05-10T03:39:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.908+0000 7f12f250d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec19fef0 con 0x7f12ec102580 2024-05-10T03:39:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.908+0000 7f12eb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12ec101be0 0x7f12ec198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.908+0000 7f12eb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12ec101be0 0x7f12ec198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60058/0 (socket says 172.21.15.45:60058) 2024-05-10T03:39:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.908+0000 7f12eb7fe700 1 -- 172.21.15.45:0/895361876 learned_addr learned my addr 172.21.15.45:0/895361876 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.908+0000 7f12ebfff700 1 --2- 172.21.15.45:0/895361876 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12ec100ac0 0x7f12ec1980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.908+0000 7f12f0aaa700 1 --2- 172.21.15.45:0/895361876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12ec102580 0x7f12ec19f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.909+0000 7f12eb7fe700 1 -- 172.21.15.45:0/895361876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12ec102580 msgr2=0x7f12ec19f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.909+0000 7f12eb7fe700 1 --2- 172.21.15.45:0/895361876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12ec102580 0x7f12ec19f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.909+0000 7f12eb7fe700 1 -- 172.21.15.45:0/895361876 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12ec100ac0 msgr2=0x7f12ec1980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:00.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.909+0000 7f12eb7fe700 1 --2- 172.21.15.45:0/895361876 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12ec100ac0 0x7f12ec1980e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:00.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.909+0000 7f12eb7fe700 1 -- 172.21.15.45:0/895361876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc0095f0 con 0x7f12ec101be0 2024-05-10T03:39:00.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.909+0000 7f12eb7fe700 1 --2- 172.21.15.45:0/895361876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12ec101be0 0x7f12ec198620 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f12e000d950 tx=0x7f12e000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:00.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.909+0000 7f12e97fa700 1 -- 172.21.15.45:0/895361876 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e000f890 con 0x7f12ec101be0 2024-05-10T03:39:00.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.909+0000 7f12f250d700 1 -- 172.21.15.45:0/895361876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12ec1a01d0 con 0x7f12ec101be0 2024-05-10T03:39:00.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.909+0000 7f12f250d700 1 -- 172.21.15.45:0/895361876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12ec1a0730 con 0x7f12ec101be0 2024-05-10T03:39:00.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.909+0000 7f12e97fa700 1 -- 172.21.15.45:0/895361876 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f12e0010460 con 0x7f12ec101be0 2024-05-10T03:39:00.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.909+0000 7f12e97fa700 1 -- 172.21.15.45:0/895361876 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e000e610 con 0x7f12ec101be0 2024-05-10T03:39:00.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.910+0000 7f12f250d700 1 -- 172.21.15.45:0/895361876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d80052f0 con 0x7f12ec101be0 2024-05-10T03:39:00.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.912+0000 7f12e97fa700 1 -- 172.21.15.45:0/895361876 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f12e000f9f0 con 0x7f12ec101be0 2024-05-10T03:39:00.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.912+0000 7f12e97fa700 1 --2- 172.21.15.45:0/895361876 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f12d40a11b0 0x7f12d40a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:00.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.913+0000 7f12e97fa700 1 -- 172.21.15.45:0/895361876 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f12e00ccf10 con 0x7f12ec101be0 2024-05-10T03:39:00.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.913+0000 7f12ebfff700 1 --2- 172.21.15.45:0/895361876 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f12d40a11b0 0x7f12d40a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:00.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.913+0000 7f12ebfff700 1 --2- 172.21.15.45:0/895361876 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f12d40a11b0 0x7f12d40a36c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f12dc006010 tx=0x7f12dc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:00.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:00.916+0000 7f12e97fa700 1 -- 172.21.15.45:0/895361876 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f12e0099d80 con 0x7f12ec101be0 2024-05-10T03:39:01.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:00 smithi045 ceph-mon[42520]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:01.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:00 smithi045 ceph-mon[42520]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:01.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:01 smithi045 ceph-mon[42520]: pgmap v243: 129 pgs: 129 active+clean; 621 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s wr, 8 op/s 2024-05-10T03:39:01.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:01 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] up:active 2024-05-10T03:39:01.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:01 smithi045 ceph-mon[42520]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-10T03:39:01.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:01 smithi045 ceph-mon[42520]: mgrmap e17: x(active, since 5m), standbys: z, y 2024-05-10T03:39:01.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:01 smithi045 ceph-mon[42520]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:39:01.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:01 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1853739944' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:39:01.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.138+0000 7f12f250d700 1 -- 172.21.15.45:0/895361876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12d8005160 con 0x7f12ec101be0 2024-05-10T03:39:01.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.139+0000 7f12e97fa700 1 -- 172.21.15.45:0/895361876 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+23981 (secure 0 0 0) 0x7f12e0016090 con 0x7f12ec101be0 2024-05-10T03:39:01.142 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:39:01.142 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":86,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:38:42.069624+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:38:34.871801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:38:35.935386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T03:38:39.029903+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:39:01.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.142+0000 7f12f250d700 1 -- 172.21.15.45:0/895361876 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f12d40a11b0 msgr2=0x7f12d40a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:01.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.142+0000 7f12f250d700 1 --2- 172.21.15.45:0/895361876 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f12d40a11b0 0x7f12d40a36c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f12dc006010 tx=0x7f12dc01a040 comp rx=0 tx=0).stop 2024-05-10T03:39:01.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.142+0000 7f12f250d700 1 -- 172.21.15.45:0/895361876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12ec101be0 msgr2=0x7f12ec198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:01.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.142+0000 7f12f250d700 1 --2- 172.21.15.45:0/895361876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12ec101be0 0x7f12ec198620 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f12e000d950 tx=0x7f12e000dc60 comp rx=0 tx=0).stop 2024-05-10T03:39:01.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.142+0000 7f12f250d700 1 -- 172.21.15.45:0/895361876 shutdown_connections 2024-05-10T03:39:01.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.142+0000 7f12f250d700 1 --2- 172.21.15.45:0/895361876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12ec102580 0x7f12ec19f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:01.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.142+0000 7f12f250d700 1 --2- 172.21.15.45:0/895361876 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f12d40a11b0 0x7f12d40a36c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:01.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.142+0000 7f12f250d700 1 --2- 172.21.15.45:0/895361876 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12ec100ac0 0x7f12ec1980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:01.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.142+0000 7f12f250d700 1 --2- 172.21.15.45:0/895361876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12ec101be0 0x7f12ec198620 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:01.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.142+0000 7f12f250d700 1 -- 172.21.15.45:0/895361876 >> 172.21.15.45:0/895361876 conn(0x7f12ec0fc0d0 msgr2=0x7f12ec0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:01.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.142+0000 7f12f250d700 1 -- 172.21.15.45:0/895361876 shutdown_connections 2024-05-10T03:39:01.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.142+0000 7f12f250d700 1 -- 172.21.15.45:0/895361876 wait complete. 2024-05-10T03:39:01.159 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-10T03:39:01.160 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T03:39:01.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.306+0000 7f6347279700 1 -- 172.21.15.45:0/3873076915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6340102580 msgr2=0x7f6340108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:01.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.306+0000 7f6347279700 1 --2- 172.21.15.45:0/3873076915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6340102580 0x7f6340108e30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f633800b0a0 tx=0x7f633800b3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:01.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.306+0000 7f6347279700 1 -- 172.21.15.45:0/3873076915 shutdown_connections 2024-05-10T03:39:01.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.306+0000 7f6347279700 1 --2- 172.21.15.45:0/3873076915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6340102580 0x7f6340108e30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:01.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.306+0000 7f6347279700 1 --2- 172.21.15.45:0/3873076915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6340100ac0 0x7f6340100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:01.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.306+0000 7f6347279700 1 --2- 172.21.15.45:0/3873076915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6340101be0 0x7f6340101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:01.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.306+0000 7f6347279700 1 -- 172.21.15.45:0/3873076915 >> 172.21.15.45:0/3873076915 conn(0x7f63400fc0d0 msgr2=0x7f63400fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:01.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.306+0000 7f6347279700 1 -- 172.21.15.45:0/3873076915 shutdown_connections 2024-05-10T03:39:01.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.306+0000 7f6347279700 1 -- 172.21.15.45:0/3873076915 wait complete. 2024-05-10T03:39:01.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.307+0000 7f6347279700 1 Processor -- start 2024-05-10T03:39:01.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.307+0000 7f6347279700 1 -- start start 2024-05-10T03:39:01.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.307+0000 7f6347279700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6340100ac0 0x7f6340197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:01.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.307+0000 7f6347279700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6340101be0 0x7f63401975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:01.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.307+0000 7f6347279700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6340102580 0x7f634019e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:01.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.307+0000 7f6347279700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634019eb60 con 0x7f6340101be0 2024-05-10T03:39:01.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.307+0000 7f6347279700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634019ecd0 con 0x7f6340100ac0 2024-05-10T03:39:01.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.307+0000 7f6347279700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634019ee90 con 0x7f6340102580 2024-05-10T03:39:01.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.307+0000 7f6344814700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6340101be0 0x7f63401975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:01.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.307+0000 7f6344814700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6340101be0 0x7f63401975c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60070/0 (socket says 172.21.15.45:60070) 2024-05-10T03:39:01.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.307+0000 7f6344814700 1 -- 172.21.15.45:0/3578235629 learned_addr learned my addr 172.21.15.45:0/3578235629 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:01.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.308+0000 7f6345015700 1 --2- 172.21.15.45:0/3578235629 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6340100ac0 0x7f6340197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:01.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.308+0000 7f6345816700 1 --2- 172.21.15.45:0/3578235629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6340102580 0x7f634019e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:01.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.308+0000 7f6344814700 1 -- 172.21.15.45:0/3578235629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6340102580 msgr2=0x7f634019e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:01.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.308+0000 7f6344814700 1 --2- 172.21.15.45:0/3578235629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6340102580 0x7f634019e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:01.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.308+0000 7f6344814700 1 -- 172.21.15.45:0/3578235629 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6340100ac0 msgr2=0x7f6340197080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:01.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.308+0000 7f6344814700 1 --2- 172.21.15.45:0/3578235629 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6340100ac0 0x7f6340197080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:01.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.308+0000 7f6344814700 1 -- 172.21.15.45:0/3578235629 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6338009d00 con 0x7f6340101be0 2024-05-10T03:39:01.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.308+0000 7f6344814700 1 --2- 172.21.15.45:0/3578235629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6340101be0 0x7f63401975c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f633000d950 tx=0x7f633000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:01.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.308+0000 7f63367fc700 1 -- 172.21.15.45:0/3578235629 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633000f890 con 0x7f6340101be0 2024-05-10T03:39:01.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.308+0000 7f63367fc700 1 -- 172.21.15.45:0/3578235629 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6330010460 con 0x7f6340101be0 2024-05-10T03:39:01.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.308+0000 7f63367fc700 1 -- 172.21.15.45:0/3578235629 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633000e610 con 0x7f6340101be0 2024-05-10T03:39:01.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.308+0000 7f6347279700 1 -- 172.21.15.45:0/3578235629 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f634019f170 con 0x7f6340101be0 2024-05-10T03:39:01.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.308+0000 7f6347279700 1 -- 172.21.15.45:0/3578235629 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634019f680 con 0x7f6340101be0 2024-05-10T03:39:01.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.309+0000 7f6347279700 1 -- 172.21.15.45:0/3578235629 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6340107cd0 con 0x7f6340101be0 2024-05-10T03:39:01.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.311+0000 7f63367fc700 1 -- 172.21.15.45:0/3578235629 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f6330010960 con 0x7f6340101be0 2024-05-10T03:39:01.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.311+0000 7f63367fc700 1 --2- 172.21.15.45:0/3578235629 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f632c0a1230 0x7f632c0a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:01.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.312+0000 7f6345015700 1 --2- 172.21.15.45:0/3578235629 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f632c0a1230 0x7f632c0a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:01.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.312+0000 7f63367fc700 1 -- 172.21.15.45:0/3578235629 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f63300cc9b0 con 0x7f6340101be0 2024-05-10T03:39:01.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.312+0000 7f6345015700 1 --2- 172.21.15.45:0/3578235629 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f632c0a1230 0x7f632c0a3740 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6340101ae0 tx=0x7f633c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:01.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.316+0000 7f63367fc700 1 -- 172.21.15.45:0/3578235629 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6330095df0 con 0x7f6340101be0 2024-05-10T03:39:01.401 INFO:journalctl@ceph.mds.b.smithi106.stdout:May 10 03:39:01 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-b[84354]: 2024-05-10T03:39:01.061+0000 7fb8b63e2700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-05-10T03:39:01.401 INFO:journalctl@ceph.mds.b.smithi106.stdout:May 10 03:39:01 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-b[84354]: 2024-05-10T03:39:01.061+0000 7fb8b63e2700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-05-10T03:39:01.401 INFO:journalctl@ceph.mds.b.smithi106.stdout:May 10 03:39:01 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-b[84354]: 2024-05-10T03:39:01.061+0000 7fb8b63e2700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-05-10T03:39:01.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:01 smithi106 ceph-mon[46996]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:01.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:01 smithi106 ceph-mon[46996]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:01.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:01 smithi106 ceph-mon[46996]: pgmap v243: 129 pgs: 129 active+clean; 621 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s wr, 8 op/s 2024-05-10T03:39:01.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:01 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] up:active 2024-05-10T03:39:01.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:01 smithi106 ceph-mon[46996]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-10T03:39:01.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:01 smithi106 ceph-mon[46996]: mgrmap e17: x(active, since 5m), standbys: z, y 2024-05-10T03:39:01.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:01 smithi106 ceph-mon[46996]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:39:01.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:01 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1853739944' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:39:01.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:01 smithi154 ceph-mon[46565]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:01.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:01 smithi154 ceph-mon[46565]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:01.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:01 smithi154 ceph-mon[46565]: pgmap v243: 129 pgs: 129 active+clean; 621 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s wr, 8 op/s 2024-05-10T03:39:01.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:01 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] up:active 2024-05-10T03:39:01.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:01 smithi154 ceph-mon[46565]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-10T03:39:01.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:01 smithi154 ceph-mon[46565]: mgrmap e17: x(active, since 5m), standbys: z, y 2024-05-10T03:39:01.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:01 smithi154 ceph-mon[46565]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:39:01.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:01 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1853739944' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:39:01.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.529+0000 7f6347279700 1 -- 172.21.15.45:0/3578235629 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6340061650 con 0x7f632c0a1230 2024-05-10T03:39:01.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.543+0000 7f63367fc700 1 -- 172.21.15.45:0/3578235629 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+417951 (secure 0 0 0) 0x7f6340061650 con 0x7f632c0a1230 2024-05-10T03:39:01.552 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:39:01.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.547+0000 7f6347279700 1 -- 172.21.15.45:0/3578235629 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f632c0a1230 msgr2=0x7f632c0a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:01.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.547+0000 7f6347279700 1 --2- 172.21.15.45:0/3578235629 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f632c0a1230 0x7f632c0a3740 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6340101ae0 tx=0x7f633c00b410 comp rx=0 tx=0).stop 2024-05-10T03:39:01.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.547+0000 7f6347279700 1 -- 172.21.15.45:0/3578235629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6340101be0 msgr2=0x7f63401975c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:01.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.547+0000 7f6347279700 1 --2- 172.21.15.45:0/3578235629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6340101be0 0x7f63401975c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f633000d950 tx=0x7f633000dc60 comp rx=0 tx=0).stop 2024-05-10T03:39:01.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.548+0000 7f6347279700 1 -- 172.21.15.45:0/3578235629 shutdown_connections 2024-05-10T03:39:01.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.548+0000 7f6347279700 1 --2- 172.21.15.45:0/3578235629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6340102580 0x7f634019e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:01.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.548+0000 7f6347279700 1 --2- 172.21.15.45:0/3578235629 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f632c0a1230 0x7f632c0a3740 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:01.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.548+0000 7f6347279700 1 --2- 172.21.15.45:0/3578235629 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6340100ac0 0x7f6340197080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:01.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.548+0000 7f6347279700 1 --2- 172.21.15.45:0/3578235629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6340101be0 0x7f63401975c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:01.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.548+0000 7f6347279700 1 -- 172.21.15.45:0/3578235629 >> 172.21.15.45:0/3578235629 conn(0x7f63400fc0d0 msgr2=0x7f6340104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:01.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.548+0000 7f6347279700 1 -- 172.21.15.45:0/3578235629 shutdown_connections 2024-05-10T03:39:01.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.548+0000 7f6347279700 1 -- 172.21.15.45:0/3578235629 wait complete. 2024-05-10T03:39:01.558 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-05-10T03:39:01.565 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":243,"stamp":"2024-05-10T03:38:59.879434+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":635464,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":327,"num_write_kb":3031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361884,"kb_used_data":13100,"kb_used_omap":18,"kb_used_meta":348653,"kb_avail":1124579940,"statfs":{"total":1151940427776,"available":1151569858560,"internally_reserved":0,"allocated":13414400,"data_stored":7388775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19129,"internal_metadata":357020999},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":42734,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004205"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145959+0000","last_change":"2024-05-10T03:38:36.586241+0000","last_active":"2024-05-10T03:38:41.145959+0000","last_peered":"2024-05-10T03:38:41.145959+0000","last_clean":"2024-05-10T03:38:41.145959+0000","last_became_active":"2024-05-10T03:38:36.585655+0000","last_became_peered":"2024-05-10T03:38:36.585655+0000","last_unstale":"2024-05-10T03:38:41.145959+0000","last_undegraded":"2024-05-10T03:38:41.145959+0000","last_fullsized":"2024-05-10T03:38:41.145959+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:58:24.614952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145158+0000","last_change":"2024-05-10T03:38:36.588174+0000","last_active":"2024-05-10T03:38:41.145158+0000","last_peered":"2024-05-10T03:38:41.145158+0000","last_clean":"2024-05-10T03:38:41.145158+0000","last_became_active":"2024-05-10T03:38:36.587843+0000","last_became_peered":"2024-05-10T03:38:36.587843+0000","last_unstale":"2024-05-10T03:38:41.145158+0000","last_undegraded":"2024-05-10T03:38:41.145158+0000","last_fullsized":"2024-05-10T03:38:41.145158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:56.414407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145210+0000","last_change":"2024-05-10T03:38:36.587344+0000","last_active":"2024-05-10T03:38:41.145210+0000","last_peered":"2024-05-10T03:38:41.145210+0000","last_clean":"2024-05-10T03:38:41.145210+0000","last_became_active":"2024-05-10T03:38:36.586345+0000","last_became_peered":"2024-05-10T03:38:36.586345+0000","last_unstale":"2024-05-10T03:38:41.145210+0000","last_undegraded":"2024-05-10T03:38:41.145210+0000","last_fullsized":"2024-05-10T03:38:41.145210+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:36.159864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.146233+0000","last_change":"2024-05-10T03:38:36.573019+0000","last_active":"2024-05-10T03:38:41.146233+0000","last_peered":"2024-05-10T03:38:41.146233+0000","last_clean":"2024-05-10T03:38:41.146233+0000","last_became_active":"2024-05-10T03:38:36.572667+0000","last_became_peered":"2024-05-10T03:38:36.572667+0000","last_unstale":"2024-05-10T03:38:41.146233+0000","last_undegraded":"2024-05-10T03:38:41.146233+0000","last_fullsized":"2024-05-10T03:38:41.146233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:24:23.722642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145744+0000","last_change":"2024-05-10T03:38:36.577069+0000","last_active":"2024-05-10T03:38:41.145744+0000","last_peered":"2024-05-10T03:38:41.145744+0000","last_clean":"2024-05-10T03:38:41.145744+0000","last_became_active":"2024-05-10T03:38:36.576683+0000","last_became_peered":"2024-05-10T03:38:36.576683+0000","last_unstale":"2024-05-10T03:38:41.145744+0000","last_undegraded":"2024-05-10T03:38:41.145744+0000","last_fullsized":"2024-05-10T03:38:41.145744+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:09:15.280098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.148508+0000","last_change":"2024-05-10T03:38:36.577518+0000","last_active":"2024-05-10T03:38:41.148508+0000","last_peered":"2024-05-10T03:38:41.148508+0000","last_clean":"2024-05-10T03:38:41.148508+0000","last_became_active":"2024-05-10T03:38:36.577147+0000","last_became_peered":"2024-05-10T03:38:36.577147+0000","last_unstale":"2024-05-10T03:38:41.148508+0000","last_undegraded":"2024-05-10T03:38:41.148508+0000","last_fullsized":"2024-05-10T03:38:41.148508+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:39:42.779405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.072733+0000","last_change":"2024-05-10T03:38:36.594241+0000","last_active":"2024-05-10T03:38:41.072733+0000","last_peered":"2024-05-10T03:38:41.072733+0000","last_clean":"2024-05-10T03:38:41.072733+0000","last_became_active":"2024-05-10T03:38:36.593943+0000","last_became_peered":"2024-05-10T03:38:36.593943+0000","last_unstale":"2024-05-10T03:38:41.072733+0000","last_undegraded":"2024-05-10T03:38:41.072733+0000","last_fullsized":"2024-05-10T03:38:41.072733+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:00.521083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.144983+0000","last_change":"2024-05-10T03:38:36.578318+0000","last_active":"2024-05-10T03:38:41.144983+0000","last_peered":"2024-05-10T03:38:41.144983+0000","last_clean":"2024-05-10T03:38:41.144983+0000","last_became_active":"2024-05-10T03:38:36.577967+0000","last_became_peered":"2024-05-10T03:38:36.577967+0000","last_unstale":"2024-05-10T03:38:41.144983+0000","last_undegraded":"2024-05-10T03:38:41.144983+0000","last_fullsized":"2024-05-10T03:38:41.144983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:45:27.988368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145721+0000","last_change":"2024-05-10T03:38:36.590219+0000","last_active":"2024-05-10T03:38:41.145721+0000","last_peered":"2024-05-10T03:38:41.145721+0000","last_clean":"2024-05-10T03:38:41.145721+0000","last_became_active":"2024-05-10T03:38:36.589849+0000","last_became_peered":"2024-05-10T03:38:36.589849+0000","last_unstale":"2024-05-10T03:38:41.145721+0000","last_undegraded":"2024-05-10T03:38:41.145721+0000","last_fullsized":"2024-05-10T03:38:41.145721+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:08:17.073204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.149019+0000","last_change":"2024-05-10T03:38:36.580555+0000","last_active":"2024-05-10T03:38:41.149019+0000","last_peered":"2024-05-10T03:38:41.149019+0000","last_clean":"2024-05-10T03:38:41.149019+0000","last_became_active":"2024-05-10T03:38:36.577575+0000","last_became_peered":"2024-05-10T03:38:36.577575+0000","last_unstale":"2024-05-10T03:38:41.149019+0000","last_undegraded":"2024-05-10T03:38:41.149019+0000","last_fullsized":"2024-05-10T03:38:41.149019+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:43:29.237054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.073279+0000","last_change":"2024-05-10T03:38:36.586599+0000","last_active":"2024-05-10T03:38:41.073279+0000","last_peered":"2024-05-10T03:38:41.073279+0000","last_clean":"2024-05-10T03:38:41.073279+0000","last_became_active":"2024-05-10T03:38:36.585794+0000","last_became_peered":"2024-05-10T03:38:36.585794+0000","last_unstale":"2024-05-10T03:38:41.073279+0000","last_undegraded":"2024-05-10T03:38:41.073279+0000","last_fullsized":"2024-05-10T03:38:41.073279+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:25:18.337715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.146131+0000","last_change":"2024-05-10T03:38:36.578957+0000","last_active":"2024-05-10T03:38:41.146131+0000","last_peered":"2024-05-10T03:38:41.146131+0000","last_clean":"2024-05-10T03:38:41.146131+0000","last_became_active":"2024-05-10T03:38:36.578636+0000","last_became_peered":"2024-05-10T03:38:36.578636+0000","last_unstale":"2024-05-10T03:38:41.146131+0000","last_undegraded":"2024-05-10T03:38:41.146131+0000","last_fullsized":"2024-05-10T03:38:41.146131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:55:38.830864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.072535+0000","last_change":"2024-05-10T03:38:36.583397+0000","last_active":"2024-05-10T03:38:41.072535+0000","last_peered":"2024-05-10T03:38:41.072535+0000","last_clean":"2024-05-10T03:38:41.072535+0000","last_became_active":"2024-05-10T03:38:36.583054+0000","last_became_peered":"2024-05-10T03:38:36.583054+0000","last_unstale":"2024-05-10T03:38:41.072535+0000","last_undegraded":"2024-05-10T03:38:41.072535+0000","last_fullsized":"2024-05-10T03:38:41.072535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:52:24.223963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.144943+0000","last_change":"2024-05-10T03:38:36.590205+0000","last_active":"2024-05-10T03:38:41.144943+0000","last_peered":"2024-05-10T03:38:41.144943+0000","last_clean":"2024-05-10T03:38:41.144943+0000","last_became_active":"2024-05-10T03:38:36.589880+0000","last_became_peered":"2024-05-10T03:38:36.589880+0000","last_unstale":"2024-05-10T03:38:41.144943+0000","last_undegraded":"2024-05-10T03:38:41.144943+0000","last_fullsized":"2024-05-10T03:38:41.144943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:22:26.374034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145486+0000","last_change":"2024-05-10T03:38:36.575776+0000","last_active":"2024-05-10T03:38:41.145486+0000","last_peered":"2024-05-10T03:38:41.145486+0000","last_clean":"2024-05-10T03:38:41.145486+0000","last_became_active":"2024-05-10T03:38:36.575431+0000","last_became_peered":"2024-05-10T03:38:36.575431+0000","last_unstale":"2024-05-10T03:38:41.145486+0000","last_undegraded":"2024-05-10T03:38:41.145486+0000","last_fullsized":"2024-05-10T03:38:41.145486+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:05.252117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145073+0000","last_change":"2024-05-10T03:38:36.591061+0000","last_active":"2024-05-10T03:38:41.145073+0000","last_peered":"2024-05-10T03:38:41.145073+0000","last_clean":"2024-05-10T03:38:41.145073+0000","last_became_active":"2024-05-10T03:38:36.590698+0000","last_became_peered":"2024-05-10T03:38:36.590698+0000","last_unstale":"2024-05-10T03:38:41.145073+0000","last_undegraded":"2024-05-10T03:38:41.145073+0000","last_fullsized":"2024-05-10T03:38:41.145073+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:44:43.130908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145856+0000","last_change":"2024-05-10T03:38:36.585990+0000","last_active":"2024-05-10T03:38:41.145856+0000","last_peered":"2024-05-10T03:38:41.145856+0000","last_clean":"2024-05-10T03:38:41.145856+0000","last_became_active":"2024-05-10T03:38:36.585221+0000","last_became_peered":"2024-05-10T03:38:36.585221+0000","last_unstale":"2024-05-10T03:38:41.145856+0000","last_undegraded":"2024-05-10T03:38:41.145856+0000","last_fullsized":"2024-05-10T03:38:41.145856+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:57:58.981790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.146899+0000","last_change":"2024-05-10T03:38:36.586651+0000","last_active":"2024-05-10T03:38:41.146899+0000","last_peered":"2024-05-10T03:38:41.146899+0000","last_clean":"2024-05-10T03:38:41.146899+0000","last_became_active":"2024-05-10T03:38:36.586243+0000","last_became_peered":"2024-05-10T03:38:36.586243+0000","last_unstale":"2024-05-10T03:38:41.146899+0000","last_undegraded":"2024-05-10T03:38:41.146899+0000","last_fullsized":"2024-05-10T03:38:41.146899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:15:58.148040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.073617+0000","last_change":"2024-05-10T03:38:36.583740+0000","last_active":"2024-05-10T03:38:41.073617+0000","last_peered":"2024-05-10T03:38:41.073617+0000","last_clean":"2024-05-10T03:38:41.073617+0000","last_became_active":"2024-05-10T03:38:36.583359+0000","last_became_peered":"2024-05-10T03:38:36.583359+0000","last_unstale":"2024-05-10T03:38:41.073617+0000","last_undegraded":"2024-05-10T03:38:41.073617+0000","last_fullsized":"2024-05-10T03:38:41.073617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:31:29.286667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.129220+0000","last_change":"2024-05-10T03:38:40.605484+0000","last_active":"2024-05-10T03:38:42.129220+0000","last_peered":"2024-05-10T03:38:42.129220+0000","last_clean":"2024-05-10T03:38:42.129220+0000","last_became_active":"2024-05-10T03:38:40.605105+0000","last_became_peered":"2024-05-10T03:38:40.605105+0000","last_unstale":"2024-05-10T03:38:42.129220+0000","last_undegraded":"2024-05-10T03:38:42.129220+0000","last_fullsized":"2024-05-10T03:38:42.129220+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:11:34.548916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.147218+0000","last_change":"2024-05-10T03:38:36.093877+0000","last_active":"2024-05-10T03:38:41.147218+0000","last_peered":"2024-05-10T03:38:41.147218+0000","last_clean":"2024-05-10T03:38:41.147218+0000","last_became_active":"2024-05-10T03:38:36.093499+0000","last_became_peered":"2024-05-10T03:38:36.093499+0000","last_unstale":"2024-05-10T03:38:41.147218+0000","last_undegraded":"2024-05-10T03:38:41.147218+0000","last_fullsized":"2024-05-10T03:38:41.147218+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:42:17.171167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145352+0000","last_change":"2024-05-10T03:38:36.570924+0000","last_active":"2024-05-10T03:38:41.145352+0000","last_peered":"2024-05-10T03:38:41.145352+0000","last_clean":"2024-05-10T03:38:41.145352+0000","last_became_active":"2024-05-10T03:38:36.569038+0000","last_became_peered":"2024-05-10T03:38:36.569038+0000","last_unstale":"2024-05-10T03:38:41.145352+0000","last_undegraded":"2024-05-10T03:38:41.145352+0000","last_fullsized":"2024-05-10T03:38:41.145352+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:35:20.327463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145007+0000","last_change":"2024-05-10T03:38:40.608982+0000","last_active":"2024-05-10T03:38:41.145007+0000","last_peered":"2024-05-10T03:38:41.145007+0000","last_clean":"2024-05-10T03:38:41.145007+0000","last_became_active":"2024-05-10T03:38:40.608619+0000","last_became_peered":"2024-05-10T03:38:40.608619+0000","last_unstale":"2024-05-10T03:38:41.145007+0000","last_undegraded":"2024-05-10T03:38:41.145007+0000","last_fullsized":"2024-05-10T03:38:41.145007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:35:56.411530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.074010+0000","last_change":"2024-05-10T03:38:36.101669+0000","last_active":"2024-05-10T03:38:42.074010+0000","last_peered":"2024-05-10T03:38:42.074010+0000","last_clean":"2024-05-10T03:38:42.074010+0000","last_became_active":"2024-05-10T03:38:36.101231+0000","last_became_peered":"2024-05-10T03:38:36.101231+0000","last_unstale":"2024-05-10T03:38:42.074010+0000","last_undegraded":"2024-05-10T03:38:42.074010+0000","last_fullsized":"2024-05-10T03:38:42.074010+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:42:21.992880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145866+0000","last_change":"2024-05-10T03:38:36.585580+0000","last_active":"2024-05-10T03:38:41.145866+0000","last_peered":"2024-05-10T03:38:41.145866+0000","last_clean":"2024-05-10T03:38:41.145866+0000","last_became_active":"2024-05-10T03:38:36.585239+0000","last_became_peered":"2024-05-10T03:38:36.585239+0000","last_unstale":"2024-05-10T03:38:41.145866+0000","last_undegraded":"2024-05-10T03:38:41.145866+0000","last_fullsized":"2024-05-10T03:38:41.145866+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:39:42.886154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145751+0000","last_change":"2024-05-10T03:38:40.610372+0000","last_active":"2024-05-10T03:38:41.145751+0000","last_peered":"2024-05-10T03:38:41.145751+0000","last_clean":"2024-05-10T03:38:41.145751+0000","last_became_active":"2024-05-10T03:38:40.609958+0000","last_became_peered":"2024-05-10T03:38:40.609958+0000","last_unstale":"2024-05-10T03:38:41.145751+0000","last_undegraded":"2024-05-10T03:38:41.145751+0000","last_fullsized":"2024-05-10T03:38:41.145751+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:04:37.461729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'7","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:57.993891+0000","last_change":"2024-05-10T03:38:36.091809+0000","last_active":"2024-05-10T03:38:57.993891+0000","last_peered":"2024-05-10T03:38:57.993891+0000","last_clean":"2024-05-10T03:38:57.993891+0000","last_became_active":"2024-05-10T03:38:36.091372+0000","last_became_peered":"2024-05-10T03:38:36.091372+0000","last_unstale":"2024-05-10T03:38:57.993891+0000","last_undegraded":"2024-05-10T03:38:57.993891+0000","last_fullsized":"2024-05-10T03:38:57.993891+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:25:01.784559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.146062+0000","last_change":"2024-05-10T03:38:36.595389+0000","last_active":"2024-05-10T03:38:41.146062+0000","last_peered":"2024-05-10T03:38:41.146062+0000","last_clean":"2024-05-10T03:38:41.146062+0000","last_became_active":"2024-05-10T03:38:36.595011+0000","last_became_peered":"2024-05-10T03:38:36.595011+0000","last_unstale":"2024-05-10T03:38:41.146062+0000","last_undegraded":"2024-05-10T03:38:41.146062+0000","last_fullsized":"2024-05-10T03:38:41.146062+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:54:38.377508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145283+0000","last_change":"2024-05-10T03:38:40.605656+0000","last_active":"2024-05-10T03:38:41.145283+0000","last_peered":"2024-05-10T03:38:41.145283+0000","last_clean":"2024-05-10T03:38:41.145283+0000","last_became_active":"2024-05-10T03:38:40.605262+0000","last_became_peered":"2024-05-10T03:38:40.605262+0000","last_unstale":"2024-05-10T03:38:41.145283+0000","last_undegraded":"2024-05-10T03:38:41.145283+0000","last_fullsized":"2024-05-10T03:38:41.145283+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:11:27.398282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.146411+0000","last_change":"2024-05-10T03:38:36.090763+0000","last_active":"2024-05-10T03:38:41.146411+0000","last_peered":"2024-05-10T03:38:41.146411+0000","last_clean":"2024-05-10T03:38:41.146411+0000","last_became_active":"2024-05-10T03:38:36.089485+0000","last_became_peered":"2024-05-10T03:38:36.089485+0000","last_unstale":"2024-05-10T03:38:41.146411+0000","last_undegraded":"2024-05-10T03:38:41.146411+0000","last_fullsized":"2024-05-10T03:38:41.146411+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:33:33.111508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.146872+0000","last_change":"2024-05-10T03:38:36.587831+0000","last_active":"2024-05-10T03:38:41.146872+0000","last_peered":"2024-05-10T03:38:41.146872+0000","last_clean":"2024-05-10T03:38:41.146872+0000","last_became_active":"2024-05-10T03:38:36.587503+0000","last_became_peered":"2024-05-10T03:38:36.587503+0000","last_unstale":"2024-05-10T03:38:41.146872+0000","last_undegraded":"2024-05-10T03:38:41.146872+0000","last_fullsized":"2024-05-10T03:38:41.146872+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:52.335134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.129856+0000","last_change":"2024-05-10T03:38:40.601327+0000","last_active":"2024-05-10T03:38:42.129856+0000","last_peered":"2024-05-10T03:38:42.129856+0000","last_clean":"2024-05-10T03:38:42.129856+0000","last_became_active":"2024-05-10T03:38:40.600901+0000","last_became_peered":"2024-05-10T03:38:40.600901+0000","last_unstale":"2024-05-10T03:38:42.129856+0000","last_undegraded":"2024-05-10T03:38:42.129856+0000","last_fullsized":"2024-05-10T03:38:42.129856+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:28.285707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:55.959218+0000","last_change":"2024-05-10T03:38:36.094064+0000","last_active":"2024-05-10T03:38:55.959218+0000","last_peered":"2024-05-10T03:38:55.959218+0000","last_clean":"2024-05-10T03:38:55.959218+0000","last_became_active":"2024-05-10T03:38:36.093522+0000","last_became_peered":"2024-05-10T03:38:36.093522+0000","last_unstale":"2024-05-10T03:38:55.959218+0000","last_undegraded":"2024-05-10T03:38:55.959218+0000","last_fullsized":"2024-05-10T03:38:55.959218+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:25:14.257166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.147415+0000","last_change":"2024-05-10T03:38:36.580553+0000","last_active":"2024-05-10T03:38:41.147415+0000","last_peered":"2024-05-10T03:38:41.147415+0000","last_clean":"2024-05-10T03:38:41.147415+0000","last_became_active":"2024-05-10T03:38:36.580160+0000","last_became_peered":"2024-05-10T03:38:36.580160+0000","last_unstale":"2024-05-10T03:38:41.147415+0000","last_undegraded":"2024-05-10T03:38:41.147415+0000","last_fullsized":"2024-05-10T03:38:41.147415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:01:14.373430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.130220+0000","last_change":"2024-05-10T03:38:40.609034+0000","last_active":"2024-05-10T03:38:42.130220+0000","last_peered":"2024-05-10T03:38:42.130220+0000","last_clean":"2024-05-10T03:38:42.130220+0000","last_became_active":"2024-05-10T03:38:40.608617+0000","last_became_peered":"2024-05-10T03:38:40.608617+0000","last_unstale":"2024-05-10T03:38:42.130220+0000","last_undegraded":"2024-05-10T03:38:42.130220+0000","last_fullsized":"2024-05-10T03:38:42.130220+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:55:28.669881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:57.994047+0000","last_change":"2024-05-10T03:38:36.103661+0000","last_active":"2024-05-10T03:38:57.994047+0000","last_peered":"2024-05-10T03:38:57.994047+0000","last_clean":"2024-05-10T03:38:57.994047+0000","last_became_active":"2024-05-10T03:38:36.103379+0000","last_became_peered":"2024-05-10T03:38:36.103379+0000","last_unstale":"2024-05-10T03:38:57.994047+0000","last_undegraded":"2024-05-10T03:38:57.994047+0000","last_fullsized":"2024-05-10T03:38:57.994047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:10:42.082568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.146410+0000","last_change":"2024-05-10T03:38:36.569429+0000","last_active":"2024-05-10T03:38:41.146410+0000","last_peered":"2024-05-10T03:38:41.146410+0000","last_clean":"2024-05-10T03:38:41.146410+0000","last_became_active":"2024-05-10T03:38:36.569042+0000","last_became_peered":"2024-05-10T03:38:36.569042+0000","last_unstale":"2024-05-10T03:38:41.146410+0000","last_undegraded":"2024-05-10T03:38:41.146410+0000","last_fullsized":"2024-05-10T03:38:41.146410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:45:14.912428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.816597+0000","last_change":"2024-05-10T03:38:40.607734+0000","last_active":"2024-05-10T03:38:41.816597+0000","last_peered":"2024-05-10T03:38:41.816597+0000","last_clean":"2024-05-10T03:38:41.816597+0000","last_became_active":"2024-05-10T03:38:40.607331+0000","last_became_peered":"2024-05-10T03:38:40.607331+0000","last_unstale":"2024-05-10T03:38:41.816597+0000","last_undegraded":"2024-05-10T03:38:41.816597+0000","last_fullsized":"2024-05-10T03:38:41.816597+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:45:08.360275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:56.977936+0000","last_change":"2024-05-10T03:38:36.083651+0000","last_active":"2024-05-10T03:38:56.977936+0000","last_peered":"2024-05-10T03:38:56.977936+0000","last_clean":"2024-05-10T03:38:56.977936+0000","last_became_active":"2024-05-10T03:38:36.083235+0000","last_became_peered":"2024-05-10T03:38:36.083235+0000","last_unstale":"2024-05-10T03:38:56.977936+0000","last_undegraded":"2024-05-10T03:38:56.977936+0000","last_fullsized":"2024-05-10T03:38:56.977936+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:28:43.179157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145103+0000","last_change":"2024-05-10T03:38:36.579055+0000","last_active":"2024-05-10T03:38:41.145103+0000","last_peered":"2024-05-10T03:38:41.145103+0000","last_clean":"2024-05-10T03:38:41.145103+0000","last_became_active":"2024-05-10T03:38:36.578200+0000","last_became_peered":"2024-05-10T03:38:36.578200+0000","last_unstale":"2024-05-10T03:38:41.145103+0000","last_undegraded":"2024-05-10T03:38:41.145103+0000","last_fullsized":"2024-05-10T03:38:41.145103+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:48:12.749264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.129930+0000","last_change":"2024-05-10T03:38:40.603903+0000","last_active":"2024-05-10T03:38:42.129930+0000","last_peered":"2024-05-10T03:38:42.129930+0000","last_clean":"2024-05-10T03:38:42.129930+0000","last_became_active":"2024-05-10T03:38:40.603481+0000","last_became_peered":"2024-05-10T03:38:40.603481+0000","last_unstale":"2024-05-10T03:38:42.129930+0000","last_undegraded":"2024-05-10T03:38:42.129930+0000","last_fullsized":"2024-05-10T03:38:42.129930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:44:48.526838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:57.993474+0000","last_change":"2024-05-10T03:38:36.093549+0000","last_active":"2024-05-10T03:38:57.993474+0000","last_peered":"2024-05-10T03:38:57.993474+0000","last_clean":"2024-05-10T03:38:57.993474+0000","last_became_active":"2024-05-10T03:38:36.093244+0000","last_became_peered":"2024-05-10T03:38:36.093244+0000","last_unstale":"2024-05-10T03:38:57.993474+0000","last_undegraded":"2024-05-10T03:38:57.993474+0000","last_fullsized":"2024-05-10T03:38:57.993474+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:11:55.727728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.146777+0000","last_change":"2024-05-10T03:38:36.582623+0000","last_active":"2024-05-10T03:38:41.146777+0000","last_peered":"2024-05-10T03:38:41.146777+0000","last_clean":"2024-05-10T03:38:41.146777+0000","last_became_active":"2024-05-10T03:38:36.582262+0000","last_became_peered":"2024-05-10T03:38:36.582262+0000","last_unstale":"2024-05-10T03:38:41.146777+0000","last_undegraded":"2024-05-10T03:38:41.146777+0000","last_fullsized":"2024-05-10T03:38:41.146777+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:48.561206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.073557+0000","last_change":"2024-05-10T03:38:40.602050+0000","last_active":"2024-05-10T03:38:42.073557+0000","last_peered":"2024-05-10T03:38:42.073557+0000","last_clean":"2024-05-10T03:38:42.073557+0000","last_became_active":"2024-05-10T03:38:40.601699+0000","last_became_peered":"2024-05-10T03:38:40.601699+0000","last_unstale":"2024-05-10T03:38:42.073557+0000","last_undegraded":"2024-05-10T03:38:42.073557+0000","last_fullsized":"2024-05-10T03:38:42.073557+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:56.778636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:55.957804+0000","last_change":"2024-05-10T03:38:36.095747+0000","last_active":"2024-05-10T03:38:55.957804+0000","last_peered":"2024-05-10T03:38:55.957804+0000","last_clean":"2024-05-10T03:38:55.957804+0000","last_became_active":"2024-05-10T03:38:36.095371+0000","last_became_peered":"2024-05-10T03:38:36.095371+0000","last_unstale":"2024-05-10T03:38:55.957804+0000","last_undegraded":"2024-05-10T03:38:55.957804+0000","last_fullsized":"2024-05-10T03:38:55.957804+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:02:37.435286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145526+0000","last_change":"2024-05-10T03:38:36.591321+0000","last_active":"2024-05-10T03:38:41.145526+0000","last_peered":"2024-05-10T03:38:41.145526+0000","last_clean":"2024-05-10T03:38:41.145526+0000","last_became_active":"2024-05-10T03:38:36.589852+0000","last_became_peered":"2024-05-10T03:38:36.589852+0000","last_unstale":"2024-05-10T03:38:41.145526+0000","last_undegraded":"2024-05-10T03:38:41.145526+0000","last_fullsized":"2024-05-10T03:38:41.145526+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:43.075901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.667123+0000","last_change":"2024-05-10T03:38:40.605096+0000","last_active":"2024-05-10T03:38:41.667123+0000","last_peered":"2024-05-10T03:38:41.667123+0000","last_clean":"2024-05-10T03:38:41.667123+0000","last_became_active":"2024-05-10T03:38:40.604595+0000","last_became_peered":"2024-05-10T03:38:40.604595+0000","last_unstale":"2024-05-10T03:38:41.667123+0000","last_undegraded":"2024-05-10T03:38:41.667123+0000","last_fullsized":"2024-05-10T03:38:41.667123+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:14.547025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.073084+0000","last_change":"2024-05-10T03:38:36.097214+0000","last_active":"2024-05-10T03:38:41.073084+0000","last_peered":"2024-05-10T03:38:41.073084+0000","last_clean":"2024-05-10T03:38:41.073084+0000","last_became_active":"2024-05-10T03:38:36.096835+0000","last_became_peered":"2024-05-10T03:38:36.096835+0000","last_unstale":"2024-05-10T03:38:41.073084+0000","last_undegraded":"2024-05-10T03:38:41.073084+0000","last_fullsized":"2024-05-10T03:38:41.073084+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:50.757974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145962+0000","last_change":"2024-05-10T03:38:36.591118+0000","last_active":"2024-05-10T03:38:41.145962+0000","last_peered":"2024-05-10T03:38:41.145962+0000","last_clean":"2024-05-10T03:38:41.145962+0000","last_became_active":"2024-05-10T03:38:36.590726+0000","last_became_peered":"2024-05-10T03:38:36.590726+0000","last_unstale":"2024-05-10T03:38:41.145962+0000","last_undegraded":"2024-05-10T03:38:41.145962+0000","last_fullsized":"2024-05-10T03:38:41.145962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:45:53.701069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145981+0000","last_change":"2024-05-10T03:38:40.605627+0000","last_active":"2024-05-10T03:38:41.145981+0000","last_peered":"2024-05-10T03:38:41.145981+0000","last_clean":"2024-05-10T03:38:41.145981+0000","last_became_active":"2024-05-10T03:38:40.605116+0000","last_became_peered":"2024-05-10T03:38:40.605116+0000","last_unstale":"2024-05-10T03:38:41.145981+0000","last_undegraded":"2024-05-10T03:38:41.145981+0000","last_fullsized":"2024-05-10T03:38:41.145981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:50:08.759725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:55.954258+0000","last_change":"2024-05-10T03:38:36.102257+0000","last_active":"2024-05-10T03:38:55.954258+0000","last_peered":"2024-05-10T03:38:55.954258+0000","last_clean":"2024-05-10T03:38:55.954258+0000","last_became_active":"2024-05-10T03:38:36.101876+0000","last_became_peered":"2024-05-10T03:38:36.101876+0000","last_unstale":"2024-05-10T03:38:55.954258+0000","last_undegraded":"2024-05-10T03:38:55.954258+0000","last_fullsized":"2024-05-10T03:38:55.954258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:38:01.164794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.146216+0000","last_change":"2024-05-10T03:38:36.591746+0000","last_active":"2024-05-10T03:38:41.146216+0000","last_peered":"2024-05-10T03:38:41.146216+0000","last_clean":"2024-05-10T03:38:41.146216+0000","last_became_active":"2024-05-10T03:38:36.591474+0000","last_became_peered":"2024-05-10T03:38:36.591474+0000","last_unstale":"2024-05-10T03:38:41.146216+0000","last_undegraded":"2024-05-10T03:38:41.146216+0000","last_fullsized":"2024-05-10T03:38:41.146216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:18:02.773737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.667154+0000","last_change":"2024-05-10T03:38:40.605956+0000","last_active":"2024-05-10T03:38:41.667154+0000","last_peered":"2024-05-10T03:38:41.667154+0000","last_clean":"2024-05-10T03:38:41.667154+0000","last_became_active":"2024-05-10T03:38:40.605466+0000","last_became_peered":"2024-05-10T03:38:40.605466+0000","last_unstale":"2024-05-10T03:38:41.667154+0000","last_undegraded":"2024-05-10T03:38:41.667154+0000","last_fullsized":"2024-05-10T03:38:41.667154+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:07:44.234771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"86'25","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:59.828390+0000","last_change":"2024-05-10T03:38:36.097746+0000","last_active":"2024-05-10T03:38:59.828390+0000","last_peered":"2024-05-10T03:38:59.828390+0000","last_clean":"2024-05-10T03:38:59.828390+0000","last_became_active":"2024-05-10T03:38:36.097269+0000","last_became_peered":"2024-05-10T03:38:36.097269+0000","last_unstale":"2024-05-10T03:38:59.828390+0000","last_undegraded":"2024-05-10T03:38:59.828390+0000","last_fullsized":"2024-05-10T03:38:59.828390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:47:07.830787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40427,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.146676+0000","last_change":"2024-05-10T03:38:36.579560+0000","last_active":"2024-05-10T03:38:41.146676+0000","last_peered":"2024-05-10T03:38:41.146676+0000","last_clean":"2024-05-10T03:38:41.146676+0000","last_became_active":"2024-05-10T03:38:36.579217+0000","last_became_peered":"2024-05-10T03:38:36.579217+0000","last_unstale":"2024-05-10T03:38:41.146676+0000","last_undegraded":"2024-05-10T03:38:41.146676+0000","last_fullsized":"2024-05-10T03:38:41.146676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:11:50.208794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.074671+0000","last_change":"2024-05-10T03:38:40.599253+0000","last_active":"2024-05-10T03:38:42.074671+0000","last_peered":"2024-05-10T03:38:42.074671+0000","last_clean":"2024-05-10T03:38:42.074671+0000","last_became_active":"2024-05-10T03:38:40.597818+0000","last_became_peered":"2024-05-10T03:38:40.597818+0000","last_unstale":"2024-05-10T03:38:42.074671+0000","last_undegraded":"2024-05-10T03:38:42.074671+0000","last_fullsized":"2024-05-10T03:38:42.074671+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:48:37.286108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:56.976240+0000","last_change":"2024-05-10T03:38:36.100727+0000","last_active":"2024-05-10T03:38:56.976240+0000","last_peered":"2024-05-10T03:38:56.976240+0000","last_clean":"2024-05-10T03:38:56.976240+0000","last_became_active":"2024-05-10T03:38:36.100381+0000","last_became_peered":"2024-05-10T03:38:36.100381+0000","last_unstale":"2024-05-10T03:38:56.976240+0000","last_undegraded":"2024-05-10T03:38:56.976240+0000","last_fullsized":"2024-05-10T03:38:56.976240+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:57:53.831417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.072385+0000","last_change":"2024-05-10T03:38:36.580924+0000","last_active":"2024-05-10T03:38:41.072385+0000","last_peered":"2024-05-10T03:38:41.072385+0000","last_clean":"2024-05-10T03:38:41.072385+0000","last_became_active":"2024-05-10T03:38:36.580598+0000","last_became_peered":"2024-05-10T03:38:36.580598+0000","last_unstale":"2024-05-10T03:38:41.072385+0000","last_undegraded":"2024-05-10T03:38:41.072385+0000","last_fullsized":"2024-05-10T03:38:41.072385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:33:12.007718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.816553+0000","last_change":"2024-05-10T03:38:40.606934+0000","last_active":"2024-05-10T03:38:41.816553+0000","last_peered":"2024-05-10T03:38:41.816553+0000","last_clean":"2024-05-10T03:38:41.816553+0000","last_became_active":"2024-05-10T03:38:40.606451+0000","last_became_peered":"2024-05-10T03:38:40.606451+0000","last_unstale":"2024-05-10T03:38:41.816553+0000","last_undegraded":"2024-05-10T03:38:41.816553+0000","last_fullsized":"2024-05-10T03:38:41.816553+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:03:43.562337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:57.994119+0000","last_change":"2024-05-10T03:38:36.093109+0000","last_active":"2024-05-10T03:38:57.994119+0000","last_peered":"2024-05-10T03:38:57.994119+0000","last_clean":"2024-05-10T03:38:57.994119+0000","last_became_active":"2024-05-10T03:38:36.092623+0000","last_became_peered":"2024-05-10T03:38:36.092623+0000","last_unstale":"2024-05-10T03:38:57.994119+0000","last_undegraded":"2024-05-10T03:38:57.994119+0000","last_fullsized":"2024-05-10T03:38:57.994119+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:27:10.367098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.072964+0000","last_change":"2024-05-10T03:38:36.582794+0000","last_active":"2024-05-10T03:38:41.072964+0000","last_peered":"2024-05-10T03:38:41.072964+0000","last_clean":"2024-05-10T03:38:41.072964+0000","last_became_active":"2024-05-10T03:38:36.582464+0000","last_became_peered":"2024-05-10T03:38:36.582464+0000","last_unstale":"2024-05-10T03:38:41.072964+0000","last_undegraded":"2024-05-10T03:38:41.072964+0000","last_fullsized":"2024-05-10T03:38:41.072964+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:58:19.665485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.667208+0000","last_change":"2024-05-10T03:38:40.608696+0000","last_active":"2024-05-10T03:38:41.667208+0000","last_peered":"2024-05-10T03:38:41.667208+0000","last_clean":"2024-05-10T03:38:41.667208+0000","last_became_active":"2024-05-10T03:38:40.607868+0000","last_became_peered":"2024-05-10T03:38:40.607868+0000","last_unstale":"2024-05-10T03:38:41.667208+0000","last_undegraded":"2024-05-10T03:38:41.667208+0000","last_fullsized":"2024-05-10T03:38:41.667208+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:27.154675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145442+0000","last_change":"2024-05-10T03:38:36.093060+0000","last_active":"2024-05-10T03:38:41.145442+0000","last_peered":"2024-05-10T03:38:41.145442+0000","last_clean":"2024-05-10T03:38:41.145442+0000","last_became_active":"2024-05-10T03:38:36.092476+0000","last_became_peered":"2024-05-10T03:38:36.092476+0000","last_unstale":"2024-05-10T03:38:41.145442+0000","last_undegraded":"2024-05-10T03:38:41.145442+0000","last_fullsized":"2024-05-10T03:38:41.145442+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:52:04.624230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.073142+0000","last_change":"2024-05-10T03:38:36.594808+0000","last_active":"2024-05-10T03:38:41.073142+0000","last_peered":"2024-05-10T03:38:41.073142+0000","last_clean":"2024-05-10T03:38:41.073142+0000","last_became_active":"2024-05-10T03:38:36.594511+0000","last_became_peered":"2024-05-10T03:38:36.594511+0000","last_unstale":"2024-05-10T03:38:41.073142+0000","last_undegraded":"2024-05-10T03:38:41.073142+0000","last_fullsized":"2024-05-10T03:38:41.073142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:18:59.981485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.131206+0000","last_change":"2024-05-10T03:38:40.605744+0000","last_active":"2024-05-10T03:38:42.131206+0000","last_peered":"2024-05-10T03:38:42.131206+0000","last_clean":"2024-05-10T03:38:42.131206+0000","last_became_active":"2024-05-10T03:38:40.605269+0000","last_became_peered":"2024-05-10T03:38:40.605269+0000","last_unstale":"2024-05-10T03:38:42.131206+0000","last_undegraded":"2024-05-10T03:38:42.131206+0000","last_fullsized":"2024-05-10T03:38:42.131206+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:21.881903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"86'16","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:56.980694+0000","last_change":"2024-05-10T03:38:36.098918+0000","last_active":"2024-05-10T03:38:56.980694+0000","last_peered":"2024-05-10T03:38:56.980694+0000","last_clean":"2024-05-10T03:38:56.980694+0000","last_became_active":"2024-05-10T03:38:36.098586+0000","last_became_peered":"2024-05-10T03:38:36.098586+0000","last_unstale":"2024-05-10T03:38:56.980694+0000","last_undegraded":"2024-05-10T03:38:56.980694+0000","last_fullsized":"2024-05-10T03:38:56.980694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:58:48.297763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145843+0000","last_change":"2024-05-10T03:38:36.581347+0000","last_active":"2024-05-10T03:38:41.145843+0000","last_peered":"2024-05-10T03:38:41.145843+0000","last_clean":"2024-05-10T03:38:41.145843+0000","last_became_active":"2024-05-10T03:38:36.581044+0000","last_became_peered":"2024-05-10T03:38:36.581044+0000","last_unstale":"2024-05-10T03:38:41.145843+0000","last_undegraded":"2024-05-10T03:38:41.145843+0000","last_fullsized":"2024-05-10T03:38:41.145843+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:23:43.885238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.073999+0000","last_change":"2024-05-10T03:38:40.600521+0000","last_active":"2024-05-10T03:38:42.073999+0000","last_peered":"2024-05-10T03:38:42.073999+0000","last_clean":"2024-05-10T03:38:42.073999+0000","last_became_active":"2024-05-10T03:38:40.600016+0000","last_became_peered":"2024-05-10T03:38:40.600016+0000","last_unstale":"2024-05-10T03:38:42.073999+0000","last_undegraded":"2024-05-10T03:38:42.073999+0000","last_fullsized":"2024-05-10T03:38:42.073999+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:58:37.881367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145801+0000","last_change":"2024-05-10T03:38:36.094209+0000","last_active":"2024-05-10T03:38:41.145801+0000","last_peered":"2024-05-10T03:38:41.145801+0000","last_clean":"2024-05-10T03:38:41.145801+0000","last_became_active":"2024-05-10T03:38:36.093447+0000","last_became_peered":"2024-05-10T03:38:36.093447+0000","last_unstale":"2024-05-10T03:38:41.145801+0000","last_undegraded":"2024-05-10T03:38:41.145801+0000","last_fullsized":"2024-05-10T03:38:41.145801+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:24:20.540340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145877+0000","last_change":"2024-05-10T03:38:36.587832+0000","last_active":"2024-05-10T03:38:41.145877+0000","last_peered":"2024-05-10T03:38:41.145877+0000","last_clean":"2024-05-10T03:38:41.145877+0000","last_became_active":"2024-05-10T03:38:36.587475+0000","last_became_peered":"2024-05-10T03:38:36.587475+0000","last_unstale":"2024-05-10T03:38:41.145877+0000","last_undegraded":"2024-05-10T03:38:41.145877+0000","last_fullsized":"2024-05-10T03:38:41.145877+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:47:53.318634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.129941+0000","last_change":"2024-05-10T03:38:41.150879+0000","last_active":"2024-05-10T03:38:42.129941+0000","last_peered":"2024-05-10T03:38:42.129941+0000","last_clean":"2024-05-10T03:38:42.129941+0000","last_became_active":"2024-05-10T03:38:41.150350+0000","last_became_peered":"2024-05-10T03:38:41.150350+0000","last_unstale":"2024-05-10T03:38:42.129941+0000","last_undegraded":"2024-05-10T03:38:42.129941+0000","last_fullsized":"2024-05-10T03:38:42.129941+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:47:32.429040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.147599+0000","last_change":"2024-05-10T03:38:36.095933+0000","last_active":"2024-05-10T03:38:41.147599+0000","last_peered":"2024-05-10T03:38:41.147599+0000","last_clean":"2024-05-10T03:38:41.147599+0000","last_became_active":"2024-05-10T03:38:36.095592+0000","last_became_peered":"2024-05-10T03:38:36.095592+0000","last_unstale":"2024-05-10T03:38:41.147599+0000","last_undegraded":"2024-05-10T03:38:41.147599+0000","last_fullsized":"2024-05-10T03:38:41.147599+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:52:21.729051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.147510+0000","last_change":"2024-05-10T03:38:36.591747+0000","last_active":"2024-05-10T03:38:41.147510+0000","last_peered":"2024-05-10T03:38:41.147510+0000","last_clean":"2024-05-10T03:38:41.147510+0000","last_became_active":"2024-05-10T03:38:36.591432+0000","last_became_peered":"2024-05-10T03:38:36.591432+0000","last_unstale":"2024-05-10T03:38:41.147510+0000","last_undegraded":"2024-05-10T03:38:41.147510+0000","last_fullsized":"2024-05-10T03:38:41.147510+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:20:37.549054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.131779+0000","last_change":"2024-05-10T03:38:40.597535+0000","last_active":"2024-05-10T03:38:42.131779+0000","last_peered":"2024-05-10T03:38:42.131779+0000","last_clean":"2024-05-10T03:38:42.131779+0000","last_became_active":"2024-05-10T03:38:40.597108+0000","last_became_peered":"2024-05-10T03:38:40.597108+0000","last_unstale":"2024-05-10T03:38:42.131779+0000","last_undegraded":"2024-05-10T03:38:42.131779+0000","last_fullsized":"2024-05-10T03:38:42.131779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:31:21.765071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.072904+0000","last_change":"2024-05-10T03:38:36.099238+0000","last_active":"2024-05-10T03:38:41.072904+0000","last_peered":"2024-05-10T03:38:41.072904+0000","last_clean":"2024-05-10T03:38:41.072904+0000","last_became_active":"2024-05-10T03:38:36.098761+0000","last_became_peered":"2024-05-10T03:38:36.098761+0000","last_unstale":"2024-05-10T03:38:41.072904+0000","last_undegraded":"2024-05-10T03:38:41.072904+0000","last_fullsized":"2024-05-10T03:38:41.072904+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:08:49.892665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.147457+0000","last_change":"2024-05-10T03:38:36.580983+0000","last_active":"2024-05-10T03:38:41.147457+0000","last_peered":"2024-05-10T03:38:41.147457+0000","last_clean":"2024-05-10T03:38:41.147457+0000","last_became_active":"2024-05-10T03:38:36.580252+0000","last_became_peered":"2024-05-10T03:38:36.580252+0000","last_unstale":"2024-05-10T03:38:41.147457+0000","last_undegraded":"2024-05-10T03:38:41.147457+0000","last_fullsized":"2024-05-10T03:38:41.147457+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:16.265473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.131419+0000","last_change":"2024-05-10T03:38:41.148651+0000","last_active":"2024-05-10T03:38:42.131419+0000","last_peered":"2024-05-10T03:38:42.131419+0000","last_clean":"2024-05-10T03:38:42.131419+0000","last_became_active":"2024-05-10T03:38:41.148192+0000","last_became_peered":"2024-05-10T03:38:41.148192+0000","last_unstale":"2024-05-10T03:38:42.131419+0000","last_undegraded":"2024-05-10T03:38:42.131419+0000","last_fullsized":"2024-05-10T03:38:42.131419+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:13:38.795763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.146995+0000","last_change":"2024-05-10T03:38:36.577839+0000","last_active":"2024-05-10T03:38:41.146995+0000","last_peered":"2024-05-10T03:38:41.146995+0000","last_clean":"2024-05-10T03:38:41.146995+0000","last_became_active":"2024-05-10T03:38:36.576917+0000","last_became_peered":"2024-05-10T03:38:36.576917+0000","last_unstale":"2024-05-10T03:38:41.146995+0000","last_undegraded":"2024-05-10T03:38:41.146995+0000","last_fullsized":"2024-05-10T03:38:41.146995+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:52:05.825241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:56.980368+0000","last_change":"2024-05-10T03:38:36.099138+0000","last_active":"2024-05-10T03:38:56.980368+0000","last_peered":"2024-05-10T03:38:56.980368+0000","last_clean":"2024-05-10T03:38:56.980368+0000","last_became_active":"2024-05-10T03:38:36.098747+0000","last_became_peered":"2024-05-10T03:38:36.098747+0000","last_unstale":"2024-05-10T03:38:56.980368+0000","last_undegraded":"2024-05-10T03:38:56.980368+0000","last_fullsized":"2024-05-10T03:38:56.980368+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:18.236383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.073205+0000","last_change":"2024-05-10T03:38:40.605489+0000","last_active":"2024-05-10T03:38:41.073205+0000","last_peered":"2024-05-10T03:38:41.073205+0000","last_clean":"2024-05-10T03:38:41.073205+0000","last_became_active":"2024-05-10T03:38:40.605040+0000","last_became_peered":"2024-05-10T03:38:40.605040+0000","last_unstale":"2024-05-10T03:38:41.073205+0000","last_undegraded":"2024-05-10T03:38:41.073205+0000","last_fullsized":"2024-05-10T03:38:41.073205+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:52:08.592132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145750+0000","last_change":"2024-05-10T03:38:36.589325+0000","last_active":"2024-05-10T03:38:41.145750+0000","last_peered":"2024-05-10T03:38:41.145750+0000","last_clean":"2024-05-10T03:38:41.145750+0000","last_became_active":"2024-05-10T03:38:36.588976+0000","last_became_peered":"2024-05-10T03:38:36.588976+0000","last_unstale":"2024-05-10T03:38:41.145750+0000","last_undegraded":"2024-05-10T03:38:41.145750+0000","last_fullsized":"2024-05-10T03:38:41.145750+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:40.849614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'2","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:55.956991+0000","last_change":"2024-05-10T03:38:36.093701+0000","last_active":"2024-05-10T03:38:55.956991+0000","last_peered":"2024-05-10T03:38:55.956991+0000","last_clean":"2024-05-10T03:38:55.956991+0000","last_became_active":"2024-05-10T03:38:36.093362+0000","last_became_peered":"2024-05-10T03:38:36.093362+0000","last_unstale":"2024-05-10T03:38:55.956991+0000","last_undegraded":"2024-05-10T03:38:55.956991+0000","last_fullsized":"2024-05-10T03:38:55.956991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:42:00.208900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":328,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.131073+0000","last_change":"2024-05-10T03:37:46.762875+0000","last_active":"2024-05-10T03:38:42.131073+0000","last_peered":"2024-05-10T03:38:42.131073+0000","last_clean":"2024-05-10T03:38:42.131073+0000","last_became_active":"2024-05-10T03:37:46.762448+0000","last_became_peered":"2024-05-10T03:37:46.762448+0000","last_unstale":"2024-05-10T03:38:42.131073+0000","last_undegraded":"2024-05-10T03:38:42.131073+0000","last_fullsized":"2024-05-10T03:38:42.131073+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:35:20.340567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:35:20.340567+0000","last_clean_scrub_stamp":"2024-05-10T03:35:20.340567+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:09:05.491303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.074661+0000","last_change":"2024-05-10T03:38:41.150966+0000","last_active":"2024-05-10T03:38:42.074661+0000","last_peered":"2024-05-10T03:38:42.074661+0000","last_clean":"2024-05-10T03:38:42.074661+0000","last_became_active":"2024-05-10T03:38:41.150505+0000","last_became_peered":"2024-05-10T03:38:41.150505+0000","last_unstale":"2024-05-10T03:38:42.074661+0000","last_undegraded":"2024-05-10T03:38:42.074661+0000","last_fullsized":"2024-05-10T03:38:42.074661+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:53.992369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.072111+0000","last_change":"2024-05-10T03:38:36.577457+0000","last_active":"2024-05-10T03:38:41.072111+0000","last_peered":"2024-05-10T03:38:41.072111+0000","last_clean":"2024-05-10T03:38:41.072111+0000","last_became_active":"2024-05-10T03:38:36.577105+0000","last_became_peered":"2024-05-10T03:38:36.577105+0000","last_unstale":"2024-05-10T03:38:41.072111+0000","last_undegraded":"2024-05-10T03:38:41.072111+0000","last_fullsized":"2024-05-10T03:38:41.072111+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:34:15.611496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.072687+0000","last_change":"2024-05-10T03:38:36.094057+0000","last_active":"2024-05-10T03:38:41.072687+0000","last_peered":"2024-05-10T03:38:41.072687+0000","last_clean":"2024-05-10T03:38:41.072687+0000","last_became_active":"2024-05-10T03:38:36.093705+0000","last_became_peered":"2024-05-10T03:38:36.093705+0000","last_unstale":"2024-05-10T03:38:41.072687+0000","last_undegraded":"2024-05-10T03:38:41.072687+0000","last_fullsized":"2024-05-10T03:38:41.072687+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:00:10.138524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.816534+0000","last_change":"2024-05-10T03:38:40.603522+0000","last_active":"2024-05-10T03:38:41.816534+0000","last_peered":"2024-05-10T03:38:41.816534+0000","last_clean":"2024-05-10T03:38:41.816534+0000","last_became_active":"2024-05-10T03:38:40.603058+0000","last_became_peered":"2024-05-10T03:38:40.603058+0000","last_unstale":"2024-05-10T03:38:41.816534+0000","last_undegraded":"2024-05-10T03:38:41.816534+0000","last_fullsized":"2024-05-10T03:38:41.816534+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:15:06.869163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"86'3","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:57.993848+0000","last_change":"2024-05-10T03:38:36.099009+0000","last_active":"2024-05-10T03:38:57.993848+0000","last_peered":"2024-05-10T03:38:57.993848+0000","last_clean":"2024-05-10T03:38:57.993848+0000","last_became_active":"2024-05-10T03:38:36.098695+0000","last_became_peered":"2024-05-10T03:38:36.098695+0000","last_unstale":"2024-05-10T03:38:57.993848+0000","last_undegraded":"2024-05-10T03:38:57.993848+0000","last_fullsized":"2024-05-10T03:38:57.993848+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:06.634752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.072737+0000","last_change":"2024-05-10T03:38:36.576498+0000","last_active":"2024-05-10T03:38:41.072737+0000","last_peered":"2024-05-10T03:38:41.072737+0000","last_clean":"2024-05-10T03:38:41.072737+0000","last_became_active":"2024-05-10T03:38:36.576161+0000","last_became_peered":"2024-05-10T03:38:36.576161+0000","last_unstale":"2024-05-10T03:38:41.072737+0000","last_undegraded":"2024-05-10T03:38:41.072737+0000","last_fullsized":"2024-05-10T03:38:41.072737+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:09.353279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.073404+0000","last_change":"2024-05-10T03:38:41.148317+0000","last_active":"2024-05-10T03:38:42.073404+0000","last_peered":"2024-05-10T03:38:42.073404+0000","last_clean":"2024-05-10T03:38:42.073404+0000","last_became_active":"2024-05-10T03:38:41.147907+0000","last_became_peered":"2024-05-10T03:38:41.147907+0000","last_unstale":"2024-05-10T03:38:42.073404+0000","last_undegraded":"2024-05-10T03:38:42.073404+0000","last_fullsized":"2024-05-10T03:38:42.073404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:23:08.157296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.146959+0000","last_change":"2024-05-10T03:38:36.096437+0000","last_active":"2024-05-10T03:38:41.146959+0000","last_peered":"2024-05-10T03:38:41.146959+0000","last_clean":"2024-05-10T03:38:41.146959+0000","last_became_active":"2024-05-10T03:38:36.096122+0000","last_became_peered":"2024-05-10T03:38:36.096122+0000","last_unstale":"2024-05-10T03:38:41.146959+0000","last_undegraded":"2024-05-10T03:38:41.146959+0000","last_fullsized":"2024-05-10T03:38:41.146959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:47:02.400065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145318+0000","last_change":"2024-05-10T03:38:36.574022+0000","last_active":"2024-05-10T03:38:41.145318+0000","last_peered":"2024-05-10T03:38:41.145318+0000","last_clean":"2024-05-10T03:38:41.145318+0000","last_became_active":"2024-05-10T03:38:36.573530+0000","last_became_peered":"2024-05-10T03:38:36.573530+0000","last_unstale":"2024-05-10T03:38:41.145318+0000","last_undegraded":"2024-05-10T03:38:41.145318+0000","last_fullsized":"2024-05-10T03:38:41.145318+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:35:32.574897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.129204+0000","last_change":"2024-05-10T03:38:40.600341+0000","last_active":"2024-05-10T03:38:42.129204+0000","last_peered":"2024-05-10T03:38:42.129204+0000","last_clean":"2024-05-10T03:38:42.129204+0000","last_became_active":"2024-05-10T03:38:40.599944+0000","last_became_peered":"2024-05-10T03:38:40.599944+0000","last_unstale":"2024-05-10T03:38:42.129204+0000","last_undegraded":"2024-05-10T03:38:42.129204+0000","last_fullsized":"2024-05-10T03:38:42.129204+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:12:01.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:55.958473+0000","last_change":"2024-05-10T03:38:36.091020+0000","last_active":"2024-05-10T03:38:55.958473+0000","last_peered":"2024-05-10T03:38:55.958473+0000","last_clean":"2024-05-10T03:38:55.958473+0000","last_became_active":"2024-05-10T03:38:36.090699+0000","last_became_peered":"2024-05-10T03:38:36.090699+0000","last_unstale":"2024-05-10T03:38:55.958473+0000","last_undegraded":"2024-05-10T03:38:55.958473+0000","last_fullsized":"2024-05-10T03:38:55.958473+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:44:12.546166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145064+0000","last_change":"2024-05-10T03:38:36.584279+0000","last_active":"2024-05-10T03:38:41.145064+0000","last_peered":"2024-05-10T03:38:41.145064+0000","last_clean":"2024-05-10T03:38:41.145064+0000","last_became_active":"2024-05-10T03:38:36.583897+0000","last_became_peered":"2024-05-10T03:38:36.583897+0000","last_unstale":"2024-05-10T03:38:41.145064+0000","last_undegraded":"2024-05-10T03:38:41.145064+0000","last_fullsized":"2024-05-10T03:38:41.145064+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:33:17.210334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.151453+0000","last_change":"2024-05-10T03:38:41.151023+0000","last_active":"2024-05-10T03:38:41.151453+0000","last_peered":"2024-05-10T03:38:41.151453+0000","last_clean":"2024-05-10T03:38:41.151453+0000","last_became_active":"2024-05-10T03:38:41.150489+0000","last_became_peered":"2024-05-10T03:38:41.150489+0000","last_unstale":"2024-05-10T03:38:41.151453+0000","last_undegraded":"2024-05-10T03:38:41.151453+0000","last_fullsized":"2024-05-10T03:38:41.151453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:57:57.440139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:55.957524+0000","last_change":"2024-05-10T03:38:36.098990+0000","last_active":"2024-05-10T03:38:55.957524+0000","last_peered":"2024-05-10T03:38:55.957524+0000","last_clean":"2024-05-10T03:38:55.957524+0000","last_became_active":"2024-05-10T03:38:36.098649+0000","last_became_peered":"2024-05-10T03:38:36.098649+0000","last_unstale":"2024-05-10T03:38:55.957524+0000","last_undegraded":"2024-05-10T03:38:55.957524+0000","last_fullsized":"2024-05-10T03:38:55.957524+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:38:09.915041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145927+0000","last_change":"2024-05-10T03:38:36.581286+0000","last_active":"2024-05-10T03:38:41.145927+0000","last_peered":"2024-05-10T03:38:41.145927+0000","last_clean":"2024-05-10T03:38:41.145927+0000","last_became_active":"2024-05-10T03:38:36.580927+0000","last_became_peered":"2024-05-10T03:38:36.580927+0000","last_unstale":"2024-05-10T03:38:41.145927+0000","last_undegraded":"2024-05-10T03:38:41.145927+0000","last_fullsized":"2024-05-10T03:38:41.145927+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:10:38.663239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.667246+0000","last_change":"2024-05-10T03:38:40.605668+0000","last_active":"2024-05-10T03:38:41.667246+0000","last_peered":"2024-05-10T03:38:41.667246+0000","last_clean":"2024-05-10T03:38:41.667246+0000","last_became_active":"2024-05-10T03:38:40.605156+0000","last_became_peered":"2024-05-10T03:38:40.605156+0000","last_unstale":"2024-05-10T03:38:41.667246+0000","last_undegraded":"2024-05-10T03:38:41.667246+0000","last_fullsized":"2024-05-10T03:38:41.667246+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:28:07.192875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:55.954654+0000","last_change":"2024-05-10T03:38:36.090250+0000","last_active":"2024-05-10T03:38:55.954654+0000","last_peered":"2024-05-10T03:38:55.954654+0000","last_clean":"2024-05-10T03:38:55.954654+0000","last_became_active":"2024-05-10T03:38:36.089899+0000","last_became_peered":"2024-05-10T03:38:36.089899+0000","last_unstale":"2024-05-10T03:38:55.954654+0000","last_undegraded":"2024-05-10T03:38:55.954654+0000","last_fullsized":"2024-05-10T03:38:55.954654+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:01:19.322065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145537+0000","last_change":"2024-05-10T03:38:36.575272+0000","last_active":"2024-05-10T03:38:41.145537+0000","last_peered":"2024-05-10T03:38:41.145537+0000","last_clean":"2024-05-10T03:38:41.145537+0000","last_became_active":"2024-05-10T03:38:36.574919+0000","last_became_peered":"2024-05-10T03:38:36.574919+0000","last_unstale":"2024-05-10T03:38:41.145537+0000","last_undegraded":"2024-05-10T03:38:41.145537+0000","last_fullsized":"2024-05-10T03:38:41.145537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:51:33.825933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145820+0000","last_change":"2024-05-10T03:38:40.609082+0000","last_active":"2024-05-10T03:38:41.145820+0000","last_peered":"2024-05-10T03:38:41.145820+0000","last_clean":"2024-05-10T03:38:41.145820+0000","last_became_active":"2024-05-10T03:38:40.608636+0000","last_became_peered":"2024-05-10T03:38:40.608636+0000","last_unstale":"2024-05-10T03:38:41.145820+0000","last_undegraded":"2024-05-10T03:38:41.145820+0000","last_fullsized":"2024-05-10T03:38:41.145820+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:18:05.288472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"86'2","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:57.994543+0000","last_change":"2024-05-10T03:38:36.101001+0000","last_active":"2024-05-10T03:38:57.994543+0000","last_peered":"2024-05-10T03:38:57.994543+0000","last_clean":"2024-05-10T03:38:57.994543+0000","last_became_active":"2024-05-10T03:38:36.100658+0000","last_became_peered":"2024-05-10T03:38:36.100658+0000","last_unstale":"2024-05-10T03:38:57.994543+0000","last_undegraded":"2024-05-10T03:38:57.994543+0000","last_fullsized":"2024-05-10T03:38:57.994543+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:15:51.963956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145134+0000","last_change":"2024-05-10T03:38:36.579314+0000","last_active":"2024-05-10T03:38:41.145134+0000","last_peered":"2024-05-10T03:38:41.145134+0000","last_clean":"2024-05-10T03:38:41.145134+0000","last_became_active":"2024-05-10T03:38:36.578747+0000","last_became_peered":"2024-05-10T03:38:36.578747+0000","last_unstale":"2024-05-10T03:38:41.145134+0000","last_undegraded":"2024-05-10T03:38:41.145134+0000","last_fullsized":"2024-05-10T03:38:41.145134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:05:25.814887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.149586+0000","last_change":"2024-05-10T03:38:41.149022+0000","last_active":"2024-05-10T03:38:41.149586+0000","last_peered":"2024-05-10T03:38:41.149586+0000","last_clean":"2024-05-10T03:38:41.149586+0000","last_became_active":"2024-05-10T03:38:41.148606+0000","last_became_peered":"2024-05-10T03:38:41.148606+0000","last_unstale":"2024-05-10T03:38:41.149586+0000","last_undegraded":"2024-05-10T03:38:41.149586+0000","last_fullsized":"2024-05-10T03:38:41.149586+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:24.039761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:55.957430+0000","last_change":"2024-05-10T03:38:36.095851+0000","last_active":"2024-05-10T03:38:55.957430+0000","last_peered":"2024-05-10T03:38:55.957430+0000","last_clean":"2024-05-10T03:38:55.957430+0000","last_became_active":"2024-05-10T03:38:36.095452+0000","last_became_peered":"2024-05-10T03:38:36.095452+0000","last_unstale":"2024-05-10T03:38:55.957430+0000","last_undegraded":"2024-05-10T03:38:55.957430+0000","last_fullsized":"2024-05-10T03:38:55.957430+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:28:15.555590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.073061+0000","last_change":"2024-05-10T03:38:36.587225+0000","last_active":"2024-05-10T03:38:41.073061+0000","last_peered":"2024-05-10T03:38:41.073061+0000","last_clean":"2024-05-10T03:38:41.073061+0000","last_became_active":"2024-05-10T03:38:36.586906+0000","last_became_peered":"2024-05-10T03:38:36.586906+0000","last_unstale":"2024-05-10T03:38:41.073061+0000","last_undegraded":"2024-05-10T03:38:41.073061+0000","last_fullsized":"2024-05-10T03:38:41.073061+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:07.128604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.353449+0000","last_change":"2024-05-10T03:38:40.600918+0000","last_active":"2024-05-10T03:38:41.353449+0000","last_peered":"2024-05-10T03:38:41.353449+0000","last_clean":"2024-05-10T03:38:41.353449+0000","last_became_active":"2024-05-10T03:38:40.600508+0000","last_became_peered":"2024-05-10T03:38:40.600508+0000","last_unstale":"2024-05-10T03:38:41.353449+0000","last_undegraded":"2024-05-10T03:38:41.353449+0000","last_fullsized":"2024-05-10T03:38:41.353449+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:02:59.589310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:57.993194+0000","last_change":"2024-05-10T03:38:36.100013+0000","last_active":"2024-05-10T03:38:57.993194+0000","last_peered":"2024-05-10T03:38:57.993194+0000","last_clean":"2024-05-10T03:38:57.993194+0000","last_became_active":"2024-05-10T03:38:36.099581+0000","last_became_peered":"2024-05-10T03:38:36.099581+0000","last_unstale":"2024-05-10T03:38:57.993194+0000","last_undegraded":"2024-05-10T03:38:57.993194+0000","last_fullsized":"2024-05-10T03:38:57.993194+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:07.195555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.073325+0000","last_change":"2024-05-10T03:38:36.586813+0000","last_active":"2024-05-10T03:38:41.073325+0000","last_peered":"2024-05-10T03:38:41.073325+0000","last_clean":"2024-05-10T03:38:41.073325+0000","last_became_active":"2024-05-10T03:38:36.586264+0000","last_became_peered":"2024-05-10T03:38:36.586264+0000","last_unstale":"2024-05-10T03:38:41.073325+0000","last_undegraded":"2024-05-10T03:38:41.073325+0000","last_fullsized":"2024-05-10T03:38:41.073325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:57:06.239509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.130269+0000","last_change":"2024-05-10T03:38:40.606897+0000","last_active":"2024-05-10T03:38:42.130269+0000","last_peered":"2024-05-10T03:38:42.130269+0000","last_clean":"2024-05-10T03:38:42.130269+0000","last_became_active":"2024-05-10T03:38:40.606339+0000","last_became_peered":"2024-05-10T03:38:40.606339+0000","last_unstale":"2024-05-10T03:38:42.130269+0000","last_undegraded":"2024-05-10T03:38:42.130269+0000","last_fullsized":"2024-05-10T03:38:42.130269+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:13.706744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:57.993903+0000","last_change":"2024-05-10T03:38:36.100689+0000","last_active":"2024-05-10T03:38:57.993903+0000","last_peered":"2024-05-10T03:38:57.993903+0000","last_clean":"2024-05-10T03:38:57.993903+0000","last_became_active":"2024-05-10T03:38:36.100352+0000","last_became_peered":"2024-05-10T03:38:36.100352+0000","last_unstale":"2024-05-10T03:38:57.993903+0000","last_undegraded":"2024-05-10T03:38:57.993903+0000","last_fullsized":"2024-05-10T03:38:57.993903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:53:45.926237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.072868+0000","last_change":"2024-05-10T03:38:36.594941+0000","last_active":"2024-05-10T03:38:41.072868+0000","last_peered":"2024-05-10T03:38:41.072868+0000","last_clean":"2024-05-10T03:38:41.072868+0000","last_became_active":"2024-05-10T03:38:36.594549+0000","last_became_peered":"2024-05-10T03:38:36.594549+0000","last_unstale":"2024-05-10T03:38:41.072868+0000","last_undegraded":"2024-05-10T03:38:41.072868+0000","last_fullsized":"2024-05-10T03:38:41.072868+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:18:29.317669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.073637+0000","last_change":"2024-05-10T03:38:40.600719+0000","last_active":"2024-05-10T03:38:42.073637+0000","last_peered":"2024-05-10T03:38:42.073637+0000","last_clean":"2024-05-10T03:38:42.073637+0000","last_became_active":"2024-05-10T03:38:40.600240+0000","last_became_peered":"2024-05-10T03:38:40.600240+0000","last_unstale":"2024-05-10T03:38:42.073637+0000","last_undegraded":"2024-05-10T03:38:42.073637+0000","last_fullsized":"2024-05-10T03:38:42.073637+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:41:47.877298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.072805+0000","last_change":"2024-05-10T03:38:36.097691+0000","last_active":"2024-05-10T03:38:41.072805+0000","last_peered":"2024-05-10T03:38:41.072805+0000","last_clean":"2024-05-10T03:38:41.072805+0000","last_became_active":"2024-05-10T03:38:36.097266+0000","last_became_peered":"2024-05-10T03:38:36.097266+0000","last_unstale":"2024-05-10T03:38:41.072805+0000","last_undegraded":"2024-05-10T03:38:41.072805+0000","last_fullsized":"2024-05-10T03:38:41.072805+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:27:57.272780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.073089+0000","last_change":"2024-05-10T03:38:36.575475+0000","last_active":"2024-05-10T03:38:41.073089+0000","last_peered":"2024-05-10T03:38:41.073089+0000","last_clean":"2024-05-10T03:38:41.073089+0000","last_became_active":"2024-05-10T03:38:36.575047+0000","last_became_peered":"2024-05-10T03:38:36.575047+0000","last_unstale":"2024-05-10T03:38:41.073089+0000","last_undegraded":"2024-05-10T03:38:41.073089+0000","last_fullsized":"2024-05-10T03:38:41.073089+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:31:53.846070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145624+0000","last_change":"2024-05-10T03:38:36.585491+0000","last_active":"2024-05-10T03:38:41.145624+0000","last_peered":"2024-05-10T03:38:41.145624+0000","last_clean":"2024-05-10T03:38:41.145624+0000","last_became_active":"2024-05-10T03:38:36.585147+0000","last_became_peered":"2024-05-10T03:38:36.585147+0000","last_unstale":"2024-05-10T03:38:41.145624+0000","last_undegraded":"2024-05-10T03:38:41.145624+0000","last_fullsized":"2024-05-10T03:38:41.145624+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:22.350420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.073175+0000","last_change":"2024-05-10T03:38:36.584092+0000","last_active":"2024-05-10T03:38:41.073175+0000","last_peered":"2024-05-10T03:38:41.073175+0000","last_clean":"2024-05-10T03:38:41.073175+0000","last_became_active":"2024-05-10T03:38:36.583749+0000","last_became_peered":"2024-05-10T03:38:36.583749+0000","last_unstale":"2024-05-10T03:38:41.073175+0000","last_undegraded":"2024-05-10T03:38:41.073175+0000","last_fullsized":"2024-05-10T03:38:41.073175+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:10.882170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.072928+0000","last_change":"2024-05-10T03:38:36.573718+0000","last_active":"2024-05-10T03:38:41.072928+0000","last_peered":"2024-05-10T03:38:41.072928+0000","last_clean":"2024-05-10T03:38:41.072928+0000","last_became_active":"2024-05-10T03:38:36.573271+0000","last_became_peered":"2024-05-10T03:38:36.573271+0000","last_unstale":"2024-05-10T03:38:41.072928+0000","last_undegraded":"2024-05-10T03:38:41.072928+0000","last_fullsized":"2024-05-10T03:38:41.072928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:38:13.798068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145941+0000","last_change":"2024-05-10T03:38:36.576975+0000","last_active":"2024-05-10T03:38:41.145941+0000","last_peered":"2024-05-10T03:38:41.145941+0000","last_clean":"2024-05-10T03:38:41.145941+0000","last_became_active":"2024-05-10T03:38:36.576640+0000","last_became_peered":"2024-05-10T03:38:36.576640+0000","last_unstale":"2024-05-10T03:38:41.145941+0000","last_undegraded":"2024-05-10T03:38:41.145941+0000","last_fullsized":"2024-05-10T03:38:41.145941+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:48:42.975793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.072632+0000","last_change":"2024-05-10T03:38:36.576607+0000","last_active":"2024-05-10T03:38:41.072632+0000","last_peered":"2024-05-10T03:38:41.072632+0000","last_clean":"2024-05-10T03:38:41.072632+0000","last_became_active":"2024-05-10T03:38:36.576255+0000","last_became_peered":"2024-05-10T03:38:36.576255+0000","last_unstale":"2024-05-10T03:38:41.072632+0000","last_undegraded":"2024-05-10T03:38:41.072632+0000","last_fullsized":"2024-05-10T03:38:41.072632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:01:23.760926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145731+0000","last_change":"2024-05-10T03:38:36.589262+0000","last_active":"2024-05-10T03:38:41.145731+0000","last_peered":"2024-05-10T03:38:41.145731+0000","last_clean":"2024-05-10T03:38:41.145731+0000","last_became_active":"2024-05-10T03:38:36.588950+0000","last_became_peered":"2024-05-10T03:38:36.588950+0000","last_unstale":"2024-05-10T03:38:41.145731+0000","last_undegraded":"2024-05-10T03:38:41.145731+0000","last_fullsized":"2024-05-10T03:38:41.145731+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:08:43.124035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.073586+0000","last_change":"2024-05-10T03:38:36.590472+0000","last_active":"2024-05-10T03:38:41.073586+0000","last_peered":"2024-05-10T03:38:41.073586+0000","last_clean":"2024-05-10T03:38:41.073586+0000","last_became_active":"2024-05-10T03:38:36.590115+0000","last_became_peered":"2024-05-10T03:38:36.590115+0000","last_unstale":"2024-05-10T03:38:41.073586+0000","last_undegraded":"2024-05-10T03:38:41.073586+0000","last_fullsized":"2024-05-10T03:38:41.073586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:33:37.982529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145531+0000","last_change":"2024-05-10T03:38:36.575958+0000","last_active":"2024-05-10T03:38:41.145531+0000","last_peered":"2024-05-10T03:38:41.145531+0000","last_clean":"2024-05-10T03:38:41.145531+0000","last_became_active":"2024-05-10T03:38:36.572958+0000","last_became_peered":"2024-05-10T03:38:36.572958+0000","last_unstale":"2024-05-10T03:38:41.145531+0000","last_undegraded":"2024-05-10T03:38:41.145531+0000","last_fullsized":"2024-05-10T03:38:41.145531+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:30:39.111371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.146784+0000","last_change":"2024-05-10T03:38:36.578225+0000","last_active":"2024-05-10T03:38:41.146784+0000","last_peered":"2024-05-10T03:38:41.146784+0000","last_clean":"2024-05-10T03:38:41.146784+0000","last_became_active":"2024-05-10T03:38:36.575920+0000","last_became_peered":"2024-05-10T03:38:36.575920+0000","last_unstale":"2024-05-10T03:38:41.146784+0000","last_undegraded":"2024-05-10T03:38:41.146784+0000","last_fullsized":"2024-05-10T03:38:41.146784+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:54:53.999971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.147205+0000","last_change":"2024-05-10T03:38:36.577720+0000","last_active":"2024-05-10T03:38:41.147205+0000","last_peered":"2024-05-10T03:38:41.147205+0000","last_clean":"2024-05-10T03:38:41.147205+0000","last_became_active":"2024-05-10T03:38:36.577360+0000","last_became_peered":"2024-05-10T03:38:36.577360+0000","last_unstale":"2024-05-10T03:38:41.147205+0000","last_undegraded":"2024-05-10T03:38:41.147205+0000","last_fullsized":"2024-05-10T03:38:41.147205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:35:59.787050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.147672+0000","last_change":"2024-05-10T03:38:36.588941+0000","last_active":"2024-05-10T03:38:41.147672+0000","last_peered":"2024-05-10T03:38:41.147672+0000","last_clean":"2024-05-10T03:38:41.147672+0000","last_became_active":"2024-05-10T03:38:36.587884+0000","last_became_peered":"2024-05-10T03:38:36.587884+0000","last_unstale":"2024-05-10T03:38:41.147672+0000","last_undegraded":"2024-05-10T03:38:41.147672+0000","last_fullsized":"2024-05-10T03:38:41.147672+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:26:10.064473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.072585+0000","last_change":"2024-05-10T03:38:36.578917+0000","last_active":"2024-05-10T03:38:41.072585+0000","last_peered":"2024-05-10T03:38:41.072585+0000","last_clean":"2024-05-10T03:38:41.072585+0000","last_became_active":"2024-05-10T03:38:36.578508+0000","last_became_peered":"2024-05-10T03:38:36.578508+0000","last_unstale":"2024-05-10T03:38:41.072585+0000","last_undegraded":"2024-05-10T03:38:41.072585+0000","last_fullsized":"2024-05-10T03:38:41.072585+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:47.670854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145529+0000","last_change":"2024-05-10T03:38:36.578410+0000","last_active":"2024-05-10T03:38:41.145529+0000","last_peered":"2024-05-10T03:38:41.145529+0000","last_clean":"2024-05-10T03:38:41.145529+0000","last_became_active":"2024-05-10T03:38:36.578055+0000","last_became_peered":"2024-05-10T03:38:36.578055+0000","last_unstale":"2024-05-10T03:38:41.145529+0000","last_undegraded":"2024-05-10T03:38:41.145529+0000","last_fullsized":"2024-05-10T03:38:41.145529+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:39:03.551019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":45096,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":303104,"data_stored":66261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514509,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":946176,"data_stored":463783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]}]},{"osd":10,"up_from":69,"seq":296352743442,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28596,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716556,"statfs":{"total":95995035648,"available":95965753344,"internally_reserved":0,"allocated":1617920,"data_stored":1078936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":1,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.66400000000000003}]},{"osd":3,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.59899999999999998}]},{"osd":5,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.72099999999999997}]},{"osd":6,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":8,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.753}]},{"osd":9,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.80200000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]}]},{"osd":9,"up_from":64,"seq":274877906965,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36148,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709004,"statfs":{"total":95995035648,"available":95958020096,"internally_reserved":0,"allocated":962560,"data_stored":464567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36043201},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.495},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.46999999999999997}]},{"osd":1,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.747},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.65800000000000003}]},{"osd":2,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.61299999999999999}]},{"osd":3,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53600000000000003}]},{"osd":4,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.629}]},{"osd":5,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.51100000000000001}]},{"osd":7,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.79100000000000004}]},{"osd":8,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.83099999999999996}]},{"osd":10,"last update":"Fri May 10 03:38:44 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.76300000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]}]},{"osd":8,"up_from":57,"seq":244813135897,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":464190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:38:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri May 10 03:38:08 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.71799999999999997}]},{"osd":2,"last update":"Fri May 10 03:38:08 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.52200000000000002}]},{"osd":3,"last update":"Fri May 10 03:38:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.79100000000000004}]},{"osd":4,"last update":"Fri May 10 03:38:08 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.84099999999999997}]},{"osd":5,"last update":"Fri May 10 03:38:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.59599999999999997}]},{"osd":6,"last update":"Fri May 10 03:38:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.75},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.85799999999999998}]},{"osd":7,"last update":"Fri May 10 03:38:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.89500000000000002}]},{"osd":9,"last update":"Fri May 10 03:38:27 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.871},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.88}]},{"osd":10,"last update":"Fri May 10 03:38:48 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.93200000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]}]},{"osd":7,"up_from":50,"seq":214748364828,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1544192,"data_stored":1054733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:37:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.437},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.502}]},{"osd":1,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.43099999999999999,"15min":0.42699999999999999},"min":{"1min":0.33600000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.44500000000000001,"15min":0.44400000000000001},"min":{"1min":0.32300000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.61799999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.40600000000000003}]},{"osd":2,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85899999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.64300000000000002,"15min":0.622},"min":{"1min":0.46600000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":2.8340000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.46600000000000003}]},{"osd":3,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.624,"15min":0.63},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.75900000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.58999999999999997}]},{"osd":4,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82199999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.627},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.34899999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78100000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.49299999999999999}]},{"osd":5,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.67800000000000005,"15min":0.65500000000000003},"min":{"1min":0.503,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.1139999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.67300000000000004,"15min":0.65500000000000003},"min":{"1min":0.49099999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.806,"5min":2.806,"15min":2.806},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.70299999999999996,"15min":0.70899999999999996},"min":{"1min":0.48599999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86499999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.90900000000000003,"5min":1.002,"15min":1.002},"last":0.60599999999999998}]},{"osd":8,"last update":"Fri May 10 03:38:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.65200000000000002}]},{"osd":9,"last update":"Fri May 10 03:38:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.63900000000000001}]},{"osd":10,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.71299999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":6,"up_from":45,"seq":193273528351,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":463783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:38:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.45300000000000001,"15min":0.443},"min":{"1min":0.33700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.46500000000000002,"15min":0.45600000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.435}]},{"osd":1,"last update":"Fri May 10 03:38:40 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.41799999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.63900000000000001,"15min":0.621},"min":{"1min":0.51400000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.622}]},{"osd":2,"last update":"Fri May 10 03:38:40 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.69799999999999995,"15min":0.68500000000000005},"min":{"1min":0.53700000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.504}]},{"osd":3,"last update":"Fri May 10 03:38:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.55600000000000005,"15min":0.54200000000000004},"min":{"1min":0.44500000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.55300000000000005,"15min":0.54500000000000004},"min":{"1min":0.432,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.35499999999999998}]},{"osd":4,"last update":"Fri May 10 03:38:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.47399999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.72999999999999998,"15min":0.71599999999999997},"min":{"1min":0.68500000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.60299999999999998}]},{"osd":5,"last update":"Fri May 10 03:38:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68100000000000005,"15min":0.67500000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.88200000000000001,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.72499999999999998,"15min":0.71799999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.52800000000000002}]},{"osd":7,"last update":"Fri May 10 03:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.83099999999999996,"15min":0.82399999999999995},"min":{"1min":0.752,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.76100000000000001,"15min":0.755},"min":{"1min":0.61399999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.92900000000000005,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.58299999999999996}]},{"osd":8,"last update":"Fri May 10 03:38:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.64400000000000002}]},{"osd":9,"last update":"Fri May 10 03:38:26 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.63100000000000001}]},{"osd":10,"last update":"Fri May 10 03:38:46 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.67600000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36144,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709008,"statfs":{"total":95995035648,"available":95958024192,"internally_reserved":0,"allocated":958464,"data_stored":467579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:38:06 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.50600000000000001,"15min":0.5},"min":{"1min":0.39300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.629},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.51500000000000001,"15min":0.498},"min":{"1min":0.39800000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.46400000000000002}]},{"osd":2,"last update":"Fri May 10 03:38:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.51900000000000002,"15min":0.497},"min":{"1min":0.38500000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.52000000000000002,"15min":0.504},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76500000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.68000000000000005}]},{"osd":3,"last update":"Fri May 10 03:38:44 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.58999999999999997,"15min":0.56399999999999995},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88,"5min":1.528,"15min":1.528},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.58599999999999997,"15min":0.55600000000000005},"min":{"1min":0.47899999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91100000000000003,"5min":1.502,"15min":1.502},"last":0.66100000000000003}]},{"osd":4,"last update":"Fri May 10 03:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.40400000000000003,"15min":0.39100000000000001},"min":{"1min":0.29999999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.40699999999999997,"15min":0.39700000000000002},"min":{"1min":0.308,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.505}]},{"osd":5,"last update":"Fri May 10 03:38:19 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60399999999999998,"15min":0.60099999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri May 10 03:38:34 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.5,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0700000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64600000000000002,"15min":0.64200000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.99199999999999999,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.61599999999999999}]},{"osd":7,"last update":"Fri May 10 03:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.378,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.92800000000000005,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.58999999999999997,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.71999999999999997}]},{"osd":8,"last update":"Fri May 10 03:38:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.76800000000000002}]},{"osd":9,"last update":"Fri May 10 03:38:31 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.75700000000000001}]},{"osd":10,"last update":"Fri May 10 03:38:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.80400000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738421,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":465801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 03:38:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.56499999999999995,"15min":0.53700000000000003},"min":{"1min":0.36899999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.55900000000000005,"15min":0.52900000000000003},"min":{"1min":0.40100000000000002,"5min":0.316,"15min":0.316},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.65200000000000002}]},{"osd":2,"last update":"Fri May 10 03:38:20 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.61499999999999999,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.379,"15min":0.379},"max":{"1min":0.92600000000000005,"5min":1.216,"15min":1.216},"last":0.91700000000000004}]},{"osd":3,"last update":"Fri May 10 03:37:40 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.46400000000000002,"15min":0.44900000000000001},"min":{"1min":0.371,"5min":0.314,"15min":0.314},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.53100000000000003,"15min":0.51000000000000001},"min":{"1min":0.40300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.82999999999999996}]},{"osd":4,"last update":"Fri May 10 03:37:59 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.60699999999999998,"15min":0.58899999999999997},"min":{"1min":0.51400000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0760000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":1.095},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.59399999999999997,"15min":0.57299999999999995},"min":{"1min":0.48299999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Fri May 10 03:38:16 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58299999999999996,"15min":0.58199999999999996},"min":{"1min":0.42599999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.68999999999999995,"15min":0.68400000000000005},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":1.1419999999999999}]},{"osd":6,"last update":"Fri May 10 03:38:34 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68400000000000005,"15min":0.68899999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":1.036}]},{"osd":7,"last update":"Fri May 10 03:37:53 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":1.1910000000000001}]},{"osd":8,"last update":"Fri May 10 03:38:11 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":1.2789999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.95399999999999996}]},{"osd":9,"last update":"Fri May 10 03:38:27 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":1.0620000000000001}]},{"osd":10,"last update":"Fri May 10 03:38:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.2350000000000001},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]}]},{"osd":2,"up_from":18,"seq":77309411375,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":999424,"data_stored":476450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:38:24 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53400000000000003,"15min":0.52500000000000002},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.39100000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.754,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.80100000000000005}]},{"osd":1,"last update":"Fri May 10 03:38:24 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.54700000000000004,"15min":0.52500000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.57799999999999996,"15min":0.54800000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90300000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.874}]},{"osd":3,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.42599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81599999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.49099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.745,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.72999999999999998}]},{"osd":4,"last update":"Fri May 10 03:37:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.44500000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.745},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61799999999999999,"15min":0.61499999999999999},"min":{"1min":0.39600000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":1.0189999999999999}]},{"osd":5,"last update":"Fri May 10 03:38:17 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.503,"15min":0.499},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.498},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.37,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.70699999999999996}]},{"osd":6,"last update":"Fri May 10 03:38:34 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.629,"15min":0.625},"min":{"1min":0.47899999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71199999999999997,"15min":0.71099999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.95199999999999996}]},{"osd":7,"last update":"Fri May 10 03:37:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.91900000000000004}]},{"osd":8,"last update":"Fri May 10 03:38:07 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.60699999999999998}]},{"osd":9,"last update":"Fri May 10 03:38:29 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.83499999999999996}]},{"osd":10,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.99299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":3,"up_from":25,"seq":107374182442,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":463736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:38:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.40200000000000002,"15min":0.377},"min":{"1min":0.36899999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.59799999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.45900000000000002,"15min":0.432},"min":{"1min":0.372,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71999999999999997,"5min":0.878,"15min":0.878},"last":0.42199999999999999}]},{"osd":1,"last update":"Fri May 10 03:38:41 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55400000000000005,"15min":0.53400000000000003},"min":{"1min":0.46999999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.57099999999999995,"15min":0.53200000000000003},"min":{"1min":0.46500000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86099999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.60199999999999998}]},{"osd":2,"last update":"Fri May 10 03:38:41 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61599999999999999,"15min":0.59799999999999998},"min":{"1min":0.46899999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.97599999999999998,"5min":1.145,"15min":1.145},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.60399999999999998,"15min":0.57599999999999996},"min":{"1min":0.441,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.45500000000000002}]},{"osd":4,"last update":"Fri May 10 03:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.495,"5min":0.433,"15min":0.433},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.63600000000000001,"15min":0.62},"min":{"1min":0.51000000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.65000000000000002}]},{"osd":5,"last update":"Fri May 10 03:38:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.64200000000000002,"15min":0.628},"min":{"1min":0.50800000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.64600000000000002,"15min":0.625},"min":{"1min":0.45900000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri May 10 03:38:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67700000000000005,"15min":0.67400000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98299999999999998,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.46899999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.94199999999999995,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.625}]},{"osd":7,"last update":"Fri May 10 03:38:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79000000000000004,"15min":0.78800000000000003},"min":{"1min":0.57299999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.95399999999999996,"5min":1.085,"15min":1.085},"last":0.77400000000000002}]},{"osd":8,"last update":"Fri May 10 03:38:09 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.68899999999999995}]},{"osd":9,"last update":"Fri May 10 03:38:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.68899999999999995}]},{"osd":10,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.81000000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]}]},{"osd":4,"up_from":33,"seq":141733920806,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":950272,"data_stored":463805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:37:59 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.47599999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.52400000000000002,"15min":0.51100000000000001},"min":{"1min":0.435,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.54000000000000004}]},{"osd":1,"last update":"Fri May 10 03:37:59 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.35599999999999998,"15min":0.34999999999999998},"min":{"1min":0.27200000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.378,"15min":0.371},"min":{"1min":0.308,"5min":0.251,"15min":0.251},"max":{"1min":0.56100000000000005,"5min":0.621,"15min":0.621},"last":0.41699999999999998}]},{"osd":2,"last update":"Fri May 10 03:37:59 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55200000000000005,"15min":0.54400000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.56200000000000006,"15min":0.55000000000000004},"min":{"1min":0.41899999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.70299999999999996}]},{"osd":3,"last update":"Fri May 10 03:37:59 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.57999999999999996,"15min":0.56599999999999995},"min":{"1min":0.55800000000000005,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.58199999999999996,"15min":0.56999999999999995},"min":{"1min":0.433,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.58299999999999996}]},{"osd":5,"last update":"Fri May 10 03:38:15 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.59699999999999998,"15min":0.58799999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.753}]},{"osd":6,"last update":"Fri May 10 03:38:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.623,"15min":0.628},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.77000000000000002,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.46600000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92200000000000004,"5min":3.714,"15min":3.714},"last":0.51800000000000002}]},{"osd":7,"last update":"Fri May 10 03:37:53 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.62},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.56399999999999995}]},{"osd":8,"last update":"Fri May 10 03:38:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.78600000000000003}]},{"osd":9,"last update":"Fri May 10 03:38:28 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.80000000000000004}]},{"osd":10,"last update":"Fri May 10 03:38:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.81699999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]}]},{"osd":5,"up_from":38,"seq":163208757284,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28568,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716584,"statfs":{"total":95995035648,"available":95965782016,"internally_reserved":0,"allocated":1589248,"data_stored":1061412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:38:16 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":0.745,"15min":0.745},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57199999999999995,"15min":0.56799999999999995},"min":{"1min":0.38,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.65200000000000002}]},{"osd":1,"last update":"Fri May 10 03:38:16 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.76300000000000001}]},{"osd":2,"last update":"Fri May 10 03:38:16 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.42199999999999999,"15min":0.41399999999999998},"min":{"1min":0.32800000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.436,"15min":0.434},"min":{"1min":0.32000000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68100000000000005,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri May 10 03:38:16 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.38600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.46800000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.77900000000000003}]},{"osd":4,"last update":"Fri May 10 03:38:16 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61399999999999999,"15min":0.61599999999999999},"min":{"1min":0.47999999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.44,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.81799999999999995}]},{"osd":6,"last update":"Fri May 10 03:38:35 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60299999999999998,"15min":0.59899999999999998},"min":{"1min":0.371,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.80400000000000005}]},{"osd":7,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.70199999999999996,"15min":0.69599999999999995},"min":{"1min":0.52400000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69199999999999995,"15min":0.68999999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.90300000000000002}]},{"osd":8,"last update":"Fri May 10 03:38:07 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.871}]},{"osd":9,"last update":"Fri May 10 03:38:29 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.93100000000000005}]},{"osd":10,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.94199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":12667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":42115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T03:39:01.575 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T03:39:01.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.754+0000 7fbd811f8700 1 -- 172.21.15.45:0/2973916834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd7c102d00 msgr2=0x7fbd7c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:01.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.754+0000 7fbd811f8700 1 --2- 172.21.15.45:0/2973916834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd7c102d00 0x7fbd7c103110 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009990 tx=0x7fbd70009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:01.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.754+0000 7fbd811f8700 1 -- 172.21.15.45:0/2973916834 shutdown_connections 2024-05-10T03:39:01.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.754+0000 7fbd811f8700 1 --2- 172.21.15.45:0/2973916834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd7c1036a0 0x7fbd7c109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:01.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.754+0000 7fbd811f8700 1 --2- 172.21.15.45:0/2973916834 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd7c101be0 0x7fbd7c101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:01.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.754+0000 7fbd811f8700 1 --2- 172.21.15.45:0/2973916834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd7c102d00 0x7fbd7c103110 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:01.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.754+0000 7fbd811f8700 1 -- 172.21.15.45:0/2973916834 >> 172.21.15.45:0/2973916834 conn(0x7fbd7c0fd210 msgr2=0x7fbd7c0ff6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:01.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.754+0000 7fbd811f8700 1 -- 172.21.15.45:0/2973916834 shutdown_connections 2024-05-10T03:39:01.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.754+0000 7fbd811f8700 1 -- 172.21.15.45:0/2973916834 wait complete. 2024-05-10T03:39:01.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.755+0000 7fbd811f8700 1 Processor -- start 2024-05-10T03:39:01.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.755+0000 7fbd811f8700 1 -- start start 2024-05-10T03:39:01.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.755+0000 7fbd811f8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd7c101be0 0x7fbd7c1980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:01.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.755+0000 7fbd811f8700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd7c102d00 0x7fbd7c198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:01.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.755+0000 7fbd811f8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd7c1036a0 0x7fbd7c19f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:01.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.755+0000 7fbd811f8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c19fba0 con 0x7fbd7c101be0 2024-05-10T03:39:01.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.755+0000 7fbd811f8700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c19fd10 con 0x7fbd7c102d00 2024-05-10T03:39:01.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.755+0000 7fbd811f8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c19fed0 con 0x7fbd7c1036a0 2024-05-10T03:39:01.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.756+0000 7fbd7ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd7c101be0 0x7fbd7c1980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:01.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.756+0000 7fbd7ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd7c101be0 0x7fbd7c1980c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60082/0 (socket says 172.21.15.45:60082) 2024-05-10T03:39:01.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.756+0000 7fbd7ad9d700 1 -- 172.21.15.45:0/529496222 learned_addr learned my addr 172.21.15.45:0/529496222 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:01.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.756+0000 7fbd7a59c700 1 --2- 172.21.15.45:0/529496222 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd7c102d00 0x7fbd7c198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:01.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.756+0000 7fbd7b59e700 1 --2- 172.21.15.45:0/529496222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd7c1036a0 0x7fbd7c19f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:01.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.756+0000 7fbd7ad9d700 1 -- 172.21.15.45:0/529496222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd7c1036a0 msgr2=0x7fbd7c19f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:01.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.756+0000 7fbd7ad9d700 1 --2- 172.21.15.45:0/529496222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd7c1036a0 0x7fbd7c19f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:01.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.756+0000 7fbd7ad9d700 1 -- 172.21.15.45:0/529496222 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd7c102d00 msgr2=0x7fbd7c198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:01.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.756+0000 7fbd7ad9d700 1 --2- 172.21.15.45:0/529496222 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd7c102d00 0x7fbd7c198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:01.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.756+0000 7fbd7ad9d700 1 -- 172.21.15.45:0/529496222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd700095f0 con 0x7fbd7c101be0 2024-05-10T03:39:01.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.756+0000 7fbd7ad9d700 1 --2- 172.21.15.45:0/529496222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd7c101be0 0x7fbd7c1980c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c00e940 tx=0x7fbd6c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:01.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.756+0000 7fbd63fff700 1 -- 172.21.15.45:0/529496222 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c00cbd0 con 0x7fbd7c101be0 2024-05-10T03:39:01.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.756+0000 7fbd63fff700 1 -- 172.21.15.45:0/529496222 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbd6c00ee90 con 0x7fbd7c101be0 2024-05-10T03:39:01.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.756+0000 7fbd811f8700 1 -- 172.21.15.45:0/529496222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd7c1a01b0 con 0x7fbd7c101be0 2024-05-10T03:39:01.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.756+0000 7fbd63fff700 1 -- 172.21.15.45:0/529496222 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c003e30 con 0x7fbd7c101be0 2024-05-10T03:39:01.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.756+0000 7fbd811f8700 1 -- 172.21.15.45:0/529496222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd7c1a06c0 con 0x7fbd7c101be0 2024-05-10T03:39:01.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.758+0000 7fbd811f8700 1 -- 172.21.15.45:0/529496222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd7c108df0 con 0x7fbd7c101be0 2024-05-10T03:39:01.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.759+0000 7fbd63fff700 1 -- 172.21.15.45:0/529496222 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fbd6c003f90 con 0x7fbd7c101be0 2024-05-10T03:39:01.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.760+0000 7fbd63fff700 1 --2- 172.21.15.45:0/529496222 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fbd640a11b0 0x7fbd640a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:01.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.760+0000 7fbd7a59c700 1 --2- 172.21.15.45:0/529496222 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fbd640a11b0 0x7fbd640a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:01.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.760+0000 7fbd63fff700 1 -- 172.21.15.45:0/529496222 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fbd6c014070 con 0x7fbd7c101be0 2024-05-10T03:39:01.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.760+0000 7fbd7a59c700 1 --2- 172.21.15.45:0/529496222 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fbd640a11b0 0x7fbd640a36c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbd7000b2e0 tx=0x7fbd7001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:01.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.763+0000 7fbd63fff700 1 -- 172.21.15.45:0/529496222 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fbd6c096b50 con 0x7fbd7c101be0 2024-05-10T03:39:01.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.977+0000 7fbd811f8700 1 -- 172.21.15.45:0/529496222 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbd7c061650 con 0x7fbd640a11b0 2024-05-10T03:39:01.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.990+0000 7fbd63fff700 1 -- 172.21.15.45:0/529496222 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+418129 (secure 0 0 0) 0x7fbd7c061650 con 0x7fbd640a11b0 2024-05-10T03:39:01.998 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:39:02.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.994+0000 7fbd811f8700 1 -- 172.21.15.45:0/529496222 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fbd640a11b0 msgr2=0x7fbd640a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:02.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.994+0000 7fbd811f8700 1 --2- 172.21.15.45:0/529496222 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fbd640a11b0 0x7fbd640a36c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbd7000b2e0 tx=0x7fbd7001a040 comp rx=0 tx=0).stop 2024-05-10T03:39:02.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.994+0000 7fbd811f8700 1 -- 172.21.15.45:0/529496222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd7c101be0 msgr2=0x7fbd7c1980c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:02.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.994+0000 7fbd811f8700 1 --2- 172.21.15.45:0/529496222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd7c101be0 0x7fbd7c1980c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c00e940 tx=0x7fbd6c00ec50 comp rx=0 tx=0).stop 2024-05-10T03:39:02.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.994+0000 7fbd811f8700 1 -- 172.21.15.45:0/529496222 shutdown_connections 2024-05-10T03:39:02.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.994+0000 7fbd811f8700 1 --2- 172.21.15.45:0/529496222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd7c1036a0 0x7fbd7c19f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:02.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.994+0000 7fbd811f8700 1 --2- 172.21.15.45:0/529496222 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fbd640a11b0 0x7fbd640a36c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:02.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.994+0000 7fbd811f8700 1 --2- 172.21.15.45:0/529496222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd7c101be0 0x7fbd7c1980c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:02.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.994+0000 7fbd811f8700 1 --2- 172.21.15.45:0/529496222 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd7c102d00 0x7fbd7c198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:02.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.994+0000 7fbd811f8700 1 -- 172.21.15.45:0/529496222 >> 172.21.15.45:0/529496222 conn(0x7fbd7c0fd210 msgr2=0x7fbd7c105f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:02.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.994+0000 7fbd811f8700 1 -- 172.21.15.45:0/529496222 shutdown_connections 2024-05-10T03:39:02.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:01.994+0000 7fbd811f8700 1 -- 172.21.15.45:0/529496222 wait complete. 2024-05-10T03:39:02.002 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-05-10T03:39:02.012 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2024-05-10T03:39:01.880262+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":636958,"num_objects":88,"num_object_clones":0,"num_object_copies":266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":141,"num_read_kb":121,"num_write":377,"num_write_kb":3040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":312,"ondisk_log_size":312,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":362012,"kb_used_data":13244,"kb_used_omap":18,"kb_used_meta":348653,"kb_avail":1124579812,"statfs":{"total":1151940427776,"available":1151569727488,"internally_reserved":0,"allocated":13561856,"data_stored":7452511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19129,"internal_metadata":357020999},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":42137,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":149,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004265"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145959+0000","last_change":"2024-05-10T03:38:36.586241+0000","last_active":"2024-05-10T03:38:41.145959+0000","last_peered":"2024-05-10T03:38:41.145959+0000","last_clean":"2024-05-10T03:38:41.145959+0000","last_became_active":"2024-05-10T03:38:36.585655+0000","last_became_peered":"2024-05-10T03:38:36.585655+0000","last_unstale":"2024-05-10T03:38:41.145959+0000","last_undegraded":"2024-05-10T03:38:41.145959+0000","last_fullsized":"2024-05-10T03:38:41.145959+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:58:24.614952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145158+0000","last_change":"2024-05-10T03:38:36.588174+0000","last_active":"2024-05-10T03:38:41.145158+0000","last_peered":"2024-05-10T03:38:41.145158+0000","last_clean":"2024-05-10T03:38:41.145158+0000","last_became_active":"2024-05-10T03:38:36.587843+0000","last_became_peered":"2024-05-10T03:38:36.587843+0000","last_unstale":"2024-05-10T03:38:41.145158+0000","last_undegraded":"2024-05-10T03:38:41.145158+0000","last_fullsized":"2024-05-10T03:38:41.145158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:56.414407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145210+0000","last_change":"2024-05-10T03:38:36.587344+0000","last_active":"2024-05-10T03:38:41.145210+0000","last_peered":"2024-05-10T03:38:41.145210+0000","last_clean":"2024-05-10T03:38:41.145210+0000","last_became_active":"2024-05-10T03:38:36.586345+0000","last_became_peered":"2024-05-10T03:38:36.586345+0000","last_unstale":"2024-05-10T03:38:41.145210+0000","last_undegraded":"2024-05-10T03:38:41.145210+0000","last_fullsized":"2024-05-10T03:38:41.145210+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:36.159864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.146233+0000","last_change":"2024-05-10T03:38:36.573019+0000","last_active":"2024-05-10T03:38:41.146233+0000","last_peered":"2024-05-10T03:38:41.146233+0000","last_clean":"2024-05-10T03:38:41.146233+0000","last_became_active":"2024-05-10T03:38:36.572667+0000","last_became_peered":"2024-05-10T03:38:36.572667+0000","last_unstale":"2024-05-10T03:38:41.146233+0000","last_undegraded":"2024-05-10T03:38:41.146233+0000","last_fullsized":"2024-05-10T03:38:41.146233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:24:23.722642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145744+0000","last_change":"2024-05-10T03:38:36.577069+0000","last_active":"2024-05-10T03:38:41.145744+0000","last_peered":"2024-05-10T03:38:41.145744+0000","last_clean":"2024-05-10T03:38:41.145744+0000","last_became_active":"2024-05-10T03:38:36.576683+0000","last_became_peered":"2024-05-10T03:38:36.576683+0000","last_unstale":"2024-05-10T03:38:41.145744+0000","last_undegraded":"2024-05-10T03:38:41.145744+0000","last_fullsized":"2024-05-10T03:38:41.145744+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:09:15.280098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.148508+0000","last_change":"2024-05-10T03:38:36.577518+0000","last_active":"2024-05-10T03:38:41.148508+0000","last_peered":"2024-05-10T03:38:41.148508+0000","last_clean":"2024-05-10T03:38:41.148508+0000","last_became_active":"2024-05-10T03:38:36.577147+0000","last_became_peered":"2024-05-10T03:38:36.577147+0000","last_unstale":"2024-05-10T03:38:41.148508+0000","last_undegraded":"2024-05-10T03:38:41.148508+0000","last_fullsized":"2024-05-10T03:38:41.148508+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:39:42.779405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.072733+0000","last_change":"2024-05-10T03:38:36.594241+0000","last_active":"2024-05-10T03:38:41.072733+0000","last_peered":"2024-05-10T03:38:41.072733+0000","last_clean":"2024-05-10T03:38:41.072733+0000","last_became_active":"2024-05-10T03:38:36.593943+0000","last_became_peered":"2024-05-10T03:38:36.593943+0000","last_unstale":"2024-05-10T03:38:41.072733+0000","last_undegraded":"2024-05-10T03:38:41.072733+0000","last_fullsized":"2024-05-10T03:38:41.072733+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:00.521083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.144983+0000","last_change":"2024-05-10T03:38:36.578318+0000","last_active":"2024-05-10T03:38:41.144983+0000","last_peered":"2024-05-10T03:38:41.144983+0000","last_clean":"2024-05-10T03:38:41.144983+0000","last_became_active":"2024-05-10T03:38:36.577967+0000","last_became_peered":"2024-05-10T03:38:36.577967+0000","last_unstale":"2024-05-10T03:38:41.144983+0000","last_undegraded":"2024-05-10T03:38:41.144983+0000","last_fullsized":"2024-05-10T03:38:41.144983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:45:27.988368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145721+0000","last_change":"2024-05-10T03:38:36.590219+0000","last_active":"2024-05-10T03:38:41.145721+0000","last_peered":"2024-05-10T03:38:41.145721+0000","last_clean":"2024-05-10T03:38:41.145721+0000","last_became_active":"2024-05-10T03:38:36.589849+0000","last_became_peered":"2024-05-10T03:38:36.589849+0000","last_unstale":"2024-05-10T03:38:41.145721+0000","last_undegraded":"2024-05-10T03:38:41.145721+0000","last_fullsized":"2024-05-10T03:38:41.145721+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:08:17.073204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.149019+0000","last_change":"2024-05-10T03:38:36.580555+0000","last_active":"2024-05-10T03:38:41.149019+0000","last_peered":"2024-05-10T03:38:41.149019+0000","last_clean":"2024-05-10T03:38:41.149019+0000","last_became_active":"2024-05-10T03:38:36.577575+0000","last_became_peered":"2024-05-10T03:38:36.577575+0000","last_unstale":"2024-05-10T03:38:41.149019+0000","last_undegraded":"2024-05-10T03:38:41.149019+0000","last_fullsized":"2024-05-10T03:38:41.149019+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:43:29.237054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.073279+0000","last_change":"2024-05-10T03:38:36.586599+0000","last_active":"2024-05-10T03:38:41.073279+0000","last_peered":"2024-05-10T03:38:41.073279+0000","last_clean":"2024-05-10T03:38:41.073279+0000","last_became_active":"2024-05-10T03:38:36.585794+0000","last_became_peered":"2024-05-10T03:38:36.585794+0000","last_unstale":"2024-05-10T03:38:41.073279+0000","last_undegraded":"2024-05-10T03:38:41.073279+0000","last_fullsized":"2024-05-10T03:38:41.073279+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:25:18.337715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.146131+0000","last_change":"2024-05-10T03:38:36.578957+0000","last_active":"2024-05-10T03:38:41.146131+0000","last_peered":"2024-05-10T03:38:41.146131+0000","last_clean":"2024-05-10T03:38:41.146131+0000","last_became_active":"2024-05-10T03:38:36.578636+0000","last_became_peered":"2024-05-10T03:38:36.578636+0000","last_unstale":"2024-05-10T03:38:41.146131+0000","last_undegraded":"2024-05-10T03:38:41.146131+0000","last_fullsized":"2024-05-10T03:38:41.146131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:55:38.830864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.072535+0000","last_change":"2024-05-10T03:38:36.583397+0000","last_active":"2024-05-10T03:38:41.072535+0000","last_peered":"2024-05-10T03:38:41.072535+0000","last_clean":"2024-05-10T03:38:41.072535+0000","last_became_active":"2024-05-10T03:38:36.583054+0000","last_became_peered":"2024-05-10T03:38:36.583054+0000","last_unstale":"2024-05-10T03:38:41.072535+0000","last_undegraded":"2024-05-10T03:38:41.072535+0000","last_fullsized":"2024-05-10T03:38:41.072535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:52:24.223963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.144943+0000","last_change":"2024-05-10T03:38:36.590205+0000","last_active":"2024-05-10T03:38:41.144943+0000","last_peered":"2024-05-10T03:38:41.144943+0000","last_clean":"2024-05-10T03:38:41.144943+0000","last_became_active":"2024-05-10T03:38:36.589880+0000","last_became_peered":"2024-05-10T03:38:36.589880+0000","last_unstale":"2024-05-10T03:38:41.144943+0000","last_undegraded":"2024-05-10T03:38:41.144943+0000","last_fullsized":"2024-05-10T03:38:41.144943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:22:26.374034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145486+0000","last_change":"2024-05-10T03:38:36.575776+0000","last_active":"2024-05-10T03:38:41.145486+0000","last_peered":"2024-05-10T03:38:41.145486+0000","last_clean":"2024-05-10T03:38:41.145486+0000","last_became_active":"2024-05-10T03:38:36.575431+0000","last_became_peered":"2024-05-10T03:38:36.575431+0000","last_unstale":"2024-05-10T03:38:41.145486+0000","last_undegraded":"2024-05-10T03:38:41.145486+0000","last_fullsized":"2024-05-10T03:38:41.145486+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:05.252117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145073+0000","last_change":"2024-05-10T03:38:36.591061+0000","last_active":"2024-05-10T03:38:41.145073+0000","last_peered":"2024-05-10T03:38:41.145073+0000","last_clean":"2024-05-10T03:38:41.145073+0000","last_became_active":"2024-05-10T03:38:36.590698+0000","last_became_peered":"2024-05-10T03:38:36.590698+0000","last_unstale":"2024-05-10T03:38:41.145073+0000","last_undegraded":"2024-05-10T03:38:41.145073+0000","last_fullsized":"2024-05-10T03:38:41.145073+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:44:43.130908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145856+0000","last_change":"2024-05-10T03:38:36.585990+0000","last_active":"2024-05-10T03:38:41.145856+0000","last_peered":"2024-05-10T03:38:41.145856+0000","last_clean":"2024-05-10T03:38:41.145856+0000","last_became_active":"2024-05-10T03:38:36.585221+0000","last_became_peered":"2024-05-10T03:38:36.585221+0000","last_unstale":"2024-05-10T03:38:41.145856+0000","last_undegraded":"2024-05-10T03:38:41.145856+0000","last_fullsized":"2024-05-10T03:38:41.145856+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:57:58.981790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.146899+0000","last_change":"2024-05-10T03:38:36.586651+0000","last_active":"2024-05-10T03:38:41.146899+0000","last_peered":"2024-05-10T03:38:41.146899+0000","last_clean":"2024-05-10T03:38:41.146899+0000","last_became_active":"2024-05-10T03:38:36.586243+0000","last_became_peered":"2024-05-10T03:38:36.586243+0000","last_unstale":"2024-05-10T03:38:41.146899+0000","last_undegraded":"2024-05-10T03:38:41.146899+0000","last_fullsized":"2024-05-10T03:38:41.146899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:15:58.148040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.073617+0000","last_change":"2024-05-10T03:38:36.583740+0000","last_active":"2024-05-10T03:38:41.073617+0000","last_peered":"2024-05-10T03:38:41.073617+0000","last_clean":"2024-05-10T03:38:41.073617+0000","last_became_active":"2024-05-10T03:38:36.583359+0000","last_became_peered":"2024-05-10T03:38:36.583359+0000","last_unstale":"2024-05-10T03:38:41.073617+0000","last_undegraded":"2024-05-10T03:38:41.073617+0000","last_fullsized":"2024-05-10T03:38:41.073617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:31:29.286667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.129220+0000","last_change":"2024-05-10T03:38:40.605484+0000","last_active":"2024-05-10T03:38:42.129220+0000","last_peered":"2024-05-10T03:38:42.129220+0000","last_clean":"2024-05-10T03:38:42.129220+0000","last_became_active":"2024-05-10T03:38:40.605105+0000","last_became_peered":"2024-05-10T03:38:40.605105+0000","last_unstale":"2024-05-10T03:38:42.129220+0000","last_undegraded":"2024-05-10T03:38:42.129220+0000","last_fullsized":"2024-05-10T03:38:42.129220+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:11:34.548916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:39:00.023246+0000","last_change":"2024-05-10T03:38:36.093877+0000","last_active":"2024-05-10T03:39:00.023246+0000","last_peered":"2024-05-10T03:39:00.023246+0000","last_clean":"2024-05-10T03:39:00.023246+0000","last_became_active":"2024-05-10T03:38:36.093499+0000","last_became_peered":"2024-05-10T03:38:36.093499+0000","last_unstale":"2024-05-10T03:39:00.023246+0000","last_undegraded":"2024-05-10T03:39:00.023246+0000","last_fullsized":"2024-05-10T03:39:00.023246+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:42:17.171167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145352+0000","last_change":"2024-05-10T03:38:36.570924+0000","last_active":"2024-05-10T03:38:41.145352+0000","last_peered":"2024-05-10T03:38:41.145352+0000","last_clean":"2024-05-10T03:38:41.145352+0000","last_became_active":"2024-05-10T03:38:36.569038+0000","last_became_peered":"2024-05-10T03:38:36.569038+0000","last_unstale":"2024-05-10T03:38:41.145352+0000","last_undegraded":"2024-05-10T03:38:41.145352+0000","last_fullsized":"2024-05-10T03:38:41.145352+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:35:20.327463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145007+0000","last_change":"2024-05-10T03:38:40.608982+0000","last_active":"2024-05-10T03:38:41.145007+0000","last_peered":"2024-05-10T03:38:41.145007+0000","last_clean":"2024-05-10T03:38:41.145007+0000","last_became_active":"2024-05-10T03:38:40.608619+0000","last_became_peered":"2024-05-10T03:38:40.608619+0000","last_unstale":"2024-05-10T03:38:41.145007+0000","last_undegraded":"2024-05-10T03:38:41.145007+0000","last_fullsized":"2024-05-10T03:38:41.145007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:35:56.411530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.074010+0000","last_change":"2024-05-10T03:38:36.101669+0000","last_active":"2024-05-10T03:38:42.074010+0000","last_peered":"2024-05-10T03:38:42.074010+0000","last_clean":"2024-05-10T03:38:42.074010+0000","last_became_active":"2024-05-10T03:38:36.101231+0000","last_became_peered":"2024-05-10T03:38:36.101231+0000","last_unstale":"2024-05-10T03:38:42.074010+0000","last_undegraded":"2024-05-10T03:38:42.074010+0000","last_fullsized":"2024-05-10T03:38:42.074010+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:42:21.992880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145866+0000","last_change":"2024-05-10T03:38:36.585580+0000","last_active":"2024-05-10T03:38:41.145866+0000","last_peered":"2024-05-10T03:38:41.145866+0000","last_clean":"2024-05-10T03:38:41.145866+0000","last_became_active":"2024-05-10T03:38:36.585239+0000","last_became_peered":"2024-05-10T03:38:36.585239+0000","last_unstale":"2024-05-10T03:38:41.145866+0000","last_undegraded":"2024-05-10T03:38:41.145866+0000","last_fullsized":"2024-05-10T03:38:41.145866+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:39:42.886154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145751+0000","last_change":"2024-05-10T03:38:40.610372+0000","last_active":"2024-05-10T03:38:41.145751+0000","last_peered":"2024-05-10T03:38:41.145751+0000","last_clean":"2024-05-10T03:38:41.145751+0000","last_became_active":"2024-05-10T03:38:40.609958+0000","last_became_peered":"2024-05-10T03:38:40.609958+0000","last_unstale":"2024-05-10T03:38:41.145751+0000","last_undegraded":"2024-05-10T03:38:41.145751+0000","last_fullsized":"2024-05-10T03:38:41.145751+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:04:37.461729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'7","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:57.993891+0000","last_change":"2024-05-10T03:38:36.091809+0000","last_active":"2024-05-10T03:38:57.993891+0000","last_peered":"2024-05-10T03:38:57.993891+0000","last_clean":"2024-05-10T03:38:57.993891+0000","last_became_active":"2024-05-10T03:38:36.091372+0000","last_became_peered":"2024-05-10T03:38:36.091372+0000","last_unstale":"2024-05-10T03:38:57.993891+0000","last_undegraded":"2024-05-10T03:38:57.993891+0000","last_fullsized":"2024-05-10T03:38:57.993891+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:25:01.784559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.146062+0000","last_change":"2024-05-10T03:38:36.595389+0000","last_active":"2024-05-10T03:38:41.146062+0000","last_peered":"2024-05-10T03:38:41.146062+0000","last_clean":"2024-05-10T03:38:41.146062+0000","last_became_active":"2024-05-10T03:38:36.595011+0000","last_became_peered":"2024-05-10T03:38:36.595011+0000","last_unstale":"2024-05-10T03:38:41.146062+0000","last_undegraded":"2024-05-10T03:38:41.146062+0000","last_fullsized":"2024-05-10T03:38:41.146062+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:54:38.377508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145283+0000","last_change":"2024-05-10T03:38:40.605656+0000","last_active":"2024-05-10T03:38:41.145283+0000","last_peered":"2024-05-10T03:38:41.145283+0000","last_clean":"2024-05-10T03:38:41.145283+0000","last_became_active":"2024-05-10T03:38:40.605262+0000","last_became_peered":"2024-05-10T03:38:40.605262+0000","last_unstale":"2024-05-10T03:38:41.145283+0000","last_undegraded":"2024-05-10T03:38:41.145283+0000","last_fullsized":"2024-05-10T03:38:41.145283+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:11:27.398282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.146411+0000","last_change":"2024-05-10T03:38:36.090763+0000","last_active":"2024-05-10T03:38:41.146411+0000","last_peered":"2024-05-10T03:38:41.146411+0000","last_clean":"2024-05-10T03:38:41.146411+0000","last_became_active":"2024-05-10T03:38:36.089485+0000","last_became_peered":"2024-05-10T03:38:36.089485+0000","last_unstale":"2024-05-10T03:38:41.146411+0000","last_undegraded":"2024-05-10T03:38:41.146411+0000","last_fullsized":"2024-05-10T03:38:41.146411+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:33:33.111508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.146872+0000","last_change":"2024-05-10T03:38:36.587831+0000","last_active":"2024-05-10T03:38:41.146872+0000","last_peered":"2024-05-10T03:38:41.146872+0000","last_clean":"2024-05-10T03:38:41.146872+0000","last_became_active":"2024-05-10T03:38:36.587503+0000","last_became_peered":"2024-05-10T03:38:36.587503+0000","last_unstale":"2024-05-10T03:38:41.146872+0000","last_undegraded":"2024-05-10T03:38:41.146872+0000","last_fullsized":"2024-05-10T03:38:41.146872+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:52.335134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.129856+0000","last_change":"2024-05-10T03:38:40.601327+0000","last_active":"2024-05-10T03:38:42.129856+0000","last_peered":"2024-05-10T03:38:42.129856+0000","last_clean":"2024-05-10T03:38:42.129856+0000","last_became_active":"2024-05-10T03:38:40.600901+0000","last_became_peered":"2024-05-10T03:38:40.600901+0000","last_unstale":"2024-05-10T03:38:42.129856+0000","last_undegraded":"2024-05-10T03:38:42.129856+0000","last_fullsized":"2024-05-10T03:38:42.129856+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:28.285707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:55.959218+0000","last_change":"2024-05-10T03:38:36.094064+0000","last_active":"2024-05-10T03:38:55.959218+0000","last_peered":"2024-05-10T03:38:55.959218+0000","last_clean":"2024-05-10T03:38:55.959218+0000","last_became_active":"2024-05-10T03:38:36.093522+0000","last_became_peered":"2024-05-10T03:38:36.093522+0000","last_unstale":"2024-05-10T03:38:55.959218+0000","last_undegraded":"2024-05-10T03:38:55.959218+0000","last_fullsized":"2024-05-10T03:38:55.959218+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:25:14.257166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.147415+0000","last_change":"2024-05-10T03:38:36.580553+0000","last_active":"2024-05-10T03:38:41.147415+0000","last_peered":"2024-05-10T03:38:41.147415+0000","last_clean":"2024-05-10T03:38:41.147415+0000","last_became_active":"2024-05-10T03:38:36.580160+0000","last_became_peered":"2024-05-10T03:38:36.580160+0000","last_unstale":"2024-05-10T03:38:41.147415+0000","last_undegraded":"2024-05-10T03:38:41.147415+0000","last_fullsized":"2024-05-10T03:38:41.147415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:01:14.373430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.130220+0000","last_change":"2024-05-10T03:38:40.609034+0000","last_active":"2024-05-10T03:38:42.130220+0000","last_peered":"2024-05-10T03:38:42.130220+0000","last_clean":"2024-05-10T03:38:42.130220+0000","last_became_active":"2024-05-10T03:38:40.608617+0000","last_became_peered":"2024-05-10T03:38:40.608617+0000","last_unstale":"2024-05-10T03:38:42.130220+0000","last_undegraded":"2024-05-10T03:38:42.130220+0000","last_fullsized":"2024-05-10T03:38:42.130220+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:55:28.669881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:57.994047+0000","last_change":"2024-05-10T03:38:36.103661+0000","last_active":"2024-05-10T03:38:57.994047+0000","last_peered":"2024-05-10T03:38:57.994047+0000","last_clean":"2024-05-10T03:38:57.994047+0000","last_became_active":"2024-05-10T03:38:36.103379+0000","last_became_peered":"2024-05-10T03:38:36.103379+0000","last_unstale":"2024-05-10T03:38:57.994047+0000","last_undegraded":"2024-05-10T03:38:57.994047+0000","last_fullsized":"2024-05-10T03:38:57.994047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:10:42.082568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.146410+0000","last_change":"2024-05-10T03:38:36.569429+0000","last_active":"2024-05-10T03:38:41.146410+0000","last_peered":"2024-05-10T03:38:41.146410+0000","last_clean":"2024-05-10T03:38:41.146410+0000","last_became_active":"2024-05-10T03:38:36.569042+0000","last_became_peered":"2024-05-10T03:38:36.569042+0000","last_unstale":"2024-05-10T03:38:41.146410+0000","last_undegraded":"2024-05-10T03:38:41.146410+0000","last_fullsized":"2024-05-10T03:38:41.146410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:45:14.912428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.816597+0000","last_change":"2024-05-10T03:38:40.607734+0000","last_active":"2024-05-10T03:38:41.816597+0000","last_peered":"2024-05-10T03:38:41.816597+0000","last_clean":"2024-05-10T03:38:41.816597+0000","last_became_active":"2024-05-10T03:38:40.607331+0000","last_became_peered":"2024-05-10T03:38:40.607331+0000","last_unstale":"2024-05-10T03:38:41.816597+0000","last_undegraded":"2024-05-10T03:38:41.816597+0000","last_fullsized":"2024-05-10T03:38:41.816597+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:45:08.360275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:56.977936+0000","last_change":"2024-05-10T03:38:36.083651+0000","last_active":"2024-05-10T03:38:56.977936+0000","last_peered":"2024-05-10T03:38:56.977936+0000","last_clean":"2024-05-10T03:38:56.977936+0000","last_became_active":"2024-05-10T03:38:36.083235+0000","last_became_peered":"2024-05-10T03:38:36.083235+0000","last_unstale":"2024-05-10T03:38:56.977936+0000","last_undegraded":"2024-05-10T03:38:56.977936+0000","last_fullsized":"2024-05-10T03:38:56.977936+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:28:43.179157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145103+0000","last_change":"2024-05-10T03:38:36.579055+0000","last_active":"2024-05-10T03:38:41.145103+0000","last_peered":"2024-05-10T03:38:41.145103+0000","last_clean":"2024-05-10T03:38:41.145103+0000","last_became_active":"2024-05-10T03:38:36.578200+0000","last_became_peered":"2024-05-10T03:38:36.578200+0000","last_unstale":"2024-05-10T03:38:41.145103+0000","last_undegraded":"2024-05-10T03:38:41.145103+0000","last_fullsized":"2024-05-10T03:38:41.145103+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:48:12.749264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.129930+0000","last_change":"2024-05-10T03:38:40.603903+0000","last_active":"2024-05-10T03:38:42.129930+0000","last_peered":"2024-05-10T03:38:42.129930+0000","last_clean":"2024-05-10T03:38:42.129930+0000","last_became_active":"2024-05-10T03:38:40.603481+0000","last_became_peered":"2024-05-10T03:38:40.603481+0000","last_unstale":"2024-05-10T03:38:42.129930+0000","last_undegraded":"2024-05-10T03:38:42.129930+0000","last_fullsized":"2024-05-10T03:38:42.129930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:44:48.526838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:57.993474+0000","last_change":"2024-05-10T03:38:36.093549+0000","last_active":"2024-05-10T03:38:57.993474+0000","last_peered":"2024-05-10T03:38:57.993474+0000","last_clean":"2024-05-10T03:38:57.993474+0000","last_became_active":"2024-05-10T03:38:36.093244+0000","last_became_peered":"2024-05-10T03:38:36.093244+0000","last_unstale":"2024-05-10T03:38:57.993474+0000","last_undegraded":"2024-05-10T03:38:57.993474+0000","last_fullsized":"2024-05-10T03:38:57.993474+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:11:55.727728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.146777+0000","last_change":"2024-05-10T03:38:36.582623+0000","last_active":"2024-05-10T03:38:41.146777+0000","last_peered":"2024-05-10T03:38:41.146777+0000","last_clean":"2024-05-10T03:38:41.146777+0000","last_became_active":"2024-05-10T03:38:36.582262+0000","last_became_peered":"2024-05-10T03:38:36.582262+0000","last_unstale":"2024-05-10T03:38:41.146777+0000","last_undegraded":"2024-05-10T03:38:41.146777+0000","last_fullsized":"2024-05-10T03:38:41.146777+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:48.561206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.073557+0000","last_change":"2024-05-10T03:38:40.602050+0000","last_active":"2024-05-10T03:38:42.073557+0000","last_peered":"2024-05-10T03:38:42.073557+0000","last_clean":"2024-05-10T03:38:42.073557+0000","last_became_active":"2024-05-10T03:38:40.601699+0000","last_became_peered":"2024-05-10T03:38:40.601699+0000","last_unstale":"2024-05-10T03:38:42.073557+0000","last_undegraded":"2024-05-10T03:38:42.073557+0000","last_fullsized":"2024-05-10T03:38:42.073557+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:56.778636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:55.957804+0000","last_change":"2024-05-10T03:38:36.095747+0000","last_active":"2024-05-10T03:38:55.957804+0000","last_peered":"2024-05-10T03:38:55.957804+0000","last_clean":"2024-05-10T03:38:55.957804+0000","last_became_active":"2024-05-10T03:38:36.095371+0000","last_became_peered":"2024-05-10T03:38:36.095371+0000","last_unstale":"2024-05-10T03:38:55.957804+0000","last_undegraded":"2024-05-10T03:38:55.957804+0000","last_fullsized":"2024-05-10T03:38:55.957804+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:02:37.435286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145526+0000","last_change":"2024-05-10T03:38:36.591321+0000","last_active":"2024-05-10T03:38:41.145526+0000","last_peered":"2024-05-10T03:38:41.145526+0000","last_clean":"2024-05-10T03:38:41.145526+0000","last_became_active":"2024-05-10T03:38:36.589852+0000","last_became_peered":"2024-05-10T03:38:36.589852+0000","last_unstale":"2024-05-10T03:38:41.145526+0000","last_undegraded":"2024-05-10T03:38:41.145526+0000","last_fullsized":"2024-05-10T03:38:41.145526+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:43.075901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.667123+0000","last_change":"2024-05-10T03:38:40.605096+0000","last_active":"2024-05-10T03:38:41.667123+0000","last_peered":"2024-05-10T03:38:41.667123+0000","last_clean":"2024-05-10T03:38:41.667123+0000","last_became_active":"2024-05-10T03:38:40.604595+0000","last_became_peered":"2024-05-10T03:38:40.604595+0000","last_unstale":"2024-05-10T03:38:41.667123+0000","last_undegraded":"2024-05-10T03:38:41.667123+0000","last_fullsized":"2024-05-10T03:38:41.667123+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:14.547025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:58.997430+0000","last_change":"2024-05-10T03:38:36.097214+0000","last_active":"2024-05-10T03:38:58.997430+0000","last_peered":"2024-05-10T03:38:58.997430+0000","last_clean":"2024-05-10T03:38:58.997430+0000","last_became_active":"2024-05-10T03:38:36.096835+0000","last_became_peered":"2024-05-10T03:38:36.096835+0000","last_unstale":"2024-05-10T03:38:58.997430+0000","last_undegraded":"2024-05-10T03:38:58.997430+0000","last_fullsized":"2024-05-10T03:38:58.997430+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:50.757974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145962+0000","last_change":"2024-05-10T03:38:36.591118+0000","last_active":"2024-05-10T03:38:41.145962+0000","last_peered":"2024-05-10T03:38:41.145962+0000","last_clean":"2024-05-10T03:38:41.145962+0000","last_became_active":"2024-05-10T03:38:36.590726+0000","last_became_peered":"2024-05-10T03:38:36.590726+0000","last_unstale":"2024-05-10T03:38:41.145962+0000","last_undegraded":"2024-05-10T03:38:41.145962+0000","last_fullsized":"2024-05-10T03:38:41.145962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:45:53.701069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145981+0000","last_change":"2024-05-10T03:38:40.605627+0000","last_active":"2024-05-10T03:38:41.145981+0000","last_peered":"2024-05-10T03:38:41.145981+0000","last_clean":"2024-05-10T03:38:41.145981+0000","last_became_active":"2024-05-10T03:38:40.605116+0000","last_became_peered":"2024-05-10T03:38:40.605116+0000","last_unstale":"2024-05-10T03:38:41.145981+0000","last_undegraded":"2024-05-10T03:38:41.145981+0000","last_fullsized":"2024-05-10T03:38:41.145981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:50:08.759725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:55.954258+0000","last_change":"2024-05-10T03:38:36.102257+0000","last_active":"2024-05-10T03:38:55.954258+0000","last_peered":"2024-05-10T03:38:55.954258+0000","last_clean":"2024-05-10T03:38:55.954258+0000","last_became_active":"2024-05-10T03:38:36.101876+0000","last_became_peered":"2024-05-10T03:38:36.101876+0000","last_unstale":"2024-05-10T03:38:55.954258+0000","last_undegraded":"2024-05-10T03:38:55.954258+0000","last_fullsized":"2024-05-10T03:38:55.954258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:38:01.164794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.146216+0000","last_change":"2024-05-10T03:38:36.591746+0000","last_active":"2024-05-10T03:38:41.146216+0000","last_peered":"2024-05-10T03:38:41.146216+0000","last_clean":"2024-05-10T03:38:41.146216+0000","last_became_active":"2024-05-10T03:38:36.591474+0000","last_became_peered":"2024-05-10T03:38:36.591474+0000","last_unstale":"2024-05-10T03:38:41.146216+0000","last_undegraded":"2024-05-10T03:38:41.146216+0000","last_fullsized":"2024-05-10T03:38:41.146216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:18:02.773737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.667154+0000","last_change":"2024-05-10T03:38:40.605956+0000","last_active":"2024-05-10T03:38:41.667154+0000","last_peered":"2024-05-10T03:38:41.667154+0000","last_clean":"2024-05-10T03:38:41.667154+0000","last_became_active":"2024-05-10T03:38:40.605466+0000","last_became_peered":"2024-05-10T03:38:40.605466+0000","last_unstale":"2024-05-10T03:38:41.667154+0000","last_undegraded":"2024-05-10T03:38:41.667154+0000","last_fullsized":"2024-05-10T03:38:41.667154+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:07:44.234771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"86'25","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:59.828390+0000","last_change":"2024-05-10T03:38:36.097746+0000","last_active":"2024-05-10T03:38:59.828390+0000","last_peered":"2024-05-10T03:38:59.828390+0000","last_clean":"2024-05-10T03:38:59.828390+0000","last_became_active":"2024-05-10T03:38:36.097269+0000","last_became_peered":"2024-05-10T03:38:36.097269+0000","last_unstale":"2024-05-10T03:38:59.828390+0000","last_undegraded":"2024-05-10T03:38:59.828390+0000","last_fullsized":"2024-05-10T03:38:59.828390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:47:07.830787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40427,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.146676+0000","last_change":"2024-05-10T03:38:36.579560+0000","last_active":"2024-05-10T03:38:41.146676+0000","last_peered":"2024-05-10T03:38:41.146676+0000","last_clean":"2024-05-10T03:38:41.146676+0000","last_became_active":"2024-05-10T03:38:36.579217+0000","last_became_peered":"2024-05-10T03:38:36.579217+0000","last_unstale":"2024-05-10T03:38:41.146676+0000","last_undegraded":"2024-05-10T03:38:41.146676+0000","last_fullsized":"2024-05-10T03:38:41.146676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:11:50.208794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.074671+0000","last_change":"2024-05-10T03:38:40.599253+0000","last_active":"2024-05-10T03:38:42.074671+0000","last_peered":"2024-05-10T03:38:42.074671+0000","last_clean":"2024-05-10T03:38:42.074671+0000","last_became_active":"2024-05-10T03:38:40.597818+0000","last_became_peered":"2024-05-10T03:38:40.597818+0000","last_unstale":"2024-05-10T03:38:42.074671+0000","last_undegraded":"2024-05-10T03:38:42.074671+0000","last_fullsized":"2024-05-10T03:38:42.074671+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:48:37.286108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:56.976240+0000","last_change":"2024-05-10T03:38:36.100727+0000","last_active":"2024-05-10T03:38:56.976240+0000","last_peered":"2024-05-10T03:38:56.976240+0000","last_clean":"2024-05-10T03:38:56.976240+0000","last_became_active":"2024-05-10T03:38:36.100381+0000","last_became_peered":"2024-05-10T03:38:36.100381+0000","last_unstale":"2024-05-10T03:38:56.976240+0000","last_undegraded":"2024-05-10T03:38:56.976240+0000","last_fullsized":"2024-05-10T03:38:56.976240+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:57:53.831417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.072385+0000","last_change":"2024-05-10T03:38:36.580924+0000","last_active":"2024-05-10T03:38:41.072385+0000","last_peered":"2024-05-10T03:38:41.072385+0000","last_clean":"2024-05-10T03:38:41.072385+0000","last_became_active":"2024-05-10T03:38:36.580598+0000","last_became_peered":"2024-05-10T03:38:36.580598+0000","last_unstale":"2024-05-10T03:38:41.072385+0000","last_undegraded":"2024-05-10T03:38:41.072385+0000","last_fullsized":"2024-05-10T03:38:41.072385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:33:12.007718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.816553+0000","last_change":"2024-05-10T03:38:40.606934+0000","last_active":"2024-05-10T03:38:41.816553+0000","last_peered":"2024-05-10T03:38:41.816553+0000","last_clean":"2024-05-10T03:38:41.816553+0000","last_became_active":"2024-05-10T03:38:40.606451+0000","last_became_peered":"2024-05-10T03:38:40.606451+0000","last_unstale":"2024-05-10T03:38:41.816553+0000","last_undegraded":"2024-05-10T03:38:41.816553+0000","last_fullsized":"2024-05-10T03:38:41.816553+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:03:43.562337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:57.994119+0000","last_change":"2024-05-10T03:38:36.093109+0000","last_active":"2024-05-10T03:38:57.994119+0000","last_peered":"2024-05-10T03:38:57.994119+0000","last_clean":"2024-05-10T03:38:57.994119+0000","last_became_active":"2024-05-10T03:38:36.092623+0000","last_became_peered":"2024-05-10T03:38:36.092623+0000","last_unstale":"2024-05-10T03:38:57.994119+0000","last_undegraded":"2024-05-10T03:38:57.994119+0000","last_fullsized":"2024-05-10T03:38:57.994119+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:27:10.367098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.072964+0000","last_change":"2024-05-10T03:38:36.582794+0000","last_active":"2024-05-10T03:38:41.072964+0000","last_peered":"2024-05-10T03:38:41.072964+0000","last_clean":"2024-05-10T03:38:41.072964+0000","last_became_active":"2024-05-10T03:38:36.582464+0000","last_became_peered":"2024-05-10T03:38:36.582464+0000","last_unstale":"2024-05-10T03:38:41.072964+0000","last_undegraded":"2024-05-10T03:38:41.072964+0000","last_fullsized":"2024-05-10T03:38:41.072964+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:58:19.665485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.667208+0000","last_change":"2024-05-10T03:38:40.608696+0000","last_active":"2024-05-10T03:38:41.667208+0000","last_peered":"2024-05-10T03:38:41.667208+0000","last_clean":"2024-05-10T03:38:41.667208+0000","last_became_active":"2024-05-10T03:38:40.607868+0000","last_became_peered":"2024-05-10T03:38:40.607868+0000","last_unstale":"2024-05-10T03:38:41.667208+0000","last_undegraded":"2024-05-10T03:38:41.667208+0000","last_fullsized":"2024-05-10T03:38:41.667208+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:27.154675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:39:00.024819+0000","last_change":"2024-05-10T03:38:36.093060+0000","last_active":"2024-05-10T03:39:00.024819+0000","last_peered":"2024-05-10T03:39:00.024819+0000","last_clean":"2024-05-10T03:39:00.024819+0000","last_became_active":"2024-05-10T03:38:36.092476+0000","last_became_peered":"2024-05-10T03:38:36.092476+0000","last_unstale":"2024-05-10T03:39:00.024819+0000","last_undegraded":"2024-05-10T03:39:00.024819+0000","last_fullsized":"2024-05-10T03:39:00.024819+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:52:04.624230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.073142+0000","last_change":"2024-05-10T03:38:36.594808+0000","last_active":"2024-05-10T03:38:41.073142+0000","last_peered":"2024-05-10T03:38:41.073142+0000","last_clean":"2024-05-10T03:38:41.073142+0000","last_became_active":"2024-05-10T03:38:36.594511+0000","last_became_peered":"2024-05-10T03:38:36.594511+0000","last_unstale":"2024-05-10T03:38:41.073142+0000","last_undegraded":"2024-05-10T03:38:41.073142+0000","last_fullsized":"2024-05-10T03:38:41.073142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:18:59.981485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.131206+0000","last_change":"2024-05-10T03:38:40.605744+0000","last_active":"2024-05-10T03:38:42.131206+0000","last_peered":"2024-05-10T03:38:42.131206+0000","last_clean":"2024-05-10T03:38:42.131206+0000","last_became_active":"2024-05-10T03:38:40.605269+0000","last_became_peered":"2024-05-10T03:38:40.605269+0000","last_unstale":"2024-05-10T03:38:42.131206+0000","last_undegraded":"2024-05-10T03:38:42.131206+0000","last_fullsized":"2024-05-10T03:38:42.131206+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:21.881903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"86'16","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:56.980694+0000","last_change":"2024-05-10T03:38:36.098918+0000","last_active":"2024-05-10T03:38:56.980694+0000","last_peered":"2024-05-10T03:38:56.980694+0000","last_clean":"2024-05-10T03:38:56.980694+0000","last_became_active":"2024-05-10T03:38:36.098586+0000","last_became_peered":"2024-05-10T03:38:36.098586+0000","last_unstale":"2024-05-10T03:38:56.980694+0000","last_undegraded":"2024-05-10T03:38:56.980694+0000","last_fullsized":"2024-05-10T03:38:56.980694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:58:48.297763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145843+0000","last_change":"2024-05-10T03:38:36.581347+0000","last_active":"2024-05-10T03:38:41.145843+0000","last_peered":"2024-05-10T03:38:41.145843+0000","last_clean":"2024-05-10T03:38:41.145843+0000","last_became_active":"2024-05-10T03:38:36.581044+0000","last_became_peered":"2024-05-10T03:38:36.581044+0000","last_unstale":"2024-05-10T03:38:41.145843+0000","last_undegraded":"2024-05-10T03:38:41.145843+0000","last_fullsized":"2024-05-10T03:38:41.145843+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:23:43.885238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.073999+0000","last_change":"2024-05-10T03:38:40.600521+0000","last_active":"2024-05-10T03:38:42.073999+0000","last_peered":"2024-05-10T03:38:42.073999+0000","last_clean":"2024-05-10T03:38:42.073999+0000","last_became_active":"2024-05-10T03:38:40.600016+0000","last_became_peered":"2024-05-10T03:38:40.600016+0000","last_unstale":"2024-05-10T03:38:42.073999+0000","last_undegraded":"2024-05-10T03:38:42.073999+0000","last_fullsized":"2024-05-10T03:38:42.073999+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:58:37.881367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145801+0000","last_change":"2024-05-10T03:38:36.094209+0000","last_active":"2024-05-10T03:38:41.145801+0000","last_peered":"2024-05-10T03:38:41.145801+0000","last_clean":"2024-05-10T03:38:41.145801+0000","last_became_active":"2024-05-10T03:38:36.093447+0000","last_became_peered":"2024-05-10T03:38:36.093447+0000","last_unstale":"2024-05-10T03:38:41.145801+0000","last_undegraded":"2024-05-10T03:38:41.145801+0000","last_fullsized":"2024-05-10T03:38:41.145801+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:24:20.540340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145877+0000","last_change":"2024-05-10T03:38:36.587832+0000","last_active":"2024-05-10T03:38:41.145877+0000","last_peered":"2024-05-10T03:38:41.145877+0000","last_clean":"2024-05-10T03:38:41.145877+0000","last_became_active":"2024-05-10T03:38:36.587475+0000","last_became_peered":"2024-05-10T03:38:36.587475+0000","last_unstale":"2024-05-10T03:38:41.145877+0000","last_undegraded":"2024-05-10T03:38:41.145877+0000","last_fullsized":"2024-05-10T03:38:41.145877+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:47:53.318634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.129941+0000","last_change":"2024-05-10T03:38:41.150879+0000","last_active":"2024-05-10T03:38:42.129941+0000","last_peered":"2024-05-10T03:38:42.129941+0000","last_clean":"2024-05-10T03:38:42.129941+0000","last_became_active":"2024-05-10T03:38:41.150350+0000","last_became_peered":"2024-05-10T03:38:41.150350+0000","last_unstale":"2024-05-10T03:38:42.129941+0000","last_undegraded":"2024-05-10T03:38:42.129941+0000","last_fullsized":"2024-05-10T03:38:42.129941+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:47:32.429040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.130200+0000","last_change":"2024-05-10T03:38:36.095933+0000","last_active":"2024-05-10T03:38:42.130200+0000","last_peered":"2024-05-10T03:38:42.130200+0000","last_clean":"2024-05-10T03:38:42.130200+0000","last_became_active":"2024-05-10T03:38:36.095592+0000","last_became_peered":"2024-05-10T03:38:36.095592+0000","last_unstale":"2024-05-10T03:38:42.130200+0000","last_undegraded":"2024-05-10T03:38:42.130200+0000","last_fullsized":"2024-05-10T03:38:42.130200+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:52:21.729051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.147510+0000","last_change":"2024-05-10T03:38:36.591747+0000","last_active":"2024-05-10T03:38:41.147510+0000","last_peered":"2024-05-10T03:38:41.147510+0000","last_clean":"2024-05-10T03:38:41.147510+0000","last_became_active":"2024-05-10T03:38:36.591432+0000","last_became_peered":"2024-05-10T03:38:36.591432+0000","last_unstale":"2024-05-10T03:38:41.147510+0000","last_undegraded":"2024-05-10T03:38:41.147510+0000","last_fullsized":"2024-05-10T03:38:41.147510+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:20:37.549054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.131779+0000","last_change":"2024-05-10T03:38:40.597535+0000","last_active":"2024-05-10T03:38:42.131779+0000","last_peered":"2024-05-10T03:38:42.131779+0000","last_clean":"2024-05-10T03:38:42.131779+0000","last_became_active":"2024-05-10T03:38:40.597108+0000","last_became_peered":"2024-05-10T03:38:40.597108+0000","last_unstale":"2024-05-10T03:38:42.131779+0000","last_undegraded":"2024-05-10T03:38:42.131779+0000","last_fullsized":"2024-05-10T03:38:42.131779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:31:21.765071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:39:00.021025+0000","last_change":"2024-05-10T03:38:36.099238+0000","last_active":"2024-05-10T03:39:00.021025+0000","last_peered":"2024-05-10T03:39:00.021025+0000","last_clean":"2024-05-10T03:39:00.021025+0000","last_became_active":"2024-05-10T03:38:36.098761+0000","last_became_peered":"2024-05-10T03:38:36.098761+0000","last_unstale":"2024-05-10T03:39:00.021025+0000","last_undegraded":"2024-05-10T03:39:00.021025+0000","last_fullsized":"2024-05-10T03:39:00.021025+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:08:49.892665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.147457+0000","last_change":"2024-05-10T03:38:36.580983+0000","last_active":"2024-05-10T03:38:41.147457+0000","last_peered":"2024-05-10T03:38:41.147457+0000","last_clean":"2024-05-10T03:38:41.147457+0000","last_became_active":"2024-05-10T03:38:36.580252+0000","last_became_peered":"2024-05-10T03:38:36.580252+0000","last_unstale":"2024-05-10T03:38:41.147457+0000","last_undegraded":"2024-05-10T03:38:41.147457+0000","last_fullsized":"2024-05-10T03:38:41.147457+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:16.265473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.131419+0000","last_change":"2024-05-10T03:38:41.148651+0000","last_active":"2024-05-10T03:38:42.131419+0000","last_peered":"2024-05-10T03:38:42.131419+0000","last_clean":"2024-05-10T03:38:42.131419+0000","last_became_active":"2024-05-10T03:38:41.148192+0000","last_became_peered":"2024-05-10T03:38:41.148192+0000","last_unstale":"2024-05-10T03:38:42.131419+0000","last_undegraded":"2024-05-10T03:38:42.131419+0000","last_fullsized":"2024-05-10T03:38:42.131419+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:13:38.795763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.146995+0000","last_change":"2024-05-10T03:38:36.577839+0000","last_active":"2024-05-10T03:38:41.146995+0000","last_peered":"2024-05-10T03:38:41.146995+0000","last_clean":"2024-05-10T03:38:41.146995+0000","last_became_active":"2024-05-10T03:38:36.576917+0000","last_became_peered":"2024-05-10T03:38:36.576917+0000","last_unstale":"2024-05-10T03:38:41.146995+0000","last_undegraded":"2024-05-10T03:38:41.146995+0000","last_fullsized":"2024-05-10T03:38:41.146995+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:52:05.825241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:56.980368+0000","last_change":"2024-05-10T03:38:36.099138+0000","last_active":"2024-05-10T03:38:56.980368+0000","last_peered":"2024-05-10T03:38:56.980368+0000","last_clean":"2024-05-10T03:38:56.980368+0000","last_became_active":"2024-05-10T03:38:36.098747+0000","last_became_peered":"2024-05-10T03:38:36.098747+0000","last_unstale":"2024-05-10T03:38:56.980368+0000","last_undegraded":"2024-05-10T03:38:56.980368+0000","last_fullsized":"2024-05-10T03:38:56.980368+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:18.236383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.130463+0000","last_change":"2024-05-10T03:38:40.605489+0000","last_active":"2024-05-10T03:38:42.130463+0000","last_peered":"2024-05-10T03:38:42.130463+0000","last_clean":"2024-05-10T03:38:42.130463+0000","last_became_active":"2024-05-10T03:38:40.605040+0000","last_became_peered":"2024-05-10T03:38:40.605040+0000","last_unstale":"2024-05-10T03:38:42.130463+0000","last_undegraded":"2024-05-10T03:38:42.130463+0000","last_fullsized":"2024-05-10T03:38:42.130463+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:52:08.592132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145750+0000","last_change":"2024-05-10T03:38:36.589325+0000","last_active":"2024-05-10T03:38:41.145750+0000","last_peered":"2024-05-10T03:38:41.145750+0000","last_clean":"2024-05-10T03:38:41.145750+0000","last_became_active":"2024-05-10T03:38:36.588976+0000","last_became_peered":"2024-05-10T03:38:36.588976+0000","last_unstale":"2024-05-10T03:38:41.145750+0000","last_undegraded":"2024-05-10T03:38:41.145750+0000","last_fullsized":"2024-05-10T03:38:41.145750+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:40.849614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:39:00.018340+0000","last_change":"2024-05-10T03:38:36.093701+0000","last_active":"2024-05-10T03:39:00.018340+0000","last_peered":"2024-05-10T03:39:00.018340+0000","last_clean":"2024-05-10T03:39:00.018340+0000","last_became_active":"2024-05-10T03:38:36.093362+0000","last_became_peered":"2024-05-10T03:38:36.093362+0000","last_unstale":"2024-05-10T03:39:00.018340+0000","last_undegraded":"2024-05-10T03:39:00.018340+0000","last_fullsized":"2024-05-10T03:39:00.018340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:42:00.208900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":328,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.131073+0000","last_change":"2024-05-10T03:37:46.762875+0000","last_active":"2024-05-10T03:38:42.131073+0000","last_peered":"2024-05-10T03:38:42.131073+0000","last_clean":"2024-05-10T03:38:42.131073+0000","last_became_active":"2024-05-10T03:37:46.762448+0000","last_became_peered":"2024-05-10T03:37:46.762448+0000","last_unstale":"2024-05-10T03:38:42.131073+0000","last_undegraded":"2024-05-10T03:38:42.131073+0000","last_fullsized":"2024-05-10T03:38:42.131073+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:35:20.340567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:35:20.340567+0000","last_clean_scrub_stamp":"2024-05-10T03:35:20.340567+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:09:05.491303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.074661+0000","last_change":"2024-05-10T03:38:41.150966+0000","last_active":"2024-05-10T03:38:42.074661+0000","last_peered":"2024-05-10T03:38:42.074661+0000","last_clean":"2024-05-10T03:38:42.074661+0000","last_became_active":"2024-05-10T03:38:41.150505+0000","last_became_peered":"2024-05-10T03:38:41.150505+0000","last_unstale":"2024-05-10T03:38:42.074661+0000","last_undegraded":"2024-05-10T03:38:42.074661+0000","last_fullsized":"2024-05-10T03:38:42.074661+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:53.992369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.072111+0000","last_change":"2024-05-10T03:38:36.577457+0000","last_active":"2024-05-10T03:38:41.072111+0000","last_peered":"2024-05-10T03:38:41.072111+0000","last_clean":"2024-05-10T03:38:41.072111+0000","last_became_active":"2024-05-10T03:38:36.577105+0000","last_became_peered":"2024-05-10T03:38:36.577105+0000","last_unstale":"2024-05-10T03:38:41.072111+0000","last_undegraded":"2024-05-10T03:38:41.072111+0000","last_fullsized":"2024-05-10T03:38:41.072111+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:34:15.611496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:56.978027+0000","last_change":"2024-05-10T03:38:36.094057+0000","last_active":"2024-05-10T03:38:56.978027+0000","last_peered":"2024-05-10T03:38:56.978027+0000","last_clean":"2024-05-10T03:38:56.978027+0000","last_became_active":"2024-05-10T03:38:36.093705+0000","last_became_peered":"2024-05-10T03:38:36.093705+0000","last_unstale":"2024-05-10T03:38:56.978027+0000","last_undegraded":"2024-05-10T03:38:56.978027+0000","last_fullsized":"2024-05-10T03:38:56.978027+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:00:10.138524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.816534+0000","last_change":"2024-05-10T03:38:40.603522+0000","last_active":"2024-05-10T03:38:41.816534+0000","last_peered":"2024-05-10T03:38:41.816534+0000","last_clean":"2024-05-10T03:38:41.816534+0000","last_became_active":"2024-05-10T03:38:40.603058+0000","last_became_peered":"2024-05-10T03:38:40.603058+0000","last_unstale":"2024-05-10T03:38:41.816534+0000","last_undegraded":"2024-05-10T03:38:41.816534+0000","last_fullsized":"2024-05-10T03:38:41.816534+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:15:06.869163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"86'3","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:57.993848+0000","last_change":"2024-05-10T03:38:36.099009+0000","last_active":"2024-05-10T03:38:57.993848+0000","last_peered":"2024-05-10T03:38:57.993848+0000","last_clean":"2024-05-10T03:38:57.993848+0000","last_became_active":"2024-05-10T03:38:36.098695+0000","last_became_peered":"2024-05-10T03:38:36.098695+0000","last_unstale":"2024-05-10T03:38:57.993848+0000","last_undegraded":"2024-05-10T03:38:57.993848+0000","last_fullsized":"2024-05-10T03:38:57.993848+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:06.634752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.072737+0000","last_change":"2024-05-10T03:38:36.576498+0000","last_active":"2024-05-10T03:38:41.072737+0000","last_peered":"2024-05-10T03:38:41.072737+0000","last_clean":"2024-05-10T03:38:41.072737+0000","last_became_active":"2024-05-10T03:38:36.576161+0000","last_became_peered":"2024-05-10T03:38:36.576161+0000","last_unstale":"2024-05-10T03:38:41.072737+0000","last_undegraded":"2024-05-10T03:38:41.072737+0000","last_fullsized":"2024-05-10T03:38:41.072737+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:09.353279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.073404+0000","last_change":"2024-05-10T03:38:41.148317+0000","last_active":"2024-05-10T03:38:42.073404+0000","last_peered":"2024-05-10T03:38:42.073404+0000","last_clean":"2024-05-10T03:38:42.073404+0000","last_became_active":"2024-05-10T03:38:41.147907+0000","last_became_peered":"2024-05-10T03:38:41.147907+0000","last_unstale":"2024-05-10T03:38:42.073404+0000","last_undegraded":"2024-05-10T03:38:42.073404+0000","last_fullsized":"2024-05-10T03:38:42.073404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:23:08.157296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'8","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:57.995298+0000","last_change":"2024-05-10T03:38:36.096437+0000","last_active":"2024-05-10T03:38:57.995298+0000","last_peered":"2024-05-10T03:38:57.995298+0000","last_clean":"2024-05-10T03:38:57.995298+0000","last_became_active":"2024-05-10T03:38:36.096122+0000","last_became_peered":"2024-05-10T03:38:36.096122+0000","last_unstale":"2024-05-10T03:38:57.995298+0000","last_undegraded":"2024-05-10T03:38:57.995298+0000","last_fullsized":"2024-05-10T03:38:57.995298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:47:02.400065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145318+0000","last_change":"2024-05-10T03:38:36.574022+0000","last_active":"2024-05-10T03:38:41.145318+0000","last_peered":"2024-05-10T03:38:41.145318+0000","last_clean":"2024-05-10T03:38:41.145318+0000","last_became_active":"2024-05-10T03:38:36.573530+0000","last_became_peered":"2024-05-10T03:38:36.573530+0000","last_unstale":"2024-05-10T03:38:41.145318+0000","last_undegraded":"2024-05-10T03:38:41.145318+0000","last_fullsized":"2024-05-10T03:38:41.145318+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:35:32.574897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.129204+0000","last_change":"2024-05-10T03:38:40.600341+0000","last_active":"2024-05-10T03:38:42.129204+0000","last_peered":"2024-05-10T03:38:42.129204+0000","last_clean":"2024-05-10T03:38:42.129204+0000","last_became_active":"2024-05-10T03:38:40.599944+0000","last_became_peered":"2024-05-10T03:38:40.599944+0000","last_unstale":"2024-05-10T03:38:42.129204+0000","last_undegraded":"2024-05-10T03:38:42.129204+0000","last_fullsized":"2024-05-10T03:38:42.129204+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:12:01.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:58.998559+0000","last_change":"2024-05-10T03:38:36.091020+0000","last_active":"2024-05-10T03:38:58.998559+0000","last_peered":"2024-05-10T03:38:58.998559+0000","last_clean":"2024-05-10T03:38:58.998559+0000","last_became_active":"2024-05-10T03:38:36.090699+0000","last_became_peered":"2024-05-10T03:38:36.090699+0000","last_unstale":"2024-05-10T03:38:58.998559+0000","last_undegraded":"2024-05-10T03:38:58.998559+0000","last_fullsized":"2024-05-10T03:38:58.998559+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:44:12.546166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145064+0000","last_change":"2024-05-10T03:38:36.584279+0000","last_active":"2024-05-10T03:38:41.145064+0000","last_peered":"2024-05-10T03:38:41.145064+0000","last_clean":"2024-05-10T03:38:41.145064+0000","last_became_active":"2024-05-10T03:38:36.583897+0000","last_became_peered":"2024-05-10T03:38:36.583897+0000","last_unstale":"2024-05-10T03:38:41.145064+0000","last_undegraded":"2024-05-10T03:38:41.145064+0000","last_fullsized":"2024-05-10T03:38:41.145064+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:33:17.210334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.151453+0000","last_change":"2024-05-10T03:38:41.151023+0000","last_active":"2024-05-10T03:38:41.151453+0000","last_peered":"2024-05-10T03:38:41.151453+0000","last_clean":"2024-05-10T03:38:41.151453+0000","last_became_active":"2024-05-10T03:38:41.150489+0000","last_became_peered":"2024-05-10T03:38:41.150489+0000","last_unstale":"2024-05-10T03:38:41.151453+0000","last_undegraded":"2024-05-10T03:38:41.151453+0000","last_fullsized":"2024-05-10T03:38:41.151453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:57:57.440139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:55.957524+0000","last_change":"2024-05-10T03:38:36.098990+0000","last_active":"2024-05-10T03:38:55.957524+0000","last_peered":"2024-05-10T03:38:55.957524+0000","last_clean":"2024-05-10T03:38:55.957524+0000","last_became_active":"2024-05-10T03:38:36.098649+0000","last_became_peered":"2024-05-10T03:38:36.098649+0000","last_unstale":"2024-05-10T03:38:55.957524+0000","last_undegraded":"2024-05-10T03:38:55.957524+0000","last_fullsized":"2024-05-10T03:38:55.957524+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:38:09.915041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145927+0000","last_change":"2024-05-10T03:38:36.581286+0000","last_active":"2024-05-10T03:38:41.145927+0000","last_peered":"2024-05-10T03:38:41.145927+0000","last_clean":"2024-05-10T03:38:41.145927+0000","last_became_active":"2024-05-10T03:38:36.580927+0000","last_became_peered":"2024-05-10T03:38:36.580927+0000","last_unstale":"2024-05-10T03:38:41.145927+0000","last_undegraded":"2024-05-10T03:38:41.145927+0000","last_fullsized":"2024-05-10T03:38:41.145927+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:10:38.663239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.667246+0000","last_change":"2024-05-10T03:38:40.605668+0000","last_active":"2024-05-10T03:38:41.667246+0000","last_peered":"2024-05-10T03:38:41.667246+0000","last_clean":"2024-05-10T03:38:41.667246+0000","last_became_active":"2024-05-10T03:38:40.605156+0000","last_became_peered":"2024-05-10T03:38:40.605156+0000","last_unstale":"2024-05-10T03:38:41.667246+0000","last_undegraded":"2024-05-10T03:38:41.667246+0000","last_fullsized":"2024-05-10T03:38:41.667246+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:28:07.192875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:55.954654+0000","last_change":"2024-05-10T03:38:36.090250+0000","last_active":"2024-05-10T03:38:55.954654+0000","last_peered":"2024-05-10T03:38:55.954654+0000","last_clean":"2024-05-10T03:38:55.954654+0000","last_became_active":"2024-05-10T03:38:36.089899+0000","last_became_peered":"2024-05-10T03:38:36.089899+0000","last_unstale":"2024-05-10T03:38:55.954654+0000","last_undegraded":"2024-05-10T03:38:55.954654+0000","last_fullsized":"2024-05-10T03:38:55.954654+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:01:19.322065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145537+0000","last_change":"2024-05-10T03:38:36.575272+0000","last_active":"2024-05-10T03:38:41.145537+0000","last_peered":"2024-05-10T03:38:41.145537+0000","last_clean":"2024-05-10T03:38:41.145537+0000","last_became_active":"2024-05-10T03:38:36.574919+0000","last_became_peered":"2024-05-10T03:38:36.574919+0000","last_unstale":"2024-05-10T03:38:41.145537+0000","last_undegraded":"2024-05-10T03:38:41.145537+0000","last_fullsized":"2024-05-10T03:38:41.145537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:51:33.825933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.074812+0000","last_change":"2024-05-10T03:38:40.609082+0000","last_active":"2024-05-10T03:38:42.074812+0000","last_peered":"2024-05-10T03:38:42.074812+0000","last_clean":"2024-05-10T03:38:42.074812+0000","last_became_active":"2024-05-10T03:38:40.608636+0000","last_became_peered":"2024-05-10T03:38:40.608636+0000","last_unstale":"2024-05-10T03:38:42.074812+0000","last_undegraded":"2024-05-10T03:38:42.074812+0000","last_fullsized":"2024-05-10T03:38:42.074812+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:18:05.288472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"86'2","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:57.994543+0000","last_change":"2024-05-10T03:38:36.101001+0000","last_active":"2024-05-10T03:38:57.994543+0000","last_peered":"2024-05-10T03:38:57.994543+0000","last_clean":"2024-05-10T03:38:57.994543+0000","last_became_active":"2024-05-10T03:38:36.100658+0000","last_became_peered":"2024-05-10T03:38:36.100658+0000","last_unstale":"2024-05-10T03:38:57.994543+0000","last_undegraded":"2024-05-10T03:38:57.994543+0000","last_fullsized":"2024-05-10T03:38:57.994543+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:15:51.963956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145134+0000","last_change":"2024-05-10T03:38:36.579314+0000","last_active":"2024-05-10T03:38:41.145134+0000","last_peered":"2024-05-10T03:38:41.145134+0000","last_clean":"2024-05-10T03:38:41.145134+0000","last_became_active":"2024-05-10T03:38:36.578747+0000","last_became_peered":"2024-05-10T03:38:36.578747+0000","last_unstale":"2024-05-10T03:38:41.145134+0000","last_undegraded":"2024-05-10T03:38:41.145134+0000","last_fullsized":"2024-05-10T03:38:41.145134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:05:25.814887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.149586+0000","last_change":"2024-05-10T03:38:41.149022+0000","last_active":"2024-05-10T03:38:41.149586+0000","last_peered":"2024-05-10T03:38:41.149586+0000","last_clean":"2024-05-10T03:38:41.149586+0000","last_became_active":"2024-05-10T03:38:41.148606+0000","last_became_peered":"2024-05-10T03:38:41.148606+0000","last_unstale":"2024-05-10T03:38:41.149586+0000","last_undegraded":"2024-05-10T03:38:41.149586+0000","last_fullsized":"2024-05-10T03:38:41.149586+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:24.039761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:55.957430+0000","last_change":"2024-05-10T03:38:36.095851+0000","last_active":"2024-05-10T03:38:55.957430+0000","last_peered":"2024-05-10T03:38:55.957430+0000","last_clean":"2024-05-10T03:38:55.957430+0000","last_became_active":"2024-05-10T03:38:36.095452+0000","last_became_peered":"2024-05-10T03:38:36.095452+0000","last_unstale":"2024-05-10T03:38:55.957430+0000","last_undegraded":"2024-05-10T03:38:55.957430+0000","last_fullsized":"2024-05-10T03:38:55.957430+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:28:15.555590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.073061+0000","last_change":"2024-05-10T03:38:36.587225+0000","last_active":"2024-05-10T03:38:41.073061+0000","last_peered":"2024-05-10T03:38:41.073061+0000","last_clean":"2024-05-10T03:38:41.073061+0000","last_became_active":"2024-05-10T03:38:36.586906+0000","last_became_peered":"2024-05-10T03:38:36.586906+0000","last_unstale":"2024-05-10T03:38:41.073061+0000","last_undegraded":"2024-05-10T03:38:41.073061+0000","last_fullsized":"2024-05-10T03:38:41.073061+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:07.128604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.353449+0000","last_change":"2024-05-10T03:38:40.600918+0000","last_active":"2024-05-10T03:38:41.353449+0000","last_peered":"2024-05-10T03:38:41.353449+0000","last_clean":"2024-05-10T03:38:41.353449+0000","last_became_active":"2024-05-10T03:38:40.600508+0000","last_became_peered":"2024-05-10T03:38:40.600508+0000","last_unstale":"2024-05-10T03:38:41.353449+0000","last_undegraded":"2024-05-10T03:38:41.353449+0000","last_fullsized":"2024-05-10T03:38:41.353449+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:02:59.589310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:57.993194+0000","last_change":"2024-05-10T03:38:36.100013+0000","last_active":"2024-05-10T03:38:57.993194+0000","last_peered":"2024-05-10T03:38:57.993194+0000","last_clean":"2024-05-10T03:38:57.993194+0000","last_became_active":"2024-05-10T03:38:36.099581+0000","last_became_peered":"2024-05-10T03:38:36.099581+0000","last_unstale":"2024-05-10T03:38:57.993194+0000","last_undegraded":"2024-05-10T03:38:57.993194+0000","last_fullsized":"2024-05-10T03:38:57.993194+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:07.195555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.073325+0000","last_change":"2024-05-10T03:38:36.586813+0000","last_active":"2024-05-10T03:38:41.073325+0000","last_peered":"2024-05-10T03:38:41.073325+0000","last_clean":"2024-05-10T03:38:41.073325+0000","last_became_active":"2024-05-10T03:38:36.586264+0000","last_became_peered":"2024-05-10T03:38:36.586264+0000","last_unstale":"2024-05-10T03:38:41.073325+0000","last_undegraded":"2024-05-10T03:38:41.073325+0000","last_fullsized":"2024-05-10T03:38:41.073325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:57:06.239509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.130269+0000","last_change":"2024-05-10T03:38:40.606897+0000","last_active":"2024-05-10T03:38:42.130269+0000","last_peered":"2024-05-10T03:38:42.130269+0000","last_clean":"2024-05-10T03:38:42.130269+0000","last_became_active":"2024-05-10T03:38:40.606339+0000","last_became_peered":"2024-05-10T03:38:40.606339+0000","last_unstale":"2024-05-10T03:38:42.130269+0000","last_undegraded":"2024-05-10T03:38:42.130269+0000","last_fullsized":"2024-05-10T03:38:42.130269+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:13.706744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:57.993903+0000","last_change":"2024-05-10T03:38:36.100689+0000","last_active":"2024-05-10T03:38:57.993903+0000","last_peered":"2024-05-10T03:38:57.993903+0000","last_clean":"2024-05-10T03:38:57.993903+0000","last_became_active":"2024-05-10T03:38:36.100352+0000","last_became_peered":"2024-05-10T03:38:36.100352+0000","last_unstale":"2024-05-10T03:38:57.993903+0000","last_undegraded":"2024-05-10T03:38:57.993903+0000","last_fullsized":"2024-05-10T03:38:57.993903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:53:45.926237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.072868+0000","last_change":"2024-05-10T03:38:36.594941+0000","last_active":"2024-05-10T03:38:41.072868+0000","last_peered":"2024-05-10T03:38:41.072868+0000","last_clean":"2024-05-10T03:38:41.072868+0000","last_became_active":"2024-05-10T03:38:36.594549+0000","last_became_peered":"2024-05-10T03:38:36.594549+0000","last_unstale":"2024-05-10T03:38:41.072868+0000","last_undegraded":"2024-05-10T03:38:41.072868+0000","last_fullsized":"2024-05-10T03:38:41.072868+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:18:29.317669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T03:38:42.073637+0000","last_change":"2024-05-10T03:38:40.600719+0000","last_active":"2024-05-10T03:38:42.073637+0000","last_peered":"2024-05-10T03:38:42.073637+0000","last_clean":"2024-05-10T03:38:42.073637+0000","last_became_active":"2024-05-10T03:38:40.600240+0000","last_became_peered":"2024-05-10T03:38:40.600240+0000","last_unstale":"2024-05-10T03:38:42.073637+0000","last_undegraded":"2024-05-10T03:38:42.073637+0000","last_fullsized":"2024-05-10T03:38:42.073637+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:41:47.877298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.072805+0000","last_change":"2024-05-10T03:38:36.097691+0000","last_active":"2024-05-10T03:38:41.072805+0000","last_peered":"2024-05-10T03:38:41.072805+0000","last_clean":"2024-05-10T03:38:41.072805+0000","last_became_active":"2024-05-10T03:38:36.097266+0000","last_became_peered":"2024-05-10T03:38:36.097266+0000","last_unstale":"2024-05-10T03:38:41.072805+0000","last_undegraded":"2024-05-10T03:38:41.072805+0000","last_fullsized":"2024-05-10T03:38:41.072805+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:27:57.272780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.073089+0000","last_change":"2024-05-10T03:38:36.575475+0000","last_active":"2024-05-10T03:38:41.073089+0000","last_peered":"2024-05-10T03:38:41.073089+0000","last_clean":"2024-05-10T03:38:41.073089+0000","last_became_active":"2024-05-10T03:38:36.575047+0000","last_became_peered":"2024-05-10T03:38:36.575047+0000","last_unstale":"2024-05-10T03:38:41.073089+0000","last_undegraded":"2024-05-10T03:38:41.073089+0000","last_fullsized":"2024-05-10T03:38:41.073089+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:31:53.846070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145624+0000","last_change":"2024-05-10T03:38:36.585491+0000","last_active":"2024-05-10T03:38:41.145624+0000","last_peered":"2024-05-10T03:38:41.145624+0000","last_clean":"2024-05-10T03:38:41.145624+0000","last_became_active":"2024-05-10T03:38:36.585147+0000","last_became_peered":"2024-05-10T03:38:36.585147+0000","last_unstale":"2024-05-10T03:38:41.145624+0000","last_undegraded":"2024-05-10T03:38:41.145624+0000","last_fullsized":"2024-05-10T03:38:41.145624+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:22.350420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.073175+0000","last_change":"2024-05-10T03:38:36.584092+0000","last_active":"2024-05-10T03:38:41.073175+0000","last_peered":"2024-05-10T03:38:41.073175+0000","last_clean":"2024-05-10T03:38:41.073175+0000","last_became_active":"2024-05-10T03:38:36.583749+0000","last_became_peered":"2024-05-10T03:38:36.583749+0000","last_unstale":"2024-05-10T03:38:41.073175+0000","last_undegraded":"2024-05-10T03:38:41.073175+0000","last_fullsized":"2024-05-10T03:38:41.073175+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:10.882170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.072928+0000","last_change":"2024-05-10T03:38:36.573718+0000","last_active":"2024-05-10T03:38:41.072928+0000","last_peered":"2024-05-10T03:38:41.072928+0000","last_clean":"2024-05-10T03:38:41.072928+0000","last_became_active":"2024-05-10T03:38:36.573271+0000","last_became_peered":"2024-05-10T03:38:36.573271+0000","last_unstale":"2024-05-10T03:38:41.072928+0000","last_undegraded":"2024-05-10T03:38:41.072928+0000","last_fullsized":"2024-05-10T03:38:41.072928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:38:13.798068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145941+0000","last_change":"2024-05-10T03:38:36.576975+0000","last_active":"2024-05-10T03:38:41.145941+0000","last_peered":"2024-05-10T03:38:41.145941+0000","last_clean":"2024-05-10T03:38:41.145941+0000","last_became_active":"2024-05-10T03:38:36.576640+0000","last_became_peered":"2024-05-10T03:38:36.576640+0000","last_unstale":"2024-05-10T03:38:41.145941+0000","last_undegraded":"2024-05-10T03:38:41.145941+0000","last_fullsized":"2024-05-10T03:38:41.145941+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:48:42.975793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.072632+0000","last_change":"2024-05-10T03:38:36.576607+0000","last_active":"2024-05-10T03:38:41.072632+0000","last_peered":"2024-05-10T03:38:41.072632+0000","last_clean":"2024-05-10T03:38:41.072632+0000","last_became_active":"2024-05-10T03:38:36.576255+0000","last_became_peered":"2024-05-10T03:38:36.576255+0000","last_unstale":"2024-05-10T03:38:41.072632+0000","last_undegraded":"2024-05-10T03:38:41.072632+0000","last_fullsized":"2024-05-10T03:38:41.072632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:01:23.760926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145731+0000","last_change":"2024-05-10T03:38:36.589262+0000","last_active":"2024-05-10T03:38:41.145731+0000","last_peered":"2024-05-10T03:38:41.145731+0000","last_clean":"2024-05-10T03:38:41.145731+0000","last_became_active":"2024-05-10T03:38:36.588950+0000","last_became_peered":"2024-05-10T03:38:36.588950+0000","last_unstale":"2024-05-10T03:38:41.145731+0000","last_undegraded":"2024-05-10T03:38:41.145731+0000","last_fullsized":"2024-05-10T03:38:41.145731+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:08:43.124035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.073586+0000","last_change":"2024-05-10T03:38:36.590472+0000","last_active":"2024-05-10T03:38:41.073586+0000","last_peered":"2024-05-10T03:38:41.073586+0000","last_clean":"2024-05-10T03:38:41.073586+0000","last_became_active":"2024-05-10T03:38:36.590115+0000","last_became_peered":"2024-05-10T03:38:36.590115+0000","last_unstale":"2024-05-10T03:38:41.073586+0000","last_undegraded":"2024-05-10T03:38:41.073586+0000","last_fullsized":"2024-05-10T03:38:41.073586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:33:37.982529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145531+0000","last_change":"2024-05-10T03:38:36.575958+0000","last_active":"2024-05-10T03:38:41.145531+0000","last_peered":"2024-05-10T03:38:41.145531+0000","last_clean":"2024-05-10T03:38:41.145531+0000","last_became_active":"2024-05-10T03:38:36.572958+0000","last_became_peered":"2024-05-10T03:38:36.572958+0000","last_unstale":"2024-05-10T03:38:41.145531+0000","last_undegraded":"2024-05-10T03:38:41.145531+0000","last_fullsized":"2024-05-10T03:38:41.145531+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:30:39.111371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.146784+0000","last_change":"2024-05-10T03:38:36.578225+0000","last_active":"2024-05-10T03:38:41.146784+0000","last_peered":"2024-05-10T03:38:41.146784+0000","last_clean":"2024-05-10T03:38:41.146784+0000","last_became_active":"2024-05-10T03:38:36.575920+0000","last_became_peered":"2024-05-10T03:38:36.575920+0000","last_unstale":"2024-05-10T03:38:41.146784+0000","last_undegraded":"2024-05-10T03:38:41.146784+0000","last_fullsized":"2024-05-10T03:38:41.146784+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:54:53.999971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.147205+0000","last_change":"2024-05-10T03:38:36.577720+0000","last_active":"2024-05-10T03:38:41.147205+0000","last_peered":"2024-05-10T03:38:41.147205+0000","last_clean":"2024-05-10T03:38:41.147205+0000","last_became_active":"2024-05-10T03:38:36.577360+0000","last_became_peered":"2024-05-10T03:38:36.577360+0000","last_unstale":"2024-05-10T03:38:41.147205+0000","last_undegraded":"2024-05-10T03:38:41.147205+0000","last_fullsized":"2024-05-10T03:38:41.147205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:35:59.787050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.147672+0000","last_change":"2024-05-10T03:38:36.588941+0000","last_active":"2024-05-10T03:38:41.147672+0000","last_peered":"2024-05-10T03:38:41.147672+0000","last_clean":"2024-05-10T03:38:41.147672+0000","last_became_active":"2024-05-10T03:38:36.587884+0000","last_became_peered":"2024-05-10T03:38:36.587884+0000","last_unstale":"2024-05-10T03:38:41.147672+0000","last_undegraded":"2024-05-10T03:38:41.147672+0000","last_fullsized":"2024-05-10T03:38:41.147672+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:26:10.064473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.072585+0000","last_change":"2024-05-10T03:38:36.578917+0000","last_active":"2024-05-10T03:38:41.072585+0000","last_peered":"2024-05-10T03:38:41.072585+0000","last_clean":"2024-05-10T03:38:41.072585+0000","last_became_active":"2024-05-10T03:38:36.578508+0000","last_became_peered":"2024-05-10T03:38:36.578508+0000","last_unstale":"2024-05-10T03:38:41.072585+0000","last_undegraded":"2024-05-10T03:38:41.072585+0000","last_fullsized":"2024-05-10T03:38:41.072585+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:47.670854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-05-10T03:38:41.145529+0000","last_change":"2024-05-10T03:38:36.578410+0000","last_active":"2024-05-10T03:38:41.145529+0000","last_peered":"2024-05-10T03:38:41.145529+0000","last_clean":"2024-05-10T03:38:41.145529+0000","last_became_active":"2024-05-10T03:38:36.578055+0000","last_became_peered":"2024-05-10T03:38:36.578055+0000","last_unstale":"2024-05-10T03:38:41.145529+0000","last_undegraded":"2024-05-10T03:38:41.145529+0000","last_fullsized":"2024-05-10T03:38:41.145529+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:39:03.551019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":28672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":46356,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":194,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":114717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":173,"ondisk_log_size":173,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514510,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":469023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]}]},{"osd":10,"up_from":69,"seq":296352743442,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28596,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716556,"statfs":{"total":95995035648,"available":95965753344,"internally_reserved":0,"allocated":1617920,"data_stored":1078936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":1,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.66400000000000003}]},{"osd":3,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.59899999999999998}]},{"osd":5,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.72099999999999997}]},{"osd":6,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":8,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.753}]},{"osd":9,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.80200000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]}]},{"osd":9,"up_from":64,"seq":274877906966,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":991232,"data_stored":473097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36043201},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.48999999999999999}]},{"osd":1,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.57999999999999996}]},{"osd":2,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.78500000000000003}]},{"osd":3,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.85499999999999998}]},{"osd":5,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.69599999999999995}]},{"osd":6,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.51100000000000001}]},{"osd":7,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.76600000000000001}]},{"osd":8,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.87},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.97099999999999997}]},{"osd":10,"last update":"Fri May 10 03:38:44 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.94399999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]}]},{"osd":8,"up_from":57,"seq":244813135897,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":464190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:38:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri May 10 03:38:08 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.71799999999999997}]},{"osd":2,"last update":"Fri May 10 03:38:08 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.52200000000000002}]},{"osd":3,"last update":"Fri May 10 03:38:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.79100000000000004}]},{"osd":4,"last update":"Fri May 10 03:38:08 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.84099999999999997}]},{"osd":5,"last update":"Fri May 10 03:38:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.59599999999999997}]},{"osd":6,"last update":"Fri May 10 03:38:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.75},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.85799999999999998}]},{"osd":7,"last update":"Fri May 10 03:38:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.89500000000000002}]},{"osd":9,"last update":"Fri May 10 03:38:27 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.871},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.88}]},{"osd":10,"last update":"Fri May 10 03:38:48 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.93200000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]}]},{"osd":7,"up_from":50,"seq":214748364829,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1576960,"data_stored":1061638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:37:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.437},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.502}]},{"osd":1,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.43099999999999999,"15min":0.42699999999999999},"min":{"1min":0.33600000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.502},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.44500000000000001,"15min":0.44400000000000001},"min":{"1min":0.32300000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.61799999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.61799999999999999}]},{"osd":2,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85899999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.64300000000000002,"15min":0.622},"min":{"1min":0.46600000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":2.8340000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.624,"15min":0.63},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.75900000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.71799999999999997}]},{"osd":4,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82199999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.34899999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78100000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.67500000000000004}]},{"osd":5,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.67800000000000005,"15min":0.65500000000000003},"min":{"1min":0.503,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.1139999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.67300000000000004,"15min":0.65500000000000003},"min":{"1min":0.49099999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.806,"5min":2.806,"15min":2.806},"last":0.73699999999999999}]},{"osd":6,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.70299999999999996,"15min":0.70899999999999996},"min":{"1min":0.48599999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86499999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.90900000000000003,"5min":1.002,"15min":1.002},"last":0.79200000000000004}]},{"osd":8,"last update":"Fri May 10 03:38:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.88300000000000001}]},{"osd":9,"last update":"Fri May 10 03:38:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.87}]},{"osd":10,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.749},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.82199999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]}]},{"osd":6,"up_from":45,"seq":193273528351,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":463783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:38:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.45300000000000001,"15min":0.443},"min":{"1min":0.33700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.46500000000000002,"15min":0.45600000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.435}]},{"osd":1,"last update":"Fri May 10 03:38:40 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.41799999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.63900000000000001,"15min":0.621},"min":{"1min":0.51400000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.622}]},{"osd":2,"last update":"Fri May 10 03:38:40 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.69799999999999995,"15min":0.68500000000000005},"min":{"1min":0.53700000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.504}]},{"osd":3,"last update":"Fri May 10 03:38:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.55600000000000005,"15min":0.54200000000000004},"min":{"1min":0.44500000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.55300000000000005,"15min":0.54500000000000004},"min":{"1min":0.432,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.35499999999999998}]},{"osd":4,"last update":"Fri May 10 03:38:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.47399999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.72999999999999998,"15min":0.71599999999999997},"min":{"1min":0.68500000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.60299999999999998}]},{"osd":5,"last update":"Fri May 10 03:38:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68100000000000005,"15min":0.67500000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.88200000000000001,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.72499999999999998,"15min":0.71799999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.52800000000000002}]},{"osd":7,"last update":"Fri May 10 03:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.83099999999999996,"15min":0.82399999999999995},"min":{"1min":0.752,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.76100000000000001,"15min":0.755},"min":{"1min":0.61399999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.92900000000000005,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.58299999999999996}]},{"osd":8,"last update":"Fri May 10 03:38:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.64400000000000002}]},{"osd":9,"last update":"Fri May 10 03:38:26 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.63100000000000001}]},{"osd":10,"last update":"Fri May 10 03:38:46 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.67600000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36192,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708960,"statfs":{"total":95995035648,"available":95957975040,"internally_reserved":0,"allocated":1007616,"data_stored":505914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:38:06 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.50600000000000001,"15min":0.5},"min":{"1min":0.39300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.51500000000000001,"15min":0.498},"min":{"1min":0.39800000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.46000000000000002}]},{"osd":2,"last update":"Fri May 10 03:38:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.51900000000000002,"15min":0.497},"min":{"1min":0.38500000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.52000000000000002,"15min":0.504},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76500000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.60899999999999999}]},{"osd":3,"last update":"Fri May 10 03:38:44 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.58999999999999997,"15min":0.56399999999999995},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88,"5min":1.528,"15min":1.528},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.58599999999999997,"15min":0.55600000000000005},"min":{"1min":0.47899999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91100000000000003,"5min":1.502,"15min":1.502},"last":0.622}]},{"osd":4,"last update":"Fri May 10 03:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.40400000000000003,"15min":0.39100000000000001},"min":{"1min":0.29999999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.40699999999999997,"15min":0.39700000000000002},"min":{"1min":0.308,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.38300000000000001}]},{"osd":5,"last update":"Fri May 10 03:38:19 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60399999999999998,"15min":0.60099999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.70299999999999996}]},{"osd":6,"last update":"Fri May 10 03:38:34 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.5,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0700000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64600000000000002,"15min":0.64200000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.99199999999999999,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.53900000000000003}]},{"osd":7,"last update":"Fri May 10 03:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.378,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.92800000000000005,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.58999999999999997,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.75}]},{"osd":8,"last update":"Fri May 10 03:38:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.73999999999999999}]},{"osd":9,"last update":"Fri May 10 03:38:31 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.71599999999999997}]},{"osd":10,"last update":"Fri May 10 03:38:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.67600000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738421,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":465801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 03:38:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.56499999999999995,"15min":0.53700000000000003},"min":{"1min":0.36899999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.55900000000000005,"15min":0.52900000000000003},"min":{"1min":0.40100000000000002,"5min":0.316,"15min":0.316},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.65200000000000002}]},{"osd":2,"last update":"Fri May 10 03:38:20 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.61499999999999999,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.379,"15min":0.379},"max":{"1min":0.92600000000000005,"5min":1.216,"15min":1.216},"last":0.91700000000000004}]},{"osd":3,"last update":"Fri May 10 03:37:40 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.46400000000000002,"15min":0.44900000000000001},"min":{"1min":0.371,"5min":0.314,"15min":0.314},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.53100000000000003,"15min":0.51000000000000001},"min":{"1min":0.40300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.82999999999999996}]},{"osd":4,"last update":"Fri May 10 03:37:59 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.60699999999999998,"15min":0.58899999999999997},"min":{"1min":0.51400000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0760000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":1.095},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.59399999999999997,"15min":0.57299999999999995},"min":{"1min":0.48299999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Fri May 10 03:38:16 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58299999999999996,"15min":0.58199999999999996},"min":{"1min":0.42599999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.68999999999999995,"15min":0.68400000000000005},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":1.1419999999999999}]},{"osd":6,"last update":"Fri May 10 03:38:34 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68400000000000005,"15min":0.68899999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":1.036}]},{"osd":7,"last update":"Fri May 10 03:37:53 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":1.1910000000000001}]},{"osd":8,"last update":"Fri May 10 03:38:11 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":1.2789999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.95399999999999996}]},{"osd":9,"last update":"Fri May 10 03:38:27 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":1.0620000000000001}]},{"osd":10,"last update":"Fri May 10 03:38:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.2350000000000001},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]}]},{"osd":2,"up_from":18,"seq":77309411375,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":999424,"data_stored":476450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:38:24 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53400000000000003,"15min":0.52500000000000002},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.39100000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.754,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.80100000000000005}]},{"osd":1,"last update":"Fri May 10 03:38:24 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.54700000000000004,"15min":0.52500000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.57799999999999996,"15min":0.54800000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90300000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.874}]},{"osd":3,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.42599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81599999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.49099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.745,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.72999999999999998}]},{"osd":4,"last update":"Fri May 10 03:37:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.44500000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.745},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61799999999999999,"15min":0.61499999999999999},"min":{"1min":0.39600000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":1.0189999999999999}]},{"osd":5,"last update":"Fri May 10 03:38:17 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.503,"15min":0.499},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.498},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.37,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.70699999999999996}]},{"osd":6,"last update":"Fri May 10 03:38:34 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.629,"15min":0.625},"min":{"1min":0.47899999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71199999999999997,"15min":0.71099999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.95199999999999996}]},{"osd":7,"last update":"Fri May 10 03:37:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.91900000000000004}]},{"osd":8,"last update":"Fri May 10 03:38:07 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.60699999999999998}]},{"osd":9,"last update":"Fri May 10 03:38:29 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.83499999999999996}]},{"osd":10,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.99299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":3,"up_from":25,"seq":107374182442,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":463736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:38:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.40200000000000002,"15min":0.377},"min":{"1min":0.36899999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.59799999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.45900000000000002,"15min":0.432},"min":{"1min":0.372,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71999999999999997,"5min":0.878,"15min":0.878},"last":0.42199999999999999}]},{"osd":1,"last update":"Fri May 10 03:38:41 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55400000000000005,"15min":0.53400000000000003},"min":{"1min":0.46999999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.57099999999999995,"15min":0.53200000000000003},"min":{"1min":0.46500000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86099999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.60199999999999998}]},{"osd":2,"last update":"Fri May 10 03:38:41 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61599999999999999,"15min":0.59799999999999998},"min":{"1min":0.46899999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.97599999999999998,"5min":1.145,"15min":1.145},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.60399999999999998,"15min":0.57599999999999996},"min":{"1min":0.441,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.45500000000000002}]},{"osd":4,"last update":"Fri May 10 03:38:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.495,"5min":0.433,"15min":0.433},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.63600000000000001,"15min":0.62},"min":{"1min":0.51000000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.65000000000000002}]},{"osd":5,"last update":"Fri May 10 03:38:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.64200000000000002,"15min":0.628},"min":{"1min":0.50800000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.64600000000000002,"15min":0.625},"min":{"1min":0.45900000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri May 10 03:38:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67700000000000005,"15min":0.67400000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98299999999999998,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.46899999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.94199999999999995,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.625}]},{"osd":7,"last update":"Fri May 10 03:38:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79000000000000004,"15min":0.78800000000000003},"min":{"1min":0.57299999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.95399999999999996,"5min":1.085,"15min":1.085},"last":0.77400000000000002}]},{"osd":8,"last update":"Fri May 10 03:38:09 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.68899999999999995}]},{"osd":9,"last update":"Fri May 10 03:38:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.68899999999999995}]},{"osd":10,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.81000000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]}]},{"osd":4,"up_from":33,"seq":141733920807,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":468531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:37:59 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.47599999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.52400000000000002,"15min":0.51100000000000001},"min":{"1min":0.435,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.54000000000000004}]},{"osd":1,"last update":"Fri May 10 03:38:59 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.376,"15min":0.35699999999999998},"min":{"1min":0.28100000000000003,"5min":0.218,"15min":0.218},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.39500000000000002,"15min":0.377},"min":{"1min":0.29399999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.45700000000000002}]},{"osd":2,"last update":"Fri May 10 03:38:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.57199999999999995,"15min":0.55100000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.84999999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.59399999999999997,"15min":0.56100000000000005},"min":{"1min":0.47099999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.72199999999999998}]},{"osd":3,"last update":"Fri May 10 03:38:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.59599999999999997,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83799999999999997,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.51700000000000002}]},{"osd":5,"last update":"Fri May 10 03:38:15 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.59699999999999998,"15min":0.58799999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.89300000000000002}]},{"osd":6,"last update":"Fri May 10 03:38:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.623,"15min":0.628},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.77000000000000002,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.46600000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92200000000000004,"5min":3.714,"15min":3.714},"last":0.55600000000000005}]},{"osd":7,"last update":"Fri May 10 03:38:59 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.57499999999999996,"15min":0.55800000000000005},"min":{"1min":0.36899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.36499999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88500000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.84899999999999998}]},{"osd":8,"last update":"Fri May 10 03:38:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.878},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.94699999999999995}]},{"osd":9,"last update":"Fri May 10 03:38:28 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.86499999999999999}]},{"osd":10,"last update":"Fri May 10 03:38:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.753},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.73799999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]}]},{"osd":5,"up_from":38,"seq":163208757284,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28568,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716584,"statfs":{"total":95995035648,"available":95965782016,"internally_reserved":0,"allocated":1589248,"data_stored":1061412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:38:16 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":0.745,"15min":0.745},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57199999999999995,"15min":0.56799999999999995},"min":{"1min":0.38,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.65200000000000002}]},{"osd":1,"last update":"Fri May 10 03:38:16 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.76300000000000001}]},{"osd":2,"last update":"Fri May 10 03:38:16 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.42199999999999999,"15min":0.41399999999999998},"min":{"1min":0.32800000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.436,"15min":0.434},"min":{"1min":0.32000000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68100000000000005,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri May 10 03:38:16 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.38600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.46800000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.77900000000000003}]},{"osd":4,"last update":"Fri May 10 03:38:16 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61399999999999999,"15min":0.61599999999999999},"min":{"1min":0.47999999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.44,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.81799999999999995}]},{"osd":6,"last update":"Fri May 10 03:38:35 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60299999999999998,"15min":0.59899999999999998},"min":{"1min":0.371,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.80400000000000005}]},{"osd":7,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.70199999999999996,"15min":0.69599999999999995},"min":{"1min":0.52400000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69199999999999995,"15min":0.68999999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.90300000000000002}]},{"osd":8,"last update":"Fri May 10 03:38:07 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.871}]},{"osd":9,"last update":"Fri May 10 03:38:29 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.93100000000000005}]},{"osd":10,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.94199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":47331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":12667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":42115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T03:39:02.019 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-10T03:39:02.020 INFO:tasks.cephadm:Setting up client nodes... 2024-05-10T03:39:02.020 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-10T03:39:02.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:02 smithi045 ceph-mon[42520]: from='client.24827 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:02.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:02 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/895361876' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:39:02.306 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:02.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:02 smithi106 ceph-mon[46996]: from='client.24827 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:02.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:02 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/895361876' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:39:02.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:02 smithi154 ceph-mon[46565]: from='client.24827 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:02.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:02 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/895361876' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:39:03.274 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:03 smithi045 ceph-mon[42520]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T03:39:03.274 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:03 smithi045 ceph-mon[42520]: pgmap v244: 129 pgs: 129 active+clean; 622 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 7.1 KiB/s wr, 13 op/s 2024-05-10T03:39:03.274 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:03 smithi045 ceph-mon[42520]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T03:39:03.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:03 smithi106 ceph-mon[46996]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T03:39:03.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:03 smithi106 ceph-mon[46996]: pgmap v244: 129 pgs: 129 active+clean; 622 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 7.1 KiB/s wr, 13 op/s 2024-05-10T03:39:03.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:03 smithi106 ceph-mon[46996]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T03:39:03.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:03 smithi154 ceph-mon[46565]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T03:39:03.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:03 smithi154 ceph-mon[46565]: pgmap v244: 129 pgs: 129 active+clean; 622 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 7.1 KiB/s wr, 13 op/s 2024-05-10T03:39:03.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:03 smithi154 ceph-mon[46565]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T03:39:03.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.489+0000 7fc3c92f1700 1 -- 172.21.15.45:0/253499873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3c4100330 msgr2=0x7fc3c4100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:03.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.489+0000 7fc3c92f1700 1 --2- 172.21.15.45:0/253499873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3c4100330 0x7fc3c4100740 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009990 tx=0x7fc3b4009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:03.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.489+0000 7fc3c92f1700 1 -- 172.21.15.45:0/253499873 shutdown_connections 2024-05-10T03:39:03.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.489+0000 7fc3c92f1700 1 --2- 172.21.15.45:0/253499873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3c4101e00 0x7fc3c41086b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:03.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.489+0000 7fc3c92f1700 1 --2- 172.21.15.45:0/253499873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3c4100330 0x7fc3c4100740 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:03.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.489+0000 7fc3c92f1700 1 --2- 172.21.15.45:0/253499873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3c4101460 0x7fc3c4101870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:03.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.489+0000 7fc3c92f1700 1 -- 172.21.15.45:0/253499873 >> 172.21.15.45:0/253499873 conn(0x7fc3c40fb970 msgr2=0x7fc3c40fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:03.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.489+0000 7fc3c92f1700 1 -- 172.21.15.45:0/253499873 shutdown_connections 2024-05-10T03:39:03.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.489+0000 7fc3c92f1700 1 -- 172.21.15.45:0/253499873 wait complete. 2024-05-10T03:39:03.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.490+0000 7fc3c92f1700 1 Processor -- start 2024-05-10T03:39:03.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.490+0000 7fc3c92f1700 1 -- start start 2024-05-10T03:39:03.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.490+0000 7fc3c92f1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3c4100330 0x7fc3c41042d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:03.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.490+0000 7fc3c92f1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3c4101460 0x7fc3c41027a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:03.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.491+0000 7fc3c92f1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3c4101e00 0x7fc3c4102e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:03.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.491+0000 7fc3c92f1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c4103530 con 0x7fc3c4100330 2024-05-10T03:39:03.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.491+0000 7fc3c92f1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c41a2260 con 0x7fc3c4101460 2024-05-10T03:39:03.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.491+0000 7fc3c92f1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c41a23a0 con 0x7fc3c4101e00 2024-05-10T03:39:03.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.491+0000 7fc3c2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3c4100330 0x7fc3c41042d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:03.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.491+0000 7fc3c2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3c4100330 0x7fc3c41042d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60094/0 (socket says 172.21.15.45:60094) 2024-05-10T03:39:03.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.491+0000 7fc3c2ffd700 1 -- 172.21.15.45:0/2354869722 learned_addr learned my addr 172.21.15.45:0/2354869722 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:03.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.491+0000 7fc3c37fe700 1 --2- 172.21.15.45:0/2354869722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3c4101e00 0x7fc3c4102e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:03.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.491+0000 7fc3c27fc700 1 --2- 172.21.15.45:0/2354869722 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3c4101460 0x7fc3c41027a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:03.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.491+0000 7fc3c2ffd700 1 -- 172.21.15.45:0/2354869722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3c4101e00 msgr2=0x7fc3c4102e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:03.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.491+0000 7fc3c2ffd700 1 --2- 172.21.15.45:0/2354869722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3c4101e00 0x7fc3c4102e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:03.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.491+0000 7fc3c2ffd700 1 -- 172.21.15.45:0/2354869722 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3c4101460 msgr2=0x7fc3c41027a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:03.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.491+0000 7fc3c2ffd700 1 --2- 172.21.15.45:0/2354869722 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3c4101460 0x7fc3c41027a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:03.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.491+0000 7fc3c2ffd700 1 -- 172.21.15.45:0/2354869722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b40095f0 con 0x7fc3c4100330 2024-05-10T03:39:03.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.491+0000 7fc3c27fc700 1 --2- 172.21.15.45:0/2354869722 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3c4101460 0x7fc3c41027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:03.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.491+0000 7fc3c2ffd700 1 --2- 172.21.15.45:0/2354869722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3c4100330 0x7fc3c41042d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40098e0 tx=0x7fc3b4005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:03.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.491+0000 7fc3abfff700 1 -- 172.21.15.45:0/2354869722 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b401d070 con 0x7fc3c4100330 2024-05-10T03:39:03.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.491+0000 7fc3c92f1700 1 -- 172.21.15.45:0/2354869722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c41a25a0 con 0x7fc3c4100330 2024-05-10T03:39:03.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.491+0000 7fc3abfff700 1 -- 172.21.15.45:0/2354869722 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc3b400be40 con 0x7fc3c4100330 2024-05-10T03:39:03.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.491+0000 7fc3abfff700 1 -- 172.21.15.45:0/2354869722 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b40173f0 con 0x7fc3c4100330 2024-05-10T03:39:03.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.492+0000 7fc3c92f1700 1 -- 172.21.15.45:0/2354869722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c41a2a10 con 0x7fc3c4100330 2024-05-10T03:39:03.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.493+0000 7fc3c92f1700 1 -- 172.21.15.45:0/2354869722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c40ff630 con 0x7fc3c4100330 2024-05-10T03:39:03.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.494+0000 7fc3abfff700 1 -- 172.21.15.45:0/2354869722 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fc3b4021410 con 0x7fc3c4100330 2024-05-10T03:39:03.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.494+0000 7fc3abfff700 1 --2- 172.21.15.45:0/2354869722 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc3ac0a11b0 0x7fc3ac0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:03.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.495+0000 7fc3c27fc700 1 --2- 172.21.15.45:0/2354869722 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc3ac0a11b0 0x7fc3ac0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:03.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.495+0000 7fc3abfff700 1 -- 172.21.15.45:0/2354869722 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc3b40ce2a0 con 0x7fc3c4100330 2024-05-10T03:39:03.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.495+0000 7fc3c27fc700 1 --2- 172.21.15.45:0/2354869722 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc3ac0a11b0 0x7fc3ac0a36c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800ad20 tx=0x7fc3b800a370 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:03.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.498+0000 7fc3abfff700 1 -- 172.21.15.45:0/2354869722 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc3b4097770 con 0x7fc3c4100330 2024-05-10T03:39:03.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.798+0000 7fc3c92f1700 1 -- 172.21.15.45:0/2354869722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fc3c404edc0 con 0x7fc3c4100330 2024-05-10T03:39:03.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.804+0000 7fc3abfff700 1 -- 172.21.15.45:0/2354869722 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) v1 ==== 170+0+59 (secure 0 0 0) 0x7fc3b409ad90 con 0x7fc3c4100330 2024-05-10T03:39:03.807 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2024-05-10T03:39:03.807 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDXlj1mUvWpLxAAkFTwKN7OiI8y0myxJxOzRQ== 2024-05-10T03:39:03.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.806+0000 7fc3c92f1700 1 -- 172.21.15.45:0/2354869722 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc3ac0a11b0 msgr2=0x7fc3ac0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:03.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.806+0000 7fc3c92f1700 1 --2- 172.21.15.45:0/2354869722 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc3ac0a11b0 0x7fc3ac0a36c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800ad20 tx=0x7fc3b800a370 comp rx=0 tx=0).stop 2024-05-10T03:39:03.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.806+0000 7fc3c92f1700 1 -- 172.21.15.45:0/2354869722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3c4100330 msgr2=0x7fc3c41042d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:03.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.806+0000 7fc3c92f1700 1 --2- 172.21.15.45:0/2354869722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3c4100330 0x7fc3c41042d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40098e0 tx=0x7fc3b4005b00 comp rx=0 tx=0).stop 2024-05-10T03:39:03.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.806+0000 7fc3c92f1700 1 -- 172.21.15.45:0/2354869722 shutdown_connections 2024-05-10T03:39:03.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.806+0000 7fc3c92f1700 1 --2- 172.21.15.45:0/2354869722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3c4101e00 0x7fc3c4102e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:03.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.806+0000 7fc3c92f1700 1 --2- 172.21.15.45:0/2354869722 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc3ac0a11b0 0x7fc3ac0a36c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:03.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.806+0000 7fc3c92f1700 1 --2- 172.21.15.45:0/2354869722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3c4100330 0x7fc3c41042d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:03.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.806+0000 7fc3c92f1700 1 --2- 172.21.15.45:0/2354869722 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3c4101460 0x7fc3c41027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:03.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.806+0000 7fc3c92f1700 1 -- 172.21.15.45:0/2354869722 >> 172.21.15.45:0/2354869722 conn(0x7fc3c40fb970 msgr2=0x7fc3c41068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:03.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.807+0000 7fc3c92f1700 1 -- 172.21.15.45:0/2354869722 shutdown_connections 2024-05-10T03:39:03.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:03.807+0000 7fc3c92f1700 1 -- 172.21.15.45:0/2354869722 wait complete. 2024-05-10T03:39:04.107 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:04 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2354869722' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-10T03:39:04.107 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:04 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2354869722' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-10T03:39:04.233 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-10T03:39:04.233 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-10T03:39:04.233 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-10T03:39:04.285 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-10T03:39:04.285 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-10T03:39:04.285 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph mgr dump --format=json 2024-05-10T03:39:04.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:04 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2354869722' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-10T03:39:04.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:04 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2354869722' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-10T03:39:04.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:04 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2354869722' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-10T03:39:04.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:04 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2354869722' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-10T03:39:04.580 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:05.283 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:05 smithi045 ceph-mon[42520]: pgmap v245: 129 pgs: 129 active+clean; 623 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 7.8 KiB/s wr, 17 op/s 2024-05-10T03:39:05.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:05 smithi106 ceph-mon[46996]: pgmap v245: 129 pgs: 129 active+clean; 623 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 7.8 KiB/s wr, 17 op/s 2024-05-10T03:39:05.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:05 smithi154 ceph-mon[46565]: pgmap v245: 129 pgs: 129 active+clean; 623 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 7.8 KiB/s wr, 17 op/s 2024-05-10T03:39:05.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.697+0000 7f48fb9c1700 1 -- 172.21.15.45:0/1008418916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f4101f50 msgr2=0x7f48f4102360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:05.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.697+0000 7f48fb9c1700 1 --2- 172.21.15.45:0/1008418916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f4101f50 0x7f48f4102360 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f48f0009990 tx=0x7f48f0009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:05.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.697+0000 7f48fb9c1700 1 -- 172.21.15.45:0/1008418916 shutdown_connections 2024-05-10T03:39:05.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.697+0000 7f48fb9c1700 1 --2- 172.21.15.45:0/1008418916 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48f41071d0 0x7f48f410eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:05.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.697+0000 7f48fb9c1700 1 --2- 172.21.15.45:0/1008418916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f4101f50 0x7f48f4102360 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:05.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.697+0000 7f48fb9c1700 1 --2- 172.21.15.45:0/1008418916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48f4106880 0x7f48f4106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:05.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.697+0000 7f48fb9c1700 1 -- 172.21.15.45:0/1008418916 >> 172.21.15.45:0/1008418916 conn(0x7f48f40fd820 msgr2=0x7f48f40ffc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:05.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.697+0000 7f48fb9c1700 1 -- 172.21.15.45:0/1008418916 shutdown_connections 2024-05-10T03:39:05.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.697+0000 7f48fb9c1700 1 -- 172.21.15.45:0/1008418916 wait complete. 2024-05-10T03:39:05.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.698+0000 7f48fb9c1700 1 Processor -- start 2024-05-10T03:39:05.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.698+0000 7f48fb9c1700 1 -- start start 2024-05-10T03:39:05.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.698+0000 7f48fb9c1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48f4101f50 0x7f48f4198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:05.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.698+0000 7f48fb9c1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f4106880 0x7f48f4198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:05.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.698+0000 7f48fb9c1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48f41071d0 0x7f48f419d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:05.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.698+0000 7f48fb9c1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f419d590 con 0x7f48f4106880 2024-05-10T03:39:05.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.698+0000 7f48fb9c1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f419d700 con 0x7f48f4101f50 2024-05-10T03:39:05.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.698+0000 7f48fb9c1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f419d8c0 con 0x7f48f41071d0 2024-05-10T03:39:05.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.699+0000 7f48f8f5c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f4106880 0x7f48f4198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:05.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.699+0000 7f48f8f5c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f4106880 0x7f48f4198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60122/0 (socket says 172.21.15.45:60122) 2024-05-10T03:39:05.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.699+0000 7f48f8f5c700 1 -- 172.21.15.45:0/378259547 learned_addr learned my addr 172.21.15.45:0/378259547 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:05.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.699+0000 7f48f975d700 1 --2- 172.21.15.45:0/378259547 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48f4101f50 0x7f48f4198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:05.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.699+0000 7f48f9f5e700 1 --2- 172.21.15.45:0/378259547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48f41071d0 0x7f48f419d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:05.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.699+0000 7f48f8f5c700 1 -- 172.21.15.45:0/378259547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48f41071d0 msgr2=0x7f48f419d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:05.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.699+0000 7f48f8f5c700 1 --2- 172.21.15.45:0/378259547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48f41071d0 0x7f48f419d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:05.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.699+0000 7f48f8f5c700 1 -- 172.21.15.45:0/378259547 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48f4101f50 msgr2=0x7f48f4198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:05.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.699+0000 7f48f8f5c700 1 --2- 172.21.15.45:0/378259547 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48f4101f50 0x7f48f4198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:05.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.699+0000 7f48f8f5c700 1 -- 172.21.15.45:0/378259547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f00095f0 con 0x7f48f4106880 2024-05-10T03:39:05.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.699+0000 7f48f8f5c700 1 --2- 172.21.15.45:0/378259547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f4106880 0x7f48f4198b10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f48e800d950 tx=0x7f48e800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:05.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.699+0000 7f48e67fc700 1 -- 172.21.15.45:0/378259547 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e8004220 con 0x7f48f4106880 2024-05-10T03:39:05.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.699+0000 7f48e67fc700 1 -- 172.21.15.45:0/378259547 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f48e8007620 con 0x7f48f4106880 2024-05-10T03:39:05.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.699+0000 7f48fb9c1700 1 -- 172.21.15.45:0/378259547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f419dba0 con 0x7f48f4106880 2024-05-10T03:39:05.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.699+0000 7f48e67fc700 1 -- 172.21.15.45:0/378259547 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e80056e0 con 0x7f48f4106880 2024-05-10T03:39:05.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.699+0000 7f48fb9c1700 1 -- 172.21.15.45:0/378259547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f41a54a0 con 0x7f48f4106880 2024-05-10T03:39:05.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.701+0000 7f48fb9c1700 1 -- 172.21.15.45:0/378259547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f410a190 con 0x7f48f4106880 2024-05-10T03:39:05.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.702+0000 7f48e67fc700 1 -- 172.21.15.45:0/378259547 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f48e8004380 con 0x7f48f4106880 2024-05-10T03:39:05.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.703+0000 7f48e67fc700 1 --2- 172.21.15.45:0/378259547 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f48e00a11b0 0x7f48e00a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:05.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.703+0000 7f48f975d700 1 --2- 172.21.15.45:0/378259547 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f48e00a11b0 0x7f48e00a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:05.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.703+0000 7f48e67fc700 1 -- 172.21.15.45:0/378259547 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f48e80ccec0 con 0x7f48f4106880 2024-05-10T03:39:05.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.704+0000 7f48f975d700 1 --2- 172.21.15.45:0/378259547 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f48e00a11b0 0x7f48e00a36c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f48f00098e0 tx=0x7f48f0005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:05.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.707+0000 7f48e67fc700 1 -- 172.21.15.45:0/378259547 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f48e8096300 con 0x7f48f4106880 2024-05-10T03:39:05.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.980+0000 7f48fb9c1700 1 -- 172.21.15.45:0/378259547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f48f4199b70 con 0x7f48f4106880 2024-05-10T03:39:05.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.986+0000 7f48e67fc700 1 -- 172.21.15.45:0/378259547 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260282 (secure 0 0 0) 0x7f48f4199b70 con 0x7f48f4106880 2024-05-10T03:39:05.993 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:39:05.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.989+0000 7f48fb9c1700 1 -- 172.21.15.45:0/378259547 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f48e00a11b0 msgr2=0x7f48e00a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:05.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.989+0000 7f48fb9c1700 1 --2- 172.21.15.45:0/378259547 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f48e00a11b0 0x7f48e00a36c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f48f00098e0 tx=0x7f48f0005960 comp rx=0 tx=0).stop 2024-05-10T03:39:05.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.989+0000 7f48fb9c1700 1 -- 172.21.15.45:0/378259547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f4106880 msgr2=0x7f48f4198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:05.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.989+0000 7f48fb9c1700 1 --2- 172.21.15.45:0/378259547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f4106880 0x7f48f4198b10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f48e800d950 tx=0x7f48e800dc60 comp rx=0 tx=0).stop 2024-05-10T03:39:05.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.989+0000 7f48fb9c1700 1 -- 172.21.15.45:0/378259547 shutdown_connections 2024-05-10T03:39:05.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.989+0000 7f48fb9c1700 1 --2- 172.21.15.45:0/378259547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48f41071d0 0x7f48f419d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:05.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.989+0000 7f48fb9c1700 1 --2- 172.21.15.45:0/378259547 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f48e00a11b0 0x7f48e00a36c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:05.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.989+0000 7f48fb9c1700 1 --2- 172.21.15.45:0/378259547 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48f4101f50 0x7f48f4198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:05.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.989+0000 7f48fb9c1700 1 --2- 172.21.15.45:0/378259547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48f4106880 0x7f48f4198b10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:05.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.989+0000 7f48fb9c1700 1 -- 172.21.15.45:0/378259547 >> 172.21.15.45:0/378259547 conn(0x7f48f40fd820 msgr2=0x7f48f4105af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:05.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.989+0000 7f48fb9c1700 1 -- 172.21.15.45:0/378259547 shutdown_connections 2024-05-10T03:39:05.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:05.989+0000 7f48fb9c1700 1 -- 172.21.15.45:0/378259547 wait complete. 2024-05-10T03:39:06.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:06 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/378259547' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-10T03:39:06.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:06 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/378259547' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-10T03:39:06.424 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":596110596},{"type":"v1","addr":"172.21.15.45:6801","nonce":596110596}]},"active_addr":"172.21.15.45:6801/596110596","active_change":"2024-05-10T03:33:25.802159+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24115,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24119,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.45:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":4243113437}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":3487072396}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":186301517}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":1957385379}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":2510945598}]}]} 2024-05-10T03:39:06.429 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-10T03:39:06.430 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-10T03:39:06.430 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-10T03:39:06.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:06 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/378259547' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-10T03:39:06.687 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:07.153 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:07 smithi045 ceph-mon[42520]: pgmap v246: 129 pgs: 129 active+clean; 628 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 8.3 KiB/s wr, 21 op/s 2024-05-10T03:39:07.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:07 smithi106 ceph-mon[46996]: pgmap v246: 129 pgs: 129 active+clean; 628 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 8.3 KiB/s wr, 21 op/s 2024-05-10T03:39:07.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:07 smithi154 ceph-mon[46565]: pgmap v246: 129 pgs: 129 active+clean; 628 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 8.3 KiB/s wr, 21 op/s 2024-05-10T03:39:07.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.780+0000 7fc70a50b700 1 -- 172.21.15.45:0/782584938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc704105730 msgr2=0x7fc704105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:07.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.780+0000 7fc70a50b700 1 --2- 172.21.15.45:0/782584938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc704105730 0x7fc704105b40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8009990 tx=0x7fc6f8009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:07.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.780+0000 7fc70a50b700 1 -- 172.21.15.45:0/782584938 shutdown_connections 2024-05-10T03:39:07.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.780+0000 7fc70a50b700 1 --2- 172.21.15.45:0/782584938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc704106080 0x7fc70410d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:07.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.780+0000 7fc70a50b700 1 --2- 172.21.15.45:0/782584938 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc704100e00 0x7fc704101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:07.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.780+0000 7fc70a50b700 1 --2- 172.21.15.45:0/782584938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc704105730 0x7fc704105b40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:07.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.780+0000 7fc70a50b700 1 -- 172.21.15.45:0/782584938 >> 172.21.15.45:0/782584938 conn(0x7fc7040fc7a0 msgr2=0x7fc7040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:07.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.780+0000 7fc70a50b700 1 -- 172.21.15.45:0/782584938 shutdown_connections 2024-05-10T03:39:07.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.780+0000 7fc70a50b700 1 -- 172.21.15.45:0/782584938 wait complete. 2024-05-10T03:39:07.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.781+0000 7fc70a50b700 1 Processor -- start 2024-05-10T03:39:07.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.781+0000 7fc70a50b700 1 -- start start 2024-05-10T03:39:07.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.781+0000 7fc70a50b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc704100e00 0x7fc7040fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:07.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.781+0000 7fc70a50b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc704105730 0x7fc7040fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:07.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.781+0000 7fc70a50b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc704106080 0x7fc7041a6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:07.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.781+0000 7fc70a50b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7040fda30 con 0x7fc704105730 2024-05-10T03:39:07.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.781+0000 7fc70a50b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7041a6ca0 con 0x7fc704106080 2024-05-10T03:39:07.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.781+0000 7fc70a50b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7041a6de0 con 0x7fc704100e00 2024-05-10T03:39:07.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.782+0000 7fc7037fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc704105730 0x7fc7040fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:07.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.782+0000 7fc7037fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc704105730 0x7fc7040fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40232/0 (socket says 172.21.15.45:40232) 2024-05-10T03:39:07.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.782+0000 7fc7037fe700 1 -- 172.21.15.45:0/1431119354 learned_addr learned my addr 172.21.15.45:0/1431119354 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:07.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.782+0000 7fc708aa8700 1 --2- 172.21.15.45:0/1431119354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc704106080 0x7fc7041a6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:07.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.782+0000 7fc703fff700 1 --2- 172.21.15.45:0/1431119354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc704100e00 0x7fc7040fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:07.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.782+0000 7fc7037fe700 1 -- 172.21.15.45:0/1431119354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc704100e00 msgr2=0x7fc7040fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:07.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.782+0000 7fc7037fe700 1 --2- 172.21.15.45:0/1431119354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc704100e00 0x7fc7040fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:07.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.782+0000 7fc7037fe700 1 -- 172.21.15.45:0/1431119354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc704106080 msgr2=0x7fc7041a6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:07.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.782+0000 7fc7037fe700 1 --2- 172.21.15.45:0/1431119354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc704106080 0x7fc7041a6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:07.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.782+0000 7fc7037fe700 1 -- 172.21.15.45:0/1431119354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f80095f0 con 0x7fc704105730 2024-05-10T03:39:07.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.782+0000 7fc7037fe700 1 --2- 172.21.15.45:0/1431119354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc704105730 0x7fc7040fd1c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8000c00 tx=0x7fc6f800f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:07.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.782+0000 7fc7017fa700 1 -- 172.21.15.45:0/1431119354 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f801d070 con 0x7fc704105730 2024-05-10T03:39:07.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.782+0000 7fc7017fa700 1 -- 172.21.15.45:0/1431119354 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc6f8003680 con 0x7fc704105730 2024-05-10T03:39:07.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.782+0000 7fc7017fa700 1 -- 172.21.15.45:0/1431119354 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f80173f0 con 0x7fc704105730 2024-05-10T03:39:07.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.782+0000 7fc70a50b700 1 -- 172.21.15.45:0/1431119354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7041a7010 con 0x7fc704105730 2024-05-10T03:39:07.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.783+0000 7fc70a50b700 1 -- 172.21.15.45:0/1431119354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7041a74b0 con 0x7fc704105730 2024-05-10T03:39:07.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.784+0000 7fc70a50b700 1 -- 172.21.15.45:0/1431119354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc70410a140 con 0x7fc704105730 2024-05-10T03:39:07.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.785+0000 7fc7017fa700 1 -- 172.21.15.45:0/1431119354 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fc6f8022600 con 0x7fc704105730 2024-05-10T03:39:07.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.786+0000 7fc7017fa700 1 --2- 172.21.15.45:0/1431119354 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc6ec0a1230 0x7fc6ec0a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:07.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.786+0000 7fc703fff700 1 --2- 172.21.15.45:0/1431119354 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc6ec0a1230 0x7fc6ec0a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:07.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.786+0000 7fc7017fa700 1 -- 172.21.15.45:0/1431119354 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc6f80cde00 con 0x7fc704105730 2024-05-10T03:39:07.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.786+0000 7fc703fff700 1 --2- 172.21.15.45:0/1431119354 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc6ec0a1230 0x7fc6ec0a3740 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4007be0 tx=0x7fc6f40073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:07.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:07.791+0000 7fc7017fa700 1 -- 172.21.15.45:0/1431119354 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc6f8097270 con 0x7fc704105730 2024-05-10T03:39:08.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:08.004+0000 7fc70a50b700 1 -- 172.21.15.45:0/1431119354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc70404edc0 con 0x7fc704105730 2024-05-10T03:39:08.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:08.006+0000 7fc7017fa700 1 -- 172.21.15.45:0/1431119354 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+23981 (secure 0 0 0) 0x7fc6f809a890 con 0x7fc704105730 2024-05-10T03:39:08.010 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:39:08.010 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":86,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:38:42.069624+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:38:34.871801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:38:35.935386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T03:38:39.029903+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:39:08.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:08.009+0000 7fc70a50b700 1 -- 172.21.15.45:0/1431119354 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc6ec0a1230 msgr2=0x7fc6ec0a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:08.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:08.009+0000 7fc70a50b700 1 --2- 172.21.15.45:0/1431119354 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc6ec0a1230 0x7fc6ec0a3740 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4007be0 tx=0x7fc6f40073d0 comp rx=0 tx=0).stop 2024-05-10T03:39:08.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:08.009+0000 7fc70a50b700 1 -- 172.21.15.45:0/1431119354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc704105730 msgr2=0x7fc7040fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:08.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:08.009+0000 7fc70a50b700 1 --2- 172.21.15.45:0/1431119354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc704105730 0x7fc7040fd1c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8000c00 tx=0x7fc6f800f710 comp rx=0 tx=0).stop 2024-05-10T03:39:08.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:08.009+0000 7fc70a50b700 1 -- 172.21.15.45:0/1431119354 shutdown_connections 2024-05-10T03:39:08.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:08.009+0000 7fc70a50b700 1 --2- 172.21.15.45:0/1431119354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc704100e00 0x7fc7040fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:08.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:08.009+0000 7fc70a50b700 1 --2- 172.21.15.45:0/1431119354 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc6ec0a1230 0x7fc6ec0a3740 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:08.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:08.009+0000 7fc70a50b700 1 --2- 172.21.15.45:0/1431119354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc704106080 0x7fc7041a6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:08.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:08.009+0000 7fc70a50b700 1 --2- 172.21.15.45:0/1431119354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc704105730 0x7fc7040fd1c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:08.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:08.009+0000 7fc70a50b700 1 -- 172.21.15.45:0/1431119354 >> 172.21.15.45:0/1431119354 conn(0x7fc7040fc7a0 msgr2=0x7fc7040690d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:08.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:08.009+0000 7fc70a50b700 1 -- 172.21.15.45:0/1431119354 shutdown_connections 2024-05-10T03:39:08.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:08.009+0000 7fc70a50b700 1 -- 172.21.15.45:0/1431119354 wait complete. 2024-05-10T03:39:08.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:08 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1431119354' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:39:08.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:08 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1431119354' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:39:08.416 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-10T03:39:08.416 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-10T03:39:08.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:08 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1431119354' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:39:08.677 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:09.158 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:09 smithi045 ceph-mon[42520]: pgmap v247: 129 pgs: 129 active+clean; 628 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 8.2 KiB/s wr, 21 op/s 2024-05-10T03:39:09.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:09 smithi106 ceph-mon[46996]: pgmap v247: 129 pgs: 129 active+clean; 628 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 8.2 KiB/s wr, 21 op/s 2024-05-10T03:39:09.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:09 smithi154 ceph-mon[46565]: pgmap v247: 129 pgs: 129 active+clean; 628 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 8.2 KiB/s wr, 21 op/s 2024-05-10T03:39:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.704+0000 7ff446213700 1 -- 172.21.15.45:0/3566150055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff440105730 msgr2=0x7ff440105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.704+0000 7ff446213700 1 --2- 172.21.15.45:0/3566150055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff440105730 0x7ff440105b40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff434009990 tx=0x7ff434009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.704+0000 7ff446213700 1 -- 172.21.15.45:0/3566150055 shutdown_connections 2024-05-10T03:39:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.704+0000 7ff446213700 1 --2- 172.21.15.45:0/3566150055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff440100e00 0x7ff440101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.704+0000 7ff446213700 1 --2- 172.21.15.45:0/3566150055 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff440106080 0x7ff44010d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.704+0000 7ff446213700 1 --2- 172.21.15.45:0/3566150055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff440105730 0x7ff440105b40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.704+0000 7ff446213700 1 -- 172.21.15.45:0/3566150055 >> 172.21.15.45:0/3566150055 conn(0x7ff4400fc7a0 msgr2=0x7ff4400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.704+0000 7ff446213700 1 -- 172.21.15.45:0/3566150055 shutdown_connections 2024-05-10T03:39:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.704+0000 7ff446213700 1 -- 172.21.15.45:0/3566150055 wait complete. 2024-05-10T03:39:09.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.705+0000 7ff446213700 1 Processor -- start 2024-05-10T03:39:09.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.705+0000 7ff446213700 1 -- start start 2024-05-10T03:39:09.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.706+0000 7ff446213700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff440100e00 0x7ff440199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.706+0000 7ff446213700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff440105730 0x7ff440199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.706+0000 7ff446213700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff440106080 0x7ff4401a44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.706+0000 7ff446213700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44019a260 con 0x7ff440100e00 2024-05-10T03:39:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.706+0000 7ff446213700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4401a49e0 con 0x7ff440106080 2024-05-10T03:39:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.706+0000 7ff446213700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4401a4b50 con 0x7ff440105730 2024-05-10T03:39:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.706+0000 7ff43f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff440100e00 0x7ff440199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.706+0000 7ff43f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff440100e00 0x7ff440199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40242/0 (socket says 172.21.15.45:40242) 2024-05-10T03:39:09.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.706+0000 7ff43f7fe700 1 -- 172.21.15.45:0/1702739410 learned_addr learned my addr 172.21.15.45:0/1702739410 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:09.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.706+0000 7ff43effd700 1 --2- 172.21.15.45:0/1702739410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff440105730 0x7ff440199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:09.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.706+0000 7ff43ffff700 1 --2- 172.21.15.45:0/1702739410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff440106080 0x7ff4401a44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:09.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.706+0000 7ff43f7fe700 1 -- 172.21.15.45:0/1702739410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff440105730 msgr2=0x7ff440199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:09.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.706+0000 7ff43f7fe700 1 --2- 172.21.15.45:0/1702739410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff440105730 0x7ff440199980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:09.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.706+0000 7ff43f7fe700 1 -- 172.21.15.45:0/1702739410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff440106080 msgr2=0x7ff4401a44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:09.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.706+0000 7ff43f7fe700 1 --2- 172.21.15.45:0/1702739410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff440106080 0x7ff4401a44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:09.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.706+0000 7ff43f7fe700 1 -- 172.21.15.45:0/1702739410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4340095f0 con 0x7ff440100e00 2024-05-10T03:39:09.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.706+0000 7ff43ffff700 1 --2- 172.21.15.45:0/1702739410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff440106080 0x7ff4401a44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:09.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.706+0000 7ff43f7fe700 1 --2- 172.21.15.45:0/1702739410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff440100e00 0x7ff440199420 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff43000d950 tx=0x7ff43000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:09.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.707+0000 7ff43cff9700 1 -- 172.21.15.45:0/1702739410 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4300098e0 con 0x7ff440100e00 2024-05-10T03:39:09.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.707+0000 7ff43cff9700 1 -- 172.21.15.45:0/1702739410 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff430010460 con 0x7ff440100e00 2024-05-10T03:39:09.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.707+0000 7ff446213700 1 -- 172.21.15.45:0/1702739410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4401a4e30 con 0x7ff440100e00 2024-05-10T03:39:09.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.707+0000 7ff43cff9700 1 -- 172.21.15.45:0/1702739410 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43000f620 con 0x7ff440100e00 2024-05-10T03:39:09.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.707+0000 7ff446213700 1 -- 172.21.15.45:0/1702739410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4401a52a0 con 0x7ff440100e00 2024-05-10T03:39:09.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.708+0000 7ff446213700 1 -- 172.21.15.45:0/1702739410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff440109040 con 0x7ff440100e00 2024-05-10T03:39:09.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.709+0000 7ff43cff9700 1 -- 172.21.15.45:0/1702739410 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ff430010960 con 0x7ff440100e00 2024-05-10T03:39:09.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.710+0000 7ff43cff9700 1 --2- 172.21.15.45:0/1702739410 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4280a1230 0x7ff4280a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:09.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.710+0000 7ff43cff9700 1 -- 172.21.15.45:0/1702739410 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ff4300ccda0 con 0x7ff440100e00 2024-05-10T03:39:09.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.710+0000 7ff43effd700 1 --2- 172.21.15.45:0/1702739410 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4280a1230 0x7ff4280a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:09.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.710+0000 7ff43effd700 1 --2- 172.21.15.45:0/1702739410 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4280a1230 0x7ff4280a3740 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff434006010 tx=0x7ff434005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:09.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.714+0000 7ff43cff9700 1 -- 172.21.15.45:0/1702739410 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff4300961e0 con 0x7ff440100e00 2024-05-10T03:39:09.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.927+0000 7ff446213700 1 -- 172.21.15.45:0/1702739410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4401022b0 con 0x7ff440100e00 2024-05-10T03:39:09.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.928+0000 7ff43cff9700 1 -- 172.21.15.45:0/1702739410 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+23981 (secure 0 0 0) 0x7ff430016090 con 0x7ff440100e00 2024-05-10T03:39:09.933 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:39:09.933 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":86,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:38:42.069624+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:38:34.871801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:38:35.935386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T03:38:39.029903+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:39:09.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.931+0000 7ff446213700 1 -- 172.21.15.45:0/1702739410 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4280a1230 msgr2=0x7ff4280a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:09.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.931+0000 7ff446213700 1 --2- 172.21.15.45:0/1702739410 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4280a1230 0x7ff4280a3740 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff434006010 tx=0x7ff434005960 comp rx=0 tx=0).stop 2024-05-10T03:39:09.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.931+0000 7ff446213700 1 -- 172.21.15.45:0/1702739410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff440100e00 msgr2=0x7ff440199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:09.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.931+0000 7ff446213700 1 --2- 172.21.15.45:0/1702739410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff440100e00 0x7ff440199420 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff43000d950 tx=0x7ff43000dc60 comp rx=0 tx=0).stop 2024-05-10T03:39:09.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.931+0000 7ff446213700 1 -- 172.21.15.45:0/1702739410 shutdown_connections 2024-05-10T03:39:09.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.931+0000 7ff446213700 1 --2- 172.21.15.45:0/1702739410 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4280a1230 0x7ff4280a3740 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:09.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.931+0000 7ff446213700 1 --2- 172.21.15.45:0/1702739410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff440106080 0x7ff4401a44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:09.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.931+0000 7ff446213700 1 --2- 172.21.15.45:0/1702739410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff440100e00 0x7ff440199420 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:09.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.931+0000 7ff446213700 1 --2- 172.21.15.45:0/1702739410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff440105730 0x7ff440199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:09.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.931+0000 7ff446213700 1 -- 172.21.15.45:0/1702739410 >> 172.21.15.45:0/1702739410 conn(0x7ff4400fc7a0 msgr2=0x7ff440104a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:09.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.931+0000 7ff446213700 1 -- 172.21.15.45:0/1702739410 shutdown_connections 2024-05-10T03:39:09.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:09.931+0000 7ff446213700 1 -- 172.21.15.45:0/1702739410 wait complete. 2024-05-10T03:39:10.266 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:10 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1702739410' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:39:10.357 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-10T03:39:10.358 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-10T03:39:10.359 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-10T03:39:10.359 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-10T03:39:10.360 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-10T03:39:10.361 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-10T03:39:10.362 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-05-10T03:39:10.363 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-05-10T03:39:10.364 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-05-10T03:39:10.364 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-05-10T03:39:10.365 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-05-10T03:39:10.365 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-05-10T03:39:10.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:10 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1702739410' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:39:10.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:10 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1702739410' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:39:11.114 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:11.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:11 smithi106 ceph-mon[46996]: pgmap v248: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 24 op/s 2024-05-10T03:39:11.420 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:11 smithi045 ceph-mon[42520]: pgmap v248: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 24 op/s 2024-05-10T03:39:11.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:11 smithi154 ceph-mon[46565]: pgmap v248: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 24 op/s 2024-05-10T03:39:11.873 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:12.177 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:12.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.485+0000 7f01b850b700 1 -- 172.21.15.45:0/2875201124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01b0106080 msgr2=0x7f01b010d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:12.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.485+0000 7f01b850b700 1 --2- 172.21.15.45:0/2875201124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01b0106080 0x7f01b010d9e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f01a800b0a0 tx=0x7f01a800b3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:12.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.486+0000 7f01b850b700 1 -- 172.21.15.45:0/2875201124 shutdown_connections 2024-05-10T03:39:12.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.486+0000 7f01b850b700 1 --2- 172.21.15.45:0/2875201124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01b0106080 0x7f01b010d9e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:12.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.486+0000 7f01b850b700 1 --2- 172.21.15.45:0/2875201124 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01b0100e00 0x7f01b0101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:12.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.486+0000 7f01b850b700 1 --2- 172.21.15.45:0/2875201124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01b0105730 0x7f01b0105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:12.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.486+0000 7f01b850b700 1 -- 172.21.15.45:0/2875201124 >> 172.21.15.45:0/2875201124 conn(0x7f01b00fc7a0 msgr2=0x7f01b00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:12.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.486+0000 7f01b850b700 1 -- 172.21.15.45:0/2875201124 shutdown_connections 2024-05-10T03:39:12.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.486+0000 7f01b850b700 1 -- 172.21.15.45:0/2875201124 wait complete. 2024-05-10T03:39:12.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.486+0000 7f01b850b700 1 Processor -- start 2024-05-10T03:39:12.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.487+0000 7f01b850b700 1 -- start start 2024-05-10T03:39:12.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.487+0000 7f01b850b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01b0100e00 0x7f01b01a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:12.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.487+0000 7f01b850b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01b0105730 0x7f01b01a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:12.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.487+0000 7f01b850b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01b0106080 0x7f01b019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:12.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.487+0000 7f01b850b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b019ace0 con 0x7f01b0100e00 2024-05-10T03:39:12.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.487+0000 7f01b850b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b019ae50 con 0x7f01b0105730 2024-05-10T03:39:12.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.487+0000 7f01b850b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b019b010 con 0x7f01b0106080 2024-05-10T03:39:12.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.487+0000 7f01b62a7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01b0100e00 0x7f01b01a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:12.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.487+0000 7f01b62a7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01b0100e00 0x7f01b01a07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40260/0 (socket says 172.21.15.45:40260) 2024-05-10T03:39:12.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.487+0000 7f01b62a7700 1 -- 172.21.15.45:0/2098959502 learned_addr learned my addr 172.21.15.45:0/2098959502 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:12.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.487+0000 7f01b5aa6700 1 --2- 172.21.15.45:0/2098959502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01b0105730 0x7f01b01a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:12.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.487+0000 7f01b6aa8700 1 --2- 172.21.15.45:0/2098959502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01b0106080 0x7f01b019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:12.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.487+0000 7f01b62a7700 1 -- 172.21.15.45:0/2098959502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01b0106080 msgr2=0x7f01b019a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:12.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.488+0000 7f01b62a7700 1 --2- 172.21.15.45:0/2098959502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01b0106080 0x7f01b019a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:12.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.488+0000 7f01b62a7700 1 -- 172.21.15.45:0/2098959502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01b0105730 msgr2=0x7f01b01a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:12.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.488+0000 7f01b62a7700 1 --2- 172.21.15.45:0/2098959502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01b0105730 0x7f01b01a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:12.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.488+0000 7f01b62a7700 1 -- 172.21.15.45:0/2098959502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a8009d00 con 0x7f01b0100e00 2024-05-10T03:39:12.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.488+0000 7f01b6aa8700 1 --2- 172.21.15.45:0/2098959502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01b0106080 0x7f01b019a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:39:12.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.488+0000 7f01b5aa6700 1 --2- 172.21.15.45:0/2098959502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01b0105730 0x7f01b01a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:12.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.488+0000 7f01b62a7700 1 --2- 172.21.15.45:0/2098959502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01b0100e00 0x7f01b01a07b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f01ac00d950 tx=0x7f01ac00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:12.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.488+0000 7f01a77fe700 1 -- 172.21.15.45:0/2098959502 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac009b40 con 0x7f01b0100e00 2024-05-10T03:39:12.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.488+0000 7f01b850b700 1 -- 172.21.15.45:0/2098959502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b019b2f0 con 0x7f01b0100e00 2024-05-10T03:39:12.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.488+0000 7f01a77fe700 1 -- 172.21.15.45:0/2098959502 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f01ac009ca0 con 0x7f01b0100e00 2024-05-10T03:39:12.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.488+0000 7f01a77fe700 1 -- 172.21.15.45:0/2098959502 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac00f6b0 con 0x7f01b0100e00 2024-05-10T03:39:12.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.488+0000 7f01b850b700 1 -- 172.21.15.45:0/2098959502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b01a7780 con 0x7f01b0100e00 2024-05-10T03:39:12.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.489+0000 7f01b850b700 1 -- 172.21.15.45:0/2098959502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f01b01022b0 con 0x7f01b0100e00 2024-05-10T03:39:12.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.492+0000 7f01a77fe700 1 -- 172.21.15.45:0/2098959502 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f01ac010460 con 0x7f01b0100e00 2024-05-10T03:39:12.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.492+0000 7f01a77fe700 1 --2- 172.21.15.45:0/2098959502 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f019c0a11b0 0x7f019c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:12.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.493+0000 7f01a77fe700 1 -- 172.21.15.45:0/2098959502 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f01ac0cd290 con 0x7f01b0100e00 2024-05-10T03:39:12.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.493+0000 7f01b5aa6700 1 --2- 172.21.15.45:0/2098959502 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f019c0a11b0 0x7f019c0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:12.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.493+0000 7f01a77fe700 1 --2- 172.21.15.45:0/2098959502 >> [v2:172.21.15.154:6808/3929679049,v1:172.21.15.154:6809/3929679049] conn(0x7f019c0abd80 0x7f019c0ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:12.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.493+0000 7f01a77fe700 1 -- 172.21.15.45:0/2098959502 --> [v2:172.21.15.154:6808/3929679049,v1:172.21.15.154:6809/3929679049] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f019c0ae8e0 con 0x7f019c0abd80 2024-05-10T03:39:12.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.493+0000 7f01a77fe700 1 -- 172.21.15.45:0/2098959502 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01ac0cd600 con 0x7f01b0100e00 2024-05-10T03:39:12.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.493+0000 7f01b6aa8700 1 --2- 172.21.15.45:0/2098959502 >> [v2:172.21.15.154:6808/3929679049,v1:172.21.15.154:6809/3929679049] conn(0x7f019c0abd80 0x7f019c0ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:12.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.493+0000 7f01b5aa6700 1 --2- 172.21.15.45:0/2098959502 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f019c0a11b0 0x7f019c0a36c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f01a0005e10 tx=0x7f01a0005d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:12.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.494+0000 7f01b6aa8700 1 --2- 172.21.15.45:0/2098959502 >> [v2:172.21.15.154:6808/3929679049,v1:172.21.15.154:6809/3929679049] conn(0x7f019c0abd80 0x7f019c0ae210 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:12.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.494+0000 7f01a77fe700 1 -- 172.21.15.45:0/2098959502 <== osd.5 v2:172.21.15.154:6808/3929679049 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f019c0ae8e0 con 0x7f019c0abd80 2024-05-10T03:39:12.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.513+0000 7f01b850b700 1 -- 172.21.15.45:0/2098959502 --> [v2:172.21.15.154:6808/3929679049,v1:172.21.15.154:6809/3929679049] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f01b00697e0 con 0x7f019c0abd80 2024-05-10T03:39:12.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.514+0000 7f01a77fe700 1 -- 172.21.15.45:0/2098959502 <== osd.5 v2:172.21.15.154:6808/3929679049 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f01b00697e0 con 0x7f019c0abd80 2024-05-10T03:39:12.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.514+0000 7f01b850b700 1 -- 172.21.15.45:0/2098959502 >> [v2:172.21.15.154:6808/3929679049,v1:172.21.15.154:6809/3929679049] conn(0x7f019c0abd80 msgr2=0x7f019c0ae210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:12.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.514+0000 7f01b850b700 1 --2- 172.21.15.45:0/2098959502 >> [v2:172.21.15.154:6808/3929679049,v1:172.21.15.154:6809/3929679049] conn(0x7f019c0abd80 0x7f019c0ae210 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:12.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.514+0000 7f01b850b700 1 -- 172.21.15.45:0/2098959502 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f019c0a11b0 msgr2=0x7f019c0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:12.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.514+0000 7f01b850b700 1 --2- 172.21.15.45:0/2098959502 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f019c0a11b0 0x7f019c0a36c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f01a0005e10 tx=0x7f01a0005d60 comp rx=0 tx=0).stop 2024-05-10T03:39:12.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.514+0000 7f01b850b700 1 -- 172.21.15.45:0/2098959502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01b0100e00 msgr2=0x7f01b01a07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:12.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.514+0000 7f01b850b700 1 --2- 172.21.15.45:0/2098959502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01b0100e00 0x7f01b01a07b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f01ac00d950 tx=0x7f01ac00dd10 comp rx=0 tx=0).stop 2024-05-10T03:39:12.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.514+0000 7f01b6aa8700 1 -- 172.21.15.45:0/2098959502 reap_dead start 2024-05-10T03:39:12.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.514+0000 7f01b850b700 1 -- 172.21.15.45:0/2098959502 shutdown_connections 2024-05-10T03:39:12.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.514+0000 7f01b850b700 1 -- 172.21.15.45:0/2098959502 >> 172.21.15.45:0/2098959502 conn(0x7f01b00fc7a0 msgr2=0x7f01b0103ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:12.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.514+0000 7f01b850b700 1 -- 172.21.15.45:0/2098959502 shutdown_connections 2024-05-10T03:39:12.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:12.514+0000 7f01b850b700 1 -- 172.21.15.45:0/2098959502 wait complete. 2024-05-10T03:39:13.118 INFO:teuthology.orchestra.run.smithi045.stdout:163208757287 2024-05-10T03:39:13.119 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-10T03:39:13.154 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:13 smithi045 ceph-mon[42520]: pgmap v249: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.2 KiB/s wr, 18 op/s 2024-05-10T03:39:13.187 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:13.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:13 smithi106 ceph-mon[46996]: pgmap v249: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.2 KiB/s wr, 18 op/s 2024-05-10T03:39:13.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:13 smithi154 ceph-mon[46565]: pgmap v249: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.2 KiB/s wr, 18 op/s 2024-05-10T03:39:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.946+0000 7f8c660b8700 1 -- 172.21.15.45:0/2396325119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c60100e00 msgr2=0x7f8c60101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.946+0000 7f8c660b8700 1 --2- 172.21.15.45:0/2396325119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c60100e00 0x7f8c60101210 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8c50009990 tx=0x7f8c50009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.946+0000 7f8c660b8700 1 -- 172.21.15.45:0/2396325119 shutdown_connections 2024-05-10T03:39:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.946+0000 7f8c660b8700 1 --2- 172.21.15.45:0/2396325119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c60106080 0x7f8c6010d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.946+0000 7f8c660b8700 1 --2- 172.21.15.45:0/2396325119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c60100e00 0x7f8c60101210 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.946+0000 7f8c660b8700 1 --2- 172.21.15.45:0/2396325119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c60105730 0x7f8c60105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.946+0000 7f8c660b8700 1 -- 172.21.15.45:0/2396325119 >> 172.21.15.45:0/2396325119 conn(0x7f8c600fc7a0 msgr2=0x7f8c600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.946+0000 7f8c660b8700 1 -- 172.21.15.45:0/2396325119 shutdown_connections 2024-05-10T03:39:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.946+0000 7f8c660b8700 1 -- 172.21.15.45:0/2396325119 wait complete. 2024-05-10T03:39:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.947+0000 7f8c660b8700 1 Processor -- start 2024-05-10T03:39:13.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.947+0000 7f8c660b8700 1 -- start start 2024-05-10T03:39:13.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.948+0000 7f8c660b8700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c60100e00 0x7f8c601995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:13.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.948+0000 7f8c660b8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c60105730 0x7f8c60199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:13.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.948+0000 7f8c660b8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c60106080 0x7f8c601a44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:13.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.948+0000 7f8c660b8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6019a2a0 con 0x7f8c60105730 2024-05-10T03:39:13.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.948+0000 7f8c660b8700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c601a49e0 con 0x7f8c60100e00 2024-05-10T03:39:13.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.948+0000 7f8c660b8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c601a4ba0 con 0x7f8c60106080 2024-05-10T03:39:13.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.948+0000 7f8c56ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c60105730 0x7f8c60199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:13.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.948+0000 7f8c56ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c60105730 0x7f8c60199b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40276/0 (socket says 172.21.15.45:40276) 2024-05-10T03:39:13.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.948+0000 7f8c56ffd700 1 -- 172.21.15.45:0/246607779 learned_addr learned my addr 172.21.15.45:0/246607779 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:13.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.948+0000 7f8c5ffff700 1 --2- 172.21.15.45:0/246607779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c60106080 0x7f8c601a44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:13.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.948+0000 7f8c5f7fe700 1 --2- 172.21.15.45:0/246607779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c60100e00 0x7f8c601995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:13.985 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.948+0000 7f8c56ffd700 1 -- 172.21.15.45:0/246607779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c60106080 msgr2=0x7f8c601a44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:13.985 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.948+0000 7f8c56ffd700 1 --2- 172.21.15.45:0/246607779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c60106080 0x7f8c601a44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:13.985 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.948+0000 7f8c56ffd700 1 -- 172.21.15.45:0/246607779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c60100e00 msgr2=0x7f8c601995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:13.985 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.948+0000 7f8c56ffd700 1 --2- 172.21.15.45:0/246607779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c60100e00 0x7f8c601995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:13.985 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.948+0000 7f8c56ffd700 1 -- 172.21.15.45:0/246607779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c500095f0 con 0x7f8c60105730 2024-05-10T03:39:13.985 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.948+0000 7f8c5f7fe700 1 --2- 172.21.15.45:0/246607779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c60100e00 0x7f8c601995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:13.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.948+0000 7f8c56ffd700 1 --2- 172.21.15.45:0/246607779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c60105730 0x7f8c60199b30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800e970 tx=0x7f8c4800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:13.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.949+0000 7f8c5d7fa700 1 -- 172.21.15.45:0/246607779 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c48009790 con 0x7f8c60105730 2024-05-10T03:39:13.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.949+0000 7f8c660b8700 1 -- 172.21.15.45:0/246607779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c601a4e80 con 0x7f8c60105730 2024-05-10T03:39:13.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.949+0000 7f8c5d7fa700 1 -- 172.21.15.45:0/246607779 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8c4800eec0 con 0x7f8c60105730 2024-05-10T03:39:13.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.949+0000 7f8c5d7fa700 1 -- 172.21.15.45:0/246607779 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c48005690 con 0x7f8c60105730 2024-05-10T03:39:13.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.949+0000 7f8c660b8700 1 -- 172.21.15.45:0/246607779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c601a5340 con 0x7f8c60105730 2024-05-10T03:39:13.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.950+0000 7f8c660b8700 1 -- 172.21.15.45:0/246607779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8c601022b0 con 0x7f8c60105730 2024-05-10T03:39:13.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.951+0000 7f8c5d7fa700 1 -- 172.21.15.45:0/246607779 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f8c48004750 con 0x7f8c60105730 2024-05-10T03:39:13.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.952+0000 7f8c5d7fa700 1 --2- 172.21.15.45:0/246607779 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8c4c0a11b0 0x7f8c4c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:13.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.952+0000 7f8c5f7fe700 1 --2- 172.21.15.45:0/246607779 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8c4c0a11b0 0x7f8c4c0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:13.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.952+0000 7f8c5d7fa700 1 -- 172.21.15.45:0/246607779 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8c48014070 con 0x7f8c60105730 2024-05-10T03:39:13.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.952+0000 7f8c5d7fa700 1 --2- 172.21.15.45:0/246607779 >> [v2:172.21.15.45:6810/1188039324,v1:172.21.15.45:6811/1188039324] conn(0x7f8c4c0abd80 0x7f8c4c0ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:13.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.952+0000 7f8c5d7fa700 1 -- 172.21.15.45:0/246607779 --> [v2:172.21.15.45:6810/1188039324,v1:172.21.15.45:6811/1188039324] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c4c0ae8e0 con 0x7f8c4c0abd80 2024-05-10T03:39:13.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.952+0000 7f8c5d7fa700 1 -- 172.21.15.45:0/246607779 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c480cf360 con 0x7f8c60105730 2024-05-10T03:39:13.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.952+0000 7f8c5ffff700 1 --2- 172.21.15.45:0/246607779 >> [v2:172.21.15.45:6810/1188039324,v1:172.21.15.45:6811/1188039324] conn(0x7f8c4c0abd80 0x7f8c4c0ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:13.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.953+0000 7f8c5f7fe700 1 --2- 172.21.15.45:0/246607779 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8c4c0a11b0 0x7f8c4c0a36c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000b2e0 tx=0x7f8c5001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:13.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.953+0000 7f8c5ffff700 1 --2- 172.21.15.45:0/246607779 >> [v2:172.21.15.45:6810/1188039324,v1:172.21.15.45:6811/1188039324] conn(0x7f8c4c0abd80 0x7f8c4c0ae210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:13.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.954+0000 7f8c5d7fa700 1 -- 172.21.15.45:0/246607779 <== osd.3 v2:172.21.15.45:6810/1188039324 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8c4c0ae8e0 con 0x7f8c4c0abd80 2024-05-10T03:39:13.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.970+0000 7f8c660b8700 1 -- 172.21.15.45:0/246607779 --> [v2:172.21.15.45:6810/1188039324,v1:172.21.15.45:6811/1188039324] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8c60061910 con 0x7f8c4c0abd80 2024-05-10T03:39:13.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.971+0000 7f8c5d7fa700 1 -- 172.21.15.45:0/246607779 <== osd.3 v2:172.21.15.45:6810/1188039324 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8c60061910 con 0x7f8c4c0abd80 2024-05-10T03:39:13.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.971+0000 7f8c660b8700 1 -- 172.21.15.45:0/246607779 >> [v2:172.21.15.45:6810/1188039324,v1:172.21.15.45:6811/1188039324] conn(0x7f8c4c0abd80 msgr2=0x7f8c4c0ae210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:13.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.971+0000 7f8c660b8700 1 --2- 172.21.15.45:0/246607779 >> [v2:172.21.15.45:6810/1188039324,v1:172.21.15.45:6811/1188039324] conn(0x7f8c4c0abd80 0x7f8c4c0ae210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:13.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.971+0000 7f8c660b8700 1 -- 172.21.15.45:0/246607779 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8c4c0a11b0 msgr2=0x7f8c4c0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:13.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.971+0000 7f8c660b8700 1 --2- 172.21.15.45:0/246607779 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8c4c0a11b0 0x7f8c4c0a36c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000b2e0 tx=0x7f8c5001a040 comp rx=0 tx=0).stop 2024-05-10T03:39:13.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.971+0000 7f8c660b8700 1 -- 172.21.15.45:0/246607779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c60105730 msgr2=0x7f8c60199b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:13.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.971+0000 7f8c660b8700 1 --2- 172.21.15.45:0/246607779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c60105730 0x7f8c60199b30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800e970 tx=0x7f8c4800ec80 comp rx=0 tx=0).stop 2024-05-10T03:39:13.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.971+0000 7f8c5ffff700 1 -- 172.21.15.45:0/246607779 reap_dead start 2024-05-10T03:39:13.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.971+0000 7f8c660b8700 1 -- 172.21.15.45:0/246607779 shutdown_connections 2024-05-10T03:39:13.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.971+0000 7f8c660b8700 1 -- 172.21.15.45:0/246607779 >> 172.21.15.45:0/246607779 conn(0x7f8c600fc7a0 msgr2=0x7f8c60106fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:13.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.971+0000 7f8c660b8700 1 -- 172.21.15.45:0/246607779 shutdown_connections 2024-05-10T03:39:13.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:13.971+0000 7f8c660b8700 1 -- 172.21.15.45:0/246607779 wait complete. 2024-05-10T03:39:13.992 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:13.997 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:14.422 INFO:teuthology.orchestra.run.smithi045.stdout:107374182446 2024-05-10T03:39:14.422 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-10T03:39:14.597 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:14.646 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:15.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.016+0000 7fb115d37700 1 -- 172.21.15.45:0/1333686275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb110100a60 msgr2=0x7fb110100e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:15.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.016+0000 7fb115d37700 1 --2- 172.21.15.45:0/1333686275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb110100a60 0x7fb110100e70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb100009990 tx=0x7fb100009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:15.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.016+0000 7fb115d37700 1 -- 172.21.15.45:0/1333686275 shutdown_connections 2024-05-10T03:39:15.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.016+0000 7fb115d37700 1 --2- 172.21.15.45:0/1333686275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb11010e610 0x7fb110110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:15.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.016+0000 7fb115d37700 1 --2- 172.21.15.45:0/1333686275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb110100a60 0x7fb110100e70 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:15.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.016+0000 7fb115d37700 1 --2- 172.21.15.45:0/1333686275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1101013b0 0x7fb11010e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:15.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.016+0000 7fb115d37700 1 -- 172.21.15.45:0/1333686275 >> 172.21.15.45:0/1333686275 conn(0x7fb1100fc760 msgr2=0x7fb1100feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:15.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.016+0000 7fb115d37700 1 -- 172.21.15.45:0/1333686275 shutdown_connections 2024-05-10T03:39:15.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.016+0000 7fb115d37700 1 -- 172.21.15.45:0/1333686275 wait complete. 2024-05-10T03:39:15.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.017+0000 7fb115d37700 1 Processor -- start 2024-05-10T03:39:15.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.017+0000 7fb115d37700 1 -- start start 2024-05-10T03:39:15.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.018+0000 7fb115d37700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb110100a60 0x7fb1101a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:15.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.018+0000 7fb115d37700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1101013b0 0x7fb1101a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:15.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.018+0000 7fb115d37700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb11010e610 0x7fb11019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:15.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.018+0000 7fb115d37700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11019abb0 con 0x7fb11010e610 2024-05-10T03:39:15.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.018+0000 7fb115d37700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11019ad20 con 0x7fb110100a60 2024-05-10T03:39:15.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.018+0000 7fb115d37700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11019ae90 con 0x7fb1101013b0 2024-05-10T03:39:15.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.018+0000 7fb10ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb11010e610 0x7fb11019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:15.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.018+0000 7fb10f7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb110100a60 0x7fb1101a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:15.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.018+0000 7fb10ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb11010e610 0x7fb11019a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40302/0 (socket says 172.21.15.45:40302) 2024-05-10T03:39:15.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.018+0000 7fb10ffff700 1 -- 172.21.15.45:0/2613079896 learned_addr learned my addr 172.21.15.45:0/2613079896 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:15.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.018+0000 7fb106ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1101013b0 0x7fb1101a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:15.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.019+0000 7fb10f7fe700 1 -- 172.21.15.45:0/2613079896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1101013b0 msgr2=0x7fb1101a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:15.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.019+0000 7fb10f7fe700 1 --2- 172.21.15.45:0/2613079896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1101013b0 0x7fb1101a0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:15.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.019+0000 7fb10f7fe700 1 -- 172.21.15.45:0/2613079896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb11010e610 msgr2=0x7fb11019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:15.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.019+0000 7fb10f7fe700 1 --2- 172.21.15.45:0/2613079896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb11010e610 0x7fb11019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:15.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.019+0000 7fb10f7fe700 1 -- 172.21.15.45:0/2613079896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1000095f0 con 0x7fb110100a60 2024-05-10T03:39:15.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.019+0000 7fb10ffff700 1 --2- 172.21.15.45:0/2613079896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb11010e610 0x7fb11019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:39:15.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.019+0000 7fb10f7fe700 1 --2- 172.21.15.45:0/2613079896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb110100a60 0x7fb1101a0640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb1000059d0 tx=0x7fb100004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:15.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.019+0000 7fb10d7fa700 1 -- 172.21.15.45:0/2613079896 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10001d070 con 0x7fb110100a60 2024-05-10T03:39:15.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.019+0000 7fb10d7fa700 1 -- 172.21.15.45:0/2613079896 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb100022470 con 0x7fb110100a60 2024-05-10T03:39:15.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.019+0000 7fb115d37700 1 -- 172.21.15.45:0/2613079896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb11019b110 con 0x7fb110100a60 2024-05-10T03:39:15.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.019+0000 7fb10d7fa700 1 -- 172.21.15.45:0/2613079896 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100017650 con 0x7fb110100a60 2024-05-10T03:39:15.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.019+0000 7fb115d37700 1 -- 172.21.15.45:0/2613079896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1101a74d0 con 0x7fb110100a60 2024-05-10T03:39:15.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.020+0000 7fb115d37700 1 -- 172.21.15.45:0/2613079896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb110114180 con 0x7fb110100a60 2024-05-10T03:39:15.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.022+0000 7fb10d7fa700 1 -- 172.21.15.45:0/2613079896 <== mon.2 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb1000225e0 con 0x7fb110100a60 2024-05-10T03:39:15.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.023+0000 7fb10d7fa700 1 --2- 172.21.15.45:0/2613079896 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb0fc0a11b0 0x7fb0fc0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:15.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.023+0000 7fb10d7fa700 1 -- 172.21.15.45:0/2613079896 <== mon.2 v2:172.21.15.106:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fb1000ce8f0 con 0x7fb110100a60 2024-05-10T03:39:15.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.023+0000 7fb106ffd700 1 --2- 172.21.15.45:0/2613079896 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb0fc0a11b0 0x7fb0fc0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:15.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.023+0000 7fb10d7fa700 1 --2- 172.21.15.45:0/2613079896 >> [v2:172.21.15.106:6800/3117600187,v1:172.21.15.106:6801/3117600187] conn(0x7fb0fc0abd80 0x7fb0fc0ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:15.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.023+0000 7fb10d7fa700 1 -- 172.21.15.45:0/2613079896 --> [v2:172.21.15.106:6800/3117600187,v1:172.21.15.106:6801/3117600187] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb0fc0ae8e0 con 0x7fb0fc0abd80 2024-05-10T03:39:15.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.023+0000 7fb10d7fa700 1 -- 172.21.15.45:0/2613079896 <== mon.2 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1000ced00 con 0x7fb110100a60 2024-05-10T03:39:15.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.024+0000 7fb10ffff700 1 --2- 172.21.15.45:0/2613079896 >> [v2:172.21.15.106:6800/3117600187,v1:172.21.15.106:6801/3117600187] conn(0x7fb0fc0abd80 0x7fb0fc0ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:15.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.024+0000 7fb106ffd700 1 --2- 172.21.15.45:0/2613079896 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb0fc0a11b0 0x7fb0fc0a36c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb1100ffb80 tx=0x7fb0f800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:15.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.024+0000 7fb10ffff700 1 --2- 172.21.15.45:0/2613079896 >> [v2:172.21.15.106:6800/3117600187,v1:172.21.15.106:6801/3117600187] conn(0x7fb0fc0abd80 0x7fb0fc0ae210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:15.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.025+0000 7fb10d7fa700 1 -- 172.21.15.45:0/2613079896 <== osd.1 v2:172.21.15.106:6800/3117600187 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb0fc0ae8e0 con 0x7fb0fc0abd80 2024-05-10T03:39:15.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.046+0000 7fb115d37700 1 -- 172.21.15.45:0/2613079896 --> [v2:172.21.15.106:6800/3117600187,v1:172.21.15.106:6801/3117600187] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb110073cc0 con 0x7fb0fc0abd80 2024-05-10T03:39:15.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.047+0000 7fb10d7fa700 1 -- 172.21.15.45:0/2613079896 <== osd.1 v2:172.21.15.106:6800/3117600187 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb110073cc0 con 0x7fb0fc0abd80 2024-05-10T03:39:15.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.047+0000 7fb115d37700 1 -- 172.21.15.45:0/2613079896 >> [v2:172.21.15.106:6800/3117600187,v1:172.21.15.106:6801/3117600187] conn(0x7fb0fc0abd80 msgr2=0x7fb0fc0ae210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:15.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.047+0000 7fb115d37700 1 --2- 172.21.15.45:0/2613079896 >> [v2:172.21.15.106:6800/3117600187,v1:172.21.15.106:6801/3117600187] conn(0x7fb0fc0abd80 0x7fb0fc0ae210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:15.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.047+0000 7fb115d37700 1 -- 172.21.15.45:0/2613079896 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb0fc0a11b0 msgr2=0x7fb0fc0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:15.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.047+0000 7fb115d37700 1 --2- 172.21.15.45:0/2613079896 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb0fc0a11b0 0x7fb0fc0a36c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb1100ffb80 tx=0x7fb0f800b410 comp rx=0 tx=0).stop 2024-05-10T03:39:15.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.047+0000 7fb115d37700 1 -- 172.21.15.45:0/2613079896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb110100a60 msgr2=0x7fb1101a0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:15.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.047+0000 7fb115d37700 1 --2- 172.21.15.45:0/2613079896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb110100a60 0x7fb1101a0640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb1000059d0 tx=0x7fb100004730 comp rx=0 tx=0).stop 2024-05-10T03:39:15.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.047+0000 7fb10ffff700 1 -- 172.21.15.45:0/2613079896 reap_dead start 2024-05-10T03:39:15.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.048+0000 7fb115d37700 1 -- 172.21.15.45:0/2613079896 shutdown_connections 2024-05-10T03:39:15.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.048+0000 7fb115d37700 1 -- 172.21.15.45:0/2613079896 >> 172.21.15.45:0/2613079896 conn(0x7fb1100fc760 msgr2=0x7fb110110010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:15.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.048+0000 7fb115d37700 1 -- 172.21.15.45:0/2613079896 shutdown_connections 2024-05-10T03:39:15.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:15.048+0000 7fb115d37700 1 -- 172.21.15.45:0/2613079896 wait complete. 2024-05-10T03:39:15.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:15 smithi045 ceph-mon[42520]: pgmap v250: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2024-05-10T03:39:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:15 smithi106 ceph-mon[46996]: pgmap v250: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2024-05-10T03:39:15.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:15 smithi154 ceph-mon[46565]: pgmap v250: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2024-05-10T03:39:16.304 INFO:teuthology.orchestra.run.smithi045.stdout:55834574901 2024-05-10T03:39:16.304 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-10T03:39:17.282 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:17 smithi045 ceph-mon[42520]: pgmap v251: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-10T03:39:17.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:17 smithi106 ceph-mon[46996]: pgmap v251: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-10T03:39:17.404 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:17.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.430+0000 7f8569879700 1 -- 172.21.15.45:0/1961633110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8564100a70 msgr2=0x7f8564100e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:17.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.430+0000 7f8569879700 1 --2- 172.21.15.45:0/1961633110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8564100a70 0x7f8564100e80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8554009990 tx=0x7f8554009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:17.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.430+0000 7f8569879700 1 -- 172.21.15.45:0/1961633110 shutdown_connections 2024-05-10T03:39:17.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.430+0000 7f8569879700 1 --2- 172.21.15.45:0/1961633110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f856410e620 0x7f8564110a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:17.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.430+0000 7f8569879700 1 --2- 172.21.15.45:0/1961633110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8564100a70 0x7f8564100e80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:17.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.430+0000 7f8569879700 1 --2- 172.21.15.45:0/1961633110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85641013c0 0x7f856410e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:17.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.430+0000 7f8569879700 1 -- 172.21.15.45:0/1961633110 >> 172.21.15.45:0/1961633110 conn(0x7f8564077740 msgr2=0x7f8564077b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:17.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.431+0000 7f8569879700 1 -- 172.21.15.45:0/1961633110 shutdown_connections 2024-05-10T03:39:17.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.431+0000 7f8569879700 1 -- 172.21.15.45:0/1961633110 wait complete. 2024-05-10T03:39:17.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.431+0000 7f8569879700 1 Processor -- start 2024-05-10T03:39:17.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.432+0000 7f8569879700 1 -- start start 2024-05-10T03:39:17.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.432+0000 7f8569879700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8564100a70 0x7f856419a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:17.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.432+0000 7f8569879700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85641013c0 0x7f856419ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:17.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.432+0000 7f8569879700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f856410e620 0x7f856419f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:17.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.432+0000 7f8569879700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856419f7f0 con 0x7f8564100a70 2024-05-10T03:39:17.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.432+0000 7f8569879700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856419f930 con 0x7f85641013c0 2024-05-10T03:39:17.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.432+0000 7f8569879700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856419faf0 con 0x7f856410e620 2024-05-10T03:39:17.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.432+0000 7f8562ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8564100a70 0x7f856419a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:17.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.432+0000 7f8562ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8564100a70 0x7f856419a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48698/0 (socket says 172.21.15.45:48698) 2024-05-10T03:39:17.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.432+0000 7f8562ffd700 1 -- 172.21.15.45:0/2647074570 learned_addr learned my addr 172.21.15.45:0/2647074570 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:17.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.433+0000 7f85627fc700 1 --2- 172.21.15.45:0/2647074570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85641013c0 0x7f856419ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:17.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.433+0000 7f85637fe700 1 --2- 172.21.15.45:0/2647074570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f856410e620 0x7f856419f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:17.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.433+0000 7f8562ffd700 1 -- 172.21.15.45:0/2647074570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f856410e620 msgr2=0x7f856419f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:17.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.433+0000 7f8562ffd700 1 --2- 172.21.15.45:0/2647074570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f856410e620 0x7f856419f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:17.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.433+0000 7f8562ffd700 1 -- 172.21.15.45:0/2647074570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85641013c0 msgr2=0x7f856419ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:17.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.433+0000 7f8562ffd700 1 --2- 172.21.15.45:0/2647074570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85641013c0 0x7f856419ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:17.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.433+0000 7f8562ffd700 1 -- 172.21.15.45:0/2647074570 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85540095f0 con 0x7f8564100a70 2024-05-10T03:39:17.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.433+0000 7f8562ffd700 1 --2- 172.21.15.45:0/2647074570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8564100a70 0x7f856419a7f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8554005910 tx=0x7f8554004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:17.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.433+0000 7f8568877700 1 -- 172.21.15.45:0/2647074570 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855401d070 con 0x7f8564100a70 2024-05-10T03:39:17.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.433+0000 7f8569879700 1 -- 172.21.15.45:0/2647074570 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856419fd70 con 0x7f8564100a70 2024-05-10T03:39:17.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.433+0000 7f8568877700 1 -- 172.21.15.45:0/2647074570 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8554022470 con 0x7f8564100a70 2024-05-10T03:39:17.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.433+0000 7f8568877700 1 -- 172.21.15.45:0/2647074570 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8554017650 con 0x7f8564100a70 2024-05-10T03:39:17.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.433+0000 7f8569879700 1 -- 172.21.15.45:0/2647074570 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85641a7560 con 0x7f8564100a70 2024-05-10T03:39:17.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.434+0000 7f8569879700 1 -- 172.21.15.45:0/2647074570 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f85641141f0 con 0x7f8564100a70 2024-05-10T03:39:17.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.436+0000 7f8568877700 1 -- 172.21.15.45:0/2647074570 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f85540225e0 con 0x7f8564100a70 2024-05-10T03:39:17.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.437+0000 7f8568877700 1 --2- 172.21.15.45:0/2647074570 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f854c0a11b0 0x7f854c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:17.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.437+0000 7f8568877700 1 -- 172.21.15.45:0/2647074570 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f85540ce290 con 0x7f8564100a70 2024-05-10T03:39:17.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.437+0000 7f85627fc700 1 --2- 172.21.15.45:0/2647074570 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f854c0a11b0 0x7f854c0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:17.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.437+0000 7f8568877700 1 --2- 172.21.15.45:0/2647074570 >> [v2:172.21.15.106:6816/1689864237,v1:172.21.15.106:6817/1689864237] conn(0x7f854c0abd80 0x7f854c0ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:17.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.437+0000 7f8568877700 1 -- 172.21.15.45:0/2647074570 --> [v2:172.21.15.106:6816/1689864237,v1:172.21.15.106:6817/1689864237] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f854c0ae8e0 con 0x7f854c0abd80 2024-05-10T03:39:17.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.437+0000 7f8568877700 1 -- 172.21.15.45:0/2647074570 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85540ce6a0 con 0x7f8564100a70 2024-05-10T03:39:17.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.437+0000 7f85627fc700 1 --2- 172.21.15.45:0/2647074570 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f854c0a11b0 0x7f854c0a36c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8564100010 tx=0x7f8558009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:17.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.438+0000 7f85637fe700 1 --2- 172.21.15.45:0/2647074570 >> [v2:172.21.15.106:6816/1689864237,v1:172.21.15.106:6817/1689864237] conn(0x7f854c0abd80 0x7f854c0ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:17.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.438+0000 7f85637fe700 1 --2- 172.21.15.45:0/2647074570 >> [v2:172.21.15.106:6816/1689864237,v1:172.21.15.106:6817/1689864237] conn(0x7f854c0abd80 0x7f854c0ae210 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:17.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.439+0000 7f8568877700 1 -- 172.21.15.45:0/2647074570 <== osd.7 v2:172.21.15.106:6816/1689864237 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f854c0ae8e0 con 0x7f854c0abd80 2024-05-10T03:39:17.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.456+0000 7f8569879700 1 -- 172.21.15.45:0/2647074570 --> [v2:172.21.15.106:6816/1689864237,v1:172.21.15.106:6817/1689864237] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8564061890 con 0x7f854c0abd80 2024-05-10T03:39:17.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.457+0000 7f8568877700 1 -- 172.21.15.45:0/2647074570 <== osd.7 v2:172.21.15.106:6816/1689864237 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8564061890 con 0x7f854c0abd80 2024-05-10T03:39:17.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.458+0000 7f8569879700 1 -- 172.21.15.45:0/2647074570 >> [v2:172.21.15.106:6816/1689864237,v1:172.21.15.106:6817/1689864237] conn(0x7f854c0abd80 msgr2=0x7f854c0ae210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:17.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.458+0000 7f8569879700 1 --2- 172.21.15.45:0/2647074570 >> [v2:172.21.15.106:6816/1689864237,v1:172.21.15.106:6817/1689864237] conn(0x7f854c0abd80 0x7f854c0ae210 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:17.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.458+0000 7f8569879700 1 -- 172.21.15.45:0/2647074570 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f854c0a11b0 msgr2=0x7f854c0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:17.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.458+0000 7f8569879700 1 --2- 172.21.15.45:0/2647074570 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f854c0a11b0 0x7f854c0a36c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8564100010 tx=0x7f8558009260 comp rx=0 tx=0).stop 2024-05-10T03:39:17.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.458+0000 7f8569879700 1 -- 172.21.15.45:0/2647074570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8564100a70 msgr2=0x7f856419a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:17.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.458+0000 7f8569879700 1 --2- 172.21.15.45:0/2647074570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8564100a70 0x7f856419a7f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8554005910 tx=0x7f8554004730 comp rx=0 tx=0).stop 2024-05-10T03:39:17.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.458+0000 7f85637fe700 1 -- 172.21.15.45:0/2647074570 reap_dead start 2024-05-10T03:39:17.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.458+0000 7f8569879700 1 -- 172.21.15.45:0/2647074570 shutdown_connections 2024-05-10T03:39:17.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.458+0000 7f8569879700 1 -- 172.21.15.45:0/2647074570 >> 172.21.15.45:0/2647074570 conn(0x7f8564077740 msgr2=0x7f856410f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:17.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.458+0000 7f8569879700 1 -- 172.21.15.45:0/2647074570 shutdown_connections 2024-05-10T03:39:17.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.458+0000 7f8569879700 1 -- 172.21.15.45:0/2647074570 wait complete. 2024-05-10T03:39:17.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:17 smithi154 ceph-mon[46565]: pgmap v251: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-10T03:39:17.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.500+0000 7f351df08700 1 -- 172.21.15.45:0/3101620673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3518103740 msgr2=0x7f351810bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:17.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.500+0000 7f351df08700 1 --2- 172.21.15.45:0/3101620673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3518103740 0x7f351810bc90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f350c009990 tx=0x7f350c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:17.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.500+0000 7f351df08700 1 -- 172.21.15.45:0/3101620673 shutdown_connections 2024-05-10T03:39:17.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.500+0000 7f351df08700 1 --2- 172.21.15.45:0/3101620673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3518102df0 0x7f3518103200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:17.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.500+0000 7f351df08700 1 --2- 172.21.15.45:0/3101620673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f351810c260 0x7f351810e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:17.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.500+0000 7f351df08700 1 --2- 172.21.15.45:0/3101620673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3518103740 0x7f351810bc90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:17.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.500+0000 7f351df08700 1 -- 172.21.15.45:0/3101620673 >> 172.21.15.45:0/3101620673 conn(0x7f35180fc7a0 msgr2=0x7f35180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:17.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.500+0000 7f351df08700 1 -- 172.21.15.45:0/3101620673 shutdown_connections 2024-05-10T03:39:17.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.500+0000 7f351df08700 1 -- 172.21.15.45:0/3101620673 wait complete. 2024-05-10T03:39:17.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.501+0000 7f351df08700 1 Processor -- start 2024-05-10T03:39:17.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.501+0000 7f351df08700 1 -- start start 2024-05-10T03:39:17.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.501+0000 7f351df08700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3518102df0 0x7f351819e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:17.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.501+0000 7f351df08700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3518103740 0x7f351819e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:17.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.501+0000 7f351df08700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f351810c260 0x7f35181983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:17.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.501+0000 7f351df08700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35181989c0 con 0x7f351810c260 2024-05-10T03:39:17.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.501+0000 7f351df08700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3518198b30 con 0x7f3518102df0 2024-05-10T03:39:17.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.501+0000 7f351df08700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3518198cf0 con 0x7f3518103740 2024-05-10T03:39:17.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.501+0000 7f3517fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f351810c260 0x7f35181983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:17.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.501+0000 7f3517fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f351810c260 0x7f35181983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48708/0 (socket says 172.21.15.45:48708) 2024-05-10T03:39:17.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.501+0000 7f3517fff700 1 -- 172.21.15.45:0/554221841 learned_addr learned my addr 172.21.15.45:0/554221841 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:17.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.501+0000 7f35177fe700 1 --2- 172.21.15.45:0/554221841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3518102df0 0x7f351819e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:17.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.502+0000 7f3516ffd700 1 --2- 172.21.15.45:0/554221841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3518103740 0x7f351819e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:17.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.502+0000 7f3517fff700 1 -- 172.21.15.45:0/554221841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3518103740 msgr2=0x7f351819e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:17.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.502+0000 7f3517fff700 1 --2- 172.21.15.45:0/554221841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3518103740 0x7f351819e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:17.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.502+0000 7f3517fff700 1 -- 172.21.15.45:0/554221841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3518102df0 msgr2=0x7f351819e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:17.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.502+0000 7f3517fff700 1 --2- 172.21.15.45:0/554221841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3518102df0 0x7f351819e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:17.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.502+0000 7f3517fff700 1 -- 172.21.15.45:0/554221841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c0095f0 con 0x7f351810c260 2024-05-10T03:39:17.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.502+0000 7f3517fff700 1 --2- 172.21.15.45:0/554221841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f351810c260 0x7f35181983f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3510007ee0 tx=0x7f351000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:17.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.502+0000 7f3514ff9700 1 -- 172.21.15.45:0/554221841 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351000ddd0 con 0x7f351810c260 2024-05-10T03:39:17.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.502+0000 7f3514ff9700 1 -- 172.21.15.45:0/554221841 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f351000f040 con 0x7f351810c260 2024-05-10T03:39:17.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.502+0000 7f351df08700 1 -- 172.21.15.45:0/554221841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3518198fd0 con 0x7f351810c260 2024-05-10T03:39:17.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.502+0000 7f3514ff9700 1 -- 172.21.15.45:0/554221841 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3510015400 con 0x7f351810c260 2024-05-10T03:39:17.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.502+0000 7f351df08700 1 -- 172.21.15.45:0/554221841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35181a5460 con 0x7f351810c260 2024-05-10T03:39:17.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.503+0000 7f351df08700 1 -- 172.21.15.45:0/554221841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f351806a1d0 con 0x7f351810c260 2024-05-10T03:39:17.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.505+0000 7f3514ff9700 1 -- 172.21.15.45:0/554221841 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f3510003a00 con 0x7f351810c260 2024-05-10T03:39:17.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.505+0000 7f3514ff9700 1 --2- 172.21.15.45:0/554221841 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f35000a11b0 0x7f35000a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:17.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.506+0000 7f35177fe700 1 --2- 172.21.15.45:0/554221841 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f35000a11b0 0x7f35000a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:17.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.506+0000 7f3514ff9700 1 -- 172.21.15.45:0/554221841 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f35100cd070 con 0x7f351810c260 2024-05-10T03:39:17.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.506+0000 7f3514ff9700 1 --2- 172.21.15.45:0/554221841 >> [v2:172.21.15.106:6808/4186845524,v1:172.21.15.106:6809/4186845524] conn(0x7f35000abd80 0x7f35000ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:17.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.506+0000 7f3514ff9700 1 -- 172.21.15.45:0/554221841 --> [v2:172.21.15.106:6808/4186845524,v1:172.21.15.106:6809/4186845524] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f35000ae8e0 con 0x7f35000abd80 2024-05-10T03:39:17.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.506+0000 7f3514ff9700 1 -- 172.21.15.45:0/554221841 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35100cd480 con 0x7f351810c260 2024-05-10T03:39:17.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.506+0000 7f3516ffd700 1 --2- 172.21.15.45:0/554221841 >> [v2:172.21.15.106:6808/4186845524,v1:172.21.15.106:6809/4186845524] conn(0x7f35000abd80 0x7f35000ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:17.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.506+0000 7f35177fe700 1 --2- 172.21.15.45:0/554221841 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f35000a11b0 0x7f35000a36c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3518199860 tx=0x7f350800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:17.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.507+0000 7f3516ffd700 1 --2- 172.21.15.45:0/554221841 >> [v2:172.21.15.106:6808/4186845524,v1:172.21.15.106:6809/4186845524] conn(0x7f35000abd80 0x7f35000ae210 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:17.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.507+0000 7f3514ff9700 1 -- 172.21.15.45:0/554221841 <== osd.4 v2:172.21.15.106:6808/4186845524 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f35000ae8e0 con 0x7f35000abd80 2024-05-10T03:39:17.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.527+0000 7f351df08700 1 -- 172.21.15.45:0/554221841 --> [v2:172.21.15.106:6808/4186845524,v1:172.21.15.106:6809/4186845524] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f35180618d0 con 0x7f35000abd80 2024-05-10T03:39:17.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.528+0000 7f3514ff9700 1 -- 172.21.15.45:0/554221841 <== osd.4 v2:172.21.15.106:6808/4186845524 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f35180618d0 con 0x7f35000abd80 2024-05-10T03:39:17.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.528+0000 7f351df08700 1 -- 172.21.15.45:0/554221841 >> [v2:172.21.15.106:6808/4186845524,v1:172.21.15.106:6809/4186845524] conn(0x7f35000abd80 msgr2=0x7f35000ae210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:17.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.529+0000 7f351df08700 1 --2- 172.21.15.45:0/554221841 >> [v2:172.21.15.106:6808/4186845524,v1:172.21.15.106:6809/4186845524] conn(0x7f35000abd80 0x7f35000ae210 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:17.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.529+0000 7f351df08700 1 -- 172.21.15.45:0/554221841 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f35000a11b0 msgr2=0x7f35000a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:17.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.529+0000 7f351df08700 1 --2- 172.21.15.45:0/554221841 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f35000a11b0 0x7f35000a36c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3518199860 tx=0x7f350800b410 comp rx=0 tx=0).stop 2024-05-10T03:39:17.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.529+0000 7f351df08700 1 -- 172.21.15.45:0/554221841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f351810c260 msgr2=0x7f35181983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:17.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.529+0000 7f351df08700 1 --2- 172.21.15.45:0/554221841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f351810c260 0x7f35181983f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3510007ee0 tx=0x7f351000d3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:17.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.529+0000 7f3517fff700 1 -- 172.21.15.45:0/554221841 reap_dead start 2024-05-10T03:39:17.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.529+0000 7f351df08700 1 -- 172.21.15.45:0/554221841 shutdown_connections 2024-05-10T03:39:17.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.529+0000 7f351df08700 1 -- 172.21.15.45:0/554221841 >> 172.21.15.45:0/554221841 conn(0x7f35180fc7a0 msgr2=0x7f35180fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:17.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.529+0000 7f351df08700 1 -- 172.21.15.45:0/554221841 shutdown_connections 2024-05-10T03:39:17.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.529+0000 7f351df08700 1 -- 172.21.15.45:0/554221841 wait complete. 2024-05-10T03:39:17.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.696+0000 7f8795c5f700 1 -- 172.21.15.45:0/2645119118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87901071d0 msgr2=0x7f879010eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:17.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.696+0000 7f8795c5f700 1 --2- 172.21.15.45:0/2645119118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87901071d0 0x7f879010eb30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f878800b0a0 tx=0x7f878800b3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:17.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.696+0000 7f8795c5f700 1 -- 172.21.15.45:0/2645119118 shutdown_connections 2024-05-10T03:39:17.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.696+0000 7f8795c5f700 1 --2- 172.21.15.45:0/2645119118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8790101fa0 0x7f87901023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:17.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.696+0000 7f8795c5f700 1 --2- 172.21.15.45:0/2645119118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87901071d0 0x7f879010eb30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:17.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.696+0000 7f8795c5f700 1 --2- 172.21.15.45:0/2645119118 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8790106880 0x7f8790106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:17.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.696+0000 7f8795c5f700 1 -- 172.21.15.45:0/2645119118 >> 172.21.15.45:0/2645119118 conn(0x7f87900778b0 msgr2=0x7f8790077cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:17.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.696+0000 7f8795c5f700 1 -- 172.21.15.45:0/2645119118 shutdown_connections 2024-05-10T03:39:17.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.697+0000 7f8795c5f700 1 -- 172.21.15.45:0/2645119118 wait complete. 2024-05-10T03:39:17.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.698+0000 7f8795c5f700 1 Processor -- start 2024-05-10T03:39:17.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.698+0000 7f8795c5f700 1 -- start start 2024-05-10T03:39:17.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.698+0000 7f8795c5f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8790101fa0 0x7f8790073510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:17.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.698+0000 7f8795c5f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8790106880 0x7f8790073a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.698+0000 7f8795c5f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87901071d0 0x7f87901a68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.698+0000 7f8795c5f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87900742c0 con 0x7f8790101fa0 2024-05-10T03:39:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.698+0000 7f8795c5f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87901a6e00 con 0x7f87901071d0 2024-05-10T03:39:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.698+0000 7f8795c5f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87901a6f40 con 0x7f8790106880 2024-05-10T03:39:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.699+0000 7f878f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8790101fa0 0x7f8790073510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.699+0000 7f878f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8790101fa0 0x7f8790073510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48726/0 (socket says 172.21.15.45:48726) 2024-05-10T03:39:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.699+0000 7f878f7fe700 1 -- 172.21.15.45:0/1813719373 learned_addr learned my addr 172.21.15.45:0/1813719373 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.699+0000 7f878effd700 1 --2- 172.21.15.45:0/1813719373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8790106880 0x7f8790073a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.699+0000 7f878ffff700 1 --2- 172.21.15.45:0/1813719373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87901071d0 0x7f87901a68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.699+0000 7f878effd700 1 -- 172.21.15.45:0/1813719373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87901071d0 msgr2=0x7f87901a68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.699+0000 7f878effd700 1 --2- 172.21.15.45:0/1813719373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87901071d0 0x7f87901a68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.699+0000 7f878effd700 1 -- 172.21.15.45:0/1813719373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8790101fa0 msgr2=0x7f8790073510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.699+0000 7f878effd700 1 --2- 172.21.15.45:0/1813719373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8790101fa0 0x7f8790073510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.699+0000 7f878effd700 1 -- 172.21.15.45:0/1813719373 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8780009520 con 0x7f8790106880 2024-05-10T03:39:17.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.699+0000 7f878ffff700 1 --2- 172.21.15.45:0/1813719373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87901071d0 0x7f87901a68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:17.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.699+0000 7f878effd700 1 --2- 172.21.15.45:0/1813719373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8790106880 0x7f8790073a50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f878400e9c0 tx=0x7f878400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:17.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.700+0000 7f878cff9700 1 -- 172.21.15.45:0/1813719373 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878400cbd0 con 0x7f8790106880 2024-05-10T03:39:17.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.700+0000 7f878cff9700 1 -- 172.21.15.45:0/1813719373 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f878400eeb0 con 0x7f8790106880 2024-05-10T03:39:17.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.700+0000 7f8795c5f700 1 -- 172.21.15.45:0/1813719373 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8788009d00 con 0x7f8790106880 2024-05-10T03:39:17.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.700+0000 7f878cff9700 1 -- 172.21.15.45:0/1813719373 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8784018660 con 0x7f8790106880 2024-05-10T03:39:17.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.700+0000 7f8795c5f700 1 -- 172.21.15.45:0/1813719373 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87901a7540 con 0x7f8790106880 2024-05-10T03:39:17.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.701+0000 7f8795c5f700 1 -- 172.21.15.45:0/1813719373 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8790103400 con 0x7f8790106880 2024-05-10T03:39:17.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.702+0000 7f878cff9700 1 -- 172.21.15.45:0/1813719373 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f8784010430 con 0x7f8790106880 2024-05-10T03:39:17.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.703+0000 7f878cff9700 1 --2- 172.21.15.45:0/1813719373 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f87780a11b0 0x7f87780a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:17.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.704+0000 7f878f7fe700 1 --2- 172.21.15.45:0/1813719373 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f87780a11b0 0x7f87780a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:17.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.704+0000 7f878cff9700 1 -- 172.21.15.45:0/1813719373 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8784014070 con 0x7f8790106880 2024-05-10T03:39:17.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.704+0000 7f878cff9700 1 --2- 172.21.15.45:0/1813719373 >> [v2:172.21.15.45:6818/202946315,v1:172.21.15.45:6819/202946315] conn(0x7f87780abd80 0x7f87780ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:17.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.704+0000 7f878cff9700 1 -- 172.21.15.45:0/1813719373 --> [v2:172.21.15.45:6818/202946315,v1:172.21.15.45:6819/202946315] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f87780ae8e0 con 0x7f87780abd80 2024-05-10T03:39:17.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.704+0000 7f878cff9700 1 -- 172.21.15.45:0/1813719373 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87840d12a0 con 0x7f8790106880 2024-05-10T03:39:17.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.704+0000 7f878f7fe700 1 --2- 172.21.15.45:0/1813719373 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f87780a11b0 0x7f87780a36c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8780009ef0 tx=0x7f8780009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:17.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.704+0000 7f878ffff700 1 --2- 172.21.15.45:0/1813719373 >> [v2:172.21.15.45:6818/202946315,v1:172.21.15.45:6819/202946315] conn(0x7f87780abd80 0x7f87780ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:17.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.704+0000 7f878ffff700 1 --2- 172.21.15.45:0/1813719373 >> [v2:172.21.15.45:6818/202946315,v1:172.21.15.45:6819/202946315] conn(0x7f87780abd80 0x7f87780ae210 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:17.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.706+0000 7f878cff9700 1 -- 172.21.15.45:0/1813719373 <== osd.6 v2:172.21.15.45:6818/202946315 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f87780ae8e0 con 0x7f87780abd80 2024-05-10T03:39:17.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.737+0000 7f8795c5f700 1 -- 172.21.15.45:0/1813719373 --> [v2:172.21.15.45:6818/202946315,v1:172.21.15.45:6819/202946315] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f87900618d0 con 0x7f87780abd80 2024-05-10T03:39:17.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.738+0000 7f878cff9700 1 -- 172.21.15.45:0/1813719373 <== osd.6 v2:172.21.15.45:6818/202946315 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f87900618d0 con 0x7f87780abd80 2024-05-10T03:39:17.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.738+0000 7f8795c5f700 1 -- 172.21.15.45:0/1813719373 >> [v2:172.21.15.45:6818/202946315,v1:172.21.15.45:6819/202946315] conn(0x7f87780abd80 msgr2=0x7f87780ae210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:17.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.738+0000 7f8795c5f700 1 --2- 172.21.15.45:0/1813719373 >> [v2:172.21.15.45:6818/202946315,v1:172.21.15.45:6819/202946315] conn(0x7f87780abd80 0x7f87780ae210 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:17.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.738+0000 7f8795c5f700 1 -- 172.21.15.45:0/1813719373 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f87780a11b0 msgr2=0x7f87780a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:17.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.738+0000 7f8795c5f700 1 --2- 172.21.15.45:0/1813719373 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f87780a11b0 0x7f87780a36c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8780009ef0 tx=0x7f8780009260 comp rx=0 tx=0).stop 2024-05-10T03:39:17.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.738+0000 7f8795c5f700 1 -- 172.21.15.45:0/1813719373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8790106880 msgr2=0x7f8790073a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:17.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.738+0000 7f8795c5f700 1 --2- 172.21.15.45:0/1813719373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8790106880 0x7f8790073a50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f878400e9c0 tx=0x7f878400ecd0 comp rx=0 tx=0).stop 2024-05-10T03:39:17.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.738+0000 7f878ffff700 1 -- 172.21.15.45:0/1813719373 reap_dead start 2024-05-10T03:39:17.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.738+0000 7f8795c5f700 1 -- 172.21.15.45:0/1813719373 shutdown_connections 2024-05-10T03:39:17.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.738+0000 7f8795c5f700 1 -- 172.21.15.45:0/1813719373 >> 172.21.15.45:0/1813719373 conn(0x7f87900778b0 msgr2=0x7f87900ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:17.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.739+0000 7f8795c5f700 1 -- 172.21.15.45:0/1813719373 shutdown_connections 2024-05-10T03:39:17.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.739+0000 7f8795c5f700 1 -- 172.21.15.45:0/1813719373 wait complete. 2024-05-10T03:39:17.763 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:17.838 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:18.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.837+0000 7fb5c363d700 1 -- 172.21.15.45:0/286356052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5bc1071c0 msgr2=0x7fb5bc10eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:18.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.837+0000 7fb5c363d700 1 --2- 172.21.15.45:0/286356052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5bc1071c0 0x7fb5bc10eb20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb5b400b0a0 tx=0x7fb5b400b3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:18.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.837+0000 7fb5c363d700 1 -- 172.21.15.45:0/286356052 shutdown_connections 2024-05-10T03:39:18.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.837+0000 7fb5c363d700 1 --2- 172.21.15.45:0/286356052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5bc1071c0 0x7fb5bc10eb20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:18.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.837+0000 7fb5c363d700 1 --2- 172.21.15.45:0/286356052 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5bc101f40 0x7fb5bc102350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:18.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.837+0000 7fb5c363d700 1 --2- 172.21.15.45:0/286356052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5bc106870 0x7fb5bc106c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:18.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.837+0000 7fb5c363d700 1 -- 172.21.15.45:0/286356052 >> 172.21.15.45:0/286356052 conn(0x7fb5bc0fd850 msgr2=0x7fb5bc0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:18.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.837+0000 7fb5c363d700 1 -- 172.21.15.45:0/286356052 shutdown_connections 2024-05-10T03:39:18.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.837+0000 7fb5c363d700 1 -- 172.21.15.45:0/286356052 wait complete. 2024-05-10T03:39:18.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.839+0000 7fb5c363d700 1 Processor -- start 2024-05-10T03:39:18.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.839+0000 7fb5c363d700 1 -- start start 2024-05-10T03:39:18.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.839+0000 7fb5c363d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5bc101f40 0x7fb5bc19e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:18.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.839+0000 7fb5c363d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5bc106870 0x7fb5bc19eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:18.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.839+0000 7fb5c363d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5bc1071c0 0x7fb5bc198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:18.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.839+0000 7fb5c363d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc198ad0 con 0x7fb5bc101f40 2024-05-10T03:39:18.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.839+0000 7fb5c363d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc198c40 con 0x7fb5bc106870 2024-05-10T03:39:18.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.839+0000 7fb5c363d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc198e00 con 0x7fb5bc1071c0 2024-05-10T03:39:18.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.839+0000 7fb5c13d9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5bc101f40 0x7fb5bc19e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:18.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.839+0000 7fb5c13d9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5bc101f40 0x7fb5bc19e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48752/0 (socket says 172.21.15.45:48752) 2024-05-10T03:39:18.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.839+0000 7fb5c13d9700 1 -- 172.21.15.45:0/1449038215 learned_addr learned my addr 172.21.15.45:0/1449038215 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:18.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.840+0000 7fb5c1bda700 1 --2- 172.21.15.45:0/1449038215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5bc1071c0 0x7fb5bc198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:18.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.840+0000 7fb5c0bd8700 1 --2- 172.21.15.45:0/1449038215 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5bc106870 0x7fb5bc19eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:18.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.840+0000 7fb5c13d9700 1 -- 172.21.15.45:0/1449038215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5bc1071c0 msgr2=0x7fb5bc198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:18.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.840+0000 7fb5c13d9700 1 --2- 172.21.15.45:0/1449038215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5bc1071c0 0x7fb5bc198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:18.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.840+0000 7fb5c13d9700 1 -- 172.21.15.45:0/1449038215 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5bc106870 msgr2=0x7fb5bc19eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:18.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.840+0000 7fb5c13d9700 1 --2- 172.21.15.45:0/1449038215 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5bc106870 0x7fb5bc19eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:18.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.840+0000 7fb5c13d9700 1 -- 172.21.15.45:0/1449038215 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b4009d00 con 0x7fb5bc101f40 2024-05-10T03:39:18.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.840+0000 7fb5c13d9700 1 --2- 172.21.15.45:0/1449038215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5bc101f40 0x7fb5bc19e5a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800d950 tx=0x7fb5b800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:18.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.840+0000 7fb5b27fc700 1 -- 172.21.15.45:0/1449038215 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8009b40 con 0x7fb5bc101f40 2024-05-10T03:39:18.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.840+0000 7fb5c363d700 1 -- 172.21.15.45:0/1449038215 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5bc1990e0 con 0x7fb5bc101f40 2024-05-10T03:39:18.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.840+0000 7fb5b27fc700 1 -- 172.21.15.45:0/1449038215 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb5b8009ca0 con 0x7fb5bc101f40 2024-05-10T03:39:18.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.840+0000 7fb5b27fc700 1 -- 172.21.15.45:0/1449038215 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b800f6b0 con 0x7fb5bc101f40 2024-05-10T03:39:18.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.840+0000 7fb5c363d700 1 -- 172.21.15.45:0/1449038215 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5bc1a5570 con 0x7fb5bc101f40 2024-05-10T03:39:18.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.841+0000 7fb5c363d700 1 -- 172.21.15.45:0/1449038215 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb5bc1033f0 con 0x7fb5bc101f40 2024-05-10T03:39:18.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.843+0000 7fb5b27fc700 1 -- 172.21.15.45:0/1449038215 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb5b8010460 con 0x7fb5bc101f40 2024-05-10T03:39:18.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.844+0000 7fb5b27fc700 1 --2- 172.21.15.45:0/1449038215 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb5a80a11b0 0x7fb5a80a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:18.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.844+0000 7fb5c0bd8700 1 --2- 172.21.15.45:0/1449038215 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb5a80a11b0 0x7fb5a80a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:18.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.844+0000 7fb5b27fc700 1 -- 172.21.15.45:0/1449038215 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fb5b80cd290 con 0x7fb5bc101f40 2024-05-10T03:39:18.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.844+0000 7fb5b27fc700 1 --2- 172.21.15.45:0/1449038215 >> [v2:172.21.15.106:6824/2680590999,v1:172.21.15.106:6825/2680590999] conn(0x7fb5a80abd80 0x7fb5a80ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:18.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.844+0000 7fb5b27fc700 1 -- 172.21.15.45:0/1449038215 --> [v2:172.21.15.106:6824/2680590999,v1:172.21.15.106:6825/2680590999] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb5a80ae8e0 con 0x7fb5a80abd80 2024-05-10T03:39:18.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.844+0000 7fb5b27fc700 1 -- 172.21.15.45:0/1449038215 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5b80cd600 con 0x7fb5bc101f40 2024-05-10T03:39:18.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.844+0000 7fb5c0bd8700 1 --2- 172.21.15.45:0/1449038215 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb5a80a11b0 0x7fb5a80a36c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc199e70 tx=0x7fb5ac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:18.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.845+0000 7fb5c1bda700 1 --2- 172.21.15.45:0/1449038215 >> [v2:172.21.15.106:6824/2680590999,v1:172.21.15.106:6825/2680590999] conn(0x7fb5a80abd80 0x7fb5a80ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:18.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.845+0000 7fb5c1bda700 1 --2- 172.21.15.45:0/1449038215 >> [v2:172.21.15.106:6824/2680590999,v1:172.21.15.106:6825/2680590999] conn(0x7fb5a80abd80 0x7fb5a80ae210 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:18.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.846+0000 7fb5b27fc700 1 -- 172.21.15.45:0/1449038215 <== osd.10 v2:172.21.15.106:6824/2680590999 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb5a80ae8e0 con 0x7fb5a80abd80 2024-05-10T03:39:18.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.864+0000 7fb5c363d700 1 -- 172.21.15.45:0/1449038215 --> [v2:172.21.15.106:6824/2680590999,v1:172.21.15.106:6825/2680590999] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb5bc061890 con 0x7fb5a80abd80 2024-05-10T03:39:18.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.865+0000 7fb5b27fc700 1 -- 172.21.15.45:0/1449038215 <== osd.10 v2:172.21.15.106:6824/2680590999 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb5bc061890 con 0x7fb5a80abd80 2024-05-10T03:39:18.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.865+0000 7fb5c363d700 1 -- 172.21.15.45:0/1449038215 >> [v2:172.21.15.106:6824/2680590999,v1:172.21.15.106:6825/2680590999] conn(0x7fb5a80abd80 msgr2=0x7fb5a80ae210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:18.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.865+0000 7fb5c363d700 1 --2- 172.21.15.45:0/1449038215 >> [v2:172.21.15.106:6824/2680590999,v1:172.21.15.106:6825/2680590999] conn(0x7fb5a80abd80 0x7fb5a80ae210 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:18.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.865+0000 7fb5c363d700 1 -- 172.21.15.45:0/1449038215 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb5a80a11b0 msgr2=0x7fb5a80a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:18.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.865+0000 7fb5c363d700 1 --2- 172.21.15.45:0/1449038215 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb5a80a11b0 0x7fb5a80a36c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc199e70 tx=0x7fb5ac009260 comp rx=0 tx=0).stop 2024-05-10T03:39:18.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.865+0000 7fb5c363d700 1 -- 172.21.15.45:0/1449038215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5bc101f40 msgr2=0x7fb5bc19e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:18.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.865+0000 7fb5c363d700 1 --2- 172.21.15.45:0/1449038215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5bc101f40 0x7fb5bc19e5a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800d950 tx=0x7fb5b800dd10 comp rx=0 tx=0).stop 2024-05-10T03:39:18.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.865+0000 7fb5c1bda700 1 -- 172.21.15.45:0/1449038215 reap_dead start 2024-05-10T03:39:18.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.865+0000 7fb5c363d700 1 -- 172.21.15.45:0/1449038215 shutdown_connections 2024-05-10T03:39:18.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.865+0000 7fb5c363d700 1 -- 172.21.15.45:0/1449038215 >> 172.21.15.45:0/1449038215 conn(0x7fb5bc0fd850 msgr2=0x7fb5bc104950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:18.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.866+0000 7fb5c363d700 1 -- 172.21.15.45:0/1449038215 shutdown_connections 2024-05-10T03:39:18.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:17.866+0000 7fb5c363d700 1 -- 172.21.15.45:0/1449038215 wait complete. 2024-05-10T03:39:18.689 INFO:teuthology.orchestra.run.smithi045.stdout:141733920811 2024-05-10T03:39:18.689 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-10T03:39:18.881 INFO:teuthology.orchestra.run.smithi045.stdout:193273528355 2024-05-10T03:39:18.882 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-05-10T03:39:18.925 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:18.971 INFO:teuthology.orchestra.run.smithi045.stdout:214748364833 2024-05-10T03:39:18.971 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-05-10T03:39:19.076 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:19.166 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:19 smithi045 ceph-mon[42520]: pgmap v252: 129 pgs: 129 active+clean; 643 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-10T03:39:19.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:19 smithi106 ceph-mon[46996]: pgmap v252: 129 pgs: 129 active+clean; 643 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-10T03:39:19.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:19 smithi154 ceph-mon[46565]: pgmap v252: 129 pgs: 129 active+clean; 643 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-10T03:39:19.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.479+0000 7ff4627b6700 1 -- 172.21.15.45:0/1644894078 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff45c10c260 msgr2=0x7ff45c10e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:19.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.479+0000 7ff4627b6700 1 --2- 172.21.15.45:0/1644894078 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff45c10c260 0x7ff45c10e770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff45400b0a0 tx=0x7ff45400b3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:19.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.479+0000 7ff4627b6700 1 -- 172.21.15.45:0/1644894078 shutdown_connections 2024-05-10T03:39:19.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.479+0000 7ff4627b6700 1 --2- 172.21.15.45:0/1644894078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff45c102df0 0x7ff45c103200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:19.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.479+0000 7ff4627b6700 1 --2- 172.21.15.45:0/1644894078 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff45c10c260 0x7ff45c10e770 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:19.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.479+0000 7ff4627b6700 1 --2- 172.21.15.45:0/1644894078 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff45c103740 0x7ff45c10bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:19.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.479+0000 7ff4627b6700 1 -- 172.21.15.45:0/1644894078 >> 172.21.15.45:0/1644894078 conn(0x7ff45c0fc7a0 msgr2=0x7ff45c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:19.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.479+0000 7ff4627b6700 1 -- 172.21.15.45:0/1644894078 shutdown_connections 2024-05-10T03:39:19.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.479+0000 7ff4627b6700 1 -- 172.21.15.45:0/1644894078 wait complete. 2024-05-10T03:39:19.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.480+0000 7ff4627b6700 1 Processor -- start 2024-05-10T03:39:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.480+0000 7ff4627b6700 1 -- start start 2024-05-10T03:39:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.481+0000 7ff4627b6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff45c102df0 0x7ff45c19e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.481+0000 7ff4627b6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff45c103740 0x7ff45c19ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.481+0000 7ff4627b6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff45c10c260 0x7ff45c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.481+0000 7ff4627b6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c198b30 con 0x7ff45c102df0 2024-05-10T03:39:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.481+0000 7ff4627b6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c198ca0 con 0x7ff45c103740 2024-05-10T03:39:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.481+0000 7ff4627b6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c198e60 con 0x7ff45c10c260 2024-05-10T03:39:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.481+0000 7ff45bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff45c102df0 0x7ff45c19e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.481+0000 7ff45bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff45c102df0 0x7ff45c19e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48770/0 (socket says 172.21.15.45:48770) 2024-05-10T03:39:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.481+0000 7ff45bfff700 1 -- 172.21.15.45:0/372363975 learned_addr learned my addr 172.21.15.45:0/372363975 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.481+0000 7ff45b7fe700 1 --2- 172.21.15.45:0/372363975 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff45c103740 0x7ff45c19ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.481+0000 7ff460d53700 1 --2- 172.21.15.45:0/372363975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff45c10c260 0x7ff45c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.481+0000 7ff45bfff700 1 -- 172.21.15.45:0/372363975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff45c10c260 msgr2=0x7ff45c198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:19.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.481+0000 7ff45bfff700 1 --2- 172.21.15.45:0/372363975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff45c10c260 0x7ff45c198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:19.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.481+0000 7ff45bfff700 1 -- 172.21.15.45:0/372363975 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff45c103740 msgr2=0x7ff45c19ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:19.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.481+0000 7ff45bfff700 1 --2- 172.21.15.45:0/372363975 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff45c103740 0x7ff45c19ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:19.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.481+0000 7ff45bfff700 1 -- 172.21.15.45:0/372363975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff454009d00 con 0x7ff45c102df0 2024-05-10T03:39:19.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.482+0000 7ff45bfff700 1 --2- 172.21.15.45:0/372363975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff45c102df0 0x7ff45c19e570 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00e970 tx=0x7ff44c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:19.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.482+0000 7ff4597fa700 1 -- 172.21.15.45:0/372363975 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c009790 con 0x7ff45c102df0 2024-05-10T03:39:19.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.482+0000 7ff4627b6700 1 -- 172.21.15.45:0/372363975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45c199140 con 0x7ff45c102df0 2024-05-10T03:39:19.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.482+0000 7ff4597fa700 1 -- 172.21.15.45:0/372363975 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff44c00eec0 con 0x7ff45c102df0 2024-05-10T03:39:19.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.482+0000 7ff4597fa700 1 -- 172.21.15.45:0/372363975 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c003d40 con 0x7ff45c102df0 2024-05-10T03:39:19.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.482+0000 7ff4627b6700 1 -- 172.21.15.45:0/372363975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45c1a55a0 con 0x7ff45c102df0 2024-05-10T03:39:19.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.483+0000 7ff4627b6700 1 -- 172.21.15.45:0/372363975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff45c111ff0 con 0x7ff45c102df0 2024-05-10T03:39:19.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.485+0000 7ff4597fa700 1 -- 172.21.15.45:0/372363975 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ff44c003f60 con 0x7ff45c102df0 2024-05-10T03:39:19.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.485+0000 7ff4597fa700 1 --2- 172.21.15.45:0/372363975 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4440a11b0 0x7ff4440a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:19.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.486+0000 7ff45b7fe700 1 --2- 172.21.15.45:0/372363975 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4440a11b0 0x7ff4440a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:19.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.486+0000 7ff4597fa700 1 -- 172.21.15.45:0/372363975 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ff44c014070 con 0x7ff45c102df0 2024-05-10T03:39:19.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.486+0000 7ff4597fa700 1 --2- 172.21.15.45:0/372363975 >> [v2:172.21.15.154:6800/2777220958,v1:172.21.15.154:6801/2777220958] conn(0x7ff4440abd80 0x7ff4440ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:19.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.486+0000 7ff4597fa700 1 -- 172.21.15.45:0/372363975 --> [v2:172.21.15.154:6800/2777220958,v1:172.21.15.154:6801/2777220958] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff4440ae8e0 con 0x7ff4440abd80 2024-05-10T03:39:19.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.486+0000 7ff4597fa700 1 -- 172.21.15.45:0/372363975 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff44c0d2320 con 0x7ff45c102df0 2024-05-10T03:39:19.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.486+0000 7ff45b7fe700 1 --2- 172.21.15.45:0/372363975 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4440a11b0 0x7ff4440a36c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0ffc40 tx=0x7ff4500073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:19.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.486+0000 7ff460d53700 1 --2- 172.21.15.45:0/372363975 >> [v2:172.21.15.154:6800/2777220958,v1:172.21.15.154:6801/2777220958] conn(0x7ff4440abd80 0x7ff4440ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:19.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.487+0000 7ff460d53700 1 --2- 172.21.15.45:0/372363975 >> [v2:172.21.15.154:6800/2777220958,v1:172.21.15.154:6801/2777220958] conn(0x7ff4440abd80 0x7ff4440ae210 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:19.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.487+0000 7ff4597fa700 1 -- 172.21.15.45:0/372363975 <== osd.2 v2:172.21.15.154:6800/2777220958 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff4440ae8e0 con 0x7ff4440abd80 2024-05-10T03:39:19.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.505+0000 7ff4627b6700 1 -- 172.21.15.45:0/372363975 --> [v2:172.21.15.154:6800/2777220958,v1:172.21.15.154:6801/2777220958] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff45c0fd6a0 con 0x7ff4440abd80 2024-05-10T03:39:19.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.506+0000 7ff4597fa700 1 -- 172.21.15.45:0/372363975 <== osd.2 v2:172.21.15.154:6800/2777220958 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff45c0fd6a0 con 0x7ff4440abd80 2024-05-10T03:39:19.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.506+0000 7ff4627b6700 1 -- 172.21.15.45:0/372363975 >> [v2:172.21.15.154:6800/2777220958,v1:172.21.15.154:6801/2777220958] conn(0x7ff4440abd80 msgr2=0x7ff4440ae210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:19.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.506+0000 7ff4627b6700 1 --2- 172.21.15.45:0/372363975 >> [v2:172.21.15.154:6800/2777220958,v1:172.21.15.154:6801/2777220958] conn(0x7ff4440abd80 0x7ff4440ae210 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:19.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.506+0000 7ff4627b6700 1 -- 172.21.15.45:0/372363975 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4440a11b0 msgr2=0x7ff4440a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:19.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.506+0000 7ff4627b6700 1 --2- 172.21.15.45:0/372363975 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4440a11b0 0x7ff4440a36c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0ffc40 tx=0x7ff4500073d0 comp rx=0 tx=0).stop 2024-05-10T03:39:19.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.506+0000 7ff4627b6700 1 -- 172.21.15.45:0/372363975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff45c102df0 msgr2=0x7ff45c19e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:19.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.506+0000 7ff4627b6700 1 --2- 172.21.15.45:0/372363975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff45c102df0 0x7ff45c19e570 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00e970 tx=0x7ff44c00ec80 comp rx=0 tx=0).stop 2024-05-10T03:39:19.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.506+0000 7ff460d53700 1 -- 172.21.15.45:0/372363975 reap_dead start 2024-05-10T03:39:19.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.506+0000 7ff4627b6700 1 -- 172.21.15.45:0/372363975 shutdown_connections 2024-05-10T03:39:19.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.506+0000 7ff4627b6700 1 -- 172.21.15.45:0/372363975 >> 172.21.15.45:0/372363975 conn(0x7ff45c0fc7a0 msgr2=0x7ff45c0fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:19.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.506+0000 7ff4627b6700 1 -- 172.21.15.45:0/372363975 shutdown_connections 2024-05-10T03:39:19.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:19.506+0000 7ff4627b6700 1 -- 172.21.15.45:0/372363975 wait complete. 2024-05-10T03:39:20.072 INFO:teuthology.orchestra.run.smithi045.stdout:77309411380 2024-05-10T03:39:20.072 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-10T03:39:20.391 INFO:teuthology.orchestra.run.smithi045.stdout:296352743446 2024-05-10T03:39:20.391 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-05-10T03:39:21.050 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:21.363 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:21 smithi045 ceph-mon[42520]: pgmap v253: 129 pgs: 129 active+clean; 643 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-10T03:39:21.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:21 smithi106 ceph-mon[46996]: pgmap v253: 129 pgs: 129 active+clean; 643 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-10T03:39:21.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:21 smithi154 ceph-mon[46565]: pgmap v253: 129 pgs: 129 active+clean; 643 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-10T03:39:21.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.840+0000 7f7fa3756700 1 -- 172.21.15.45:0/1155004003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f9c102da0 msgr2=0x7f7f9c1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:21.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.840+0000 7f7fa3756700 1 --2- 172.21.15.45:0/1155004003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f9c102da0 0x7f7f9c1031b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009990 tx=0x7f7f98009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.840+0000 7f7fa3756700 1 -- 172.21.15.45:0/1155004003 shutdown_connections 2024-05-10T03:39:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.840+0000 7f7fa3756700 1 --2- 172.21.15.45:0/1155004003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f9c10c210 0x7f7f9c10e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.840+0000 7f7fa3756700 1 --2- 172.21.15.45:0/1155004003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f9c102da0 0x7f7f9c1031b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.840+0000 7f7fa3756700 1 --2- 172.21.15.45:0/1155004003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f9c1036f0 0x7f7f9c10bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.840+0000 7f7fa3756700 1 -- 172.21.15.45:0/1155004003 >> 172.21.15.45:0/1155004003 conn(0x7f7f9c0fc7a0 msgr2=0x7f7f9c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.840+0000 7f7fa3756700 1 -- 172.21.15.45:0/1155004003 shutdown_connections 2024-05-10T03:39:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.840+0000 7f7fa3756700 1 -- 172.21.15.45:0/1155004003 wait complete. 2024-05-10T03:39:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.841+0000 7f7fa3756700 1 Processor -- start 2024-05-10T03:39:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.841+0000 7f7fa3756700 1 -- start start 2024-05-10T03:39:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.841+0000 7f7fa3756700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f9c102da0 0x7f7f9c19e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.841+0000 7f7fa3756700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f9c1036f0 0x7f7f9c19e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.842+0000 7f7fa3756700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f9c10c210 0x7f7f9c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.842+0000 7f7fa3756700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9c1989b0 con 0x7f7f9c10c210 2024-05-10T03:39:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.842+0000 7f7fa3756700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9c198b20 con 0x7f7f9c1036f0 2024-05-10T03:39:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.842+0000 7f7fa3756700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9c198ce0 con 0x7f7f9c102da0 2024-05-10T03:39:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.842+0000 7f7fa1cf3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f9c10c210 0x7f7f9c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.842+0000 7f7fa0cf1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f9c1036f0 0x7f7f9c19e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.842+0000 7f7fa1cf3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f9c10c210 0x7f7f9c1983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48788/0 (socket says 172.21.15.45:48788) 2024-05-10T03:39:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.842+0000 7f7fa1cf3700 1 -- 172.21.15.45:0/1050738613 learned_addr learned my addr 172.21.15.45:0/1050738613 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.842+0000 7f7fa14f2700 1 --2- 172.21.15.45:0/1050738613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f9c102da0 0x7f7f9c19e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.842+0000 7f7fa1cf3700 1 -- 172.21.15.45:0/1050738613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f9c102da0 msgr2=0x7f7f9c19e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.842+0000 7f7fa1cf3700 1 --2- 172.21.15.45:0/1050738613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f9c102da0 0x7f7f9c19e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.842+0000 7f7fa1cf3700 1 -- 172.21.15.45:0/1050738613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f9c1036f0 msgr2=0x7f7f9c19e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.842+0000 7f7fa1cf3700 1 --2- 172.21.15.45:0/1050738613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f9c1036f0 0x7f7f9c19e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.842+0000 7f7fa1cf3700 1 -- 172.21.15.45:0/1050738613 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f980095f0 con 0x7f7f9c10c210 2024-05-10T03:39:21.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.842+0000 7f7fa1cf3700 1 --2- 172.21.15.45:0/1050738613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f9c10c210 0x7f7f9c1983e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7f94007ee0 tx=0x7f7f9400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:21.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.843+0000 7f7f927fc700 1 -- 172.21.15.45:0/1050738613 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f94017070 con 0x7f7f9c10c210 2024-05-10T03:39:21.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.843+0000 7f7fa3756700 1 -- 172.21.15.45:0/1050738613 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f9c198fc0 con 0x7f7f9c10c210 2024-05-10T03:39:21.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.843+0000 7f7f927fc700 1 -- 172.21.15.45:0/1050738613 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7f9400f040 con 0x7f7f9c10c210 2024-05-10T03:39:21.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.843+0000 7f7f927fc700 1 -- 172.21.15.45:0/1050738613 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f94005610 con 0x7f7f9c10c210 2024-05-10T03:39:21.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.843+0000 7f7fa3756700 1 -- 172.21.15.45:0/1050738613 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f9c1a5450 con 0x7f7f9c10c210 2024-05-10T03:39:21.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.843+0000 7f7fa3756700 1 -- 172.21.15.45:0/1050738613 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7f9c069600 con 0x7f7f9c10c210 2024-05-10T03:39:21.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.845+0000 7f7f927fc700 1 -- 172.21.15.45:0/1050738613 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f7f94005770 con 0x7f7f9c10c210 2024-05-10T03:39:21.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.846+0000 7f7f927fc700 1 --2- 172.21.15.45:0/1050738613 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7f880a11b0 0x7f7f880a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:21.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.846+0000 7f7fa14f2700 1 --2- 172.21.15.45:0/1050738613 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7f880a11b0 0x7f7f880a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:21.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.846+0000 7f7f927fc700 1 -- 172.21.15.45:0/1050738613 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f7f940cca30 con 0x7f7f9c10c210 2024-05-10T03:39:21.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.846+0000 7f7f927fc700 1 --2- 172.21.15.45:0/1050738613 >> [v2:172.21.15.45:6802/2233620683,v1:172.21.15.45:6803/2233620683] conn(0x7f7f880abd80 0x7f7f880ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:21.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.846+0000 7f7f927fc700 1 -- 172.21.15.45:0/1050738613 --> [v2:172.21.15.45:6802/2233620683,v1:172.21.15.45:6803/2233620683] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f880ae8e0 con 0x7f7f880abd80 2024-05-10T03:39:21.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.846+0000 7f7f927fc700 1 -- 172.21.15.45:0/1050738613 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f940cce40 con 0x7f7f9c10c210 2024-05-10T03:39:21.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.846+0000 7f7fa0cf1700 1 --2- 172.21.15.45:0/1050738613 >> [v2:172.21.15.45:6802/2233620683,v1:172.21.15.45:6803/2233620683] conn(0x7f7f880abd80 0x7f7f880ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:21.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.847+0000 7f7fa14f2700 1 --2- 172.21.15.45:0/1050738613 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7f880a11b0 0x7f7f880a36c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7f98006010 tx=0x7f7f9801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:21.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.847+0000 7f7fa0cf1700 1 --2- 172.21.15.45:0/1050738613 >> [v2:172.21.15.45:6802/2233620683,v1:172.21.15.45:6803/2233620683] conn(0x7f7f880abd80 0x7f7f880ae210 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:21.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.848+0000 7f7f927fc700 1 -- 172.21.15.45:0/1050738613 <== osd.0 v2:172.21.15.45:6802/2233620683 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f7f880ae8e0 con 0x7f7f880abd80 2024-05-10T03:39:21.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.864+0000 7f7fa3756700 1 -- 172.21.15.45:0/1050738613 --> [v2:172.21.15.45:6802/2233620683,v1:172.21.15.45:6803/2233620683] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7f9c061890 con 0x7f7f880abd80 2024-05-10T03:39:21.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.865+0000 7f7f927fc700 1 -- 172.21.15.45:0/1050738613 <== osd.0 v2:172.21.15.45:6802/2233620683 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7f9c061890 con 0x7f7f880abd80 2024-05-10T03:39:21.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.865+0000 7f7fa3756700 1 -- 172.21.15.45:0/1050738613 >> [v2:172.21.15.45:6802/2233620683,v1:172.21.15.45:6803/2233620683] conn(0x7f7f880abd80 msgr2=0x7f7f880ae210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:21.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.865+0000 7f7fa3756700 1 --2- 172.21.15.45:0/1050738613 >> [v2:172.21.15.45:6802/2233620683,v1:172.21.15.45:6803/2233620683] conn(0x7f7f880abd80 0x7f7f880ae210 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:21.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.865+0000 7f7fa3756700 1 -- 172.21.15.45:0/1050738613 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7f880a11b0 msgr2=0x7f7f880a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:21.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.865+0000 7f7fa3756700 1 --2- 172.21.15.45:0/1050738613 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7f880a11b0 0x7f7f880a36c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7f98006010 tx=0x7f7f9801a040 comp rx=0 tx=0).stop 2024-05-10T03:39:21.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.865+0000 7f7fa3756700 1 -- 172.21.15.45:0/1050738613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f9c10c210 msgr2=0x7f7f9c1983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:21.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.865+0000 7f7fa3756700 1 --2- 172.21.15.45:0/1050738613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f9c10c210 0x7f7f9c1983e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7f94007ee0 tx=0x7f7f9400d3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:21.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.865+0000 7f7fa1cf3700 1 -- 172.21.15.45:0/1050738613 reap_dead start 2024-05-10T03:39:21.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.865+0000 7f7fa3756700 1 -- 172.21.15.45:0/1050738613 shutdown_connections 2024-05-10T03:39:21.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.865+0000 7f7fa3756700 1 -- 172.21.15.45:0/1050738613 >> 172.21.15.45:0/1050738613 conn(0x7f7f9c0fc7a0 msgr2=0x7f7f9c0fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:21.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.865+0000 7f7fa3756700 1 -- 172.21.15.45:0/1050738613 shutdown_connections 2024-05-10T03:39:21.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:21.865+0000 7f7fa3756700 1 -- 172.21.15.45:0/1050738613 wait complete. 2024-05-10T03:39:22.375 INFO:teuthology.orchestra.run.smithi045.stdout:34359738426 2024-05-10T03:39:22.375 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-10T03:39:22.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.499+0000 7f5fc7ce1700 1 -- 172.21.15.45:0/3854236464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fc0106860 msgr2=0x7f5fc0106c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.499+0000 7f5fc7ce1700 1 --2- 172.21.15.45:0/3854236464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fc0106860 0x7f5fc0106c70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0009990 tx=0x7f5fb0009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.499+0000 7f5fc7ce1700 1 -- 172.21.15.45:0/3854236464 shutdown_connections 2024-05-10T03:39:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.499+0000 7f5fc7ce1700 1 --2- 172.21.15.45:0/3854236464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fc0101f30 0x7f5fc0102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.499+0000 7f5fc7ce1700 1 --2- 172.21.15.45:0/3854236464 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fc01071b0 0x7f5fc010eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.499+0000 7f5fc7ce1700 1 --2- 172.21.15.45:0/3854236464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fc0106860 0x7f5fc0106c70 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.499+0000 7f5fc7ce1700 1 -- 172.21.15.45:0/3854236464 >> 172.21.15.45:0/3854236464 conn(0x7f5fc00fd9c0 msgr2=0x7f5fc00ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.499+0000 7f5fc7ce1700 1 -- 172.21.15.45:0/3854236464 shutdown_connections 2024-05-10T03:39:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.499+0000 7f5fc7ce1700 1 -- 172.21.15.45:0/3854236464 wait complete. 2024-05-10T03:39:22.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.500+0000 7f5fc7ce1700 1 Processor -- start 2024-05-10T03:39:22.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.500+0000 7f5fc7ce1700 1 -- start start 2024-05-10T03:39:22.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.501+0000 7f5fc7ce1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fc0101f30 0x7f5fc019e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:22.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.501+0000 7f5fc7ce1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fc0106860 0x7f5fc019e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:22.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.501+0000 7f5fc7ce1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fc01071b0 0x7f5fc0198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:22.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.501+0000 7f5fc7ce1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc0198940 con 0x7f5fc0106860 2024-05-10T03:39:22.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.501+0000 7f5fc7ce1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc0198ab0 con 0x7f5fc0101f30 2024-05-10T03:39:22.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.501+0000 7f5fc7ce1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc0198c70 con 0x7f5fc01071b0 2024-05-10T03:39:22.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.501+0000 7f5fc527c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fc0106860 0x7f5fc019e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:22.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.501+0000 7f5fc527c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fc0106860 0x7f5fc019e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48816/0 (socket says 172.21.15.45:48816) 2024-05-10T03:39:22.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.501+0000 7f5fc527c700 1 -- 172.21.15.45:0/325822677 learned_addr learned my addr 172.21.15.45:0/325822677 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:22.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.501+0000 7f5fc5a7d700 1 --2- 172.21.15.45:0/325822677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fc0101f30 0x7f5fc019e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:22.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.501+0000 7f5fc627e700 1 --2- 172.21.15.45:0/325822677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fc01071b0 0x7f5fc0198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:22.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.501+0000 7f5fc527c700 1 -- 172.21.15.45:0/325822677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fc01071b0 msgr2=0x7f5fc0198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:22.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.501+0000 7f5fc527c700 1 --2- 172.21.15.45:0/325822677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fc01071b0 0x7f5fc0198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:22.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.501+0000 7f5fc527c700 1 -- 172.21.15.45:0/325822677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fc0101f30 msgr2=0x7f5fc019e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:22.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.501+0000 7f5fc527c700 1 --2- 172.21.15.45:0/325822677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fc0101f30 0x7f5fc019e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:22.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.501+0000 7f5fc527c700 1 -- 172.21.15.45:0/325822677 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb00095f0 con 0x7f5fc0106860 2024-05-10T03:39:22.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.501+0000 7f5fc527c700 1 --2- 172.21.15.45:0/325822677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fc0106860 0x7f5fc019e9e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00098e0 tx=0x7f5fb000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:22.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.502+0000 7f5fb6ffd700 1 -- 172.21.15.45:0/325822677 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb001d070 con 0x7f5fc0106860 2024-05-10T03:39:22.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.502+0000 7f5fc7ce1700 1 -- 172.21.15.45:0/325822677 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc0198ef0 con 0x7f5fc0106860 2024-05-10T03:39:22.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.502+0000 7f5fb6ffd700 1 -- 172.21.15.45:0/325822677 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5fb0003680 con 0x7f5fc0106860 2024-05-10T03:39:22.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.502+0000 7f5fb6ffd700 1 -- 172.21.15.45:0/325822677 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb00173f0 con 0x7f5fc0106860 2024-05-10T03:39:22.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.502+0000 7f5fc7ce1700 1 -- 172.21.15.45:0/325822677 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc0073440 con 0x7f5fc0106860 2024-05-10T03:39:22.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.503+0000 7f5fc7ce1700 1 -- 172.21.15.45:0/325822677 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5fc0111fb0 con 0x7f5fc0106860 2024-05-10T03:39:22.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.504+0000 7f5fb6ffd700 1 -- 172.21.15.45:0/325822677 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f5fb0022470 con 0x7f5fc0106860 2024-05-10T03:39:22.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.505+0000 7f5fb6ffd700 1 --2- 172.21.15.45:0/325822677 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f5fac0a11b0 0x7f5fac0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:22.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.505+0000 7f5fc5a7d700 1 --2- 172.21.15.45:0/325822677 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f5fac0a11b0 0x7f5fac0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:22.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.505+0000 7f5fb6ffd700 1 -- 172.21.15.45:0/325822677 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f5fb00ce490 con 0x7f5fc0106860 2024-05-10T03:39:22.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.506+0000 7f5fb6ffd700 1 --2- 172.21.15.45:0/325822677 >> [v2:172.21.15.154:6824/3779086590,v1:172.21.15.154:6825/3779086590] conn(0x7f5fac0abd80 0x7f5fac0ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:22.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.506+0000 7f5fb6ffd700 1 -- 172.21.15.45:0/325822677 --> [v2:172.21.15.154:6824/3779086590,v1:172.21.15.154:6825/3779086590] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5fac0ae8e0 con 0x7f5fac0abd80 2024-05-10T03:39:22.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.506+0000 7f5fb6ffd700 1 -- 172.21.15.45:0/325822677 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fb00ce800 con 0x7f5fc0106860 2024-05-10T03:39:22.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.506+0000 7f5fc5a7d700 1 --2- 172.21.15.45:0/325822677 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f5fac0a11b0 0x7f5fac0a36c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0199870 tx=0x7f5fbc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:22.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.506+0000 7f5fc627e700 1 --2- 172.21.15.45:0/325822677 >> [v2:172.21.15.154:6824/3779086590,v1:172.21.15.154:6825/3779086590] conn(0x7f5fac0abd80 0x7f5fac0ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:22.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.506+0000 7f5fc627e700 1 --2- 172.21.15.45:0/325822677 >> [v2:172.21.15.154:6824/3779086590,v1:172.21.15.154:6825/3779086590] conn(0x7f5fac0abd80 0x7f5fac0ae210 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:22.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.507+0000 7f5fb6ffd700 1 -- 172.21.15.45:0/325822677 <== osd.11 v2:172.21.15.154:6824/3779086590 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f5fac0ae8e0 con 0x7f5fac0abd80 2024-05-10T03:39:22.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.526+0000 7f5fc7ce1700 1 -- 172.21.15.45:0/325822677 --> [v2:172.21.15.154:6824/3779086590,v1:172.21.15.154:6825/3779086590] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5fc0061910 con 0x7f5fac0abd80 2024-05-10T03:39:22.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.527+0000 7f5fb6ffd700 1 -- 172.21.15.45:0/325822677 <== osd.11 v2:172.21.15.154:6824/3779086590 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f5fc0061910 con 0x7f5fac0abd80 2024-05-10T03:39:22.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.527+0000 7f5fc7ce1700 1 -- 172.21.15.45:0/325822677 >> [v2:172.21.15.154:6824/3779086590,v1:172.21.15.154:6825/3779086590] conn(0x7f5fac0abd80 msgr2=0x7f5fac0ae210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:22.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.527+0000 7f5fc7ce1700 1 --2- 172.21.15.45:0/325822677 >> [v2:172.21.15.154:6824/3779086590,v1:172.21.15.154:6825/3779086590] conn(0x7f5fac0abd80 0x7f5fac0ae210 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:22.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.527+0000 7f5fc7ce1700 1 -- 172.21.15.45:0/325822677 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f5fac0a11b0 msgr2=0x7f5fac0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:22.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.527+0000 7f5fc7ce1700 1 --2- 172.21.15.45:0/325822677 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f5fac0a11b0 0x7f5fac0a36c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0199870 tx=0x7f5fbc00b410 comp rx=0 tx=0).stop 2024-05-10T03:39:22.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.527+0000 7f5fc7ce1700 1 -- 172.21.15.45:0/325822677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fc0106860 msgr2=0x7f5fc019e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:22.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.527+0000 7f5fc7ce1700 1 --2- 172.21.15.45:0/325822677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fc0106860 0x7f5fc019e9e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00098e0 tx=0x7f5fb000f690 comp rx=0 tx=0).stop 2024-05-10T03:39:22.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.527+0000 7f5fc627e700 1 -- 172.21.15.45:0/325822677 reap_dead start 2024-05-10T03:39:22.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.528+0000 7f5fc7ce1700 1 -- 172.21.15.45:0/325822677 shutdown_connections 2024-05-10T03:39:22.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.528+0000 7f5fc7ce1700 1 -- 172.21.15.45:0/325822677 >> 172.21.15.45:0/325822677 conn(0x7f5fc00fd9c0 msgr2=0x7f5fc0105bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:22.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.528+0000 7f5fc7ce1700 1 -- 172.21.15.45:0/325822677 shutdown_connections 2024-05-10T03:39:22.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.528+0000 7f5fc7ce1700 1 -- 172.21.15.45:0/325822677 wait complete. 2024-05-10T03:39:22.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.710+0000 7f921d8ea700 1 -- 172.21.15.45:0/120439422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f921810c210 msgr2=0x7f921810e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:22.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.710+0000 7f921d8ea700 1 --2- 172.21.15.45:0/120439422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f921810c210 0x7f921810e720 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9210009990 tx=0x7f9210009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:22.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.710+0000 7f921d8ea700 1 -- 172.21.15.45:0/120439422 shutdown_connections 2024-05-10T03:39:22.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.710+0000 7f921d8ea700 1 --2- 172.21.15.45:0/120439422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f921810c210 0x7f921810e720 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:22.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.710+0000 7f921d8ea700 1 --2- 172.21.15.45:0/120439422 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9218102da0 0x7f92181031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:22.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.710+0000 7f921d8ea700 1 --2- 172.21.15.45:0/120439422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92181036f0 0x7f921810bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:22.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.710+0000 7f921d8ea700 1 -- 172.21.15.45:0/120439422 >> 172.21.15.45:0/120439422 conn(0x7f92180fc7a0 msgr2=0x7f92180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:22.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.710+0000 7f921d8ea700 1 -- 172.21.15.45:0/120439422 shutdown_connections 2024-05-10T03:39:22.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.711+0000 7f921d8ea700 1 -- 172.21.15.45:0/120439422 wait complete. 2024-05-10T03:39:22.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.711+0000 7f921d8ea700 1 Processor -- start 2024-05-10T03:39:22.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.712+0000 7f921d8ea700 1 -- start start 2024-05-10T03:39:22.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.712+0000 7f921d8ea700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9218102da0 0x7f9218198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:22.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.712+0000 7f921d8ea700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92181036f0 0x7f9218198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:22.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.712+0000 7f921d8ea700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f921810c210 0x7f921819cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:22.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.712+0000 7f921d8ea700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921819d540 con 0x7f921810c210 2024-05-10T03:39:22.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.712+0000 7f921d8ea700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921819d6b0 con 0x7f9218102da0 2024-05-10T03:39:22.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.712+0000 7f921d8ea700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921819d870 con 0x7f92181036f0 2024-05-10T03:39:22.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.712+0000 7f92177fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f921810c210 0x7f921819cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:22.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.712+0000 7f92177fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f921810c210 0x7f921819cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48844/0 (socket says 172.21.15.45:48844) 2024-05-10T03:39:22.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.712+0000 7f92177fe700 1 -- 172.21.15.45:0/1094547193 learned_addr learned my addr 172.21.15.45:0/1094547193 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:22.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.712+0000 7f92167fc700 1 --2- 172.21.15.45:0/1094547193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92181036f0 0x7f9218198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:22.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.712+0000 7f9216ffd700 1 --2- 172.21.15.45:0/1094547193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9218102da0 0x7f9218198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:22.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.712+0000 7f92177fe700 1 -- 172.21.15.45:0/1094547193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92181036f0 msgr2=0x7f9218198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:22.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.712+0000 7f92177fe700 1 --2- 172.21.15.45:0/1094547193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92181036f0 0x7f9218198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:22.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.712+0000 7f92177fe700 1 -- 172.21.15.45:0/1094547193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9218102da0 msgr2=0x7f9218198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:22.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.712+0000 7f92177fe700 1 --2- 172.21.15.45:0/1094547193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9218102da0 0x7f9218198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:22.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.712+0000 7f92177fe700 1 -- 172.21.15.45:0/1094547193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92100095f0 con 0x7f921810c210 2024-05-10T03:39:22.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.712+0000 7f92167fc700 1 --2- 172.21.15.45:0/1094547193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92181036f0 0x7f9218198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:22.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.713+0000 7f92177fe700 1 --2- 172.21.15.45:0/1094547193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f921810c210 0x7f921819cfd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9210005740 tx=0x7f9210009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:22.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.713+0000 7f921c8e8700 1 -- 172.21.15.45:0/1094547193 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921001d070 con 0x7f921810c210 2024-05-10T03:39:22.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.713+0000 7f921c8e8700 1 -- 172.21.15.45:0/1094547193 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9210022470 con 0x7f921810c210 2024-05-10T03:39:22.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.713+0000 7f921d8ea700 1 -- 172.21.15.45:0/1094547193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f921819daf0 con 0x7f921810c210 2024-05-10T03:39:22.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.713+0000 7f921d8ea700 1 -- 172.21.15.45:0/1094547193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92181a5280 con 0x7f921810c210 2024-05-10T03:39:22.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.713+0000 7f921c8e8700 1 -- 172.21.15.45:0/1094547193 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9210017650 con 0x7f921810c210 2024-05-10T03:39:22.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.714+0000 7f920e7fc700 1 -- 172.21.15.45:0/1094547193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f91fc000fc0 con 0x7f921810c210 2024-05-10T03:39:22.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.716+0000 7f921c8e8700 1 -- 172.21.15.45:0/1094547193 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f92100225e0 con 0x7f921810c210 2024-05-10T03:39:22.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.716+0000 7f921c8e8700 1 --2- 172.21.15.45:0/1094547193 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f92040a11b0 0x7f92040a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:22.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.716+0000 7f9216ffd700 1 --2- 172.21.15.45:0/1094547193 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f92040a11b0 0x7f92040a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:22.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.716+0000 7f921c8e8700 1 -- 172.21.15.45:0/1094547193 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f92100cea70 con 0x7f921810c210 2024-05-10T03:39:22.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.717+0000 7f921c8e8700 1 --2- 172.21.15.45:0/1094547193 >> [v2:172.21.15.154:6816/1548564532,v1:172.21.15.154:6817/1548564532] conn(0x7f92040abd80 0x7f92040ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:22.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.717+0000 7f921c8e8700 1 -- 172.21.15.45:0/1094547193 --> [v2:172.21.15.154:6816/1548564532,v1:172.21.15.154:6817/1548564532] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f92040ae8e0 con 0x7f92040abd80 2024-05-10T03:39:22.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.717+0000 7f921c8e8700 1 -- 172.21.15.45:0/1094547193 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92100cee80 con 0x7f921810c210 2024-05-10T03:39:22.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.717+0000 7f92167fc700 1 --2- 172.21.15.45:0/1094547193 >> [v2:172.21.15.154:6816/1548564532,v1:172.21.15.154:6817/1548564532] conn(0x7f92040abd80 0x7f92040ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:22.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.718+0000 7f92167fc700 1 --2- 172.21.15.45:0/1094547193 >> [v2:172.21.15.154:6816/1548564532,v1:172.21.15.154:6817/1548564532] conn(0x7f92040abd80 0x7f92040ae210 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:22.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.718+0000 7f9216ffd700 1 --2- 172.21.15.45:0/1094547193 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f92040a11b0 0x7f92040a36c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f921806ab80 tx=0x7f920800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:22.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.719+0000 7f921c8e8700 1 -- 172.21.15.45:0/1094547193 <== osd.8 v2:172.21.15.154:6816/1548564532 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f92040ae8e0 con 0x7f92040abd80 2024-05-10T03:39:22.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.736+0000 7f920e7fc700 1 -- 172.21.15.45:0/1094547193 --> [v2:172.21.15.154:6816/1548564532,v1:172.21.15.154:6817/1548564532] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f91fc002d40 con 0x7f92040abd80 2024-05-10T03:39:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.736+0000 7f921c8e8700 1 -- 172.21.15.45:0/1094547193 <== osd.8 v2:172.21.15.154:6816/1548564532 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f91fc002d40 con 0x7f92040abd80 2024-05-10T03:39:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.737+0000 7f920e7fc700 1 -- 172.21.15.45:0/1094547193 >> [v2:172.21.15.154:6816/1548564532,v1:172.21.15.154:6817/1548564532] conn(0x7f92040abd80 msgr2=0x7f92040ae210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:22.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.737+0000 7f920e7fc700 1 --2- 172.21.15.45:0/1094547193 >> [v2:172.21.15.154:6816/1548564532,v1:172.21.15.154:6817/1548564532] conn(0x7f92040abd80 0x7f92040ae210 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:22.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.737+0000 7f920e7fc700 1 -- 172.21.15.45:0/1094547193 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f92040a11b0 msgr2=0x7f92040a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:22.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.737+0000 7f920e7fc700 1 --2- 172.21.15.45:0/1094547193 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f92040a11b0 0x7f92040a36c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f921806ab80 tx=0x7f920800b040 comp rx=0 tx=0).stop 2024-05-10T03:39:22.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.737+0000 7f920e7fc700 1 -- 172.21.15.45:0/1094547193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f921810c210 msgr2=0x7f921819cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:22.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.737+0000 7f920e7fc700 1 --2- 172.21.15.45:0/1094547193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f921810c210 0x7f921819cfd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9210005740 tx=0x7f9210009550 comp rx=0 tx=0).stop 2024-05-10T03:39:22.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.737+0000 7f92177fe700 1 -- 172.21.15.45:0/1094547193 reap_dead start 2024-05-10T03:39:22.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.737+0000 7f920e7fc700 1 -- 172.21.15.45:0/1094547193 shutdown_connections 2024-05-10T03:39:22.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.737+0000 7f920e7fc700 1 -- 172.21.15.45:0/1094547193 >> 172.21.15.45:0/1094547193 conn(0x7f92180fc7a0 msgr2=0x7f92180fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:22.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.737+0000 7f920e7fc700 1 -- 172.21.15.45:0/1094547193 shutdown_connections 2024-05-10T03:39:22.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.737+0000 7f920e7fc700 1 -- 172.21.15.45:0/1094547193 wait complete. 2024-05-10T03:39:22.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.883+0000 7f5090494700 1 -- 172.21.15.45:0/2025759621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f508810c220 msgr2=0x7f508810e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:22.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.883+0000 7f5090494700 1 --2- 172.21.15.45:0/2025759621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f508810c220 0x7f508810e730 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f508000b0a0 tx=0x7f508000b3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:22.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.883+0000 7f5090494700 1 -- 172.21.15.45:0/2025759621 shutdown_connections 2024-05-10T03:39:22.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.883+0000 7f5090494700 1 --2- 172.21.15.45:0/2025759621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f508810c220 0x7f508810e730 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:22.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.883+0000 7f5090494700 1 --2- 172.21.15.45:0/2025759621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5088102e40 0x7f5088103250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:22.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.883+0000 7f5090494700 1 --2- 172.21.15.45:0/2025759621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5088103790 0x7f508810bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:22.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.883+0000 7f5090494700 1 -- 172.21.15.45:0/2025759621 >> 172.21.15.45:0/2025759621 conn(0x7f50880fc7a0 msgr2=0x7f50880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:22.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.883+0000 7f5090494700 1 -- 172.21.15.45:0/2025759621 shutdown_connections 2024-05-10T03:39:22.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.883+0000 7f5090494700 1 -- 172.21.15.45:0/2025759621 wait complete. 2024-05-10T03:39:22.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.884+0000 7f5090494700 1 Processor -- start 2024-05-10T03:39:22.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.884+0000 7f5090494700 1 -- start start 2024-05-10T03:39:22.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.885+0000 7f5090494700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5088102e40 0x7f508819e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:22.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.885+0000 7f5090494700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5088103790 0x7f508819ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:22.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.885+0000 7f5090494700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f508810c220 0x7f50881984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:22.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.885+0000 7f5090494700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5088198ac0 con 0x7f5088103790 2024-05-10T03:39:22.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.885+0000 7f5090494700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5088198c30 con 0x7f508810c220 2024-05-10T03:39:22.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.885+0000 7f5090494700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5088198df0 con 0x7f5088102e40 2024-05-10T03:39:22.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.885+0000 7f508da2f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5088103790 0x7f508819ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:22.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.885+0000 7f508da2f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5088103790 0x7f508819ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48860/0 (socket says 172.21.15.45:48860) 2024-05-10T03:39:22.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.885+0000 7f508da2f700 1 -- 172.21.15.45:0/3921640458 learned_addr learned my addr 172.21.15.45:0/3921640458 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:22.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.885+0000 7f508e230700 1 --2- 172.21.15.45:0/3921640458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5088102e40 0x7f508819e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:22.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.885+0000 7f508ea31700 1 --2- 172.21.15.45:0/3921640458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f508810c220 0x7f50881984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:22.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.885+0000 7f508da2f700 1 -- 172.21.15.45:0/3921640458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5088102e40 msgr2=0x7f508819e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:22.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.885+0000 7f508da2f700 1 --2- 172.21.15.45:0/3921640458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5088102e40 0x7f508819e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:22.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.885+0000 7f508da2f700 1 -- 172.21.15.45:0/3921640458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f508810c220 msgr2=0x7f50881984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:22.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.885+0000 7f508da2f700 1 --2- 172.21.15.45:0/3921640458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f508810c220 0x7f50881984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:22.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.885+0000 7f508da2f700 1 -- 172.21.15.45:0/3921640458 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5080009d00 con 0x7f5088103790 2024-05-10T03:39:22.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.886+0000 7f508da2f700 1 --2- 172.21.15.45:0/3921640458 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5088103790 0x7f508819ead0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f507800e9f0 tx=0x7f507800edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:22.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.886+0000 7f507f7fe700 1 -- 172.21.15.45:0/3921640458 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5078009750 con 0x7f5088103790 2024-05-10T03:39:22.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.886+0000 7f507f7fe700 1 -- 172.21.15.45:0/3921640458 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5078004d10 con 0x7f5088103790 2024-05-10T03:39:22.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.886+0000 7f5090494700 1 -- 172.21.15.45:0/3921640458 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50881990d0 con 0x7f5088103790 2024-05-10T03:39:22.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.886+0000 7f507f7fe700 1 -- 172.21.15.45:0/3921640458 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50780056f0 con 0x7f5088103790 2024-05-10T03:39:22.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.886+0000 7f5090494700 1 -- 172.21.15.45:0/3921640458 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50881a5560 con 0x7f5088103790 2024-05-10T03:39:22.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.887+0000 7f5090494700 1 -- 172.21.15.45:0/3921640458 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50881073e0 con 0x7f5088103790 2024-05-10T03:39:22.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.888+0000 7f507f7fe700 1 -- 172.21.15.45:0/3921640458 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f5078004750 con 0x7f5088103790 2024-05-10T03:39:22.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.889+0000 7f507f7fe700 1 --2- 172.21.15.45:0/3921640458 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f50740a1230 0x7f50740a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:22.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.890+0000 7f508e230700 1 --2- 172.21.15.45:0/3921640458 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f50740a1230 0x7f50740a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:22.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.890+0000 7f507f7fe700 1 -- 172.21.15.45:0/3921640458 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f5078014070 con 0x7f5088103790 2024-05-10T03:39:22.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.890+0000 7f508e230700 1 --2- 172.21.15.45:0/3921640458 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f50740a1230 0x7f50740a3740 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5084005950 tx=0x7f50840058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:22.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:22.894+0000 7f507f7fe700 1 -- 172.21.15.45:0/3921640458 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5078096670 con 0x7f5088103790 2024-05-10T03:39:22.946 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:23.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:23.113+0000 7f5090494700 1 -- 172.21.15.45:0/3921640458 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5088069560 con 0x7f5088103790 2024-05-10T03:39:23.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:23.113+0000 7f507f7fe700 1 -- 172.21.15.45:0/3921640458 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5078004e80 con 0x7f5088103790 2024-05-10T03:39:23.117 INFO:teuthology.orchestra.run.smithi045.stdout:107374182447 2024-05-10T03:39:23.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:23.115+0000 7f5090494700 1 -- 172.21.15.45:0/3921640458 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f50740a1230 msgr2=0x7f50740a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:23.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:23.115+0000 7f5090494700 1 --2- 172.21.15.45:0/3921640458 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f50740a1230 0x7f50740a3740 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5084005950 tx=0x7f50840058e0 comp rx=0 tx=0).stop 2024-05-10T03:39:23.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:23.115+0000 7f5090494700 1 -- 172.21.15.45:0/3921640458 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5088103790 msgr2=0x7f508819ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:23.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:23.115+0000 7f5090494700 1 --2- 172.21.15.45:0/3921640458 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5088103790 0x7f508819ead0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f507800e9f0 tx=0x7f507800edb0 comp rx=0 tx=0).stop 2024-05-10T03:39:23.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:23.116+0000 7f5090494700 1 -- 172.21.15.45:0/3921640458 shutdown_connections 2024-05-10T03:39:23.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:23.116+0000 7f5090494700 1 --2- 172.21.15.45:0/3921640458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5088102e40 0x7f508819e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:23.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:23.116+0000 7f5090494700 1 --2- 172.21.15.45:0/3921640458 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f50740a1230 0x7f50740a3740 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:23.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:23.116+0000 7f5090494700 1 --2- 172.21.15.45:0/3921640458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f508810c220 0x7f50881984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:23.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:23.116+0000 7f5090494700 1 --2- 172.21.15.45:0/3921640458 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5088103790 0x7f508819ead0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:23.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:23.116+0000 7f5090494700 1 -- 172.21.15.45:0/3921640458 >> 172.21.15.45:0/3921640458 conn(0x7f50880fc7a0 msgr2=0x7f50880fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:23.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:23.116+0000 7f5090494700 1 -- 172.21.15.45:0/3921640458 shutdown_connections 2024-05-10T03:39:23.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:23.116+0000 7f5090494700 1 -- 172.21.15.45:0/3921640458 wait complete. 2024-05-10T03:39:23.372 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:23 smithi045 ceph-mon[42520]: pgmap v254: 129 pgs: 129 active+clean; 643 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-10T03:39:23.398 INFO:teuthology.orchestra.run.smithi045.stdout:326417514515 2024-05-10T03:39:23.399 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-05-10T03:39:23.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:23 smithi106 ceph-mon[46996]: pgmap v254: 129 pgs: 129 active+clean; 643 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-10T03:39:23.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:23 smithi154 ceph-mon[46565]: pgmap v254: 129 pgs: 129 active+clean; 643 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-10T03:39:23.606 INFO:teuthology.orchestra.run.smithi045.stdout:244813135902 2024-05-10T03:39:23.606 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-05-10T03:39:24.146 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182446 got 107374182447 for osd.3 2024-05-10T03:39:24.146 DEBUG:teuthology.parallel:result is None 2024-05-10T03:39:24.213 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:24.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:24 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3921640458' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-10T03:39:24.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:24 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3921640458' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-10T03:39:24.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:24 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3921640458' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-10T03:39:24.515 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.897+0000 7fc6e9d66700 1 -- 172.21.15.45:0/2349715109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6e4106860 msgr2=0x7fc6e4106c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.897+0000 7fc6e9d66700 1 --2- 172.21.15.45:0/2349715109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6e4106860 0x7fc6e4106c70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009990 tx=0x7fc6d8009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.897+0000 7fc6e9d66700 1 -- 172.21.15.45:0/2349715109 shutdown_connections 2024-05-10T03:39:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.897+0000 7fc6e9d66700 1 --2- 172.21.15.45:0/2349715109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6e41071b0 0x7fc6e410eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.897+0000 7fc6e9d66700 1 --2- 172.21.15.45:0/2349715109 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6e4100440 0x7fc6e4100850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.897+0000 7fc6e9d66700 1 --2- 172.21.15.45:0/2349715109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6e4106860 0x7fc6e4106c70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.897+0000 7fc6e9d66700 1 -- 172.21.15.45:0/2349715109 >> 172.21.15.45:0/2349715109 conn(0x7fc6e40fbec0 msgr2=0x7fc6e40fe310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.897+0000 7fc6e9d66700 1 -- 172.21.15.45:0/2349715109 shutdown_connections 2024-05-10T03:39:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.897+0000 7fc6e9d66700 1 -- 172.21.15.45:0/2349715109 wait complete. 2024-05-10T03:39:24.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.898+0000 7fc6e9d66700 1 Processor -- start 2024-05-10T03:39:24.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.898+0000 7fc6e9d66700 1 -- start start 2024-05-10T03:39:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.898+0000 7fc6e9d66700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6e4100440 0x7fc6e419e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.898+0000 7fc6e9d66700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6e4106860 0x7fc6e419ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.898+0000 7fc6e9d66700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6e41071b0 0x7fc6e4198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.898+0000 7fc6e9d66700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e4198a10 con 0x7fc6e41071b0 2024-05-10T03:39:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.898+0000 7fc6e9d66700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e4198b80 con 0x7fc6e4100440 2024-05-10T03:39:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.899+0000 7fc6e9d66700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e4198d40 con 0x7fc6e4106860 2024-05-10T03:39:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.899+0000 7fc6e3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6e41071b0 0x7fc6e4198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.899+0000 7fc6e3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6e41071b0 0x7fc6e4198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48866/0 (socket says 172.21.15.45:48866) 2024-05-10T03:39:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.899+0000 7fc6e3fff700 1 -- 172.21.15.45:0/1579832118 learned_addr learned my addr 172.21.15.45:0/1579832118 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.899+0000 7fc6e37fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6e4100440 0x7fc6e419e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.899+0000 7fc6e2ffd700 1 --2- 172.21.15.45:0/1579832118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6e4106860 0x7fc6e419ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.899+0000 7fc6e3fff700 1 -- 172.21.15.45:0/1579832118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6e4106860 msgr2=0x7fc6e419ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.899+0000 7fc6e3fff700 1 --2- 172.21.15.45:0/1579832118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6e4106860 0x7fc6e419ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.899+0000 7fc6e3fff700 1 -- 172.21.15.45:0/1579832118 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6e4100440 msgr2=0x7fc6e419e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:24.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.899+0000 7fc6e3fff700 1 --2- 172.21.15.45:0/1579832118 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6e4100440 0x7fc6e419e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:24.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.899+0000 7fc6e3fff700 1 -- 172.21.15.45:0/1579832118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d80095f0 con 0x7fc6e41071b0 2024-05-10T03:39:24.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.899+0000 7fc6e3fff700 1 --2- 172.21.15.45:0/1579832118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6e41071b0 0x7fc6e4198410 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc007ee0 tx=0x7fc6dc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:24.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.899+0000 7fc6e0ff9700 1 -- 172.21.15.45:0/1579832118 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc017070 con 0x7fc6e41071b0 2024-05-10T03:39:24.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.900+0000 7fc6e0ff9700 1 -- 172.21.15.45:0/1579832118 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc6dc00f040 con 0x7fc6e41071b0 2024-05-10T03:39:24.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.900+0000 7fc6e0ff9700 1 -- 172.21.15.45:0/1579832118 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc005610 con 0x7fc6e41071b0 2024-05-10T03:39:24.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.900+0000 7fc6e9d66700 1 -- 172.21.15.45:0/1579832118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e4199020 con 0x7fc6e41071b0 2024-05-10T03:39:24.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.900+0000 7fc6e9d66700 1 -- 172.21.15.45:0/1579832118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e406ae00 con 0x7fc6e41071b0 2024-05-10T03:39:24.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.901+0000 7fc6e9d66700 1 -- 172.21.15.45:0/1579832118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc6e41992d0 con 0x7fc6e41071b0 2024-05-10T03:39:24.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.903+0000 7fc6e0ff9700 1 -- 172.21.15.45:0/1579832118 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fc6dc005770 con 0x7fc6e41071b0 2024-05-10T03:39:24.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.903+0000 7fc6e0ff9700 1 --2- 172.21.15.45:0/1579832118 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc6cc0a1230 0x7fc6cc0a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:24.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.904+0000 7fc6e37fe700 1 --2- 172.21.15.45:0/1579832118 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc6cc0a1230 0x7fc6cc0a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:24.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.904+0000 7fc6e0ff9700 1 -- 172.21.15.45:0/1579832118 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc6dc0cc420 con 0x7fc6e41071b0 2024-05-10T03:39:24.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.904+0000 7fc6e0ff9700 1 --2- 172.21.15.45:0/1579832118 >> [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087] conn(0x7fc6cc0abe00 0x7fc6cc0ae290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:24.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.904+0000 7fc6e0ff9700 1 -- 172.21.15.45:0/1579832118 --> [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc6cc0ae960 con 0x7fc6cc0abe00 2024-05-10T03:39:24.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.904+0000 7fc6e0ff9700 1 -- 172.21.15.45:0/1579832118 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6dc0cc790 con 0x7fc6e41071b0 2024-05-10T03:39:24.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.904+0000 7fc6e2ffd700 1 --2- 172.21.15.45:0/1579832118 >> [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087] conn(0x7fc6cc0abe00 0x7fc6cc0ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:24.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.904+0000 7fc6e37fe700 1 --2- 172.21.15.45:0/1579832118 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc6cc0a1230 0x7fc6cc0a3740 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009c60 tx=0x7fc6d4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:24.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.904+0000 7fc6e2ffd700 1 --2- 172.21.15.45:0/1579832118 >> [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087] conn(0x7fc6cc0abe00 0x7fc6cc0ae290 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:24.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.905+0000 7fc6e0ff9700 1 -- 172.21.15.45:0/1579832118 <== osd.9 v2:172.21.15.45:6826/3092314087 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc6cc0ae960 con 0x7fc6cc0abe00 2024-05-10T03:39:24.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.922+0000 7fc6e9d66700 1 -- 172.21.15.45:0/1579832118 --> [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc6e4111fb0 con 0x7fc6cc0abe00 2024-05-10T03:39:24.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.922+0000 7fc6e0ff9700 1 -- 172.21.15.45:0/1579832118 <== osd.9 v2:172.21.15.45:6826/3092314087 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc6d801e040 con 0x7fc6cc0abe00 2024-05-10T03:39:24.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.923+0000 7fc6e9d66700 1 -- 172.21.15.45:0/1579832118 >> [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087] conn(0x7fc6cc0abe00 msgr2=0x7fc6cc0ae290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:24.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.923+0000 7fc6e9d66700 1 --2- 172.21.15.45:0/1579832118 >> [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087] conn(0x7fc6cc0abe00 0x7fc6cc0ae290 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:24.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.923+0000 7fc6e9d66700 1 -- 172.21.15.45:0/1579832118 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc6cc0a1230 msgr2=0x7fc6cc0a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:24.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.923+0000 7fc6e9d66700 1 --2- 172.21.15.45:0/1579832118 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc6cc0a1230 0x7fc6cc0a3740 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009c60 tx=0x7fc6d4009260 comp rx=0 tx=0).stop 2024-05-10T03:39:24.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.923+0000 7fc6e9d66700 1 -- 172.21.15.45:0/1579832118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6e41071b0 msgr2=0x7fc6e4198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:24.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.923+0000 7fc6e9d66700 1 --2- 172.21.15.45:0/1579832118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6e41071b0 0x7fc6e4198410 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc007ee0 tx=0x7fc6dc00d3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:24.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.923+0000 7fc6e3fff700 1 -- 172.21.15.45:0/1579832118 reap_dead start 2024-05-10T03:39:24.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.923+0000 7fc6e9d66700 1 -- 172.21.15.45:0/1579832118 shutdown_connections 2024-05-10T03:39:24.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.923+0000 7fc6e9d66700 1 -- 172.21.15.45:0/1579832118 >> 172.21.15.45:0/1579832118 conn(0x7fc6e40fbec0 msgr2=0x7fc6e4104980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:24.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.923+0000 7fc6e9d66700 1 -- 172.21.15.45:0/1579832118 shutdown_connections 2024-05-10T03:39:24.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:24.923+0000 7fc6e9d66700 1 -- 172.21.15.45:0/1579832118 wait complete. 2024-05-10T03:39:25.354 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:25 smithi045 ceph-mon[42520]: pgmap v255: 129 pgs: 129 active+clean; 643 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-10T03:39:25.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:25 smithi106 ceph-mon[46996]: pgmap v255: 129 pgs: 129 active+clean; 643 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-10T03:39:25.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:25 smithi154 ceph-mon[46565]: pgmap v255: 129 pgs: 129 active+clean; 643 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-10T03:39:25.624 INFO:teuthology.orchestra.run.smithi045.stdout:274877906971 2024-05-10T03:39:25.625 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-05-10T03:39:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.548+0000 7f54cbaed700 1 -- 172.21.15.45:0/1711354269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54c4100e60 msgr2=0x7f54c4101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.548+0000 7f54cbaed700 1 --2- 172.21.15.45:0/1711354269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54c4100e60 0x7f54c4101270 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009a10 tx=0x7f54c0009d20 comp rx=0 tx=0).stop 2024-05-10T03:39:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.548+0000 7f54cbaed700 1 -- 172.21.15.45:0/1711354269 shutdown_connections 2024-05-10T03:39:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.548+0000 7f54cbaed700 1 --2- 172.21.15.45:0/1711354269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c41060e0 0x7f54c410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.548+0000 7f54cbaed700 1 --2- 172.21.15.45:0/1711354269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54c4100e60 0x7f54c4101270 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.548+0000 7f54cbaed700 1 --2- 172.21.15.45:0/1711354269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54c4105790 0x7f54c4105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.548+0000 7f54cbaed700 1 -- 172.21.15.45:0/1711354269 >> 172.21.15.45:0/1711354269 conn(0x7f54c40fc760 msgr2=0x7f54c40feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.548+0000 7f54cbaed700 1 -- 172.21.15.45:0/1711354269 shutdown_connections 2024-05-10T03:39:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.548+0000 7f54cbaed700 1 -- 172.21.15.45:0/1711354269 wait complete. 2024-05-10T03:39:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.548+0000 7f54cbaed700 1 Processor -- start 2024-05-10T03:39:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.549+0000 7f54cbaed700 1 -- start start 2024-05-10T03:39:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.549+0000 7f54cbaed700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54c4100e60 0x7f54c41963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.549+0000 7f54cbaed700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c4105790 0x7f54c4196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.549+0000 7f54cbaed700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54c41060e0 0x7f54c419ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.549+0000 7f54cbaed700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c419b3c0 con 0x7f54c41060e0 2024-05-10T03:39:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.549+0000 7f54cbaed700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c419b530 con 0x7f54c4100e60 2024-05-10T03:39:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.549+0000 7f54cbaed700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c419b6f0 con 0x7f54c4105790 2024-05-10T03:39:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.549+0000 7f54ca08a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54c41060e0 0x7f54c419ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.549+0000 7f54ca08a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54c41060e0 0x7f54c419ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48878/0 (socket says 172.21.15.45:48878) 2024-05-10T03:39:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.549+0000 7f54ca08a700 1 -- 172.21.15.45:0/1086480742 learned_addr learned my addr 172.21.15.45:0/1086480742 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.549+0000 7f54c9889700 1 --2- 172.21.15.45:0/1086480742 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54c4100e60 0x7f54c41963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.549+0000 7f54c9088700 1 --2- 172.21.15.45:0/1086480742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c4105790 0x7f54c4196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.549+0000 7f54ca08a700 1 -- 172.21.15.45:0/1086480742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c4105790 msgr2=0x7f54c4196940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.549+0000 7f54ca08a700 1 --2- 172.21.15.45:0/1086480742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c4105790 0x7f54c4196940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.549+0000 7f54ca08a700 1 -- 172.21.15.45:0/1086480742 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54c4100e60 msgr2=0x7f54c41963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.549+0000 7f54ca08a700 1 --2- 172.21.15.45:0/1086480742 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54c4100e60 0x7f54c41963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.549+0000 7f54ca08a700 1 -- 172.21.15.45:0/1086480742 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c00095f0 con 0x7f54c41060e0 2024-05-10T03:39:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.549+0000 7f54c9088700 1 --2- 172.21.15.45:0/1086480742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c4105790 0x7f54c4196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:25.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.550+0000 7f54ca08a700 1 --2- 172.21.15.45:0/1086480742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54c41060e0 0x7f54c419ae50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f54bc007ee0 tx=0x7f54bc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:25.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.550+0000 7f54baffd700 1 -- 172.21.15.45:0/1086480742 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc00ddd0 con 0x7f54c41060e0 2024-05-10T03:39:25.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.550+0000 7f54cbaed700 1 -- 172.21.15.45:0/1086480742 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c419b9d0 con 0x7f54c41060e0 2024-05-10T03:39:25.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.550+0000 7f54baffd700 1 -- 172.21.15.45:0/1086480742 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f54bc00f040 con 0x7f54c41060e0 2024-05-10T03:39:25.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.550+0000 7f54baffd700 1 -- 172.21.15.45:0/1086480742 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc015400 con 0x7f54c41060e0 2024-05-10T03:39:25.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.550+0000 7f54cbaed700 1 -- 172.21.15.45:0/1086480742 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c419bcb0 con 0x7f54c41060e0 2024-05-10T03:39:25.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.551+0000 7f54cbaed700 1 -- 172.21.15.45:0/1086480742 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c4109130 con 0x7f54c41060e0 2024-05-10T03:39:25.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.554+0000 7f54baffd700 1 -- 172.21.15.45:0/1086480742 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f54bc004000 con 0x7f54c41060e0 2024-05-10T03:39:25.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.554+0000 7f54baffd700 1 --2- 172.21.15.45:0/1086480742 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f54b00a11b0 0x7f54b00a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:25.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.554+0000 7f54c9889700 1 --2- 172.21.15.45:0/1086480742 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f54b00a11b0 0x7f54b00a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.554+0000 7f54baffd700 1 -- 172.21.15.45:0/1086480742 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f54bc0ccd70 con 0x7f54c41060e0 2024-05-10T03:39:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.555+0000 7f54c9889700 1 --2- 172.21.15.45:0/1086480742 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f54b00a11b0 0x7f54b00a36c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009960 tx=0x7f54c0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.558+0000 7f54baffd700 1 -- 172.21.15.45:0/1086480742 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f54bc0961b0 con 0x7f54c41060e0 2024-05-10T03:39:25.876 INFO:teuthology.orchestra.run.smithi045.stdout:193273528357 2024-05-10T03:39:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.803+0000 7f54cbaed700 1 -- 172.21.15.45:0/1086480742 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f54c404edc0 con 0x7f54c41060e0 2024-05-10T03:39:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.803+0000 7f54baffd700 1 -- 172.21.15.45:0/1086480742 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f54bc0997d0 con 0x7f54c41060e0 2024-05-10T03:39:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.805+0000 7f54cbaed700 1 -- 172.21.15.45:0/1086480742 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f54b00a11b0 msgr2=0x7f54b00a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.805+0000 7f54cbaed700 1 --2- 172.21.15.45:0/1086480742 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f54b00a11b0 0x7f54b00a36c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009960 tx=0x7f54c0005fb0 comp rx=0 tx=0).stop 2024-05-10T03:39:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.805+0000 7f54cbaed700 1 -- 172.21.15.45:0/1086480742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54c41060e0 msgr2=0x7f54c419ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.805+0000 7f54cbaed700 1 --2- 172.21.15.45:0/1086480742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54c41060e0 0x7f54c419ae50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f54bc007ee0 tx=0x7f54bc00d3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.806+0000 7f54cbaed700 1 -- 172.21.15.45:0/1086480742 shutdown_connections 2024-05-10T03:39:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.806+0000 7f54cbaed700 1 --2- 172.21.15.45:0/1086480742 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f54b00a11b0 0x7f54b00a36c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.806+0000 7f54cbaed700 1 --2- 172.21.15.45:0/1086480742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54c41060e0 0x7f54c419ae50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.806+0000 7f54cbaed700 1 --2- 172.21.15.45:0/1086480742 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54c4100e60 0x7f54c41963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.806+0000 7f54cbaed700 1 --2- 172.21.15.45:0/1086480742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c4105790 0x7f54c4196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.806+0000 7f54cbaed700 1 -- 172.21.15.45:0/1086480742 >> 172.21.15.45:0/1086480742 conn(0x7f54c40fc760 msgr2=0x7f54c4103920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.806+0000 7f54cbaed700 1 -- 172.21.15.45:0/1086480742 shutdown_connections 2024-05-10T03:39:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:25.806+0000 7f54cbaed700 1 -- 172.21.15.45:0/1086480742 wait complete. 2024-05-10T03:39:26.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:26 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1086480742' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-10T03:39:26.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-05-10T03:39:26.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-05-10T03:39:26.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-05-10T03:39:26.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-05-10T03:39:26.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [5, 8]}]: dispatch 2024-05-10T03:39:26.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-05-10T03:39:26.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-05-10T03:39:26.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-05-10T03:39:26.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-05-10T03:39:26.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-05-10T03:39:26.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:26 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1086480742' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-10T03:39:26.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-05-10T03:39:26.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-05-10T03:39:26.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-05-10T03:39:26.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-05-10T03:39:26.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [5, 8]}]: dispatch 2024-05-10T03:39:26.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-05-10T03:39:26.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-05-10T03:39:26.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-05-10T03:39:26.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-05-10T03:39:26.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-05-10T03:39:26.422 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:26.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:26 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1086480742' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-10T03:39:26.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-05-10T03:39:26.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-05-10T03:39:26.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-05-10T03:39:26.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-05-10T03:39:26.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [5, 8]}]: dispatch 2024-05-10T03:39:26.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-05-10T03:39:26.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-05-10T03:39:26.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-05-10T03:39:26.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-05-10T03:39:26.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-05-10T03:39:26.585 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:26.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.688+0000 7f5d368e2700 1 -- 172.21.15.45:0/651660589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d30102e40 msgr2=0x7f5d30103250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:26.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.688+0000 7f5d368e2700 1 --2- 172.21.15.45:0/651660589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d30102e40 0x7f5d30103250 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009990 tx=0x7f5d20009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:26.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.688+0000 7f5d368e2700 1 -- 172.21.15.45:0/651660589 shutdown_connections 2024-05-10T03:39:26.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.688+0000 7f5d368e2700 1 --2- 172.21.15.45:0/651660589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d3010c220 0x7f5d3010e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:26.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.688+0000 7f5d368e2700 1 --2- 172.21.15.45:0/651660589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d30102e40 0x7f5d30103250 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:26.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.688+0000 7f5d368e2700 1 --2- 172.21.15.45:0/651660589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d30103790 0x7f5d3010bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:26.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.688+0000 7f5d368e2700 1 -- 172.21.15.45:0/651660589 >> 172.21.15.45:0/651660589 conn(0x7f5d300fc7a0 msgr2=0x7f5d300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:26.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.688+0000 7f5d368e2700 1 -- 172.21.15.45:0/651660589 shutdown_connections 2024-05-10T03:39:26.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.688+0000 7f5d368e2700 1 -- 172.21.15.45:0/651660589 wait complete. 2024-05-10T03:39:26.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.689+0000 7f5d368e2700 1 Processor -- start 2024-05-10T03:39:26.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.689+0000 7f5d368e2700 1 -- start start 2024-05-10T03:39:26.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.690+0000 7f5d368e2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d30102e40 0x7f5d30100b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:26.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.690+0000 7f5d368e2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d30103790 0x7f5d30101070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:26.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.690+0000 7f5d368e2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d3010c220 0x7f5d301a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:26.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.690+0000 7f5d368e2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d301018e0 con 0x7f5d30102e40 2024-05-10T03:39:26.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.690+0000 7f5d368e2700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d301a6ce0 con 0x7f5d3010c220 2024-05-10T03:39:26.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.690+0000 7f5d368e2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d301a6e20 con 0x7f5d30103790 2024-05-10T03:39:26.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.690+0000 7f5d2ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d30102e40 0x7f5d30100b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:26.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.690+0000 7f5d2ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d30102e40 0x7f5d30100b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48892/0 (socket says 172.21.15.45:48892) 2024-05-10T03:39:26.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.690+0000 7f5d2ffff700 1 -- 172.21.15.45:0/51352508 learned_addr learned my addr 172.21.15.45:0/51352508 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:26.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.690+0000 7f5d2f7fe700 1 --2- 172.21.15.45:0/51352508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d30103790 0x7f5d30101070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:26.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.690+0000 7f5d34e7f700 1 --2- 172.21.15.45:0/51352508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d3010c220 0x7f5d301a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:26.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.691+0000 7f5d2ffff700 1 -- 172.21.15.45:0/51352508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d30103790 msgr2=0x7f5d30101070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:26.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.691+0000 7f5d2ffff700 1 --2- 172.21.15.45:0/51352508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d30103790 0x7f5d30101070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:26.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.691+0000 7f5d2ffff700 1 -- 172.21.15.45:0/51352508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d3010c220 msgr2=0x7f5d301a67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:26.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.691+0000 7f5d2ffff700 1 --2- 172.21.15.45:0/51352508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d3010c220 0x7f5d301a67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:26.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.691+0000 7f5d2ffff700 1 -- 172.21.15.45:0/51352508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d200095f0 con 0x7f5d30102e40 2024-05-10T03:39:26.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.691+0000 7f5d2ffff700 1 --2- 172.21.15.45:0/51352508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d30102e40 0x7f5d30100b30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5d200098e0 tx=0x7f5d2000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:26.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.691+0000 7f5d2d7fa700 1 -- 172.21.15.45:0/51352508 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2001d070 con 0x7f5d30102e40 2024-05-10T03:39:26.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.691+0000 7f5d2d7fa700 1 -- 172.21.15.45:0/51352508 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5d20003680 con 0x7f5d30102e40 2024-05-10T03:39:26.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.691+0000 7f5d368e2700 1 -- 172.21.15.45:0/51352508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d301a7050 con 0x7f5d30102e40 2024-05-10T03:39:26.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.691+0000 7f5d2d7fa700 1 -- 172.21.15.45:0/51352508 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d200173f0 con 0x7f5d30102e40 2024-05-10T03:39:26.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.691+0000 7f5d368e2700 1 -- 172.21.15.45:0/51352508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d301a7460 con 0x7f5d30102e40 2024-05-10T03:39:26.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.694+0000 7f5d368e2700 1 -- 172.21.15.45:0/51352508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d301073e0 con 0x7f5d30102e40 2024-05-10T03:39:26.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.695+0000 7f5d2d7fa700 1 -- 172.21.15.45:0/51352508 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f5d200226e0 con 0x7f5d30102e40 2024-05-10T03:39:26.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.696+0000 7f5d2d7fa700 1 --2- 172.21.15.45:0/51352508 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f5d180a11b0 0x7f5d180a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:26.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.697+0000 7f5d2d7fa700 1 -- 172.21.15.45:0/51352508 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f5d200cde40 con 0x7f5d30102e40 2024-05-10T03:39:26.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.697+0000 7f5d2f7fe700 1 --2- 172.21.15.45:0/51352508 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f5d180a11b0 0x7f5d180a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:26.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.697+0000 7f5d2f7fe700 1 --2- 172.21.15.45:0/51352508 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f5d180a11b0 0x7f5d180a36c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5d300ffbd0 tx=0x7f5d2400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:26.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.702+0000 7f5d2d7fa700 1 -- 172.21.15.45:0/51352508 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5d200971f0 con 0x7f5d30102e40 2024-05-10T03:39:26.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.929+0000 7f5d368e2700 1 -- 172.21.15.45:0/51352508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5d30069560 con 0x7f5d30102e40 2024-05-10T03:39:26.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.930+0000 7f5d2d7fa700 1 -- 172.21.15.45:0/51352508 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5d2009a810 con 0x7f5d30102e40 2024-05-10T03:39:26.934 INFO:teuthology.orchestra.run.smithi045.stdout:163208757290 2024-05-10T03:39:26.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.932+0000 7f5d368e2700 1 -- 172.21.15.45:0/51352508 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f5d180a11b0 msgr2=0x7f5d180a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:26.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.932+0000 7f5d368e2700 1 --2- 172.21.15.45:0/51352508 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f5d180a11b0 0x7f5d180a36c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5d300ffbd0 tx=0x7f5d2400b410 comp rx=0 tx=0).stop 2024-05-10T03:39:26.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.932+0000 7f5d368e2700 1 -- 172.21.15.45:0/51352508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d30102e40 msgr2=0x7f5d30100b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:26.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.932+0000 7f5d368e2700 1 --2- 172.21.15.45:0/51352508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d30102e40 0x7f5d30100b30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5d200098e0 tx=0x7f5d2000f690 comp rx=0 tx=0).stop 2024-05-10T03:39:26.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.933+0000 7f5d368e2700 1 -- 172.21.15.45:0/51352508 shutdown_connections 2024-05-10T03:39:26.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.933+0000 7f5d368e2700 1 --2- 172.21.15.45:0/51352508 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f5d180a11b0 0x7f5d180a36c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:26.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.933+0000 7f5d368e2700 1 --2- 172.21.15.45:0/51352508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d3010c220 0x7f5d301a67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:26.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.933+0000 7f5d368e2700 1 --2- 172.21.15.45:0/51352508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d30102e40 0x7f5d30100b30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.933+0000 7f5d368e2700 1 --2- 172.21.15.45:0/51352508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d30103790 0x7f5d30101070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.933+0000 7f5d368e2700 1 -- 172.21.15.45:0/51352508 >> 172.21.15.45:0/51352508 conn(0x7f5d300fc7a0 msgr2=0x7f5d300fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.933+0000 7f5d368e2700 1 -- 172.21.15.45:0/51352508 shutdown_connections 2024-05-10T03:39:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.933+0000 7f5d368e2700 1 -- 172.21.15.45:0/51352508 wait complete. 2024-05-10T03:39:26.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.949+0000 7ffab5ea5700 1 -- 172.21.15.45:0/2447201476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffab01060e0 msgr2=0x7ffab010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:26.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.949+0000 7ffab5ea5700 1 --2- 172.21.15.45:0/2447201476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffab01060e0 0x7ffab010da40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000b0a0 tx=0x7ffaa000b3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:26.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.949+0000 7ffab5ea5700 1 -- 172.21.15.45:0/2447201476 shutdown_connections 2024-05-10T03:39:26.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.949+0000 7ffab5ea5700 1 --2- 172.21.15.45:0/2447201476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffab01060e0 0x7ffab010da40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:26.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.949+0000 7ffab5ea5700 1 --2- 172.21.15.45:0/2447201476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffab0100e60 0x7ffab0101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:26.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.949+0000 7ffab5ea5700 1 --2- 172.21.15.45:0/2447201476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffab0105790 0x7ffab0105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:26.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.949+0000 7ffab5ea5700 1 -- 172.21.15.45:0/2447201476 >> 172.21.15.45:0/2447201476 conn(0x7ffab00fc760 msgr2=0x7ffab00feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:26.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.949+0000 7ffab5ea5700 1 -- 172.21.15.45:0/2447201476 shutdown_connections 2024-05-10T03:39:26.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.949+0000 7ffab5ea5700 1 -- 172.21.15.45:0/2447201476 wait complete. 2024-05-10T03:39:26.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.949+0000 7ffab5ea5700 1 Processor -- start 2024-05-10T03:39:26.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.950+0000 7ffab5ea5700 1 -- start start 2024-05-10T03:39:26.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.950+0000 7ffab5ea5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffab0100e60 0x7ffab019e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:26.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.950+0000 7ffab5ea5700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffab0105790 0x7ffab019ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:26.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.950+0000 7ffab5ea5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffab01060e0 0x7ffab0198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:26.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.950+0000 7ffab5ea5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab0198b30 con 0x7ffab01060e0 2024-05-10T03:39:26.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.950+0000 7ffab5ea5700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab0198ca0 con 0x7ffab0105790 2024-05-10T03:39:26.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.950+0000 7ffab5ea5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab0198e60 con 0x7ffab0100e60 2024-05-10T03:39:26.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.950+0000 7ffaaffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffab01060e0 0x7ffab0198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:26.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.950+0000 7ffaaf7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffab0100e60 0x7ffab019e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:26.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.950+0000 7ffaaffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffab01060e0 0x7ffab0198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48918/0 (socket says 172.21.15.45:48918) 2024-05-10T03:39:26.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.950+0000 7ffaaffff700 1 -- 172.21.15.45:0/3796739017 learned_addr learned my addr 172.21.15.45:0/3796739017 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:26.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.950+0000 7ffaaeffd700 1 --2- 172.21.15.45:0/3796739017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffab0105790 0x7ffab019ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:26.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.951+0000 7ffaaf7fe700 1 -- 172.21.15.45:0/3796739017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffab0105790 msgr2=0x7ffab019ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:26.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.951+0000 7ffaaf7fe700 1 --2- 172.21.15.45:0/3796739017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffab0105790 0x7ffab019ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:26.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.951+0000 7ffaaf7fe700 1 -- 172.21.15.45:0/3796739017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffab01060e0 msgr2=0x7ffab0198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:26.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.951+0000 7ffaaf7fe700 1 --2- 172.21.15.45:0/3796739017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffab01060e0 0x7ffab0198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:26.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.951+0000 7ffaaf7fe700 1 -- 172.21.15.45:0/3796739017 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa0009d00 con 0x7ffab0100e60 2024-05-10T03:39:26.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.951+0000 7ffaaffff700 1 --2- 172.21.15.45:0/3796739017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffab01060e0 0x7ffab0198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:39:26.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.951+0000 7ffaaf7fe700 1 --2- 172.21.15.45:0/3796739017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffab0100e60 0x7ffab019e570 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800e9f0 tx=0x7ffaa800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:26.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.951+0000 7ffaacff9700 1 -- 172.21.15.45:0/3796739017 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa800c9c0 con 0x7ffab0100e60 2024-05-10T03:39:26.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.951+0000 7ffab5ea5700 1 -- 172.21.15.45:0/3796739017 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab0199140 con 0x7ffab0100e60 2024-05-10T03:39:26.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.951+0000 7ffaacff9700 1 -- 172.21.15.45:0/3796739017 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ffaa8010430 con 0x7ffab0100e60 2024-05-10T03:39:26.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.951+0000 7ffaacff9700 1 -- 172.21.15.45:0/3796739017 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8018660 con 0x7ffab0100e60 2024-05-10T03:39:26.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.951+0000 7ffab5ea5700 1 -- 172.21.15.45:0/3796739017 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab01a55a0 con 0x7ffab0100e60 2024-05-10T03:39:26.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.952+0000 7ffab5ea5700 1 -- 172.21.15.45:0/3796739017 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab010a1a0 con 0x7ffab0100e60 2024-05-10T03:39:26.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.954+0000 7ffaacff9700 1 -- 172.21.15.45:0/3796739017 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ffaa8010910 con 0x7ffab0100e60 2024-05-10T03:39:26.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.955+0000 7ffaacff9700 1 --2- 172.21.15.45:0/3796739017 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ffa9c0a11b0 0x7ffa9c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:26.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.955+0000 7ffaaeffd700 1 --2- 172.21.15.45:0/3796739017 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ffa9c0a11b0 0x7ffa9c0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:26.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.955+0000 7ffaacff9700 1 -- 172.21.15.45:0/3796739017 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ffaa8014070 con 0x7ffab0100e60 2024-05-10T03:39:26.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.955+0000 7ffaaeffd700 1 --2- 172.21.15.45:0/3796739017 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ffa9c0a11b0 0x7ffa9c0a36c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffab00ffcb0 tx=0x7ffa98009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:26.958+0000 7ffaacff9700 1 -- 172.21.15.45:0/3796739017 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ffaa80966a0 con 0x7ffab0100e60 2024-05-10T03:39:27.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:27.189+0000 7ffab5ea5700 1 -- 172.21.15.45:0/3796739017 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffab0199c50 con 0x7ffab0100e60 2024-05-10T03:39:27.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:27.190+0000 7ffaacff9700 1 -- 172.21.15.45:0/3796739017 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffaa80105a0 con 0x7ffab0100e60 2024-05-10T03:39:27.193 INFO:teuthology.orchestra.run.smithi045.stdout:55834574903 2024-05-10T03:39:27.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:27.193+0000 7ffab5ea5700 1 -- 172.21.15.45:0/3796739017 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ffa9c0a11b0 msgr2=0x7ffa9c0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:27.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:27.193+0000 7ffab5ea5700 1 --2- 172.21.15.45:0/3796739017 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ffa9c0a11b0 0x7ffa9c0a36c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffab00ffcb0 tx=0x7ffa98009260 comp rx=0 tx=0).stop 2024-05-10T03:39:27.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:27.193+0000 7ffab5ea5700 1 -- 172.21.15.45:0/3796739017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffab0100e60 msgr2=0x7ffab019e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:27.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:27.193+0000 7ffab5ea5700 1 --2- 172.21.15.45:0/3796739017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffab0100e60 0x7ffab019e570 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800e9f0 tx=0x7ffaa800ed00 comp rx=0 tx=0).stop 2024-05-10T03:39:27.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:27.193+0000 7ffab5ea5700 1 -- 172.21.15.45:0/3796739017 shutdown_connections 2024-05-10T03:39:27.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:27.193+0000 7ffab5ea5700 1 --2- 172.21.15.45:0/3796739017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffab0100e60 0x7ffab019e570 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:27.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:27.193+0000 7ffab5ea5700 1 --2- 172.21.15.45:0/3796739017 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ffa9c0a11b0 0x7ffa9c0a36c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:27.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:27.193+0000 7ffab5ea5700 1 --2- 172.21.15.45:0/3796739017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffab01060e0 0x7ffab0198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:27.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:27.193+0000 7ffab5ea5700 1 --2- 172.21.15.45:0/3796739017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffab0105790 0x7ffab019ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:27.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:27.193+0000 7ffab5ea5700 1 -- 172.21.15.45:0/3796739017 >> 172.21.15.45:0/3796739017 conn(0x7ffab00fc760 msgr2=0x7ffab0073720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:27.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:27.194+0000 7ffab5ea5700 1 -- 172.21.15.45:0/3796739017 shutdown_connections 2024-05-10T03:39:27.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:27.194+0000 7ffab5ea5700 1 -- 172.21.15.45:0/3796739017 wait complete. 2024-05-10T03:39:27.229 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:27 smithi045 ceph-mon[42520]: pgmap v256: 129 pgs: 129 active+clean; 643 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-10T03:39:27.229 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-05-10T03:39:27.229 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-05-10T03:39:27.229 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-05-10T03:39:27.230 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-05-10T03:39:27.230 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [5, 8]}]': finished 2024-05-10T03:39:27.230 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-05-10T03:39:27.230 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-05-10T03:39:27.230 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-05-10T03:39:27.230 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-05-10T03:39:27.230 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-05-10T03:39:27.230 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:27 smithi045 ceph-mon[42520]: osdmap e87: 12 total, 12 up, 12 in 2024-05-10T03:39:27.230 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:27 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/51352508' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-10T03:39:27.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:27 smithi106 ceph-mon[46996]: pgmap v256: 129 pgs: 129 active+clean; 643 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-10T03:39:27.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:27 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-05-10T03:39:27.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:27 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-05-10T03:39:27.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:27 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-05-10T03:39:27.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:27 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-05-10T03:39:27.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:27 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [5, 8]}]': finished 2024-05-10T03:39:27.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:27 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-05-10T03:39:27.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:27 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-05-10T03:39:27.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:27 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-05-10T03:39:27.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:27 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-05-10T03:39:27.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:27 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-05-10T03:39:27.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:27 smithi106 ceph-mon[46996]: osdmap e87: 12 total, 12 up, 12 in 2024-05-10T03:39:27.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:27 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/51352508' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-10T03:39:27.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:27 smithi154 ceph-mon[46565]: pgmap v256: 129 pgs: 129 active+clean; 643 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-10T03:39:27.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:27 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-05-10T03:39:27.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:27 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-05-10T03:39:27.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:27 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-05-10T03:39:27.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:27 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-05-10T03:39:27.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:27 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [5, 8]}]': finished 2024-05-10T03:39:27.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:27 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-05-10T03:39:27.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:27 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-05-10T03:39:27.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:27 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-05-10T03:39:27.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:27 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-05-10T03:39:27.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:27 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-05-10T03:39:27.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:27 smithi154 ceph-mon[46565]: osdmap e87: 12 total, 12 up, 12 in 2024-05-10T03:39:27.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:27 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/51352508' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-10T03:39:28.237 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528355 got 193273528357 for osd.6 2024-05-10T03:39:28.237 DEBUG:teuthology.parallel:result is None 2024-05-10T03:39:28.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.258+0000 7f29321a1700 1 -- 172.21.15.45:0/1673167864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f292c100e00 msgr2=0x7f292c101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:28.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.258+0000 7f29321a1700 1 --2- 172.21.15.45:0/1673167864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f292c100e00 0x7f292c101210 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f291c009990 tx=0x7f291c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:28.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.258+0000 7f29321a1700 1 -- 172.21.15.45:0/1673167864 shutdown_connections 2024-05-10T03:39:28.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.258+0000 7f29321a1700 1 --2- 172.21.15.45:0/1673167864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f292c106080 0x7f292c10d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:28.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.258+0000 7f29321a1700 1 --2- 172.21.15.45:0/1673167864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f292c100e00 0x7f292c101210 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:28.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.258+0000 7f29321a1700 1 --2- 172.21.15.45:0/1673167864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292c105730 0x7f292c105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:28.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.258+0000 7f29321a1700 1 -- 172.21.15.45:0/1673167864 >> 172.21.15.45:0/1673167864 conn(0x7f292c0fc7a0 msgr2=0x7f292c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:28.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.258+0000 7f29321a1700 1 -- 172.21.15.45:0/1673167864 shutdown_connections 2024-05-10T03:39:28.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.258+0000 7f29321a1700 1 -- 172.21.15.45:0/1673167864 wait complete. 2024-05-10T03:39:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.259+0000 7f29321a1700 1 Processor -- start 2024-05-10T03:39:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.259+0000 7f29321a1700 1 -- start start 2024-05-10T03:39:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.259+0000 7f29321a1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f292c100e00 0x7f292c197140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.259+0000 7f29321a1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292c105730 0x7f292c197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.259+0000 7f29321a1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f292c106080 0x7f292c1a67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.259+0000 7f29321a1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292c197e70 con 0x7f292c100e00 2024-05-10T03:39:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.259+0000 7f29321a1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292c197fe0 con 0x7f292c105730 2024-05-10T03:39:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.259+0000 7f29321a1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292c1a6d50 con 0x7f292c106080 2024-05-10T03:39:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.259+0000 7f292b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f292c100e00 0x7f292c197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.259+0000 7f292b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f292c100e00 0x7f292c197140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48002/0 (socket says 172.21.15.45:48002) 2024-05-10T03:39:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.259+0000 7f292b7fe700 1 -- 172.21.15.45:0/924413562 learned_addr learned my addr 172.21.15.45:0/924413562 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.259+0000 7f292affd700 1 --2- 172.21.15.45:0/924413562 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292c105730 0x7f292c197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.260+0000 7f292bfff700 1 --2- 172.21.15.45:0/924413562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f292c106080 0x7f292c1a67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.260+0000 7f292b7fe700 1 -- 172.21.15.45:0/924413562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f292c106080 msgr2=0x7f292c1a67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.260+0000 7f292b7fe700 1 --2- 172.21.15.45:0/924413562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f292c106080 0x7f292c1a67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.260+0000 7f292b7fe700 1 -- 172.21.15.45:0/924413562 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292c105730 msgr2=0x7f292c197680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.260+0000 7f292b7fe700 1 --2- 172.21.15.45:0/924413562 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292c105730 0x7f292c197680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.260+0000 7f292b7fe700 1 -- 172.21.15.45:0/924413562 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291c0095f0 con 0x7f292c100e00 2024-05-10T03:39:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.260+0000 7f292bfff700 1 --2- 172.21.15.45:0/924413562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f292c106080 0x7f292c1a67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:39:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.260+0000 7f292b7fe700 1 --2- 172.21.15.45:0/924413562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f292c100e00 0x7f292c197140 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f291c0098e0 tx=0x7f291c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.260+0000 7f2928ff9700 1 -- 172.21.15.45:0/924413562 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c01d070 con 0x7f292c100e00 2024-05-10T03:39:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.260+0000 7f2928ff9700 1 -- 172.21.15.45:0/924413562 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f291c003680 con 0x7f292c100e00 2024-05-10T03:39:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.260+0000 7f2928ff9700 1 -- 172.21.15.45:0/924413562 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c0173f0 con 0x7f292c100e00 2024-05-10T03:39:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.260+0000 7f29321a1700 1 -- 172.21.15.45:0/924413562 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f292c1a6fd0 con 0x7f292c100e00 2024-05-10T03:39:28.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.260+0000 7f29321a1700 1 -- 172.21.15.45:0/924413562 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f292c1a7330 con 0x7f292c100e00 2024-05-10T03:39:28.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.262+0000 7f29321a1700 1 -- 172.21.15.45:0/924413562 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f292c1090d0 con 0x7f292c100e00 2024-05-10T03:39:28.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.263+0000 7f2928ff9700 1 -- 172.21.15.45:0/924413562 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f291c022470 con 0x7f292c100e00 2024-05-10T03:39:28.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.263+0000 7f2928ff9700 1 --2- 172.21.15.45:0/924413562 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f29140a11b0 0x7f29140a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:28.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.264+0000 7f292affd700 1 --2- 172.21.15.45:0/924413562 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f29140a11b0 0x7f29140a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:28.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.264+0000 7f2928ff9700 1 -- 172.21.15.45:0/924413562 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f291c0cdf00 con 0x7f292c100e00 2024-05-10T03:39:28.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.264+0000 7f292affd700 1 --2- 172.21.15.45:0/924413562 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f29140a11b0 0x7f29140a36c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f292c0697d0 tx=0x7f29200073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:28.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.268+0000 7f2928ff9700 1 -- 172.21.15.45:0/924413562 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f291c09ad40 con 0x7f292c100e00 2024-05-10T03:39:28.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:28 smithi106 ceph-mon[46996]: osdmap e88: 12 total, 12 up, 12 in 2024-05-10T03:39:28.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:28 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3796739017' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-10T03:39:28.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:28 smithi154 ceph-mon[46565]: osdmap e88: 12 total, 12 up, 12 in 2024-05-10T03:39:28.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:28 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3796739017' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-10T03:39:28.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.497+0000 7f29321a1700 1 -- 172.21.15.45:0/924413562 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f292c1022b0 con 0x7f292c100e00 2024-05-10T03:39:28.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.498+0000 7f2928ff9700 1 -- 172.21.15.45:0/924413562 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f291c09a8d0 con 0x7f292c100e00 2024-05-10T03:39:28.501 INFO:teuthology.orchestra.run.smithi045.stdout:141733920813 2024-05-10T03:39:28.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.500+0000 7f29321a1700 1 -- 172.21.15.45:0/924413562 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f29140a11b0 msgr2=0x7f29140a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:28.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.500+0000 7f29321a1700 1 --2- 172.21.15.45:0/924413562 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f29140a11b0 0x7f29140a36c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f292c0697d0 tx=0x7f29200073d0 comp rx=0 tx=0).stop 2024-05-10T03:39:28.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.500+0000 7f29321a1700 1 -- 172.21.15.45:0/924413562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f292c100e00 msgr2=0x7f292c197140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:28.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.500+0000 7f29321a1700 1 --2- 172.21.15.45:0/924413562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f292c100e00 0x7f292c197140 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f291c0098e0 tx=0x7f291c00f690 comp rx=0 tx=0).stop 2024-05-10T03:39:28.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.500+0000 7f29321a1700 1 -- 172.21.15.45:0/924413562 shutdown_connections 2024-05-10T03:39:28.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.500+0000 7f29321a1700 1 --2- 172.21.15.45:0/924413562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f292c106080 0x7f292c1a67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:28.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.500+0000 7f29321a1700 1 --2- 172.21.15.45:0/924413562 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f29140a11b0 0x7f29140a36c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:28.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.500+0000 7f29321a1700 1 --2- 172.21.15.45:0/924413562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f292c100e00 0x7f292c197140 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:28.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.500+0000 7f29321a1700 1 --2- 172.21.15.45:0/924413562 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292c105730 0x7f292c197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:28.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.500+0000 7f29321a1700 1 -- 172.21.15.45:0/924413562 >> 172.21.15.45:0/924413562 conn(0x7f292c0fc7a0 msgr2=0x7f292c104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:28.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.500+0000 7f29321a1700 1 -- 172.21.15.45:0/924413562 shutdown_connections 2024-05-10T03:39:28.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:28.500+0000 7f29321a1700 1 -- 172.21.15.45:0/924413562 wait complete. 2024-05-10T03:39:28.519 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:28 smithi045 ceph-mon[42520]: osdmap e88: 12 total, 12 up, 12 in 2024-05-10T03:39:28.520 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:28 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3796739017' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-10T03:39:28.541 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757287 got 163208757290 for osd.5 2024-05-10T03:39:28.541 DEBUG:teuthology.parallel:result is None 2024-05-10T03:39:28.588 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:28.615 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574901 got 55834574903 for osd.1 2024-05-10T03:39:28.615 DEBUG:teuthology.parallel:result is None 2024-05-10T03:39:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:29.367 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:29 smithi045 ceph-mon[42520]: pgmap v259: 129 pgs: 2 peering, 127 active+clean; 643 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-05-10T03:39:29.368 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:29 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/924413562' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-10T03:39:29.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:29 smithi106 ceph-mon[46996]: pgmap v259: 129 pgs: 2 peering, 127 active+clean; 643 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-05-10T03:39:29.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:29 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/924413562' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-10T03:39:29.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:29 smithi154 ceph-mon[46565]: pgmap v259: 129 pgs: 2 peering, 127 active+clean; 643 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-05-10T03:39:29.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:29 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/924413562' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-10T03:39:29.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.822+0000 7f7feddc7700 1 -- 172.21.15.45:0/4174478748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fe8103750 msgr2=0x7f7fe810bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:29.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.822+0000 7f7feddc7700 1 --2- 172.21.15.45:0/4174478748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fe8103750 0x7f7fe810bca0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc009990 tx=0x7f7fdc009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:29.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.822+0000 7f7feddc7700 1 -- 172.21.15.45:0/4174478748 shutdown_connections 2024-05-10T03:39:29.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.822+0000 7f7feddc7700 1 --2- 172.21.15.45:0/4174478748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fe8102e00 0x7f7fe8103210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:29.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.822+0000 7f7feddc7700 1 --2- 172.21.15.45:0/4174478748 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fe810c230 0x7f7fe810e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:29.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.822+0000 7f7feddc7700 1 --2- 172.21.15.45:0/4174478748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fe8103750 0x7f7fe810bca0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.822+0000 7f7feddc7700 1 -- 172.21.15.45:0/4174478748 >> 172.21.15.45:0/4174478748 conn(0x7f7fe80fc7a0 msgr2=0x7f7fe80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.822+0000 7f7feddc7700 1 -- 172.21.15.45:0/4174478748 shutdown_connections 2024-05-10T03:39:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.822+0000 7f7feddc7700 1 -- 172.21.15.45:0/4174478748 wait complete. 2024-05-10T03:39:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.823+0000 7f7feddc7700 1 Processor -- start 2024-05-10T03:39:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.823+0000 7f7feddc7700 1 -- start start 2024-05-10T03:39:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.824+0000 7f7feddc7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fe8102e00 0x7f7fe819e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.824+0000 7f7feddc7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fe8103750 0x7f7fe819e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.824+0000 7f7feddc7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fe810c230 0x7f7fe81983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.824+0000 7f7feddc7700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe81989a0 con 0x7f7fe810c230 2024-05-10T03:39:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.824+0000 7f7feddc7700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe8198b10 con 0x7f7fe8102e00 2024-05-10T03:39:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.824+0000 7f7feddc7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe8198cd0 con 0x7f7fe8103750 2024-05-10T03:39:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.824+0000 7f7fe7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fe810c230 0x7f7fe81983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.824+0000 7f7fe6ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fe8103750 0x7f7fe819e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:29.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.824+0000 7f7fe7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fe810c230 0x7f7fe81983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48012/0 (socket says 172.21.15.45:48012) 2024-05-10T03:39:29.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.824+0000 7f7fe7fff700 1 -- 172.21.15.45:0/2864778291 learned_addr learned my addr 172.21.15.45:0/2864778291 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:29.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.824+0000 7f7fe77fe700 1 --2- 172.21.15.45:0/2864778291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fe8102e00 0x7f7fe819e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:29.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.824+0000 7f7fe7fff700 1 -- 172.21.15.45:0/2864778291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fe8103750 msgr2=0x7f7fe819e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:29.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.824+0000 7f7fe7fff700 1 --2- 172.21.15.45:0/2864778291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fe8103750 0x7f7fe819e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:29.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.824+0000 7f7fe7fff700 1 -- 172.21.15.45:0/2864778291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fe8102e00 msgr2=0x7f7fe819e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:29.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.824+0000 7f7fe7fff700 1 --2- 172.21.15.45:0/2864778291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fe8102e00 0x7f7fe819e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:29.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.824+0000 7f7fe7fff700 1 -- 172.21.15.45:0/2864778291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fdc0095f0 con 0x7f7fe810c230 2024-05-10T03:39:29.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.824+0000 7f7fe7fff700 1 --2- 172.21.15.45:0/2864778291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fe810c230 0x7f7fe81983d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0007ee0 tx=0x7f7fe000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:29.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.824+0000 7f7fe4ff9700 1 -- 172.21.15.45:0/2864778291 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe0017070 con 0x7f7fe810c230 2024-05-10T03:39:29.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.825+0000 7f7fe4ff9700 1 -- 172.21.15.45:0/2864778291 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7fe000f040 con 0x7f7fe810c230 2024-05-10T03:39:29.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.825+0000 7f7feddc7700 1 -- 172.21.15.45:0/2864778291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe8198fb0 con 0x7f7fe810c230 2024-05-10T03:39:29.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.825+0000 7f7fe4ff9700 1 -- 172.21.15.45:0/2864778291 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe0005610 con 0x7f7fe810c230 2024-05-10T03:39:29.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.825+0000 7f7feddc7700 1 -- 172.21.15.45:0/2864778291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe81a5440 con 0x7f7fe810c230 2024-05-10T03:39:29.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.826+0000 7f7feddc7700 1 -- 172.21.15.45:0/2864778291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe81073f0 con 0x7f7fe810c230 2024-05-10T03:39:29.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.827+0000 7f7fe4ff9700 1 -- 172.21.15.45:0/2864778291 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f7fe0005770 con 0x7f7fe810c230 2024-05-10T03:39:29.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.828+0000 7f7fe4ff9700 1 --2- 172.21.15.45:0/2864778291 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7fd00a11b0 0x7f7fd00a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:29.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.828+0000 7f7fe77fe700 1 --2- 172.21.15.45:0/2864778291 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7fd00a11b0 0x7f7fd00a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:29.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.828+0000 7f7fe4ff9700 1 -- 172.21.15.45:0/2864778291 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f7fe00ccae0 con 0x7f7fe810c230 2024-05-10T03:39:29.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.828+0000 7f7fe77fe700 1 --2- 172.21.15.45:0/2864778291 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7fd00a11b0 0x7f7fd00a36c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8199840 tx=0x7f7fd800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:29.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:29.832+0000 7f7fe4ff9700 1 -- 172.21.15.45:0/2864778291 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7fe0095e00 con 0x7f7fe810c230 2024-05-10T03:39:30.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.054+0000 7f7feddc7700 1 -- 172.21.15.45:0/2864778291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7fe80695a0 con 0x7f7fe810c230 2024-05-10T03:39:30.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.055+0000 7f7fe4ff9700 1 -- 172.21.15.45:0/2864778291 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7fe0009390 con 0x7f7fe810c230 2024-05-10T03:39:30.059 INFO:teuthology.orchestra.run.smithi045.stdout:77309411381 2024-05-10T03:39:30.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.058+0000 7f7feddc7700 1 -- 172.21.15.45:0/2864778291 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7fd00a11b0 msgr2=0x7f7fd00a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:30.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.058+0000 7f7feddc7700 1 --2- 172.21.15.45:0/2864778291 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7fd00a11b0 0x7f7fd00a36c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8199840 tx=0x7f7fd800b410 comp rx=0 tx=0).stop 2024-05-10T03:39:30.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.058+0000 7f7feddc7700 1 -- 172.21.15.45:0/2864778291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fe810c230 msgr2=0x7f7fe81983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:30.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.058+0000 7f7feddc7700 1 --2- 172.21.15.45:0/2864778291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fe810c230 0x7f7fe81983d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0007ee0 tx=0x7f7fe000d3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:30.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.058+0000 7f7feddc7700 1 -- 172.21.15.45:0/2864778291 shutdown_connections 2024-05-10T03:39:30.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.058+0000 7f7feddc7700 1 --2- 172.21.15.45:0/2864778291 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7fd00a11b0 0x7f7fd00a36c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:30.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.058+0000 7f7feddc7700 1 --2- 172.21.15.45:0/2864778291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fe810c230 0x7f7fe81983d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:30.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.058+0000 7f7feddc7700 1 --2- 172.21.15.45:0/2864778291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fe8102e00 0x7f7fe819e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:30.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.058+0000 7f7feddc7700 1 --2- 172.21.15.45:0/2864778291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fe8103750 0x7f7fe819e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:30.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.058+0000 7f7feddc7700 1 -- 172.21.15.45:0/2864778291 >> 172.21.15.45:0/2864778291 conn(0x7f7fe80fc7a0 msgr2=0x7f7fe80fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:30.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.058+0000 7f7feddc7700 1 -- 172.21.15.45:0/2864778291 shutdown_connections 2024-05-10T03:39:30.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.058+0000 7f7feddc7700 1 -- 172.21.15.45:0/2864778291 wait complete. 2024-05-10T03:39:30.222 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:30 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2864778291' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-10T03:39:30.229 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920811 got 141733920813 for osd.4 2024-05-10T03:39:30.229 DEBUG:teuthology.parallel:result is None 2024-05-10T03:39:30.286 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.383+0000 7f7f56d5a700 1 -- 172.21.15.45:0/1890750868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f50105770 msgr2=0x7f7f50105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.383+0000 7f7f56d5a700 1 --2- 172.21.15.45:0/1890750868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f50105770 0x7f7f50105b80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c009990 tx=0x7f7f3c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.384+0000 7f7f56d5a700 1 -- 172.21.15.45:0/1890750868 shutdown_connections 2024-05-10T03:39:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.384+0000 7f7f56d5a700 1 --2- 172.21.15.45:0/1890750868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f501060c0 0x7f7f5010da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.384+0000 7f7f56d5a700 1 --2- 172.21.15.45:0/1890750868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f50100e40 0x7f7f50101250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.384+0000 7f7f56d5a700 1 --2- 172.21.15.45:0/1890750868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f50105770 0x7f7f50105b80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.384+0000 7f7f56d5a700 1 -- 172.21.15.45:0/1890750868 >> 172.21.15.45:0/1890750868 conn(0x7f7f500fc730 msgr2=0x7f7f500feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.384+0000 7f7f56d5a700 1 -- 172.21.15.45:0/1890750868 shutdown_connections 2024-05-10T03:39:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.384+0000 7f7f56d5a700 1 -- 172.21.15.45:0/1890750868 wait complete. 2024-05-10T03:39:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.385+0000 7f7f56d5a700 1 Processor -- start 2024-05-10T03:39:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.385+0000 7f7f56d5a700 1 -- start start 2024-05-10T03:39:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.385+0000 7f7f56d5a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f50100e40 0x7f7f501974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.385+0000 7f7f56d5a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f50105770 0x7f7f50197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.385+0000 7f7f56d5a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f501060c0 0x7f7f5019bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.385+0000 7f7f56d5a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5019c500 con 0x7f7f501060c0 2024-05-10T03:39:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.385+0000 7f7f56d5a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5019c670 con 0x7f7f50100e40 2024-05-10T03:39:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.385+0000 7f7f56d5a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5019c830 con 0x7f7f50105770 2024-05-10T03:39:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.385+0000 7f7f552f7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f501060c0 0x7f7f5019bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.385+0000 7f7f552f7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f501060c0 0x7f7f5019bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48036/0 (socket says 172.21.15.45:48036) 2024-05-10T03:39:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.386+0000 7f7f552f7700 1 -- 172.21.15.45:0/2731699730 learned_addr learned my addr 172.21.15.45:0/2731699730 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.386+0000 7f7f54af6700 1 --2- 172.21.15.45:0/2731699730 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f50100e40 0x7f7f501974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.386+0000 7f7f4ffff700 1 --2- 172.21.15.45:0/2731699730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f50105770 0x7f7f50197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.386+0000 7f7f552f7700 1 -- 172.21.15.45:0/2731699730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f50105770 msgr2=0x7f7f50197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.386+0000 7f7f552f7700 1 --2- 172.21.15.45:0/2731699730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f50105770 0x7f7f50197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.386+0000 7f7f552f7700 1 -- 172.21.15.45:0/2731699730 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f50100e40 msgr2=0x7f7f501974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.386+0000 7f7f552f7700 1 --2- 172.21.15.45:0/2731699730 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f50100e40 0x7f7f501974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:30.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.386+0000 7f7f552f7700 1 -- 172.21.15.45:0/2731699730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c0095f0 con 0x7f7f501060c0 2024-05-10T03:39:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.386+0000 7f7f552f7700 1 --2- 172.21.15.45:0/2731699730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f501060c0 0x7f7f5019bf90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7f48007ee0 tx=0x7f7f4800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.386+0000 7f7f4dffb700 1 -- 172.21.15.45:0/2731699730 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f48017070 con 0x7f7f501060c0 2024-05-10T03:39:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.386+0000 7f7f4dffb700 1 -- 172.21.15.45:0/2731699730 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7f4800f040 con 0x7f7f501060c0 2024-05-10T03:39:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.386+0000 7f7f4dffb700 1 -- 172.21.15.45:0/2731699730 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f48005760 con 0x7f7f501060c0 2024-05-10T03:39:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.387+0000 7f7f56d5a700 1 -- 172.21.15.45:0/2731699730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5019cb10 con 0x7f7f501060c0 2024-05-10T03:39:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.387+0000 7f7f56d5a700 1 -- 172.21.15.45:0/2731699730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f5019cdf0 con 0x7f7f501060c0 2024-05-10T03:39:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.388+0000 7f7f56d5a700 1 -- 172.21.15.45:0/2731699730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f50109170 con 0x7f7f501060c0 2024-05-10T03:39:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.389+0000 7f7f4dffb700 1 -- 172.21.15.45:0/2731699730 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f7f480058c0 con 0x7f7f501060c0 2024-05-10T03:39:30.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.390+0000 7f7f4dffb700 1 --2- 172.21.15.45:0/2731699730 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7f400a11b0 0x7f7f400a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:30.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.390+0000 7f7f4dffb700 1 -- 172.21.15.45:0/2731699730 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f7f480cc490 con 0x7f7f501060c0 2024-05-10T03:39:30.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.390+0000 7f7f54af6700 1 --2- 172.21.15.45:0/2731699730 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7f400a11b0 0x7f7f400a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:30.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.391+0000 7f7f54af6700 1 --2- 172.21.15.45:0/2731699730 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7f400a11b0 0x7f7f400a36c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7f44009c60 tx=0x7f7f44009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:30.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.395+0000 7f7f4dffb700 1 -- 172.21.15.45:0/2731699730 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7f480957b0 con 0x7f7f501060c0 2024-05-10T03:39:30.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:30 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2864778291' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-10T03:39:30.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:30 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2864778291' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-10T03:39:30.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.625+0000 7f7f56d5a700 1 -- 172.21.15.45:0/2731699730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7f5004edc0 con 0x7f7f501060c0 2024-05-10T03:39:30.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.625+0000 7f7f4dffb700 1 -- 172.21.15.45:0/2731699730 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7f48098dd0 con 0x7f7f501060c0 2024-05-10T03:39:30.629 INFO:teuthology.orchestra.run.smithi045.stdout:34359738428 2024-05-10T03:39:30.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.628+0000 7f7f56d5a700 1 -- 172.21.15.45:0/2731699730 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7f400a11b0 msgr2=0x7f7f400a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:30.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.628+0000 7f7f56d5a700 1 --2- 172.21.15.45:0/2731699730 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7f400a11b0 0x7f7f400a36c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7f44009c60 tx=0x7f7f44009260 comp rx=0 tx=0).stop 2024-05-10T03:39:30.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.628+0000 7f7f56d5a700 1 -- 172.21.15.45:0/2731699730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f501060c0 msgr2=0x7f7f5019bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:30.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.628+0000 7f7f56d5a700 1 --2- 172.21.15.45:0/2731699730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f501060c0 0x7f7f5019bf90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7f48007ee0 tx=0x7f7f4800d3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:30.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.628+0000 7f7f56d5a700 1 -- 172.21.15.45:0/2731699730 shutdown_connections 2024-05-10T03:39:30.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.628+0000 7f7f56d5a700 1 --2- 172.21.15.45:0/2731699730 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7f400a11b0 0x7f7f400a36c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:30.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.628+0000 7f7f56d5a700 1 --2- 172.21.15.45:0/2731699730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f501060c0 0x7f7f5019bf90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:30.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.628+0000 7f7f56d5a700 1 --2- 172.21.15.45:0/2731699730 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f50100e40 0x7f7f501974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:30.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.628+0000 7f7f56d5a700 1 --2- 172.21.15.45:0/2731699730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f50105770 0x7f7f50197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:30.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.628+0000 7f7f56d5a700 1 -- 172.21.15.45:0/2731699730 >> 172.21.15.45:0/2731699730 conn(0x7f7f500fc730 msgr2=0x7f7f50107020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:30.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.628+0000 7f7f56d5a700 1 -- 172.21.15.45:0/2731699730 shutdown_connections 2024-05-10T03:39:30.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.628+0000 7f7f56d5a700 1 -- 172.21.15.45:0/2731699730 wait complete. 2024-05-10T03:39:30.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.679+0000 7f71a417e700 1 -- 172.21.15.45:0/738429338 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f719c1071b0 msgr2=0x7f719c10eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:30.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.679+0000 7f71a417e700 1 --2- 172.21.15.45:0/738429338 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f719c1071b0 0x7f719c10eb10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7194009f90 tx=0x7f719400b330 comp rx=0 tx=0).stop 2024-05-10T03:39:30.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.679+0000 7f71a417e700 1 -- 172.21.15.45:0/738429338 shutdown_connections 2024-05-10T03:39:30.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.679+0000 7f71a417e700 1 --2- 172.21.15.45:0/738429338 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f719c1071b0 0x7f719c10eb10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:30.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.679+0000 7f71a417e700 1 --2- 172.21.15.45:0/738429338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f719c101f30 0x7f719c102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:30.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.679+0000 7f71a417e700 1 --2- 172.21.15.45:0/738429338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f719c106860 0x7f719c106c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:30.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.679+0000 7f71a417e700 1 -- 172.21.15.45:0/738429338 >> 172.21.15.45:0/738429338 conn(0x7f719c0fd9c0 msgr2=0x7f719c0ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:30.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.680+0000 7f71a417e700 1 -- 172.21.15.45:0/738429338 shutdown_connections 2024-05-10T03:39:30.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.680+0000 7f71a417e700 1 -- 172.21.15.45:0/738429338 wait complete. 2024-05-10T03:39:30.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.680+0000 7f71a417e700 1 Processor -- start 2024-05-10T03:39:30.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.680+0000 7f71a417e700 1 -- start start 2024-05-10T03:39:30.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.681+0000 7f71a417e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f719c101f30 0x7f719c19e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:30.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.681+0000 7f71a417e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f719c106860 0x7f719c19eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:30.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.681+0000 7f71a417e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f719c1071b0 0x7f719c198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:30.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.681+0000 7f71a417e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c198b50 con 0x7f719c1071b0 2024-05-10T03:39:30.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.681+0000 7f71a417e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c198c90 con 0x7f719c101f30 2024-05-10T03:39:30.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.681+0000 7f71a417e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c198e50 con 0x7f719c106860 2024-05-10T03:39:30.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.681+0000 7f71a271b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f719c1071b0 0x7f719c198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:30.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.681+0000 7f71a1f1a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f719c101f30 0x7f719c19e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:30.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.681+0000 7f71a271b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f719c1071b0 0x7f719c198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48056/0 (socket says 172.21.15.45:48056) 2024-05-10T03:39:30.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.681+0000 7f71a271b700 1 -- 172.21.15.45:0/3272067711 learned_addr learned my addr 172.21.15.45:0/3272067711 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:30.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.681+0000 7f71a1719700 1 --2- 172.21.15.45:0/3272067711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f719c106860 0x7f719c19eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:30.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.681+0000 7f71a271b700 1 -- 172.21.15.45:0/3272067711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f719c106860 msgr2=0x7f719c19eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:30.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.681+0000 7f71a271b700 1 --2- 172.21.15.45:0/3272067711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f719c106860 0x7f719c19eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:30.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.681+0000 7f71a271b700 1 -- 172.21.15.45:0/3272067711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f719c101f30 msgr2=0x7f719c19e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:30.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.681+0000 7f71a271b700 1 --2- 172.21.15.45:0/3272067711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f719c101f30 0x7f719c19e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:30.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.681+0000 7f71a271b700 1 -- 172.21.15.45:0/3272067711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71980095f0 con 0x7f719c1071b0 2024-05-10T03:39:30.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.681+0000 7f71a1f1a700 1 --2- 172.21.15.45:0/3272067711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f719c101f30 0x7f719c19e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:39:30.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.681+0000 7f71a271b700 1 --2- 172.21.15.45:0/3272067711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f719c1071b0 0x7f719c198580 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f71940079f0 tx=0x7f7194007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:30.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.682+0000 7f7192ffd700 1 -- 172.21.15.45:0/3272067711 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719400e040 con 0x7f719c1071b0 2024-05-10T03:39:30.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.682+0000 7f71a417e700 1 -- 172.21.15.45:0/3272067711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7194009c40 con 0x7f719c1071b0 2024-05-10T03:39:30.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.682+0000 7f7192ffd700 1 -- 172.21.15.45:0/3272067711 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f719401d470 con 0x7f719c1071b0 2024-05-10T03:39:30.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.682+0000 7f7192ffd700 1 -- 172.21.15.45:0/3272067711 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71940052a0 con 0x7f719c1071b0 2024-05-10T03:39:30.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.682+0000 7f71a417e700 1 -- 172.21.15.45:0/3272067711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719c1993b0 con 0x7f719c1071b0 2024-05-10T03:39:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.683+0000 7f71a417e700 1 -- 172.21.15.45:0/3272067711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719c10a260 con 0x7f719c1071b0 2024-05-10T03:39:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.684+0000 7f7192ffd700 1 -- 172.21.15.45:0/3272067711 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f719401d950 con 0x7f719c1071b0 2024-05-10T03:39:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.685+0000 7f7192ffd700 1 --2- 172.21.15.45:0/3272067711 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f71880a11b0 0x7f71880a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:30.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.685+0000 7f71a1f1a700 1 --2- 172.21.15.45:0/3272067711 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f71880a11b0 0x7f71880a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:30.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.685+0000 7f7192ffd700 1 -- 172.21.15.45:0/3272067711 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f71940ce3f0 con 0x7f719c1071b0 2024-05-10T03:39:30.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.686+0000 7f71a1f1a700 1 --2- 172.21.15.45:0/3272067711 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f71880a11b0 0x7f71880a36c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f719c101380 tx=0x7f7198009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:30.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.689+0000 7f7192ffd700 1 -- 172.21.15.45:0/3272067711 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7194097740 con 0x7f719c1071b0 2024-05-10T03:39:30.772 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:30.802 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411380 got 77309411381 for osd.2 2024-05-10T03:39:30.802 DEBUG:teuthology.parallel:result is None 2024-05-10T03:39:30.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.906+0000 7f71a417e700 1 -- 172.21.15.45:0/3272067711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f719c1033e0 con 0x7f719c1071b0 2024-05-10T03:39:30.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.907+0000 7f7192ffd700 1 -- 172.21.15.45:0/3272067711 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f719409ad60 con 0x7f719c1071b0 2024-05-10T03:39:30.910 INFO:teuthology.orchestra.run.smithi045.stdout:326417514516 2024-05-10T03:39:30.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.909+0000 7f71a417e700 1 -- 172.21.15.45:0/3272067711 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f71880a11b0 msgr2=0x7f71880a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.909+0000 7f71a417e700 1 --2- 172.21.15.45:0/3272067711 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f71880a11b0 0x7f71880a36c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f719c101380 tx=0x7f7198009310 comp rx=0 tx=0).stop 2024-05-10T03:39:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.909+0000 7f71a417e700 1 -- 172.21.15.45:0/3272067711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f719c1071b0 msgr2=0x7f719c198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.909+0000 7f71a417e700 1 --2- 172.21.15.45:0/3272067711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f719c1071b0 0x7f719c198580 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f71940079f0 tx=0x7f7194007a20 comp rx=0 tx=0).stop 2024-05-10T03:39:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.909+0000 7f71a417e700 1 -- 172.21.15.45:0/3272067711 shutdown_connections 2024-05-10T03:39:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.909+0000 7f71a417e700 1 --2- 172.21.15.45:0/3272067711 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f71880a11b0 0x7f71880a36c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.909+0000 7f71a417e700 1 --2- 172.21.15.45:0/3272067711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f719c1071b0 0x7f719c198580 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.909+0000 7f71a417e700 1 --2- 172.21.15.45:0/3272067711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f719c101f30 0x7f719c19e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.909+0000 7f71a417e700 1 --2- 172.21.15.45:0/3272067711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f719c106860 0x7f719c19eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.909+0000 7f71a417e700 1 -- 172.21.15.45:0/3272067711 >> 172.21.15.45:0/3272067711 conn(0x7f719c0fd9c0 msgr2=0x7f719c105fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.909+0000 7f71a417e700 1 -- 172.21.15.45:0/3272067711 shutdown_connections 2024-05-10T03:39:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:30.909+0000 7f71a417e700 1 -- 172.21.15.45:0/3272067711 wait complete. 2024-05-10T03:39:31.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:31 smithi106 ceph-mon[46996]: pgmap v260: 129 pgs: 2 peering, 127 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 255 B/s wr, 10 op/s; 7.7 KiB/s, 1 objects/s recovering 2024-05-10T03:39:31.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:31 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2731699730' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-10T03:39:31.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:31 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3272067711' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-10T03:39:31.466 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:31 smithi045 ceph-mon[42520]: pgmap v260: 129 pgs: 2 peering, 127 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 255 B/s wr, 10 op/s; 7.7 KiB/s, 1 objects/s recovering 2024-05-10T03:39:31.467 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:31 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2731699730' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-10T03:39:31.467 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:31 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3272067711' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-10T03:39:31.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:31 smithi154 ceph-mon[46565]: pgmap v260: 129 pgs: 2 peering, 127 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 255 B/s wr, 10 op/s; 7.7 KiB/s, 1 objects/s recovering 2024-05-10T03:39:31.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:31 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2731699730' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-10T03:39:31.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:31 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3272067711' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-10T03:39:31.639 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738426 got 34359738428 for osd.0 2024-05-10T03:39:31.639 DEBUG:teuthology.parallel:result is None 2024-05-10T03:39:32.062 INFO:tasks.cephadm.ceph_manager.ceph:need seq 326417514515 got 326417514516 for osd.11 2024-05-10T03:39:32.062 DEBUG:teuthology.parallel:result is None 2024-05-10T03:39:32.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.639+0000 7fa2cef3e700 1 -- 172.21.15.45:0/3803029549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2c8103790 msgr2=0x7fa2c810bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:32.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.639+0000 7fa2cef3e700 1 --2- 172.21.15.45:0/3803029549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2c8103790 0x7fa2c810bce0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc009990 tx=0x7fa2bc009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:32.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.639+0000 7fa2cef3e700 1 -- 172.21.15.45:0/3803029549 shutdown_connections 2024-05-10T03:39:32.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.639+0000 7fa2cef3e700 1 --2- 172.21.15.45:0/3803029549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2c810c270 0x7fa2c810e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:32.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.639+0000 7fa2cef3e700 1 --2- 172.21.15.45:0/3803029549 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2c8102e40 0x7fa2c8103250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:32.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.639+0000 7fa2cef3e700 1 --2- 172.21.15.45:0/3803029549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2c8103790 0x7fa2c810bce0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:32.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.639+0000 7fa2cef3e700 1 -- 172.21.15.45:0/3803029549 >> 172.21.15.45:0/3803029549 conn(0x7fa2c80fc760 msgr2=0x7fa2c80feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:32.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.639+0000 7fa2cef3e700 1 -- 172.21.15.45:0/3803029549 shutdown_connections 2024-05-10T03:39:32.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.639+0000 7fa2cef3e700 1 -- 172.21.15.45:0/3803029549 wait complete. 2024-05-10T03:39:32.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.640+0000 7fa2cef3e700 1 Processor -- start 2024-05-10T03:39:32.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.640+0000 7fa2cef3e700 1 -- start start 2024-05-10T03:39:32.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.641+0000 7fa2cef3e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2c8102e40 0x7fa2c819e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:32.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.641+0000 7fa2cef3e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2c8103790 0x7fa2c819e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:32.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.641+0000 7fa2cef3e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2c810c270 0x7fa2c8198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:32.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.641+0000 7fa2cef3e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c81989e0 con 0x7fa2c8102e40 2024-05-10T03:39:32.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.641+0000 7fa2cef3e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c8198b50 con 0x7fa2c8103790 2024-05-10T03:39:32.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.641+0000 7fa2cef3e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c8198d10 con 0x7fa2c810c270 2024-05-10T03:39:32.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.641+0000 7fa2cccda700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2c8102e40 0x7fa2c819e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:32.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.641+0000 7fa2cccda700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2c8102e40 0x7fa2c819e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48078/0 (socket says 172.21.15.45:48078) 2024-05-10T03:39:32.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.641+0000 7fa2cccda700 1 -- 172.21.15.45:0/3483461226 learned_addr learned my addr 172.21.15.45:0/3483461226 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:32.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.641+0000 7fa2cd4db700 1 --2- 172.21.15.45:0/3483461226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2c810c270 0x7fa2c8198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:32.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.641+0000 7fa2c7fff700 1 --2- 172.21.15.45:0/3483461226 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2c8103790 0x7fa2c819e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:32.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.641+0000 7fa2cccda700 1 -- 172.21.15.45:0/3483461226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2c810c270 msgr2=0x7fa2c8198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:32.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.641+0000 7fa2cccda700 1 --2- 172.21.15.45:0/3483461226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2c810c270 0x7fa2c8198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:32.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.641+0000 7fa2cccda700 1 -- 172.21.15.45:0/3483461226 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2c8103790 msgr2=0x7fa2c819e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:32.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.641+0000 7fa2cccda700 1 --2- 172.21.15.45:0/3483461226 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2c8103790 0x7fa2c819e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:32.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.641+0000 7fa2cccda700 1 -- 172.21.15.45:0/3483461226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc0095f0 con 0x7fa2c8102e40 2024-05-10T03:39:32.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.641+0000 7fa2cd4db700 1 --2- 172.21.15.45:0/3483461226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2c810c270 0x7fa2c8198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:32.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.641+0000 7fa2cccda700 1 --2- 172.21.15.45:0/3483461226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2c8102e40 0x7fa2c819e4b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa2b800d950 tx=0x7fa2b800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:32.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.642+0000 7fa2c5ffb700 1 -- 172.21.15.45:0/3483461226 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8009b40 con 0x7fa2c8102e40 2024-05-10T03:39:32.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.642+0000 7fa2cef3e700 1 -- 172.21.15.45:0/3483461226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c8198ff0 con 0x7fa2c8102e40 2024-05-10T03:39:32.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.642+0000 7fa2c5ffb700 1 -- 172.21.15.45:0/3483461226 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa2b8009ca0 con 0x7fa2c8102e40 2024-05-10T03:39:32.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.642+0000 7fa2c5ffb700 1 -- 172.21.15.45:0/3483461226 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b800f6b0 con 0x7fa2c8102e40 2024-05-10T03:39:32.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.642+0000 7fa2cef3e700 1 -- 172.21.15.45:0/3483461226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c81a5480 con 0x7fa2c8102e40 2024-05-10T03:39:32.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.643+0000 7fa2cef3e700 1 -- 172.21.15.45:0/3483461226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c8107430 con 0x7fa2c8102e40 2024-05-10T03:39:32.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.645+0000 7fa2c5ffb700 1 -- 172.21.15.45:0/3483461226 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fa2b8010460 con 0x7fa2c8102e40 2024-05-10T03:39:32.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.645+0000 7fa2c5ffb700 1 --2- 172.21.15.45:0/3483461226 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa2b00a11b0 0x7fa2b00a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:32.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.645+0000 7fa2c5ffb700 1 -- 172.21.15.45:0/3483461226 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fa2b80cd0e0 con 0x7fa2c8102e40 2024-05-10T03:39:32.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.645+0000 7fa2c7fff700 1 --2- 172.21.15.45:0/3483461226 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa2b00a11b0 0x7fa2b00a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:32.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.646+0000 7fa2c7fff700 1 --2- 172.21.15.45:0/3483461226 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa2b00a11b0 0x7fa2b00a36c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc006010 tx=0x7fa2bc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:32.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.651+0000 7fa2c5ffb700 1 -- 172.21.15.45:0/3483461226 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa2b8096400 con 0x7fa2c8102e40 2024-05-10T03:39:32.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.874+0000 7fa2cef3e700 1 -- 172.21.15.45:0/3483461226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa2c8073cc0 con 0x7fa2c8102e40 2024-05-10T03:39:32.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.874+0000 7fa2c5ffb700 1 -- 172.21.15.45:0/3483461226 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa2b8099a20 con 0x7fa2c8102e40 2024-05-10T03:39:32.878 INFO:teuthology.orchestra.run.smithi045.stdout:214748364836 2024-05-10T03:39:32.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.877+0000 7fa2cef3e700 1 -- 172.21.15.45:0/3483461226 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa2b00a11b0 msgr2=0x7fa2b00a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:32.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.877+0000 7fa2cef3e700 1 --2- 172.21.15.45:0/3483461226 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa2b00a11b0 0x7fa2b00a36c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc006010 tx=0x7fa2bc01a040 comp rx=0 tx=0).stop 2024-05-10T03:39:32.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.877+0000 7fa2cef3e700 1 -- 172.21.15.45:0/3483461226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2c8102e40 msgr2=0x7fa2c819e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:32.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.877+0000 7fa2cef3e700 1 --2- 172.21.15.45:0/3483461226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2c8102e40 0x7fa2c819e4b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa2b800d950 tx=0x7fa2b800dd10 comp rx=0 tx=0).stop 2024-05-10T03:39:32.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.877+0000 7fa2cef3e700 1 -- 172.21.15.45:0/3483461226 shutdown_connections 2024-05-10T03:39:32.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.877+0000 7fa2cef3e700 1 --2- 172.21.15.45:0/3483461226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2c810c270 0x7fa2c8198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:32.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.877+0000 7fa2cef3e700 1 --2- 172.21.15.45:0/3483461226 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa2b00a11b0 0x7fa2b00a36c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:32.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.877+0000 7fa2cef3e700 1 --2- 172.21.15.45:0/3483461226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2c8102e40 0x7fa2c819e4b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:32.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.877+0000 7fa2cef3e700 1 --2- 172.21.15.45:0/3483461226 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2c8103790 0x7fa2c819e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:32.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.877+0000 7fa2cef3e700 1 -- 172.21.15.45:0/3483461226 >> 172.21.15.45:0/3483461226 conn(0x7fa2c80fc760 msgr2=0x7fa2c80fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:32.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.877+0000 7fa2cef3e700 1 -- 172.21.15.45:0/3483461226 shutdown_connections 2024-05-10T03:39:32.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:32.877+0000 7fa2cef3e700 1 -- 172.21.15.45:0/3483461226 wait complete. 2024-05-10T03:39:33.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:33 smithi045 ceph-mon[42520]: pgmap v261: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 255 B/s wr, 10 op/s; 7.8 KiB/s, 1 objects/s recovering 2024-05-10T03:39:33.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:33 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3483461226' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-10T03:39:33.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:33 smithi106 ceph-mon[46996]: pgmap v261: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 255 B/s wr, 10 op/s; 7.8 KiB/s, 1 objects/s recovering 2024-05-10T03:39:33.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:33 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3483461226' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-10T03:39:33.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:33 smithi154 ceph-mon[46565]: pgmap v261: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 255 B/s wr, 10 op/s; 7.8 KiB/s, 1 objects/s recovering 2024-05-10T03:39:33.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:33 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3483461226' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-10T03:39:33.578 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364833 got 214748364836 for osd.7 2024-05-10T03:39:33.578 DEBUG:teuthology.parallel:result is None 2024-05-10T03:39:33.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.848+0000 7ffbbb82c700 1 -- 172.21.15.45:0/1670677805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbb4101510 msgr2=0x7ffbb4101920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:33.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.848+0000 7ffbbb82c700 1 --2- 172.21.15.45:0/1670677805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbb4101510 0x7ffbb4101920 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0009990 tx=0x7ffbb0009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:33.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.848+0000 7ffbbb82c700 1 -- 172.21.15.45:0/1670677805 shutdown_connections 2024-05-10T03:39:33.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.848+0000 7ffbbb82c700 1 --2- 172.21.15.45:0/1670677805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbb4106110 0x7ffbb410da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:33.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.848+0000 7ffbbb82c700 1 --2- 172.21.15.45:0/1670677805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbb4101510 0x7ffbb4101920 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:33.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.848+0000 7ffbbb82c700 1 --2- 172.21.15.45:0/1670677805 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffbb41057c0 0x7ffbb4105bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:33.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.848+0000 7ffbbb82c700 1 -- 172.21.15.45:0/1670677805 >> 172.21.15.45:0/1670677805 conn(0x7ffbb40fbed0 msgr2=0x7ffbb40fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:33.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.848+0000 7ffbbb82c700 1 -- 172.21.15.45:0/1670677805 shutdown_connections 2024-05-10T03:39:33.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.848+0000 7ffbbb82c700 1 -- 172.21.15.45:0/1670677805 wait complete. 2024-05-10T03:39:33.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.850+0000 7ffbbb82c700 1 Processor -- start 2024-05-10T03:39:33.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.850+0000 7ffbbb82c700 1 -- start start 2024-05-10T03:39:33.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.850+0000 7ffbbb82c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffbb4101510 0x7ffbb4072f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:33.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.850+0000 7ffbbb82c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbb41057c0 0x7ffbb406de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.850+0000 7ffbbb82c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbb4106110 0x7ffbb406e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.850+0000 7ffbbb82c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb406ec70 con 0x7ffbb41057c0 2024-05-10T03:39:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.850+0000 7ffbbb82c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb41ad270 con 0x7ffbb4101510 2024-05-10T03:39:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.850+0000 7ffbbb82c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb41ad3b0 con 0x7ffbb4106110 2024-05-10T03:39:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.850+0000 7ffbb8dc7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbb41057c0 0x7ffbb406de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.850+0000 7ffbb8dc7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbb41057c0 0x7ffbb406de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48098/0 (socket says 172.21.15.45:48098) 2024-05-10T03:39:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.850+0000 7ffbb8dc7700 1 -- 172.21.15.45:0/3382421338 learned_addr learned my addr 172.21.15.45:0/3382421338 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.850+0000 7ffbb9dc9700 1 --2- 172.21.15.45:0/3382421338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbb4106110 0x7ffbb406e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.850+0000 7ffbb95c8700 1 --2- 172.21.15.45:0/3382421338 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffbb4101510 0x7ffbb4072f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.851+0000 7ffbb8dc7700 1 -- 172.21.15.45:0/3382421338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbb4106110 msgr2=0x7ffbb406e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.851+0000 7ffbb8dc7700 1 --2- 172.21.15.45:0/3382421338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbb4106110 0x7ffbb406e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.851+0000 7ffbb8dc7700 1 -- 172.21.15.45:0/3382421338 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffbb4101510 msgr2=0x7ffbb4072f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.851+0000 7ffbb8dc7700 1 --2- 172.21.15.45:0/3382421338 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffbb4101510 0x7ffbb4072f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.851+0000 7ffbb8dc7700 1 -- 172.21.15.45:0/3382421338 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb00095f0 con 0x7ffbb41057c0 2024-05-10T03:39:33.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.851+0000 7ffbb8dc7700 1 --2- 172.21.15.45:0/3382421338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbb41057c0 0x7ffbb406de90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ffba400d980 tx=0x7ffba400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:33.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.851+0000 7ffbaa7fc700 1 -- 172.21.15.45:0/3382421338 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba4004220 con 0x7ffbb41057c0 2024-05-10T03:39:33.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.851+0000 7ffbbb82c700 1 -- 172.21.15.45:0/3382421338 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb41ad660 con 0x7ffbb41057c0 2024-05-10T03:39:33.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.851+0000 7ffbaa7fc700 1 -- 172.21.15.45:0/3382421338 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ffba4004d10 con 0x7ffbb41057c0 2024-05-10T03:39:33.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.851+0000 7ffbbb82c700 1 -- 172.21.15.45:0/3382421338 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb41adbb0 con 0x7ffbb41057c0 2024-05-10T03:39:33.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.851+0000 7ffbaa7fc700 1 -- 172.21.15.45:0/3382421338 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba40056e0 con 0x7ffbb41057c0 2024-05-10T03:39:33.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.853+0000 7ffbbb82c700 1 -- 172.21.15.45:0/3382421338 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb980052f0 con 0x7ffbb41057c0 2024-05-10T03:39:33.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.854+0000 7ffbaa7fc700 1 -- 172.21.15.45:0/3382421338 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ffba4004e80 con 0x7ffbb41057c0 2024-05-10T03:39:33.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.855+0000 7ffbaa7fc700 1 --2- 172.21.15.45:0/3382421338 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ffba00a11b0 0x7ffba00a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:33.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.855+0000 7ffbb95c8700 1 --2- 172.21.15.45:0/3382421338 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ffba00a11b0 0x7ffba00a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:33.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.855+0000 7ffbaa7fc700 1 -- 172.21.15.45:0/3382421338 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ffba40cd0c0 con 0x7ffbb41057c0 2024-05-10T03:39:33.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.856+0000 7ffbb95c8700 1 --2- 172.21.15.45:0/3382421338 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ffba00a11b0 0x7ffba00a36c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000b7f0 tx=0x7ffbb001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:33.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:33.859+0000 7ffbaa7fc700 1 -- 172.21.15.45:0/3382421338 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ffba40963e0 con 0x7ffbb41057c0 2024-05-10T03:39:34.003 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.000+0000 7fd9c8393700 1 -- 172.21.15.45:0/2855037904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c0100710 msgr2=0x7fd9c0100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:34.003 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.000+0000 7fd9c8393700 1 --2- 172.21.15.45:0/2855037904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c0100710 0x7fd9c0100b20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0009990 tx=0x7fd9b0009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:34.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.001+0000 7fd9c8393700 1 -- 172.21.15.45:0/2855037904 shutdown_connections 2024-05-10T03:39:34.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.001+0000 7fd9c8393700 1 --2- 172.21.15.45:0/2855037904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c010e950 0x7fd9c0110d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:34.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.001+0000 7fd9c8393700 1 --2- 172.21.15.45:0/2855037904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9c0102d50 0x7fd9c01001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:34.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.001+0000 7fd9c8393700 1 --2- 172.21.15.45:0/2855037904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c0100710 0x7fd9c0100b20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:34.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.001+0000 7fd9c8393700 1 -- 172.21.15.45:0/2855037904 >> 172.21.15.45:0/2855037904 conn(0x7fd9c00fbed0 msgr2=0x7fd9c00fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:34.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.001+0000 7fd9c8393700 1 -- 172.21.15.45:0/2855037904 shutdown_connections 2024-05-10T03:39:34.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.001+0000 7fd9c8393700 1 -- 172.21.15.45:0/2855037904 wait complete. 2024-05-10T03:39:34.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.001+0000 7fd9c8393700 1 Processor -- start 2024-05-10T03:39:34.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.002+0000 7fd9c8393700 1 -- start start 2024-05-10T03:39:34.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.002+0000 7fd9c8393700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9c0100710 0x7fd9c01a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:34.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.002+0000 7fd9c8393700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c0102d50 0x7fd9c01a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:34.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.002+0000 7fd9c8393700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c010e950 0x7fd9c019a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:34.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.002+0000 7fd9c8393700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c019aea0 con 0x7fd9c010e950 2024-05-10T03:39:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.002+0000 7fd9c8393700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c019b010 con 0x7fd9c0100710 2024-05-10T03:39:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.002+0000 7fd9c8393700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c019b1d0 con 0x7fd9c0102d50 2024-05-10T03:39:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.002+0000 7fd9c6930700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c010e950 0x7fd9c019a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.002+0000 7fd9c592e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c0102d50 0x7fd9c01a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.002+0000 7fd9c612f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9c0100710 0x7fd9c01a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.002+0000 7fd9c592e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c0102d50 0x7fd9c01a0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:49714/0 (socket says 172.21.15.45:49714) 2024-05-10T03:39:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.002+0000 7fd9c592e700 1 -- 172.21.15.45:0/1200383442 learned_addr learned my addr 172.21.15.45:0/1200383442 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.002+0000 7fd9c6930700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c010e950 0x7fd9c019a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48122/0 (socket says 172.21.15.45:48122) 2024-05-10T03:39:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.003+0000 7fd9c6930700 1 -- 172.21.15.45:0/1200383442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c0102d50 msgr2=0x7fd9c01a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.003+0000 7fd9c6930700 1 --2- 172.21.15.45:0/1200383442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c0102d50 0x7fd9c01a0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.003+0000 7fd9c6930700 1 -- 172.21.15.45:0/1200383442 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9c0100710 msgr2=0x7fd9c01a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.003+0000 7fd9c6930700 1 --2- 172.21.15.45:0/1200383442 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9c0100710 0x7fd9c01a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.003+0000 7fd9c6930700 1 -- 172.21.15.45:0/1200383442 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b00095f0 con 0x7fd9c010e950 2024-05-10T03:39:34.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.003+0000 7fd9c6930700 1 --2- 172.21.15.45:0/1200383442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c010e950 0x7fd9c019a8d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8007f10 tx=0x7fd9b800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:34.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.003+0000 7fd9b77fe700 1 -- 172.21.15.45:0/1200383442 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8004db0 con 0x7fd9c010e950 2024-05-10T03:39:34.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.003+0000 7fd9b77fe700 1 -- 172.21.15.45:0/1200383442 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd9b800f040 con 0x7fd9c010e950 2024-05-10T03:39:34.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.003+0000 7fd9c8393700 1 -- 172.21.15.45:0/1200383442 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c019b4b0 con 0x7fd9c010e950 2024-05-10T03:39:34.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.003+0000 7fd9b77fe700 1 -- 172.21.15.45:0/1200383442 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8005a90 con 0x7fd9c010e950 2024-05-10T03:39:34.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.004+0000 7fd9c8393700 1 -- 172.21.15.45:0/1200383442 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c01a7940 con 0x7fd9c010e950 2024-05-10T03:39:34.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.005+0000 7fd9c8393700 1 -- 172.21.15.45:0/1200383442 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c0101480 con 0x7fd9c010e950 2024-05-10T03:39:34.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.006+0000 7fd9b77fe700 1 -- 172.21.15.45:0/1200383442 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fd9b80050b0 con 0x7fd9c010e950 2024-05-10T03:39:34.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.007+0000 7fd9b77fe700 1 --2- 172.21.15.45:0/1200383442 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd9ac0a11b0 0x7fd9ac0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:34.010 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.007+0000 7fd9b77fe700 1 -- 172.21.15.45:0/1200383442 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fd9b80cc5a0 con 0x7fd9c010e950 2024-05-10T03:39:34.010 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.007+0000 7fd9c612f700 1 --2- 172.21.15.45:0/1200383442 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd9ac0a11b0 0x7fd9ac0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:34.010 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.008+0000 7fd9c612f700 1 --2- 172.21.15.45:0/1200383442 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd9ac0a11b0 0x7fd9ac0a36c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd9c019bd40 tx=0x7fd9bc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:34.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.012+0000 7fd9b77fe700 1 -- 172.21.15.45:0/1200383442 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd9b80958c0 con 0x7fd9c010e950 2024-05-10T03:39:34.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.086+0000 7ffbbb82c700 1 -- 172.21.15.45:0/3382421338 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7ffb98005870 con 0x7ffbb41057c0 2024-05-10T03:39:34.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.086+0000 7ffbaa7fc700 1 -- 172.21.15.45:0/3382421338 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffba4099a00 con 0x7ffbb41057c0 2024-05-10T03:39:34.089 INFO:teuthology.orchestra.run.smithi045.stdout:274877906973 2024-05-10T03:39:34.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.089+0000 7ffbbb82c700 1 -- 172.21.15.45:0/3382421338 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ffba00a11b0 msgr2=0x7ffba00a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:34.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.089+0000 7ffbbb82c700 1 --2- 172.21.15.45:0/3382421338 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ffba00a11b0 0x7ffba00a36c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000b7f0 tx=0x7ffbb001a040 comp rx=0 tx=0).stop 2024-05-10T03:39:34.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.089+0000 7ffbbb82c700 1 -- 172.21.15.45:0/3382421338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbb41057c0 msgr2=0x7ffbb406de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:34.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.089+0000 7ffbbb82c700 1 --2- 172.21.15.45:0/3382421338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbb41057c0 0x7ffbb406de90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ffba400d980 tx=0x7ffba400dc90 comp rx=0 tx=0).stop 2024-05-10T03:39:34.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.089+0000 7ffbbb82c700 1 -- 172.21.15.45:0/3382421338 shutdown_connections 2024-05-10T03:39:34.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.089+0000 7ffbbb82c700 1 --2- 172.21.15.45:0/3382421338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbb4106110 0x7ffbb406e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:34.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.089+0000 7ffbbb82c700 1 --2- 172.21.15.45:0/3382421338 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ffba00a11b0 0x7ffba00a36c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:34.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.089+0000 7ffbbb82c700 1 --2- 172.21.15.45:0/3382421338 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffbb4101510 0x7ffbb4072f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:34.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.089+0000 7ffbbb82c700 1 --2- 172.21.15.45:0/3382421338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbb41057c0 0x7ffbb406de90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:34.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.089+0000 7ffbbb82c700 1 -- 172.21.15.45:0/3382421338 >> 172.21.15.45:0/3382421338 conn(0x7ffbb40fbed0 msgr2=0x7ffbb41009e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:34.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.090+0000 7ffbbb82c700 1 -- 172.21.15.45:0/3382421338 shutdown_connections 2024-05-10T03:39:34.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.090+0000 7ffbbb82c700 1 -- 172.21.15.45:0/3382421338 wait complete. 2024-05-10T03:39:34.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.108+0000 7fe2888b0700 1 -- 172.21.15.45:0/251819954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2841000f0 msgr2=0x7fe284100500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:34.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.108+0000 7fe2888b0700 1 --2- 172.21.15.45:0/251819954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2841000f0 0x7fe284100500 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe2740098f0 tx=0x7fe274009c00 comp rx=0 tx=0).stop 2024-05-10T03:39:34.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.108+0000 7fe2888b0700 1 -- 172.21.15.45:0/251819954 shutdown_connections 2024-05-10T03:39:34.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.108+0000 7fe2888b0700 1 --2- 172.21.15.45:0/251819954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe284106c60 0x7fe284107070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:34.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.108+0000 7fe2888b0700 1 --2- 172.21.15.45:0/251819954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe284100a40 0x7fe28410ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:34.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.108+0000 7fe2888b0700 1 --2- 172.21.15.45:0/251819954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2841000f0 0x7fe284100500 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:34.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.108+0000 7fe2888b0700 1 -- 172.21.15.45:0/251819954 >> 172.21.15.45:0/251819954 conn(0x7fe2840fbed0 msgr2=0x7fe2840fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:34.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.108+0000 7fe2888b0700 1 -- 172.21.15.45:0/251819954 shutdown_connections 2024-05-10T03:39:34.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.108+0000 7fe2888b0700 1 -- 172.21.15.45:0/251819954 wait complete. 2024-05-10T03:39:34.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.109+0000 7fe2888b0700 1 Processor -- start 2024-05-10T03:39:34.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.109+0000 7fe2888b0700 1 -- start start 2024-05-10T03:39:34.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.110+0000 7fe2888b0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2841000f0 0x7fe28419e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:34.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.110+0000 7fe2888b0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe284100a40 0x7fe28419eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:34.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.110+0000 7fe2888b0700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe284106c60 0x7fe2841985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:34.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.110+0000 7fe2888b0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe284198ba0 con 0x7fe2841000f0 2024-05-10T03:39:34.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.110+0000 7fe2888b0700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe284198d10 con 0x7fe284106c60 2024-05-10T03:39:34.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.110+0000 7fe2888b0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe284198ed0 con 0x7fe284100a40 2024-05-10T03:39:34.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.110+0000 7fe281d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe284100a40 0x7fe28419eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:34.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.110+0000 7fe28259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2841000f0 0x7fe28419e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:34.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.110+0000 7fe28259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2841000f0 0x7fe28419e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48140/0 (socket says 172.21.15.45:48140) 2024-05-10T03:39:34.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.110+0000 7fe28259c700 1 -- 172.21.15.45:0/1453546961 learned_addr learned my addr 172.21.15.45:0/1453546961 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:34.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.110+0000 7fe282d9d700 1 --2- 172.21.15.45:0/1453546961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe284106c60 0x7fe2841985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:34.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.111+0000 7fe281d9b700 1 -- 172.21.15.45:0/1453546961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe284106c60 msgr2=0x7fe2841985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:34.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.111+0000 7fe281d9b700 1 --2- 172.21.15.45:0/1453546961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe284106c60 0x7fe2841985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:34.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.111+0000 7fe281d9b700 1 -- 172.21.15.45:0/1453546961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2841000f0 msgr2=0x7fe28419e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:34.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.111+0000 7fe281d9b700 1 --2- 172.21.15.45:0/1453546961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2841000f0 0x7fe28419e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:34.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.111+0000 7fe281d9b700 1 -- 172.21.15.45:0/1453546961 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe274009520 con 0x7fe284100a40 2024-05-10T03:39:34.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.111+0000 7fe281d9b700 1 --2- 172.21.15.45:0/1453546961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe284100a40 0x7fe28419eb40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe274000c00 tx=0x7fe27400fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:34.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.111+0000 7fe2737fe700 1 -- 172.21.15.45:0/1453546961 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27401c070 con 0x7fe284100a40 2024-05-10T03:39:34.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.111+0000 7fe2888b0700 1 -- 172.21.15.45:0/1453546961 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe284199150 con 0x7fe284100a40 2024-05-10T03:39:34.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.111+0000 7fe2737fe700 1 -- 172.21.15.45:0/1453546961 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe274005520 con 0x7fe284100a40 2024-05-10T03:39:34.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.111+0000 7fe2737fe700 1 -- 172.21.15.45:0/1453546961 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe274003900 con 0x7fe284100a40 2024-05-10T03:39:34.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.111+0000 7fe2888b0700 1 -- 172.21.15.45:0/1453546961 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28406ae00 con 0x7fe284100a40 2024-05-10T03:39:34.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.113+0000 7fe2888b0700 1 -- 172.21.15.45:0/1453546961 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe28410a1b0 con 0x7fe284100a40 2024-05-10T03:39:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.114+0000 7fe2737fe700 1 -- 172.21.15.45:0/1453546961 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fe274020030 con 0x7fe284100a40 2024-05-10T03:39:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.114+0000 7fe2737fe700 1 --2- 172.21.15.45:0/1453546961 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe26c0a11b0 0x7fe26c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.115+0000 7fe2737fe700 1 -- 172.21.15.45:0/1453546961 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fe2740cda70 con 0x7fe284100a40 2024-05-10T03:39:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.115+0000 7fe28259c700 1 --2- 172.21.15.45:0/1453546961 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe26c0a11b0 0x7fe26c0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.116+0000 7fe28259c700 1 --2- 172.21.15.45:0/1453546961 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe26c0a11b0 0x7fe26c0a36c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe2841998d0 tx=0x7fe278009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:34.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.120+0000 7fe2737fe700 1 -- 172.21.15.45:0/1453546961 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe2740cfe60 con 0x7fe284100a40 2024-05-10T03:39:34.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.258+0000 7fd9c8393700 1 -- 172.21.15.45:0/1200383442 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7fd9c019bff0 con 0x7fd9c010e950 2024-05-10T03:39:34.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.258+0000 7fd9b77fe700 1 -- 172.21.15.45:0/1200383442 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9b8098ee0 con 0x7fd9c010e950 2024-05-10T03:39:34.261 INFO:teuthology.orchestra.run.smithi045.stdout:244813135905 2024-05-10T03:39:34.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.262+0000 7fd9c8393700 1 -- 172.21.15.45:0/1200383442 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd9ac0a11b0 msgr2=0x7fd9ac0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:34.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.262+0000 7fd9c8393700 1 --2- 172.21.15.45:0/1200383442 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd9ac0a11b0 0x7fd9ac0a36c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd9c019bd40 tx=0x7fd9bc009260 comp rx=0 tx=0).stop 2024-05-10T03:39:34.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.262+0000 7fd9c8393700 1 -- 172.21.15.45:0/1200383442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c010e950 msgr2=0x7fd9c019a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:34.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.262+0000 7fd9c8393700 1 --2- 172.21.15.45:0/1200383442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c010e950 0x7fd9c019a8d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8007f10 tx=0x7fd9b800d3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:34.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.262+0000 7fd9c8393700 1 -- 172.21.15.45:0/1200383442 shutdown_connections 2024-05-10T03:39:34.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.262+0000 7fd9c8393700 1 --2- 172.21.15.45:0/1200383442 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd9ac0a11b0 0x7fd9ac0a36c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:34.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.262+0000 7fd9c8393700 1 --2- 172.21.15.45:0/1200383442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c010e950 0x7fd9c019a8d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:34.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.262+0000 7fd9c8393700 1 --2- 172.21.15.45:0/1200383442 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9c0100710 0x7fd9c01a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:34.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.262+0000 7fd9c8393700 1 --2- 172.21.15.45:0/1200383442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c0102d50 0x7fd9c01a0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:34.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.262+0000 7fd9c8393700 1 -- 172.21.15.45:0/1200383442 >> 172.21.15.45:0/1200383442 conn(0x7fd9c00fbed0 msgr2=0x7fd9c00fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:34.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.262+0000 7fd9c8393700 1 -- 172.21.15.45:0/1200383442 shutdown_connections 2024-05-10T03:39:34.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.262+0000 7fd9c8393700 1 -- 172.21.15.45:0/1200383442 wait complete. 2024-05-10T03:39:34.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.346+0000 7fe2888b0700 1 -- 172.21.15.45:0/1453546961 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7fe2840ffa80 con 0x7fe284100a40 2024-05-10T03:39:34.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.346+0000 7fe2737fe700 1 -- 172.21.15.45:0/1453546961 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7fe274096e20 con 0x7fe284100a40 2024-05-10T03:39:34.349 INFO:teuthology.orchestra.run.smithi045.stdout:296352743449 2024-05-10T03:39:34.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.349+0000 7fe2888b0700 1 -- 172.21.15.45:0/1453546961 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe26c0a11b0 msgr2=0x7fe26c0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:34.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.349+0000 7fe2888b0700 1 --2- 172.21.15.45:0/1453546961 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe26c0a11b0 0x7fe26c0a36c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe2841998d0 tx=0x7fe278009310 comp rx=0 tx=0).stop 2024-05-10T03:39:34.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.349+0000 7fe2888b0700 1 -- 172.21.15.45:0/1453546961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe284100a40 msgr2=0x7fe28419eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:34.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.349+0000 7fe2888b0700 1 --2- 172.21.15.45:0/1453546961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe284100a40 0x7fe28419eb40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe274000c00 tx=0x7fe27400fa00 comp rx=0 tx=0).stop 2024-05-10T03:39:34.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.349+0000 7fe2888b0700 1 -- 172.21.15.45:0/1453546961 shutdown_connections 2024-05-10T03:39:34.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.349+0000 7fe2888b0700 1 --2- 172.21.15.45:0/1453546961 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe26c0a11b0 0x7fe26c0a36c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:34.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.349+0000 7fe2888b0700 1 --2- 172.21.15.45:0/1453546961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe284106c60 0x7fe2841985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:34.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.349+0000 7fe2888b0700 1 --2- 172.21.15.45:0/1453546961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2841000f0 0x7fe28419e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:34.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.349+0000 7fe2888b0700 1 --2- 172.21.15.45:0/1453546961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe284100a40 0x7fe28419eb40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:34.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.349+0000 7fe2888b0700 1 -- 172.21.15.45:0/1453546961 >> 172.21.15.45:0/1453546961 conn(0x7fe2840fbed0 msgr2=0x7fe2840fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:34.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.349+0000 7fe2888b0700 1 -- 172.21.15.45:0/1453546961 shutdown_connections 2024-05-10T03:39:34.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:34.349+0000 7fe2888b0700 1 -- 172.21.15.45:0/1453546961 wait complete. 2024-05-10T03:39:34.377 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:34 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:39:34.377 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:34 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3382421338' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-10T03:39:34.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:34 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:39:34.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:34 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3382421338' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-10T03:39:34.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:34 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:39:34.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:34 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3382421338' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-10T03:39:34.971 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743446 got 296352743449 for osd.10 2024-05-10T03:39:34.972 DEBUG:teuthology.parallel:result is None 2024-05-10T03:39:34.972 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135902 got 244813135905 for osd.8 2024-05-10T03:39:34.972 DEBUG:teuthology.parallel:result is None 2024-05-10T03:39:35.183 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906971 got 274877906973 for osd.9 2024-05-10T03:39:35.183 DEBUG:teuthology.parallel:result is None 2024-05-10T03:39:35.183 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-10T03:39:35.184 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-10T03:39:35.217 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:35 smithi045 ceph-mon[42520]: pgmap v262: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 8 op/s; 7.8 KiB/s, 1 objects/s recovering 2024-05-10T03:39:35.217 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:35 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1200383442' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-10T03:39:35.217 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:35 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1453546961' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-10T03:39:35.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:35 smithi106 ceph-mon[46996]: pgmap v262: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 8 op/s; 7.8 KiB/s, 1 objects/s recovering 2024-05-10T03:39:35.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:35 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1200383442' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-10T03:39:35.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:35 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1453546961' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-10T03:39:35.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:35 smithi154 ceph-mon[46565]: pgmap v262: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 8 op/s; 7.8 KiB/s, 1 objects/s recovering 2024-05-10T03:39:35.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:35 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1200383442' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-10T03:39:35.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:35 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1453546961' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-10T03:39:35.605 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:36.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:36 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:39:36.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:36 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:39:36.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:36 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:39:36.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:36 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:39:36.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:36 smithi106 ceph-mon[46996]: pgmap v263: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 208 B/s wr, 9 op/s; 6.3 KiB/s, 1 objects/s recovering 2024-05-10T03:39:36.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:36 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:39:36.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:36 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:39:36.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:36 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:39:36.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:36 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:39:36.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:36 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:39:36.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:36 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:39:36.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:36 smithi154 ceph-mon[46565]: pgmap v263: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 208 B/s wr, 9 op/s; 6.3 KiB/s, 1 objects/s recovering 2024-05-10T03:39:36.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:36 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:39:36.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:36 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:39:36.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:36 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:39:36.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:36 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:39:36.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:36 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:39:36.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:36 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:39:36.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:36 smithi045 ceph-mon[42520]: pgmap v263: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 208 B/s wr, 9 op/s; 6.3 KiB/s, 1 objects/s recovering 2024-05-10T03:39:36.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:36 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:39:36.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:36 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:39:36.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.805+0000 7eff1ad6f700 1 -- 172.21.15.45:0/3902288454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff141060c0 msgr2=0x7eff1410da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:36.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.805+0000 7eff1ad6f700 1 --2- 172.21.15.45:0/3902288454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff141060c0 0x7eff1410da20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00b0a0 tx=0x7eff0c00b3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:36.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.805+0000 7eff1ad6f700 1 -- 172.21.15.45:0/3902288454 shutdown_connections 2024-05-10T03:39:36.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.805+0000 7eff1ad6f700 1 --2- 172.21.15.45:0/3902288454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff14100e40 0x7eff14101250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:36.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.805+0000 7eff1ad6f700 1 --2- 172.21.15.45:0/3902288454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff141060c0 0x7eff1410da20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:36.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.805+0000 7eff1ad6f700 1 --2- 172.21.15.45:0/3902288454 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff14105770 0x7eff14105b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:36.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.805+0000 7eff1ad6f700 1 -- 172.21.15.45:0/3902288454 >> 172.21.15.45:0/3902288454 conn(0x7eff140fc760 msgr2=0x7eff140feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:36.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.805+0000 7eff1ad6f700 1 -- 172.21.15.45:0/3902288454 shutdown_connections 2024-05-10T03:39:36.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.806+0000 7eff1ad6f700 1 -- 172.21.15.45:0/3902288454 wait complete. 2024-05-10T03:39:36.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.806+0000 7eff1ad6f700 1 Processor -- start 2024-05-10T03:39:36.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.807+0000 7eff1ad6f700 1 -- start start 2024-05-10T03:39:36.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.807+0000 7eff1ad6f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff14100e40 0x7eff141a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:36.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.807+0000 7eff1ad6f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff14105770 0x7eff141a0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:36.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.807+0000 7eff1ad6f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff141060c0 0x7eff1419a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:36.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.807+0000 7eff1ad6f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1419acf0 con 0x7eff14100e40 2024-05-10T03:39:36.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.807+0000 7eff1ad6f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1419ae60 con 0x7eff141060c0 2024-05-10T03:39:36.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.807+0000 7eff1ad6f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1419b020 con 0x7eff14105770 2024-05-10T03:39:36.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.807+0000 7eff18b0b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff14100e40 0x7eff141a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:36.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.807+0000 7eff18b0b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff14100e40 0x7eff141a07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48160/0 (socket says 172.21.15.45:48160) 2024-05-10T03:39:36.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.807+0000 7eff18b0b700 1 -- 172.21.15.45:0/2729386340 learned_addr learned my addr 172.21.15.45:0/2729386340 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:36.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.807+0000 7eff13fff700 1 --2- 172.21.15.45:0/2729386340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff14105770 0x7eff141a0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:36.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.807+0000 7eff1930c700 1 --2- 172.21.15.45:0/2729386340 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff141060c0 0x7eff1419a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:36.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.807+0000 7eff18b0b700 1 -- 172.21.15.45:0/2729386340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff14105770 msgr2=0x7eff141a0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:36.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.807+0000 7eff18b0b700 1 --2- 172.21.15.45:0/2729386340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff14105770 0x7eff141a0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:36.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.807+0000 7eff18b0b700 1 -- 172.21.15.45:0/2729386340 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff141060c0 msgr2=0x7eff1419a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:36.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.807+0000 7eff18b0b700 1 --2- 172.21.15.45:0/2729386340 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff141060c0 0x7eff1419a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:36.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.808+0000 7eff18b0b700 1 -- 172.21.15.45:0/2729386340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c009d00 con 0x7eff14100e40 2024-05-10T03:39:36.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.808+0000 7eff1930c700 1 --2- 172.21.15.45:0/2729386340 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff141060c0 0x7eff1419a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:39:36.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.808+0000 7eff18b0b700 1 --2- 172.21.15.45:0/2729386340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff14100e40 0x7eff141a07c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7eff0400e9a0 tx=0x7eff0400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:36.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.808+0000 7eff11ffb700 1 -- 172.21.15.45:0/2729386340 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff04009790 con 0x7eff14100e40 2024-05-10T03:39:36.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.808+0000 7eff11ffb700 1 -- 172.21.15.45:0/2729386340 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7eff0400cbd0 con 0x7eff14100e40 2024-05-10T03:39:36.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.808+0000 7eff1ad6f700 1 -- 172.21.15.45:0/2729386340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1419b300 con 0x7eff14100e40 2024-05-10T03:39:36.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.808+0000 7eff11ffb700 1 -- 172.21.15.45:0/2729386340 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff04018730 con 0x7eff14100e40 2024-05-10T03:39:36.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.808+0000 7eff1ad6f700 1 -- 172.21.15.45:0/2729386340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff141a7790 con 0x7eff14100e40 2024-05-10T03:39:36.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.809+0000 7eff1ad6f700 1 -- 172.21.15.45:0/2729386340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff141022f0 con 0x7eff14100e40 2024-05-10T03:39:36.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.812+0000 7eff11ffb700 1 -- 172.21.15.45:0/2729386340 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7eff04010430 con 0x7eff14100e40 2024-05-10T03:39:36.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.812+0000 7eff11ffb700 1 --2- 172.21.15.45:0/2729386340 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7eff000a11b0 0x7eff000a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:36.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.812+0000 7eff11ffb700 1 -- 172.21.15.45:0/2729386340 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7eff04014070 con 0x7eff14100e40 2024-05-10T03:39:36.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.812+0000 7eff13fff700 1 --2- 172.21.15.45:0/2729386340 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7eff000a11b0 0x7eff000a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:36.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.813+0000 7eff13fff700 1 --2- 172.21.15.45:0/2729386340 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7eff000a11b0 0x7eff000a36c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efefc005fd0 tx=0x7efefc005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:36.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:36.816+0000 7eff11ffb700 1 -- 172.21.15.45:0/2729386340 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7eff04096880 con 0x7eff14100e40 2024-05-10T03:39:37.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:37.024+0000 7eff1ad6f700 1 -- 172.21.15.45:0/2729386340 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff1404edc0 con 0x7eff000a11b0 2024-05-10T03:39:37.041 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:37.038+0000 7eff11ffb700 1 -- 172.21.15.45:0/2729386340 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+422258 (secure 0 0 0) 0x7eff1404edc0 con 0x7eff000a11b0 2024-05-10T03:39:37.050 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:39:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:37.042+0000 7eff1ad6f700 1 -- 172.21.15.45:0/2729386340 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7eff000a11b0 msgr2=0x7eff000a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:37.042+0000 7eff1ad6f700 1 --2- 172.21.15.45:0/2729386340 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7eff000a11b0 0x7eff000a36c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efefc005fd0 tx=0x7efefc005ee0 comp rx=0 tx=0).stop 2024-05-10T03:39:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:37.042+0000 7eff1ad6f700 1 -- 172.21.15.45:0/2729386340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff14100e40 msgr2=0x7eff141a07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:37.042+0000 7eff1ad6f700 1 --2- 172.21.15.45:0/2729386340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff14100e40 0x7eff141a07c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7eff0400e9a0 tx=0x7eff0400ed60 comp rx=0 tx=0).stop 2024-05-10T03:39:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:37.042+0000 7eff1ad6f700 1 -- 172.21.15.45:0/2729386340 shutdown_connections 2024-05-10T03:39:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:37.042+0000 7eff1ad6f700 1 --2- 172.21.15.45:0/2729386340 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7eff000a11b0 0x7eff000a36c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:37.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:37.042+0000 7eff1ad6f700 1 --2- 172.21.15.45:0/2729386340 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7eff141060c0 0x7eff1419a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:37.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:37.042+0000 7eff1ad6f700 1 --2- 172.21.15.45:0/2729386340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff14100e40 0x7eff141a07c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:37.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:37.042+0000 7eff1ad6f700 1 --2- 172.21.15.45:0/2729386340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff14105770 0x7eff141a0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:37.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:37.042+0000 7eff1ad6f700 1 -- 172.21.15.45:0/2729386340 >> 172.21.15.45:0/2729386340 conn(0x7eff140fc760 msgr2=0x7eff1410d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:37.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:37.042+0000 7eff1ad6f700 1 -- 172.21.15.45:0/2729386340 shutdown_connections 2024-05-10T03:39:37.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:37.042+0000 7eff1ad6f700 1 -- 172.21.15.45:0/2729386340 wait complete. 2024-05-10T03:39:37.055 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-05-10T03:39:37.381 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:37 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:39:37.381 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:37 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:39:37.381 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:37 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:39:37.381 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:37 smithi045 ceph-mon[42520]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T03:39:37.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:37 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:39:37.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:37 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:39:37.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:37 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:39:37.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:37 smithi154 ceph-mon[46565]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T03:39:37.605 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":263,"stamp":"2024-05-10T03:39:35.891704+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660537,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":499,"num_read_kb":370,"num_write":417,"num_write_kb":3077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1244630,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":345,"ondisk_log_size":345,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":421,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":362704,"kb_used_data":13800,"kb_used_omap":18,"kb_used_meta":348653,"kb_avail":1124579120,"statfs":{"total":1151940427776,"available":1151569018880,"internally_reserved":0,"allocated":14131200,"data_stored":7803843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19129,"internal_metadata":357020999},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1652,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":45,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":63894,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.826851"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076912+0000","last_change":"2024-05-10T03:38:36.586241+0000","last_active":"2024-05-10T03:39:26.076912+0000","last_peered":"2024-05-10T03:39:26.076912+0000","last_clean":"2024-05-10T03:39:26.076912+0000","last_became_active":"2024-05-10T03:38:36.585655+0000","last_became_peered":"2024-05-10T03:38:36.585655+0000","last_unstale":"2024-05-10T03:39:26.076912+0000","last_undegraded":"2024-05-10T03:39:26.076912+0000","last_fullsized":"2024-05-10T03:39:26.076912+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:58:24.614952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067299+0000","last_change":"2024-05-10T03:38:36.588174+0000","last_active":"2024-05-10T03:39:26.067299+0000","last_peered":"2024-05-10T03:39:26.067299+0000","last_clean":"2024-05-10T03:39:26.067299+0000","last_became_active":"2024-05-10T03:38:36.587843+0000","last_became_peered":"2024-05-10T03:38:36.587843+0000","last_unstale":"2024-05-10T03:39:26.067299+0000","last_undegraded":"2024-05-10T03:39:26.067299+0000","last_fullsized":"2024-05-10T03:39:26.067299+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:56.414407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067873+0000","last_change":"2024-05-10T03:38:36.587344+0000","last_active":"2024-05-10T03:39:26.067873+0000","last_peered":"2024-05-10T03:39:26.067873+0000","last_clean":"2024-05-10T03:39:26.067873+0000","last_became_active":"2024-05-10T03:38:36.586345+0000","last_became_peered":"2024-05-10T03:38:36.586345+0000","last_unstale":"2024-05-10T03:39:26.067873+0000","last_undegraded":"2024-05-10T03:39:26.067873+0000","last_fullsized":"2024-05-10T03:39:26.067873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:36.159864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.068208+0000","last_change":"2024-05-10T03:38:36.573019+0000","last_active":"2024-05-10T03:39:26.068208+0000","last_peered":"2024-05-10T03:39:26.068208+0000","last_clean":"2024-05-10T03:39:26.068208+0000","last_became_active":"2024-05-10T03:38:36.572667+0000","last_became_peered":"2024-05-10T03:38:36.572667+0000","last_unstale":"2024-05-10T03:39:26.068208+0000","last_undegraded":"2024-05-10T03:39:26.068208+0000","last_fullsized":"2024-05-10T03:39:26.068208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:24:23.722642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074998+0000","last_change":"2024-05-10T03:38:36.577069+0000","last_active":"2024-05-10T03:39:26.074998+0000","last_peered":"2024-05-10T03:39:26.074998+0000","last_clean":"2024-05-10T03:39:26.074998+0000","last_became_active":"2024-05-10T03:38:36.576683+0000","last_became_peered":"2024-05-10T03:38:36.576683+0000","last_unstale":"2024-05-10T03:39:26.074998+0000","last_undegraded":"2024-05-10T03:39:26.074998+0000","last_fullsized":"2024-05-10T03:39:26.074998+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:09:15.280098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073190+0000","last_change":"2024-05-10T03:38:36.577518+0000","last_active":"2024-05-10T03:39:26.073190+0000","last_peered":"2024-05-10T03:39:26.073190+0000","last_clean":"2024-05-10T03:39:26.073190+0000","last_became_active":"2024-05-10T03:38:36.577147+0000","last_became_peered":"2024-05-10T03:38:36.577147+0000","last_unstale":"2024-05-10T03:39:26.073190+0000","last_undegraded":"2024-05-10T03:39:26.073190+0000","last_fullsized":"2024-05-10T03:39:26.073190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:39:42.779405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078304+0000","last_change":"2024-05-10T03:38:36.594241+0000","last_active":"2024-05-10T03:39:26.078304+0000","last_peered":"2024-05-10T03:39:26.078304+0000","last_clean":"2024-05-10T03:39:26.078304+0000","last_became_active":"2024-05-10T03:38:36.593943+0000","last_became_peered":"2024-05-10T03:38:36.593943+0000","last_unstale":"2024-05-10T03:39:26.078304+0000","last_undegraded":"2024-05-10T03:39:26.078304+0000","last_fullsized":"2024-05-10T03:39:26.078304+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:00.521083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076927+0000","last_change":"2024-05-10T03:38:36.578318+0000","last_active":"2024-05-10T03:39:26.076927+0000","last_peered":"2024-05-10T03:39:26.076927+0000","last_clean":"2024-05-10T03:39:26.076927+0000","last_became_active":"2024-05-10T03:38:36.577967+0000","last_became_peered":"2024-05-10T03:38:36.577967+0000","last_unstale":"2024-05-10T03:39:26.076927+0000","last_undegraded":"2024-05-10T03:39:26.076927+0000","last_fullsized":"2024-05-10T03:39:26.076927+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:45:27.988368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075718+0000","last_change":"2024-05-10T03:38:36.590219+0000","last_active":"2024-05-10T03:39:26.075718+0000","last_peered":"2024-05-10T03:39:26.075718+0000","last_clean":"2024-05-10T03:39:26.075718+0000","last_became_active":"2024-05-10T03:38:36.589849+0000","last_became_peered":"2024-05-10T03:38:36.589849+0000","last_unstale":"2024-05-10T03:39:26.075718+0000","last_undegraded":"2024-05-10T03:39:26.075718+0000","last_fullsized":"2024-05-10T03:39:26.075718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:08:17.073204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072847+0000","last_change":"2024-05-10T03:38:36.580555+0000","last_active":"2024-05-10T03:39:26.072847+0000","last_peered":"2024-05-10T03:39:26.072847+0000","last_clean":"2024-05-10T03:39:26.072847+0000","last_became_active":"2024-05-10T03:38:36.577575+0000","last_became_peered":"2024-05-10T03:38:36.577575+0000","last_unstale":"2024-05-10T03:39:26.072847+0000","last_undegraded":"2024-05-10T03:39:26.072847+0000","last_fullsized":"2024-05-10T03:39:26.072847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:43:29.237054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078946+0000","last_change":"2024-05-10T03:38:36.586599+0000","last_active":"2024-05-10T03:39:26.078946+0000","last_peered":"2024-05-10T03:39:26.078946+0000","last_clean":"2024-05-10T03:39:26.078946+0000","last_became_active":"2024-05-10T03:38:36.585794+0000","last_became_peered":"2024-05-10T03:38:36.585794+0000","last_unstale":"2024-05-10T03:39:26.078946+0000","last_undegraded":"2024-05-10T03:39:26.078946+0000","last_fullsized":"2024-05-10T03:39:26.078946+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:25:18.337715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.068090+0000","last_change":"2024-05-10T03:38:36.578957+0000","last_active":"2024-05-10T03:39:26.068090+0000","last_peered":"2024-05-10T03:39:26.068090+0000","last_clean":"2024-05-10T03:39:26.068090+0000","last_became_active":"2024-05-10T03:38:36.578636+0000","last_became_peered":"2024-05-10T03:38:36.578636+0000","last_unstale":"2024-05-10T03:39:26.068090+0000","last_undegraded":"2024-05-10T03:39:26.068090+0000","last_fullsized":"2024-05-10T03:39:26.068090+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:55:38.830864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.079013+0000","last_change":"2024-05-10T03:39:27.079013+0000","last_active":"2024-05-10T03:39:27.079013+0000","last_peered":"2024-05-10T03:39:27.079013+0000","last_clean":"2024-05-10T03:39:27.079013+0000","last_became_active":"2024-05-10T03:39:27.078674+0000","last_became_peered":"2024-05-10T03:39:27.078674+0000","last_unstale":"2024-05-10T03:39:27.079013+0000","last_undegraded":"2024-05-10T03:39:27.079013+0000","last_fullsized":"2024-05-10T03:39:27.079013+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:59:52.547126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.066698+0000","last_change":"2024-05-10T03:38:36.590205+0000","last_active":"2024-05-10T03:39:26.066698+0000","last_peered":"2024-05-10T03:39:26.066698+0000","last_clean":"2024-05-10T03:39:26.066698+0000","last_became_active":"2024-05-10T03:38:36.589880+0000","last_became_peered":"2024-05-10T03:38:36.589880+0000","last_unstale":"2024-05-10T03:39:26.066698+0000","last_undegraded":"2024-05-10T03:39:26.066698+0000","last_fullsized":"2024-05-10T03:39:26.066698+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:22:26.374034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.077754+0000","last_change":"2024-05-10T03:39:27.077754+0000","last_active":"2024-05-10T03:39:27.077754+0000","last_peered":"2024-05-10T03:39:27.077754+0000","last_clean":"2024-05-10T03:39:27.077754+0000","last_became_active":"2024-05-10T03:39:27.077313+0000","last_became_peered":"2024-05-10T03:39:27.077313+0000","last_unstale":"2024-05-10T03:39:27.077754+0000","last_undegraded":"2024-05-10T03:39:27.077754+0000","last_fullsized":"2024-05-10T03:39:27.077754+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:36:49.331763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074838+0000","last_change":"2024-05-10T03:38:36.591061+0000","last_active":"2024-05-10T03:39:26.074838+0000","last_peered":"2024-05-10T03:39:26.074838+0000","last_clean":"2024-05-10T03:39:26.074838+0000","last_became_active":"2024-05-10T03:38:36.590698+0000","last_became_peered":"2024-05-10T03:38:36.590698+0000","last_unstale":"2024-05-10T03:39:26.074838+0000","last_undegraded":"2024-05-10T03:39:26.074838+0000","last_fullsized":"2024-05-10T03:39:26.074838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:44:43.130908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076823+0000","last_change":"2024-05-10T03:38:36.585990+0000","last_active":"2024-05-10T03:39:26.076823+0000","last_peered":"2024-05-10T03:39:26.076823+0000","last_clean":"2024-05-10T03:39:26.076823+0000","last_became_active":"2024-05-10T03:38:36.585221+0000","last_became_peered":"2024-05-10T03:38:36.585221+0000","last_unstale":"2024-05-10T03:39:26.076823+0000","last_undegraded":"2024-05-10T03:39:26.076823+0000","last_fullsized":"2024-05-10T03:39:26.076823+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:57:58.981790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074421+0000","last_change":"2024-05-10T03:38:36.586651+0000","last_active":"2024-05-10T03:39:26.074421+0000","last_peered":"2024-05-10T03:39:26.074421+0000","last_clean":"2024-05-10T03:39:26.074421+0000","last_became_active":"2024-05-10T03:38:36.586243+0000","last_became_peered":"2024-05-10T03:38:36.586243+0000","last_unstale":"2024-05-10T03:39:26.074421+0000","last_undegraded":"2024-05-10T03:39:26.074421+0000","last_fullsized":"2024-05-10T03:39:26.074421+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:15:58.148040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.071924+0000","last_change":"2024-05-10T03:38:36.583740+0000","last_active":"2024-05-10T03:39:26.071924+0000","last_peered":"2024-05-10T03:39:26.071924+0000","last_clean":"2024-05-10T03:39:26.071924+0000","last_became_active":"2024-05-10T03:38:36.583359+0000","last_became_peered":"2024-05-10T03:38:36.583359+0000","last_unstale":"2024-05-10T03:39:26.071924+0000","last_undegraded":"2024-05-10T03:39:26.071924+0000","last_fullsized":"2024-05-10T03:39:26.071924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:31:29.286667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072212+0000","last_change":"2024-05-10T03:38:40.605484+0000","last_active":"2024-05-10T03:39:26.072212+0000","last_peered":"2024-05-10T03:39:26.072212+0000","last_clean":"2024-05-10T03:39:26.072212+0000","last_became_active":"2024-05-10T03:38:40.605105+0000","last_became_peered":"2024-05-10T03:38:40.605105+0000","last_unstale":"2024-05-10T03:39:26.072212+0000","last_undegraded":"2024-05-10T03:39:26.072212+0000","last_fullsized":"2024-05-10T03:39:26.072212+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:11:34.548916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:30.063680+0000","last_change":"2024-05-10T03:38:36.093877+0000","last_active":"2024-05-10T03:39:30.063680+0000","last_peered":"2024-05-10T03:39:30.063680+0000","last_clean":"2024-05-10T03:39:30.063680+0000","last_became_active":"2024-05-10T03:38:36.093499+0000","last_became_peered":"2024-05-10T03:38:36.093499+0000","last_unstale":"2024-05-10T03:39:30.063680+0000","last_undegraded":"2024-05-10T03:39:30.063680+0000","last_fullsized":"2024-05-10T03:39:30.063680+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:42:17.171167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.080639+0000","last_change":"2024-05-10T03:39:27.080639+0000","last_active":"2024-05-10T03:39:27.080639+0000","last_peered":"2024-05-10T03:39:27.080639+0000","last_clean":"2024-05-10T03:39:27.080639+0000","last_became_active":"2024-05-10T03:39:27.080267+0000","last_became_peered":"2024-05-10T03:39:27.080267+0000","last_unstale":"2024-05-10T03:39:27.080639+0000","last_undegraded":"2024-05-10T03:39:27.080639+0000","last_fullsized":"2024-05-10T03:39:27.080639+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:56:51.282955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067286+0000","last_change":"2024-05-10T03:38:40.608982+0000","last_active":"2024-05-10T03:39:26.067286+0000","last_peered":"2024-05-10T03:39:26.067286+0000","last_clean":"2024-05-10T03:39:26.067286+0000","last_became_active":"2024-05-10T03:38:40.608619+0000","last_became_peered":"2024-05-10T03:38:40.608619+0000","last_unstale":"2024-05-10T03:39:26.067286+0000","last_undegraded":"2024-05-10T03:39:26.067286+0000","last_fullsized":"2024-05-10T03:39:26.067286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:35:56.411530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077808+0000","last_change":"2024-05-10T03:38:36.101669+0000","last_active":"2024-05-10T03:39:26.077808+0000","last_peered":"2024-05-10T03:39:26.077808+0000","last_clean":"2024-05-10T03:39:26.077808+0000","last_became_active":"2024-05-10T03:38:36.101231+0000","last_became_peered":"2024-05-10T03:38:36.101231+0000","last_unstale":"2024-05-10T03:39:26.077808+0000","last_undegraded":"2024-05-10T03:39:26.077808+0000","last_fullsized":"2024-05-10T03:39:26.077808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:42:21.992880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067320+0000","last_change":"2024-05-10T03:38:36.585580+0000","last_active":"2024-05-10T03:39:26.067320+0000","last_peered":"2024-05-10T03:39:26.067320+0000","last_clean":"2024-05-10T03:39:26.067320+0000","last_became_active":"2024-05-10T03:38:36.585239+0000","last_became_peered":"2024-05-10T03:38:36.585239+0000","last_unstale":"2024-05-10T03:39:26.067320+0000","last_undegraded":"2024-05-10T03:39:26.067320+0000","last_fullsized":"2024-05-10T03:39:26.067320+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:39:42.886154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067314+0000","last_change":"2024-05-10T03:38:40.610372+0000","last_active":"2024-05-10T03:39:26.067314+0000","last_peered":"2024-05-10T03:39:26.067314+0000","last_clean":"2024-05-10T03:39:26.067314+0000","last_became_active":"2024-05-10T03:38:40.609958+0000","last_became_peered":"2024-05-10T03:38:40.609958+0000","last_unstale":"2024-05-10T03:39:26.067314+0000","last_undegraded":"2024-05-10T03:39:26.067314+0000","last_fullsized":"2024-05-10T03:39:26.067314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:04:37.461729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075873+0000","last_change":"2024-05-10T03:38:36.091809+0000","last_active":"2024-05-10T03:39:26.075873+0000","last_peered":"2024-05-10T03:39:26.075873+0000","last_clean":"2024-05-10T03:39:26.075873+0000","last_became_active":"2024-05-10T03:38:36.091372+0000","last_became_peered":"2024-05-10T03:38:36.091372+0000","last_unstale":"2024-05-10T03:39:26.075873+0000","last_undegraded":"2024-05-10T03:39:26.075873+0000","last_fullsized":"2024-05-10T03:39:26.075873+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:25:01.784559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075357+0000","last_change":"2024-05-10T03:38:36.595389+0000","last_active":"2024-05-10T03:39:26.075357+0000","last_peered":"2024-05-10T03:39:26.075357+0000","last_clean":"2024-05-10T03:39:26.075357+0000","last_became_active":"2024-05-10T03:38:36.595011+0000","last_became_peered":"2024-05-10T03:38:36.595011+0000","last_unstale":"2024-05-10T03:39:26.075357+0000","last_undegraded":"2024-05-10T03:39:26.075357+0000","last_fullsized":"2024-05-10T03:39:26.075357+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:54:38.377508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067207+0000","last_change":"2024-05-10T03:38:40.605656+0000","last_active":"2024-05-10T03:39:26.067207+0000","last_peered":"2024-05-10T03:39:26.067207+0000","last_clean":"2024-05-10T03:39:26.067207+0000","last_became_active":"2024-05-10T03:38:40.605262+0000","last_became_peered":"2024-05-10T03:38:40.605262+0000","last_unstale":"2024-05-10T03:39:26.067207+0000","last_undegraded":"2024-05-10T03:39:26.067207+0000","last_fullsized":"2024-05-10T03:39:26.067207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:11:27.398282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.089175+0000","last_change":"2024-05-10T03:39:27.089175+0000","last_active":"2024-05-10T03:39:27.089175+0000","last_peered":"2024-05-10T03:39:27.089175+0000","last_clean":"2024-05-10T03:39:27.089175+0000","last_became_active":"2024-05-10T03:39:27.080923+0000","last_became_peered":"2024-05-10T03:39:27.080923+0000","last_unstale":"2024-05-10T03:39:27.089175+0000","last_undegraded":"2024-05-10T03:39:27.089175+0000","last_fullsized":"2024-05-10T03:39:27.089175+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:22.891201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073498+0000","last_change":"2024-05-10T03:38:36.587831+0000","last_active":"2024-05-10T03:39:26.073498+0000","last_peered":"2024-05-10T03:39:26.073498+0000","last_clean":"2024-05-10T03:39:26.073498+0000","last_became_active":"2024-05-10T03:38:36.587503+0000","last_became_peered":"2024-05-10T03:38:36.587503+0000","last_unstale":"2024-05-10T03:39:26.073498+0000","last_undegraded":"2024-05-10T03:39:26.073498+0000","last_fullsized":"2024-05-10T03:39:26.073498+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:52.335134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.071626+0000","last_change":"2024-05-10T03:38:40.601327+0000","last_active":"2024-05-10T03:39:26.071626+0000","last_peered":"2024-05-10T03:39:26.071626+0000","last_clean":"2024-05-10T03:39:26.071626+0000","last_became_active":"2024-05-10T03:38:40.600901+0000","last_became_peered":"2024-05-10T03:38:40.600901+0000","last_unstale":"2024-05-10T03:39:26.071626+0000","last_undegraded":"2024-05-10T03:39:26.071626+0000","last_fullsized":"2024-05-10T03:39:26.071626+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:28.285707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:33.069105+0000","last_change":"2024-05-10T03:38:36.094064+0000","last_active":"2024-05-10T03:39:33.069105+0000","last_peered":"2024-05-10T03:39:33.069105+0000","last_clean":"2024-05-10T03:39:33.069105+0000","last_became_active":"2024-05-10T03:38:36.093522+0000","last_became_peered":"2024-05-10T03:38:36.093522+0000","last_unstale":"2024-05-10T03:39:33.069105+0000","last_undegraded":"2024-05-10T03:39:33.069105+0000","last_fullsized":"2024-05-10T03:39:33.069105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:25:14.257166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076617+0000","last_change":"2024-05-10T03:38:36.580553+0000","last_active":"2024-05-10T03:39:26.076617+0000","last_peered":"2024-05-10T03:39:26.076617+0000","last_clean":"2024-05-10T03:39:26.076617+0000","last_became_active":"2024-05-10T03:38:36.580160+0000","last_became_peered":"2024-05-10T03:38:36.580160+0000","last_unstale":"2024-05-10T03:39:26.076617+0000","last_undegraded":"2024-05-10T03:39:26.076617+0000","last_fullsized":"2024-05-10T03:39:26.076617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:01:14.373430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.071997+0000","last_change":"2024-05-10T03:38:40.609034+0000","last_active":"2024-05-10T03:39:26.071997+0000","last_peered":"2024-05-10T03:39:26.071997+0000","last_clean":"2024-05-10T03:39:26.071997+0000","last_became_active":"2024-05-10T03:38:40.608617+0000","last_became_peered":"2024-05-10T03:38:40.608617+0000","last_unstale":"2024-05-10T03:39:26.071997+0000","last_undegraded":"2024-05-10T03:39:26.071997+0000","last_fullsized":"2024-05-10T03:39:26.071997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:55:28.669881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.093057+0000","last_change":"2024-05-10T03:39:27.093057+0000","last_active":"2024-05-10T03:39:27.093057+0000","last_peered":"2024-05-10T03:39:27.093057+0000","last_clean":"2024-05-10T03:39:27.093057+0000","last_became_active":"2024-05-10T03:39:27.076537+0000","last_became_peered":"2024-05-10T03:39:27.076537+0000","last_unstale":"2024-05-10T03:39:27.093057+0000","last_undegraded":"2024-05-10T03:39:27.093057+0000","last_fullsized":"2024-05-10T03:39:27.093057+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:24.158984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073109+0000","last_change":"2024-05-10T03:38:36.569429+0000","last_active":"2024-05-10T03:39:26.073109+0000","last_peered":"2024-05-10T03:39:26.073109+0000","last_clean":"2024-05-10T03:39:26.073109+0000","last_became_active":"2024-05-10T03:38:36.569042+0000","last_became_peered":"2024-05-10T03:38:36.569042+0000","last_unstale":"2024-05-10T03:39:26.073109+0000","last_undegraded":"2024-05-10T03:39:26.073109+0000","last_fullsized":"2024-05-10T03:39:26.073109+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:45:14.912428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076732+0000","last_change":"2024-05-10T03:38:40.607734+0000","last_active":"2024-05-10T03:39:26.076732+0000","last_peered":"2024-05-10T03:39:26.076732+0000","last_clean":"2024-05-10T03:39:26.076732+0000","last_became_active":"2024-05-10T03:38:40.607331+0000","last_became_peered":"2024-05-10T03:38:40.607331+0000","last_unstale":"2024-05-10T03:39:26.076732+0000","last_undegraded":"2024-05-10T03:39:26.076732+0000","last_fullsized":"2024-05-10T03:39:26.076732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:45:08.360275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.069502+0000","last_change":"2024-05-10T03:38:36.083651+0000","last_active":"2024-05-10T03:39:26.069502+0000","last_peered":"2024-05-10T03:39:26.069502+0000","last_clean":"2024-05-10T03:39:26.069502+0000","last_became_active":"2024-05-10T03:38:36.083235+0000","last_became_peered":"2024-05-10T03:38:36.083235+0000","last_unstale":"2024-05-10T03:39:26.069502+0000","last_undegraded":"2024-05-10T03:39:26.069502+0000","last_fullsized":"2024-05-10T03:39:26.069502+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:28:43.179157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077120+0000","last_change":"2024-05-10T03:38:36.579055+0000","last_active":"2024-05-10T03:39:26.077120+0000","last_peered":"2024-05-10T03:39:26.077120+0000","last_clean":"2024-05-10T03:39:26.077120+0000","last_became_active":"2024-05-10T03:38:36.578200+0000","last_became_peered":"2024-05-10T03:38:36.578200+0000","last_unstale":"2024-05-10T03:39:26.077120+0000","last_undegraded":"2024-05-10T03:39:26.077120+0000","last_fullsized":"2024-05-10T03:39:26.077120+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:48:12.749264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067181+0000","last_change":"2024-05-10T03:38:40.603903+0000","last_active":"2024-05-10T03:39:26.067181+0000","last_peered":"2024-05-10T03:39:26.067181+0000","last_clean":"2024-05-10T03:39:26.067181+0000","last_became_active":"2024-05-10T03:38:40.603481+0000","last_became_peered":"2024-05-10T03:38:40.603481+0000","last_unstale":"2024-05-10T03:39:26.067181+0000","last_undegraded":"2024-05-10T03:39:26.067181+0000","last_fullsized":"2024-05-10T03:39:26.067181+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:44:48.526838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072175+0000","last_change":"2024-05-10T03:38:36.093549+0000","last_active":"2024-05-10T03:39:26.072175+0000","last_peered":"2024-05-10T03:39:26.072175+0000","last_clean":"2024-05-10T03:39:26.072175+0000","last_became_active":"2024-05-10T03:38:36.093244+0000","last_became_peered":"2024-05-10T03:38:36.093244+0000","last_unstale":"2024-05-10T03:39:26.072175+0000","last_undegraded":"2024-05-10T03:39:26.072175+0000","last_fullsized":"2024-05-10T03:39:26.072175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:11:55.727728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073706+0000","last_change":"2024-05-10T03:38:36.582623+0000","last_active":"2024-05-10T03:39:26.073706+0000","last_peered":"2024-05-10T03:39:26.073706+0000","last_clean":"2024-05-10T03:39:26.073706+0000","last_became_active":"2024-05-10T03:38:36.582262+0000","last_became_peered":"2024-05-10T03:38:36.582262+0000","last_unstale":"2024-05-10T03:39:26.073706+0000","last_undegraded":"2024-05-10T03:39:26.073706+0000","last_fullsized":"2024-05-10T03:39:26.073706+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:48.561206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077079+0000","last_change":"2024-05-10T03:38:40.602050+0000","last_active":"2024-05-10T03:39:26.077079+0000","last_peered":"2024-05-10T03:39:26.077079+0000","last_clean":"2024-05-10T03:39:26.077079+0000","last_became_active":"2024-05-10T03:38:40.601699+0000","last_became_peered":"2024-05-10T03:38:40.601699+0000","last_unstale":"2024-05-10T03:39:26.077079+0000","last_undegraded":"2024-05-10T03:39:26.077079+0000","last_fullsized":"2024-05-10T03:39:26.077079+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:56.778636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":92,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:34.069738+0000","last_change":"2024-05-10T03:38:36.095747+0000","last_active":"2024-05-10T03:39:34.069738+0000","last_peered":"2024-05-10T03:39:34.069738+0000","last_clean":"2024-05-10T03:39:34.069738+0000","last_became_active":"2024-05-10T03:38:36.095371+0000","last_became_peered":"2024-05-10T03:38:36.095371+0000","last_unstale":"2024-05-10T03:39:34.069738+0000","last_undegraded":"2024-05-10T03:39:34.069738+0000","last_fullsized":"2024-05-10T03:39:34.069738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:02:37.435286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075561+0000","last_change":"2024-05-10T03:38:36.591321+0000","last_active":"2024-05-10T03:39:26.075561+0000","last_peered":"2024-05-10T03:39:26.075561+0000","last_clean":"2024-05-10T03:39:26.075561+0000","last_became_active":"2024-05-10T03:38:36.589852+0000","last_became_peered":"2024-05-10T03:38:36.589852+0000","last_unstale":"2024-05-10T03:39:26.075561+0000","last_undegraded":"2024-05-10T03:39:26.075561+0000","last_fullsized":"2024-05-10T03:39:26.075561+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:43.075901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073535+0000","last_change":"2024-05-10T03:38:40.605096+0000","last_active":"2024-05-10T03:39:26.073535+0000","last_peered":"2024-05-10T03:39:26.073535+0000","last_clean":"2024-05-10T03:39:26.073535+0000","last_became_active":"2024-05-10T03:38:40.604595+0000","last_became_peered":"2024-05-10T03:38:40.604595+0000","last_unstale":"2024-05-10T03:39:26.073535+0000","last_undegraded":"2024-05-10T03:39:26.073535+0000","last_fullsized":"2024-05-10T03:39:26.073535+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:14.547025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078938+0000","last_change":"2024-05-10T03:38:36.097214+0000","last_active":"2024-05-10T03:39:26.078938+0000","last_peered":"2024-05-10T03:39:26.078938+0000","last_clean":"2024-05-10T03:39:26.078938+0000","last_became_active":"2024-05-10T03:38:36.096835+0000","last_became_peered":"2024-05-10T03:38:36.096835+0000","last_unstale":"2024-05-10T03:39:26.078938+0000","last_undegraded":"2024-05-10T03:39:26.078938+0000","last_fullsized":"2024-05-10T03:39:26.078938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:50.757974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.081369+0000","last_change":"2024-05-10T03:39:27.081369+0000","last_active":"2024-05-10T03:39:27.081369+0000","last_peered":"2024-05-10T03:39:27.081369+0000","last_clean":"2024-05-10T03:39:27.081369+0000","last_became_active":"2024-05-10T03:39:27.080851+0000","last_became_peered":"2024-05-10T03:39:27.080851+0000","last_unstale":"2024-05-10T03:39:27.081369+0000","last_undegraded":"2024-05-10T03:39:27.081369+0000","last_fullsized":"2024-05-10T03:39:27.081369+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:11.552549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067592+0000","last_change":"2024-05-10T03:38:40.605627+0000","last_active":"2024-05-10T03:39:26.067592+0000","last_peered":"2024-05-10T03:39:26.067592+0000","last_clean":"2024-05-10T03:39:26.067592+0000","last_became_active":"2024-05-10T03:38:40.605116+0000","last_became_peered":"2024-05-10T03:38:40.605116+0000","last_unstale":"2024-05-10T03:39:26.067592+0000","last_undegraded":"2024-05-10T03:39:26.067592+0000","last_fullsized":"2024-05-10T03:39:26.067592+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:50:08.759725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073226+0000","last_change":"2024-05-10T03:38:36.102257+0000","last_active":"2024-05-10T03:39:26.073226+0000","last_peered":"2024-05-10T03:39:26.073226+0000","last_clean":"2024-05-10T03:39:26.073226+0000","last_became_active":"2024-05-10T03:38:36.101876+0000","last_became_peered":"2024-05-10T03:38:36.101876+0000","last_unstale":"2024-05-10T03:39:26.073226+0000","last_undegraded":"2024-05-10T03:39:26.073226+0000","last_fullsized":"2024-05-10T03:39:26.073226+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:38:01.164794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075466+0000","last_change":"2024-05-10T03:38:36.591746+0000","last_active":"2024-05-10T03:39:26.075466+0000","last_peered":"2024-05-10T03:39:26.075466+0000","last_clean":"2024-05-10T03:39:26.075466+0000","last_became_active":"2024-05-10T03:38:36.591474+0000","last_became_peered":"2024-05-10T03:38:36.591474+0000","last_unstale":"2024-05-10T03:39:26.075466+0000","last_undegraded":"2024-05-10T03:39:26.075466+0000","last_fullsized":"2024-05-10T03:39:26.075466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:18:02.773737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073900+0000","last_change":"2024-05-10T03:38:40.605956+0000","last_active":"2024-05-10T03:39:26.073900+0000","last_peered":"2024-05-10T03:39:26.073900+0000","last_clean":"2024-05-10T03:39:26.073900+0000","last_became_active":"2024-05-10T03:38:40.605466+0000","last_became_peered":"2024-05-10T03:38:40.605466+0000","last_unstale":"2024-05-10T03:39:26.073900+0000","last_undegraded":"2024-05-10T03:39:26.073900+0000","last_fullsized":"2024-05-10T03:39:26.073900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:07:44.234771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"86'34","reported_seq":151,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:34.090318+0000","last_change":"2024-05-10T03:39:27.083993+0000","last_active":"2024-05-10T03:39:34.090318+0000","last_peered":"2024-05-10T03:39:34.090318+0000","last_clean":"2024-05-10T03:39:34.090318+0000","last_became_active":"2024-05-10T03:39:27.075982+0000","last_became_peered":"2024-05-10T03:39:27.075982+0000","last_unstale":"2024-05-10T03:39:34.090318+0000","last_undegraded":"2024-05-10T03:39:34.090318+0000","last_fullsized":"2024-05-10T03:39:34.090318+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:10:49.852271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63312,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":73,"num_read_kb":97,"num_write":36,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":63312,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075545+0000","last_change":"2024-05-10T03:38:36.579560+0000","last_active":"2024-05-10T03:39:26.075545+0000","last_peered":"2024-05-10T03:39:26.075545+0000","last_clean":"2024-05-10T03:39:26.075545+0000","last_became_active":"2024-05-10T03:38:36.579217+0000","last_became_peered":"2024-05-10T03:38:36.579217+0000","last_unstale":"2024-05-10T03:39:26.075545+0000","last_undegraded":"2024-05-10T03:39:26.075545+0000","last_fullsized":"2024-05-10T03:39:26.075545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:11:50.208794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076114+0000","last_change":"2024-05-10T03:38:40.599253+0000","last_active":"2024-05-10T03:39:26.076114+0000","last_peered":"2024-05-10T03:39:26.076114+0000","last_clean":"2024-05-10T03:39:26.076114+0000","last_became_active":"2024-05-10T03:38:40.597818+0000","last_became_peered":"2024-05-10T03:38:40.597818+0000","last_unstale":"2024-05-10T03:39:26.076114+0000","last_undegraded":"2024-05-10T03:39:26.076114+0000","last_fullsized":"2024-05-10T03:39:26.076114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:48:37.286108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073316+0000","last_change":"2024-05-10T03:38:36.100727+0000","last_active":"2024-05-10T03:39:26.073316+0000","last_peered":"2024-05-10T03:39:26.073316+0000","last_clean":"2024-05-10T03:39:26.073316+0000","last_became_active":"2024-05-10T03:38:36.100381+0000","last_became_peered":"2024-05-10T03:38:36.100381+0000","last_unstale":"2024-05-10T03:39:26.073316+0000","last_undegraded":"2024-05-10T03:39:26.073316+0000","last_fullsized":"2024-05-10T03:39:26.073316+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:57:53.831417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.069729+0000","last_change":"2024-05-10T03:38:36.580924+0000","last_active":"2024-05-10T03:39:26.069729+0000","last_peered":"2024-05-10T03:39:26.069729+0000","last_clean":"2024-05-10T03:39:26.069729+0000","last_became_active":"2024-05-10T03:38:36.580598+0000","last_became_peered":"2024-05-10T03:38:36.580598+0000","last_unstale":"2024-05-10T03:39:26.069729+0000","last_undegraded":"2024-05-10T03:39:26.069729+0000","last_fullsized":"2024-05-10T03:39:26.069729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:33:12.007718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077561+0000","last_change":"2024-05-10T03:38:40.606934+0000","last_active":"2024-05-10T03:39:26.077561+0000","last_peered":"2024-05-10T03:39:26.077561+0000","last_clean":"2024-05-10T03:39:26.077561+0000","last_became_active":"2024-05-10T03:38:40.606451+0000","last_became_peered":"2024-05-10T03:38:40.606451+0000","last_unstale":"2024-05-10T03:39:26.077561+0000","last_undegraded":"2024-05-10T03:39:26.077561+0000","last_fullsized":"2024-05-10T03:39:26.077561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:03:43.562337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073308+0000","last_change":"2024-05-10T03:38:36.093109+0000","last_active":"2024-05-10T03:39:26.073308+0000","last_peered":"2024-05-10T03:39:26.073308+0000","last_clean":"2024-05-10T03:39:26.073308+0000","last_became_active":"2024-05-10T03:38:36.092623+0000","last_became_peered":"2024-05-10T03:38:36.092623+0000","last_unstale":"2024-05-10T03:39:26.073308+0000","last_undegraded":"2024-05-10T03:39:26.073308+0000","last_fullsized":"2024-05-10T03:39:26.073308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:27:10.367098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.079173+0000","last_change":"2024-05-10T03:38:36.582794+0000","last_active":"2024-05-10T03:39:26.079173+0000","last_peered":"2024-05-10T03:39:26.079173+0000","last_clean":"2024-05-10T03:39:26.079173+0000","last_became_active":"2024-05-10T03:38:36.582464+0000","last_became_peered":"2024-05-10T03:38:36.582464+0000","last_unstale":"2024-05-10T03:39:26.079173+0000","last_undegraded":"2024-05-10T03:39:26.079173+0000","last_fullsized":"2024-05-10T03:39:26.079173+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:58:19.665485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074568+0000","last_change":"2024-05-10T03:38:40.608696+0000","last_active":"2024-05-10T03:39:26.074568+0000","last_peered":"2024-05-10T03:39:26.074568+0000","last_clean":"2024-05-10T03:39:26.074568+0000","last_became_active":"2024-05-10T03:38:40.607868+0000","last_became_peered":"2024-05-10T03:38:40.607868+0000","last_unstale":"2024-05-10T03:39:26.074568+0000","last_undegraded":"2024-05-10T03:39:26.074568+0000","last_fullsized":"2024-05-10T03:39:26.074568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:27.154675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:29.068653+0000","last_change":"2024-05-10T03:38:36.093060+0000","last_active":"2024-05-10T03:39:29.068653+0000","last_peered":"2024-05-10T03:39:29.068653+0000","last_clean":"2024-05-10T03:39:29.068653+0000","last_became_active":"2024-05-10T03:38:36.092476+0000","last_became_peered":"2024-05-10T03:38:36.092476+0000","last_unstale":"2024-05-10T03:39:29.068653+0000","last_undegraded":"2024-05-10T03:39:29.068653+0000","last_fullsized":"2024-05-10T03:39:29.068653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:52:04.624230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078407+0000","last_change":"2024-05-10T03:38:36.594808+0000","last_active":"2024-05-10T03:39:26.078407+0000","last_peered":"2024-05-10T03:39:26.078407+0000","last_clean":"2024-05-10T03:39:26.078407+0000","last_became_active":"2024-05-10T03:38:36.594511+0000","last_became_peered":"2024-05-10T03:38:36.594511+0000","last_unstale":"2024-05-10T03:39:26.078407+0000","last_undegraded":"2024-05-10T03:39:26.078407+0000","last_fullsized":"2024-05-10T03:39:26.078407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:18:59.981485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070877+0000","last_change":"2024-05-10T03:38:40.605744+0000","last_active":"2024-05-10T03:39:26.070877+0000","last_peered":"2024-05-10T03:39:26.070877+0000","last_clean":"2024-05-10T03:39:26.070877+0000","last_became_active":"2024-05-10T03:38:40.605269+0000","last_became_peered":"2024-05-10T03:38:40.605269+0000","last_unstale":"2024-05-10T03:39:26.070877+0000","last_undegraded":"2024-05-10T03:39:26.070877+0000","last_fullsized":"2024-05-10T03:39:26.070877+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:21.881903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074955+0000","last_change":"2024-05-10T03:38:36.098918+0000","last_active":"2024-05-10T03:39:26.074955+0000","last_peered":"2024-05-10T03:39:26.074955+0000","last_clean":"2024-05-10T03:39:26.074955+0000","last_became_active":"2024-05-10T03:38:36.098586+0000","last_became_peered":"2024-05-10T03:38:36.098586+0000","last_unstale":"2024-05-10T03:39:26.074955+0000","last_undegraded":"2024-05-10T03:39:26.074955+0000","last_fullsized":"2024-05-10T03:39:26.074955+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:58:48.297763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072973+0000","last_change":"2024-05-10T03:38:36.581347+0000","last_active":"2024-05-10T03:39:26.072973+0000","last_peered":"2024-05-10T03:39:26.072973+0000","last_clean":"2024-05-10T03:39:26.072973+0000","last_became_active":"2024-05-10T03:38:36.581044+0000","last_became_peered":"2024-05-10T03:38:36.581044+0000","last_unstale":"2024-05-10T03:39:26.072973+0000","last_undegraded":"2024-05-10T03:39:26.072973+0000","last_fullsized":"2024-05-10T03:39:26.072973+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:23:43.885238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072974+0000","last_change":"2024-05-10T03:38:40.600521+0000","last_active":"2024-05-10T03:39:26.072974+0000","last_peered":"2024-05-10T03:39:26.072974+0000","last_clean":"2024-05-10T03:39:26.072974+0000","last_became_active":"2024-05-10T03:38:40.600016+0000","last_became_peered":"2024-05-10T03:38:40.600016+0000","last_unstale":"2024-05-10T03:39:26.072974+0000","last_undegraded":"2024-05-10T03:39:26.072974+0000","last_fullsized":"2024-05-10T03:39:26.072974+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:58:37.881367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075200+0000","last_change":"2024-05-10T03:38:36.094209+0000","last_active":"2024-05-10T03:39:26.075200+0000","last_peered":"2024-05-10T03:39:26.075200+0000","last_clean":"2024-05-10T03:39:26.075200+0000","last_became_active":"2024-05-10T03:38:36.093447+0000","last_became_peered":"2024-05-10T03:38:36.093447+0000","last_unstale":"2024-05-10T03:39:26.075200+0000","last_undegraded":"2024-05-10T03:39:26.075200+0000","last_fullsized":"2024-05-10T03:39:26.075200+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:24:20.540340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077847+0000","last_change":"2024-05-10T03:38:36.587832+0000","last_active":"2024-05-10T03:39:26.077847+0000","last_peered":"2024-05-10T03:39:26.077847+0000","last_clean":"2024-05-10T03:39:26.077847+0000","last_became_active":"2024-05-10T03:38:36.587475+0000","last_became_peered":"2024-05-10T03:38:36.587475+0000","last_unstale":"2024-05-10T03:39:26.077847+0000","last_undegraded":"2024-05-10T03:39:26.077847+0000","last_fullsized":"2024-05-10T03:39:26.077847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:47:53.318634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076509+0000","last_change":"2024-05-10T03:38:41.150879+0000","last_active":"2024-05-10T03:39:26.076509+0000","last_peered":"2024-05-10T03:39:26.076509+0000","last_clean":"2024-05-10T03:39:26.076509+0000","last_became_active":"2024-05-10T03:38:41.150350+0000","last_became_peered":"2024-05-10T03:38:41.150350+0000","last_unstale":"2024-05-10T03:39:26.076509+0000","last_undegraded":"2024-05-10T03:39:26.076509+0000","last_fullsized":"2024-05-10T03:39:26.076509+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:47:32.429040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074172+0000","last_change":"2024-05-10T03:38:36.095933+0000","last_active":"2024-05-10T03:39:26.074172+0000","last_peered":"2024-05-10T03:39:26.074172+0000","last_clean":"2024-05-10T03:39:26.074172+0000","last_became_active":"2024-05-10T03:38:36.095592+0000","last_became_peered":"2024-05-10T03:38:36.095592+0000","last_unstale":"2024-05-10T03:39:26.074172+0000","last_undegraded":"2024-05-10T03:39:26.074172+0000","last_fullsized":"2024-05-10T03:39:26.074172+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:52:21.729051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072554+0000","last_change":"2024-05-10T03:38:36.591747+0000","last_active":"2024-05-10T03:39:26.072554+0000","last_peered":"2024-05-10T03:39:26.072554+0000","last_clean":"2024-05-10T03:39:26.072554+0000","last_became_active":"2024-05-10T03:38:36.591432+0000","last_became_peered":"2024-05-10T03:38:36.591432+0000","last_unstale":"2024-05-10T03:39:26.072554+0000","last_undegraded":"2024-05-10T03:39:26.072554+0000","last_fullsized":"2024-05-10T03:39:26.072554+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:20:37.549054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070521+0000","last_change":"2024-05-10T03:38:40.597535+0000","last_active":"2024-05-10T03:39:26.070521+0000","last_peered":"2024-05-10T03:39:26.070521+0000","last_clean":"2024-05-10T03:39:26.070521+0000","last_became_active":"2024-05-10T03:38:40.597108+0000","last_became_peered":"2024-05-10T03:38:40.597108+0000","last_unstale":"2024-05-10T03:39:26.070521+0000","last_undegraded":"2024-05-10T03:39:26.070521+0000","last_fullsized":"2024-05-10T03:39:26.070521+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:31:21.765071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":61,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:34.069630+0000","last_change":"2024-05-10T03:38:36.099238+0000","last_active":"2024-05-10T03:39:34.069630+0000","last_peered":"2024-05-10T03:39:34.069630+0000","last_clean":"2024-05-10T03:39:34.069630+0000","last_became_active":"2024-05-10T03:38:36.098761+0000","last_became_peered":"2024-05-10T03:38:36.098761+0000","last_unstale":"2024-05-10T03:39:34.069630+0000","last_undegraded":"2024-05-10T03:39:34.069630+0000","last_fullsized":"2024-05-10T03:39:34.069630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:08:49.892665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072990+0000","last_change":"2024-05-10T03:38:36.580983+0000","last_active":"2024-05-10T03:39:26.072990+0000","last_peered":"2024-05-10T03:39:26.072990+0000","last_clean":"2024-05-10T03:39:26.072990+0000","last_became_active":"2024-05-10T03:38:36.580252+0000","last_became_peered":"2024-05-10T03:38:36.580252+0000","last_unstale":"2024-05-10T03:39:26.072990+0000","last_undegraded":"2024-05-10T03:39:26.072990+0000","last_fullsized":"2024-05-10T03:39:26.072990+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:16.265473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070165+0000","last_change":"2024-05-10T03:38:41.148651+0000","last_active":"2024-05-10T03:39:26.070165+0000","last_peered":"2024-05-10T03:39:26.070165+0000","last_clean":"2024-05-10T03:39:26.070165+0000","last_became_active":"2024-05-10T03:38:41.148192+0000","last_became_peered":"2024-05-10T03:38:41.148192+0000","last_unstale":"2024-05-10T03:39:26.070165+0000","last_undegraded":"2024-05-10T03:39:26.070165+0000","last_fullsized":"2024-05-10T03:39:26.070165+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:13:38.795763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072565+0000","last_change":"2024-05-10T03:38:36.577839+0000","last_active":"2024-05-10T03:39:26.072565+0000","last_peered":"2024-05-10T03:39:26.072565+0000","last_clean":"2024-05-10T03:39:26.072565+0000","last_became_active":"2024-05-10T03:38:36.576917+0000","last_became_peered":"2024-05-10T03:38:36.576917+0000","last_unstale":"2024-05-10T03:39:26.072565+0000","last_undegraded":"2024-05-10T03:39:26.072565+0000","last_fullsized":"2024-05-10T03:39:26.072565+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:52:05.825241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":58,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:31.071324+0000","last_change":"2024-05-10T03:38:36.099138+0000","last_active":"2024-05-10T03:39:31.071324+0000","last_peered":"2024-05-10T03:39:31.071324+0000","last_clean":"2024-05-10T03:39:31.071324+0000","last_became_active":"2024-05-10T03:38:36.098747+0000","last_became_peered":"2024-05-10T03:38:36.098747+0000","last_unstale":"2024-05-10T03:39:31.071324+0000","last_undegraded":"2024-05-10T03:39:31.071324+0000","last_fullsized":"2024-05-10T03:39:31.071324+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:18.236383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078995+0000","last_change":"2024-05-10T03:38:40.605489+0000","last_active":"2024-05-10T03:39:26.078995+0000","last_peered":"2024-05-10T03:39:26.078995+0000","last_clean":"2024-05-10T03:39:26.078995+0000","last_became_active":"2024-05-10T03:38:40.605040+0000","last_became_peered":"2024-05-10T03:38:40.605040+0000","last_unstale":"2024-05-10T03:39:26.078995+0000","last_undegraded":"2024-05-10T03:39:26.078995+0000","last_fullsized":"2024-05-10T03:39:26.078995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:52:08.592132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077045+0000","last_change":"2024-05-10T03:38:36.589325+0000","last_active":"2024-05-10T03:39:26.077045+0000","last_peered":"2024-05-10T03:39:26.077045+0000","last_clean":"2024-05-10T03:39:26.077045+0000","last_became_active":"2024-05-10T03:38:36.588976+0000","last_became_peered":"2024-05-10T03:38:36.588976+0000","last_unstale":"2024-05-10T03:39:26.077045+0000","last_undegraded":"2024-05-10T03:39:26.077045+0000","last_fullsized":"2024-05-10T03:39:26.077045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:40.849614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067440+0000","last_change":"2024-05-10T03:38:36.093701+0000","last_active":"2024-05-10T03:39:26.067440+0000","last_peered":"2024-05-10T03:39:26.067440+0000","last_clean":"2024-05-10T03:39:26.067440+0000","last_became_active":"2024-05-10T03:38:36.093362+0000","last_became_peered":"2024-05-10T03:38:36.093362+0000","last_unstale":"2024-05-10T03:39:26.067440+0000","last_undegraded":"2024-05-10T03:39:26.067440+0000","last_fullsized":"2024-05-10T03:39:26.067440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:42:00.208900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":330,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078251+0000","last_change":"2024-05-10T03:37:46.762875+0000","last_active":"2024-05-10T03:39:26.078251+0000","last_peered":"2024-05-10T03:39:26.078251+0000","last_clean":"2024-05-10T03:39:26.078251+0000","last_became_active":"2024-05-10T03:37:46.762448+0000","last_became_peered":"2024-05-10T03:37:46.762448+0000","last_unstale":"2024-05-10T03:39:26.078251+0000","last_undegraded":"2024-05-10T03:39:26.078251+0000","last_fullsized":"2024-05-10T03:39:26.078251+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:35:20.340567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:35:20.340567+0000","last_clean_scrub_stamp":"2024-05-10T03:35:20.340567+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:09:05.491303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073007+0000","last_change":"2024-05-10T03:38:41.150966+0000","last_active":"2024-05-10T03:39:26.073007+0000","last_peered":"2024-05-10T03:39:26.073007+0000","last_clean":"2024-05-10T03:39:26.073007+0000","last_became_active":"2024-05-10T03:38:41.150505+0000","last_became_peered":"2024-05-10T03:38:41.150505+0000","last_unstale":"2024-05-10T03:39:26.073007+0000","last_undegraded":"2024-05-10T03:39:26.073007+0000","last_fullsized":"2024-05-10T03:39:26.073007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:53.992369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.069834+0000","last_change":"2024-05-10T03:38:36.577457+0000","last_active":"2024-05-10T03:39:26.069834+0000","last_peered":"2024-05-10T03:39:26.069834+0000","last_clean":"2024-05-10T03:39:26.069834+0000","last_became_active":"2024-05-10T03:38:36.577105+0000","last_became_peered":"2024-05-10T03:38:36.577105+0000","last_unstale":"2024-05-10T03:39:26.069834+0000","last_undegraded":"2024-05-10T03:39:26.069834+0000","last_fullsized":"2024-05-10T03:39:26.069834+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:34:15.611496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078317+0000","last_change":"2024-05-10T03:38:36.094057+0000","last_active":"2024-05-10T03:39:26.078317+0000","last_peered":"2024-05-10T03:39:26.078317+0000","last_clean":"2024-05-10T03:39:26.078317+0000","last_became_active":"2024-05-10T03:38:36.093705+0000","last_became_peered":"2024-05-10T03:38:36.093705+0000","last_unstale":"2024-05-10T03:39:26.078317+0000","last_undegraded":"2024-05-10T03:39:26.078317+0000","last_fullsized":"2024-05-10T03:39:26.078317+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:00:10.138524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077005+0000","last_change":"2024-05-10T03:38:40.603522+0000","last_active":"2024-05-10T03:39:26.077005+0000","last_peered":"2024-05-10T03:39:26.077005+0000","last_clean":"2024-05-10T03:39:26.077005+0000","last_became_active":"2024-05-10T03:38:40.603058+0000","last_became_peered":"2024-05-10T03:38:40.603058+0000","last_unstale":"2024-05-10T03:39:26.077005+0000","last_undegraded":"2024-05-10T03:39:26.077005+0000","last_fullsized":"2024-05-10T03:39:26.077005+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:15:06.869163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075656+0000","last_change":"2024-05-10T03:38:36.099009+0000","last_active":"2024-05-10T03:39:26.075656+0000","last_peered":"2024-05-10T03:39:26.075656+0000","last_clean":"2024-05-10T03:39:26.075656+0000","last_became_active":"2024-05-10T03:38:36.098695+0000","last_became_peered":"2024-05-10T03:38:36.098695+0000","last_unstale":"2024-05-10T03:39:26.075656+0000","last_undegraded":"2024-05-10T03:39:26.075656+0000","last_fullsized":"2024-05-10T03:39:26.075656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:06.634752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070881+0000","last_change":"2024-05-10T03:38:36.576498+0000","last_active":"2024-05-10T03:39:26.070881+0000","last_peered":"2024-05-10T03:39:26.070881+0000","last_clean":"2024-05-10T03:39:26.070881+0000","last_became_active":"2024-05-10T03:38:36.576161+0000","last_became_peered":"2024-05-10T03:38:36.576161+0000","last_unstale":"2024-05-10T03:39:26.070881+0000","last_undegraded":"2024-05-10T03:39:26.070881+0000","last_fullsized":"2024-05-10T03:39:26.070881+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:09.353279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076991+0000","last_change":"2024-05-10T03:38:41.148317+0000","last_active":"2024-05-10T03:39:26.076991+0000","last_peered":"2024-05-10T03:39:26.076991+0000","last_clean":"2024-05-10T03:39:26.076991+0000","last_became_active":"2024-05-10T03:38:41.147907+0000","last_became_peered":"2024-05-10T03:38:41.147907+0000","last_unstale":"2024-05-10T03:39:26.076991+0000","last_undegraded":"2024-05-10T03:39:26.076991+0000","last_fullsized":"2024-05-10T03:39:26.076991+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:23:08.157296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'9","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074498+0000","last_change":"2024-05-10T03:38:36.096437+0000","last_active":"2024-05-10T03:39:26.074498+0000","last_peered":"2024-05-10T03:39:26.074498+0000","last_clean":"2024-05-10T03:39:26.074498+0000","last_became_active":"2024-05-10T03:38:36.096122+0000","last_became_peered":"2024-05-10T03:38:36.096122+0000","last_unstale":"2024-05-10T03:39:26.074498+0000","last_undegraded":"2024-05-10T03:39:26.074498+0000","last_fullsized":"2024-05-10T03:39:26.074498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:47:02.400065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077474+0000","last_change":"2024-05-10T03:38:36.574022+0000","last_active":"2024-05-10T03:39:26.077474+0000","last_peered":"2024-05-10T03:39:26.077474+0000","last_clean":"2024-05-10T03:39:26.077474+0000","last_became_active":"2024-05-10T03:38:36.573530+0000","last_became_peered":"2024-05-10T03:38:36.573530+0000","last_unstale":"2024-05-10T03:39:26.077474+0000","last_undegraded":"2024-05-10T03:39:26.077474+0000","last_fullsized":"2024-05-10T03:39:26.077474+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:35:32.574897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072099+0000","last_change":"2024-05-10T03:38:40.600341+0000","last_active":"2024-05-10T03:39:26.072099+0000","last_peered":"2024-05-10T03:39:26.072099+0000","last_clean":"2024-05-10T03:39:26.072099+0000","last_became_active":"2024-05-10T03:38:40.599944+0000","last_became_peered":"2024-05-10T03:38:40.599944+0000","last_unstale":"2024-05-10T03:39:26.072099+0000","last_undegraded":"2024-05-10T03:39:26.072099+0000","last_fullsized":"2024-05-10T03:39:26.072099+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:12:01.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067765+0000","last_change":"2024-05-10T03:38:36.091020+0000","last_active":"2024-05-10T03:39:26.067765+0000","last_peered":"2024-05-10T03:39:26.067765+0000","last_clean":"2024-05-10T03:39:26.067765+0000","last_became_active":"2024-05-10T03:38:36.090699+0000","last_became_peered":"2024-05-10T03:38:36.090699+0000","last_unstale":"2024-05-10T03:39:26.067765+0000","last_undegraded":"2024-05-10T03:39:26.067765+0000","last_fullsized":"2024-05-10T03:39:26.067765+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:44:12.546166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067252+0000","last_change":"2024-05-10T03:38:36.584279+0000","last_active":"2024-05-10T03:39:26.067252+0000","last_peered":"2024-05-10T03:39:26.067252+0000","last_clean":"2024-05-10T03:39:26.067252+0000","last_became_active":"2024-05-10T03:38:36.583897+0000","last_became_peered":"2024-05-10T03:38:36.583897+0000","last_unstale":"2024-05-10T03:39:26.067252+0000","last_undegraded":"2024-05-10T03:39:26.067252+0000","last_fullsized":"2024-05-10T03:39:26.067252+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:33:17.210334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067474+0000","last_change":"2024-05-10T03:38:41.151023+0000","last_active":"2024-05-10T03:39:26.067474+0000","last_peered":"2024-05-10T03:39:26.067474+0000","last_clean":"2024-05-10T03:39:26.067474+0000","last_became_active":"2024-05-10T03:38:41.150489+0000","last_became_peered":"2024-05-10T03:38:41.150489+0000","last_unstale":"2024-05-10T03:39:26.067474+0000","last_undegraded":"2024-05-10T03:39:26.067474+0000","last_fullsized":"2024-05-10T03:39:26.067474+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:57:57.440139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074840+0000","last_change":"2024-05-10T03:38:36.098990+0000","last_active":"2024-05-10T03:39:26.074840+0000","last_peered":"2024-05-10T03:39:26.074840+0000","last_clean":"2024-05-10T03:39:26.074840+0000","last_became_active":"2024-05-10T03:38:36.098649+0000","last_became_peered":"2024-05-10T03:38:36.098649+0000","last_unstale":"2024-05-10T03:39:26.074840+0000","last_undegraded":"2024-05-10T03:39:26.074840+0000","last_fullsized":"2024-05-10T03:39:26.074840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:38:09.915041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075102+0000","last_change":"2024-05-10T03:38:36.581286+0000","last_active":"2024-05-10T03:39:26.075102+0000","last_peered":"2024-05-10T03:39:26.075102+0000","last_clean":"2024-05-10T03:39:26.075102+0000","last_became_active":"2024-05-10T03:38:36.580927+0000","last_became_peered":"2024-05-10T03:38:36.580927+0000","last_unstale":"2024-05-10T03:39:26.075102+0000","last_undegraded":"2024-05-10T03:39:26.075102+0000","last_fullsized":"2024-05-10T03:39:26.075102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:10:38.663239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074691+0000","last_change":"2024-05-10T03:38:40.605668+0000","last_active":"2024-05-10T03:39:26.074691+0000","last_peered":"2024-05-10T03:39:26.074691+0000","last_clean":"2024-05-10T03:39:26.074691+0000","last_became_active":"2024-05-10T03:38:40.605156+0000","last_became_peered":"2024-05-10T03:38:40.605156+0000","last_unstale":"2024-05-10T03:39:26.074691+0000","last_undegraded":"2024-05-10T03:39:26.074691+0000","last_fullsized":"2024-05-10T03:39:26.074691+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:28:07.192875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077182+0000","last_change":"2024-05-10T03:38:36.090250+0000","last_active":"2024-05-10T03:39:26.077182+0000","last_peered":"2024-05-10T03:39:26.077182+0000","last_clean":"2024-05-10T03:39:26.077182+0000","last_became_active":"2024-05-10T03:38:36.089899+0000","last_became_peered":"2024-05-10T03:38:36.089899+0000","last_unstale":"2024-05-10T03:39:26.077182+0000","last_undegraded":"2024-05-10T03:39:26.077182+0000","last_fullsized":"2024-05-10T03:39:26.077182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:01:19.322065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076480+0000","last_change":"2024-05-10T03:38:36.575272+0000","last_active":"2024-05-10T03:39:26.076480+0000","last_peered":"2024-05-10T03:39:26.076480+0000","last_clean":"2024-05-10T03:39:26.076480+0000","last_became_active":"2024-05-10T03:38:36.574919+0000","last_became_peered":"2024-05-10T03:38:36.574919+0000","last_unstale":"2024-05-10T03:39:26.076480+0000","last_undegraded":"2024-05-10T03:39:26.076480+0000","last_fullsized":"2024-05-10T03:39:26.076480+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:51:33.825933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067385+0000","last_change":"2024-05-10T03:38:40.609082+0000","last_active":"2024-05-10T03:39:26.067385+0000","last_peered":"2024-05-10T03:39:26.067385+0000","last_clean":"2024-05-10T03:39:26.067385+0000","last_became_active":"2024-05-10T03:38:40.608636+0000","last_became_peered":"2024-05-10T03:38:40.608636+0000","last_unstale":"2024-05-10T03:39:26.067385+0000","last_undegraded":"2024-05-10T03:39:26.067385+0000","last_fullsized":"2024-05-10T03:39:26.067385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:18:05.288472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.071676+0000","last_change":"2024-05-10T03:38:36.101001+0000","last_active":"2024-05-10T03:39:26.071676+0000","last_peered":"2024-05-10T03:39:26.071676+0000","last_clean":"2024-05-10T03:39:26.071676+0000","last_became_active":"2024-05-10T03:38:36.100658+0000","last_became_peered":"2024-05-10T03:38:36.100658+0000","last_unstale":"2024-05-10T03:39:26.071676+0000","last_undegraded":"2024-05-10T03:39:26.071676+0000","last_fullsized":"2024-05-10T03:39:26.071676+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:15:51.963956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077340+0000","last_change":"2024-05-10T03:38:36.579314+0000","last_active":"2024-05-10T03:39:26.077340+0000","last_peered":"2024-05-10T03:39:26.077340+0000","last_clean":"2024-05-10T03:39:26.077340+0000","last_became_active":"2024-05-10T03:38:36.578747+0000","last_became_peered":"2024-05-10T03:38:36.578747+0000","last_unstale":"2024-05-10T03:39:26.077340+0000","last_undegraded":"2024-05-10T03:39:26.077340+0000","last_fullsized":"2024-05-10T03:39:26.077340+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:05:25.814887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067380+0000","last_change":"2024-05-10T03:38:41.149022+0000","last_active":"2024-05-10T03:39:26.067380+0000","last_peered":"2024-05-10T03:39:26.067380+0000","last_clean":"2024-05-10T03:39:26.067380+0000","last_became_active":"2024-05-10T03:38:41.148606+0000","last_became_peered":"2024-05-10T03:38:41.148606+0000","last_unstale":"2024-05-10T03:39:26.067380+0000","last_undegraded":"2024-05-10T03:39:26.067380+0000","last_fullsized":"2024-05-10T03:39:26.067380+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:24.039761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.088000+0000","last_change":"2024-05-10T03:39:27.088000+0000","last_active":"2024-05-10T03:39:27.088000+0000","last_peered":"2024-05-10T03:39:27.088000+0000","last_clean":"2024-05-10T03:39:27.088000+0000","last_became_active":"2024-05-10T03:39:27.078679+0000","last_became_peered":"2024-05-10T03:39:27.078679+0000","last_unstale":"2024-05-10T03:39:27.088000+0000","last_undegraded":"2024-05-10T03:39:27.088000+0000","last_fullsized":"2024-05-10T03:39:27.088000+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:32.644494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078840+0000","last_change":"2024-05-10T03:38:36.587225+0000","last_active":"2024-05-10T03:39:26.078840+0000","last_peered":"2024-05-10T03:39:26.078840+0000","last_clean":"2024-05-10T03:39:26.078840+0000","last_became_active":"2024-05-10T03:38:36.586906+0000","last_became_peered":"2024-05-10T03:38:36.586906+0000","last_unstale":"2024-05-10T03:39:26.078840+0000","last_undegraded":"2024-05-10T03:39:26.078840+0000","last_fullsized":"2024-05-10T03:39:26.078840+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:07.128604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075048+0000","last_change":"2024-05-10T03:38:40.600918+0000","last_active":"2024-05-10T03:39:26.075048+0000","last_peered":"2024-05-10T03:39:26.075048+0000","last_clean":"2024-05-10T03:39:26.075048+0000","last_became_active":"2024-05-10T03:38:40.600508+0000","last_became_peered":"2024-05-10T03:38:40.600508+0000","last_unstale":"2024-05-10T03:39:26.075048+0000","last_undegraded":"2024-05-10T03:39:26.075048+0000","last_fullsized":"2024-05-10T03:39:26.075048+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:02:59.589310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":60,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:32.067833+0000","last_change":"2024-05-10T03:38:36.100013+0000","last_active":"2024-05-10T03:39:32.067833+0000","last_peered":"2024-05-10T03:39:32.067833+0000","last_clean":"2024-05-10T03:39:32.067833+0000","last_became_active":"2024-05-10T03:38:36.099581+0000","last_became_peered":"2024-05-10T03:38:36.099581+0000","last_unstale":"2024-05-10T03:39:32.067833+0000","last_undegraded":"2024-05-10T03:39:32.067833+0000","last_fullsized":"2024-05-10T03:39:32.067833+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:07.195555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.079287+0000","last_change":"2024-05-10T03:38:36.586813+0000","last_active":"2024-05-10T03:39:26.079287+0000","last_peered":"2024-05-10T03:39:26.079287+0000","last_clean":"2024-05-10T03:39:26.079287+0000","last_became_active":"2024-05-10T03:38:36.586264+0000","last_became_peered":"2024-05-10T03:38:36.586264+0000","last_unstale":"2024-05-10T03:39:26.079287+0000","last_undegraded":"2024-05-10T03:39:26.079287+0000","last_fullsized":"2024-05-10T03:39:26.079287+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:57:06.239509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.066683+0000","last_change":"2024-05-10T03:38:40.606897+0000","last_active":"2024-05-10T03:39:26.066683+0000","last_peered":"2024-05-10T03:39:26.066683+0000","last_clean":"2024-05-10T03:39:26.066683+0000","last_became_active":"2024-05-10T03:38:40.606339+0000","last_became_peered":"2024-05-10T03:38:40.606339+0000","last_unstale":"2024-05-10T03:39:26.066683+0000","last_undegraded":"2024-05-10T03:39:26.066683+0000","last_fullsized":"2024-05-10T03:39:26.066683+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:13.706744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074765+0000","last_change":"2024-05-10T03:38:36.100689+0000","last_active":"2024-05-10T03:39:26.074765+0000","last_peered":"2024-05-10T03:39:26.074765+0000","last_clean":"2024-05-10T03:39:26.074765+0000","last_became_active":"2024-05-10T03:38:36.100352+0000","last_became_peered":"2024-05-10T03:38:36.100352+0000","last_unstale":"2024-05-10T03:39:26.074765+0000","last_undegraded":"2024-05-10T03:39:26.074765+0000","last_fullsized":"2024-05-10T03:39:26.074765+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:53:45.926237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.266329+0000","last_change":"2024-05-10T03:39:27.266329+0000","last_active":"2024-05-10T03:39:27.266329+0000","last_peered":"2024-05-10T03:39:27.266329+0000","last_clean":"2024-05-10T03:39:27.266329+0000","last_became_active":"2024-05-10T03:39:27.265905+0000","last_became_peered":"2024-05-10T03:39:27.265905+0000","last_unstale":"2024-05-10T03:39:27.266329+0000","last_undegraded":"2024-05-10T03:39:27.266329+0000","last_fullsized":"2024-05-10T03:39:27.266329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:24.604276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,8],"acting":[7,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072213+0000","last_change":"2024-05-10T03:38:40.600719+0000","last_active":"2024-05-10T03:39:26.072213+0000","last_peered":"2024-05-10T03:39:26.072213+0000","last_clean":"2024-05-10T03:39:26.072213+0000","last_became_active":"2024-05-10T03:38:40.600240+0000","last_became_peered":"2024-05-10T03:38:40.600240+0000","last_unstale":"2024-05-10T03:39:26.072213+0000","last_undegraded":"2024-05-10T03:39:26.072213+0000","last_fullsized":"2024-05-10T03:39:26.072213+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:41:47.877298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070778+0000","last_change":"2024-05-10T03:38:36.097691+0000","last_active":"2024-05-10T03:39:26.070778+0000","last_peered":"2024-05-10T03:39:26.070778+0000","last_clean":"2024-05-10T03:39:26.070778+0000","last_became_active":"2024-05-10T03:38:36.097266+0000","last_became_peered":"2024-05-10T03:38:36.097266+0000","last_unstale":"2024-05-10T03:39:26.070778+0000","last_undegraded":"2024-05-10T03:39:26.070778+0000","last_fullsized":"2024-05-10T03:39:26.070778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:27:57.272780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.079029+0000","last_change":"2024-05-10T03:38:36.575475+0000","last_active":"2024-05-10T03:39:26.079029+0000","last_peered":"2024-05-10T03:39:26.079029+0000","last_clean":"2024-05-10T03:39:26.079029+0000","last_became_active":"2024-05-10T03:38:36.575047+0000","last_became_peered":"2024-05-10T03:38:36.575047+0000","last_unstale":"2024-05-10T03:39:26.079029+0000","last_undegraded":"2024-05-10T03:39:26.079029+0000","last_fullsized":"2024-05-10T03:39:26.079029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:31:53.846070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077134+0000","last_change":"2024-05-10T03:38:36.585491+0000","last_active":"2024-05-10T03:39:26.077134+0000","last_peered":"2024-05-10T03:39:26.077134+0000","last_clean":"2024-05-10T03:39:26.077134+0000","last_became_active":"2024-05-10T03:38:36.585147+0000","last_became_peered":"2024-05-10T03:38:36.585147+0000","last_unstale":"2024-05-10T03:39:26.077134+0000","last_undegraded":"2024-05-10T03:39:26.077134+0000","last_fullsized":"2024-05-10T03:39:26.077134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:22.350420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072517+0000","last_change":"2024-05-10T03:38:36.584092+0000","last_active":"2024-05-10T03:39:26.072517+0000","last_peered":"2024-05-10T03:39:26.072517+0000","last_clean":"2024-05-10T03:39:26.072517+0000","last_became_active":"2024-05-10T03:38:36.583749+0000","last_became_peered":"2024-05-10T03:38:36.583749+0000","last_unstale":"2024-05-10T03:39:26.072517+0000","last_undegraded":"2024-05-10T03:39:26.072517+0000","last_fullsized":"2024-05-10T03:39:26.072517+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:10.882170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.071548+0000","last_change":"2024-05-10T03:38:36.573718+0000","last_active":"2024-05-10T03:39:26.071548+0000","last_peered":"2024-05-10T03:39:26.071548+0000","last_clean":"2024-05-10T03:39:26.071548+0000","last_became_active":"2024-05-10T03:38:36.573271+0000","last_became_peered":"2024-05-10T03:38:36.573271+0000","last_unstale":"2024-05-10T03:39:26.071548+0000","last_undegraded":"2024-05-10T03:39:26.071548+0000","last_fullsized":"2024-05-10T03:39:26.071548+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:38:13.798068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067000+0000","last_change":"2024-05-10T03:38:36.576975+0000","last_active":"2024-05-10T03:39:26.067000+0000","last_peered":"2024-05-10T03:39:26.067000+0000","last_clean":"2024-05-10T03:39:26.067000+0000","last_became_active":"2024-05-10T03:38:36.576640+0000","last_became_peered":"2024-05-10T03:38:36.576640+0000","last_unstale":"2024-05-10T03:39:26.067000+0000","last_undegraded":"2024-05-10T03:39:26.067000+0000","last_fullsized":"2024-05-10T03:39:26.067000+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:48:42.975793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.077884+0000","last_change":"2024-05-10T03:39:27.077884+0000","last_active":"2024-05-10T03:39:27.077884+0000","last_peered":"2024-05-10T03:39:27.077884+0000","last_clean":"2024-05-10T03:39:27.077884+0000","last_became_active":"2024-05-10T03:39:27.077475+0000","last_became_peered":"2024-05-10T03:39:27.077475+0000","last_unstale":"2024-05-10T03:39:27.077884+0000","last_undegraded":"2024-05-10T03:39:27.077884+0000","last_fullsized":"2024-05-10T03:39:27.077884+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:21:35.216448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076864+0000","last_change":"2024-05-10T03:38:36.589262+0000","last_active":"2024-05-10T03:39:26.076864+0000","last_peered":"2024-05-10T03:39:26.076864+0000","last_clean":"2024-05-10T03:39:26.076864+0000","last_became_active":"2024-05-10T03:38:36.588950+0000","last_became_peered":"2024-05-10T03:38:36.588950+0000","last_unstale":"2024-05-10T03:39:26.076864+0000","last_undegraded":"2024-05-10T03:39:26.076864+0000","last_fullsized":"2024-05-10T03:39:26.076864+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:08:43.124035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074184+0000","last_change":"2024-05-10T03:38:36.590472+0000","last_active":"2024-05-10T03:39:26.074184+0000","last_peered":"2024-05-10T03:39:26.074184+0000","last_clean":"2024-05-10T03:39:26.074184+0000","last_became_active":"2024-05-10T03:38:36.590115+0000","last_became_peered":"2024-05-10T03:38:36.590115+0000","last_unstale":"2024-05-10T03:39:26.074184+0000","last_undegraded":"2024-05-10T03:39:26.074184+0000","last_fullsized":"2024-05-10T03:39:26.074184+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:33:37.982529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077634+0000","last_change":"2024-05-10T03:38:36.575958+0000","last_active":"2024-05-10T03:39:26.077634+0000","last_peered":"2024-05-10T03:39:26.077634+0000","last_clean":"2024-05-10T03:39:26.077634+0000","last_became_active":"2024-05-10T03:38:36.572958+0000","last_became_peered":"2024-05-10T03:38:36.572958+0000","last_unstale":"2024-05-10T03:39:26.077634+0000","last_undegraded":"2024-05-10T03:39:26.077634+0000","last_fullsized":"2024-05-10T03:39:26.077634+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:30:39.111371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072295+0000","last_change":"2024-05-10T03:38:36.578225+0000","last_active":"2024-05-10T03:39:26.072295+0000","last_peered":"2024-05-10T03:39:26.072295+0000","last_clean":"2024-05-10T03:39:26.072295+0000","last_became_active":"2024-05-10T03:38:36.575920+0000","last_became_peered":"2024-05-10T03:38:36.575920+0000","last_unstale":"2024-05-10T03:39:26.072295+0000","last_undegraded":"2024-05-10T03:39:26.072295+0000","last_fullsized":"2024-05-10T03:39:26.072295+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:54:53.999971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077198+0000","last_change":"2024-05-10T03:38:36.577720+0000","last_active":"2024-05-10T03:39:26.077198+0000","last_peered":"2024-05-10T03:39:26.077198+0000","last_clean":"2024-05-10T03:39:26.077198+0000","last_became_active":"2024-05-10T03:38:36.577360+0000","last_became_peered":"2024-05-10T03:38:36.577360+0000","last_unstale":"2024-05-10T03:39:26.077198+0000","last_undegraded":"2024-05-10T03:39:26.077198+0000","last_fullsized":"2024-05-10T03:39:26.077198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:35:59.787050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075148+0000","last_change":"2024-05-10T03:38:36.588941+0000","last_active":"2024-05-10T03:39:26.075148+0000","last_peered":"2024-05-10T03:39:26.075148+0000","last_clean":"2024-05-10T03:39:26.075148+0000","last_became_active":"2024-05-10T03:38:36.587884+0000","last_became_peered":"2024-05-10T03:38:36.587884+0000","last_unstale":"2024-05-10T03:39:26.075148+0000","last_undegraded":"2024-05-10T03:39:26.075148+0000","last_fullsized":"2024-05-10T03:39:26.075148+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:26:10.064473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070771+0000","last_change":"2024-05-10T03:38:36.578917+0000","last_active":"2024-05-10T03:39:26.070771+0000","last_peered":"2024-05-10T03:39:26.070771+0000","last_clean":"2024-05-10T03:39:26.070771+0000","last_became_active":"2024-05-10T03:38:36.578508+0000","last_became_peered":"2024-05-10T03:38:36.578508+0000","last_unstale":"2024-05-10T03:39:26.070771+0000","last_undegraded":"2024-05-10T03:39:26.070771+0000","last_fullsized":"2024-05-10T03:39:26.070771+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:47.670854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077705+0000","last_change":"2024-05-10T03:38:36.578410+0000","last_active":"2024-05-10T03:39:26.077705+0000","last_peered":"2024-05-10T03:39:26.077705+0000","last_clean":"2024-05-10T03:39:26.077705+0000","last_became_active":"2024-05-10T03:38:36.578055+0000","last_became_peered":"2024-05-10T03:38:36.578055+0000","last_unstale":"2024-05-10T03:39:26.077705+0000","last_undegraded":"2024-05-10T03:39:26.077705+0000","last_fullsized":"2024-05-10T03:39:26.077705+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:39:03.551019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69935,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":373,"num_read_kb":261,"num_write":234,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":63894,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":209805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514517,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":999424,"data_stored":488391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.67700000000000005}]},{"osd":1,"last update":"Fri May 10 03:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.53700000000000003}]},{"osd":2,"last update":"Fri May 10 03:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.80700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":4,"last update":"Fri May 10 03:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri May 10 03:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":1.0860000000000001}]},{"osd":6,"last update":"Fri May 10 03:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.93899999999999995}]},{"osd":7,"last update":"Fri May 10 03:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.95999999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":9,"last update":"Fri May 10 03:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.042}]},{"osd":10,"last update":"Fri May 10 03:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.872},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.88900000000000001}]}]},{"osd":10,"up_from":69,"seq":296352743450,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28672,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716480,"statfs":{"total":95995035648,"available":95965675520,"internally_reserved":0,"allocated":1691648,"data_stored":1137937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":1,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.441},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.41799999999999998}]},{"osd":2,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.66500000000000004}]},{"osd":3,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.60099999999999998}]},{"osd":6,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":8,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.71799999999999997}]},{"osd":9,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.76100000000000001}]},{"osd":11,"last update":"Fri May 10 03:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.751}]}]},{"osd":9,"up_from":64,"seq":274877906973,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":1024000,"data_stored":491883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36043201},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.93899999999999995}]},{"osd":1,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.76500000000000001}]},{"osd":2,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.72899999999999998}]},{"osd":3,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.82199999999999995}]},{"osd":4,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.85999999999999999}]},{"osd":5,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.90500000000000003}]},{"osd":6,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.51100000000000001}]},{"osd":7,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.997},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.0169999999999999}]},{"osd":8,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":1.1140000000000001}]},{"osd":10,"last update":"Fri May 10 03:38:44 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.0429999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]}]},{"osd":8,"up_from":57,"seq":244813135905,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1007616,"data_stored":487252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.51900000000000002}]},{"osd":1,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64300000000000002,"15min":0.64200000000000002},"min":{"1min":0.46200000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.748},{"interface":"front","average":{"1min":0.623,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75700000000000001,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.60999999999999999}]},{"osd":2,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.47199999999999998,"15min":0.46600000000000003},"min":{"1min":0.35199999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.623},{"interface":"front","average":{"1min":0.499,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71099999999999997,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.54000000000000004}]},{"osd":3,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81799999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.62,"15min":0.61299999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.49099999999999999}]},{"osd":4,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.625,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84599999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.68400000000000005,"15min":0.67900000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.79400000000000004}]},{"osd":5,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":0.60699999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78800000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.437},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.55200000000000005}]},{"osd":6,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.67000000000000004,"15min":0.66100000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71799999999999997,"15min":0.71699999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90500000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.65000000000000002}]},{"osd":7,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.52700000000000002,"5min":0.498,"15min":0.498},"max":{"1min":0.90400000000000003,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.58499999999999996,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0009999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.76600000000000001}]},{"osd":9,"last update":"Fri May 10 03:39:30 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.749,"15min":0.73299999999999998},"min":{"1min":0.61199999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.75600000000000001,"15min":0.73799999999999999},"min":{"1min":0.67500000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.83699999999999997}]},{"osd":10,"last update":"Fri May 10 03:38:48 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.92300000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]}]},{"osd":7,"up_from":50,"seq":214748364837,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28596,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716556,"statfs":{"total":95995035648,"available":95965753344,"internally_reserved":0,"allocated":1613824,"data_stored":1084520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:37:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.437},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.502}]},{"osd":1,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.43099999999999999,"15min":0.42699999999999999},"min":{"1min":0.33600000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.44500000000000001,"15min":0.44400000000000001},"min":{"1min":0.32300000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.61799999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.45500000000000002}]},{"osd":2,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85899999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.64300000000000002,"15min":0.622},"min":{"1min":0.46600000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":2.8340000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.56399999999999995}]},{"osd":3,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.624,"15min":0.63},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.75900000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.59899999999999998}]},{"osd":4,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82199999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.34899999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78100000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.499}]},{"osd":5,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.67800000000000005,"15min":0.65500000000000003},"min":{"1min":0.503,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.1139999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.67300000000000004,"15min":0.65500000000000003},"min":{"1min":0.49099999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.806,"5min":2.806,"15min":2.806},"last":0.72699999999999998}]},{"osd":6,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.70299999999999996,"15min":0.70899999999999996},"min":{"1min":0.48599999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86499999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.90900000000000003,"5min":1.002,"15min":1.002},"last":0.85999999999999999}]},{"osd":8,"last update":"Fri May 10 03:39:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.70599999999999996,"15min":0.70399999999999996},"min":{"1min":0.56299999999999994,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.90800000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79200000000000004,"15min":0.79800000000000004},"min":{"1min":0.55000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94899999999999995,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.67700000000000005}]},{"osd":9,"last update":"Fri May 10 03:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.97799999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74199999999999999,"15min":0.74299999999999999},"min":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.90100000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.81599999999999995}]},{"osd":10,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.77900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]},{"osd":6,"up_from":45,"seq":193273528359,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":995328,"data_stored":483243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:38:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.45300000000000001,"15min":0.443},"min":{"1min":0.33700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":3.7570000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.46500000000000002,"15min":0.45600000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Fri May 10 03:38:40 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.41799999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.63900000000000001,"15min":0.621},"min":{"1min":0.51400000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":4.0439999999999996}]},{"osd":2,"last update":"Fri May 10 03:38:40 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.628},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.69799999999999995,"15min":0.68500000000000005},"min":{"1min":0.53700000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":3.8719999999999999}]},{"osd":3,"last update":"Fri May 10 03:38:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.55600000000000005,"15min":0.54200000000000004},"min":{"1min":0.44500000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":4.476},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.55300000000000005,"15min":0.54500000000000004},"min":{"1min":0.432,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":1.085}]},{"osd":4,"last update":"Fri May 10 03:38:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.47399999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.72999999999999998,"15min":0.71599999999999997},"min":{"1min":0.68500000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":4.0910000000000002}]},{"osd":5,"last update":"Fri May 10 03:38:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68100000000000005,"15min":0.67500000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.88200000000000001,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.72499999999999998,"15min":0.71799999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.67000000000000004}]},{"osd":7,"last update":"Fri May 10 03:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.83099999999999996,"15min":0.82399999999999995},"min":{"1min":0.752,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":3.9660000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.76100000000000001,"15min":0.755},"min":{"1min":0.61399999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.92900000000000005,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.95699999999999996}]},{"osd":8,"last update":"Fri May 10 03:39:09 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.54800000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.96399999999999997,"5min":0.999,"15min":0.999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.88100000000000001,"15min":0.88900000000000001},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":3.9199999999999999}]},{"osd":9,"last update":"Fri May 10 03:39:30 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.95799999999999996,"15min":0.94599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":3.827,"5min":3.827,"15min":3.827},"last":3.827},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.84599999999999997,"15min":0.84799999999999998},"min":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.022}]},{"osd":10,"last update":"Fri May 10 03:38:46 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":4.1340000000000003},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.99199999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0049999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":1064960,"data_stored":547585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.52900000000000003,"15min":0.50800000000000001},"min":{"1min":0.35499999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53000000000000003,"15min":0.503},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73899999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.55600000000000005}]},{"osd":2,"last update":"Fri May 10 03:39:27 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.55300000000000005,"15min":0.50800000000000001},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.82799999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.56499999999999995,"15min":0.51900000000000002},"min":{"1min":0.42099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.83299999999999996}]},{"osd":3,"last update":"Fri May 10 03:38:44 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.58999999999999997,"15min":0.56399999999999995},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88,"5min":1.528,"15min":1.528},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.58599999999999997,"15min":0.55600000000000005},"min":{"1min":0.47899999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91100000000000003,"5min":1.502,"15min":1.502},"last":0.73799999999999999}]},{"osd":4,"last update":"Fri May 10 03:39:06 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.434,"15min":0.40100000000000002},"min":{"1min":0.318,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.749,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.626},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.442,"15min":0.40799999999999997},"min":{"1min":0.38300000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.70899999999999996}]},{"osd":5,"last update":"Fri May 10 03:39:23 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.63600000000000001,"15min":0.61199999999999999},"min":{"1min":0.46300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.67600000000000005,"15min":0.64600000000000002},"min":{"1min":0.54500000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.88}]},{"osd":6,"last update":"Fri May 10 03:38:34 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.5,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0700000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64600000000000002,"15min":0.64200000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.99199999999999999,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.86799999999999999}]},{"osd":7,"last update":"Fri May 10 03:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.378,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.92800000000000005,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.58999999999999997,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.81100000000000005}]},{"osd":8,"last update":"Fri May 10 03:39:11 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.66100000000000003,"15min":0.64300000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.73199999999999998,"15min":0.71199999999999997},"min":{"1min":0.63800000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.94299999999999995}]},{"osd":9,"last update":"Fri May 10 03:38:31 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":1.012},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.91400000000000003}]},{"osd":10,"last update":"Fri May 10 03:38:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.95599999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1019904,"data_stored":484699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 03:39:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.59699999999999998,"15min":0.54800000000000004},"min":{"1min":0.443,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.089,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.58499999999999996,"15min":0.53700000000000003},"min":{"1min":0.443,"5min":0.316,"15min":0.316},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.163}]},{"osd":2,"last update":"Fri May 10 03:39:22 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.64900000000000002,"15min":0.60699999999999998},"min":{"1min":0.434,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":1.125},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.66000000000000003,"15min":0.60199999999999998},"min":{"1min":0.50600000000000001,"5min":0.379,"15min":0.379},"max":{"1min":1.038,"5min":1.216,"15min":1.216},"last":0.91100000000000003}]},{"osd":3,"last update":"Fri May 10 03:37:40 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.46400000000000002,"15min":0.44900000000000001},"min":{"1min":0.371,"5min":0.314,"15min":0.314},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.53100000000000003,"15min":0.51000000000000001},"min":{"1min":0.40300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":1.1419999999999999}]},{"osd":4,"last update":"Fri May 10 03:39:04 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.64200000000000002,"15min":0.60099999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":1.101},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.622,"15min":0.58199999999999996},"min":{"1min":0.38800000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1.036}]},{"osd":5,"last update":"Fri May 10 03:39:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.60999999999999999,"15min":0.59099999999999997},"min":{"1min":0.45700000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.72599999999999998,"15min":0.69599999999999995},"min":{"1min":0.56299999999999994,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.98899999999999999}]},{"osd":6,"last update":"Fri May 10 03:38:34 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68400000000000005,"15min":0.68899999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.83099999999999996}]},{"osd":7,"last update":"Fri May 10 03:37:53 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":1.0649999999999999}]},{"osd":8,"last update":"Fri May 10 03:39:11 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.85699999999999998,"15min":0.84699999999999998},"min":{"1min":0.58099999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.86099999999999999,"15min":0.85199999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.232,"5min":1.373,"15min":1.373},"last":0.94499999999999995}]},{"osd":9,"last update":"Fri May 10 03:39:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.83499999999999996,"15min":0.82099999999999995},"min":{"1min":0.55600000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.3089999999999999,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.70199999999999996,"15min":0.68100000000000005},"min":{"1min":0.42799999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.80700000000000005}]},{"osd":10,"last update":"Fri May 10 03:38:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.179},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":1.198}]},{"osd":11,"last update":"Fri May 10 03:39:04 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.079}]}]},{"osd":2,"up_from":18,"seq":77309411383,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":1011712,"data_stored":484838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.38800000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71799999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.41199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80100000000000005,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.76400000000000001}]},{"osd":1,"last update":"Fri May 10 03:39:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.57799999999999996,"15min":0.53500000000000003},"min":{"1min":0.39200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.625,"15min":0.56399999999999995},"min":{"1min":0.372,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.77600000000000002}]},{"osd":3,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.42599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81599999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.49099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.745,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.71199999999999997}]},{"osd":4,"last update":"Fri May 10 03:37:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.44500000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61799999999999999,"15min":0.61499999999999999},"min":{"1min":0.39600000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.68799999999999994}]},{"osd":5,"last update":"Fri May 10 03:39:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.53200000000000003,"15min":0.50800000000000001},"min":{"1min":0.29599999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.56799999999999995,"15min":0.55200000000000005},"min":{"1min":0.36299999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80200000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri May 10 03:38:34 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.629,"15min":0.625},"min":{"1min":0.47899999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71199999999999997,"15min":0.71099999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.83099999999999996}]},{"osd":7,"last update":"Fri May 10 03:37:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.61099999999999999}]},{"osd":8,"last update":"Fri May 10 03:39:12 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.63900000000000001,"15min":0.63200000000000001},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.96299999999999997,"5min":0.995,"15min":0.995},"last":0.84399999999999997}]},{"osd":9,"last update":"Fri May 10 03:39:30 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.77000000000000002,"15min":0.75900000000000001},"min":{"1min":0.54800000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.83399999999999996,"15min":0.82399999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.90800000000000003}]},{"osd":10,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.89100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]},{"osd":3,"up_from":25,"seq":107374182450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1003520,"data_stored":482668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:38:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.40200000000000002,"15min":0.377},"min":{"1min":0.36899999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.59799999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.45900000000000002,"15min":0.432},"min":{"1min":0.372,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71999999999999997,"5min":0.878,"15min":0.878},"last":0.64900000000000002}]},{"osd":1,"last update":"Fri May 10 03:38:41 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55400000000000005,"15min":0.53400000000000003},"min":{"1min":0.46999999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.57099999999999995,"15min":0.53200000000000003},"min":{"1min":0.46500000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86099999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":1.133}]},{"osd":2,"last update":"Fri May 10 03:38:41 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61599999999999999,"15min":0.59799999999999998},"min":{"1min":0.46899999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.97599999999999998,"5min":1.145,"15min":1.145},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.60399999999999998,"15min":0.57599999999999996},"min":{"1min":0.441,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.73499999999999999}]},{"osd":4,"last update":"Fri May 10 03:39:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.628,"15min":0.60599999999999998},"min":{"1min":0.53600000000000003,"5min":0.433,"15min":0.433},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.65400000000000003,"15min":0.626},"min":{"1min":0.54700000000000004,"5min":0.443,"15min":0.443},"max":{"1min":0.93300000000000005,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri May 10 03:39:21 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65200000000000002,"15min":0.63200000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.014,"5min":1.224,"15min":1.224},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66200000000000003,"15min":0.63},"min":{"1min":0.438,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.996,"5min":1.093,"15min":1.093},"last":1.387}]},{"osd":6,"last update":"Fri May 10 03:38:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67700000000000005,"15min":0.67400000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98299999999999998,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.2549999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.46899999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.94199999999999995,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.47999999999999998}]},{"osd":7,"last update":"Fri May 10 03:38:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79000000000000004,"15min":0.78800000000000003},"min":{"1min":0.57299999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.95399999999999996,"5min":1.085,"15min":1.085},"last":1.2969999999999999}]},{"osd":8,"last update":"Fri May 10 03:38:09 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.68899999999999995}]},{"osd":9,"last update":"Fri May 10 03:39:27 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.879,"15min":0.90300000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":1.427},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.81899999999999995,"15min":0.83599999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.81200000000000006}]},{"osd":10,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":1.335}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]}]},{"osd":4,"up_from":33,"seq":141733920814,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1077248,"data_stored":550629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:37:59 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.47599999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.52400000000000002,"15min":0.51100000000000001},"min":{"1min":0.435,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.54000000000000004}]},{"osd":1,"last update":"Fri May 10 03:38:59 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.376,"15min":0.35699999999999998},"min":{"1min":0.28100000000000003,"5min":0.218,"15min":0.218},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.39500000000000002,"15min":0.377},"min":{"1min":0.29399999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.45700000000000002}]},{"osd":2,"last update":"Fri May 10 03:38:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.57199999999999995,"15min":0.55100000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.84999999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.59399999999999997,"15min":0.56100000000000005},"min":{"1min":0.47099999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.58799999999999997}]},{"osd":3,"last update":"Fri May 10 03:38:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.59599999999999997,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83799999999999997,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri May 10 03:39:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61699999999999999,"15min":0.59499999999999997},"min":{"1min":0.497,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90500000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.63500000000000001,"15min":0.60499999999999998},"min":{"1min":0.47999999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65700000000000003}]},{"osd":6,"last update":"Fri May 10 03:38:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.623,"15min":0.628},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.77000000000000002,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.46600000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92200000000000004,"5min":3.714,"15min":3.714},"last":0.70699999999999996}]},{"osd":7,"last update":"Fri May 10 03:38:59 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.57499999999999996,"15min":0.55800000000000005},"min":{"1min":0.36899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.36499999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88500000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.72399999999999998}]},{"osd":8,"last update":"Fri May 10 03:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.64900000000000002,"15min":0.64000000000000001},"min":{"1min":0.45200000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.76600000000000001,"15min":0.76000000000000001},"min":{"1min":0.50700000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.81200000000000006}]},{"osd":9,"last update":"Fri May 10 03:38:28 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.748}]},{"osd":10,"last update":"Fri May 10 03:38:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.78900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]}]},{"osd":5,"up_from":38,"seq":163208757292,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1622016,"data_stored":1080198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.5},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58199999999999996,"15min":0.57199999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.86799999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.48199999999999998}]},{"osd":1,"last update":"Fri May 10 03:39:17 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59099999999999997,"15min":0.58399999999999996},"min":{"1min":0.441,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92600000000000005,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.48199999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.64000000000000001}]},{"osd":2,"last update":"Fri May 10 03:39:17 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.436,"15min":0.41799999999999998},"min":{"1min":0.32700000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69599999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.44600000000000001,"15min":0.438},"min":{"1min":0.312,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68400000000000005,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.379}]},{"osd":3,"last update":"Fri May 10 03:39:17 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.88,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.432},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.47499999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78300000000000003,"5min":1.095,"15min":1.095},"last":0.46000000000000002}]},{"osd":4,"last update":"Fri May 10 03:39:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.63400000000000001,"15min":0.623},"min":{"1min":0.45300000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.42299999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66800000000000004}]},{"osd":6,"last update":"Fri May 10 03:38:35 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60299999999999998,"15min":0.59899999999999998},"min":{"1min":0.371,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.59399999999999997}]},{"osd":7,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.70199999999999996,"15min":0.69599999999999995},"min":{"1min":0.52400000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69199999999999995,"15min":0.68999999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.65600000000000003}]},{"osd":8,"last update":"Fri May 10 03:39:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.64400000000000002,"15min":0.63600000000000001},"min":{"1min":0.39100000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.56399999999999995}]},{"osd":9,"last update":"Fri May 10 03:39:29 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.70199999999999996,"15min":0.68400000000000005},"min":{"1min":0.56100000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.753,"15min":0.73099999999999998},"min":{"1min":0.64600000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.70399999999999996}]},{"osd":10,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.78000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T03:39:37.614 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-10T03:39:37.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:37 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:39:37.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:37 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:39:37.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:37 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:39:37.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:37 smithi106 ceph-mon[46996]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T03:39:37.872 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:38.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:38 smithi045 ceph-mon[42520]: pgmap v264: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 189 B/s wr, 9 op/s; 5.8 KiB/s, 1 objects/s recovering 2024-05-10T03:39:38.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:38 smithi154 ceph-mon[46565]: pgmap v264: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 189 B/s wr, 9 op/s; 5.8 KiB/s, 1 objects/s recovering 2024-05-10T03:39:38.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:38 smithi106 ceph-mon[46996]: pgmap v264: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 189 B/s wr, 9 op/s; 5.8 KiB/s, 1 objects/s recovering 2024-05-10T03:39:38.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.985+0000 7efe6b98b700 1 -- 172.21.15.45:0/902058365 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe64103750 msgr2=0x7efe6410bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:38.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.985+0000 7efe6b98b700 1 --2- 172.21.15.45:0/902058365 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe64103750 0x7efe6410bca0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7efe54009990 tx=0x7efe54009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:38.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.985+0000 7efe6b98b700 1 -- 172.21.15.45:0/902058365 shutdown_connections 2024-05-10T03:39:38.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.985+0000 7efe6b98b700 1 --2- 172.21.15.45:0/902058365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe64102e00 0x7efe64103210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:38.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.985+0000 7efe6b98b700 1 --2- 172.21.15.45:0/902058365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe6410c230 0x7efe6410e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:38.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.985+0000 7efe6b98b700 1 --2- 172.21.15.45:0/902058365 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe64103750 0x7efe6410bca0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:38.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.985+0000 7efe6b98b700 1 -- 172.21.15.45:0/902058365 >> 172.21.15.45:0/902058365 conn(0x7efe640fc7a0 msgr2=0x7efe640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:38.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.985+0000 7efe6b98b700 1 -- 172.21.15.45:0/902058365 shutdown_connections 2024-05-10T03:39:38.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.985+0000 7efe6b98b700 1 -- 172.21.15.45:0/902058365 wait complete. 2024-05-10T03:39:38.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.986+0000 7efe6b98b700 1 Processor -- start 2024-05-10T03:39:38.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.986+0000 7efe6b98b700 1 -- start start 2024-05-10T03:39:38.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.986+0000 7efe6b98b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe64102e00 0x7efe6419e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:38.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.986+0000 7efe6b98b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe64103750 0x7efe6419e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:38.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.986+0000 7efe6b98b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe6410c230 0x7efe641983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:38.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.986+0000 7efe6b98b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe641989a0 con 0x7efe64103750 2024-05-10T03:39:38.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.986+0000 7efe6b98b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe64198b10 con 0x7efe6410c230 2024-05-10T03:39:38.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.986+0000 7efe6b98b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe64198cd0 con 0x7efe64102e00 2024-05-10T03:39:38.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.986+0000 7efe68f26700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe64103750 0x7efe6419e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:38.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.986+0000 7efe68f26700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe64103750 0x7efe6419e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40262/0 (socket says 172.21.15.45:40262) 2024-05-10T03:39:38.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.986+0000 7efe68f26700 1 -- 172.21.15.45:0/2700963026 learned_addr learned my addr 172.21.15.45:0/2700963026 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:38.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.986+0000 7efe69727700 1 --2- 172.21.15.45:0/2700963026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe64102e00 0x7efe6419e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:38.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.986+0000 7efe69f28700 1 --2- 172.21.15.45:0/2700963026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe6410c230 0x7efe641983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:38.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.987+0000 7efe68f26700 1 -- 172.21.15.45:0/2700963026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe64102e00 msgr2=0x7efe6419e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:38.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.987+0000 7efe68f26700 1 --2- 172.21.15.45:0/2700963026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe64102e00 0x7efe6419e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:38.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.987+0000 7efe68f26700 1 -- 172.21.15.45:0/2700963026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe6410c230 msgr2=0x7efe641983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:38.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.987+0000 7efe68f26700 1 --2- 172.21.15.45:0/2700963026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe6410c230 0x7efe641983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:38.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.987+0000 7efe68f26700 1 -- 172.21.15.45:0/2700963026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe540095f0 con 0x7efe64103750 2024-05-10T03:39:38.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.987+0000 7efe69f28700 1 --2- 172.21.15.45:0/2700963026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe6410c230 0x7efe641983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:38.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.987+0000 7efe68f26700 1 --2- 172.21.15.45:0/2700963026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe64103750 0x7efe6419e9b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efe540098e0 tx=0x7efe5400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:38.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.987+0000 7efe5a7fc700 1 -- 172.21.15.45:0/2700963026 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5401d070 con 0x7efe64103750 2024-05-10T03:39:38.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.987+0000 7efe5a7fc700 1 -- 172.21.15.45:0/2700963026 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efe54003680 con 0x7efe64103750 2024-05-10T03:39:38.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.987+0000 7efe5a7fc700 1 -- 172.21.15.45:0/2700963026 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe540173f0 con 0x7efe64103750 2024-05-10T03:39:38.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.987+0000 7efe6b98b700 1 -- 172.21.15.45:0/2700963026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe64198f50 con 0x7efe64103750 2024-05-10T03:39:38.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.987+0000 7efe6b98b700 1 -- 172.21.15.45:0/2700963026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe641a5270 con 0x7efe64103750 2024-05-10T03:39:38.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.988+0000 7efe6b98b700 1 -- 172.21.15.45:0/2700963026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe641073f0 con 0x7efe64103750 2024-05-10T03:39:38.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.989+0000 7efe5a7fc700 1 -- 172.21.15.45:0/2700963026 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7efe54022470 con 0x7efe64103750 2024-05-10T03:39:38.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.990+0000 7efe5a7fc700 1 --2- 172.21.15.45:0/2700963026 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efe500a1230 0x7efe500a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:38.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.990+0000 7efe69727700 1 --2- 172.21.15.45:0/2700963026 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efe500a1230 0x7efe500a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:38.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.990+0000 7efe5a7fc700 1 -- 172.21.15.45:0/2700963026 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7efe540ce290 con 0x7efe64103750 2024-05-10T03:39:38.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.991+0000 7efe69727700 1 --2- 172.21.15.45:0/2700963026 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efe500a1230 0x7efe500a3740 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efe64199840 tx=0x7efe6000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:38.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:38.994+0000 7efe5a7fc700 1 -- 172.21.15.45:0/2700963026 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7efe5409b0d0 con 0x7efe64103750 2024-05-10T03:39:39.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:39.202+0000 7efe6b98b700 1 -- 172.21.15.45:0/2700963026 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efe64199b80 con 0x7efe500a1230 2024-05-10T03:39:39.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:39.215+0000 7efe5a7fc700 1 -- 172.21.15.45:0/2700963026 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+422452 (secure 0 0 0) 0x7efe60015070 con 0x7efe500a1230 2024-05-10T03:39:39.222 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:39:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:39.219+0000 7efe6b98b700 1 -- 172.21.15.45:0/2700963026 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efe500a1230 msgr2=0x7efe500a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:39.219+0000 7efe6b98b700 1 --2- 172.21.15.45:0/2700963026 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efe500a1230 0x7efe500a3740 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efe64199840 tx=0x7efe6000b410 comp rx=0 tx=0).stop 2024-05-10T03:39:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:39.219+0000 7efe6b98b700 1 -- 172.21.15.45:0/2700963026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe64103750 msgr2=0x7efe6419e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:39.219+0000 7efe6b98b700 1 --2- 172.21.15.45:0/2700963026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe64103750 0x7efe6419e9b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efe540098e0 tx=0x7efe5400f690 comp rx=0 tx=0).stop 2024-05-10T03:39:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:39.219+0000 7efe6b98b700 1 -- 172.21.15.45:0/2700963026 shutdown_connections 2024-05-10T03:39:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:39.219+0000 7efe6b98b700 1 --2- 172.21.15.45:0/2700963026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe64102e00 0x7efe6419e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:39.219+0000 7efe6b98b700 1 --2- 172.21.15.45:0/2700963026 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efe500a1230 0x7efe500a3740 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:39.219+0000 7efe6b98b700 1 --2- 172.21.15.45:0/2700963026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe6410c230 0x7efe641983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:39.219+0000 7efe6b98b700 1 --2- 172.21.15.45:0/2700963026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe64103750 0x7efe6419e9b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:39.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:39.219+0000 7efe6b98b700 1 -- 172.21.15.45:0/2700963026 >> 172.21.15.45:0/2700963026 conn(0x7efe640fc7a0 msgr2=0x7efe640fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:39.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:39.219+0000 7efe6b98b700 1 -- 172.21.15.45:0/2700963026 shutdown_connections 2024-05-10T03:39:39.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:39.219+0000 7efe6b98b700 1 -- 172.21.15.45:0/2700963026 wait complete. 2024-05-10T03:39:39.227 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-05-10T03:39:39.668 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":264,"stamp":"2024-05-10T03:39:37.892415+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660537,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":509,"num_read_kb":375,"num_write":417,"num_write_kb":3077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1244630,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":345,"ondisk_log_size":345,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":362704,"kb_used_data":13800,"kb_used_omap":18,"kb_used_meta":348653,"kb_avail":1124579120,"statfs":{"total":1151940427776,"available":1151569018880,"internally_reserved":0,"allocated":14131200,"data_stored":7803843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19129,"internal_metadata":357020999},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1652,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":-3,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":49,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":63894,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.825478"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076912+0000","last_change":"2024-05-10T03:38:36.586241+0000","last_active":"2024-05-10T03:39:26.076912+0000","last_peered":"2024-05-10T03:39:26.076912+0000","last_clean":"2024-05-10T03:39:26.076912+0000","last_became_active":"2024-05-10T03:38:36.585655+0000","last_became_peered":"2024-05-10T03:38:36.585655+0000","last_unstale":"2024-05-10T03:39:26.076912+0000","last_undegraded":"2024-05-10T03:39:26.076912+0000","last_fullsized":"2024-05-10T03:39:26.076912+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:58:24.614952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067299+0000","last_change":"2024-05-10T03:38:36.588174+0000","last_active":"2024-05-10T03:39:26.067299+0000","last_peered":"2024-05-10T03:39:26.067299+0000","last_clean":"2024-05-10T03:39:26.067299+0000","last_became_active":"2024-05-10T03:38:36.587843+0000","last_became_peered":"2024-05-10T03:38:36.587843+0000","last_unstale":"2024-05-10T03:39:26.067299+0000","last_undegraded":"2024-05-10T03:39:26.067299+0000","last_fullsized":"2024-05-10T03:39:26.067299+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:56.414407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067873+0000","last_change":"2024-05-10T03:38:36.587344+0000","last_active":"2024-05-10T03:39:26.067873+0000","last_peered":"2024-05-10T03:39:26.067873+0000","last_clean":"2024-05-10T03:39:26.067873+0000","last_became_active":"2024-05-10T03:38:36.586345+0000","last_became_peered":"2024-05-10T03:38:36.586345+0000","last_unstale":"2024-05-10T03:39:26.067873+0000","last_undegraded":"2024-05-10T03:39:26.067873+0000","last_fullsized":"2024-05-10T03:39:26.067873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:36.159864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.068208+0000","last_change":"2024-05-10T03:38:36.573019+0000","last_active":"2024-05-10T03:39:26.068208+0000","last_peered":"2024-05-10T03:39:26.068208+0000","last_clean":"2024-05-10T03:39:26.068208+0000","last_became_active":"2024-05-10T03:38:36.572667+0000","last_became_peered":"2024-05-10T03:38:36.572667+0000","last_unstale":"2024-05-10T03:39:26.068208+0000","last_undegraded":"2024-05-10T03:39:26.068208+0000","last_fullsized":"2024-05-10T03:39:26.068208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:24:23.722642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074998+0000","last_change":"2024-05-10T03:38:36.577069+0000","last_active":"2024-05-10T03:39:26.074998+0000","last_peered":"2024-05-10T03:39:26.074998+0000","last_clean":"2024-05-10T03:39:26.074998+0000","last_became_active":"2024-05-10T03:38:36.576683+0000","last_became_peered":"2024-05-10T03:38:36.576683+0000","last_unstale":"2024-05-10T03:39:26.074998+0000","last_undegraded":"2024-05-10T03:39:26.074998+0000","last_fullsized":"2024-05-10T03:39:26.074998+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:09:15.280098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073190+0000","last_change":"2024-05-10T03:38:36.577518+0000","last_active":"2024-05-10T03:39:26.073190+0000","last_peered":"2024-05-10T03:39:26.073190+0000","last_clean":"2024-05-10T03:39:26.073190+0000","last_became_active":"2024-05-10T03:38:36.577147+0000","last_became_peered":"2024-05-10T03:38:36.577147+0000","last_unstale":"2024-05-10T03:39:26.073190+0000","last_undegraded":"2024-05-10T03:39:26.073190+0000","last_fullsized":"2024-05-10T03:39:26.073190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:39:42.779405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078304+0000","last_change":"2024-05-10T03:38:36.594241+0000","last_active":"2024-05-10T03:39:26.078304+0000","last_peered":"2024-05-10T03:39:26.078304+0000","last_clean":"2024-05-10T03:39:26.078304+0000","last_became_active":"2024-05-10T03:38:36.593943+0000","last_became_peered":"2024-05-10T03:38:36.593943+0000","last_unstale":"2024-05-10T03:39:26.078304+0000","last_undegraded":"2024-05-10T03:39:26.078304+0000","last_fullsized":"2024-05-10T03:39:26.078304+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:00.521083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076927+0000","last_change":"2024-05-10T03:38:36.578318+0000","last_active":"2024-05-10T03:39:26.076927+0000","last_peered":"2024-05-10T03:39:26.076927+0000","last_clean":"2024-05-10T03:39:26.076927+0000","last_became_active":"2024-05-10T03:38:36.577967+0000","last_became_peered":"2024-05-10T03:38:36.577967+0000","last_unstale":"2024-05-10T03:39:26.076927+0000","last_undegraded":"2024-05-10T03:39:26.076927+0000","last_fullsized":"2024-05-10T03:39:26.076927+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:45:27.988368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075718+0000","last_change":"2024-05-10T03:38:36.590219+0000","last_active":"2024-05-10T03:39:26.075718+0000","last_peered":"2024-05-10T03:39:26.075718+0000","last_clean":"2024-05-10T03:39:26.075718+0000","last_became_active":"2024-05-10T03:38:36.589849+0000","last_became_peered":"2024-05-10T03:38:36.589849+0000","last_unstale":"2024-05-10T03:39:26.075718+0000","last_undegraded":"2024-05-10T03:39:26.075718+0000","last_fullsized":"2024-05-10T03:39:26.075718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:08:17.073204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072847+0000","last_change":"2024-05-10T03:38:36.580555+0000","last_active":"2024-05-10T03:39:26.072847+0000","last_peered":"2024-05-10T03:39:26.072847+0000","last_clean":"2024-05-10T03:39:26.072847+0000","last_became_active":"2024-05-10T03:38:36.577575+0000","last_became_peered":"2024-05-10T03:38:36.577575+0000","last_unstale":"2024-05-10T03:39:26.072847+0000","last_undegraded":"2024-05-10T03:39:26.072847+0000","last_fullsized":"2024-05-10T03:39:26.072847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:43:29.237054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078946+0000","last_change":"2024-05-10T03:38:36.586599+0000","last_active":"2024-05-10T03:39:26.078946+0000","last_peered":"2024-05-10T03:39:26.078946+0000","last_clean":"2024-05-10T03:39:26.078946+0000","last_became_active":"2024-05-10T03:38:36.585794+0000","last_became_peered":"2024-05-10T03:38:36.585794+0000","last_unstale":"2024-05-10T03:39:26.078946+0000","last_undegraded":"2024-05-10T03:39:26.078946+0000","last_fullsized":"2024-05-10T03:39:26.078946+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:25:18.337715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.068090+0000","last_change":"2024-05-10T03:38:36.578957+0000","last_active":"2024-05-10T03:39:26.068090+0000","last_peered":"2024-05-10T03:39:26.068090+0000","last_clean":"2024-05-10T03:39:26.068090+0000","last_became_active":"2024-05-10T03:38:36.578636+0000","last_became_peered":"2024-05-10T03:38:36.578636+0000","last_unstale":"2024-05-10T03:39:26.068090+0000","last_undegraded":"2024-05-10T03:39:26.068090+0000","last_fullsized":"2024-05-10T03:39:26.068090+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:55:38.830864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.079013+0000","last_change":"2024-05-10T03:39:27.079013+0000","last_active":"2024-05-10T03:39:27.079013+0000","last_peered":"2024-05-10T03:39:27.079013+0000","last_clean":"2024-05-10T03:39:27.079013+0000","last_became_active":"2024-05-10T03:39:27.078674+0000","last_became_peered":"2024-05-10T03:39:27.078674+0000","last_unstale":"2024-05-10T03:39:27.079013+0000","last_undegraded":"2024-05-10T03:39:27.079013+0000","last_fullsized":"2024-05-10T03:39:27.079013+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:59:52.547126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.066698+0000","last_change":"2024-05-10T03:38:36.590205+0000","last_active":"2024-05-10T03:39:26.066698+0000","last_peered":"2024-05-10T03:39:26.066698+0000","last_clean":"2024-05-10T03:39:26.066698+0000","last_became_active":"2024-05-10T03:38:36.589880+0000","last_became_peered":"2024-05-10T03:38:36.589880+0000","last_unstale":"2024-05-10T03:39:26.066698+0000","last_undegraded":"2024-05-10T03:39:26.066698+0000","last_fullsized":"2024-05-10T03:39:26.066698+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:22:26.374034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.077754+0000","last_change":"2024-05-10T03:39:27.077754+0000","last_active":"2024-05-10T03:39:27.077754+0000","last_peered":"2024-05-10T03:39:27.077754+0000","last_clean":"2024-05-10T03:39:27.077754+0000","last_became_active":"2024-05-10T03:39:27.077313+0000","last_became_peered":"2024-05-10T03:39:27.077313+0000","last_unstale":"2024-05-10T03:39:27.077754+0000","last_undegraded":"2024-05-10T03:39:27.077754+0000","last_fullsized":"2024-05-10T03:39:27.077754+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:36:49.331763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074838+0000","last_change":"2024-05-10T03:38:36.591061+0000","last_active":"2024-05-10T03:39:26.074838+0000","last_peered":"2024-05-10T03:39:26.074838+0000","last_clean":"2024-05-10T03:39:26.074838+0000","last_became_active":"2024-05-10T03:38:36.590698+0000","last_became_peered":"2024-05-10T03:38:36.590698+0000","last_unstale":"2024-05-10T03:39:26.074838+0000","last_undegraded":"2024-05-10T03:39:26.074838+0000","last_fullsized":"2024-05-10T03:39:26.074838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:44:43.130908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076823+0000","last_change":"2024-05-10T03:38:36.585990+0000","last_active":"2024-05-10T03:39:26.076823+0000","last_peered":"2024-05-10T03:39:26.076823+0000","last_clean":"2024-05-10T03:39:26.076823+0000","last_became_active":"2024-05-10T03:38:36.585221+0000","last_became_peered":"2024-05-10T03:38:36.585221+0000","last_unstale":"2024-05-10T03:39:26.076823+0000","last_undegraded":"2024-05-10T03:39:26.076823+0000","last_fullsized":"2024-05-10T03:39:26.076823+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:57:58.981790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074421+0000","last_change":"2024-05-10T03:38:36.586651+0000","last_active":"2024-05-10T03:39:26.074421+0000","last_peered":"2024-05-10T03:39:26.074421+0000","last_clean":"2024-05-10T03:39:26.074421+0000","last_became_active":"2024-05-10T03:38:36.586243+0000","last_became_peered":"2024-05-10T03:38:36.586243+0000","last_unstale":"2024-05-10T03:39:26.074421+0000","last_undegraded":"2024-05-10T03:39:26.074421+0000","last_fullsized":"2024-05-10T03:39:26.074421+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:15:58.148040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.071924+0000","last_change":"2024-05-10T03:38:36.583740+0000","last_active":"2024-05-10T03:39:26.071924+0000","last_peered":"2024-05-10T03:39:26.071924+0000","last_clean":"2024-05-10T03:39:26.071924+0000","last_became_active":"2024-05-10T03:38:36.583359+0000","last_became_peered":"2024-05-10T03:38:36.583359+0000","last_unstale":"2024-05-10T03:39:26.071924+0000","last_undegraded":"2024-05-10T03:39:26.071924+0000","last_fullsized":"2024-05-10T03:39:26.071924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:31:29.286667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072212+0000","last_change":"2024-05-10T03:38:40.605484+0000","last_active":"2024-05-10T03:39:26.072212+0000","last_peered":"2024-05-10T03:39:26.072212+0000","last_clean":"2024-05-10T03:39:26.072212+0000","last_became_active":"2024-05-10T03:38:40.605105+0000","last_became_peered":"2024-05-10T03:38:40.605105+0000","last_unstale":"2024-05-10T03:39:26.072212+0000","last_undegraded":"2024-05-10T03:39:26.072212+0000","last_fullsized":"2024-05-10T03:39:26.072212+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:11:34.548916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:35.070632+0000","last_change":"2024-05-10T03:38:36.093877+0000","last_active":"2024-05-10T03:39:35.070632+0000","last_peered":"2024-05-10T03:39:35.070632+0000","last_clean":"2024-05-10T03:39:35.070632+0000","last_became_active":"2024-05-10T03:38:36.093499+0000","last_became_peered":"2024-05-10T03:38:36.093499+0000","last_unstale":"2024-05-10T03:39:35.070632+0000","last_undegraded":"2024-05-10T03:39:35.070632+0000","last_fullsized":"2024-05-10T03:39:35.070632+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:42:17.171167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.080639+0000","last_change":"2024-05-10T03:39:27.080639+0000","last_active":"2024-05-10T03:39:27.080639+0000","last_peered":"2024-05-10T03:39:27.080639+0000","last_clean":"2024-05-10T03:39:27.080639+0000","last_became_active":"2024-05-10T03:39:27.080267+0000","last_became_peered":"2024-05-10T03:39:27.080267+0000","last_unstale":"2024-05-10T03:39:27.080639+0000","last_undegraded":"2024-05-10T03:39:27.080639+0000","last_fullsized":"2024-05-10T03:39:27.080639+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:56:51.282955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067286+0000","last_change":"2024-05-10T03:38:40.608982+0000","last_active":"2024-05-10T03:39:26.067286+0000","last_peered":"2024-05-10T03:39:26.067286+0000","last_clean":"2024-05-10T03:39:26.067286+0000","last_became_active":"2024-05-10T03:38:40.608619+0000","last_became_peered":"2024-05-10T03:38:40.608619+0000","last_unstale":"2024-05-10T03:39:26.067286+0000","last_undegraded":"2024-05-10T03:39:26.067286+0000","last_fullsized":"2024-05-10T03:39:26.067286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:35:56.411530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077808+0000","last_change":"2024-05-10T03:38:36.101669+0000","last_active":"2024-05-10T03:39:26.077808+0000","last_peered":"2024-05-10T03:39:26.077808+0000","last_clean":"2024-05-10T03:39:26.077808+0000","last_became_active":"2024-05-10T03:38:36.101231+0000","last_became_peered":"2024-05-10T03:38:36.101231+0000","last_unstale":"2024-05-10T03:39:26.077808+0000","last_undegraded":"2024-05-10T03:39:26.077808+0000","last_fullsized":"2024-05-10T03:39:26.077808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:42:21.992880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067320+0000","last_change":"2024-05-10T03:38:36.585580+0000","last_active":"2024-05-10T03:39:26.067320+0000","last_peered":"2024-05-10T03:39:26.067320+0000","last_clean":"2024-05-10T03:39:26.067320+0000","last_became_active":"2024-05-10T03:38:36.585239+0000","last_became_peered":"2024-05-10T03:38:36.585239+0000","last_unstale":"2024-05-10T03:39:26.067320+0000","last_undegraded":"2024-05-10T03:39:26.067320+0000","last_fullsized":"2024-05-10T03:39:26.067320+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:39:42.886154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067314+0000","last_change":"2024-05-10T03:38:40.610372+0000","last_active":"2024-05-10T03:39:26.067314+0000","last_peered":"2024-05-10T03:39:26.067314+0000","last_clean":"2024-05-10T03:39:26.067314+0000","last_became_active":"2024-05-10T03:38:40.609958+0000","last_became_peered":"2024-05-10T03:38:40.609958+0000","last_unstale":"2024-05-10T03:39:26.067314+0000","last_undegraded":"2024-05-10T03:39:26.067314+0000","last_fullsized":"2024-05-10T03:39:26.067314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:04:37.461729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075873+0000","last_change":"2024-05-10T03:38:36.091809+0000","last_active":"2024-05-10T03:39:26.075873+0000","last_peered":"2024-05-10T03:39:26.075873+0000","last_clean":"2024-05-10T03:39:26.075873+0000","last_became_active":"2024-05-10T03:38:36.091372+0000","last_became_peered":"2024-05-10T03:38:36.091372+0000","last_unstale":"2024-05-10T03:39:26.075873+0000","last_undegraded":"2024-05-10T03:39:26.075873+0000","last_fullsized":"2024-05-10T03:39:26.075873+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:25:01.784559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075357+0000","last_change":"2024-05-10T03:38:36.595389+0000","last_active":"2024-05-10T03:39:26.075357+0000","last_peered":"2024-05-10T03:39:26.075357+0000","last_clean":"2024-05-10T03:39:26.075357+0000","last_became_active":"2024-05-10T03:38:36.595011+0000","last_became_peered":"2024-05-10T03:38:36.595011+0000","last_unstale":"2024-05-10T03:39:26.075357+0000","last_undegraded":"2024-05-10T03:39:26.075357+0000","last_fullsized":"2024-05-10T03:39:26.075357+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:54:38.377508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067207+0000","last_change":"2024-05-10T03:38:40.605656+0000","last_active":"2024-05-10T03:39:26.067207+0000","last_peered":"2024-05-10T03:39:26.067207+0000","last_clean":"2024-05-10T03:39:26.067207+0000","last_became_active":"2024-05-10T03:38:40.605262+0000","last_became_peered":"2024-05-10T03:38:40.605262+0000","last_unstale":"2024-05-10T03:39:26.067207+0000","last_undegraded":"2024-05-10T03:39:26.067207+0000","last_fullsized":"2024-05-10T03:39:26.067207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:11:27.398282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.089175+0000","last_change":"2024-05-10T03:39:27.089175+0000","last_active":"2024-05-10T03:39:27.089175+0000","last_peered":"2024-05-10T03:39:27.089175+0000","last_clean":"2024-05-10T03:39:27.089175+0000","last_became_active":"2024-05-10T03:39:27.080923+0000","last_became_peered":"2024-05-10T03:39:27.080923+0000","last_unstale":"2024-05-10T03:39:27.089175+0000","last_undegraded":"2024-05-10T03:39:27.089175+0000","last_fullsized":"2024-05-10T03:39:27.089175+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:22.891201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073498+0000","last_change":"2024-05-10T03:38:36.587831+0000","last_active":"2024-05-10T03:39:26.073498+0000","last_peered":"2024-05-10T03:39:26.073498+0000","last_clean":"2024-05-10T03:39:26.073498+0000","last_became_active":"2024-05-10T03:38:36.587503+0000","last_became_peered":"2024-05-10T03:38:36.587503+0000","last_unstale":"2024-05-10T03:39:26.073498+0000","last_undegraded":"2024-05-10T03:39:26.073498+0000","last_fullsized":"2024-05-10T03:39:26.073498+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:52.335134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.071626+0000","last_change":"2024-05-10T03:38:40.601327+0000","last_active":"2024-05-10T03:39:26.071626+0000","last_peered":"2024-05-10T03:39:26.071626+0000","last_clean":"2024-05-10T03:39:26.071626+0000","last_became_active":"2024-05-10T03:38:40.600901+0000","last_became_peered":"2024-05-10T03:38:40.600901+0000","last_unstale":"2024-05-10T03:39:26.071626+0000","last_undegraded":"2024-05-10T03:39:26.071626+0000","last_fullsized":"2024-05-10T03:39:26.071626+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:28.285707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:33.069105+0000","last_change":"2024-05-10T03:38:36.094064+0000","last_active":"2024-05-10T03:39:33.069105+0000","last_peered":"2024-05-10T03:39:33.069105+0000","last_clean":"2024-05-10T03:39:33.069105+0000","last_became_active":"2024-05-10T03:38:36.093522+0000","last_became_peered":"2024-05-10T03:38:36.093522+0000","last_unstale":"2024-05-10T03:39:33.069105+0000","last_undegraded":"2024-05-10T03:39:33.069105+0000","last_fullsized":"2024-05-10T03:39:33.069105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:25:14.257166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076617+0000","last_change":"2024-05-10T03:38:36.580553+0000","last_active":"2024-05-10T03:39:26.076617+0000","last_peered":"2024-05-10T03:39:26.076617+0000","last_clean":"2024-05-10T03:39:26.076617+0000","last_became_active":"2024-05-10T03:38:36.580160+0000","last_became_peered":"2024-05-10T03:38:36.580160+0000","last_unstale":"2024-05-10T03:39:26.076617+0000","last_undegraded":"2024-05-10T03:39:26.076617+0000","last_fullsized":"2024-05-10T03:39:26.076617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:01:14.373430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.071997+0000","last_change":"2024-05-10T03:38:40.609034+0000","last_active":"2024-05-10T03:39:26.071997+0000","last_peered":"2024-05-10T03:39:26.071997+0000","last_clean":"2024-05-10T03:39:26.071997+0000","last_became_active":"2024-05-10T03:38:40.608617+0000","last_became_peered":"2024-05-10T03:38:40.608617+0000","last_unstale":"2024-05-10T03:39:26.071997+0000","last_undegraded":"2024-05-10T03:39:26.071997+0000","last_fullsized":"2024-05-10T03:39:26.071997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:55:28.669881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.093057+0000","last_change":"2024-05-10T03:39:27.093057+0000","last_active":"2024-05-10T03:39:27.093057+0000","last_peered":"2024-05-10T03:39:27.093057+0000","last_clean":"2024-05-10T03:39:27.093057+0000","last_became_active":"2024-05-10T03:39:27.076537+0000","last_became_peered":"2024-05-10T03:39:27.076537+0000","last_unstale":"2024-05-10T03:39:27.093057+0000","last_undegraded":"2024-05-10T03:39:27.093057+0000","last_fullsized":"2024-05-10T03:39:27.093057+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:24.158984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073109+0000","last_change":"2024-05-10T03:38:36.569429+0000","last_active":"2024-05-10T03:39:26.073109+0000","last_peered":"2024-05-10T03:39:26.073109+0000","last_clean":"2024-05-10T03:39:26.073109+0000","last_became_active":"2024-05-10T03:38:36.569042+0000","last_became_peered":"2024-05-10T03:38:36.569042+0000","last_unstale":"2024-05-10T03:39:26.073109+0000","last_undegraded":"2024-05-10T03:39:26.073109+0000","last_fullsized":"2024-05-10T03:39:26.073109+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:45:14.912428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076732+0000","last_change":"2024-05-10T03:38:40.607734+0000","last_active":"2024-05-10T03:39:26.076732+0000","last_peered":"2024-05-10T03:39:26.076732+0000","last_clean":"2024-05-10T03:39:26.076732+0000","last_became_active":"2024-05-10T03:38:40.607331+0000","last_became_peered":"2024-05-10T03:38:40.607331+0000","last_unstale":"2024-05-10T03:39:26.076732+0000","last_undegraded":"2024-05-10T03:39:26.076732+0000","last_fullsized":"2024-05-10T03:39:26.076732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:45:08.360275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.069502+0000","last_change":"2024-05-10T03:38:36.083651+0000","last_active":"2024-05-10T03:39:26.069502+0000","last_peered":"2024-05-10T03:39:26.069502+0000","last_clean":"2024-05-10T03:39:26.069502+0000","last_became_active":"2024-05-10T03:38:36.083235+0000","last_became_peered":"2024-05-10T03:38:36.083235+0000","last_unstale":"2024-05-10T03:39:26.069502+0000","last_undegraded":"2024-05-10T03:39:26.069502+0000","last_fullsized":"2024-05-10T03:39:26.069502+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:28:43.179157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077120+0000","last_change":"2024-05-10T03:38:36.579055+0000","last_active":"2024-05-10T03:39:26.077120+0000","last_peered":"2024-05-10T03:39:26.077120+0000","last_clean":"2024-05-10T03:39:26.077120+0000","last_became_active":"2024-05-10T03:38:36.578200+0000","last_became_peered":"2024-05-10T03:38:36.578200+0000","last_unstale":"2024-05-10T03:39:26.077120+0000","last_undegraded":"2024-05-10T03:39:26.077120+0000","last_fullsized":"2024-05-10T03:39:26.077120+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:48:12.749264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067181+0000","last_change":"2024-05-10T03:38:40.603903+0000","last_active":"2024-05-10T03:39:26.067181+0000","last_peered":"2024-05-10T03:39:26.067181+0000","last_clean":"2024-05-10T03:39:26.067181+0000","last_became_active":"2024-05-10T03:38:40.603481+0000","last_became_peered":"2024-05-10T03:38:40.603481+0000","last_unstale":"2024-05-10T03:39:26.067181+0000","last_undegraded":"2024-05-10T03:39:26.067181+0000","last_fullsized":"2024-05-10T03:39:26.067181+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:44:48.526838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072175+0000","last_change":"2024-05-10T03:38:36.093549+0000","last_active":"2024-05-10T03:39:26.072175+0000","last_peered":"2024-05-10T03:39:26.072175+0000","last_clean":"2024-05-10T03:39:26.072175+0000","last_became_active":"2024-05-10T03:38:36.093244+0000","last_became_peered":"2024-05-10T03:38:36.093244+0000","last_unstale":"2024-05-10T03:39:26.072175+0000","last_undegraded":"2024-05-10T03:39:26.072175+0000","last_fullsized":"2024-05-10T03:39:26.072175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:11:55.727728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073706+0000","last_change":"2024-05-10T03:38:36.582623+0000","last_active":"2024-05-10T03:39:26.073706+0000","last_peered":"2024-05-10T03:39:26.073706+0000","last_clean":"2024-05-10T03:39:26.073706+0000","last_became_active":"2024-05-10T03:38:36.582262+0000","last_became_peered":"2024-05-10T03:38:36.582262+0000","last_unstale":"2024-05-10T03:39:26.073706+0000","last_undegraded":"2024-05-10T03:39:26.073706+0000","last_fullsized":"2024-05-10T03:39:26.073706+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:48.561206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077079+0000","last_change":"2024-05-10T03:38:40.602050+0000","last_active":"2024-05-10T03:39:26.077079+0000","last_peered":"2024-05-10T03:39:26.077079+0000","last_clean":"2024-05-10T03:39:26.077079+0000","last_became_active":"2024-05-10T03:38:40.601699+0000","last_became_peered":"2024-05-10T03:38:40.601699+0000","last_unstale":"2024-05-10T03:39:26.077079+0000","last_undegraded":"2024-05-10T03:39:26.077079+0000","last_fullsized":"2024-05-10T03:39:26.077079+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:56.778636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":92,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:34.069738+0000","last_change":"2024-05-10T03:38:36.095747+0000","last_active":"2024-05-10T03:39:34.069738+0000","last_peered":"2024-05-10T03:39:34.069738+0000","last_clean":"2024-05-10T03:39:34.069738+0000","last_became_active":"2024-05-10T03:38:36.095371+0000","last_became_peered":"2024-05-10T03:38:36.095371+0000","last_unstale":"2024-05-10T03:39:34.069738+0000","last_undegraded":"2024-05-10T03:39:34.069738+0000","last_fullsized":"2024-05-10T03:39:34.069738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:02:37.435286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075561+0000","last_change":"2024-05-10T03:38:36.591321+0000","last_active":"2024-05-10T03:39:26.075561+0000","last_peered":"2024-05-10T03:39:26.075561+0000","last_clean":"2024-05-10T03:39:26.075561+0000","last_became_active":"2024-05-10T03:38:36.589852+0000","last_became_peered":"2024-05-10T03:38:36.589852+0000","last_unstale":"2024-05-10T03:39:26.075561+0000","last_undegraded":"2024-05-10T03:39:26.075561+0000","last_fullsized":"2024-05-10T03:39:26.075561+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:43.075901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073535+0000","last_change":"2024-05-10T03:38:40.605096+0000","last_active":"2024-05-10T03:39:26.073535+0000","last_peered":"2024-05-10T03:39:26.073535+0000","last_clean":"2024-05-10T03:39:26.073535+0000","last_became_active":"2024-05-10T03:38:40.604595+0000","last_became_peered":"2024-05-10T03:38:40.604595+0000","last_unstale":"2024-05-10T03:39:26.073535+0000","last_undegraded":"2024-05-10T03:39:26.073535+0000","last_fullsized":"2024-05-10T03:39:26.073535+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:14.547025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078938+0000","last_change":"2024-05-10T03:38:36.097214+0000","last_active":"2024-05-10T03:39:26.078938+0000","last_peered":"2024-05-10T03:39:26.078938+0000","last_clean":"2024-05-10T03:39:26.078938+0000","last_became_active":"2024-05-10T03:38:36.096835+0000","last_became_peered":"2024-05-10T03:38:36.096835+0000","last_unstale":"2024-05-10T03:39:26.078938+0000","last_undegraded":"2024-05-10T03:39:26.078938+0000","last_fullsized":"2024-05-10T03:39:26.078938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:50.757974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.081369+0000","last_change":"2024-05-10T03:39:27.081369+0000","last_active":"2024-05-10T03:39:27.081369+0000","last_peered":"2024-05-10T03:39:27.081369+0000","last_clean":"2024-05-10T03:39:27.081369+0000","last_became_active":"2024-05-10T03:39:27.080851+0000","last_became_peered":"2024-05-10T03:39:27.080851+0000","last_unstale":"2024-05-10T03:39:27.081369+0000","last_undegraded":"2024-05-10T03:39:27.081369+0000","last_fullsized":"2024-05-10T03:39:27.081369+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:11.552549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067592+0000","last_change":"2024-05-10T03:38:40.605627+0000","last_active":"2024-05-10T03:39:26.067592+0000","last_peered":"2024-05-10T03:39:26.067592+0000","last_clean":"2024-05-10T03:39:26.067592+0000","last_became_active":"2024-05-10T03:38:40.605116+0000","last_became_peered":"2024-05-10T03:38:40.605116+0000","last_unstale":"2024-05-10T03:39:26.067592+0000","last_undegraded":"2024-05-10T03:39:26.067592+0000","last_fullsized":"2024-05-10T03:39:26.067592+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:50:08.759725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073226+0000","last_change":"2024-05-10T03:38:36.102257+0000","last_active":"2024-05-10T03:39:26.073226+0000","last_peered":"2024-05-10T03:39:26.073226+0000","last_clean":"2024-05-10T03:39:26.073226+0000","last_became_active":"2024-05-10T03:38:36.101876+0000","last_became_peered":"2024-05-10T03:38:36.101876+0000","last_unstale":"2024-05-10T03:39:26.073226+0000","last_undegraded":"2024-05-10T03:39:26.073226+0000","last_fullsized":"2024-05-10T03:39:26.073226+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:38:01.164794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075466+0000","last_change":"2024-05-10T03:38:36.591746+0000","last_active":"2024-05-10T03:39:26.075466+0000","last_peered":"2024-05-10T03:39:26.075466+0000","last_clean":"2024-05-10T03:39:26.075466+0000","last_became_active":"2024-05-10T03:38:36.591474+0000","last_became_peered":"2024-05-10T03:38:36.591474+0000","last_unstale":"2024-05-10T03:39:26.075466+0000","last_undegraded":"2024-05-10T03:39:26.075466+0000","last_fullsized":"2024-05-10T03:39:26.075466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:18:02.773737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073900+0000","last_change":"2024-05-10T03:38:40.605956+0000","last_active":"2024-05-10T03:39:26.073900+0000","last_peered":"2024-05-10T03:39:26.073900+0000","last_clean":"2024-05-10T03:39:26.073900+0000","last_became_active":"2024-05-10T03:38:40.605466+0000","last_became_peered":"2024-05-10T03:38:40.605466+0000","last_unstale":"2024-05-10T03:39:26.073900+0000","last_undegraded":"2024-05-10T03:39:26.073900+0000","last_fullsized":"2024-05-10T03:39:26.073900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:07:44.234771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"86'34","reported_seq":151,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:34.090318+0000","last_change":"2024-05-10T03:39:27.083993+0000","last_active":"2024-05-10T03:39:34.090318+0000","last_peered":"2024-05-10T03:39:34.090318+0000","last_clean":"2024-05-10T03:39:34.090318+0000","last_became_active":"2024-05-10T03:39:27.075982+0000","last_became_peered":"2024-05-10T03:39:27.075982+0000","last_unstale":"2024-05-10T03:39:34.090318+0000","last_undegraded":"2024-05-10T03:39:34.090318+0000","last_fullsized":"2024-05-10T03:39:34.090318+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:10:49.852271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63312,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":73,"num_read_kb":97,"num_write":36,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":63312,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075545+0000","last_change":"2024-05-10T03:38:36.579560+0000","last_active":"2024-05-10T03:39:26.075545+0000","last_peered":"2024-05-10T03:39:26.075545+0000","last_clean":"2024-05-10T03:39:26.075545+0000","last_became_active":"2024-05-10T03:38:36.579217+0000","last_became_peered":"2024-05-10T03:38:36.579217+0000","last_unstale":"2024-05-10T03:39:26.075545+0000","last_undegraded":"2024-05-10T03:39:26.075545+0000","last_fullsized":"2024-05-10T03:39:26.075545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:11:50.208794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076114+0000","last_change":"2024-05-10T03:38:40.599253+0000","last_active":"2024-05-10T03:39:26.076114+0000","last_peered":"2024-05-10T03:39:26.076114+0000","last_clean":"2024-05-10T03:39:26.076114+0000","last_became_active":"2024-05-10T03:38:40.597818+0000","last_became_peered":"2024-05-10T03:38:40.597818+0000","last_unstale":"2024-05-10T03:39:26.076114+0000","last_undegraded":"2024-05-10T03:39:26.076114+0000","last_fullsized":"2024-05-10T03:39:26.076114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:48:37.286108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073316+0000","last_change":"2024-05-10T03:38:36.100727+0000","last_active":"2024-05-10T03:39:26.073316+0000","last_peered":"2024-05-10T03:39:26.073316+0000","last_clean":"2024-05-10T03:39:26.073316+0000","last_became_active":"2024-05-10T03:38:36.100381+0000","last_became_peered":"2024-05-10T03:38:36.100381+0000","last_unstale":"2024-05-10T03:39:26.073316+0000","last_undegraded":"2024-05-10T03:39:26.073316+0000","last_fullsized":"2024-05-10T03:39:26.073316+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:57:53.831417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.069729+0000","last_change":"2024-05-10T03:38:36.580924+0000","last_active":"2024-05-10T03:39:26.069729+0000","last_peered":"2024-05-10T03:39:26.069729+0000","last_clean":"2024-05-10T03:39:26.069729+0000","last_became_active":"2024-05-10T03:38:36.580598+0000","last_became_peered":"2024-05-10T03:38:36.580598+0000","last_unstale":"2024-05-10T03:39:26.069729+0000","last_undegraded":"2024-05-10T03:39:26.069729+0000","last_fullsized":"2024-05-10T03:39:26.069729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:33:12.007718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077561+0000","last_change":"2024-05-10T03:38:40.606934+0000","last_active":"2024-05-10T03:39:26.077561+0000","last_peered":"2024-05-10T03:39:26.077561+0000","last_clean":"2024-05-10T03:39:26.077561+0000","last_became_active":"2024-05-10T03:38:40.606451+0000","last_became_peered":"2024-05-10T03:38:40.606451+0000","last_unstale":"2024-05-10T03:39:26.077561+0000","last_undegraded":"2024-05-10T03:39:26.077561+0000","last_fullsized":"2024-05-10T03:39:26.077561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:03:43.562337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073308+0000","last_change":"2024-05-10T03:38:36.093109+0000","last_active":"2024-05-10T03:39:26.073308+0000","last_peered":"2024-05-10T03:39:26.073308+0000","last_clean":"2024-05-10T03:39:26.073308+0000","last_became_active":"2024-05-10T03:38:36.092623+0000","last_became_peered":"2024-05-10T03:38:36.092623+0000","last_unstale":"2024-05-10T03:39:26.073308+0000","last_undegraded":"2024-05-10T03:39:26.073308+0000","last_fullsized":"2024-05-10T03:39:26.073308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:27:10.367098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.079173+0000","last_change":"2024-05-10T03:38:36.582794+0000","last_active":"2024-05-10T03:39:26.079173+0000","last_peered":"2024-05-10T03:39:26.079173+0000","last_clean":"2024-05-10T03:39:26.079173+0000","last_became_active":"2024-05-10T03:38:36.582464+0000","last_became_peered":"2024-05-10T03:38:36.582464+0000","last_unstale":"2024-05-10T03:39:26.079173+0000","last_undegraded":"2024-05-10T03:39:26.079173+0000","last_fullsized":"2024-05-10T03:39:26.079173+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:58:19.665485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074568+0000","last_change":"2024-05-10T03:38:40.608696+0000","last_active":"2024-05-10T03:39:26.074568+0000","last_peered":"2024-05-10T03:39:26.074568+0000","last_clean":"2024-05-10T03:39:26.074568+0000","last_became_active":"2024-05-10T03:38:40.607868+0000","last_became_peered":"2024-05-10T03:38:40.607868+0000","last_unstale":"2024-05-10T03:39:26.074568+0000","last_undegraded":"2024-05-10T03:39:26.074568+0000","last_fullsized":"2024-05-10T03:39:26.074568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:27.154675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":61,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:34.077728+0000","last_change":"2024-05-10T03:38:36.093060+0000","last_active":"2024-05-10T03:39:34.077728+0000","last_peered":"2024-05-10T03:39:34.077728+0000","last_clean":"2024-05-10T03:39:34.077728+0000","last_became_active":"2024-05-10T03:38:36.092476+0000","last_became_peered":"2024-05-10T03:38:36.092476+0000","last_unstale":"2024-05-10T03:39:34.077728+0000","last_undegraded":"2024-05-10T03:39:34.077728+0000","last_fullsized":"2024-05-10T03:39:34.077728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:52:04.624230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078407+0000","last_change":"2024-05-10T03:38:36.594808+0000","last_active":"2024-05-10T03:39:26.078407+0000","last_peered":"2024-05-10T03:39:26.078407+0000","last_clean":"2024-05-10T03:39:26.078407+0000","last_became_active":"2024-05-10T03:38:36.594511+0000","last_became_peered":"2024-05-10T03:38:36.594511+0000","last_unstale":"2024-05-10T03:39:26.078407+0000","last_undegraded":"2024-05-10T03:39:26.078407+0000","last_fullsized":"2024-05-10T03:39:26.078407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:18:59.981485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070877+0000","last_change":"2024-05-10T03:38:40.605744+0000","last_active":"2024-05-10T03:39:26.070877+0000","last_peered":"2024-05-10T03:39:26.070877+0000","last_clean":"2024-05-10T03:39:26.070877+0000","last_became_active":"2024-05-10T03:38:40.605269+0000","last_became_peered":"2024-05-10T03:38:40.605269+0000","last_unstale":"2024-05-10T03:39:26.070877+0000","last_undegraded":"2024-05-10T03:39:26.070877+0000","last_fullsized":"2024-05-10T03:39:26.070877+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:21.881903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074955+0000","last_change":"2024-05-10T03:38:36.098918+0000","last_active":"2024-05-10T03:39:26.074955+0000","last_peered":"2024-05-10T03:39:26.074955+0000","last_clean":"2024-05-10T03:39:26.074955+0000","last_became_active":"2024-05-10T03:38:36.098586+0000","last_became_peered":"2024-05-10T03:38:36.098586+0000","last_unstale":"2024-05-10T03:39:26.074955+0000","last_undegraded":"2024-05-10T03:39:26.074955+0000","last_fullsized":"2024-05-10T03:39:26.074955+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:58:48.297763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072973+0000","last_change":"2024-05-10T03:38:36.581347+0000","last_active":"2024-05-10T03:39:26.072973+0000","last_peered":"2024-05-10T03:39:26.072973+0000","last_clean":"2024-05-10T03:39:26.072973+0000","last_became_active":"2024-05-10T03:38:36.581044+0000","last_became_peered":"2024-05-10T03:38:36.581044+0000","last_unstale":"2024-05-10T03:39:26.072973+0000","last_undegraded":"2024-05-10T03:39:26.072973+0000","last_fullsized":"2024-05-10T03:39:26.072973+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:23:43.885238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072974+0000","last_change":"2024-05-10T03:38:40.600521+0000","last_active":"2024-05-10T03:39:26.072974+0000","last_peered":"2024-05-10T03:39:26.072974+0000","last_clean":"2024-05-10T03:39:26.072974+0000","last_became_active":"2024-05-10T03:38:40.600016+0000","last_became_peered":"2024-05-10T03:38:40.600016+0000","last_unstale":"2024-05-10T03:39:26.072974+0000","last_undegraded":"2024-05-10T03:39:26.072974+0000","last_fullsized":"2024-05-10T03:39:26.072974+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:58:37.881367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075200+0000","last_change":"2024-05-10T03:38:36.094209+0000","last_active":"2024-05-10T03:39:26.075200+0000","last_peered":"2024-05-10T03:39:26.075200+0000","last_clean":"2024-05-10T03:39:26.075200+0000","last_became_active":"2024-05-10T03:38:36.093447+0000","last_became_peered":"2024-05-10T03:38:36.093447+0000","last_unstale":"2024-05-10T03:39:26.075200+0000","last_undegraded":"2024-05-10T03:39:26.075200+0000","last_fullsized":"2024-05-10T03:39:26.075200+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:24:20.540340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077847+0000","last_change":"2024-05-10T03:38:36.587832+0000","last_active":"2024-05-10T03:39:26.077847+0000","last_peered":"2024-05-10T03:39:26.077847+0000","last_clean":"2024-05-10T03:39:26.077847+0000","last_became_active":"2024-05-10T03:38:36.587475+0000","last_became_peered":"2024-05-10T03:38:36.587475+0000","last_unstale":"2024-05-10T03:39:26.077847+0000","last_undegraded":"2024-05-10T03:39:26.077847+0000","last_fullsized":"2024-05-10T03:39:26.077847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:47:53.318634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076509+0000","last_change":"2024-05-10T03:38:41.150879+0000","last_active":"2024-05-10T03:39:26.076509+0000","last_peered":"2024-05-10T03:39:26.076509+0000","last_clean":"2024-05-10T03:39:26.076509+0000","last_became_active":"2024-05-10T03:38:41.150350+0000","last_became_peered":"2024-05-10T03:38:41.150350+0000","last_unstale":"2024-05-10T03:39:26.076509+0000","last_undegraded":"2024-05-10T03:39:26.076509+0000","last_fullsized":"2024-05-10T03:39:26.076509+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:47:32.429040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074172+0000","last_change":"2024-05-10T03:38:36.095933+0000","last_active":"2024-05-10T03:39:26.074172+0000","last_peered":"2024-05-10T03:39:26.074172+0000","last_clean":"2024-05-10T03:39:26.074172+0000","last_became_active":"2024-05-10T03:38:36.095592+0000","last_became_peered":"2024-05-10T03:38:36.095592+0000","last_unstale":"2024-05-10T03:39:26.074172+0000","last_undegraded":"2024-05-10T03:39:26.074172+0000","last_fullsized":"2024-05-10T03:39:26.074172+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:52:21.729051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072554+0000","last_change":"2024-05-10T03:38:36.591747+0000","last_active":"2024-05-10T03:39:26.072554+0000","last_peered":"2024-05-10T03:39:26.072554+0000","last_clean":"2024-05-10T03:39:26.072554+0000","last_became_active":"2024-05-10T03:38:36.591432+0000","last_became_peered":"2024-05-10T03:38:36.591432+0000","last_unstale":"2024-05-10T03:39:26.072554+0000","last_undegraded":"2024-05-10T03:39:26.072554+0000","last_fullsized":"2024-05-10T03:39:26.072554+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:20:37.549054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070521+0000","last_change":"2024-05-10T03:38:40.597535+0000","last_active":"2024-05-10T03:39:26.070521+0000","last_peered":"2024-05-10T03:39:26.070521+0000","last_clean":"2024-05-10T03:39:26.070521+0000","last_became_active":"2024-05-10T03:38:40.597108+0000","last_became_peered":"2024-05-10T03:38:40.597108+0000","last_unstale":"2024-05-10T03:39:26.070521+0000","last_undegraded":"2024-05-10T03:39:26.070521+0000","last_fullsized":"2024-05-10T03:39:26.070521+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:31:21.765071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":61,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:34.069630+0000","last_change":"2024-05-10T03:38:36.099238+0000","last_active":"2024-05-10T03:39:34.069630+0000","last_peered":"2024-05-10T03:39:34.069630+0000","last_clean":"2024-05-10T03:39:34.069630+0000","last_became_active":"2024-05-10T03:38:36.098761+0000","last_became_peered":"2024-05-10T03:38:36.098761+0000","last_unstale":"2024-05-10T03:39:34.069630+0000","last_undegraded":"2024-05-10T03:39:34.069630+0000","last_fullsized":"2024-05-10T03:39:34.069630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:08:49.892665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072990+0000","last_change":"2024-05-10T03:38:36.580983+0000","last_active":"2024-05-10T03:39:26.072990+0000","last_peered":"2024-05-10T03:39:26.072990+0000","last_clean":"2024-05-10T03:39:26.072990+0000","last_became_active":"2024-05-10T03:38:36.580252+0000","last_became_peered":"2024-05-10T03:38:36.580252+0000","last_unstale":"2024-05-10T03:39:26.072990+0000","last_undegraded":"2024-05-10T03:39:26.072990+0000","last_fullsized":"2024-05-10T03:39:26.072990+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:16.265473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070165+0000","last_change":"2024-05-10T03:38:41.148651+0000","last_active":"2024-05-10T03:39:26.070165+0000","last_peered":"2024-05-10T03:39:26.070165+0000","last_clean":"2024-05-10T03:39:26.070165+0000","last_became_active":"2024-05-10T03:38:41.148192+0000","last_became_peered":"2024-05-10T03:38:41.148192+0000","last_unstale":"2024-05-10T03:39:26.070165+0000","last_undegraded":"2024-05-10T03:39:26.070165+0000","last_fullsized":"2024-05-10T03:39:26.070165+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:13:38.795763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072565+0000","last_change":"2024-05-10T03:38:36.577839+0000","last_active":"2024-05-10T03:39:26.072565+0000","last_peered":"2024-05-10T03:39:26.072565+0000","last_clean":"2024-05-10T03:39:26.072565+0000","last_became_active":"2024-05-10T03:38:36.576917+0000","last_became_peered":"2024-05-10T03:38:36.576917+0000","last_unstale":"2024-05-10T03:39:26.072565+0000","last_undegraded":"2024-05-10T03:39:26.072565+0000","last_fullsized":"2024-05-10T03:39:26.072565+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:52:05.825241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":58,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:31.071324+0000","last_change":"2024-05-10T03:38:36.099138+0000","last_active":"2024-05-10T03:39:31.071324+0000","last_peered":"2024-05-10T03:39:31.071324+0000","last_clean":"2024-05-10T03:39:31.071324+0000","last_became_active":"2024-05-10T03:38:36.098747+0000","last_became_peered":"2024-05-10T03:38:36.098747+0000","last_unstale":"2024-05-10T03:39:31.071324+0000","last_undegraded":"2024-05-10T03:39:31.071324+0000","last_fullsized":"2024-05-10T03:39:31.071324+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:18.236383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078995+0000","last_change":"2024-05-10T03:38:40.605489+0000","last_active":"2024-05-10T03:39:26.078995+0000","last_peered":"2024-05-10T03:39:26.078995+0000","last_clean":"2024-05-10T03:39:26.078995+0000","last_became_active":"2024-05-10T03:38:40.605040+0000","last_became_peered":"2024-05-10T03:38:40.605040+0000","last_unstale":"2024-05-10T03:39:26.078995+0000","last_undegraded":"2024-05-10T03:39:26.078995+0000","last_fullsized":"2024-05-10T03:39:26.078995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:52:08.592132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077045+0000","last_change":"2024-05-10T03:38:36.589325+0000","last_active":"2024-05-10T03:39:26.077045+0000","last_peered":"2024-05-10T03:39:26.077045+0000","last_clean":"2024-05-10T03:39:26.077045+0000","last_became_active":"2024-05-10T03:38:36.588976+0000","last_became_peered":"2024-05-10T03:38:36.588976+0000","last_unstale":"2024-05-10T03:39:26.077045+0000","last_undegraded":"2024-05-10T03:39:26.077045+0000","last_fullsized":"2024-05-10T03:39:26.077045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:40.849614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067440+0000","last_change":"2024-05-10T03:38:36.093701+0000","last_active":"2024-05-10T03:39:26.067440+0000","last_peered":"2024-05-10T03:39:26.067440+0000","last_clean":"2024-05-10T03:39:26.067440+0000","last_became_active":"2024-05-10T03:38:36.093362+0000","last_became_peered":"2024-05-10T03:38:36.093362+0000","last_unstale":"2024-05-10T03:39:26.067440+0000","last_undegraded":"2024-05-10T03:39:26.067440+0000","last_fullsized":"2024-05-10T03:39:26.067440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:42:00.208900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":330,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078251+0000","last_change":"2024-05-10T03:37:46.762875+0000","last_active":"2024-05-10T03:39:26.078251+0000","last_peered":"2024-05-10T03:39:26.078251+0000","last_clean":"2024-05-10T03:39:26.078251+0000","last_became_active":"2024-05-10T03:37:46.762448+0000","last_became_peered":"2024-05-10T03:37:46.762448+0000","last_unstale":"2024-05-10T03:39:26.078251+0000","last_undegraded":"2024-05-10T03:39:26.078251+0000","last_fullsized":"2024-05-10T03:39:26.078251+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:35:20.340567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:35:20.340567+0000","last_clean_scrub_stamp":"2024-05-10T03:35:20.340567+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:09:05.491303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073007+0000","last_change":"2024-05-10T03:38:41.150966+0000","last_active":"2024-05-10T03:39:26.073007+0000","last_peered":"2024-05-10T03:39:26.073007+0000","last_clean":"2024-05-10T03:39:26.073007+0000","last_became_active":"2024-05-10T03:38:41.150505+0000","last_became_peered":"2024-05-10T03:38:41.150505+0000","last_unstale":"2024-05-10T03:39:26.073007+0000","last_undegraded":"2024-05-10T03:39:26.073007+0000","last_fullsized":"2024-05-10T03:39:26.073007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:53.992369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.069834+0000","last_change":"2024-05-10T03:38:36.577457+0000","last_active":"2024-05-10T03:39:26.069834+0000","last_peered":"2024-05-10T03:39:26.069834+0000","last_clean":"2024-05-10T03:39:26.069834+0000","last_became_active":"2024-05-10T03:38:36.577105+0000","last_became_peered":"2024-05-10T03:38:36.577105+0000","last_unstale":"2024-05-10T03:39:26.069834+0000","last_undegraded":"2024-05-10T03:39:26.069834+0000","last_fullsized":"2024-05-10T03:39:26.069834+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:34:15.611496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078317+0000","last_change":"2024-05-10T03:38:36.094057+0000","last_active":"2024-05-10T03:39:26.078317+0000","last_peered":"2024-05-10T03:39:26.078317+0000","last_clean":"2024-05-10T03:39:26.078317+0000","last_became_active":"2024-05-10T03:38:36.093705+0000","last_became_peered":"2024-05-10T03:38:36.093705+0000","last_unstale":"2024-05-10T03:39:26.078317+0000","last_undegraded":"2024-05-10T03:39:26.078317+0000","last_fullsized":"2024-05-10T03:39:26.078317+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:00:10.138524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077005+0000","last_change":"2024-05-10T03:38:40.603522+0000","last_active":"2024-05-10T03:39:26.077005+0000","last_peered":"2024-05-10T03:39:26.077005+0000","last_clean":"2024-05-10T03:39:26.077005+0000","last_became_active":"2024-05-10T03:38:40.603058+0000","last_became_peered":"2024-05-10T03:38:40.603058+0000","last_unstale":"2024-05-10T03:39:26.077005+0000","last_undegraded":"2024-05-10T03:39:26.077005+0000","last_fullsized":"2024-05-10T03:39:26.077005+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:15:06.869163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075656+0000","last_change":"2024-05-10T03:38:36.099009+0000","last_active":"2024-05-10T03:39:26.075656+0000","last_peered":"2024-05-10T03:39:26.075656+0000","last_clean":"2024-05-10T03:39:26.075656+0000","last_became_active":"2024-05-10T03:38:36.098695+0000","last_became_peered":"2024-05-10T03:38:36.098695+0000","last_unstale":"2024-05-10T03:39:26.075656+0000","last_undegraded":"2024-05-10T03:39:26.075656+0000","last_fullsized":"2024-05-10T03:39:26.075656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:06.634752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070881+0000","last_change":"2024-05-10T03:38:36.576498+0000","last_active":"2024-05-10T03:39:26.070881+0000","last_peered":"2024-05-10T03:39:26.070881+0000","last_clean":"2024-05-10T03:39:26.070881+0000","last_became_active":"2024-05-10T03:38:36.576161+0000","last_became_peered":"2024-05-10T03:38:36.576161+0000","last_unstale":"2024-05-10T03:39:26.070881+0000","last_undegraded":"2024-05-10T03:39:26.070881+0000","last_fullsized":"2024-05-10T03:39:26.070881+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:09.353279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076991+0000","last_change":"2024-05-10T03:38:41.148317+0000","last_active":"2024-05-10T03:39:26.076991+0000","last_peered":"2024-05-10T03:39:26.076991+0000","last_clean":"2024-05-10T03:39:26.076991+0000","last_became_active":"2024-05-10T03:38:41.147907+0000","last_became_peered":"2024-05-10T03:38:41.147907+0000","last_unstale":"2024-05-10T03:39:26.076991+0000","last_undegraded":"2024-05-10T03:39:26.076991+0000","last_fullsized":"2024-05-10T03:39:26.076991+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:23:08.157296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'9","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074498+0000","last_change":"2024-05-10T03:38:36.096437+0000","last_active":"2024-05-10T03:39:26.074498+0000","last_peered":"2024-05-10T03:39:26.074498+0000","last_clean":"2024-05-10T03:39:26.074498+0000","last_became_active":"2024-05-10T03:38:36.096122+0000","last_became_peered":"2024-05-10T03:38:36.096122+0000","last_unstale":"2024-05-10T03:39:26.074498+0000","last_undegraded":"2024-05-10T03:39:26.074498+0000","last_fullsized":"2024-05-10T03:39:26.074498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:47:02.400065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077474+0000","last_change":"2024-05-10T03:38:36.574022+0000","last_active":"2024-05-10T03:39:26.077474+0000","last_peered":"2024-05-10T03:39:26.077474+0000","last_clean":"2024-05-10T03:39:26.077474+0000","last_became_active":"2024-05-10T03:38:36.573530+0000","last_became_peered":"2024-05-10T03:38:36.573530+0000","last_unstale":"2024-05-10T03:39:26.077474+0000","last_undegraded":"2024-05-10T03:39:26.077474+0000","last_fullsized":"2024-05-10T03:39:26.077474+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:35:32.574897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072099+0000","last_change":"2024-05-10T03:38:40.600341+0000","last_active":"2024-05-10T03:39:26.072099+0000","last_peered":"2024-05-10T03:39:26.072099+0000","last_clean":"2024-05-10T03:39:26.072099+0000","last_became_active":"2024-05-10T03:38:40.599944+0000","last_became_peered":"2024-05-10T03:38:40.599944+0000","last_unstale":"2024-05-10T03:39:26.072099+0000","last_undegraded":"2024-05-10T03:39:26.072099+0000","last_fullsized":"2024-05-10T03:39:26.072099+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:12:01.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067765+0000","last_change":"2024-05-10T03:38:36.091020+0000","last_active":"2024-05-10T03:39:26.067765+0000","last_peered":"2024-05-10T03:39:26.067765+0000","last_clean":"2024-05-10T03:39:26.067765+0000","last_became_active":"2024-05-10T03:38:36.090699+0000","last_became_peered":"2024-05-10T03:38:36.090699+0000","last_unstale":"2024-05-10T03:39:26.067765+0000","last_undegraded":"2024-05-10T03:39:26.067765+0000","last_fullsized":"2024-05-10T03:39:26.067765+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:44:12.546166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067252+0000","last_change":"2024-05-10T03:38:36.584279+0000","last_active":"2024-05-10T03:39:26.067252+0000","last_peered":"2024-05-10T03:39:26.067252+0000","last_clean":"2024-05-10T03:39:26.067252+0000","last_became_active":"2024-05-10T03:38:36.583897+0000","last_became_peered":"2024-05-10T03:38:36.583897+0000","last_unstale":"2024-05-10T03:39:26.067252+0000","last_undegraded":"2024-05-10T03:39:26.067252+0000","last_fullsized":"2024-05-10T03:39:26.067252+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:33:17.210334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067474+0000","last_change":"2024-05-10T03:38:41.151023+0000","last_active":"2024-05-10T03:39:26.067474+0000","last_peered":"2024-05-10T03:39:26.067474+0000","last_clean":"2024-05-10T03:39:26.067474+0000","last_became_active":"2024-05-10T03:38:41.150489+0000","last_became_peered":"2024-05-10T03:38:41.150489+0000","last_unstale":"2024-05-10T03:39:26.067474+0000","last_undegraded":"2024-05-10T03:39:26.067474+0000","last_fullsized":"2024-05-10T03:39:26.067474+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:57:57.440139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074840+0000","last_change":"2024-05-10T03:38:36.098990+0000","last_active":"2024-05-10T03:39:26.074840+0000","last_peered":"2024-05-10T03:39:26.074840+0000","last_clean":"2024-05-10T03:39:26.074840+0000","last_became_active":"2024-05-10T03:38:36.098649+0000","last_became_peered":"2024-05-10T03:38:36.098649+0000","last_unstale":"2024-05-10T03:39:26.074840+0000","last_undegraded":"2024-05-10T03:39:26.074840+0000","last_fullsized":"2024-05-10T03:39:26.074840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:38:09.915041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075102+0000","last_change":"2024-05-10T03:38:36.581286+0000","last_active":"2024-05-10T03:39:26.075102+0000","last_peered":"2024-05-10T03:39:26.075102+0000","last_clean":"2024-05-10T03:39:26.075102+0000","last_became_active":"2024-05-10T03:38:36.580927+0000","last_became_peered":"2024-05-10T03:38:36.580927+0000","last_unstale":"2024-05-10T03:39:26.075102+0000","last_undegraded":"2024-05-10T03:39:26.075102+0000","last_fullsized":"2024-05-10T03:39:26.075102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:10:38.663239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074691+0000","last_change":"2024-05-10T03:38:40.605668+0000","last_active":"2024-05-10T03:39:26.074691+0000","last_peered":"2024-05-10T03:39:26.074691+0000","last_clean":"2024-05-10T03:39:26.074691+0000","last_became_active":"2024-05-10T03:38:40.605156+0000","last_became_peered":"2024-05-10T03:38:40.605156+0000","last_unstale":"2024-05-10T03:39:26.074691+0000","last_undegraded":"2024-05-10T03:39:26.074691+0000","last_fullsized":"2024-05-10T03:39:26.074691+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:28:07.192875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077182+0000","last_change":"2024-05-10T03:38:36.090250+0000","last_active":"2024-05-10T03:39:26.077182+0000","last_peered":"2024-05-10T03:39:26.077182+0000","last_clean":"2024-05-10T03:39:26.077182+0000","last_became_active":"2024-05-10T03:38:36.089899+0000","last_became_peered":"2024-05-10T03:38:36.089899+0000","last_unstale":"2024-05-10T03:39:26.077182+0000","last_undegraded":"2024-05-10T03:39:26.077182+0000","last_fullsized":"2024-05-10T03:39:26.077182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:01:19.322065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076480+0000","last_change":"2024-05-10T03:38:36.575272+0000","last_active":"2024-05-10T03:39:26.076480+0000","last_peered":"2024-05-10T03:39:26.076480+0000","last_clean":"2024-05-10T03:39:26.076480+0000","last_became_active":"2024-05-10T03:38:36.574919+0000","last_became_peered":"2024-05-10T03:38:36.574919+0000","last_unstale":"2024-05-10T03:39:26.076480+0000","last_undegraded":"2024-05-10T03:39:26.076480+0000","last_fullsized":"2024-05-10T03:39:26.076480+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:51:33.825933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067385+0000","last_change":"2024-05-10T03:38:40.609082+0000","last_active":"2024-05-10T03:39:26.067385+0000","last_peered":"2024-05-10T03:39:26.067385+0000","last_clean":"2024-05-10T03:39:26.067385+0000","last_became_active":"2024-05-10T03:38:40.608636+0000","last_became_peered":"2024-05-10T03:38:40.608636+0000","last_unstale":"2024-05-10T03:39:26.067385+0000","last_undegraded":"2024-05-10T03:39:26.067385+0000","last_fullsized":"2024-05-10T03:39:26.067385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:18:05.288472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.071676+0000","last_change":"2024-05-10T03:38:36.101001+0000","last_active":"2024-05-10T03:39:26.071676+0000","last_peered":"2024-05-10T03:39:26.071676+0000","last_clean":"2024-05-10T03:39:26.071676+0000","last_became_active":"2024-05-10T03:38:36.100658+0000","last_became_peered":"2024-05-10T03:38:36.100658+0000","last_unstale":"2024-05-10T03:39:26.071676+0000","last_undegraded":"2024-05-10T03:39:26.071676+0000","last_fullsized":"2024-05-10T03:39:26.071676+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:15:51.963956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077340+0000","last_change":"2024-05-10T03:38:36.579314+0000","last_active":"2024-05-10T03:39:26.077340+0000","last_peered":"2024-05-10T03:39:26.077340+0000","last_clean":"2024-05-10T03:39:26.077340+0000","last_became_active":"2024-05-10T03:38:36.578747+0000","last_became_peered":"2024-05-10T03:38:36.578747+0000","last_unstale":"2024-05-10T03:39:26.077340+0000","last_undegraded":"2024-05-10T03:39:26.077340+0000","last_fullsized":"2024-05-10T03:39:26.077340+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:05:25.814887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067380+0000","last_change":"2024-05-10T03:38:41.149022+0000","last_active":"2024-05-10T03:39:26.067380+0000","last_peered":"2024-05-10T03:39:26.067380+0000","last_clean":"2024-05-10T03:39:26.067380+0000","last_became_active":"2024-05-10T03:38:41.148606+0000","last_became_peered":"2024-05-10T03:38:41.148606+0000","last_unstale":"2024-05-10T03:39:26.067380+0000","last_undegraded":"2024-05-10T03:39:26.067380+0000","last_fullsized":"2024-05-10T03:39:26.067380+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:24.039761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.088000+0000","last_change":"2024-05-10T03:39:27.088000+0000","last_active":"2024-05-10T03:39:27.088000+0000","last_peered":"2024-05-10T03:39:27.088000+0000","last_clean":"2024-05-10T03:39:27.088000+0000","last_became_active":"2024-05-10T03:39:27.078679+0000","last_became_peered":"2024-05-10T03:39:27.078679+0000","last_unstale":"2024-05-10T03:39:27.088000+0000","last_undegraded":"2024-05-10T03:39:27.088000+0000","last_fullsized":"2024-05-10T03:39:27.088000+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:32.644494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078840+0000","last_change":"2024-05-10T03:38:36.587225+0000","last_active":"2024-05-10T03:39:26.078840+0000","last_peered":"2024-05-10T03:39:26.078840+0000","last_clean":"2024-05-10T03:39:26.078840+0000","last_became_active":"2024-05-10T03:38:36.586906+0000","last_became_peered":"2024-05-10T03:38:36.586906+0000","last_unstale":"2024-05-10T03:39:26.078840+0000","last_undegraded":"2024-05-10T03:39:26.078840+0000","last_fullsized":"2024-05-10T03:39:26.078840+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:07.128604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075048+0000","last_change":"2024-05-10T03:38:40.600918+0000","last_active":"2024-05-10T03:39:26.075048+0000","last_peered":"2024-05-10T03:39:26.075048+0000","last_clean":"2024-05-10T03:39:26.075048+0000","last_became_active":"2024-05-10T03:38:40.600508+0000","last_became_peered":"2024-05-10T03:38:40.600508+0000","last_unstale":"2024-05-10T03:39:26.075048+0000","last_undegraded":"2024-05-10T03:39:26.075048+0000","last_fullsized":"2024-05-10T03:39:26.075048+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:02:59.589310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":60,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:32.067833+0000","last_change":"2024-05-10T03:38:36.100013+0000","last_active":"2024-05-10T03:39:32.067833+0000","last_peered":"2024-05-10T03:39:32.067833+0000","last_clean":"2024-05-10T03:39:32.067833+0000","last_became_active":"2024-05-10T03:38:36.099581+0000","last_became_peered":"2024-05-10T03:38:36.099581+0000","last_unstale":"2024-05-10T03:39:32.067833+0000","last_undegraded":"2024-05-10T03:39:32.067833+0000","last_fullsized":"2024-05-10T03:39:32.067833+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:07.195555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.079287+0000","last_change":"2024-05-10T03:38:36.586813+0000","last_active":"2024-05-10T03:39:26.079287+0000","last_peered":"2024-05-10T03:39:26.079287+0000","last_clean":"2024-05-10T03:39:26.079287+0000","last_became_active":"2024-05-10T03:38:36.586264+0000","last_became_peered":"2024-05-10T03:38:36.586264+0000","last_unstale":"2024-05-10T03:39:26.079287+0000","last_undegraded":"2024-05-10T03:39:26.079287+0000","last_fullsized":"2024-05-10T03:39:26.079287+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:57:06.239509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.066683+0000","last_change":"2024-05-10T03:38:40.606897+0000","last_active":"2024-05-10T03:39:26.066683+0000","last_peered":"2024-05-10T03:39:26.066683+0000","last_clean":"2024-05-10T03:39:26.066683+0000","last_became_active":"2024-05-10T03:38:40.606339+0000","last_became_peered":"2024-05-10T03:38:40.606339+0000","last_unstale":"2024-05-10T03:39:26.066683+0000","last_undegraded":"2024-05-10T03:39:26.066683+0000","last_fullsized":"2024-05-10T03:39:26.066683+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:13.706744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074765+0000","last_change":"2024-05-10T03:38:36.100689+0000","last_active":"2024-05-10T03:39:26.074765+0000","last_peered":"2024-05-10T03:39:26.074765+0000","last_clean":"2024-05-10T03:39:26.074765+0000","last_became_active":"2024-05-10T03:38:36.100352+0000","last_became_peered":"2024-05-10T03:38:36.100352+0000","last_unstale":"2024-05-10T03:39:26.074765+0000","last_undegraded":"2024-05-10T03:39:26.074765+0000","last_fullsized":"2024-05-10T03:39:26.074765+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:53:45.926237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.266329+0000","last_change":"2024-05-10T03:39:27.266329+0000","last_active":"2024-05-10T03:39:27.266329+0000","last_peered":"2024-05-10T03:39:27.266329+0000","last_clean":"2024-05-10T03:39:27.266329+0000","last_became_active":"2024-05-10T03:39:27.265905+0000","last_became_peered":"2024-05-10T03:39:27.265905+0000","last_unstale":"2024-05-10T03:39:27.266329+0000","last_undegraded":"2024-05-10T03:39:27.266329+0000","last_fullsized":"2024-05-10T03:39:27.266329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:24.604276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,8],"acting":[7,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072213+0000","last_change":"2024-05-10T03:38:40.600719+0000","last_active":"2024-05-10T03:39:26.072213+0000","last_peered":"2024-05-10T03:39:26.072213+0000","last_clean":"2024-05-10T03:39:26.072213+0000","last_became_active":"2024-05-10T03:38:40.600240+0000","last_became_peered":"2024-05-10T03:38:40.600240+0000","last_unstale":"2024-05-10T03:39:26.072213+0000","last_undegraded":"2024-05-10T03:39:26.072213+0000","last_fullsized":"2024-05-10T03:39:26.072213+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:41:47.877298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070778+0000","last_change":"2024-05-10T03:38:36.097691+0000","last_active":"2024-05-10T03:39:26.070778+0000","last_peered":"2024-05-10T03:39:26.070778+0000","last_clean":"2024-05-10T03:39:26.070778+0000","last_became_active":"2024-05-10T03:38:36.097266+0000","last_became_peered":"2024-05-10T03:38:36.097266+0000","last_unstale":"2024-05-10T03:39:26.070778+0000","last_undegraded":"2024-05-10T03:39:26.070778+0000","last_fullsized":"2024-05-10T03:39:26.070778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:27:57.272780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.079029+0000","last_change":"2024-05-10T03:38:36.575475+0000","last_active":"2024-05-10T03:39:26.079029+0000","last_peered":"2024-05-10T03:39:26.079029+0000","last_clean":"2024-05-10T03:39:26.079029+0000","last_became_active":"2024-05-10T03:38:36.575047+0000","last_became_peered":"2024-05-10T03:38:36.575047+0000","last_unstale":"2024-05-10T03:39:26.079029+0000","last_undegraded":"2024-05-10T03:39:26.079029+0000","last_fullsized":"2024-05-10T03:39:26.079029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:31:53.846070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077134+0000","last_change":"2024-05-10T03:38:36.585491+0000","last_active":"2024-05-10T03:39:26.077134+0000","last_peered":"2024-05-10T03:39:26.077134+0000","last_clean":"2024-05-10T03:39:26.077134+0000","last_became_active":"2024-05-10T03:38:36.585147+0000","last_became_peered":"2024-05-10T03:38:36.585147+0000","last_unstale":"2024-05-10T03:39:26.077134+0000","last_undegraded":"2024-05-10T03:39:26.077134+0000","last_fullsized":"2024-05-10T03:39:26.077134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:22.350420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072517+0000","last_change":"2024-05-10T03:38:36.584092+0000","last_active":"2024-05-10T03:39:26.072517+0000","last_peered":"2024-05-10T03:39:26.072517+0000","last_clean":"2024-05-10T03:39:26.072517+0000","last_became_active":"2024-05-10T03:38:36.583749+0000","last_became_peered":"2024-05-10T03:38:36.583749+0000","last_unstale":"2024-05-10T03:39:26.072517+0000","last_undegraded":"2024-05-10T03:39:26.072517+0000","last_fullsized":"2024-05-10T03:39:26.072517+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:10.882170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.071548+0000","last_change":"2024-05-10T03:38:36.573718+0000","last_active":"2024-05-10T03:39:26.071548+0000","last_peered":"2024-05-10T03:39:26.071548+0000","last_clean":"2024-05-10T03:39:26.071548+0000","last_became_active":"2024-05-10T03:38:36.573271+0000","last_became_peered":"2024-05-10T03:38:36.573271+0000","last_unstale":"2024-05-10T03:39:26.071548+0000","last_undegraded":"2024-05-10T03:39:26.071548+0000","last_fullsized":"2024-05-10T03:39:26.071548+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:38:13.798068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067000+0000","last_change":"2024-05-10T03:38:36.576975+0000","last_active":"2024-05-10T03:39:26.067000+0000","last_peered":"2024-05-10T03:39:26.067000+0000","last_clean":"2024-05-10T03:39:26.067000+0000","last_became_active":"2024-05-10T03:38:36.576640+0000","last_became_peered":"2024-05-10T03:38:36.576640+0000","last_unstale":"2024-05-10T03:39:26.067000+0000","last_undegraded":"2024-05-10T03:39:26.067000+0000","last_fullsized":"2024-05-10T03:39:26.067000+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:48:42.975793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.077884+0000","last_change":"2024-05-10T03:39:27.077884+0000","last_active":"2024-05-10T03:39:27.077884+0000","last_peered":"2024-05-10T03:39:27.077884+0000","last_clean":"2024-05-10T03:39:27.077884+0000","last_became_active":"2024-05-10T03:39:27.077475+0000","last_became_peered":"2024-05-10T03:39:27.077475+0000","last_unstale":"2024-05-10T03:39:27.077884+0000","last_undegraded":"2024-05-10T03:39:27.077884+0000","last_fullsized":"2024-05-10T03:39:27.077884+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:21:35.216448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076864+0000","last_change":"2024-05-10T03:38:36.589262+0000","last_active":"2024-05-10T03:39:26.076864+0000","last_peered":"2024-05-10T03:39:26.076864+0000","last_clean":"2024-05-10T03:39:26.076864+0000","last_became_active":"2024-05-10T03:38:36.588950+0000","last_became_peered":"2024-05-10T03:38:36.588950+0000","last_unstale":"2024-05-10T03:39:26.076864+0000","last_undegraded":"2024-05-10T03:39:26.076864+0000","last_fullsized":"2024-05-10T03:39:26.076864+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:08:43.124035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074184+0000","last_change":"2024-05-10T03:38:36.590472+0000","last_active":"2024-05-10T03:39:26.074184+0000","last_peered":"2024-05-10T03:39:26.074184+0000","last_clean":"2024-05-10T03:39:26.074184+0000","last_became_active":"2024-05-10T03:38:36.590115+0000","last_became_peered":"2024-05-10T03:38:36.590115+0000","last_unstale":"2024-05-10T03:39:26.074184+0000","last_undegraded":"2024-05-10T03:39:26.074184+0000","last_fullsized":"2024-05-10T03:39:26.074184+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:33:37.982529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077634+0000","last_change":"2024-05-10T03:38:36.575958+0000","last_active":"2024-05-10T03:39:26.077634+0000","last_peered":"2024-05-10T03:39:26.077634+0000","last_clean":"2024-05-10T03:39:26.077634+0000","last_became_active":"2024-05-10T03:38:36.572958+0000","last_became_peered":"2024-05-10T03:38:36.572958+0000","last_unstale":"2024-05-10T03:39:26.077634+0000","last_undegraded":"2024-05-10T03:39:26.077634+0000","last_fullsized":"2024-05-10T03:39:26.077634+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:30:39.111371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072295+0000","last_change":"2024-05-10T03:38:36.578225+0000","last_active":"2024-05-10T03:39:26.072295+0000","last_peered":"2024-05-10T03:39:26.072295+0000","last_clean":"2024-05-10T03:39:26.072295+0000","last_became_active":"2024-05-10T03:38:36.575920+0000","last_became_peered":"2024-05-10T03:38:36.575920+0000","last_unstale":"2024-05-10T03:39:26.072295+0000","last_undegraded":"2024-05-10T03:39:26.072295+0000","last_fullsized":"2024-05-10T03:39:26.072295+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:54:53.999971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077198+0000","last_change":"2024-05-10T03:38:36.577720+0000","last_active":"2024-05-10T03:39:26.077198+0000","last_peered":"2024-05-10T03:39:26.077198+0000","last_clean":"2024-05-10T03:39:26.077198+0000","last_became_active":"2024-05-10T03:38:36.577360+0000","last_became_peered":"2024-05-10T03:38:36.577360+0000","last_unstale":"2024-05-10T03:39:26.077198+0000","last_undegraded":"2024-05-10T03:39:26.077198+0000","last_fullsized":"2024-05-10T03:39:26.077198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:35:59.787050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075148+0000","last_change":"2024-05-10T03:38:36.588941+0000","last_active":"2024-05-10T03:39:26.075148+0000","last_peered":"2024-05-10T03:39:26.075148+0000","last_clean":"2024-05-10T03:39:26.075148+0000","last_became_active":"2024-05-10T03:38:36.587884+0000","last_became_peered":"2024-05-10T03:38:36.587884+0000","last_unstale":"2024-05-10T03:39:26.075148+0000","last_undegraded":"2024-05-10T03:39:26.075148+0000","last_fullsized":"2024-05-10T03:39:26.075148+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:26:10.064473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070771+0000","last_change":"2024-05-10T03:38:36.578917+0000","last_active":"2024-05-10T03:39:26.070771+0000","last_peered":"2024-05-10T03:39:26.070771+0000","last_clean":"2024-05-10T03:39:26.070771+0000","last_became_active":"2024-05-10T03:38:36.578508+0000","last_became_peered":"2024-05-10T03:38:36.578508+0000","last_unstale":"2024-05-10T03:39:26.070771+0000","last_undegraded":"2024-05-10T03:39:26.070771+0000","last_fullsized":"2024-05-10T03:39:26.070771+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:47.670854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077705+0000","last_change":"2024-05-10T03:38:36.578410+0000","last_active":"2024-05-10T03:39:26.077705+0000","last_peered":"2024-05-10T03:39:26.077705+0000","last_clean":"2024-05-10T03:39:26.077705+0000","last_became_active":"2024-05-10T03:38:36.578055+0000","last_became_peered":"2024-05-10T03:38:36.578055+0000","last_unstale":"2024-05-10T03:39:26.077705+0000","last_undegraded":"2024-05-10T03:39:26.077705+0000","last_fullsized":"2024-05-10T03:39:26.077705+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:39:03.551019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69935,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":383,"num_read_kb":266,"num_write":234,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":63894,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":209805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514518,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":999424,"data_stored":488391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.52400000000000002}]},{"osd":1,"last update":"Fri May 10 03:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.71699999999999997}]},{"osd":2,"last update":"Fri May 10 03:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":4,"last update":"Fri May 10 03:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.61799999999999999}]},{"osd":5,"last update":"Fri May 10 03:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.47899999999999998}]},{"osd":6,"last update":"Fri May 10 03:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.51000000000000001}]},{"osd":7,"last update":"Fri May 10 03:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.753}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":9,"last update":"Fri May 10 03:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.78100000000000003}]},{"osd":10,"last update":"Fri May 10 03:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.66100000000000003}]}]},{"osd":10,"up_from":69,"seq":296352743450,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28672,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716480,"statfs":{"total":95995035648,"available":95965675520,"internally_reserved":0,"allocated":1691648,"data_stored":1137937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":1,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.441},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.41799999999999998}]},{"osd":2,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.66500000000000004}]},{"osd":3,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.60099999999999998}]},{"osd":6,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":8,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.71799999999999997}]},{"osd":9,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.76100000000000001}]},{"osd":11,"last update":"Fri May 10 03:39:02 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.751}]}]},{"osd":9,"up_from":64,"seq":274877906974,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":1024000,"data_stored":491883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36043201},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.53900000000000003,"15min":0.55100000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.63600000000000001,"5min":0.879,"15min":0.879},"last":0.44},{"interface":"front","average":{"1min":0.5,"5min":0.57599999999999996,"15min":0.58799999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.93899999999999995,"5min":1.171,"15min":1.171},"last":0.39700000000000002}]},{"osd":1,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67600000000000005,"15min":0.67700000000000005},"min":{"1min":0.40699999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96999999999999997,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71299999999999997,"15min":0.72499999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.77500000000000002,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.48599999999999999}]},{"osd":2,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.76200000000000001,"15min":0.78400000000000003},"min":{"1min":0.52600000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.76900000000000002,"5min":1.137,"15min":1.137},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.78500000000000003,"15min":0.80800000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.84599999999999997,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.56299999999999994}]},{"osd":3,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.68500000000000005,"15min":0.70199999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.65000000000000002,"15min":0.67100000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.504}]},{"osd":4,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88300000000000001,"5min":1.147,"15min":1.147},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76200000000000001,"15min":0.76600000000000001},"min":{"1min":0.54700000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.88100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.66300000000000003}]},{"osd":5,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.83899999999999997,"15min":0.85899999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.86699999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.86299999999999999,"15min":0.89200000000000002},"min":{"1min":0.54700000000000004,"5min":0.501,"15min":0.501},"max":{"1min":0.90500000000000003,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.68600000000000005}]},{"osd":6,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.51100000000000001}]},{"osd":7,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.91200000000000003,"15min":0.93799999999999994},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.997,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.94099999999999995,"15min":0.96899999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0169999999999999,"5min":1.377,"15min":1.377},"last":0.626}]},{"osd":8,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.94799999999999995,"15min":0.98199999999999998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.92500000000000004,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.98599999999999999,"15min":1.01},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1140000000000001,"5min":1.579,"15min":1.579},"last":0.80900000000000005}]},{"osd":10,"last update":"Fri May 10 03:38:44 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.84699999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]}]},{"osd":8,"up_from":57,"seq":244813135905,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1007616,"data_stored":487252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.51900000000000002}]},{"osd":1,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64300000000000002,"15min":0.64200000000000002},"min":{"1min":0.46200000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.748},{"interface":"front","average":{"1min":0.623,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75700000000000001,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.60999999999999999}]},{"osd":2,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.47199999999999998,"15min":0.46600000000000003},"min":{"1min":0.35199999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.623},{"interface":"front","average":{"1min":0.499,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71099999999999997,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.54000000000000004}]},{"osd":3,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81799999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.62,"15min":0.61299999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.49099999999999999}]},{"osd":4,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.625,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84599999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.68400000000000005,"15min":0.67900000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.79400000000000004}]},{"osd":5,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":0.60699999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78800000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.437},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.55200000000000005}]},{"osd":6,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.67000000000000004,"15min":0.66100000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71799999999999997,"15min":0.71699999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90500000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.65000000000000002}]},{"osd":7,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.52700000000000002,"5min":0.498,"15min":0.498},"max":{"1min":0.90400000000000003,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.58499999999999996,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0009999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.76600000000000001}]},{"osd":9,"last update":"Fri May 10 03:39:30 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.749,"15min":0.73299999999999998},"min":{"1min":0.61199999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.75600000000000001,"15min":0.73799999999999999},"min":{"1min":0.67500000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.83699999999999997}]},{"osd":10,"last update":"Fri May 10 03:38:48 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.92300000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]}]},{"osd":7,"up_from":50,"seq":214748364837,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28596,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716556,"statfs":{"total":95995035648,"available":95965753344,"internally_reserved":0,"allocated":1613824,"data_stored":1084520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:37:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.437},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.502}]},{"osd":1,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.43099999999999999,"15min":0.42699999999999999},"min":{"1min":0.33600000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.44500000000000001,"15min":0.44400000000000001},"min":{"1min":0.32300000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.61799999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.45500000000000002}]},{"osd":2,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85899999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.64300000000000002,"15min":0.622},"min":{"1min":0.46600000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":2.8340000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.56399999999999995}]},{"osd":3,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.624,"15min":0.63},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.75900000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.59899999999999998}]},{"osd":4,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82199999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.34899999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78100000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.499}]},{"osd":5,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.67800000000000005,"15min":0.65500000000000003},"min":{"1min":0.503,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.1139999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.67300000000000004,"15min":0.65500000000000003},"min":{"1min":0.49099999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":2.806,"5min":2.806,"15min":2.806},"last":0.72699999999999998}]},{"osd":6,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.70299999999999996,"15min":0.70899999999999996},"min":{"1min":0.48599999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86499999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.90900000000000003,"5min":1.002,"15min":1.002},"last":0.85999999999999999}]},{"osd":8,"last update":"Fri May 10 03:39:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.70599999999999996,"15min":0.70399999999999996},"min":{"1min":0.56299999999999994,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.90800000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79200000000000004,"15min":0.79800000000000004},"min":{"1min":0.55000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94899999999999995,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.67700000000000005}]},{"osd":9,"last update":"Fri May 10 03:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.97799999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74199999999999999,"15min":0.74299999999999999},"min":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.90100000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.81599999999999995}]},{"osd":10,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.77900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]},{"osd":6,"up_from":45,"seq":193273528359,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":995328,"data_stored":483243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:38:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.45300000000000001,"15min":0.443},"min":{"1min":0.33700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":3.7570000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.46500000000000002,"15min":0.45600000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Fri May 10 03:38:40 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.41799999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.63900000000000001,"15min":0.621},"min":{"1min":0.51400000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":4.0439999999999996}]},{"osd":2,"last update":"Fri May 10 03:38:40 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.628},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.69799999999999995,"15min":0.68500000000000005},"min":{"1min":0.53700000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":3.8719999999999999}]},{"osd":3,"last update":"Fri May 10 03:38:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.55600000000000005,"15min":0.54200000000000004},"min":{"1min":0.44500000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":4.476},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.55300000000000005,"15min":0.54500000000000004},"min":{"1min":0.432,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":1.085}]},{"osd":4,"last update":"Fri May 10 03:38:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.47399999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.72999999999999998,"15min":0.71599999999999997},"min":{"1min":0.68500000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":4.0910000000000002}]},{"osd":5,"last update":"Fri May 10 03:38:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68100000000000005,"15min":0.67500000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.88200000000000001,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.72499999999999998,"15min":0.71799999999999997},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.67000000000000004}]},{"osd":7,"last update":"Fri May 10 03:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.83099999999999996,"15min":0.82399999999999995},"min":{"1min":0.752,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":3.9660000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.76100000000000001,"15min":0.755},"min":{"1min":0.61399999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.92900000000000005,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.95699999999999996}]},{"osd":8,"last update":"Fri May 10 03:39:09 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.54800000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.96399999999999997,"5min":0.999,"15min":0.999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.88100000000000001,"15min":0.88900000000000001},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":3.9199999999999999}]},{"osd":9,"last update":"Fri May 10 03:39:30 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.95799999999999996,"15min":0.94599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":3.827,"5min":3.827,"15min":3.827},"last":3.827},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.84599999999999997,"15min":0.84799999999999998},"min":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.022}]},{"osd":10,"last update":"Fri May 10 03:38:46 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":4.1340000000000003},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.99199999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0049999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":1064960,"data_stored":547585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.52900000000000003,"15min":0.50800000000000001},"min":{"1min":0.35499999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.53000000000000003,"15min":0.503},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73899999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.56399999999999995}]},{"osd":2,"last update":"Fri May 10 03:39:27 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.55300000000000005,"15min":0.50800000000000001},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.82799999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.56499999999999995,"15min":0.51900000000000002},"min":{"1min":0.42099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.81799999999999995}]},{"osd":3,"last update":"Fri May 10 03:38:44 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.58999999999999997,"15min":0.56399999999999995},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88,"5min":1.528,"15min":1.528},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.58599999999999997,"15min":0.55600000000000005},"min":{"1min":0.47899999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91100000000000003,"5min":1.502,"15min":1.502},"last":0.61499999999999999}]},{"osd":4,"last update":"Fri May 10 03:39:06 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.434,"15min":0.40100000000000002},"min":{"1min":0.318,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.749,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.442,"15min":0.40799999999999997},"min":{"1min":0.38300000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Fri May 10 03:39:23 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.63600000000000001,"15min":0.61199999999999999},"min":{"1min":0.46300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.67600000000000005,"15min":0.64600000000000002},"min":{"1min":0.54500000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.76900000000000002}]},{"osd":6,"last update":"Fri May 10 03:38:34 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.5,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0700000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64600000000000002,"15min":0.64200000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.99199999999999999,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.79100000000000004}]},{"osd":7,"last update":"Fri May 10 03:38:50 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.378,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.92800000000000005,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.58999999999999997,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.84299999999999997}]},{"osd":8,"last update":"Fri May 10 03:39:11 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.66100000000000003,"15min":0.64300000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.73199999999999998,"15min":0.71199999999999997},"min":{"1min":0.63800000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.85899999999999999}]},{"osd":9,"last update":"Fri May 10 03:39:33 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.77800000000000002,"15min":0.754},"min":{"1min":0.67600000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.871,"5min":0.78300000000000003,"15min":0.76800000000000002},"min":{"1min":0.60499999999999998,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.879}]},{"osd":10,"last update":"Fri May 10 03:38:44 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.90500000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1019904,"data_stored":484699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 03:39:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.59699999999999998,"15min":0.54800000000000004},"min":{"1min":0.443,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.089,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.58499999999999996,"15min":0.53700000000000003},"min":{"1min":0.443,"5min":0.316,"15min":0.316},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.163}]},{"osd":2,"last update":"Fri May 10 03:39:22 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.64900000000000002,"15min":0.60699999999999998},"min":{"1min":0.434,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":1.125},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.66000000000000003,"15min":0.60199999999999998},"min":{"1min":0.50600000000000001,"5min":0.379,"15min":0.379},"max":{"1min":1.038,"5min":1.216,"15min":1.216},"last":0.91100000000000003}]},{"osd":3,"last update":"Fri May 10 03:37:40 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.46400000000000002,"15min":0.44900000000000001},"min":{"1min":0.371,"5min":0.314,"15min":0.314},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.53100000000000003,"15min":0.51000000000000001},"min":{"1min":0.40300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":1.1419999999999999}]},{"osd":4,"last update":"Fri May 10 03:39:04 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.64200000000000002,"15min":0.60099999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":1.101},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.622,"15min":0.58199999999999996},"min":{"1min":0.38800000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":1.036}]},{"osd":5,"last update":"Fri May 10 03:39:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.60999999999999999,"15min":0.59099999999999997},"min":{"1min":0.45700000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.72599999999999998,"15min":0.69599999999999995},"min":{"1min":0.56299999999999994,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.98899999999999999}]},{"osd":6,"last update":"Fri May 10 03:38:34 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68400000000000005,"15min":0.68899999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.83099999999999996}]},{"osd":7,"last update":"Fri May 10 03:37:53 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":1.0649999999999999}]},{"osd":8,"last update":"Fri May 10 03:39:11 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.85699999999999998,"15min":0.84699999999999998},"min":{"1min":0.58099999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.86099999999999999,"15min":0.85199999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.232,"5min":1.373,"15min":1.373},"last":0.94499999999999995}]},{"osd":9,"last update":"Fri May 10 03:39:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.83499999999999996,"15min":0.82099999999999995},"min":{"1min":0.55600000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.3089999999999999,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.70199999999999996,"15min":0.68100000000000005},"min":{"1min":0.42799999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.80700000000000005}]},{"osd":10,"last update":"Fri May 10 03:38:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.179},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":1.198}]},{"osd":11,"last update":"Fri May 10 03:39:04 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.079}]}]},{"osd":2,"up_from":18,"seq":77309411383,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":1011712,"data_stored":484838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.38800000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71799999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.41199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80100000000000005,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.76400000000000001}]},{"osd":1,"last update":"Fri May 10 03:39:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.57799999999999996,"15min":0.53500000000000003},"min":{"1min":0.39200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.625,"15min":0.56399999999999995},"min":{"1min":0.372,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.77600000000000002}]},{"osd":3,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.42599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81599999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.49099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.745,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.71199999999999997}]},{"osd":4,"last update":"Fri May 10 03:37:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.44500000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61799999999999999,"15min":0.61499999999999999},"min":{"1min":0.39600000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.68799999999999994}]},{"osd":5,"last update":"Fri May 10 03:39:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.53200000000000003,"15min":0.50800000000000001},"min":{"1min":0.29599999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.56799999999999995,"15min":0.55200000000000005},"min":{"1min":0.36299999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80200000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri May 10 03:38:34 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.629,"15min":0.625},"min":{"1min":0.47899999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71199999999999997,"15min":0.71099999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.83099999999999996}]},{"osd":7,"last update":"Fri May 10 03:37:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.61099999999999999}]},{"osd":8,"last update":"Fri May 10 03:39:12 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.63900000000000001,"15min":0.63200000000000001},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.96299999999999997,"5min":0.995,"15min":0.995},"last":0.84399999999999997}]},{"osd":9,"last update":"Fri May 10 03:39:30 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.77000000000000002,"15min":0.75900000000000001},"min":{"1min":0.54800000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.83399999999999996,"15min":0.82399999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.90800000000000003}]},{"osd":10,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.89100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]},{"osd":3,"up_from":25,"seq":107374182451,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1003520,"data_stored":482668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:38:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.40200000000000002,"15min":0.377},"min":{"1min":0.36899999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.59799999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.45900000000000002,"15min":0.432},"min":{"1min":0.372,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71999999999999997,"5min":0.878,"15min":0.878},"last":0.54500000000000004}]},{"osd":1,"last update":"Fri May 10 03:38:41 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55400000000000005,"15min":0.53400000000000003},"min":{"1min":0.46999999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.57099999999999995,"15min":0.53200000000000003},"min":{"1min":0.46500000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86099999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.64200000000000002}]},{"osd":2,"last update":"Fri May 10 03:38:41 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61599999999999999,"15min":0.59799999999999998},"min":{"1min":0.46899999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.97599999999999998,"5min":1.145,"15min":1.145},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.60399999999999998,"15min":0.57599999999999996},"min":{"1min":0.441,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.84499999999999997}]},{"osd":4,"last update":"Fri May 10 03:39:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.628,"15min":0.60599999999999998},"min":{"1min":0.53600000000000003,"5min":0.433,"15min":0.433},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.65400000000000003,"15min":0.626},"min":{"1min":0.54700000000000004,"5min":0.443,"15min":0.443},"max":{"1min":0.93300000000000005,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.74099999999999999}]},{"osd":5,"last update":"Fri May 10 03:39:21 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65200000000000002,"15min":0.63200000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.014,"5min":1.224,"15min":1.224},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66200000000000003,"15min":0.63},"min":{"1min":0.438,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.996,"5min":1.093,"15min":1.093},"last":0.78200000000000003}]},{"osd":6,"last update":"Fri May 10 03:38:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67700000000000005,"15min":0.67400000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98299999999999998,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.46899999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.94199999999999995,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri May 10 03:38:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79000000000000004,"15min":0.78800000000000003},"min":{"1min":0.57299999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.95399999999999996,"5min":1.085,"15min":1.085},"last":0.82499999999999996}]},{"osd":8,"last update":"Fri May 10 03:38:09 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.68899999999999995}]},{"osd":9,"last update":"Fri May 10 03:39:27 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.879,"15min":0.90300000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.81899999999999995,"15min":0.83599999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.76900000000000002}]},{"osd":10,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.875}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]}]},{"osd":4,"up_from":33,"seq":141733920815,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1077248,"data_stored":550629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:37:59 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.47599999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.52400000000000002,"15min":0.51100000000000001},"min":{"1min":0.435,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.54000000000000004}]},{"osd":1,"last update":"Fri May 10 03:38:59 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.376,"15min":0.35699999999999998},"min":{"1min":0.28100000000000003,"5min":0.218,"15min":0.218},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.39500000000000002,"15min":0.377},"min":{"1min":0.29399999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.39000000000000001}]},{"osd":2,"last update":"Fri May 10 03:38:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.57199999999999995,"15min":0.55100000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.84999999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.59399999999999997,"15min":0.56100000000000005},"min":{"1min":0.47099999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.56299999999999994}]},{"osd":3,"last update":"Fri May 10 03:38:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.59599999999999997,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83799999999999997,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri May 10 03:39:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61699999999999999,"15min":0.59499999999999997},"min":{"1min":0.497,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90500000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.504},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.63500000000000001,"15min":0.60499999999999998},"min":{"1min":0.47999999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.53900000000000003}]},{"osd":6,"last update":"Fri May 10 03:38:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.623,"15min":0.628},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.77000000000000002,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.46600000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92200000000000004,"5min":3.714,"15min":3.714},"last":0.74199999999999999}]},{"osd":7,"last update":"Fri May 10 03:38:59 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.57499999999999996,"15min":0.55800000000000005},"min":{"1min":0.36899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.36499999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88500000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.66900000000000004}]},{"osd":8,"last update":"Fri May 10 03:39:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.64900000000000002,"15min":0.64000000000000001},"min":{"1min":0.45200000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.76600000000000001,"15min":0.76000000000000001},"min":{"1min":0.50700000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.81100000000000005}]},{"osd":9,"last update":"Fri May 10 03:39:31 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.81899999999999995,"15min":0.82299999999999995},"min":{"1min":0.53100000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92800000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.92700000000000005,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.78800000000000003}]},{"osd":10,"last update":"Fri May 10 03:38:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.71899999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757292,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1622016,"data_stored":1080198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.5},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58199999999999996,"15min":0.57199999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.86799999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.48199999999999998}]},{"osd":1,"last update":"Fri May 10 03:39:17 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59099999999999997,"15min":0.58399999999999996},"min":{"1min":0.441,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92600000000000005,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.48199999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.64000000000000001}]},{"osd":2,"last update":"Fri May 10 03:39:17 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.436,"15min":0.41799999999999998},"min":{"1min":0.32700000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69599999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.44600000000000001,"15min":0.438},"min":{"1min":0.312,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68400000000000005,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.379}]},{"osd":3,"last update":"Fri May 10 03:39:17 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.88,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.432},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.47499999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78300000000000003,"5min":1.095,"15min":1.095},"last":0.46000000000000002}]},{"osd":4,"last update":"Fri May 10 03:39:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.63400000000000001,"15min":0.623},"min":{"1min":0.45300000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.42299999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66800000000000004}]},{"osd":6,"last update":"Fri May 10 03:38:35 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60299999999999998,"15min":0.59899999999999998},"min":{"1min":0.371,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.59399999999999997}]},{"osd":7,"last update":"Fri May 10 03:38:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.70199999999999996,"15min":0.69599999999999995},"min":{"1min":0.52400000000000002,"5min":0.504,"15min":0.504},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69199999999999995,"15min":0.68999999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.65600000000000003}]},{"osd":8,"last update":"Fri May 10 03:39:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.64400000000000002,"15min":0.63600000000000001},"min":{"1min":0.39100000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.56399999999999995}]},{"osd":9,"last update":"Fri May 10 03:39:29 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.70199999999999996,"15min":0.68400000000000005},"min":{"1min":0.56100000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.753,"15min":0.73099999999999998},"min":{"1min":0.64600000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.70399999999999996}]},{"osd":10,"last update":"Fri May 10 03:38:45 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.78000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T03:39:39.676 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-10T03:39:39.676 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-10T03:39:39.676 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-10T03:39:39.676 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph health --format=json 2024-05-10T03:39:39.933 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:40.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.983+0000 7f22c9ea6700 1 -- 172.21.15.45:0/633220486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22c410c210 msgr2=0x7f22c410e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:40.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.983+0000 7f22c9ea6700 1 --2- 172.21.15.45:0/633220486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22c410c210 0x7f22c410e720 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f22bc00b0a0 tx=0x7f22bc00b3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:40.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.983+0000 7f22c9ea6700 1 -- 172.21.15.45:0/633220486 shutdown_connections 2024-05-10T03:39:40.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.983+0000 7f22c9ea6700 1 --2- 172.21.15.45:0/633220486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22c410c210 0x7f22c410e720 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:40.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.983+0000 7f22c9ea6700 1 --2- 172.21.15.45:0/633220486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22c4102da0 0x7f22c41031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:40.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.983+0000 7f22c9ea6700 1 --2- 172.21.15.45:0/633220486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c41036f0 0x7f22c410bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:40.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.983+0000 7f22c9ea6700 1 -- 172.21.15.45:0/633220486 >> 172.21.15.45:0/633220486 conn(0x7f22c40fc7a0 msgr2=0x7f22c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:40.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.983+0000 7f22c9ea6700 1 -- 172.21.15.45:0/633220486 shutdown_connections 2024-05-10T03:39:40.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.983+0000 7f22c9ea6700 1 -- 172.21.15.45:0/633220486 wait complete. 2024-05-10T03:39:40.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.984+0000 7f22c9ea6700 1 Processor -- start 2024-05-10T03:39:40.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.984+0000 7f22c9ea6700 1 -- start start 2024-05-10T03:39:40.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.985+0000 7f22c9ea6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22c4102da0 0x7f22c419e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:40.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.985+0000 7f22c9ea6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c41036f0 0x7f22c419eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:40.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.985+0000 7f22c9ea6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22c410c210 0x7f22c41984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:40.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.985+0000 7f22c9ea6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c4198ab0 con 0x7f22c410c210 2024-05-10T03:39:40.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.985+0000 7f22c9ea6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c4198c20 con 0x7f22c4102da0 2024-05-10T03:39:40.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.985+0000 7f22c9ea6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c4198de0 con 0x7f22c41036f0 2024-05-10T03:39:40.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.985+0000 7f22c3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22c410c210 0x7f22c41984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:40.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.985+0000 7f22c3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22c410c210 0x7f22c41984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40282/0 (socket says 172.21.15.45:40282) 2024-05-10T03:39:40.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.985+0000 7f22c3fff700 1 -- 172.21.15.45:0/1216547160 learned_addr learned my addr 172.21.15.45:0/1216547160 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:40.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.985+0000 7f22c37fe700 1 --2- 172.21.15.45:0/1216547160 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22c4102da0 0x7f22c419e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:40.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.985+0000 7f22c2ffd700 1 --2- 172.21.15.45:0/1216547160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c41036f0 0x7f22c419eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:40.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.985+0000 7f22c3fff700 1 -- 172.21.15.45:0/1216547160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c41036f0 msgr2=0x7f22c419eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:40.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.985+0000 7f22c3fff700 1 --2- 172.21.15.45:0/1216547160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c41036f0 0x7f22c419eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:40.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.985+0000 7f22c3fff700 1 -- 172.21.15.45:0/1216547160 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22c4102da0 msgr2=0x7f22c419e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:40.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.985+0000 7f22c3fff700 1 --2- 172.21.15.45:0/1216547160 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22c4102da0 0x7f22c419e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:40.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.985+0000 7f22c3fff700 1 -- 172.21.15.45:0/1216547160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc009d00 con 0x7f22c410c210 2024-05-10T03:39:40.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.985+0000 7f22c3fff700 1 --2- 172.21.15.45:0/1216547160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22c410c210 0x7f22c41984e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f22bc00b070 tx=0x7f22bc004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:40.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.986+0000 7f22c0ff9700 1 -- 172.21.15.45:0/1216547160 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc00e040 con 0x7f22c410c210 2024-05-10T03:39:40.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.986+0000 7f22c9ea6700 1 -- 172.21.15.45:0/1216547160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c4199060 con 0x7f22c410c210 2024-05-10T03:39:40.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.986+0000 7f22c0ff9700 1 -- 172.21.15.45:0/1216547160 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f22bc0079d0 con 0x7f22c410c210 2024-05-10T03:39:40.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.986+0000 7f22c0ff9700 1 -- 172.21.15.45:0/1216547160 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc0052a0 con 0x7f22c410c210 2024-05-10T03:39:40.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.986+0000 7f22c9ea6700 1 -- 172.21.15.45:0/1216547160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c41a5550 con 0x7f22c410c210 2024-05-10T03:39:40.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.987+0000 7f22c9ea6700 1 -- 172.21.15.45:0/1216547160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22c41072f0 con 0x7f22c410c210 2024-05-10T03:39:40.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.988+0000 7f22c0ff9700 1 -- 172.21.15.45:0/1216547160 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f22bc01d470 con 0x7f22c410c210 2024-05-10T03:39:40.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.989+0000 7f22c0ff9700 1 --2- 172.21.15.45:0/1216547160 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f22ac0a11b0 0x7f22ac0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:40.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.989+0000 7f22c0ff9700 1 -- 172.21.15.45:0/1216547160 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f22bc0ce150 con 0x7f22c410c210 2024-05-10T03:39:40.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.989+0000 7f22c37fe700 1 --2- 172.21.15.45:0/1216547160 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f22ac0a11b0 0x7f22ac0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:40.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.989+0000 7f22c37fe700 1 --2- 172.21.15.45:0/1216547160 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f22ac0a11b0 0x7f22ac0a36c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f22c4199950 tx=0x7f22b4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:40.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:40.994+0000 7f22c0ff9700 1 -- 172.21.15.45:0/1216547160 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f22bc097500 con 0x7f22c410c210 2024-05-10T03:39:41.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:40 smithi154 ceph-mon[46565]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T03:39:41.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:40 smithi154 ceph-mon[46565]: pgmap v265: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 11 op/s; 5.2 KiB/s, 1 objects/s recovering 2024-05-10T03:39:41.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.255+0000 7f22c9ea6700 1 -- 172.21.15.45:0/1216547160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f22c4199c00 con 0x7f22c410c210 2024-05-10T03:39:41.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.255+0000 7f22c0ff9700 1 -- 172.21.15.45:0/1216547160 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f22bc09ab20 con 0x7f22c410c210 2024-05-10T03:39:41.258 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:39:41.258 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-10T03:39:41.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.258+0000 7f22c9ea6700 1 -- 172.21.15.45:0/1216547160 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f22ac0a11b0 msgr2=0x7f22ac0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:41.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.258+0000 7f22c9ea6700 1 --2- 172.21.15.45:0/1216547160 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f22ac0a11b0 0x7f22ac0a36c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f22c4199950 tx=0x7f22b4009260 comp rx=0 tx=0).stop 2024-05-10T03:39:41.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.258+0000 7f22c9ea6700 1 -- 172.21.15.45:0/1216547160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22c410c210 msgr2=0x7f22c41984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:41.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.258+0000 7f22c9ea6700 1 --2- 172.21.15.45:0/1216547160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22c410c210 0x7f22c41984e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f22bc00b070 tx=0x7f22bc004c80 comp rx=0 tx=0).stop 2024-05-10T03:39:41.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.258+0000 7f22c9ea6700 1 -- 172.21.15.45:0/1216547160 shutdown_connections 2024-05-10T03:39:41.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.258+0000 7f22c9ea6700 1 --2- 172.21.15.45:0/1216547160 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f22ac0a11b0 0x7f22ac0a36c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:41.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.258+0000 7f22c9ea6700 1 --2- 172.21.15.45:0/1216547160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22c410c210 0x7f22c41984e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:41.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.258+0000 7f22c9ea6700 1 --2- 172.21.15.45:0/1216547160 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22c4102da0 0x7f22c419e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:41.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.258+0000 7f22c9ea6700 1 --2- 172.21.15.45:0/1216547160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c41036f0 0x7f22c419eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:41.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.258+0000 7f22c9ea6700 1 -- 172.21.15.45:0/1216547160 >> 172.21.15.45:0/1216547160 conn(0x7f22c40fc7a0 msgr2=0x7f22c40fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:41.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.258+0000 7f22c9ea6700 1 -- 172.21.15.45:0/1216547160 shutdown_connections 2024-05-10T03:39:41.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.258+0000 7f22c9ea6700 1 -- 172.21.15.45:0/1216547160 wait complete. 2024-05-10T03:39:41.283 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:40 smithi045 ceph-mon[42520]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T03:39:41.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:40 smithi045 ceph-mon[42520]: pgmap v265: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 11 op/s; 5.2 KiB/s, 1 objects/s recovering 2024-05-10T03:39:41.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:40 smithi106 ceph-mon[46996]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T03:39:41.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:40 smithi106 ceph-mon[46996]: pgmap v265: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 11 op/s; 5.2 KiB/s, 1 objects/s recovering 2024-05-10T03:39:41.635 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-10T03:39:41.635 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:39:41.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.791+0000 7f269a389700 1 -- 172.21.15.45:0/954332167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2694107a50 msgr2=0x7f2694109e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.791+0000 7f269a389700 1 --2- 172.21.15.45:0/954332167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2694107a50 0x7f2694109e70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f268c00b0a0 tx=0x7f268c00b3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.791+0000 7f269a389700 1 -- 172.21.15.45:0/954332167 shutdown_connections 2024-05-10T03:39:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.791+0000 7f269a389700 1 --2- 172.21.15.45:0/954332167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26940fff80 0x7f2694100390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.792+0000 7f269a389700 1 --2- 172.21.15.45:0/954332167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2694107a50 0x7f2694109e70 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.792+0000 7f269a389700 1 --2- 172.21.15.45:0/954332167 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26941050f0 0x7f2694107510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.792+0000 7f269a389700 1 -- 172.21.15.45:0/954332167 >> 172.21.15.45:0/954332167 conn(0x7f26940fb8f0 msgr2=0x7f26940fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.792+0000 7f269a389700 1 -- 172.21.15.45:0/954332167 shutdown_connections 2024-05-10T03:39:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.792+0000 7f269a389700 1 -- 172.21.15.45:0/954332167 wait complete. 2024-05-10T03:39:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.792+0000 7f269a389700 1 Processor -- start 2024-05-10T03:39:41.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.792+0000 7f269a389700 1 -- start start 2024-05-10T03:39:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.793+0000 7f269a389700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26940fff80 0x7f2694198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.793+0000 7f269a389700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26941050f0 0x7f2694198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.793+0000 7f269a389700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2694107a50 0x7f269419f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.793+0000 7f269a389700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269419fc10 con 0x7f26941050f0 2024-05-10T03:39:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.793+0000 7f269a389700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269419fd80 con 0x7f26940fff80 2024-05-10T03:39:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.793+0000 7f269a389700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269419ff40 con 0x7f2694107a50 2024-05-10T03:39:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.793+0000 7f26937fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26941050f0 0x7f2694198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.793+0000 7f26937fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26941050f0 0x7f2694198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40298/0 (socket says 172.21.15.45:40298) 2024-05-10T03:39:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.793+0000 7f26937fe700 1 -- 172.21.15.45:0/1562117408 learned_addr learned my addr 172.21.15.45:0/1562117408 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:41.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.793+0000 7f2693fff700 1 --2- 172.21.15.45:0/1562117408 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26940fff80 0x7f2694198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.793+0000 7f2698926700 1 --2- 172.21.15.45:0/1562117408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2694107a50 0x7f269419f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.793+0000 7f26937fe700 1 -- 172.21.15.45:0/1562117408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2694107a50 msgr2=0x7f269419f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.793+0000 7f26937fe700 1 --2- 172.21.15.45:0/1562117408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2694107a50 0x7f269419f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.793+0000 7f26937fe700 1 -- 172.21.15.45:0/1562117408 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26940fff80 msgr2=0x7f2694198130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.793+0000 7f26937fe700 1 --2- 172.21.15.45:0/1562117408 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26940fff80 0x7f2694198130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.793+0000 7f26937fe700 1 -- 172.21.15.45:0/1562117408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268c009d00 con 0x7f26941050f0 2024-05-10T03:39:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.793+0000 7f2698926700 1 --2- 172.21.15.45:0/1562117408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2694107a50 0x7f269419f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.794+0000 7f26937fe700 1 --2- 172.21.15.45:0/1562117408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26941050f0 0x7f2694198670 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f267c00d980 tx=0x7f267c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.794+0000 7f26917fa700 1 -- 172.21.15.45:0/1562117408 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c004220 con 0x7f26941050f0 2024-05-10T03:39:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.794+0000 7f269a389700 1 -- 172.21.15.45:0/1562117408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26941a0220 con 0x7f26941050f0 2024-05-10T03:39:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.794+0000 7f26917fa700 1 -- 172.21.15.45:0/1562117408 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f267c007640 con 0x7f26941050f0 2024-05-10T03:39:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.794+0000 7f26917fa700 1 -- 172.21.15.45:0/1562117408 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c005720 con 0x7f26941050f0 2024-05-10T03:39:41.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.794+0000 7f269a389700 1 -- 172.21.15.45:0/1562117408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26941a0730 con 0x7f26941050f0 2024-05-10T03:39:41.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.795+0000 7f269a389700 1 -- 172.21.15.45:0/1562117408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26940fd4a0 con 0x7f26941050f0 2024-05-10T03:39:41.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.796+0000 7f26917fa700 1 -- 172.21.15.45:0/1562117408 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f267c004410 con 0x7f26941050f0 2024-05-10T03:39:41.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.797+0000 7f26917fa700 1 --2- 172.21.15.45:0/1562117408 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f26800a11b0 0x7f26800a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:41.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.797+0000 7f2693fff700 1 --2- 172.21.15.45:0/1562117408 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f26800a11b0 0x7f26800a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.797+0000 7f26917fa700 1 -- 172.21.15.45:0/1562117408 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f267c0cd130 con 0x7f26941050f0 2024-05-10T03:39:41.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.797+0000 7f2693fff700 1 --2- 172.21.15.45:0/1562117408 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f26800a11b0 0x7f26800a36c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2694103070 tx=0x7f2684009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:41.803 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:41.800+0000 7f26917fa700 1 -- 172.21.15.45:0/1562117408 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f267c0963f0 con 0x7f26941050f0 2024-05-10T03:39:42.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.019+0000 7f269a389700 1 -- 172.21.15.45:0/1562117408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26940678b0 con 0x7f26941050f0 2024-05-10T03:39:42.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.021+0000 7f26917fa700 1 -- 172.21.15.45:0/1562117408 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+24508 (secure 0 0 0) 0x7f267c016090 con 0x7f26941050f0 2024-05-10T03:39:42.023 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:39:42.024 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":88,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:39:27.064512+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:38:34.871801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:38:35.935386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T03:38:39.029903+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:39:42.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.023+0000 7f269a389700 1 -- 172.21.15.45:0/1562117408 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f26800a11b0 msgr2=0x7f26800a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:42.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.023+0000 7f269a389700 1 --2- 172.21.15.45:0/1562117408 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f26800a11b0 0x7f26800a36c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2694103070 tx=0x7f2684009260 comp rx=0 tx=0).stop 2024-05-10T03:39:42.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.023+0000 7f269a389700 1 -- 172.21.15.45:0/1562117408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26941050f0 msgr2=0x7f2694198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:42.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.023+0000 7f269a389700 1 --2- 172.21.15.45:0/1562117408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26941050f0 0x7f2694198670 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f267c00d980 tx=0x7f267c00dc90 comp rx=0 tx=0).stop 2024-05-10T03:39:42.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.024+0000 7f269a389700 1 -- 172.21.15.45:0/1562117408 shutdown_connections 2024-05-10T03:39:42.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.024+0000 7f269a389700 1 --2- 172.21.15.45:0/1562117408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2694107a50 0x7f269419f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:42.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.024+0000 7f269a389700 1 --2- 172.21.15.45:0/1562117408 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f26800a11b0 0x7f26800a36c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:42.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.024+0000 7f269a389700 1 --2- 172.21.15.45:0/1562117408 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26940fff80 0x7f2694198130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:42.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.024+0000 7f269a389700 1 --2- 172.21.15.45:0/1562117408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26941050f0 0x7f2694198670 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:42.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.024+0000 7f269a389700 1 -- 172.21.15.45:0/1562117408 >> 172.21.15.45:0/1562117408 conn(0x7f26940fb8f0 msgr2=0x7f2694105f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:42.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.024+0000 7f269a389700 1 -- 172.21.15.45:0/1562117408 shutdown_connections 2024-05-10T03:39:42.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.024+0000 7f269a389700 1 -- 172.21.15.45:0/1562117408 wait complete. 2024-05-10T03:39:42.041 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T03:35:20.339400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T03:38:34.871801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T03:38:35.935386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-10T03:38:39.029903+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-10T03:39:42.042 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T03:39:42.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.192+0000 7f45a0709700 1 -- 172.21.15.45:0/208938254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4598107970 msgr2=0x7f4598109d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:42.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.192+0000 7f45a0709700 1 --2- 172.21.15.45:0/208938254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4598107970 0x7f4598109d90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f459000b0a0 tx=0x7f459000b3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:42.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.192+0000 7f45a0709700 1 -- 172.21.15.45:0/208938254 shutdown_connections 2024-05-10T03:39:42.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.192+0000 7f45a0709700 1 --2- 172.21.15.45:0/208938254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45981026b0 0x7f4598104ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:42.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.192+0000 7f45a0709700 1 --2- 172.21.15.45:0/208938254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4598107970 0x7f4598109d90 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:42.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.192+0000 7f45a0709700 1 --2- 172.21.15.45:0/208938254 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4598105010 0x7f4598107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:42.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.192+0000 7f45a0709700 1 -- 172.21.15.45:0/208938254 >> 172.21.15.45:0/208938254 conn(0x7f45980fc0d0 msgr2=0x7f45980fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:42.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.192+0000 7f45a0709700 1 -- 172.21.15.45:0/208938254 shutdown_connections 2024-05-10T03:39:42.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.192+0000 7f45a0709700 1 -- 172.21.15.45:0/208938254 wait complete. 2024-05-10T03:39:42.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.193+0000 7f45a0709700 1 Processor -- start 2024-05-10T03:39:42.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.193+0000 7f45a0709700 1 -- start start 2024-05-10T03:39:42.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.193+0000 7f45a0709700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45981026b0 0x7f45981980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:42.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.193+0000 7f45a0709700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4598105010 0x7f4598198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:42.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.193+0000 7f45a0709700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4598107970 0x7f459819f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:42.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.193+0000 7f45a0709700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459819fbb0 con 0x7f45981026b0 2024-05-10T03:39:42.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.193+0000 7f45a0709700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459819fd20 con 0x7f4598105010 2024-05-10T03:39:42.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.193+0000 7f45a0709700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459819fee0 con 0x7f4598107970 2024-05-10T03:39:42.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.193+0000 7f459e4a5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45981026b0 0x7f45981980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:42.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.194+0000 7f459e4a5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45981026b0 0x7f45981980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40312/0 (socket says 172.21.15.45:40312) 2024-05-10T03:39:42.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.194+0000 7f459e4a5700 1 -- 172.21.15.45:0/4100981881 learned_addr learned my addr 172.21.15.45:0/4100981881 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:42.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.194+0000 7f459dca4700 1 --2- 172.21.15.45:0/4100981881 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4598105010 0x7f4598198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:42.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.194+0000 7f459eca6700 1 --2- 172.21.15.45:0/4100981881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4598107970 0x7f459819f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:42.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.194+0000 7f459e4a5700 1 -- 172.21.15.45:0/4100981881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4598107970 msgr2=0x7f459819f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:42.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.194+0000 7f459e4a5700 1 --2- 172.21.15.45:0/4100981881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4598107970 0x7f459819f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:42.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.194+0000 7f459e4a5700 1 -- 172.21.15.45:0/4100981881 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4598105010 msgr2=0x7f4598198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:42.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.194+0000 7f459e4a5700 1 --2- 172.21.15.45:0/4100981881 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4598105010 0x7f4598198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:42.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.194+0000 7f459e4a5700 1 -- 172.21.15.45:0/4100981881 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4590009d00 con 0x7f45981026b0 2024-05-10T03:39:42.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.194+0000 7f459e4a5700 1 --2- 172.21.15.45:0/4100981881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45981026b0 0x7f45981980d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f459400d950 tx=0x7f459400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:42.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.194+0000 7f458f7fe700 1 -- 172.21.15.45:0/4100981881 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4594004220 con 0x7f45981026b0 2024-05-10T03:39:42.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.194+0000 7f45a0709700 1 -- 172.21.15.45:0/4100981881 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45981a01c0 con 0x7f45981026b0 2024-05-10T03:39:42.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.194+0000 7f458f7fe700 1 -- 172.21.15.45:0/4100981881 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4594007620 con 0x7f45981026b0 2024-05-10T03:39:42.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.194+0000 7f458f7fe700 1 -- 172.21.15.45:0/4100981881 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4594005700 con 0x7f45981026b0 2024-05-10T03:39:42.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.194+0000 7f45a0709700 1 -- 172.21.15.45:0/4100981881 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45981004a0 con 0x7f45981026b0 2024-05-10T03:39:42.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.195+0000 7f45a0709700 1 -- 172.21.15.45:0/4100981881 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45980fdc80 con 0x7f45981026b0 2024-05-10T03:39:42.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.197+0000 7f458f7fe700 1 -- 172.21.15.45:0/4100981881 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f4594004380 con 0x7f45981026b0 2024-05-10T03:39:42.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.197+0000 7f458f7fe700 1 --2- 172.21.15.45:0/4100981881 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f45840a1260 0x7f45840a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:42.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.198+0000 7f458f7fe700 1 -- 172.21.15.45:0/4100981881 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f45940cd100 con 0x7f45981026b0 2024-05-10T03:39:42.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.198+0000 7f459dca4700 1 --2- 172.21.15.45:0/4100981881 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f45840a1260 0x7f45840a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:42.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.198+0000 7f459dca4700 1 --2- 172.21.15.45:0/4100981881 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f45840a1260 0x7f45840a3770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4598199170 tx=0x7f4588009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:42.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.201+0000 7f458f7fe700 1 -- 172.21.15.45:0/4100981881 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f45940963c0 con 0x7f45981026b0 2024-05-10T03:39:42.223 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:41 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1216547160' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-10T03:39:42.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:41 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1216547160' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-10T03:39:42.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:41 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1216547160' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-10T03:39:42.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.415+0000 7f45a0709700 1 -- 172.21.15.45:0/4100981881 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f45980694d0 con 0x7f45981026b0 2024-05-10T03:39:42.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.416+0000 7f458f7fe700 1 -- 172.21.15.45:0/4100981881 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4594016020 con 0x7f45981026b0 2024-05-10T03:39:42.418 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-05-10T03:39:42.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.418+0000 7f45a0709700 1 -- 172.21.15.45:0/4100981881 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f45840a1260 msgr2=0x7f45840a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:42.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.418+0000 7f45a0709700 1 --2- 172.21.15.45:0/4100981881 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f45840a1260 0x7f45840a3770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4598199170 tx=0x7f4588009260 comp rx=0 tx=0).stop 2024-05-10T03:39:42.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.418+0000 7f45a0709700 1 -- 172.21.15.45:0/4100981881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45981026b0 msgr2=0x7f45981980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:42.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.418+0000 7f45a0709700 1 --2- 172.21.15.45:0/4100981881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45981026b0 0x7f45981980d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f459400d950 tx=0x7f459400dc60 comp rx=0 tx=0).stop 2024-05-10T03:39:42.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.418+0000 7f45a0709700 1 -- 172.21.15.45:0/4100981881 shutdown_connections 2024-05-10T03:39:42.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.418+0000 7f45a0709700 1 --2- 172.21.15.45:0/4100981881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4598107970 0x7f459819f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:42.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.418+0000 7f45a0709700 1 --2- 172.21.15.45:0/4100981881 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f45840a1260 0x7f45840a3770 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:42.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.418+0000 7f45a0709700 1 --2- 172.21.15.45:0/4100981881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45981026b0 0x7f45981980d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:42.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.418+0000 7f45a0709700 1 --2- 172.21.15.45:0/4100981881 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4598105010 0x7f4598198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:42.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.418+0000 7f45a0709700 1 -- 172.21.15.45:0/4100981881 >> 172.21.15.45:0/4100981881 conn(0x7f45980fc0d0 msgr2=0x7f45981034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:42.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.418+0000 7f45a0709700 1 -- 172.21.15.45:0/4100981881 shutdown_connections 2024-05-10T03:39:42.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.418+0000 7f45a0709700 1 -- 172.21.15.45:0/4100981881 wait complete. 2024-05-10T03:39:42.436 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T03:39:42.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.585+0000 7fdf5c7a1700 1 -- 172.21.15.45:0/2785774380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf54102580 msgr2=0x7fdf54108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:42.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.585+0000 7fdf5c7a1700 1 --2- 172.21.15.45:0/2785774380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf54102580 0x7fdf54108e30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c00b0a0 tx=0x7fdf4c00b3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:42.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.585+0000 7fdf5c7a1700 1 -- 172.21.15.45:0/2785774380 shutdown_connections 2024-05-10T03:39:42.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.585+0000 7fdf5c7a1700 1 --2- 172.21.15.45:0/2785774380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf54102580 0x7fdf54108e30 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:42.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.585+0000 7fdf5c7a1700 1 --2- 172.21.15.45:0/2785774380 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf54100ac0 0x7fdf54100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:42.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.585+0000 7fdf5c7a1700 1 --2- 172.21.15.45:0/2785774380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf54101be0 0x7fdf54101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:42.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.585+0000 7fdf5c7a1700 1 -- 172.21.15.45:0/2785774380 >> 172.21.15.45:0/2785774380 conn(0x7fdf540fc0d0 msgr2=0x7fdf540fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:42.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.585+0000 7fdf5c7a1700 1 -- 172.21.15.45:0/2785774380 shutdown_connections 2024-05-10T03:39:42.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.585+0000 7fdf5c7a1700 1 -- 172.21.15.45:0/2785774380 wait complete. 2024-05-10T03:39:42.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.586+0000 7fdf5c7a1700 1 Processor -- start 2024-05-10T03:39:42.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.586+0000 7fdf5c7a1700 1 -- start start 2024-05-10T03:39:42.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.586+0000 7fdf5c7a1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf54100ac0 0x7fdf541980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:42.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.586+0000 7fdf5c7a1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf54101be0 0x7fdf541985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:42.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.586+0000 7fdf5c7a1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf54102580 0x7fdf5419f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:42.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.586+0000 7fdf5c7a1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5419fb90 con 0x7fdf54102580 2024-05-10T03:39:42.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.586+0000 7fdf5c7a1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5419fd00 con 0x7fdf54100ac0 2024-05-10T03:39:42.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.586+0000 7fdf5c7a1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5419fec0 con 0x7fdf54101be0 2024-05-10T03:39:42.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.586+0000 7fdf5ad3e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf54102580 0x7fdf5419f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:42.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.586+0000 7fdf5ad3e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf54102580 0x7fdf5419f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40320/0 (socket says 172.21.15.45:40320) 2024-05-10T03:39:42.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.586+0000 7fdf5ad3e700 1 -- 172.21.15.45:0/1397819410 learned_addr learned my addr 172.21.15.45:0/1397819410 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:42.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.586+0000 7fdf5a53d700 1 --2- 172.21.15.45:0/1397819410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf54100ac0 0x7fdf541980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:42.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.587+0000 7fdf59d3c700 1 --2- 172.21.15.45:0/1397819410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf54101be0 0x7fdf541985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:42.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.587+0000 7fdf5ad3e700 1 -- 172.21.15.45:0/1397819410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf54101be0 msgr2=0x7fdf541985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:42.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.587+0000 7fdf5ad3e700 1 --2- 172.21.15.45:0/1397819410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf54101be0 0x7fdf541985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:42.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.587+0000 7fdf5ad3e700 1 -- 172.21.15.45:0/1397819410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf54100ac0 msgr2=0x7fdf541980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:42.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.587+0000 7fdf5ad3e700 1 --2- 172.21.15.45:0/1397819410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf54100ac0 0x7fdf541980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:42.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.587+0000 7fdf5ad3e700 1 -- 172.21.15.45:0/1397819410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4c009d00 con 0x7fdf54102580 2024-05-10T03:39:42.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.587+0000 7fdf59d3c700 1 --2- 172.21.15.45:0/1397819410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf54101be0 0x7fdf541985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:42.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.587+0000 7fdf5ad3e700 1 --2- 172.21.15.45:0/1397819410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf54102580 0x7fdf5419f580 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c00b070 tx=0x7fdf4c009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:42.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.587+0000 7fdf477fe700 1 -- 172.21.15.45:0/1397819410 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c00e040 con 0x7fdf54102580 2024-05-10T03:39:42.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.587+0000 7fdf477fe700 1 -- 172.21.15.45:0/1397819410 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdf4c00be40 con 0x7fdf54102580 2024-05-10T03:39:42.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.587+0000 7fdf5c7a1700 1 -- 172.21.15.45:0/1397819410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf541a0140 con 0x7fdf54102580 2024-05-10T03:39:42.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.587+0000 7fdf477fe700 1 -- 172.21.15.45:0/1397819410 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c01b6c0 con 0x7fdf54102580 2024-05-10T03:39:42.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.587+0000 7fdf5c7a1700 1 -- 172.21.15.45:0/1397819410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf541a05c0 con 0x7fdf54102580 2024-05-10T03:39:42.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.588+0000 7fdf5c7a1700 1 -- 172.21.15.45:0/1397819410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf540694d0 con 0x7fdf54102580 2024-05-10T03:39:42.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.590+0000 7fdf477fe700 1 -- 172.21.15.45:0/1397819410 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fdf4c01d470 con 0x7fdf54102580 2024-05-10T03:39:42.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.590+0000 7fdf477fe700 1 --2- 172.21.15.45:0/1397819410 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fdf400a12e0 0x7fdf400a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:42.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.590+0000 7fdf477fe700 1 -- 172.21.15.45:0/1397819410 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fdf4c0cdf70 con 0x7fdf54102580 2024-05-10T03:39:42.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.591+0000 7fdf5a53d700 1 --2- 172.21.15.45:0/1397819410 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fdf400a12e0 0x7fdf400a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:42.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.591+0000 7fdf5a53d700 1 --2- 172.21.15.45:0/1397819410 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fdf400a12e0 0x7fdf400a37f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdf54101ae0 tx=0x7fdf50009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:42.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.594+0000 7fdf477fe700 1 -- 172.21.15.45:0/1397819410 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fdf4c0973a0 con 0x7fdf54102580 2024-05-10T03:39:42.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.811+0000 7fdf5c7a1700 1 -- 172.21.15.45:0/1397819410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdf541a08e0 con 0x7fdf54102580 2024-05-10T03:39:43.677 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:42 smithi106 ceph-mon[46996]: pgmap v266: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 48 B/s, 0 objects/s recovering 2024-05-10T03:39:43.677 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:42 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1562117408' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:39:43.677 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:42 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/4100981881' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:39:43.677 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:42 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1397819410' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:39:43.677 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:42 smithi154 ceph-mon[46565]: pgmap v266: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 48 B/s, 0 objects/s recovering 2024-05-10T03:39:43.678 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:42 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1562117408' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:39:43.678 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:42 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/4100981881' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:39:43.678 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:42 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1397819410' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:39:43.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.812+0000 7fdf477fe700 1 -- 172.21.15.45:0/1397819410 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdf4c09a9c0 con 0x7fdf54102580 2024-05-10T03:39:43.678 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-05-10T03:39:43.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.814+0000 7fdf5c7a1700 1 -- 172.21.15.45:0/1397819410 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fdf400a12e0 msgr2=0x7fdf400a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:43.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.814+0000 7fdf5c7a1700 1 --2- 172.21.15.45:0/1397819410 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fdf400a12e0 0x7fdf400a37f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdf54101ae0 tx=0x7fdf50009260 comp rx=0 tx=0).stop 2024-05-10T03:39:43.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.814+0000 7fdf5c7a1700 1 -- 172.21.15.45:0/1397819410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf54102580 msgr2=0x7fdf5419f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:43.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.814+0000 7fdf5c7a1700 1 --2- 172.21.15.45:0/1397819410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf54102580 0x7fdf5419f580 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c00b070 tx=0x7fdf4c009810 comp rx=0 tx=0).stop 2024-05-10T03:39:43.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.814+0000 7fdf5c7a1700 1 -- 172.21.15.45:0/1397819410 shutdown_connections 2024-05-10T03:39:43.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.814+0000 7fdf5c7a1700 1 --2- 172.21.15.45:0/1397819410 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fdf400a12e0 0x7fdf400a37f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:43.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.814+0000 7fdf5c7a1700 1 --2- 172.21.15.45:0/1397819410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf54102580 0x7fdf5419f580 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:43.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.814+0000 7fdf5c7a1700 1 --2- 172.21.15.45:0/1397819410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf54100ac0 0x7fdf541980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:43.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.814+0000 7fdf5c7a1700 1 --2- 172.21.15.45:0/1397819410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf54101be0 0x7fdf541985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:43.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.814+0000 7fdf5c7a1700 1 -- 172.21.15.45:0/1397819410 >> 172.21.15.45:0/1397819410 conn(0x7fdf540fc0d0 msgr2=0x7fdf540fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:43.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.815+0000 7fdf5c7a1700 1 -- 172.21.15.45:0/1397819410 shutdown_connections 2024-05-10T03:39:43.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:42.815+0000 7fdf5c7a1700 1 -- 172.21.15.45:0/1397819410 wait complete. 2024-05-10T03:39:43.681 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T03:39:43.681 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:42 smithi045 ceph-mon[42520]: pgmap v266: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 48 B/s, 0 objects/s recovering 2024-05-10T03:39:43.682 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:42 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1562117408' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:39:43.682 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:42 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/4100981881' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:39:43.682 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:42 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1397819410' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:39:43.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.839+0000 7f104dad9700 1 -- 172.21.15.45:0/855346130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1048102cf0 msgr2=0x7f1048103100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:43.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.839+0000 7f104dad9700 1 --2- 172.21.15.45:0/855346130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1048102cf0 0x7f1048103100 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1030009990 tx=0x7f1030009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:43.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.839+0000 7f104dad9700 1 -- 172.21.15.45:0/855346130 shutdown_connections 2024-05-10T03:39:43.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.840+0000 7f104dad9700 1 --2- 172.21.15.45:0/855346130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1048101bd0 0x7f1048101fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:43.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.840+0000 7f104dad9700 1 --2- 172.21.15.45:0/855346130 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1048103690 0x7f1048109f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:43.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.840+0000 7f104dad9700 1 --2- 172.21.15.45:0/855346130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1048102cf0 0x7f1048103100 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:43.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.840+0000 7f104dad9700 1 -- 172.21.15.45:0/855346130 >> 172.21.15.45:0/855346130 conn(0x7f10480fd1e0 msgr2=0x7f10480ff690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:43.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.840+0000 7f104dad9700 1 -- 172.21.15.45:0/855346130 shutdown_connections 2024-05-10T03:39:43.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.840+0000 7f104dad9700 1 -- 172.21.15.45:0/855346130 wait complete. 2024-05-10T03:39:43.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.840+0000 7f104dad9700 1 Processor -- start 2024-05-10T03:39:43.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.841+0000 7f104dad9700 1 -- start start 2024-05-10T03:39:43.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.841+0000 7f104dad9700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1048101bd0 0x7f1048198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:43.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.841+0000 7f104dad9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1048102cf0 0x7f1048198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:43.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.841+0000 7f104dad9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1048103690 0x7f104819f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:43.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.841+0000 7f104dad9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104819fb20 con 0x7f1048102cf0 2024-05-10T03:39:43.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.841+0000 7f104dad9700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104819fc90 con 0x7f1048101bd0 2024-05-10T03:39:43.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.841+0000 7f104dad9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104819fe50 con 0x7f1048103690 2024-05-10T03:39:43.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.841+0000 7f1046ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1048102cf0 0x7f1048198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:43.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.841+0000 7f1046ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1048102cf0 0x7f1048198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40334/0 (socket says 172.21.15.45:40334) 2024-05-10T03:39:43.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.841+0000 7f1046ffd700 1 -- 172.21.15.45:0/1365185708 learned_addr learned my addr 172.21.15.45:0/1365185708 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:43.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.841+0000 7f1047fff700 1 --2- 172.21.15.45:0/1365185708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1048103690 0x7f104819f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:43.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.841+0000 7f10477fe700 1 --2- 172.21.15.45:0/1365185708 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1048101bd0 0x7f1048198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:43.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.841+0000 7f1046ffd700 1 -- 172.21.15.45:0/1365185708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1048103690 msgr2=0x7f104819f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:43.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.841+0000 7f1046ffd700 1 --2- 172.21.15.45:0/1365185708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1048103690 0x7f104819f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:43.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.841+0000 7f1046ffd700 1 -- 172.21.15.45:0/1365185708 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1048101bd0 msgr2=0x7f1048198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:43.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.841+0000 7f1046ffd700 1 --2- 172.21.15.45:0/1365185708 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1048101bd0 0x7f1048198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:43.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.841+0000 7f1046ffd700 1 -- 172.21.15.45:0/1365185708 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10300095f0 con 0x7f1048102cf0 2024-05-10T03:39:43.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.841+0000 7f1046ffd700 1 --2- 172.21.15.45:0/1365185708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1048102cf0 0x7f1048198580 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1030000c00 tx=0x7f103000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:43.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.842+0000 7f1044ff9700 1 -- 172.21.15.45:0/1365185708 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103001d070 con 0x7f1048102cf0 2024-05-10T03:39:43.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.842+0000 7f104dad9700 1 -- 172.21.15.45:0/1365185708 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10481a00d0 con 0x7f1048102cf0 2024-05-10T03:39:43.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.842+0000 7f1044ff9700 1 -- 172.21.15.45:0/1365185708 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1030022470 con 0x7f1048102cf0 2024-05-10T03:39:43.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.842+0000 7f1044ff9700 1 -- 172.21.15.45:0/1365185708 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1030017650 con 0x7f1048102cf0 2024-05-10T03:39:43.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.842+0000 7f104dad9700 1 -- 172.21.15.45:0/1365185708 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10481a0550 con 0x7f1048102cf0 2024-05-10T03:39:43.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.843+0000 7f104dad9700 1 -- 172.21.15.45:0/1365185708 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1048108de0 con 0x7f1048102cf0 2024-05-10T03:39:43.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.845+0000 7f1044ff9700 1 -- 172.21.15.45:0/1365185708 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f1030022950 con 0x7f1048102cf0 2024-05-10T03:39:43.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.845+0000 7f1044ff9700 1 --2- 172.21.15.45:0/1365185708 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f10340a1260 0x7f10340a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:43.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.846+0000 7f1044ff9700 1 -- 172.21.15.45:0/1365185708 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f10300ce2c0 con 0x7f1048102cf0 2024-05-10T03:39:43.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.846+0000 7f10477fe700 1 --2- 172.21.15.45:0/1365185708 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f10340a1260 0x7f10340a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:43.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.846+0000 7f10477fe700 1 --2- 172.21.15.45:0/1365185708 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f10340a1260 0x7f10340a3770 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1048102bf0 tx=0x7f103800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:43.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:43.849+0000 7f1044ff9700 1 -- 172.21.15.45:0/1365185708 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1030097610 con 0x7f1048102cf0 2024-05-10T03:39:44.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.067+0000 7f104dad9700 1 -- 172.21.15.45:0/1365185708 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f104810d670 con 0x7f1048102cf0 2024-05-10T03:39:44.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.067+0000 7f1044ff9700 1 -- 172.21.15.45:0/1365185708 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f103009ac30 con 0x7f1048102cf0 2024-05-10T03:39:44.070 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2024-05-10T03:39:44.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.069+0000 7f104dad9700 1 -- 172.21.15.45:0/1365185708 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f10340a1260 msgr2=0x7f10340a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:44.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.069+0000 7f104dad9700 1 --2- 172.21.15.45:0/1365185708 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f10340a1260 0x7f10340a3770 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1048102bf0 tx=0x7f103800b410 comp rx=0 tx=0).stop 2024-05-10T03:39:44.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.069+0000 7f104dad9700 1 -- 172.21.15.45:0/1365185708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1048102cf0 msgr2=0x7f1048198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:44.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.069+0000 7f104dad9700 1 --2- 172.21.15.45:0/1365185708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1048102cf0 0x7f1048198580 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1030000c00 tx=0x7f103000f690 comp rx=0 tx=0).stop 2024-05-10T03:39:44.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.070+0000 7f104dad9700 1 -- 172.21.15.45:0/1365185708 shutdown_connections 2024-05-10T03:39:44.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.070+0000 7f104dad9700 1 --2- 172.21.15.45:0/1365185708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1048103690 0x7f104819f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:44.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.070+0000 7f104dad9700 1 --2- 172.21.15.45:0/1365185708 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f10340a1260 0x7f10340a3770 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:44.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.070+0000 7f104dad9700 1 --2- 172.21.15.45:0/1365185708 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1048101bd0 0x7f1048198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:44.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.070+0000 7f104dad9700 1 --2- 172.21.15.45:0/1365185708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1048102cf0 0x7f1048198580 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:44.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.070+0000 7f104dad9700 1 -- 172.21.15.45:0/1365185708 >> 172.21.15.45:0/1365185708 conn(0x7f10480fd1e0 msgr2=0x7f1048105f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:44.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.070+0000 7f104dad9700 1 -- 172.21.15.45:0/1365185708 shutdown_connections 2024-05-10T03:39:44.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.070+0000 7f104dad9700 1 -- 172.21.15.45:0/1365185708 wait complete. 2024-05-10T03:39:44.087 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-10T03:39:44.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.238+0000 7f19cde8b700 1 -- 172.21.15.45:0/57564849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c8101c10 msgr2=0x7f19c8102020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:44.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.238+0000 7f19cde8b700 1 --2- 172.21.15.45:0/57564849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c8101c10 0x7f19c8102020 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f19bc009990 tx=0x7f19bc009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:44.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.238+0000 7f19cde8b700 1 -- 172.21.15.45:0/57564849 shutdown_connections 2024-05-10T03:39:44.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.238+0000 7f19cde8b700 1 --2- 172.21.15.45:0/57564849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c81025b0 0x7f19c8108e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:44.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.238+0000 7f19cde8b700 1 --2- 172.21.15.45:0/57564849 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19c8100af0 0x7f19c8100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:44.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.238+0000 7f19cde8b700 1 --2- 172.21.15.45:0/57564849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c8101c10 0x7f19c8102020 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:44.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.238+0000 7f19cde8b700 1 -- 172.21.15.45:0/57564849 >> 172.21.15.45:0/57564849 conn(0x7f19c80fc100 msgr2=0x7f19c80fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:44.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.238+0000 7f19cde8b700 1 -- 172.21.15.45:0/57564849 shutdown_connections 2024-05-10T03:39:44.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.238+0000 7f19cde8b700 1 -- 172.21.15.45:0/57564849 wait complete. 2024-05-10T03:39:44.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.239+0000 7f19cde8b700 1 Processor -- start 2024-05-10T03:39:44.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.239+0000 7f19cde8b700 1 -- start start 2024-05-10T03:39:44.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.239+0000 7f19cde8b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c8100af0 0x7f19c81048b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:44.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.239+0000 7f19cde8b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19c8101c10 0x7f19c8102f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:44.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.239+0000 7f19cde8b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c81025b0 0x7f19c8103490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:44.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.239+0000 7f19cde8b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c8103b70 con 0x7f19c81025b0 2024-05-10T03:39:44.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.239+0000 7f19cde8b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c8103ce0 con 0x7f19c8101c10 2024-05-10T03:39:44.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.239+0000 7f19cde8b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c81a2050 con 0x7f19c8100af0 2024-05-10T03:39:44.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.239+0000 7f19c7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c81025b0 0x7f19c8103490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:44.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.239+0000 7f19c7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c81025b0 0x7f19c8103490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40366/0 (socket says 172.21.15.45:40366) 2024-05-10T03:39:44.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.239+0000 7f19c7fff700 1 -- 172.21.15.45:0/2235555042 learned_addr learned my addr 172.21.15.45:0/2235555042 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:44.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.239+0000 7f19c77fe700 1 --2- 172.21.15.45:0/2235555042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c8100af0 0x7f19c81048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:44.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.239+0000 7f19c6ffd700 1 --2- 172.21.15.45:0/2235555042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19c8101c10 0x7f19c8102f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:44.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.240+0000 7f19c7fff700 1 -- 172.21.15.45:0/2235555042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c8100af0 msgr2=0x7f19c81048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:44.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.240+0000 7f19c7fff700 1 --2- 172.21.15.45:0/2235555042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c8100af0 0x7f19c81048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:44.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.240+0000 7f19c7fff700 1 -- 172.21.15.45:0/2235555042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19c8101c10 msgr2=0x7f19c8102f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:44.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.240+0000 7f19c7fff700 1 --2- 172.21.15.45:0/2235555042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19c8101c10 0x7f19c8102f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:44.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.240+0000 7f19c7fff700 1 -- 172.21.15.45:0/2235555042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19bc0095f0 con 0x7f19c81025b0 2024-05-10T03:39:44.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.240+0000 7f19c7fff700 1 --2- 172.21.15.45:0/2235555042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c81025b0 0x7f19c8103490 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f19c000ef30 tx=0x7f19c000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:44.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.240+0000 7f19c4ff9700 1 -- 172.21.15.45:0/2235555042 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c0018070 con 0x7f19c81025b0 2024-05-10T03:39:44.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.240+0000 7f19c4ff9700 1 -- 172.21.15.45:0/2235555042 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f19c000f040 con 0x7f19c81025b0 2024-05-10T03:39:44.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.240+0000 7f19cde8b700 1 -- 172.21.15.45:0/2235555042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c81a2250 con 0x7f19c81025b0 2024-05-10T03:39:44.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.240+0000 7f19c4ff9700 1 -- 172.21.15.45:0/2235555042 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c000cd50 con 0x7f19c81025b0 2024-05-10T03:39:44.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.240+0000 7f19cde8b700 1 -- 172.21.15.45:0/2235555042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c81a2730 con 0x7f19c81025b0 2024-05-10T03:39:44.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.241+0000 7f19cde8b700 1 -- 172.21.15.45:0/2235555042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c80678b0 con 0x7f19c81025b0 2024-05-10T03:39:44.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.243+0000 7f19c4ff9700 1 -- 172.21.15.45:0/2235555042 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f19c0003a00 con 0x7f19c81025b0 2024-05-10T03:39:44.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.243+0000 7f19c4ff9700 1 --2- 172.21.15.45:0/2235555042 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f19b00a12e0 0x7f19b00a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:44.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.243+0000 7f19c4ff9700 1 -- 172.21.15.45:0/2235555042 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f19c00cd0c0 con 0x7f19c81025b0 2024-05-10T03:39:44.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.243+0000 7f19c77fe700 1 --2- 172.21.15.45:0/2235555042 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f19b00a12e0 0x7f19b00a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:44.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.244+0000 7f19c77fe700 1 --2- 172.21.15.45:0/2235555042 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f19b00a12e0 0x7f19b00a37f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f19c8101b10 tx=0x7f19b8007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:44.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.247+0000 7f19c4ff9700 1 -- 172.21.15.45:0/2235555042 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f19c0096470 con 0x7f19c81025b0 2024-05-10T03:39:44.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.467+0000 7f19cde8b700 1 -- 172.21.15.45:0/2235555042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f19c810c680 con 0x7f19c81025b0 2024-05-10T03:39:44.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.467+0000 7f19c4ff9700 1 -- 172.21.15.45:0/2235555042 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) v1 ==== 103+0+11 (secure 0 0 0) 0x7f19c0099a90 con 0x7f19c81025b0 2024-05-10T03:39:44.470 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-05-10T03:39:44.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.469+0000 7f19cde8b700 1 -- 172.21.15.45:0/2235555042 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f19b00a12e0 msgr2=0x7f19b00a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:44.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.469+0000 7f19cde8b700 1 --2- 172.21.15.45:0/2235555042 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f19b00a12e0 0x7f19b00a37f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f19c8101b10 tx=0x7f19b8007400 comp rx=0 tx=0).stop 2024-05-10T03:39:44.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.469+0000 7f19cde8b700 1 -- 172.21.15.45:0/2235555042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c81025b0 msgr2=0x7f19c8103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:44.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.469+0000 7f19cde8b700 1 --2- 172.21.15.45:0/2235555042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c81025b0 0x7f19c8103490 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f19c000ef30 tx=0x7f19c000c3a0 comp rx=0 tx=0).stop 2024-05-10T03:39:44.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.469+0000 7f19cde8b700 1 -- 172.21.15.45:0/2235555042 shutdown_connections 2024-05-10T03:39:44.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.469+0000 7f19cde8b700 1 --2- 172.21.15.45:0/2235555042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19c8100af0 0x7f19c81048b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:44.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.469+0000 7f19cde8b700 1 --2- 172.21.15.45:0/2235555042 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f19b00a12e0 0x7f19b00a37f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:44.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.469+0000 7f19cde8b700 1 --2- 172.21.15.45:0/2235555042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c81025b0 0x7f19c8103490 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:44.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.469+0000 7f19cde8b700 1 --2- 172.21.15.45:0/2235555042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19c8101c10 0x7f19c8102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:44.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.469+0000 7f19cde8b700 1 -- 172.21.15.45:0/2235555042 >> 172.21.15.45:0/2235555042 conn(0x7f19c80fc100 msgr2=0x7f19c80fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:44.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.470+0000 7f19cde8b700 1 -- 172.21.15.45:0/2235555042 shutdown_connections 2024-05-10T03:39:44.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.470+0000 7f19cde8b700 1 -- 172.21.15.45:0/2235555042 wait complete. 2024-05-10T03:39:44.487 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:39:44.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.635+0000 7f12c6206700 1 -- 172.21.15.45:0/3295754899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12c0100ac0 msgr2=0x7f12c0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:44.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.635+0000 7f12c6206700 1 --2- 172.21.15.45:0/3295754899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12c0100ac0 0x7f12c0100ed0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f12b0009990 tx=0x7f12b0009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:44.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.635+0000 7f12c6206700 1 -- 172.21.15.45:0/3295754899 shutdown_connections 2024-05-10T03:39:44.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.635+0000 7f12c6206700 1 --2- 172.21.15.45:0/3295754899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c0102580 0x7f12c0108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:44.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.635+0000 7f12c6206700 1 --2- 172.21.15.45:0/3295754899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12c0100ac0 0x7f12c0100ed0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:44.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.635+0000 7f12c6206700 1 --2- 172.21.15.45:0/3295754899 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12c0101be0 0x7f12c0101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:44.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.635+0000 7f12c6206700 1 -- 172.21.15.45:0/3295754899 >> 172.21.15.45:0/3295754899 conn(0x7f12c00fc0d0 msgr2=0x7f12c00fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:44.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.635+0000 7f12c6206700 1 -- 172.21.15.45:0/3295754899 shutdown_connections 2024-05-10T03:39:44.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.635+0000 7f12c6206700 1 -- 172.21.15.45:0/3295754899 wait complete. 2024-05-10T03:39:44.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.636+0000 7f12c6206700 1 Processor -- start 2024-05-10T03:39:44.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.636+0000 7f12c6206700 1 -- start start 2024-05-10T03:39:44.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.636+0000 7f12c6206700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c0100ac0 0x7f12c0198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:44.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.636+0000 7f12c6206700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12c0101be0 0x7f12c0198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:44.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.636+0000 7f12c6206700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12c0102580 0x7f12c019f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:44.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.636+0000 7f12c6206700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c019fb30 con 0x7f12c0101be0 2024-05-10T03:39:44.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.636+0000 7f12c6206700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c019fca0 con 0x7f12c0102580 2024-05-10T03:39:44.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.636+0000 7f12c6206700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c019fe60 con 0x7f12c0100ac0 2024-05-10T03:39:44.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.636+0000 7f12beffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12c0101be0 0x7f12c0198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:44.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.637+0000 7f12beffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12c0101be0 0x7f12c0198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40388/0 (socket says 172.21.15.45:40388) 2024-05-10T03:39:44.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.637+0000 7f12beffd700 1 -- 172.21.15.45:0/2245230528 learned_addr learned my addr 172.21.15.45:0/2245230528 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:44.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.637+0000 7f12bffff700 1 --2- 172.21.15.45:0/2245230528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12c0102580 0x7f12c019f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:44.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.637+0000 7f12bf7fe700 1 --2- 172.21.15.45:0/2245230528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c0100ac0 0x7f12c0198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:44.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.637+0000 7f12beffd700 1 -- 172.21.15.45:0/2245230528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c0100ac0 msgr2=0x7f12c0198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:44.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.637+0000 7f12beffd700 1 --2- 172.21.15.45:0/2245230528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c0100ac0 0x7f12c0198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:44.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.637+0000 7f12beffd700 1 -- 172.21.15.45:0/2245230528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12c0102580 msgr2=0x7f12c019f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:44.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.637+0000 7f12beffd700 1 --2- 172.21.15.45:0/2245230528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12c0102580 0x7f12c019f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:44.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.637+0000 7f12beffd700 1 -- 172.21.15.45:0/2245230528 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b00095f0 con 0x7f12c0101be0 2024-05-10T03:39:44.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.637+0000 7f12bf7fe700 1 --2- 172.21.15.45:0/2245230528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c0100ac0 0x7f12c0198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:44.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.637+0000 7f12beffd700 1 --2- 172.21.15.45:0/2245230528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12c0101be0 0x7f12c0198590 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f12b400d980 tx=0x7f12b400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:44.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.637+0000 7f12bcff9700 1 -- 172.21.15.45:0/2245230528 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b4004220 con 0x7f12c0101be0 2024-05-10T03:39:44.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.637+0000 7f12c6206700 1 -- 172.21.15.45:0/2245230528 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c01a0140 con 0x7f12c0101be0 2024-05-10T03:39:44.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.637+0000 7f12bcff9700 1 -- 172.21.15.45:0/2245230528 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f12b4007640 con 0x7f12c0101be0 2024-05-10T03:39:44.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.637+0000 7f12bcff9700 1 -- 172.21.15.45:0/2245230528 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b4005720 con 0x7f12c0101be0 2024-05-10T03:39:44.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.637+0000 7f12c6206700 1 -- 172.21.15.45:0/2245230528 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c01a06a0 con 0x7f12c0101be0 2024-05-10T03:39:44.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.638+0000 7f12c6206700 1 -- 172.21.15.45:0/2245230528 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c00694d0 con 0x7f12c0101be0 2024-05-10T03:39:44.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.640+0000 7f12bcff9700 1 -- 172.21.15.45:0/2245230528 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f12b4004750 con 0x7f12c0101be0 2024-05-10T03:39:44.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.640+0000 7f12bcff9700 1 --2- 172.21.15.45:0/2245230528 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f12a80a11b0 0x7f12a80a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:44.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.641+0000 7f12bcff9700 1 -- 172.21.15.45:0/2245230528 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f12b40cd150 con 0x7f12c0101be0 2024-05-10T03:39:44.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.641+0000 7f12bf7fe700 1 --2- 172.21.15.45:0/2245230528 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f12a80a11b0 0x7f12a80a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:44.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.641+0000 7f12bf7fe700 1 --2- 172.21.15.45:0/2245230528 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f12a80a11b0 0x7f12a80a36c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f12b000b8e0 tx=0x7f12b001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:44.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.644+0000 7f12bcff9700 1 -- 172.21.15.45:0/2245230528 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f12b4096470 con 0x7f12c0101be0 2024-05-10T03:39:44.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.912+0000 7f12c6206700 1 -- 172.21.15.45:0/2245230528 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12c010c4d0 con 0x7f12c0101be0 2024-05-10T03:39:44.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.912+0000 7f12bcff9700 1 -- 172.21.15.45:0/2245230528 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10926 (secure 0 0 0) 0x7f12b4016020 con 0x7f12c0101be0 2024-05-10T03:39:44.915 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:39:44.915 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/378320264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":378320264},{"type":"v1","addr":"172.21.15.45:6835","nonce":378320264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3032381796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3032381796},{"type":"v1","addr":"172.21.15.45:6837","nonce":3032381796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T03:38:36.555290+0000","modified":"2024-05-10T03:39:00.010786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24548,"mds_2":24547,"mds_3":24526,"mds_4":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14625":{"gid":14625,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6839/4007419304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":4007419304},{"type":"v1","addr":"172.21.15.45:6839","nonce":4007419304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14637":{"gid":14637,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6841/1355456195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1355456195},{"type":"v1","addr":"172.21.15.45:6841","nonce":1355456195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/4037121210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":4037121210},{"type":"v1","addr":"172.21.15.154:6835","nonce":4037121210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24521":{"gid":24521,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.106:6835/4162885659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4162885659},{"type":"v1","addr":"172.21.15.106:6835","nonce":4162885659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.154:6837/608167481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":608167481},{"type":"v1","addr":"172.21.15.154:6837","nonce":608167481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/1506563336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1506563336},{"type":"v1","addr":"172.21.15.154:6839","nonce":1506563336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.106:6837/3047487403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":3047487403},{"type":"v1","addr":"172.21.15.106:6837","nonce":3047487403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6839/3533867856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":3533867856},{"type":"v1","addr":"172.21.15.106:6839","nonce":3533867856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T03:39:44.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.915+0000 7f12c6206700 1 -- 172.21.15.45:0/2245230528 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f12a80a11b0 msgr2=0x7f12a80a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:44.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.915+0000 7f12c6206700 1 --2- 172.21.15.45:0/2245230528 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f12a80a11b0 0x7f12a80a36c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f12b000b8e0 tx=0x7f12b001a040 comp rx=0 tx=0).stop 2024-05-10T03:39:44.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.915+0000 7f12c6206700 1 -- 172.21.15.45:0/2245230528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12c0101be0 msgr2=0x7f12c0198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:44.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.915+0000 7f12c6206700 1 --2- 172.21.15.45:0/2245230528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12c0101be0 0x7f12c0198590 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f12b400d980 tx=0x7f12b400dc90 comp rx=0 tx=0).stop 2024-05-10T03:39:44.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.915+0000 7f12c6206700 1 -- 172.21.15.45:0/2245230528 shutdown_connections 2024-05-10T03:39:44.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.915+0000 7f12c6206700 1 --2- 172.21.15.45:0/2245230528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c0100ac0 0x7f12c0198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:44.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.915+0000 7f12c6206700 1 --2- 172.21.15.45:0/2245230528 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f12a80a11b0 0x7f12a80a36c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:44.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.915+0000 7f12c6206700 1 --2- 172.21.15.45:0/2245230528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12c0102580 0x7f12c019f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:44.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.915+0000 7f12c6206700 1 --2- 172.21.15.45:0/2245230528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12c0101be0 0x7f12c0198590 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:44.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.915+0000 7f12c6206700 1 -- 172.21.15.45:0/2245230528 >> 172.21.15.45:0/2245230528 conn(0x7f12c00fc0d0 msgr2=0x7f12c00fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:44.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.915+0000 7f12c6206700 1 -- 172.21.15.45:0/2245230528 shutdown_connections 2024-05-10T03:39:44.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:44.915+0000 7f12c6206700 1 -- 172.21.15.45:0/2245230528 wait complete. 2024-05-10T03:39:44.919 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 27 2024-05-10T03:39:44.933 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:39:45.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.080+0000 7fc42daa7700 1 -- 172.21.15.45:0/3024784406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc428100d30 msgr2=0x7fc428101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:45.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.080+0000 7fc42daa7700 1 --2- 172.21.15.45:0/3024784406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc428100d30 0x7fc428101140 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc41c009990 tx=0x7fc41c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.080+0000 7fc42daa7700 1 -- 172.21.15.45:0/3024784406 shutdown_connections 2024-05-10T03:39:45.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.080+0000 7fc42daa7700 1 --2- 172.21.15.45:0/3024784406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc428102030 0x7fc428102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.080+0000 7fc42daa7700 1 --2- 172.21.15.45:0/3024784406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc428101680 0x7fc428108f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.080+0000 7fc42daa7700 1 --2- 172.21.15.45:0/3024784406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc428100d30 0x7fc428101140 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.080+0000 7fc42daa7700 1 -- 172.21.15.45:0/3024784406 >> 172.21.15.45:0/3024784406 conn(0x7fc4280fb8f0 msgr2=0x7fc4280fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:45.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.080+0000 7fc42daa7700 1 -- 172.21.15.45:0/3024784406 shutdown_connections 2024-05-10T03:39:45.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.080+0000 7fc42daa7700 1 -- 172.21.15.45:0/3024784406 wait complete. 2024-05-10T03:39:45.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.081+0000 7fc42daa7700 1 Processor -- start 2024-05-10T03:39:45.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.081+0000 7fc42daa7700 1 -- start start 2024-05-10T03:39:45.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.081+0000 7fc42daa7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc428100d30 0x7fc428196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:45.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.081+0000 7fc42daa7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc428101680 0x7fc4281974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:45.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.081+0000 7fc42daa7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc428102030 0x7fc42819e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:45.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.081+0000 7fc42daa7700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42819ea70 con 0x7fc428102030 2024-05-10T03:39:45.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.081+0000 7fc42daa7700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42819ebe0 con 0x7fc428101680 2024-05-10T03:39:45.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.081+0000 7fc42daa7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42819eda0 con 0x7fc428100d30 2024-05-10T03:39:45.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.081+0000 7fc427fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc428102030 0x7fc42819e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:45.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.081+0000 7fc4277fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc428100d30 0x7fc428196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:45.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.081+0000 7fc427fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc428102030 0x7fc42819e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40394/0 (socket says 172.21.15.45:40394) 2024-05-10T03:39:45.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.081+0000 7fc427fff700 1 -- 172.21.15.45:0/2135332342 learned_addr learned my addr 172.21.15.45:0/2135332342 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:45.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.081+0000 7fc426ffd700 1 --2- 172.21.15.45:0/2135332342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc428101680 0x7fc4281974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:45.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.082+0000 7fc427fff700 1 -- 172.21.15.45:0/2135332342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc428100d30 msgr2=0x7fc428196f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:45.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.082+0000 7fc427fff700 1 --2- 172.21.15.45:0/2135332342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc428100d30 0x7fc428196f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.082+0000 7fc427fff700 1 -- 172.21.15.45:0/2135332342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc428101680 msgr2=0x7fc4281974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:45.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.082+0000 7fc427fff700 1 --2- 172.21.15.45:0/2135332342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc428101680 0x7fc4281974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.082+0000 7fc427fff700 1 -- 172.21.15.45:0/2135332342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41c0095f0 con 0x7fc428102030 2024-05-10T03:39:45.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.082+0000 7fc4277fe700 1 --2- 172.21.15.45:0/2135332342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc428100d30 0x7fc428196f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:39:45.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.082+0000 7fc427fff700 1 --2- 172.21.15.45:0/2135332342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc428102030 0x7fc42819e460 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc420007ee0 tx=0x7fc42000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:45.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.082+0000 7fc424ff9700 1 -- 172.21.15.45:0/2135332342 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc420017070 con 0x7fc428102030 2024-05-10T03:39:45.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.082+0000 7fc424ff9700 1 -- 172.21.15.45:0/2135332342 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc42000f040 con 0x7fc428102030 2024-05-10T03:39:45.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.082+0000 7fc42daa7700 1 -- 172.21.15.45:0/2135332342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4280ffc80 con 0x7fc428102030 2024-05-10T03:39:45.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.082+0000 7fc424ff9700 1 -- 172.21.15.45:0/2135332342 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc420005610 con 0x7fc428102030 2024-05-10T03:39:45.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.082+0000 7fc42daa7700 1 -- 172.21.15.45:0/2135332342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc428100140 con 0x7fc428102030 2024-05-10T03:39:45.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.083+0000 7fc42daa7700 1 -- 172.21.15.45:0/2135332342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc42810cd90 con 0x7fc428102030 2024-05-10T03:39:45.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.085+0000 7fc424ff9700 1 -- 172.21.15.45:0/2135332342 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fc420005770 con 0x7fc428102030 2024-05-10T03:39:45.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.086+0000 7fc424ff9700 1 --2- 172.21.15.45:0/2135332342 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc4100a11b0 0x7fc4100a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:45.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.086+0000 7fc4277fe700 1 --2- 172.21.15.45:0/2135332342 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc4100a11b0 0x7fc4100a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:45.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.086+0000 7fc424ff9700 1 -- 172.21.15.45:0/2135332342 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc4200ccb60 con 0x7fc428102030 2024-05-10T03:39:45.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.086+0000 7fc4277fe700 1 --2- 172.21.15.45:0/2135332342 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc4100a11b0 0x7fc4100a36c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc4280681e0 tx=0x7fc418010040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:45.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.090+0000 7fc424ff9700 1 -- 172.21.15.45:0/2135332342 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc420095e80 con 0x7fc428102030 2024-05-10T03:39:45.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:44 smithi154 ceph-mon[46565]: pgmap v267: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:39:45.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:44 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1365185708' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:39:45.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:44 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2235555042' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:39:45.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:44 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2245230528' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:39:45.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:44 smithi045 ceph-mon[42520]: pgmap v267: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:39:45.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:44 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1365185708' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:39:45.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:44 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2235555042' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:39:45.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:44 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2245230528' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:39:45.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.314+0000 7fc42daa7700 1 -- 172.21.15.45:0/2135332342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4280678b0 con 0x7fc428102030 2024-05-10T03:39:45.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.316+0000 7fc424ff9700 1 -- 172.21.15.45:0/2135332342 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+24508 (secure 0 0 0) 0x7fc420009390 con 0x7fc428102030 2024-05-10T03:39:45.319 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:39:45.319 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":88,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:39:27.064512+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:38:34.871801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:38:35.935386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T03:38:39.029903+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:39:45.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.318+0000 7fc42daa7700 1 -- 172.21.15.45:0/2135332342 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc4100a11b0 msgr2=0x7fc4100a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:45.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.318+0000 7fc42daa7700 1 --2- 172.21.15.45:0/2135332342 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc4100a11b0 0x7fc4100a36c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc4280681e0 tx=0x7fc418010040 comp rx=0 tx=0).stop 2024-05-10T03:39:45.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.318+0000 7fc42daa7700 1 -- 172.21.15.45:0/2135332342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc428102030 msgr2=0x7fc42819e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:45.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.318+0000 7fc42daa7700 1 --2- 172.21.15.45:0/2135332342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc428102030 0x7fc42819e460 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc420007ee0 tx=0x7fc42000d3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.318+0000 7fc42daa7700 1 -- 172.21.15.45:0/2135332342 shutdown_connections 2024-05-10T03:39:45.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.318+0000 7fc42daa7700 1 --2- 172.21.15.45:0/2135332342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc428100d30 0x7fc428196f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.318+0000 7fc42daa7700 1 --2- 172.21.15.45:0/2135332342 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc4100a11b0 0x7fc4100a36c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.318+0000 7fc42daa7700 1 --2- 172.21.15.45:0/2135332342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc428102030 0x7fc42819e460 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.318+0000 7fc42daa7700 1 --2- 172.21.15.45:0/2135332342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc428101680 0x7fc4281974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.318+0000 7fc42daa7700 1 -- 172.21.15.45:0/2135332342 >> 172.21.15.45:0/2135332342 conn(0x7fc4280fb8f0 msgr2=0x7fc428104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:45.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.319+0000 7fc42daa7700 1 -- 172.21.15.45:0/2135332342 shutdown_connections 2024-05-10T03:39:45.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.319+0000 7fc42daa7700 1 -- 172.21.15.45:0/2135332342 wait complete. 2024-05-10T03:39:45.336 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T03:35:20.339400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T03:38:34.871801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T03:38:35.935386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-10T03:38:39.029903+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-10T03:39:45.337 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T03:39:45.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:44 smithi106 ceph-mon[46996]: pgmap v267: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:39:45.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:44 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1365185708' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:39:45.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:44 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2235555042' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:39:45.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:44 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2245230528' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:39:45.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.487+0000 7fec34c83700 1 -- 172.21.15.45:0/2210191664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec301050c0 msgr2=0x7fec301074e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:45.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.487+0000 7fec34c83700 1 --2- 172.21.15.45:0/2210191664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec301050c0 0x7fec301074e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fec18009990 tx=0x7fec18009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.487+0000 7fec34c83700 1 -- 172.21.15.45:0/2210191664 shutdown_connections 2024-05-10T03:39:45.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.487+0000 7fec34c83700 1 --2- 172.21.15.45:0/2210191664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec30102760 0x7fec30104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.487+0000 7fec34c83700 1 --2- 172.21.15.45:0/2210191664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec30107a20 0x7fec30109e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.487+0000 7fec34c83700 1 --2- 172.21.15.45:0/2210191664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec301050c0 0x7fec301074e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.487+0000 7fec34c83700 1 -- 172.21.15.45:0/2210191664 >> 172.21.15.45:0/2210191664 conn(0x7fec300fc180 msgr2=0x7fec300fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:45.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.487+0000 7fec34c83700 1 -- 172.21.15.45:0/2210191664 shutdown_connections 2024-05-10T03:39:45.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.487+0000 7fec34c83700 1 -- 172.21.15.45:0/2210191664 wait complete. 2024-05-10T03:39:45.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.488+0000 7fec34c83700 1 Processor -- start 2024-05-10T03:39:45.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.488+0000 7fec34c83700 1 -- start start 2024-05-10T03:39:45.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.488+0000 7fec34c83700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec30102760 0x7fec30197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:45.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.488+0000 7fec34c83700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec301050c0 0x7fec30198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:45.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.488+0000 7fec34c83700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec30107a20 0x7fec3019f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:45.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.488+0000 7fec34c83700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3019fad0 con 0x7fec30107a20 2024-05-10T03:39:45.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.488+0000 7fec34c83700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3019fc40 con 0x7fec30102760 2024-05-10T03:39:45.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.488+0000 7fec34c83700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3019fe00 con 0x7fec301050c0 2024-05-10T03:39:45.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.488+0000 7fec2ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec30107a20 0x7fec3019f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:45.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.488+0000 7fec2ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec30107a20 0x7fec3019f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40406/0 (socket says 172.21.15.45:40406) 2024-05-10T03:39:45.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.488+0000 7fec2ed9d700 1 -- 172.21.15.45:0/1741656726 learned_addr learned my addr 172.21.15.45:0/1741656726 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:45.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.488+0000 7fec2dd9b700 1 --2- 172.21.15.45:0/1741656726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec301050c0 0x7fec30198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:45.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.488+0000 7fec2e59c700 1 --2- 172.21.15.45:0/1741656726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec30102760 0x7fec30197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:45.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.489+0000 7fec2ed9d700 1 -- 172.21.15.45:0/1741656726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec301050c0 msgr2=0x7fec30198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:45.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.489+0000 7fec2ed9d700 1 --2- 172.21.15.45:0/1741656726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec301050c0 0x7fec30198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.489+0000 7fec2ed9d700 1 -- 172.21.15.45:0/1741656726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec30102760 msgr2=0x7fec30197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:45.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.489+0000 7fec2ed9d700 1 --2- 172.21.15.45:0/1741656726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec30102760 0x7fec30197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.489+0000 7fec2ed9d700 1 -- 172.21.15.45:0/1741656726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec180095f0 con 0x7fec30107a20 2024-05-10T03:39:45.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.489+0000 7fec2dd9b700 1 --2- 172.21.15.45:0/1741656726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec301050c0 0x7fec30198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:45.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.489+0000 7fec2ed9d700 1 --2- 172.21.15.45:0/1741656726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec30107a20 0x7fec3019f4c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fec280094f0 tx=0x7fec28007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:45.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.489+0000 7fec277fe700 1 -- 172.21.15.45:0/1741656726 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec28004db0 con 0x7fec30107a20 2024-05-10T03:39:45.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.489+0000 7fec34c83700 1 -- 172.21.15.45:0/1741656726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec301a00e0 con 0x7fec30107a20 2024-05-10T03:39:45.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.489+0000 7fec34c83700 1 -- 172.21.15.45:0/1741656726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec301a05f0 con 0x7fec30107a20 2024-05-10T03:39:45.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.489+0000 7fec277fe700 1 -- 172.21.15.45:0/1741656726 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fec2800f040 con 0x7fec30107a20 2024-05-10T03:39:45.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.489+0000 7fec277fe700 1 -- 172.21.15.45:0/1741656726 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec28005aa0 con 0x7fec30107a20 2024-05-10T03:39:45.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.490+0000 7fec34c83700 1 -- 172.21.15.45:0/1741656726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec10005320 con 0x7fec30107a20 2024-05-10T03:39:45.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.492+0000 7fec277fe700 1 -- 172.21.15.45:0/1741656726 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fec2800db60 con 0x7fec30107a20 2024-05-10T03:39:45.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.493+0000 7fec277fe700 1 --2- 172.21.15.45:0/1741656726 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fec1c0a1260 0x7fec1c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:45.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.493+0000 7fec277fe700 1 -- 172.21.15.45:0/1741656726 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fec280ccf50 con 0x7fec30107a20 2024-05-10T03:39:45.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.493+0000 7fec2e59c700 1 --2- 172.21.15.45:0/1741656726 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fec1c0a1260 0x7fec1c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:45.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.494+0000 7fec2e59c700 1 --2- 172.21.15.45:0/1741656726 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fec1c0a1260 0x7fec1c0a3770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fec3006a1a0 tx=0x7fec20009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:45.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.497+0000 7fec277fe700 1 -- 172.21.15.45:0/1741656726 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fec28096210 con 0x7fec30107a20 2024-05-10T03:39:45.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.711+0000 7fec34c83700 1 -- 172.21.15.45:0/1741656726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec10005b50 con 0x7fec30107a20 2024-05-10T03:39:45.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.711+0000 7fec277fe700 1 -- 172.21.15.45:0/1741656726 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec28023020 con 0x7fec30107a20 2024-05-10T03:39:45.714 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-05-10T03:39:45.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.713+0000 7fec34c83700 1 -- 172.21.15.45:0/1741656726 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fec1c0a1260 msgr2=0x7fec1c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:45.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.713+0000 7fec34c83700 1 --2- 172.21.15.45:0/1741656726 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fec1c0a1260 0x7fec1c0a3770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fec3006a1a0 tx=0x7fec20009260 comp rx=0 tx=0).stop 2024-05-10T03:39:45.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.713+0000 7fec34c83700 1 -- 172.21.15.45:0/1741656726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec30107a20 msgr2=0x7fec3019f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:45.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.713+0000 7fec34c83700 1 --2- 172.21.15.45:0/1741656726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec30107a20 0x7fec3019f4c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fec280094f0 tx=0x7fec28007f90 comp rx=0 tx=0).stop 2024-05-10T03:39:45.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.713+0000 7fec34c83700 1 -- 172.21.15.45:0/1741656726 shutdown_connections 2024-05-10T03:39:45.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.713+0000 7fec34c83700 1 --2- 172.21.15.45:0/1741656726 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fec1c0a1260 0x7fec1c0a3770 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.713+0000 7fec34c83700 1 --2- 172.21.15.45:0/1741656726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec30107a20 0x7fec3019f4c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.713+0000 7fec34c83700 1 --2- 172.21.15.45:0/1741656726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec30102760 0x7fec30197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.713+0000 7fec34c83700 1 --2- 172.21.15.45:0/1741656726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec301050c0 0x7fec30198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.713+0000 7fec34c83700 1 -- 172.21.15.45:0/1741656726 >> 172.21.15.45:0/1741656726 conn(0x7fec300fc180 msgr2=0x7fec30103270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:45.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.714+0000 7fec34c83700 1 -- 172.21.15.45:0/1741656726 shutdown_connections 2024-05-10T03:39:45.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.714+0000 7fec34c83700 1 -- 172.21.15.45:0/1741656726 wait complete. 2024-05-10T03:39:45.731 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T03:39:45.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.881+0000 7fdfbfd67700 1 -- 172.21.15.45:0/3728629202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfb8102580 msgr2=0x7fdfb8108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:45.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.881+0000 7fdfbfd67700 1 --2- 172.21.15.45:0/3728629202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfb8102580 0x7fdfb8108e30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000b0a0 tx=0x7fdfb000b3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.881+0000 7fdfbfd67700 1 -- 172.21.15.45:0/3728629202 shutdown_connections 2024-05-10T03:39:45.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.881+0000 7fdfbfd67700 1 --2- 172.21.15.45:0/3728629202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfb8102580 0x7fdfb8108e30 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.881+0000 7fdfbfd67700 1 --2- 172.21.15.45:0/3728629202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdfb8100ac0 0x7fdfb8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.881+0000 7fdfbfd67700 1 --2- 172.21.15.45:0/3728629202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb8101be0 0x7fdfb8101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.881+0000 7fdfbfd67700 1 -- 172.21.15.45:0/3728629202 >> 172.21.15.45:0/3728629202 conn(0x7fdfb80fc0d0 msgr2=0x7fdfb80fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:45.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.881+0000 7fdfbfd67700 1 -- 172.21.15.45:0/3728629202 shutdown_connections 2024-05-10T03:39:45.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.881+0000 7fdfbfd67700 1 -- 172.21.15.45:0/3728629202 wait complete. 2024-05-10T03:39:45.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.881+0000 7fdfbfd67700 1 Processor -- start 2024-05-10T03:39:45.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.882+0000 7fdfbfd67700 1 -- start start 2024-05-10T03:39:45.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.882+0000 7fdfbfd67700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfb8100ac0 0x7fdfb81980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:45.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.882+0000 7fdfbfd67700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdfb8101be0 0x7fdfb8198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:45.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.882+0000 7fdfbfd67700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb8102580 0x7fdfb819f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:45.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.882+0000 7fdfbfd67700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb819fba0 con 0x7fdfb8100ac0 2024-05-10T03:39:45.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.882+0000 7fdfbfd67700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb819fd10 con 0x7fdfb8101be0 2024-05-10T03:39:45.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.882+0000 7fdfbfd67700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb819fed0 con 0x7fdfb8102580 2024-05-10T03:39:45.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.882+0000 7fdfbdb03700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfb8100ac0 0x7fdfb81980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:45.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.882+0000 7fdfbdb03700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfb8100ac0 0x7fdfb81980c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40426/0 (socket says 172.21.15.45:40426) 2024-05-10T03:39:45.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.882+0000 7fdfbdb03700 1 -- 172.21.15.45:0/25359614 learned_addr learned my addr 172.21.15.45:0/25359614 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:45.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.882+0000 7fdfbd302700 1 --2- 172.21.15.45:0/25359614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdfb8101be0 0x7fdfb8198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:45.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.882+0000 7fdfbe304700 1 --2- 172.21.15.45:0/25359614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb8102580 0x7fdfb819f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:45.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.882+0000 7fdfbdb03700 1 -- 172.21.15.45:0/25359614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb8102580 msgr2=0x7fdfb819f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:45.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.882+0000 7fdfbdb03700 1 --2- 172.21.15.45:0/25359614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb8102580 0x7fdfb819f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.882+0000 7fdfbdb03700 1 -- 172.21.15.45:0/25359614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdfb8101be0 msgr2=0x7fdfb8198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:45.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.882+0000 7fdfbdb03700 1 --2- 172.21.15.45:0/25359614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdfb8101be0 0x7fdfb8198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:45.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.882+0000 7fdfbdb03700 1 -- 172.21.15.45:0/25359614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb0009d00 con 0x7fdfb8100ac0 2024-05-10T03:39:45.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.882+0000 7fdfbd302700 1 --2- 172.21.15.45:0/25359614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdfb8101be0 0x7fdfb8198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:45.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.882+0000 7fdfbdb03700 1 --2- 172.21.15.45:0/25359614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfb8100ac0 0x7fdfb81980c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400e940 tx=0x7fdfb400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:45.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.883+0000 7fdfaaffd700 1 -- 172.21.15.45:0/25359614 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb400cbd0 con 0x7fdfb8100ac0 2024-05-10T03:39:45.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.883+0000 7fdfbfd67700 1 -- 172.21.15.45:0/25359614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb81a01b0 con 0x7fdfb8100ac0 2024-05-10T03:39:45.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.883+0000 7fdfaaffd700 1 -- 172.21.15.45:0/25359614 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdfb4004500 con 0x7fdfb8100ac0 2024-05-10T03:39:45.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.883+0000 7fdfaaffd700 1 -- 172.21.15.45:0/25359614 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4003e30 con 0x7fdfb8100ac0 2024-05-10T03:39:45.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.883+0000 7fdfbfd67700 1 -- 172.21.15.45:0/25359614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb81a0710 con 0x7fdfb8100ac0 2024-05-10T03:39:45.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.884+0000 7fdfbfd67700 1 -- 172.21.15.45:0/25359614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb80694d0 con 0x7fdfb8100ac0 2024-05-10T03:39:45.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.885+0000 7fdfaaffd700 1 -- 172.21.15.45:0/25359614 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fdfb4003fb0 con 0x7fdfb8100ac0 2024-05-10T03:39:45.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.886+0000 7fdfaaffd700 1 --2- 172.21.15.45:0/25359614 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fdfa40a1260 0x7fdfa40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:45.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.886+0000 7fdfaaffd700 1 -- 172.21.15.45:0/25359614 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fdfb4014070 con 0x7fdfb8100ac0 2024-05-10T03:39:45.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.886+0000 7fdfbd302700 1 --2- 172.21.15.45:0/25359614 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fdfa40a1260 0x7fdfa40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:45.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.886+0000 7fdfbd302700 1 --2- 172.21.15.45:0/25359614 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fdfa40a1260 0x7fdfa40a3770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8199160 tx=0x7fdfac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:45.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:45.889+0000 7fdfaaffd700 1 -- 172.21.15.45:0/25359614 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fdfb4096690 con 0x7fdfb8100ac0 2024-05-10T03:39:46.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:45 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2135332342' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:39:46.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:45 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1741656726' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:39:46.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.106+0000 7fdfbfd67700 1 -- 172.21.15.45:0/25359614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdfb81a0a90 con 0x7fdfb8100ac0 2024-05-10T03:39:46.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.107+0000 7fdfaaffd700 1 -- 172.21.15.45:0/25359614 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdfb4099cb0 con 0x7fdfb8100ac0 2024-05-10T03:39:46.109 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-05-10T03:39:46.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.110+0000 7fdfbfd67700 1 -- 172.21.15.45:0/25359614 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fdfa40a1260 msgr2=0x7fdfa40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:46.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.110+0000 7fdfbfd67700 1 --2- 172.21.15.45:0/25359614 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fdfa40a1260 0x7fdfa40a3770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8199160 tx=0x7fdfac009260 comp rx=0 tx=0).stop 2024-05-10T03:39:46.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.110+0000 7fdfbfd67700 1 -- 172.21.15.45:0/25359614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfb8100ac0 msgr2=0x7fdfb81980c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:46.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.110+0000 7fdfbfd67700 1 --2- 172.21.15.45:0/25359614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfb8100ac0 0x7fdfb81980c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400e940 tx=0x7fdfb400ed00 comp rx=0 tx=0).stop 2024-05-10T03:39:46.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.110+0000 7fdfbfd67700 1 -- 172.21.15.45:0/25359614 shutdown_connections 2024-05-10T03:39:46.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.110+0000 7fdfbfd67700 1 --2- 172.21.15.45:0/25359614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb8102580 0x7fdfb819f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:46.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.110+0000 7fdfbfd67700 1 --2- 172.21.15.45:0/25359614 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fdfa40a1260 0x7fdfa40a3770 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:46.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.110+0000 7fdfbfd67700 1 --2- 172.21.15.45:0/25359614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfb8100ac0 0x7fdfb81980c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:46.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.110+0000 7fdfbfd67700 1 --2- 172.21.15.45:0/25359614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdfb8101be0 0x7fdfb8198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:46.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.110+0000 7fdfbfd67700 1 -- 172.21.15.45:0/25359614 >> 172.21.15.45:0/25359614 conn(0x7fdfb80fc0d0 msgr2=0x7fdfb80fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:46.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.110+0000 7fdfbfd67700 1 -- 172.21.15.45:0/25359614 shutdown_connections 2024-05-10T03:39:46.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.110+0000 7fdfbfd67700 1 -- 172.21.15.45:0/25359614 wait complete. 2024-05-10T03:39:46.127 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T03:39:46.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:45 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2135332342' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:39:46.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:45 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1741656726' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:39:46.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.277+0000 7fd7366e2700 1 -- 172.21.15.45:0/3679969998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7301025a0 msgr2=0x7fd730108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:46.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.277+0000 7fd7366e2700 1 --2- 172.21.15.45:0/3679969998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7301025a0 0x7fd730108e50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd72800b0a0 tx=0x7fd72800b3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:46.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.277+0000 7fd7366e2700 1 -- 172.21.15.45:0/3679969998 shutdown_connections 2024-05-10T03:39:46.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.277+0000 7fd7366e2700 1 --2- 172.21.15.45:0/3679969998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7301025a0 0x7fd730108e50 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:46.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.277+0000 7fd7366e2700 1 --2- 172.21.15.45:0/3679969998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd730100ae0 0x7fd730100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:46.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.277+0000 7fd7366e2700 1 --2- 172.21.15.45:0/3679969998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd730101c00 0x7fd730102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:46.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.277+0000 7fd7366e2700 1 -- 172.21.15.45:0/3679969998 >> 172.21.15.45:0/3679969998 conn(0x7fd7300fc110 msgr2=0x7fd7300fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:46.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.277+0000 7fd7366e2700 1 -- 172.21.15.45:0/3679969998 shutdown_connections 2024-05-10T03:39:46.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.277+0000 7fd7366e2700 1 -- 172.21.15.45:0/3679969998 wait complete. 2024-05-10T03:39:46.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.277+0000 7fd7366e2700 1 Processor -- start 2024-05-10T03:39:46.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.277+0000 7fd7366e2700 1 -- start start 2024-05-10T03:39:46.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.278+0000 7fd7366e2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd730100ae0 0x7fd730198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:46.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.278+0000 7fd7366e2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd730101c00 0x7fd730198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:46.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.278+0000 7fd7366e2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7301025a0 0x7fd73019f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:46.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.278+0000 7fd7366e2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73019fbf0 con 0x7fd730101c00 2024-05-10T03:39:46.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.278+0000 7fd7366e2700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73019fd60 con 0x7fd730100ae0 2024-05-10T03:39:46.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.278+0000 7fd7366e2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73019ff20 con 0x7fd7301025a0 2024-05-10T03:39:46.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.278+0000 7fd72f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd730101c00 0x7fd730198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:46.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.278+0000 7fd72f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd730101c00 0x7fd730198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40436/0 (socket says 172.21.15.45:40436) 2024-05-10T03:39:46.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.278+0000 7fd72f7fe700 1 -- 172.21.15.45:0/1575579291 learned_addr learned my addr 172.21.15.45:0/1575579291 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:46.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.278+0000 7fd72ffff700 1 --2- 172.21.15.45:0/1575579291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd730100ae0 0x7fd730198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:46.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.278+0000 7fd734c7f700 1 --2- 172.21.15.45:0/1575579291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7301025a0 0x7fd73019f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:46.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.278+0000 7fd72f7fe700 1 -- 172.21.15.45:0/1575579291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7301025a0 msgr2=0x7fd73019f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:46.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.278+0000 7fd72f7fe700 1 --2- 172.21.15.45:0/1575579291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7301025a0 0x7fd73019f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:46.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.278+0000 7fd72f7fe700 1 -- 172.21.15.45:0/1575579291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd730100ae0 msgr2=0x7fd730198110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:46.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.278+0000 7fd72f7fe700 1 --2- 172.21.15.45:0/1575579291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd730100ae0 0x7fd730198110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:46.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.278+0000 7fd72f7fe700 1 -- 172.21.15.45:0/1575579291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd728009d00 con 0x7fd730101c00 2024-05-10T03:39:46.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.279+0000 7fd72f7fe700 1 --2- 172.21.15.45:0/1575579291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd730101c00 0x7fd730198650 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd72400e9a0 tx=0x7fd72400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:46.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.279+0000 7fd72d7fa700 1 -- 172.21.15.45:0/1575579291 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd724009790 con 0x7fd730101c00 2024-05-10T03:39:46.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.279+0000 7fd7366e2700 1 -- 172.21.15.45:0/1575579291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7301a0200 con 0x7fd730101c00 2024-05-10T03:39:46.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.279+0000 7fd72d7fa700 1 -- 172.21.15.45:0/1575579291 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd72400cbd0 con 0x7fd730101c00 2024-05-10T03:39:46.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.279+0000 7fd72d7fa700 1 -- 172.21.15.45:0/1575579291 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd724018680 con 0x7fd730101c00 2024-05-10T03:39:46.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.279+0000 7fd7366e2700 1 -- 172.21.15.45:0/1575579291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7301a0760 con 0x7fd730101c00 2024-05-10T03:39:46.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.280+0000 7fd7366e2700 1 -- 172.21.15.45:0/1575579291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd730068730 con 0x7fd730101c00 2024-05-10T03:39:46.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.281+0000 7fd72d7fa700 1 -- 172.21.15.45:0/1575579291 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fd7240188a0 con 0x7fd730101c00 2024-05-10T03:39:46.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.282+0000 7fd72d7fa700 1 --2- 172.21.15.45:0/1575579291 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd7180a1260 0x7fd7180a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:46.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.282+0000 7fd72d7fa700 1 -- 172.21.15.45:0/1575579291 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fd724014070 con 0x7fd730101c00 2024-05-10T03:39:46.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.282+0000 7fd72ffff700 1 --2- 172.21.15.45:0/1575579291 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd7180a1260 0x7fd7180a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:46.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.283+0000 7fd72ffff700 1 --2- 172.21.15.45:0/1575579291 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd7180a1260 0x7fd7180a3770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd730101b00 tx=0x7fd720007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:46.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.286+0000 7fd72d7fa700 1 -- 172.21.15.45:0/1575579291 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd7240967b0 con 0x7fd730101c00 2024-05-10T03:39:46.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:45 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2135332342' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:39:46.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:45 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1741656726' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:39:46.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.504+0000 7fd7366e2700 1 -- 172.21.15.45:0/1575579291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd7301a0a80 con 0x7fd730101c00 2024-05-10T03:39:46.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.505+0000 7fd72d7fa700 1 -- 172.21.15.45:0/1575579291 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd724099dd0 con 0x7fd730101c00 2024-05-10T03:39:46.507 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2024-05-10T03:39:46.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.507+0000 7fd7366e2700 1 -- 172.21.15.45:0/1575579291 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd7180a1260 msgr2=0x7fd7180a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:46.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.507+0000 7fd7366e2700 1 --2- 172.21.15.45:0/1575579291 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd7180a1260 0x7fd7180a3770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd730101b00 tx=0x7fd720007400 comp rx=0 tx=0).stop 2024-05-10T03:39:46.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.507+0000 7fd7366e2700 1 -- 172.21.15.45:0/1575579291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd730101c00 msgr2=0x7fd730198650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:46.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.507+0000 7fd7366e2700 1 --2- 172.21.15.45:0/1575579291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd730101c00 0x7fd730198650 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd72400e9a0 tx=0x7fd72400ecb0 comp rx=0 tx=0).stop 2024-05-10T03:39:46.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.507+0000 7fd7366e2700 1 -- 172.21.15.45:0/1575579291 shutdown_connections 2024-05-10T03:39:46.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.507+0000 7fd7366e2700 1 --2- 172.21.15.45:0/1575579291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7301025a0 0x7fd73019f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:46.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.507+0000 7fd7366e2700 1 --2- 172.21.15.45:0/1575579291 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd7180a1260 0x7fd7180a3770 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:46.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.507+0000 7fd7366e2700 1 --2- 172.21.15.45:0/1575579291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd730100ae0 0x7fd730198110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:46.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.507+0000 7fd7366e2700 1 --2- 172.21.15.45:0/1575579291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd730101c00 0x7fd730198650 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:46.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.507+0000 7fd7366e2700 1 -- 172.21.15.45:0/1575579291 >> 172.21.15.45:0/1575579291 conn(0x7fd7300fc110 msgr2=0x7fd7300fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:46.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.507+0000 7fd7366e2700 1 -- 172.21.15.45:0/1575579291 shutdown_connections 2024-05-10T03:39:46.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.507+0000 7fd7366e2700 1 -- 172.21.15.45:0/1575579291 wait complete. 2024-05-10T03:39:46.524 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-10T03:39:46.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.673+0000 7f4145bac700 1 -- 172.21.15.45:0/3866858844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4140104d10 msgr2=0x7f41401071f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.673+0000 7f4145bac700 1 --2- 172.21.15.45:0/3866858844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4140104d10 0x7f41401071f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4134009990 tx=0x7f4134009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.673+0000 7f4145bac700 1 -- 172.21.15.45:0/3866858844 shutdown_connections 2024-05-10T03:39:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.673+0000 7f4145bac700 1 --2- 172.21.15.45:0/3866858844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4140069090 0x7f4140104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.674+0000 7f4145bac700 1 --2- 172.21.15.45:0/3866858844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4140107880 0x7f4140109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.674+0000 7f4145bac700 1 --2- 172.21.15.45:0/3866858844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4140104d10 0x7f41401071f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.674+0000 7f4145bac700 1 -- 172.21.15.45:0/3866858844 >> 172.21.15.45:0/3866858844 conn(0x7f41400fc0d0 msgr2=0x7f41400fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.674+0000 7f4145bac700 1 -- 172.21.15.45:0/3866858844 shutdown_connections 2024-05-10T03:39:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.674+0000 7f4145bac700 1 -- 172.21.15.45:0/3866858844 wait complete. 2024-05-10T03:39:46.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.674+0000 7f4145bac700 1 Processor -- start 2024-05-10T03:39:46.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.675+0000 7f4145bac700 1 -- start start 2024-05-10T03:39:46.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.675+0000 7f4145bac700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4140069090 0x7f4140197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:46.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.675+0000 7f4145bac700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4140104d10 0x7f4140198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:46.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.675+0000 7f4145bac700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4140107880 0x7f414019f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:46.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.675+0000 7f4145bac700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414019fab0 con 0x7f4140069090 2024-05-10T03:39:46.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.675+0000 7f4145bac700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414019fc20 con 0x7f4140104d10 2024-05-10T03:39:46.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.675+0000 7f4145bac700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414019fde0 con 0x7f4140107880 2024-05-10T03:39:46.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.675+0000 7f413f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4140069090 0x7f4140197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:46.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.675+0000 7f413f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4140069090 0x7f4140197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40450/0 (socket says 172.21.15.45:40450) 2024-05-10T03:39:46.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.675+0000 7f413f7fe700 1 -- 172.21.15.45:0/3465283924 learned_addr learned my addr 172.21.15.45:0/3465283924 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:46.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.675+0000 7f413effd700 1 --2- 172.21.15.45:0/3465283924 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4140104d10 0x7f4140198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:46.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.675+0000 7f413ffff700 1 --2- 172.21.15.45:0/3465283924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4140107880 0x7f414019f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:46.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.675+0000 7f413f7fe700 1 -- 172.21.15.45:0/3465283924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4140107880 msgr2=0x7f414019f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:46.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.675+0000 7f413f7fe700 1 --2- 172.21.15.45:0/3465283924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4140107880 0x7f414019f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:46.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.675+0000 7f413f7fe700 1 -- 172.21.15.45:0/3465283924 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4140104d10 msgr2=0x7f4140198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:46.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.675+0000 7f413f7fe700 1 --2- 172.21.15.45:0/3465283924 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4140104d10 0x7f4140198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:46.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.675+0000 7f413f7fe700 1 -- 172.21.15.45:0/3465283924 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41340095f0 con 0x7f4140069090 2024-05-10T03:39:46.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.676+0000 7f413f7fe700 1 --2- 172.21.15.45:0/3465283924 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4140069090 0x7f4140197fd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f413000d950 tx=0x7f413000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:46.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.676+0000 7f413cff9700 1 -- 172.21.15.45:0/3465283924 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4130004a30 con 0x7f4140069090 2024-05-10T03:39:46.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.676+0000 7f4145bac700 1 -- 172.21.15.45:0/3465283924 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41401a00c0 con 0x7f4140069090 2024-05-10T03:39:46.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.676+0000 7f413cff9700 1 -- 172.21.15.45:0/3465283924 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4130007620 con 0x7f4140069090 2024-05-10T03:39:46.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.676+0000 7f413cff9700 1 -- 172.21.15.45:0/3465283924 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413000fb50 con 0x7f4140069090 2024-05-10T03:39:46.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.676+0000 7f4145bac700 1 -- 172.21.15.45:0/3465283924 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41401a0620 con 0x7f4140069090 2024-05-10T03:39:46.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.677+0000 7f4145bac700 1 -- 172.21.15.45:0/3465283924 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41400fdc80 con 0x7f4140069090 2024-05-10T03:39:46.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.678+0000 7f413cff9700 1 -- 172.21.15.45:0/3465283924 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f413000fcd0 con 0x7f4140069090 2024-05-10T03:39:46.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.679+0000 7f413cff9700 1 --2- 172.21.15.45:0/3465283924 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f41280a1260 0x7f41280a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:46.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.679+0000 7f413cff9700 1 -- 172.21.15.45:0/3465283924 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f41300ccca0 con 0x7f4140069090 2024-05-10T03:39:46.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.679+0000 7f413effd700 1 --2- 172.21.15.45:0/3465283924 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f41280a1260 0x7f41280a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:46.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.679+0000 7f413effd700 1 --2- 172.21.15.45:0/3465283924 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f41280a1260 0x7f41280a3770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f413400b2e0 tx=0x7f413401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:46.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.683+0000 7f413cff9700 1 -- 172.21.15.45:0/3465283924 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4130095fc0 con 0x7f4140069090 2024-05-10T03:39:46.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.899+0000 7f4145bac700 1 -- 172.21.15.45:0/3465283924 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f414010d500 con 0x7f4140069090 2024-05-10T03:39:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.899+0000 7f413cff9700 1 -- 172.21.15.45:0/3465283924 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) v1 ==== 103+0+11 (secure 0 0 0) 0x7f413001f0a0 con 0x7f4140069090 2024-05-10T03:39:46.902 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-05-10T03:39:46.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.901+0000 7f4145bac700 1 -- 172.21.15.45:0/3465283924 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f41280a1260 msgr2=0x7f41280a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:46.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.901+0000 7f4145bac700 1 --2- 172.21.15.45:0/3465283924 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f41280a1260 0x7f41280a3770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f413400b2e0 tx=0x7f413401a040 comp rx=0 tx=0).stop 2024-05-10T03:39:46.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.902+0000 7f4145bac700 1 -- 172.21.15.45:0/3465283924 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4140069090 msgr2=0x7f4140197fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:46.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.902+0000 7f4145bac700 1 --2- 172.21.15.45:0/3465283924 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4140069090 0x7f4140197fd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f413000d950 tx=0x7f413000dc60 comp rx=0 tx=0).stop 2024-05-10T03:39:46.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.902+0000 7f4145bac700 1 -- 172.21.15.45:0/3465283924 shutdown_connections 2024-05-10T03:39:46.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.902+0000 7f4145bac700 1 --2- 172.21.15.45:0/3465283924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4140107880 0x7f414019f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:46.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.902+0000 7f4145bac700 1 --2- 172.21.15.45:0/3465283924 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f41280a1260 0x7f41280a3770 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:46.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.902+0000 7f4145bac700 1 --2- 172.21.15.45:0/3465283924 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4140069090 0x7f4140197fd0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:46.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.902+0000 7f4145bac700 1 --2- 172.21.15.45:0/3465283924 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4140104d10 0x7f4140198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:46.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.902+0000 7f4145bac700 1 -- 172.21.15.45:0/3465283924 >> 172.21.15.45:0/3465283924 conn(0x7f41400fc0d0 msgr2=0x7f4140102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:46.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.902+0000 7f4145bac700 1 -- 172.21.15.45:0/3465283924 shutdown_connections 2024-05-10T03:39:46.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:46.902+0000 7f4145bac700 1 -- 172.21.15.45:0/3465283924 wait complete. 2024-05-10T03:39:46.919 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:39:47.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.066+0000 7fe0b6b89700 1 -- 172.21.15.45:0/4095616453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0b0102580 msgr2=0x7fe0b0108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:47.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.066+0000 7fe0b6b89700 1 --2- 172.21.15.45:0/4095616453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0b0102580 0x7fe0b0108e30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe0a800b0a0 tx=0x7fe0a800b3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.066+0000 7fe0b6b89700 1 -- 172.21.15.45:0/4095616453 shutdown_connections 2024-05-10T03:39:47.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.066+0000 7fe0b6b89700 1 --2- 172.21.15.45:0/4095616453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0b0100ac0 0x7fe0b0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.066+0000 7fe0b6b89700 1 --2- 172.21.15.45:0/4095616453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0b0102580 0x7fe0b0108e30 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.066+0000 7fe0b6b89700 1 --2- 172.21.15.45:0/4095616453 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0b0101be0 0x7fe0b0101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.066+0000 7fe0b6b89700 1 -- 172.21.15.45:0/4095616453 >> 172.21.15.45:0/4095616453 conn(0x7fe0b00fc0d0 msgr2=0x7fe0b00fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:47.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.066+0000 7fe0b6b89700 1 -- 172.21.15.45:0/4095616453 shutdown_connections 2024-05-10T03:39:47.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.066+0000 7fe0b6b89700 1 -- 172.21.15.45:0/4095616453 wait complete. 2024-05-10T03:39:47.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.067+0000 7fe0b6b89700 1 Processor -- start 2024-05-10T03:39:47.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.067+0000 7fe0b6b89700 1 -- start start 2024-05-10T03:39:47.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.067+0000 7fe0b6b89700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0b0100ac0 0x7fe0b0198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:47.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.067+0000 7fe0b6b89700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0b0101be0 0x7fe0b01986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:47.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.067+0000 7fe0b6b89700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0b0102580 0x7fe0b019f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:47.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.067+0000 7fe0b6b89700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b019fc60 con 0x7fe0b0100ac0 2024-05-10T03:39:47.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.067+0000 7fe0b6b89700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b019fdd0 con 0x7fe0b0102580 2024-05-10T03:39:47.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.067+0000 7fe0b6b89700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b019ff90 con 0x7fe0b0101be0 2024-05-10T03:39:47.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.067+0000 7fe0b4925700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0b0100ac0 0x7fe0b0198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:47.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.067+0000 7fe0b4925700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0b0100ac0 0x7fe0b0198180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40480/0 (socket says 172.21.15.45:40480) 2024-05-10T03:39:47.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.067+0000 7fe0b4925700 1 -- 172.21.15.45:0/573607712 learned_addr learned my addr 172.21.15.45:0/573607712 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:47.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.068+0000 7fe0affff700 1 --2- 172.21.15.45:0/573607712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0b0101be0 0x7fe0b01986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:47.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.068+0000 7fe0b5126700 1 --2- 172.21.15.45:0/573607712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0b0102580 0x7fe0b019f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:47.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.068+0000 7fe0b4925700 1 -- 172.21.15.45:0/573607712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0b0101be0 msgr2=0x7fe0b01986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:47.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.068+0000 7fe0b4925700 1 --2- 172.21.15.45:0/573607712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0b0101be0 0x7fe0b01986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.068+0000 7fe0b4925700 1 -- 172.21.15.45:0/573607712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0b0102580 msgr2=0x7fe0b019f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:47.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.068+0000 7fe0b4925700 1 --2- 172.21.15.45:0/573607712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0b0102580 0x7fe0b019f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.068+0000 7fe0b4925700 1 -- 172.21.15.45:0/573607712 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a8009d00 con 0x7fe0b0100ac0 2024-05-10T03:39:47.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.068+0000 7fe0b4925700 1 --2- 172.21.15.45:0/573607712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0b0100ac0 0x7fe0b0198180 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe0a400e940 tx=0x7fe0a400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:47.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.068+0000 7fe0adffb700 1 -- 172.21.15.45:0/573607712 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a400cbd0 con 0x7fe0b0100ac0 2024-05-10T03:39:47.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.068+0000 7fe0adffb700 1 -- 172.21.15.45:0/573607712 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe0a400ee90 con 0x7fe0b0100ac0 2024-05-10T03:39:47.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.068+0000 7fe0b6b89700 1 -- 172.21.15.45:0/573607712 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b01a0270 con 0x7fe0b0100ac0 2024-05-10T03:39:47.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.068+0000 7fe0adffb700 1 -- 172.21.15.45:0/573607712 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a4003e30 con 0x7fe0b0100ac0 2024-05-10T03:39:47.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.069+0000 7fe0b6b89700 1 -- 172.21.15.45:0/573607712 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b01a0780 con 0x7fe0b0100ac0 2024-05-10T03:39:47.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.070+0000 7fe0b6b89700 1 -- 172.21.15.45:0/573607712 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b00694d0 con 0x7fe0b0100ac0 2024-05-10T03:39:47.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.071+0000 7fe0adffb700 1 -- 172.21.15.45:0/573607712 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fe0a4003f90 con 0x7fe0b0100ac0 2024-05-10T03:39:47.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.072+0000 7fe0adffb700 1 --2- 172.21.15.45:0/573607712 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe0a00a11b0 0x7fe0a00a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:47.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.072+0000 7fe0affff700 1 --2- 172.21.15.45:0/573607712 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe0a00a11b0 0x7fe0a00a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:47.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.072+0000 7fe0adffb700 1 -- 172.21.15.45:0/573607712 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fe0a4014070 con 0x7fe0b0100ac0 2024-05-10T03:39:47.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.072+0000 7fe0affff700 1 --2- 172.21.15.45:0/573607712 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe0a00a11b0 0x7fe0a00a36c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0199220 tx=0x7fe09c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:47.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.077+0000 7fe0adffb700 1 -- 172.21.15.45:0/573607712 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe0a40963c0 con 0x7fe0b0100ac0 2024-05-10T03:39:47.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:46 smithi154 ceph-mon[46565]: pgmap v268: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T03:39:47.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:46 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/25359614' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:39:47.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:46 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1575579291' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:39:47.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:46 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3465283924' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:39:47.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:46 smithi045 ceph-mon[42520]: pgmap v268: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T03:39:47.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:46 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/25359614' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:39:47.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:46 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1575579291' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:39:47.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:46 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3465283924' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:39:47.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.346+0000 7fe0b6b89700 1 -- 172.21.15.45:0/573607712 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0b010c410 con 0x7fe0b0100ac0 2024-05-10T03:39:47.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.347+0000 7fe0adffb700 1 -- 172.21.15.45:0/573607712 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10926 (secure 0 0 0) 0x7fe0a40999e0 con 0x7fe0b0100ac0 2024-05-10T03:39:47.349 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:39:47.349 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/378320264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":378320264},{"type":"v1","addr":"172.21.15.45:6835","nonce":378320264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3032381796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3032381796},{"type":"v1","addr":"172.21.15.45:6837","nonce":3032381796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T03:38:36.555290+0000","modified":"2024-05-10T03:39:00.010786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24548,"mds_2":24547,"mds_3":24526,"mds_4":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14625":{"gid":14625,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6839/4007419304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":4007419304},{"type":"v1","addr":"172.21.15.45:6839","nonce":4007419304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14637":{"gid":14637,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6841/1355456195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1355456195},{"type":"v1","addr":"172.21.15.45:6841","nonce":1355456195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/4037121210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":4037121210},{"type":"v1","addr":"172.21.15.154:6835","nonce":4037121210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24521":{"gid":24521,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.106:6835/4162885659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4162885659},{"type":"v1","addr":"172.21.15.106:6835","nonce":4162885659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.154:6837/608167481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":608167481},{"type":"v1","addr":"172.21.15.154:6837","nonce":608167481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/1506563336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1506563336},{"type":"v1","addr":"172.21.15.154:6839","nonce":1506563336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.106:6837/3047487403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":3047487403},{"type":"v1","addr":"172.21.15.106:6837","nonce":3047487403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6839/3533867856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":3533867856},{"type":"v1","addr":"172.21.15.106:6839","nonce":3533867856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T03:39:47.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.349+0000 7fe0b6b89700 1 -- 172.21.15.45:0/573607712 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe0a00a11b0 msgr2=0x7fe0a00a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:47.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.349+0000 7fe0b6b89700 1 --2- 172.21.15.45:0/573607712 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe0a00a11b0 0x7fe0a00a36c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0199220 tx=0x7fe09c009260 comp rx=0 tx=0).stop 2024-05-10T03:39:47.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.349+0000 7fe0b6b89700 1 -- 172.21.15.45:0/573607712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0b0100ac0 msgr2=0x7fe0b0198180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:47.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.349+0000 7fe0b6b89700 1 --2- 172.21.15.45:0/573607712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0b0100ac0 0x7fe0b0198180 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe0a400e940 tx=0x7fe0a400ec50 comp rx=0 tx=0).stop 2024-05-10T03:39:47.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.350+0000 7fe0b6b89700 1 -- 172.21.15.45:0/573607712 shutdown_connections 2024-05-10T03:39:47.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.350+0000 7fe0b6b89700 1 --2- 172.21.15.45:0/573607712 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe0a00a11b0 0x7fe0a00a36c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.350+0000 7fe0b6b89700 1 --2- 172.21.15.45:0/573607712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0b0102580 0x7fe0b019f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.350+0000 7fe0b6b89700 1 --2- 172.21.15.45:0/573607712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0b0100ac0 0x7fe0b0198180 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.350+0000 7fe0b6b89700 1 --2- 172.21.15.45:0/573607712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0b0101be0 0x7fe0b01986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.350+0000 7fe0b6b89700 1 -- 172.21.15.45:0/573607712 >> 172.21.15.45:0/573607712 conn(0x7fe0b00fc0d0 msgr2=0x7fe0b00fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:47.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.350+0000 7fe0b6b89700 1 -- 172.21.15.45:0/573607712 shutdown_connections 2024-05-10T03:39:47.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.350+0000 7fe0b6b89700 1 -- 172.21.15.45:0/573607712 wait complete. 2024-05-10T03:39:47.354 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 27 2024-05-10T03:39:47.367 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:39:47.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:46 smithi106 ceph-mon[46996]: pgmap v268: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T03:39:47.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:46 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/25359614' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:39:47.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:46 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1575579291' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:39:47.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:46 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3465283924' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:39:47.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.513+0000 7f193c25e700 1 -- 172.21.15.45:0/3998983130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19341036c0 msgr2=0x7f1934109f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:47.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.513+0000 7f193c25e700 1 --2- 172.21.15.45:0/3998983130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19341036c0 0x7f1934109f70 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f192c00b0a0 tx=0x7f192c00b3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.513+0000 7f193c25e700 1 -- 172.21.15.45:0/3998983130 shutdown_connections 2024-05-10T03:39:47.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.513+0000 7f193c25e700 1 --2- 172.21.15.45:0/3998983130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19341036c0 0x7f1934109f70 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.513+0000 7f193c25e700 1 --2- 172.21.15.45:0/3998983130 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1934101c00 0x7f1934102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.513+0000 7f193c25e700 1 --2- 172.21.15.45:0/3998983130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1934102d20 0x7f1934103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.513+0000 7f193c25e700 1 -- 172.21.15.45:0/3998983130 >> 172.21.15.45:0/3998983130 conn(0x7f19340fd210 msgr2=0x7f19340ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:47.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.513+0000 7f193c25e700 1 -- 172.21.15.45:0/3998983130 shutdown_connections 2024-05-10T03:39:47.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.513+0000 7f193c25e700 1 -- 172.21.15.45:0/3998983130 wait complete. 2024-05-10T03:39:47.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.514+0000 7f193c25e700 1 Processor -- start 2024-05-10T03:39:47.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.514+0000 7f193c25e700 1 -- start start 2024-05-10T03:39:47.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.514+0000 7f193c25e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1934101c00 0x7f1934074ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:47.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.514+0000 7f193c25e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1934102d20 0x7f1934073560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:47.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.514+0000 7f193c25e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19341036c0 0x7f1934073aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:47.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.514+0000 7f193c25e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1934074180 con 0x7f19341036c0 2024-05-10T03:39:47.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.514+0000 7f193c25e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19340742f0 con 0x7f1934102d20 2024-05-10T03:39:47.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.514+0000 7f193c25e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19341a2210 con 0x7f1934101c00 2024-05-10T03:39:47.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.514+0000 7f193a7fb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19341036c0 0x7f1934073aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:47.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.514+0000 7f193a7fb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19341036c0 0x7f1934073aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43564/0 (socket says 172.21.15.45:43564) 2024-05-10T03:39:47.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.515+0000 7f193a7fb700 1 -- 172.21.15.45:0/658133504 learned_addr learned my addr 172.21.15.45:0/658133504 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:47.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.515+0000 7f19397f9700 1 --2- 172.21.15.45:0/658133504 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1934102d20 0x7f1934073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:47.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.515+0000 7f1939ffa700 1 --2- 172.21.15.45:0/658133504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1934101c00 0x7f1934074ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:47.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.515+0000 7f193a7fb700 1 -- 172.21.15.45:0/658133504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1934101c00 msgr2=0x7f1934074ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:47.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.515+0000 7f193a7fb700 1 --2- 172.21.15.45:0/658133504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1934101c00 0x7f1934074ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.515+0000 7f193a7fb700 1 -- 172.21.15.45:0/658133504 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1934102d20 msgr2=0x7f1934073560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:47.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.515+0000 7f193a7fb700 1 --2- 172.21.15.45:0/658133504 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1934102d20 0x7f1934073560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.515+0000 7f193a7fb700 1 -- 172.21.15.45:0/658133504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192c009d00 con 0x7f19341036c0 2024-05-10T03:39:47.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.515+0000 7f193a7fb700 1 --2- 172.21.15.45:0/658133504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19341036c0 0x7f1934073aa0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f192c00b830 tx=0x7f192c0093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:47.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.515+0000 7f192affd700 1 -- 172.21.15.45:0/658133504 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c00e040 con 0x7f19341036c0 2024-05-10T03:39:47.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.515+0000 7f192affd700 1 -- 172.21.15.45:0/658133504 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f192c003e10 con 0x7f19341036c0 2024-05-10T03:39:47.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.515+0000 7f193c25e700 1 -- 172.21.15.45:0/658133504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19341a2410 con 0x7f19341036c0 2024-05-10T03:39:47.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.515+0000 7f192affd700 1 -- 172.21.15.45:0/658133504 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c005540 con 0x7f19341036c0 2024-05-10T03:39:47.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.515+0000 7f193c25e700 1 -- 172.21.15.45:0/658133504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19341a2830 con 0x7f19341036c0 2024-05-10T03:39:47.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.517+0000 7f193c25e700 1 -- 172.21.15.45:0/658133504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1934108e10 con 0x7f19341036c0 2024-05-10T03:39:47.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.518+0000 7f192affd700 1 -- 172.21.15.45:0/658133504 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f192c01db80 con 0x7f19341036c0 2024-05-10T03:39:47.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.518+0000 7f192affd700 1 --2- 172.21.15.45:0/658133504 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f19200a11b0 0x7f19200a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:47.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.519+0000 7f1939ffa700 1 --2- 172.21.15.45:0/658133504 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f19200a11b0 0x7f19200a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:47.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.519+0000 7f192affd700 1 -- 172.21.15.45:0/658133504 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f192c0ce120 con 0x7f19341036c0 2024-05-10T03:39:47.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.519+0000 7f1939ffa700 1 --2- 172.21.15.45:0/658133504 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f19200a11b0 0x7f19200a36c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1934102c20 tx=0x7f193000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:47.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.523+0000 7f192affd700 1 -- 172.21.15.45:0/658133504 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f192c0974d0 con 0x7f19341036c0 2024-05-10T03:39:47.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.741+0000 7f193c25e700 1 -- 172.21.15.45:0/658133504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f193410d660 con 0x7f19341036c0 2024-05-10T03:39:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.743+0000 7f192affd700 1 -- 172.21.15.45:0/658133504 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+24508 (secure 0 0 0) 0x7f192c09aaf0 con 0x7f19341036c0 2024-05-10T03:39:47.746 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:39:47.746 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":88,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:39:27.064512+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:38:34.871801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:38:35.935386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T03:38:39.029903+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:39:47.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.745+0000 7f193c25e700 1 -- 172.21.15.45:0/658133504 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f19200a11b0 msgr2=0x7f19200a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:47.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.745+0000 7f193c25e700 1 --2- 172.21.15.45:0/658133504 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f19200a11b0 0x7f19200a36c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1934102c20 tx=0x7f193000b410 comp rx=0 tx=0).stop 2024-05-10T03:39:47.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.745+0000 7f193c25e700 1 -- 172.21.15.45:0/658133504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19341036c0 msgr2=0x7f1934073aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:47.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.745+0000 7f193c25e700 1 --2- 172.21.15.45:0/658133504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19341036c0 0x7f1934073aa0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f192c00b830 tx=0x7f192c0093b0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.745+0000 7f193c25e700 1 -- 172.21.15.45:0/658133504 shutdown_connections 2024-05-10T03:39:47.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.745+0000 7f193c25e700 1 --2- 172.21.15.45:0/658133504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1934101c00 0x7f1934074ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.745+0000 7f193c25e700 1 --2- 172.21.15.45:0/658133504 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f19200a11b0 0x7f19200a36c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.745+0000 7f193c25e700 1 --2- 172.21.15.45:0/658133504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19341036c0 0x7f1934073aa0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.745+0000 7f193c25e700 1 --2- 172.21.15.45:0/658133504 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1934102d20 0x7f1934073560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.745+0000 7f193c25e700 1 -- 172.21.15.45:0/658133504 >> 172.21.15.45:0/658133504 conn(0x7f19340fd210 msgr2=0x7f1934105f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:47.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.745+0000 7f193c25e700 1 -- 172.21.15.45:0/658133504 shutdown_connections 2024-05-10T03:39:47.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.746+0000 7f193c25e700 1 -- 172.21.15.45:0/658133504 wait complete. 2024-05-10T03:39:47.763 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:39:47.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.911+0000 7fb7d1283700 1 -- 172.21.15.45:0/3848479268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7cc1031a0 msgr2=0x7fb7cc1035b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:47.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.911+0000 7fb7d1283700 1 --2- 172.21.15.45:0/3848479268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7cc1031a0 0x7fb7cc1035b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc009990 tx=0x7fb7bc009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.911+0000 7fb7d1283700 1 -- 172.21.15.45:0/3848479268 shutdown_connections 2024-05-10T03:39:47.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.911+0000 7fb7d1283700 1 --2- 172.21.15.45:0/3848479268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7cc100530 0x7fb7cc10a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.911+0000 7fb7d1283700 1 --2- 172.21.15.45:0/3848479268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7cc1031a0 0x7fb7cc1035b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.911+0000 7fb7d1283700 1 --2- 172.21.15.45:0/3848479268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7cc0ffbe0 0x7fb7cc0ffff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.911+0000 7fb7d1283700 1 -- 172.21.15.45:0/3848479268 >> 172.21.15.45:0/3848479268 conn(0x7fb7cc0fb8b0 msgr2=0x7fb7cc0fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:47.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.911+0000 7fb7d1283700 1 -- 172.21.15.45:0/3848479268 shutdown_connections 2024-05-10T03:39:47.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.911+0000 7fb7d1283700 1 -- 172.21.15.45:0/3848479268 wait complete. 2024-05-10T03:39:47.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.912+0000 7fb7d1283700 1 Processor -- start 2024-05-10T03:39:47.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.912+0000 7fb7d1283700 1 -- start start 2024-05-10T03:39:47.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.912+0000 7fb7d1283700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7cc0ffbe0 0x7fb7cc102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:47.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.912+0000 7fb7d1283700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7cc100530 0x7fb7cc100e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:47.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.912+0000 7fb7d1283700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7cc1031a0 0x7fb7cc101350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:47.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.912+0000 7fb7d1283700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc1019b0 con 0x7fb7cc100530 2024-05-10T03:39:47.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.912+0000 7fb7d1283700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc101b20 con 0x7fb7cc0ffbe0 2024-05-10T03:39:47.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.912+0000 7fb7d1283700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc101ce0 con 0x7fb7cc1031a0 2024-05-10T03:39:47.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.912+0000 7fb7ca7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7cc100530 0x7fb7cc100e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:47.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.912+0000 7fb7ca7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7cc100530 0x7fb7cc100e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43584/0 (socket says 172.21.15.45:43584) 2024-05-10T03:39:47.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.912+0000 7fb7ca7fc700 1 -- 172.21.15.45:0/2557184366 learned_addr learned my addr 172.21.15.45:0/2557184366 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:47.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.912+0000 7fb7caffd700 1 --2- 172.21.15.45:0/2557184366 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7cc0ffbe0 0x7fb7cc102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:47.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.912+0000 7fb7cb7fe700 1 --2- 172.21.15.45:0/2557184366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7cc1031a0 0x7fb7cc101350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:47.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.913+0000 7fb7ca7fc700 1 -- 172.21.15.45:0/2557184366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7cc1031a0 msgr2=0x7fb7cc101350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:47.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.913+0000 7fb7ca7fc700 1 --2- 172.21.15.45:0/2557184366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7cc1031a0 0x7fb7cc101350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.913+0000 7fb7ca7fc700 1 -- 172.21.15.45:0/2557184366 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7cc0ffbe0 msgr2=0x7fb7cc102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:47.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.913+0000 7fb7ca7fc700 1 --2- 172.21.15.45:0/2557184366 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7cc0ffbe0 0x7fb7cc102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:47.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.913+0000 7fb7ca7fc700 1 -- 172.21.15.45:0/2557184366 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc0095f0 con 0x7fb7cc100530 2024-05-10T03:39:47.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.913+0000 7fb7ca7fc700 1 --2- 172.21.15.45:0/2557184366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7cc100530 0x7fb7cc100e10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000d950 tx=0x7fb7c000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:47.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.913+0000 7fb7b3fff700 1 -- 172.21.15.45:0/2557184366 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c0009940 con 0x7fb7cc100530 2024-05-10T03:39:47.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.913+0000 7fb7b3fff700 1 -- 172.21.15.45:0/2557184366 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb7c0010460 con 0x7fb7cc100530 2024-05-10T03:39:47.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.913+0000 7fb7d1283700 1 -- 172.21.15.45:0/2557184366 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7cc1a22e0 con 0x7fb7cc100530 2024-05-10T03:39:47.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.913+0000 7fb7b3fff700 1 -- 172.21.15.45:0/2557184366 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c000f620 con 0x7fb7cc100530 2024-05-10T03:39:47.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.913+0000 7fb7d1283700 1 -- 172.21.15.45:0/2557184366 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7cc1a27f0 con 0x7fb7cc100530 2024-05-10T03:39:47.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.914+0000 7fb7d1283700 1 -- 172.21.15.45:0/2557184366 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7cc108ff0 con 0x7fb7cc100530 2024-05-10T03:39:47.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.915+0000 7fb7b3fff700 1 -- 172.21.15.45:0/2557184366 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb7c0010960 con 0x7fb7cc100530 2024-05-10T03:39:47.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.916+0000 7fb7b3fff700 1 --2- 172.21.15.45:0/2557184366 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb7b40a11b0 0x7fb7b40a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:47.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.916+0000 7fb7caffd700 1 --2- 172.21.15.45:0/2557184366 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb7b40a11b0 0x7fb7b40a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:47.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.916+0000 7fb7b3fff700 1 -- 172.21.15.45:0/2557184366 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb7c00ccc30 con 0x7fb7cc100530 2024-05-10T03:39:47.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.917+0000 7fb7caffd700 1 --2- 172.21.15.45:0/2557184366 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb7b40a11b0 0x7fb7b40a36c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc006010 tx=0x7fb7bc011040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:47.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:47.920+0000 7fb7b3fff700 1 -- 172.21.15.45:0/2557184366 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb7c0095f50 con 0x7fb7cc100530 2024-05-10T03:39:48.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:47 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/573607712' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:39:48.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:47 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/658133504' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:39:48.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.193+0000 7fb7d1283700 1 -- 172.21.15.45:0/2557184366 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7cc068730 con 0x7fb7cc100530 2024-05-10T03:39:48.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.194+0000 7fb7b3fff700 1 -- 172.21.15.45:0/2557184366 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10926 (secure 0 0 0) 0x7fb7c0016090 con 0x7fb7cc100530 2024-05-10T03:39:48.197 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:39:48.197 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/378320264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":378320264},{"type":"v1","addr":"172.21.15.45:6835","nonce":378320264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3032381796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3032381796},{"type":"v1","addr":"172.21.15.45:6837","nonce":3032381796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T03:38:36.555290+0000","modified":"2024-05-10T03:39:00.010786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24548,"mds_2":24547,"mds_3":24526,"mds_4":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14625":{"gid":14625,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6839/4007419304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":4007419304},{"type":"v1","addr":"172.21.15.45:6839","nonce":4007419304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14637":{"gid":14637,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6841/1355456195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1355456195},{"type":"v1","addr":"172.21.15.45:6841","nonce":1355456195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/4037121210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":4037121210},{"type":"v1","addr":"172.21.15.154:6835","nonce":4037121210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24521":{"gid":24521,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.106:6835/4162885659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4162885659},{"type":"v1","addr":"172.21.15.106:6835","nonce":4162885659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.154:6837/608167481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":608167481},{"type":"v1","addr":"172.21.15.154:6837","nonce":608167481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/1506563336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1506563336},{"type":"v1","addr":"172.21.15.154:6839","nonce":1506563336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.106:6837/3047487403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":3047487403},{"type":"v1","addr":"172.21.15.106:6837","nonce":3047487403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6839/3533867856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":3533867856},{"type":"v1","addr":"172.21.15.106:6839","nonce":3533867856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T03:39:48.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.196+0000 7fb7d1283700 1 -- 172.21.15.45:0/2557184366 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb7b40a11b0 msgr2=0x7fb7b40a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.196+0000 7fb7d1283700 1 --2- 172.21.15.45:0/2557184366 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb7b40a11b0 0x7fb7b40a36c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc006010 tx=0x7fb7bc011040 comp rx=0 tx=0).stop 2024-05-10T03:39:48.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.196+0000 7fb7d1283700 1 -- 172.21.15.45:0/2557184366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7cc100530 msgr2=0x7fb7cc100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.196+0000 7fb7d1283700 1 --2- 172.21.15.45:0/2557184366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7cc100530 0x7fb7cc100e10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000d950 tx=0x7fb7c000dc60 comp rx=0 tx=0).stop 2024-05-10T03:39:48.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.196+0000 7fb7d1283700 1 -- 172.21.15.45:0/2557184366 shutdown_connections 2024-05-10T03:39:48.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.196+0000 7fb7d1283700 1 --2- 172.21.15.45:0/2557184366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7cc1031a0 0x7fb7cc101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.196+0000 7fb7d1283700 1 --2- 172.21.15.45:0/2557184366 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb7b40a11b0 0x7fb7b40a36c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.196+0000 7fb7d1283700 1 --2- 172.21.15.45:0/2557184366 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7cc0ffbe0 0x7fb7cc102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.196+0000 7fb7d1283700 1 --2- 172.21.15.45:0/2557184366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7cc100530 0x7fb7cc100e10 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.196+0000 7fb7d1283700 1 -- 172.21.15.45:0/2557184366 >> 172.21.15.45:0/2557184366 conn(0x7fb7cc0fb8b0 msgr2=0x7fb7cc106130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:48.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.197+0000 7fb7d1283700 1 -- 172.21.15.45:0/2557184366 shutdown_connections 2024-05-10T03:39:48.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.197+0000 7fb7d1283700 1 -- 172.21.15.45:0/2557184366 wait complete. 2024-05-10T03:39:48.200 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 27 2024-05-10T03:39:48.215 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-10T03:38:36.555290+0000', 'modified': '2024-05-10T03:39:00.010786+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24590, 'mds_1': 24548, 'mds_2': 24547, 'mds_3': 24526, 'mds_4': 24521}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14625': {'gid': 14625, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.45:6839/4007419304', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6838', 'nonce': 4007419304}, {'type': 'v1', 'addr': '172.21.15.45:6839', 'nonce': 4007419304}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_14637': {'gid': 14637, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.45:6841/1355456195', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6840', 'nonce': 1355456195}, {'type': 'v1', 'addr': '172.21.15.45:6841', 'nonce': 1355456195}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24475': {'gid': 24475, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6833/4274344062', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6832', 'nonce': 4274344062}, {'type': 'v1', 'addr': '172.21.15.154:6833', 'nonce': 4274344062}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24491': {'gid': 24491, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.106:6833/3404247109', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6832', 'nonce': 3404247109}, {'type': 'v1', 'addr': '172.21.15.106:6833', 'nonce': 3404247109}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24514': {'gid': 24514, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6835/4037121210', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 4037121210}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 4037121210}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24521': {'gid': 24521, 'name': 'e', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.106:6835/4162885659', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6834', 'nonce': 4162885659}, {'type': 'v1', 'addr': '172.21.15.106:6835', 'nonce': 4162885659}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24526': {'gid': 24526, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.154:6837/608167481', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6836', 'nonce': 608167481}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 608167481}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24547': {'gid': 24547, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.154:6839/1506563336', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6838', 'nonce': 1506563336}, {'type': 'v1', 'addr': '172.21.15.154:6839', 'nonce': 1506563336}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24548': {'gid': 24548, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.106:6837/3047487403', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6836', 'nonce': 3047487403}, {'type': 'v1', 'addr': '172.21.15.106:6837', 'nonce': 3047487403}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24590': {'gid': 24590, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.106:6839/3533867856', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6838', 'nonce': 3533867856}, {'type': 'v1', 'addr': '172.21.15.106:6839', 'nonce': 3533867856}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-10T03:39:48.215 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-10T03:39:48.215 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-05-10T03:39:48.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:47 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/573607712' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:39:48.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:47 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/658133504' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:39:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.370+0000 7fc61b31d700 1 -- 172.21.15.45:0/1679508852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc614101750 msgr2=0x7fc614101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.370+0000 7fc61b31d700 1 --2- 172.21.15.45:0/1679508852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc614101750 0x7fc614101b60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc60c00b0a0 tx=0x7fc60c00b3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.370+0000 7fc61b31d700 1 -- 172.21.15.45:0/1679508852 shutdown_connections 2024-05-10T03:39:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.370+0000 7fc61b31d700 1 --2- 172.21.15.45:0/1679508852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6141004b0 0x7fc6141008c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.370+0000 7fc61b31d700 1 --2- 172.21.15.45:0/1679508852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc614101750 0x7fc614101b60 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.370+0000 7fc61b31d700 1 --2- 172.21.15.45:0/1679508852 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc614100e00 0x7fc614101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.370+0000 7fc61b31d700 1 -- 172.21.15.45:0/1679508852 >> 172.21.15.45:0/1679508852 conn(0x7fc6140fc0c0 msgr2=0x7fc6140fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.370+0000 7fc61b31d700 1 -- 172.21.15.45:0/1679508852 shutdown_connections 2024-05-10T03:39:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.370+0000 7fc61b31d700 1 -- 172.21.15.45:0/1679508852 wait complete. 2024-05-10T03:39:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.371+0000 7fc61b31d700 1 Processor -- start 2024-05-10T03:39:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.371+0000 7fc61b31d700 1 -- start start 2024-05-10T03:39:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.371+0000 7fc61b31d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6141004b0 0x7fc61419a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.371+0000 7fc61b31d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc614100e00 0x7fc61419a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.371+0000 7fc61b31d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc614101750 0x7fc6141a17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.371+0000 7fc61b31d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6141a1db0 con 0x7fc614101750 2024-05-10T03:39:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.371+0000 7fc61b31d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6141a1f20 con 0x7fc614100e00 2024-05-10T03:39:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.371+0000 7fc61b31d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6141a20e0 con 0x7fc6141004b0 2024-05-10T03:39:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.371+0000 7fc6198ba700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc614101750 0x7fc6141a17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.371+0000 7fc6198ba700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc614101750 0x7fc6141a17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43596/0 (socket says 172.21.15.45:43596) 2024-05-10T03:39:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.371+0000 7fc6198ba700 1 -- 172.21.15.45:0/1050688706 learned_addr learned my addr 172.21.15.45:0/1050688706 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.371+0000 7fc6190b9700 1 --2- 172.21.15.45:0/1050688706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6141004b0 0x7fc61419a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.371+0000 7fc6188b8700 1 --2- 172.21.15.45:0/1050688706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc614100e00 0x7fc61419a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.372+0000 7fc6198ba700 1 -- 172.21.15.45:0/1050688706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6141004b0 msgr2=0x7fc61419a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.372+0000 7fc6198ba700 1 --2- 172.21.15.45:0/1050688706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6141004b0 0x7fc61419a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.372+0000 7fc6198ba700 1 -- 172.21.15.45:0/1050688706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc614100e00 msgr2=0x7fc61419a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.372+0000 7fc6198ba700 1 --2- 172.21.15.45:0/1050688706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc614100e00 0x7fc61419a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.372+0000 7fc6198ba700 1 -- 172.21.15.45:0/1050688706 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60c009d00 con 0x7fc614101750 2024-05-10T03:39:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.372+0000 7fc6198ba700 1 --2- 172.21.15.45:0/1050688706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc614101750 0x7fc6141a17a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc60c00b070 tx=0x7fc60c0094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.372+0000 7fc60a7fc700 1 -- 172.21.15.45:0/1050688706 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c00e040 con 0x7fc614101750 2024-05-10T03:39:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.372+0000 7fc60a7fc700 1 -- 172.21.15.45:0/1050688706 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc60c01d960 con 0x7fc614101750 2024-05-10T03:39:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.372+0000 7fc61b31d700 1 -- 172.21.15.45:0/1050688706 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6141a2360 con 0x7fc614101750 2024-05-10T03:39:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.372+0000 7fc60a7fc700 1 -- 172.21.15.45:0/1050688706 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c01b9d0 con 0x7fc614101750 2024-05-10T03:39:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.372+0000 7fc61b31d700 1 -- 172.21.15.45:0/1050688706 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6141a2830 con 0x7fc614101750 2024-05-10T03:39:48.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.375+0000 7fc60a7fc700 1 -- 172.21.15.45:0/1050688706 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fc60c01dad0 con 0x7fc614101750 2024-05-10T03:39:48.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.375+0000 7fc60a7fc700 1 --2- 172.21.15.45:0/1050688706 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc6000a12e0 0x7fc6000a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.375+0000 7fc6190b9700 1 --2- 172.21.15.45:0/1050688706 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc6000a12e0 0x7fc6000a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.375+0000 7fc60a7fc700 1 -- 172.21.15.45:0/1050688706 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc60c0ce550 con 0x7fc614101750 2024-05-10T03:39:48.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.376+0000 7fc6190b9700 1 --2- 172.21.15.45:0/1050688706 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc6000a12e0 0x7fc6000a37f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc61406a220 tx=0x7fc6100073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:48.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.376+0000 7fc62b661b80 1 Processor -- start 2024-05-10T03:39:48.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.376+0000 7fc62b661b80 1 -- start start 2024-05-10T03:39:48.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.377+0000 7fc62b661b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fe4c4a650 0x558fe4c4aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.377+0000 7fc62b661b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4b520 0x558fe4c4b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.377+0000 7fc62b661b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fe4c4be70 0x558fe4c52770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.377+0000 7fc62b661b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fe4b71100 con 0x558fe4c4b520 2024-05-10T03:39:48.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.377+0000 7fc62b661b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fe4b6eac0 con 0x558fe4c4be70 2024-05-10T03:39:48.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.377+0000 7fc62b661b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fe4b6a3b0 con 0x558fe4c4a650 2024-05-10T03:39:48.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.377+0000 7fc6188b8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4b520 0x558fe4c4b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.377+0000 7fc6188b8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4b520 0x558fe4c4b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43612/0 (socket says 172.21.15.45:43612) 2024-05-10T03:39:48.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.377+0000 7fc6188b8700 1 -- 172.21.15.45:0/2189387569 learned_addr learned my addr 172.21.15.45:0/2189387569 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:48.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.377+0000 7fc6190b9700 1 --2- 172.21.15.45:0/2189387569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fe4c4a650 0x558fe4c4aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.377+0000 7fc6198ba700 1 --2- 172.21.15.45:0/2189387569 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fe4c4be70 0x558fe4c52770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.377+0000 7fc6188b8700 1 -- 172.21.15.45:0/2189387569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fe4c4a650 msgr2=0x558fe4c4aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.377+0000 7fc6188b8700 1 --2- 172.21.15.45:0/2189387569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fe4c4a650 0x558fe4c4aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.377+0000 7fc6188b8700 1 -- 172.21.15.45:0/2189387569 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fe4c4be70 msgr2=0x558fe4c52770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.377+0000 7fc6188b8700 1 --2- 172.21.15.45:0/2189387569 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fe4c4be70 0x558fe4c52770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.377+0000 7fc6188b8700 1 -- 172.21.15.45:0/2189387569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fe49eb360 con 0x558fe4c4b520 2024-05-10T03:39:48.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.377+0000 7fc6188b8700 1 --2- 172.21.15.45:0/2189387569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4b520 0x558fe4c4b930 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc60400dc80 tx=0x7fc60400df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6abc7f394f98a734 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:48.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.378+0000 7fc5ff7fe700 1 -- 172.21.15.45:0/2189387569 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60400fab0 con 0x558fe4c4b520 2024-05-10T03:39:48.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.378+0000 7fc5ff7fe700 1 -- 172.21.15.45:0/2189387569 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc60400fc10 con 0x558fe4c4b520 2024-05-10T03:39:48.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.378+0000 7fc5ff7fe700 1 -- 172.21.15.45:0/2189387569 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60401b670 con 0x558fe4c4b520 2024-05-10T03:39:48.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.378+0000 7fc62b661b80 1 -- 172.21.15.45:0/2189387569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4b520 msgr2=0x558fe4c4b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.378+0000 7fc62b661b80 1 --2- 172.21.15.45:0/2189387569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4b520 0x558fe4c4b930 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc60400dc80 tx=0x7fc60400df90 comp rx=0 tx=0).stop 2024-05-10T03:39:48.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.379+0000 7fc62b661b80 1 -- 172.21.15.45:0/2189387569 shutdown_connections 2024-05-10T03:39:48.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.379+0000 7fc62b661b80 1 --2- 172.21.15.45:0/2189387569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fe4c4a650 0x558fe4c4aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.379+0000 7fc62b661b80 1 --2- 172.21.15.45:0/2189387569 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fe4c4be70 0x558fe4c52770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.379+0000 7fc62b661b80 1 --2- 172.21.15.45:0/2189387569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4b520 0x558fe4c4b930 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.379+0000 7fc62b661b80 1 -- 172.21.15.45:0/2189387569 >> 172.21.15.45:0/2189387569 conn(0x558fe4baca10 msgr2=0x558fe4c44f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:48.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.379+0000 7fc62b661b80 1 -- 172.21.15.45:0/2189387569 shutdown_connections 2024-05-10T03:39:48.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.379+0000 7fc62b661b80 1 -- 172.21.15.45:0/2189387569 wait complete. 2024-05-10T03:39:48.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.379+0000 7fc62b661b80 1 -- start start 2024-05-10T03:39:48.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.379+0000 7fc62b661b80 1 Processor -- start 2024-05-10T03:39:48.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.380+0000 7fc62b661b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fe4c4a650 0x558fe4c546c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.380+0000 7fc62b661b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4b520 0x558fe4c54c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.380+0000 7fc62b661b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fe4c4be70 0x558fe4c5bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.380+0000 7fc62b661b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fe4b06510 con 0x558fe4c4b520 2024-05-10T03:39:48.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.380+0000 7fc62b661b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fe4b061b0 con 0x558fe4c4a650 2024-05-10T03:39:48.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.380+0000 7fc62b661b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fe49ed650 con 0x558fe4c4be70 2024-05-10T03:39:48.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.380+0000 7fc62b661b80 10 client.0 _ll_register_callbacks cb 0x558fe4b0fae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:39:48.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.380+0000 7fc6188b8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4b520 0x558fe4c54c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.380+0000 7fc6188b8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4b520 0x558fe4c54c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43626/0 (socket says 172.21.15.45:43626) 2024-05-10T03:39:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.380+0000 7fc6188b8700 1 -- 172.21.15.45:0/4188481332 learned_addr learned my addr 172.21.15.45:0/4188481332 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.380+0000 7fc6198ba700 1 --2- 172.21.15.45:0/4188481332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fe4c4be70 0x558fe4c5bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.380+0000 7fc6190b9700 1 --2- 172.21.15.45:0/4188481332 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fe4c4a650 0x558fe4c546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.380+0000 7fc6188b8700 1 -- 172.21.15.45:0/4188481332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fe4c4be70 msgr2=0x558fe4c5bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.380+0000 7fc6188b8700 1 --2- 172.21.15.45:0/4188481332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fe4c4be70 0x558fe4c5bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.380+0000 7fc6188b8700 1 -- 172.21.15.45:0/4188481332 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fe4c4a650 msgr2=0x558fe4c546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.380+0000 7fc6188b8700 1 --2- 172.21.15.45:0/4188481332 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fe4c4a650 0x558fe4c546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.380+0000 7fc6188b8700 1 -- 172.21.15.45:0/4188481332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc60400d8e0 con 0x558fe4c4b520 2024-05-10T03:39:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.380+0000 7fc6188b8700 1 --2- 172.21.15.45:0/4188481332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4b520 0x558fe4c54c00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc604005810 tx=0x7fc60400ffb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c600493161a94f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.380+0000 7fc5fcff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:39:48.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.381+0000 7fc5fcff9700 1 -- 172.21.15.45:0/4188481332 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc604020070 con 0x558fe4c4b520 2024-05-10T03:39:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.381+0000 7fc5fcff9700 1 -- 172.21.15.45:0/4188481332 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc604011650 con 0x558fe4c4b520 2024-05-10T03:39:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.381+0000 7fc62b661b80 1 -- 172.21.15.45:0/4188481332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558fe4ac3220 con 0x558fe4c4b520 2024-05-10T03:39:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.381+0000 7fc5fcff9700 1 -- 172.21.15.45:0/4188481332 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc60400fa70 con 0x558fe4c4b520 2024-05-10T03:39:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.381+0000 7fc62b661b80 10 client.15225 fetch_fsmap learned FSMap version 27 2024-05-10T03:39:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.381+0000 7fc62b661b80 1 -- 172.21.15.45:0/4188481332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x558fe4997b10 con 0x558fe4c4b520 2024-05-10T03:39:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.381+0000 7fc5fcff9700 1 -- 172.21.15.45:0/4188481332 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x558fe4ac3220 con 0x558fe4c4b520 2024-05-10T03:39:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.381+0000 7fc5fcff9700 1 -- 172.21.15.45:0/4188481332 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc604003b70 con 0x558fe4c4b520 2024-05-10T03:39:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.381+0000 7fc62b661b80 10 client.15225 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T03:39:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.381+0000 7fc62b661b80 10 client.15225 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-10T03:39:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.381+0000 7fc62b661b80 20 client.15225 populate_metadata read hostname 'smithi045' 2024-05-10T03:39:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.381+0000 7fc62b661b80 1 --2- 172.21.15.45:0/4188481332 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x558fe4c5f670 0x558fe4c64970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.381+0000 7fc62b661b80 4 client.15225 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:39:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.381+0000 7fc62b661b80 1 -- 172.21.15.45:0/4188481332 --> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558fe4c19730 con 0x558fe4c5f670 2024-05-10T03:39:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.382+0000 7fc6190b9700 1 --2- 172.21.15.45:0/4188481332 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x558fe4c5f670 0x558fe4c64970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.382+0000 7fc6190b9700 1 --2- 172.21.15.45:0/4188481332 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x558fe4c5f670 0x558fe4c64970 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=202a904494216598 server_cookie=e121960dc3820177 in_seq=0 out_seq=0 2024-05-10T03:39:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.382+0000 7fc5fcff9700 10 client.15225 ms_handle_connect on v2:172.21.15.106:6834/4162885659 2024-05-10T03:39:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.383+0000 7fc5fcff9700 1 -- 172.21.15.45:0/4188481332 <== mds.4 v2:172.21.15.106:6834/4162885659 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558fe4c19730 con 0x558fe4c5f670 2024-05-10T03:39:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.383+0000 7fc5fcff9700 10 client.15225 handle_command_reply: tid=0 2024-05-10T03:39:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.383+0000 7fc62b661b80 1 client.15225 shutdown 2024-05-10T03:39:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.383+0000 7fc62b661b80 1 -- 172.21.15.45:0/4188481332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4b520 msgr2=0x558fe4c54c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.383+0000 7fc62b661b80 1 --2- 172.21.15.45:0/4188481332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4b520 0x558fe4c54c00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc604005810 tx=0x7fc60400ffb0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.383+0000 7fc62b661b80 1 -- 172.21.15.45:0/4188481332 shutdown_connections 2024-05-10T03:39:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.383+0000 7fc62b661b80 1 --2- 172.21.15.45:0/4188481332 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x558fe4c5f670 0x558fe4c64970 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.383+0000 7fc62b661b80 1 --2- 172.21.15.45:0/4188481332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fe4c4be70 0x558fe4c5bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.383+0000 7fc62b661b80 1 --2- 172.21.15.45:0/4188481332 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fe4c4a650 0x558fe4c546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.383+0000 7fc5fcff9700 0 client.15225 ms_handle_reset on v2:172.21.15.106:6834/4162885659 2024-05-10T03:39:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.383+0000 7fc62b661b80 1 --2- 172.21.15.45:0/4188481332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4b520 0x558fe4c54c00 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.383+0000 7fc62b661b80 1 -- 172.21.15.45:0/4188481332 >> 172.21.15.45:0/4188481332 conn(0x558fe4baca10 msgr2=0x558fe4c44f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:48.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.383+0000 7fc62b661b80 1 -- 172.21.15.45:0/4188481332 shutdown_connections 2024-05-10T03:39:48.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.383+0000 7fc62b661b80 1 -- 172.21.15.45:0/4188481332 wait complete. 2024-05-10T03:39:48.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.383+0000 7fc62b661b80 20 client.15225 trim_cache size 0 max 16384 2024-05-10T03:39:48.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:47 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/573607712' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:39:48.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:47 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/658133504' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:39:48.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.402+0000 7fc62b661b80 1 Processor -- start 2024-05-10T03:39:48.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.403+0000 7fc62b661b80 1 -- start start 2024-05-10T03:39:48.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.403+0000 7fc62b661b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fe4c4a650 0x558fe4c53c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.403+0000 7fc62b661b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fe4c4b520 0x558fe4c5bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.403+0000 7fc62b661b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4be70 0x558fe4c52cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.403+0000 7fc62b661b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fe4ac3220 con 0x558fe4c4be70 2024-05-10T03:39:48.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.403+0000 7fc62b661b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fe4b282b0 con 0x558fe4c4b520 2024-05-10T03:39:48.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.403+0000 7fc62b661b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fe4b63150 con 0x558fe4c4a650 2024-05-10T03:39:48.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.403+0000 7fc6198ba700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4be70 0x558fe4c52cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.403+0000 7fc6198ba700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4be70 0x558fe4c52cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43630/0 (socket says 172.21.15.45:43630) 2024-05-10T03:39:48.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.403+0000 7fc6198ba700 1 -- 172.21.15.45:0/2901938996 learned_addr learned my addr 172.21.15.45:0/2901938996 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:48.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.403+0000 7fc6188b8700 1 --2- 172.21.15.45:0/2901938996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fe4c4b520 0x558fe4c5bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.403+0000 7fc6190b9700 1 --2- 172.21.15.45:0/2901938996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fe4c4a650 0x558fe4c53c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.403+0000 7fc6198ba700 1 -- 172.21.15.45:0/2901938996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fe4c4a650 msgr2=0x558fe4c53c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.403+0000 7fc6198ba700 1 --2- 172.21.15.45:0/2901938996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fe4c4a650 0x558fe4c53c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.403+0000 7fc6198ba700 1 -- 172.21.15.45:0/2901938996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fe4c4b520 msgr2=0x558fe4c5bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.403+0000 7fc6198ba700 1 --2- 172.21.15.45:0/2901938996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fe4c4b520 0x558fe4c5bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.403+0000 7fc6198ba700 1 -- 172.21.15.45:0/2901938996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fe4b30510 con 0x558fe4c4be70 2024-05-10T03:39:48.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.404+0000 7fc6198ba700 1 --2- 172.21.15.45:0/2901938996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4be70 0x558fe4c52cb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc60c009fd0 tx=0x7fc60c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46cc83311e414e62 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:48.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.404+0000 7fc5fffff700 1 -- 172.21.15.45:0/2901938996 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c09af20 con 0x558fe4c4be70 2024-05-10T03:39:48.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.404+0000 7fc5fffff700 1 -- 172.21.15.45:0/2901938996 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc60c09bcc0 con 0x558fe4c4be70 2024-05-10T03:39:48.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.404+0000 7fc5fffff700 1 -- 172.21.15.45:0/2901938996 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c099960 con 0x558fe4c4be70 2024-05-10T03:39:48.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.404+0000 7fc62b661b80 1 -- 172.21.15.45:0/2901938996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4be70 msgr2=0x558fe4c52cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.404+0000 7fc62b661b80 1 --2- 172.21.15.45:0/2901938996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4be70 0x558fe4c52cb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc60c009fd0 tx=0x7fc60c009040 comp rx=0 tx=0).stop 2024-05-10T03:39:48.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.405+0000 7fc62b661b80 1 -- 172.21.15.45:0/2901938996 shutdown_connections 2024-05-10T03:39:48.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.405+0000 7fc62b661b80 1 --2- 172.21.15.45:0/2901938996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fe4c4a650 0x558fe4c53c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.405+0000 7fc62b661b80 1 --2- 172.21.15.45:0/2901938996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4be70 0x558fe4c52cb0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.405+0000 7fc62b661b80 1 --2- 172.21.15.45:0/2901938996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fe4c4b520 0x558fe4c5bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.405+0000 7fc62b661b80 1 -- 172.21.15.45:0/2901938996 >> 172.21.15.45:0/2901938996 conn(0x558fe4baca10 msgr2=0x558fe4c4acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:48.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.405+0000 7fc62b661b80 1 -- 172.21.15.45:0/2901938996 shutdown_connections 2024-05-10T03:39:48.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.405+0000 7fc62b661b80 1 -- 172.21.15.45:0/2901938996 wait complete. 2024-05-10T03:39:48.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.405+0000 7fc62b661b80 1 -- start start 2024-05-10T03:39:48.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.405+0000 7fc62b661b80 1 Processor -- start 2024-05-10T03:39:48.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.405+0000 7fc62b661b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fe4c4a650 0x558fe4c57a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.406+0000 7fc62b661b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fe4c4b520 0x558fe4c57f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.406+0000 7fc62b661b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4be70 0x558fe4c5ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.406+0000 7fc62b661b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fe4c5b3c0 con 0x558fe4c4be70 2024-05-10T03:39:48.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.406+0000 7fc62b661b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fe4c5b530 con 0x558fe4c4a650 2024-05-10T03:39:48.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.406+0000 7fc62b661b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fe4c5b6f0 con 0x558fe4c4b520 2024-05-10T03:39:48.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.406+0000 7fc62b661b80 10 client.0 _ll_register_callbacks cb 0x558fe4b0fae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:39:48.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.406+0000 7fc6198ba700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4be70 0x558fe4c5ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.406+0000 7fc6198ba700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4be70 0x558fe4c5ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43638/0 (socket says 172.21.15.45:43638) 2024-05-10T03:39:48.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.406+0000 7fc6198ba700 1 -- 172.21.15.45:0/3953432705 learned_addr learned my addr 172.21.15.45:0/3953432705 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:48.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.406+0000 7fc6188b8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fe4c4b520 0x558fe4c57f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.406+0000 7fc6190b9700 1 --2- 172.21.15.45:0/3953432705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fe4c4a650 0x558fe4c57a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.406+0000 7fc6198ba700 1 -- 172.21.15.45:0/3953432705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fe4c4b520 msgr2=0x558fe4c57f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.406+0000 7fc6198ba700 1 --2- 172.21.15.45:0/3953432705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fe4c4b520 0x558fe4c57f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.406+0000 7fc6198ba700 1 -- 172.21.15.45:0/3953432705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fe4c4a650 msgr2=0x558fe4c57a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.406+0000 7fc6198ba700 1 --2- 172.21.15.45:0/3953432705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fe4c4a650 0x558fe4c57a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.406+0000 7fc6198ba700 1 -- 172.21.15.45:0/3953432705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6141a2830 con 0x558fe4c4be70 2024-05-10T03:39:48.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.406+0000 7fc6190b9700 1 --2- 172.21.15.45:0/3953432705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fe4c4a650 0x558fe4c57a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:48.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.406+0000 7fc6198ba700 1 --2- 172.21.15.45:0/3953432705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4be70 0x558fe4c5ae80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc60c0cbc70 tx=0x7fc60c00b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de360f236562ff2f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:48.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.406+0000 7fc5fcff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:39:48.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.406+0000 7fc5fcff9700 1 -- 172.21.15.45:0/3953432705 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c09af20 con 0x558fe4c4be70 2024-05-10T03:39:48.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.406+0000 7fc5fcff9700 1 -- 172.21.15.45:0/3953432705 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc60c01de40 con 0x558fe4c4be70 2024-05-10T03:39:48.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.406+0000 7fc62b661b80 1 -- 172.21.15.45:0/3953432705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc60400fc10 con 0x558fe4c4be70 2024-05-10T03:39:48.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.407+0000 7fc5fcff9700 1 -- 172.21.15.45:0/3953432705 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc60c09f3f0 con 0x558fe4c4be70 2024-05-10T03:39:48.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.407+0000 7fc62b661b80 10 client.15231 fetch_fsmap learned FSMap version 27 2024-05-10T03:39:48.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.407+0000 7fc62b661b80 1 -- 172.21.15.45:0/3953432705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x558fe49efc80 con 0x558fe4c4be70 2024-05-10T03:39:48.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.407+0000 7fc5fcff9700 1 -- 172.21.15.45:0/3953432705 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc60c07e020 con 0x558fe4c4be70 2024-05-10T03:39:48.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.407+0000 7fc5fcff9700 1 -- 172.21.15.45:0/3953432705 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc60c09b820 con 0x558fe4c4be70 2024-05-10T03:39:48.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.407+0000 7fc62b661b80 10 client.15231 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T03:39:48.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.407+0000 7fc62b661b80 10 client.15231 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-10T03:39:48.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.407+0000 7fc62b661b80 20 client.15231 populate_metadata read hostname 'smithi045' 2024-05-10T03:39:48.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.407+0000 7fc62b661b80 1 --2- 172.21.15.45:0/3953432705 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x558fe4cb8ee0 0x558fe4cb6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.407+0000 7fc62b661b80 4 client.15231 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T03:39:48.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.407+0000 7fc62b661b80 1 -- 172.21.15.45:0/3953432705 --> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558fe4b62e70 con 0x558fe4cb8ee0 2024-05-10T03:39:48.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.408+0000 7fc6190b9700 1 --2- 172.21.15.45:0/3953432705 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x558fe4cb8ee0 0x558fe4cb6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.408+0000 7fc5fcff9700 10 client.15231 ms_handle_connect on v2:172.21.15.106:6834/4162885659 2024-05-10T03:39:48.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.408+0000 7fc6190b9700 1 --2- 172.21.15.45:0/3953432705 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x558fe4cb8ee0 0x558fe4cb6e90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a6ff91628d482676 server_cookie=77fe38ae467f7145 in_seq=0 out_seq=0 2024-05-10T03:39:48.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.408+0000 7fc5fcff9700 1 -- 172.21.15.45:0/3953432705 <== mds.4 v2:172.21.15.106:6834/4162885659 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x558fe4b62e70 con 0x558fe4cb8ee0 2024-05-10T03:39:48.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.408+0000 7fc5fcff9700 10 client.15231 handle_command_reply: tid=0 2024-05-10T03:39:48.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.408+0000 7fc62b661b80 1 client.15231 shutdown 2024-05-10T03:39:48.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.408+0000 7fc62b661b80 1 -- 172.21.15.45:0/3953432705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4be70 msgr2=0x558fe4c5ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.408+0000 7fc62b661b80 1 --2- 172.21.15.45:0/3953432705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4be70 0x558fe4c5ae80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc60c0cbc70 tx=0x7fc60c00b3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.408+0000 7fc62b661b80 1 -- 172.21.15.45:0/3953432705 shutdown_connections 2024-05-10T03:39:48.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.408+0000 7fc62b661b80 1 --2- 172.21.15.45:0/3953432705 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x558fe4cb8ee0 0x558fe4cb6e90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.408+0000 7fc62b661b80 1 --2- 172.21.15.45:0/3953432705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fe4c4be70 0x558fe4c5ae80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.408+0000 7fc62b661b80 1 --2- 172.21.15.45:0/3953432705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fe4c4a650 0x558fe4c57a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.408+0000 7fc5fcff9700 0 client.15231 ms_handle_reset on v2:172.21.15.106:6834/4162885659 2024-05-10T03:39:48.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.408+0000 7fc62b661b80 1 --2- 172.21.15.45:0/3953432705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fe4c4b520 0x558fe4c57f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.408+0000 7fc62b661b80 1 -- 172.21.15.45:0/3953432705 >> 172.21.15.45:0/3953432705 conn(0x558fe4baca10 msgr2=0x558fe4c68990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:48.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.409+0000 7fc62b661b80 1 -- 172.21.15.45:0/3953432705 shutdown_connections 2024-05-10T03:39:48.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.409+0000 7fc62b661b80 1 -- 172.21.15.45:0/3953432705 wait complete. 2024-05-10T03:39:48.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.409+0000 7fc62b661b80 20 client.15231 trim_cache size 0 max 16384 2024-05-10T03:39:48.418 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:39:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "d2a0bafa-0e7d-11ef-bc98-c7b262605968", 2024-05-10T03:39:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 4, 2024-05-10T03:39:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 24521, 2024-05-10T03:39:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2024-05-10T03:39:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2024-05-10T03:39:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2024-05-10T03:39:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 49.420102526999997, 2024-05-10T03:39:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 27, 2024-05-10T03:39:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 88, 2024-05-10T03:39:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 86, 2024-05-10T03:39:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 90.580166324000004 2024-05-10T03:39:48.419 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:39:48.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.409+0000 7fc61b31d700 1 -- 172.21.15.45:0/1050688706 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc6000a12e0 msgr2=0x7fc6000a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.409+0000 7fc61b31d700 1 --2- 172.21.15.45:0/1050688706 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc6000a12e0 0x7fc6000a37f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc61406a220 tx=0x7fc6100073d0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.409+0000 7fc61b31d700 1 -- 172.21.15.45:0/1050688706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc614101750 msgr2=0x7fc6141a17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.409+0000 7fc61b31d700 1 --2- 172.21.15.45:0/1050688706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc614101750 0x7fc6141a17a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc60c00b070 tx=0x7fc60c0094c0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.409+0000 7fc61b31d700 1 -- 172.21.15.45:0/1050688706 shutdown_connections 2024-05-10T03:39:48.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.409+0000 7fc61b31d700 1 --2- 172.21.15.45:0/1050688706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6141004b0 0x7fc61419a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.409+0000 7fc61b31d700 1 --2- 172.21.15.45:0/1050688706 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc6000a12e0 0x7fc6000a37f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.409+0000 7fc61b31d700 1 --2- 172.21.15.45:0/1050688706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc614101750 0x7fc6141a17a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.409+0000 7fc61b31d700 1 --2- 172.21.15.45:0/1050688706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc614100e00 0x7fc61419a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.409+0000 7fc61b31d700 1 -- 172.21.15.45:0/1050688706 >> 172.21.15.45:0/1050688706 conn(0x7fc6140fc0c0 msgr2=0x7fc6140fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:48.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.409+0000 7fc61b31d700 1 -- 172.21.15.45:0/1050688706 shutdown_connections 2024-05-10T03:39:48.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.409+0000 7fc61b31d700 1 -- 172.21.15.45:0/1050688706 wait complete. 2024-05-10T03:39:48.426 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-10T03:39:48.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.574+0000 7f0d5401a700 1 -- 172.21.15.45:0/373856095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d4c102910 msgr2=0x7f0d4c109210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.574+0000 7f0d5401a700 1 --2- 172.21.15.45:0/373856095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d4c102910 0x7f0d4c109210 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400b0a0 tx=0x7f0d4400b3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.574+0000 7f0d5401a700 1 -- 172.21.15.45:0/373856095 shutdown_connections 2024-05-10T03:39:48.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.574+0000 7f0d5401a700 1 --2- 172.21.15.45:0/373856095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d4c102910 0x7f0d4c109210 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.574+0000 7f0d5401a700 1 --2- 172.21.15.45:0/373856095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d4c1010d0 0x7f0d4c1014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.574+0000 7f0d5401a700 1 --2- 172.21.15.45:0/373856095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d4c101fc0 0x7f0d4c1023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.574+0000 7f0d5401a700 1 -- 172.21.15.45:0/373856095 >> 172.21.15.45:0/373856095 conn(0x7f0d4c0fb8b0 msgr2=0x7f0d4c0fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:48.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.574+0000 7f0d5401a700 1 -- 172.21.15.45:0/373856095 shutdown_connections 2024-05-10T03:39:48.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.574+0000 7f0d5401a700 1 -- 172.21.15.45:0/373856095 wait complete. 2024-05-10T03:39:48.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.575+0000 7f0d5401a700 1 Processor -- start 2024-05-10T03:39:48.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.575+0000 7f0d5401a700 1 -- start start 2024-05-10T03:39:48.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.575+0000 7f0d5401a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d4c1010d0 0x7f0d4c1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.575+0000 7f0d5401a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d4c101fc0 0x7f0d4c198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.575+0000 7f0d5401a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d4c102910 0x7f0d4c19f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.575+0000 7f0d5401a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4c19fdc0 con 0x7f0d4c102910 2024-05-10T03:39:48.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.575+0000 7f0d5401a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4c19ff30 con 0x7f0d4c1010d0 2024-05-10T03:39:48.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.575+0000 7f0d5401a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4c1a00f0 con 0x7f0d4c101fc0 2024-05-10T03:39:48.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.575+0000 7f0d525b7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d4c102910 0x7f0d4c19f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.575+0000 7f0d525b7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d4c102910 0x7f0d4c19f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43658/0 (socket says 172.21.15.45:43658) 2024-05-10T03:39:48.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.575+0000 7f0d525b7700 1 -- 172.21.15.45:0/3707089503 learned_addr learned my addr 172.21.15.45:0/3707089503 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:48.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.575+0000 7f0d515b5700 1 --2- 172.21.15.45:0/3707089503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d4c101fc0 0x7f0d4c198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.575+0000 7f0d51db6700 1 --2- 172.21.15.45:0/3707089503 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d4c1010d0 0x7f0d4c1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.576+0000 7f0d525b7700 1 -- 172.21.15.45:0/3707089503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d4c101fc0 msgr2=0x7f0d4c198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.576+0000 7f0d525b7700 1 --2- 172.21.15.45:0/3707089503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d4c101fc0 0x7f0d4c198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.576+0000 7f0d525b7700 1 -- 172.21.15.45:0/3707089503 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d4c1010d0 msgr2=0x7f0d4c1982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.576+0000 7f0d525b7700 1 --2- 172.21.15.45:0/3707089503 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d4c1010d0 0x7f0d4c1982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.576+0000 7f0d525b7700 1 -- 172.21.15.45:0/3707089503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d44009d00 con 0x7f0d4c102910 2024-05-10T03:39:48.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.576+0000 7f0d525b7700 1 --2- 172.21.15.45:0/3707089503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d4c102910 0x7f0d4c19f7b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0d440079b0 tx=0x7f0d440079e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:48.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.576+0000 7f0d42ffd700 1 -- 172.21.15.45:0/3707089503 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4400e040 con 0x7f0d4c102910 2024-05-10T03:39:48.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.576+0000 7f0d42ffd700 1 -- 172.21.15.45:0/3707089503 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0d4400be50 con 0x7f0d4c102910 2024-05-10T03:39:48.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.576+0000 7f0d5401a700 1 -- 172.21.15.45:0/3707089503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d4c1a0370 con 0x7f0d4c102910 2024-05-10T03:39:48.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.576+0000 7f0d42ffd700 1 -- 172.21.15.45:0/3707089503 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d440052a0 con 0x7f0d4c102910 2024-05-10T03:39:48.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.576+0000 7f0d5401a700 1 -- 172.21.15.45:0/3707089503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4c1a07f0 con 0x7f0d4c102910 2024-05-10T03:39:48.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.579+0000 7f0d42ffd700 1 -- 172.21.15.45:0/3707089503 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f0d44004c50 con 0x7f0d4c102910 2024-05-10T03:39:48.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.580+0000 7f0d42ffd700 1 --2- 172.21.15.45:0/3707089503 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0d380a1260 0x7f0d380a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.581+0000 7f0d51db6700 1 --2- 172.21.15.45:0/3707089503 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0d380a1260 0x7f0d380a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.581+0000 7f0d42ffd700 1 -- 172.21.15.45:0/3707089503 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f0d440ce1a0 con 0x7f0d4c102910 2024-05-10T03:39:48.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.581+0000 7f0d51db6700 1 --2- 172.21.15.45:0/3707089503 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0d380a1260 0x7f0d380a3770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0d48005950 tx=0x7f0d4800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:48.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.582+0000 7f0d6435eb80 1 Processor -- start 2024-05-10T03:39:48.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.582+0000 7f0d6435eb80 1 -- start start 2024-05-10T03:39:48.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.582+0000 7f0d6435eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb0650 0x562299bb0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.582+0000 7f0d6435eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562299bb1520 0x562299bb1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.582+0000 7f0d6435eb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562299bb1e70 0x562299bb8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.582+0000 7f0d6435eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562299ad7100 con 0x562299bb0650 2024-05-10T03:39:48.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.582+0000 7f0d6435eb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x562299ad4ac0 con 0x562299bb1e70 2024-05-10T03:39:48.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.582+0000 7f0d6435eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x562299ad03b0 con 0x562299bb1520 2024-05-10T03:39:48.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.582+0000 7f0d51db6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb0650 0x562299bb0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.582+0000 7f0d51db6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb0650 0x562299bb0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43672/0 (socket says 172.21.15.45:43672) 2024-05-10T03:39:48.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.582+0000 7f0d51db6700 1 -- 172.21.15.45:0/1015991260 learned_addr learned my addr 172.21.15.45:0/1015991260 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:48.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.582+0000 7f0d515b5700 1 --2- 172.21.15.45:0/1015991260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562299bb1520 0x562299bb1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.582+0000 7f0d525b7700 1 --2- 172.21.15.45:0/1015991260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562299bb1e70 0x562299bb8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.583+0000 7f0d51db6700 1 -- 172.21.15.45:0/1015991260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562299bb1520 msgr2=0x562299bb1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.583+0000 7f0d51db6700 1 --2- 172.21.15.45:0/1015991260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562299bb1520 0x562299bb1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.583+0000 7f0d51db6700 1 -- 172.21.15.45:0/1015991260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562299bb1e70 msgr2=0x562299bb8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.583+0000 7f0d51db6700 1 --2- 172.21.15.45:0/1015991260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562299bb1e70 0x562299bb8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.583+0000 7f0d51db6700 1 -- 172.21.15.45:0/1015991260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562299951360 con 0x562299bb0650 2024-05-10T03:39:48.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.583+0000 7f0d51db6700 1 --2- 172.21.15.45:0/1015991260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb0650 0x562299bb0aa0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0d48010f70 tx=0x7f0d48013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9ed063968cdcdf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:48.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.583+0000 7f0d37fff700 1 -- 172.21.15.45:0/1015991260 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d48011db0 con 0x562299bb0650 2024-05-10T03:39:48.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.583+0000 7f0d37fff700 1 -- 172.21.15.45:0/1015991260 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0d48015070 con 0x562299bb0650 2024-05-10T03:39:48.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.583+0000 7f0d37fff700 1 -- 172.21.15.45:0/1015991260 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4801c610 con 0x562299bb0650 2024-05-10T03:39:48.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.584+0000 7f0d6435eb80 1 -- 172.21.15.45:0/1015991260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb0650 msgr2=0x562299bb0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.584+0000 7f0d6435eb80 1 --2- 172.21.15.45:0/1015991260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb0650 0x562299bb0aa0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0d48010f70 tx=0x7f0d48013000 comp rx=0 tx=0).stop 2024-05-10T03:39:48.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.584+0000 7f0d6435eb80 1 -- 172.21.15.45:0/1015991260 shutdown_connections 2024-05-10T03:39:48.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.584+0000 7f0d6435eb80 1 --2- 172.21.15.45:0/1015991260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562299bb1e70 0x562299bb8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.584+0000 7f0d6435eb80 1 --2- 172.21.15.45:0/1015991260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb0650 0x562299bb0aa0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.584+0000 7f0d6435eb80 1 --2- 172.21.15.45:0/1015991260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562299bb1520 0x562299bb1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.584+0000 7f0d6435eb80 1 -- 172.21.15.45:0/1015991260 >> 172.21.15.45:0/1015991260 conn(0x562299b12a10 msgr2=0x562299baaf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:48.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.585+0000 7f0d6435eb80 1 -- 172.21.15.45:0/1015991260 shutdown_connections 2024-05-10T03:39:48.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.585+0000 7f0d6435eb80 1 -- 172.21.15.45:0/1015991260 wait complete. 2024-05-10T03:39:48.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.585+0000 7f0d6435eb80 1 -- start start 2024-05-10T03:39:48.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.585+0000 7f0d6435eb80 1 Processor -- start 2024-05-10T03:39:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.586+0000 7f0d6435eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb0650 0x562299bba5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.586+0000 7f0d6435eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562299bb1520 0x562299bbab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.586+0000 7f0d6435eb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562299bb1e70 0x562299bc1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.586+0000 7f0d6435eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562299a6c510 con 0x562299bb0650 2024-05-10T03:39:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.586+0000 7f0d6435eb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x562299a6c1b0 con 0x562299bb1e70 2024-05-10T03:39:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.586+0000 7f0d6435eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x562299953650 con 0x562299bb1520 2024-05-10T03:39:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.586+0000 7f0d6435eb80 10 client.0 _ll_register_callbacks cb 0x562299a75ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:39:48.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.586+0000 7f0d515b5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562299bb1520 0x562299bbab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.586+0000 7f0d515b5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562299bb1520 0x562299bbab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:45142/0 (socket says 172.21.15.45:45142) 2024-05-10T03:39:48.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.586+0000 7f0d525b7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562299bb1e70 0x562299bc1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.586+0000 7f0d515b5700 1 -- 172.21.15.45:0/3078473704 learned_addr learned my addr 172.21.15.45:0/3078473704 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:48.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.586+0000 7f0d51db6700 1 --2- 172.21.15.45:0/3078473704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb0650 0x562299bba5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.586+0000 7f0d525b7700 1 -- 172.21.15.45:0/3078473704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562299bb1520 msgr2=0x562299bbab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.586+0000 7f0d525b7700 1 --2- 172.21.15.45:0/3078473704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562299bb1520 0x562299bbab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.586+0000 7f0d525b7700 1 -- 172.21.15.45:0/3078473704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb0650 msgr2=0x562299bba5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.586+0000 7f0d525b7700 1 --2- 172.21.15.45:0/3078473704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb0650 0x562299bba5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.586+0000 7f0d525b7700 1 -- 172.21.15.45:0/3078473704 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d48010c20 con 0x562299bb1e70 2024-05-10T03:39:48.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.586+0000 7f0d515b5700 1 --2- 172.21.15.45:0/3078473704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562299bb1520 0x562299bbab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:48.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.587+0000 7f0d525b7700 1 --2- 172.21.15.45:0/3078473704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562299bb1e70 0x562299bc1a80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0d440cb840 tx=0x7f0d4409ad50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23415abda253dabd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:48.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.587+0000 7f0d357fa700 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-05-10T03:39:48.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.587+0000 7f0d357fa700 1 -- 172.21.15.45:0/3078473704 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d440ce030 con 0x562299bb1e70 2024-05-10T03:39:48.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.587+0000 7f0d357fa700 1 -- 172.21.15.45:0/3078473704 <== mon.2 v2:172.21.15.106:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f0d4409b910 con 0x562299bb1e70 2024-05-10T03:39:48.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.587+0000 7f0d6435eb80 1 -- 172.21.15.45:0/3078473704 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562299a29220 con 0x562299bb1e70 2024-05-10T03:39:48.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.587+0000 7f0d357fa700 1 -- 172.21.15.45:0/3078473704 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d4409b210 con 0x562299bb1e70 2024-05-10T03:39:48.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.587+0000 7f0d6435eb80 10 client.25139 fetch_fsmap learned FSMap version 27 2024-05-10T03:39:48.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.587+0000 7f0d6435eb80 1 -- 172.21.15.45:0/3078473704 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5622998fdb10 con 0x562299bb1e70 2024-05-10T03:39:48.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.588+0000 7f0d357fa700 1 -- 172.21.15.45:0/3078473704 <== mon.2 v2:172.21.15.106:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0d44065070 con 0x562299bb1e70 2024-05-10T03:39:48.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.588+0000 7f0d357fa700 1 -- 172.21.15.45:0/3078473704 <== mon.2 v2:172.21.15.106:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f0d4409a700 con 0x562299bb1e70 2024-05-10T03:39:48.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.588+0000 7f0d6435eb80 10 client.25139 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T03:39:48.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.588+0000 7f0d6435eb80 10 client.25139 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T03:39:48.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.588+0000 7f0d6435eb80 20 client.25139 populate_metadata read hostname 'smithi045' 2024-05-10T03:39:48.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.588+0000 7f0d6435eb80 1 --2- 172.21.15.45:0/3078473704 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x562299bc59c0 0x562299bca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.588+0000 7f0d6435eb80 4 client.25139 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:39:48.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.588+0000 7f0d6435eb80 1 -- 172.21.15.45:0/3078473704 --> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562299b7f730 con 0x562299bc59c0 2024-05-10T03:39:48.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.588+0000 7f0d51db6700 1 --2- 172.21.15.45:0/3078473704 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x562299bc59c0 0x562299bca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.589+0000 7f0d357fa700 10 client.25139 ms_handle_connect on v2:172.21.15.154:6836/608167481 2024-05-10T03:39:48.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.589+0000 7f0d51db6700 1 --2- 172.21.15.45:0/3078473704 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x562299bc59c0 0x562299bca6d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1685d7ac000db479 server_cookie=6524220bb9df69d0 in_seq=0 out_seq=0 2024-05-10T03:39:48.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.590+0000 7f0d357fa700 1 -- 172.21.15.45:0/3078473704 <== mds.3 v2:172.21.15.154:6836/608167481 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562299b7f730 con 0x562299bc59c0 2024-05-10T03:39:48.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.590+0000 7f0d357fa700 10 client.25139 handle_command_reply: tid=0 2024-05-10T03:39:48.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.590+0000 7f0d6435eb80 1 client.25139 shutdown 2024-05-10T03:39:48.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.590+0000 7f0d6435eb80 1 -- 172.21.15.45:0/3078473704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562299bb1e70 msgr2=0x562299bc1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.590+0000 7f0d6435eb80 1 --2- 172.21.15.45:0/3078473704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562299bb1e70 0x562299bc1a80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0d440cb840 tx=0x7f0d4409ad50 comp rx=0 tx=0).stop 2024-05-10T03:39:48.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.590+0000 7f0d6435eb80 1 -- 172.21.15.45:0/3078473704 shutdown_connections 2024-05-10T03:39:48.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.590+0000 7f0d6435eb80 1 --2- 172.21.15.45:0/3078473704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562299bb1e70 0x562299bc1a80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.590+0000 7f0d6435eb80 1 --2- 172.21.15.45:0/3078473704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb0650 0x562299bba5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.590+0000 7f0d6435eb80 1 --2- 172.21.15.45:0/3078473704 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x562299bc59c0 0x562299bca6d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.590+0000 7f0d6435eb80 1 --2- 172.21.15.45:0/3078473704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562299bb1520 0x562299bbab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.590+0000 7f0d6435eb80 1 -- 172.21.15.45:0/3078473704 >> 172.21.15.45:0/3078473704 conn(0x562299b12a10 msgr2=0x562299baaf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:48.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.590+0000 7f0d357fa700 0 client.25139 ms_handle_reset on v2:172.21.15.154:6836/608167481 2024-05-10T03:39:48.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.590+0000 7f0d6435eb80 1 -- 172.21.15.45:0/3078473704 shutdown_connections 2024-05-10T03:39:48.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.590+0000 7f0d6435eb80 1 -- 172.21.15.45:0/3078473704 wait complete. 2024-05-10T03:39:48.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.590+0000 7f0d6435eb80 20 client.25139 trim_cache size 0 max 16384 2024-05-10T03:39:48.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.610+0000 7f0d6435eb80 1 Processor -- start 2024-05-10T03:39:48.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.610+0000 7f0d6435eb80 1 -- start start 2024-05-10T03:39:48.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.610+0000 7f0d6435eb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562299bb0650 0x562299bc2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.610+0000 7f0d6435eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb1520 0x562299bc1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.610+0000 7f0d6435eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562299bb1e70 0x562299bb0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.610+0000 7f0d6435eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562299ba7ce0 con 0x562299bb1520 2024-05-10T03:39:48.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.610+0000 7f0d6435eb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x562299bb5d30 con 0x562299bb0650 2024-05-10T03:39:48.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.610+0000 7f0d6435eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x562299bc1e70 con 0x562299bb1e70 2024-05-10T03:39:48.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.610+0000 7f0d515b5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb1520 0x562299bc1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.610+0000 7f0d515b5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb1520 0x562299bc1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43690/0 (socket says 172.21.15.45:43690) 2024-05-10T03:39:48.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.610+0000 7f0d515b5700 1 -- 172.21.15.45:0/1531244714 learned_addr learned my addr 172.21.15.45:0/1531244714 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:48.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.610+0000 7f0d51db6700 1 --2- 172.21.15.45:0/1531244714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562299bb0650 0x562299bc2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.610+0000 7f0d525b7700 1 --2- 172.21.15.45:0/1531244714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562299bb1e70 0x562299bb0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.610+0000 7f0d515b5700 1 -- 172.21.15.45:0/1531244714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562299bb1e70 msgr2=0x562299bb0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.610+0000 7f0d515b5700 1 --2- 172.21.15.45:0/1531244714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562299bb1e70 0x562299bb0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.610+0000 7f0d515b5700 1 -- 172.21.15.45:0/1531244714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562299bb0650 msgr2=0x562299bc2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.610+0000 7f0d515b5700 1 --2- 172.21.15.45:0/1531244714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562299bb0650 0x562299bc2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.610+0000 7f0d515b5700 1 -- 172.21.15.45:0/1531244714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562299a96510 con 0x562299bb1520 2024-05-10T03:39:48.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.610+0000 7f0d525b7700 1 --2- 172.21.15.45:0/1531244714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562299bb1e70 0x562299bb0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:48.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.611+0000 7f0d515b5700 1 --2- 172.21.15.45:0/1531244714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb1520 0x562299bc1930 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c009ef0 tx=0x7f0d3c010710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d828cee56130fc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:48.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.611+0000 7f0d40ff9700 1 -- 172.21.15.45:0/1531244714 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c004230 con 0x562299bb1520 2024-05-10T03:39:48.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.611+0000 7f0d40ff9700 1 -- 172.21.15.45:0/1531244714 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0d3c018040 con 0x562299bb1520 2024-05-10T03:39:48.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.611+0000 7f0d40ff9700 1 -- 172.21.15.45:0/1531244714 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c01c800 con 0x562299bb1520 2024-05-10T03:39:48.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.612+0000 7f0d6435eb80 1 -- 172.21.15.45:0/1531244714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb1520 msgr2=0x562299bc1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.612+0000 7f0d6435eb80 1 --2- 172.21.15.45:0/1531244714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb1520 0x562299bc1930 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c009ef0 tx=0x7f0d3c010710 comp rx=0 tx=0).stop 2024-05-10T03:39:48.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.612+0000 7f0d6435eb80 1 -- 172.21.15.45:0/1531244714 shutdown_connections 2024-05-10T03:39:48.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.612+0000 7f0d6435eb80 1 --2- 172.21.15.45:0/1531244714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562299bb1e70 0x562299bb0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.612+0000 7f0d6435eb80 1 --2- 172.21.15.45:0/1531244714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562299bb0650 0x562299bc2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.612+0000 7f0d6435eb80 1 --2- 172.21.15.45:0/1531244714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb1520 0x562299bc1930 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.612+0000 7f0d6435eb80 1 -- 172.21.15.45:0/1531244714 >> 172.21.15.45:0/1531244714 conn(0x562299b12a10 msgr2=0x562299baaf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:48.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.612+0000 7f0d6435eb80 1 -- 172.21.15.45:0/1531244714 shutdown_connections 2024-05-10T03:39:48.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.612+0000 7f0d6435eb80 1 -- 172.21.15.45:0/1531244714 wait complete. 2024-05-10T03:39:48.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.612+0000 7f0d6435eb80 1 -- start start 2024-05-10T03:39:48.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.612+0000 7f0d6435eb80 1 Processor -- start 2024-05-10T03:39:48.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.613+0000 7f0d6435eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb0650 0x562299bbda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.613+0000 7f0d6435eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562299bb1520 0x562299bbdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.613+0000 7f0d6435eb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562299bb1e70 0x562299bc0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.613+0000 7f0d6435eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562299bc1370 con 0x562299bb0650 2024-05-10T03:39:48.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.613+0000 7f0d6435eb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x562299bc14e0 con 0x562299bb1e70 2024-05-10T03:39:48.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.613+0000 7f0d6435eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x562299bc16a0 con 0x562299bb1520 2024-05-10T03:39:48.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.613+0000 7f0d6435eb80 10 client.0 _ll_register_callbacks cb 0x562299a75ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:39:48.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.613+0000 7f0d51db6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb0650 0x562299bbda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.613+0000 7f0d51db6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb0650 0x562299bbda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43700/0 (socket says 172.21.15.45:43700) 2024-05-10T03:39:48.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.613+0000 7f0d51db6700 1 -- 172.21.15.45:0/1428865813 learned_addr learned my addr 172.21.15.45:0/1428865813 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:48.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.613+0000 7f0d515b5700 1 --2- 172.21.15.45:0/1428865813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562299bb1520 0x562299bbdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.613+0000 7f0d525b7700 1 --2- 172.21.15.45:0/1428865813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562299bb1e70 0x562299bc0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.613+0000 7f0d51db6700 1 -- 172.21.15.45:0/1428865813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562299bb1520 msgr2=0x562299bbdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.613+0000 7f0d51db6700 1 --2- 172.21.15.45:0/1428865813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562299bb1520 0x562299bbdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.613+0000 7f0d51db6700 1 -- 172.21.15.45:0/1428865813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562299bb1e70 msgr2=0x562299bc0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.613+0000 7f0d51db6700 1 --2- 172.21.15.45:0/1428865813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562299bb1e70 0x562299bc0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.613+0000 7f0d51db6700 1 -- 172.21.15.45:0/1428865813 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d3c009b70 con 0x562299bb0650 2024-05-10T03:39:48.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.614+0000 7f0d51db6700 1 --2- 172.21.15.45:0/1428865813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb0650 0x562299bbda50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x562299bb0330 tx=0x7f0d48011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7cb0d57489102c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:48.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.614+0000 7f0d357fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:39:48.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.614+0000 7f0d357fa700 1 -- 172.21.15.45:0/1428865813 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4802d040 con 0x562299bb0650 2024-05-10T03:39:48.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.614+0000 7f0d6435eb80 1 -- 172.21.15.45:0/1428865813 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d48015070 con 0x562299bb0650 2024-05-10T03:39:48.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.614+0000 7f0d357fa700 1 -- 172.21.15.45:0/1428865813 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f0d48017070 con 0x562299bb0650 2024-05-10T03:39:48.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.614+0000 7f0d357fa700 1 -- 172.21.15.45:0/1428865813 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d48005590 con 0x562299bb0650 2024-05-10T03:39:48.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.614+0000 7f0d6435eb80 10 client.15249 fetch_fsmap learned FSMap version 27 2024-05-10T03:39:48.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.614+0000 7f0d6435eb80 1 -- 172.21.15.45:0/1428865813 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x562299955c80 con 0x562299bb0650 2024-05-10T03:39:48.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.614+0000 7f0d357fa700 1 -- 172.21.15.45:0/1428865813 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0d48015070 con 0x562299bb0650 2024-05-10T03:39:48.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.614+0000 7f0d357fa700 1 -- 172.21.15.45:0/1428865813 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f0d4801e650 con 0x562299bb0650 2024-05-10T03:39:48.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.614+0000 7f0d6435eb80 10 client.15249 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T03:39:48.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.614+0000 7f0d6435eb80 10 client.15249 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T03:39:48.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.614+0000 7f0d6435eb80 20 client.15249 populate_metadata read hostname 'smithi045' 2024-05-10T03:39:48.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.614+0000 7f0d6435eb80 1 --2- 172.21.15.45:0/1428865813 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x562299c1eb20 0x562299c1d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.614+0000 7f0d6435eb80 4 client.15249 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T03:39:48.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.614+0000 7f0d6435eb80 1 -- 172.21.15.45:0/1428865813 --> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562299ac8e70 con 0x562299c1eb20 2024-05-10T03:39:48.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.615+0000 7f0d515b5700 1 --2- 172.21.15.45:0/1428865813 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x562299c1eb20 0x562299c1d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.615+0000 7f0d357fa700 10 client.15249 ms_handle_connect on v2:172.21.15.154:6836/608167481 2024-05-10T03:39:48.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.615+0000 7f0d515b5700 1 --2- 172.21.15.45:0/1428865813 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x562299c1eb20 0x562299c1d0b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5a0fceb29f58bbb9 server_cookie=26f081a4d3dd524a in_seq=0 out_seq=0 2024-05-10T03:39:48.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.616+0000 7f0d357fa700 1 -- 172.21.15.45:0/1428865813 <== mds.3 v2:172.21.15.154:6836/608167481 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x562299ac8e70 con 0x562299c1eb20 2024-05-10T03:39:48.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.616+0000 7f0d357fa700 10 client.15249 handle_command_reply: tid=0 2024-05-10T03:39:48.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.616+0000 7f0d6435eb80 1 client.15249 shutdown 2024-05-10T03:39:48.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.616+0000 7f0d6435eb80 1 -- 172.21.15.45:0/1428865813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb0650 msgr2=0x562299bbda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.616+0000 7f0d6435eb80 1 --2- 172.21.15.45:0/1428865813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb0650 0x562299bbda50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x562299bb0330 tx=0x7f0d48011f20 comp rx=0 tx=0).stop 2024-05-10T03:39:48.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.616+0000 7f0d6435eb80 1 -- 172.21.15.45:0/1428865813 shutdown_connections 2024-05-10T03:39:48.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.616+0000 7f0d6435eb80 1 --2- 172.21.15.45:0/1428865813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562299bb1e70 0x562299bc0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.616+0000 7f0d6435eb80 1 --2- 172.21.15.45:0/1428865813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562299bb0650 0x562299bbda50 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.616+0000 7f0d6435eb80 1 --2- 172.21.15.45:0/1428865813 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x562299c1eb20 0x562299c1d0b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.616+0000 7f0d6435eb80 1 --2- 172.21.15.45:0/1428865813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562299bb1520 0x562299bbdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.616+0000 7f0d6435eb80 1 -- 172.21.15.45:0/1428865813 >> 172.21.15.45:0/1428865813 conn(0x562299b12a10 msgr2=0x562299baba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:48.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.616+0000 7f0d357fa700 0 client.15249 ms_handle_reset on v2:172.21.15.154:6836/608167481 2024-05-10T03:39:48.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.616+0000 7f0d6435eb80 1 -- 172.21.15.45:0/1428865813 shutdown_connections 2024-05-10T03:39:48.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.616+0000 7f0d6435eb80 1 -- 172.21.15.45:0/1428865813 wait complete. 2024-05-10T03:39:48.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.616+0000 7f0d6435eb80 20 client.15249 trim_cache size 0 max 16384 2024-05-10T03:39:48.629 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:39:48.629 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "d2a0bafa-0e7d-11ef-bc98-c7b262605968", 2024-05-10T03:39:48.629 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 3, 2024-05-10T03:39:48.629 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 24526, 2024-05-10T03:39:48.629 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2024-05-10T03:39:48.629 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2024-05-10T03:39:48.629 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2024-05-10T03:39:48.630 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 50.632755942999999, 2024-05-10T03:39:48.630 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 27, 2024-05-10T03:39:48.630 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 88, 2024-05-10T03:39:48.630 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 86, 2024-05-10T03:39:48.630 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 87.254179351999994 2024-05-10T03:39:48.630 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:39:48.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.617+0000 7f0d5401a700 1 -- 172.21.15.45:0/3707089503 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0d380a1260 msgr2=0x7f0d380a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.617+0000 7f0d5401a700 1 --2- 172.21.15.45:0/3707089503 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0d380a1260 0x7f0d380a3770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0d48005950 tx=0x7f0d4800b410 comp rx=0 tx=0).stop 2024-05-10T03:39:48.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.617+0000 7f0d5401a700 1 -- 172.21.15.45:0/3707089503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d4c102910 msgr2=0x7f0d4c19f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.617+0000 7f0d5401a700 1 --2- 172.21.15.45:0/3707089503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d4c102910 0x7f0d4c19f7b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0d440079b0 tx=0x7f0d440079e0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.617+0000 7f0d5401a700 1 -- 172.21.15.45:0/3707089503 shutdown_connections 2024-05-10T03:39:48.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.617+0000 7f0d5401a700 1 --2- 172.21.15.45:0/3707089503 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0d380a1260 0x7f0d380a3770 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.617+0000 7f0d5401a700 1 --2- 172.21.15.45:0/3707089503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d4c102910 0x7f0d4c19f7b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.617+0000 7f0d5401a700 1 --2- 172.21.15.45:0/3707089503 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d4c1010d0 0x7f0d4c1982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.617+0000 7f0d5401a700 1 --2- 172.21.15.45:0/3707089503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d4c101fc0 0x7f0d4c198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.617+0000 7f0d5401a700 1 -- 172.21.15.45:0/3707089503 >> 172.21.15.45:0/3707089503 conn(0x7f0d4c0fb8b0 msgr2=0x7f0d4c1051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:48.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.617+0000 7f0d5401a700 1 -- 172.21.15.45:0/3707089503 shutdown_connections 2024-05-10T03:39:48.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.617+0000 7f0d5401a700 1 -- 172.21.15.45:0/3707089503 wait complete. 2024-05-10T03:39:48.633 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-05-10T03:39:48.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.780+0000 7f4606390700 1 -- 172.21.15.45:0/1660103984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4600102580 msgr2=0x7f4600108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.780+0000 7f4606390700 1 --2- 172.21.15.45:0/1660103984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4600102580 0x7f4600108e30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f45f800b0a0 tx=0x7f45f800b3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.780+0000 7f4606390700 1 -- 172.21.15.45:0/1660103984 shutdown_connections 2024-05-10T03:39:48.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.780+0000 7f4606390700 1 --2- 172.21.15.45:0/1660103984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4600100ac0 0x7f4600100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.780+0000 7f4606390700 1 --2- 172.21.15.45:0/1660103984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4600102580 0x7f4600108e30 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.780+0000 7f4606390700 1 --2- 172.21.15.45:0/1660103984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4600101be0 0x7f4600101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.780+0000 7f4606390700 1 -- 172.21.15.45:0/1660103984 >> 172.21.15.45:0/1660103984 conn(0x7f46000fc0d0 msgr2=0x7f46000fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:48.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.780+0000 7f4606390700 1 -- 172.21.15.45:0/1660103984 shutdown_connections 2024-05-10T03:39:48.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.780+0000 7f4606390700 1 -- 172.21.15.45:0/1660103984 wait complete. 2024-05-10T03:39:48.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.781+0000 7f4606390700 1 Processor -- start 2024-05-10T03:39:48.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.781+0000 7f4606390700 1 -- start start 2024-05-10T03:39:48.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.782+0000 7f4606390700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4600100ac0 0x7f4600104880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.782+0000 7f4606390700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4600101be0 0x7f4600102f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.782+0000 7f4606390700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4600102580 0x7f4600103460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.782+0000 7f4606390700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4600103b40 con 0x7f4600102580 2024-05-10T03:39:48.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.782+0000 7f4606390700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4600103cb0 con 0x7f4600101be0 2024-05-10T03:39:48.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.782+0000 7f4606390700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46001a2140 con 0x7f4600100ac0 2024-05-10T03:39:48.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.782+0000 7f460492d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4600102580 0x7f4600103460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.782+0000 7f460492d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4600102580 0x7f4600103460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43728/0 (socket says 172.21.15.45:43728) 2024-05-10T03:39:48.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.782+0000 7f460492d700 1 -- 172.21.15.45:0/946529887 learned_addr learned my addr 172.21.15.45:0/946529887 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:48.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.782+0000 7f45fffff700 1 --2- 172.21.15.45:0/946529887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4600100ac0 0x7f4600104880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.782+0000 7f45ff7fe700 1 --2- 172.21.15.45:0/946529887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4600101be0 0x7f4600102f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.782+0000 7f460492d700 1 -- 172.21.15.45:0/946529887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4600100ac0 msgr2=0x7f4600104880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.782+0000 7f460492d700 1 --2- 172.21.15.45:0/946529887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4600100ac0 0x7f4600104880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.782+0000 7f460492d700 1 -- 172.21.15.45:0/946529887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4600101be0 msgr2=0x7f4600102f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.782+0000 7f460492d700 1 --2- 172.21.15.45:0/946529887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4600101be0 0x7f4600102f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.782+0000 7f460492d700 1 -- 172.21.15.45:0/946529887 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f8009d00 con 0x7f4600102580 2024-05-10T03:39:48.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.782+0000 7f45ff7fe700 1 --2- 172.21.15.45:0/946529887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4600101be0 0x7f4600102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:39:48.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.782+0000 7f460492d700 1 --2- 172.21.15.45:0/946529887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4600102580 0x7f4600103460 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f45f800b070 tx=0x7f45f8009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:48.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.782+0000 7f45fd7fa700 1 -- 172.21.15.45:0/946529887 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f800e040 con 0x7f4600102580 2024-05-10T03:39:48.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.782+0000 7f45fd7fa700 1 -- 172.21.15.45:0/946529887 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f45f800be40 con 0x7f4600102580 2024-05-10T03:39:48.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.782+0000 7f4606390700 1 -- 172.21.15.45:0/946529887 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46001a2340 con 0x7f4600102580 2024-05-10T03:39:48.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.783+0000 7f45fd7fa700 1 -- 172.21.15.45:0/946529887 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f801b6c0 con 0x7f4600102580 2024-05-10T03:39:48.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.783+0000 7f4606390700 1 -- 172.21.15.45:0/946529887 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46001a27c0 con 0x7f4600102580 2024-05-10T03:39:48.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.785+0000 7f45fd7fa700 1 -- 172.21.15.45:0/946529887 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f45f801b820 con 0x7f4600102580 2024-05-10T03:39:48.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.786+0000 7f45fd7fa700 1 --2- 172.21.15.45:0/946529887 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f45e80a12e0 0x7f45e80a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.786+0000 7f45fffff700 1 --2- 172.21.15.45:0/946529887 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f45e80a12e0 0x7f45e80a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.786+0000 7f45fd7fa700 1 -- 172.21.15.45:0/946529887 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f45f80cdc60 con 0x7f4600102580 2024-05-10T03:39:48.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.787+0000 7f46166d4b80 1 Processor -- start 2024-05-10T03:39:48.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.787+0000 7f45fffff700 1 --2- 172.21.15.45:0/946529887 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f45e80a12e0 0x7f45e80a37f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4600101ae0 tx=0x7f45f0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:48.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.787+0000 7f46166d4b80 1 -- start start 2024-05-10T03:39:48.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.787+0000 7f46166d4b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf12650 0x56208bf12aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.787+0000 7f46166d4b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56208bf13520 0x56208bf13930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.787+0000 7f46166d4b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208bf13e70 0x56208bf1a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.787+0000 7f46166d4b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56208be39100 con 0x56208bf12650 2024-05-10T03:39:48.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.787+0000 7f46166d4b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x56208be36ac0 con 0x56208bf13520 2024-05-10T03:39:48.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.787+0000 7f46166d4b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x56208be323b0 con 0x56208bf13e70 2024-05-10T03:39:48.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.787+0000 7f45fffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf12650 0x56208bf12aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.787+0000 7f45fffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf12650 0x56208bf12aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43736/0 (socket says 172.21.15.45:43736) 2024-05-10T03:39:48.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.787+0000 7f45fffff700 1 -- 172.21.15.45:0/1991495587 learned_addr learned my addr 172.21.15.45:0/1991495587 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:48.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.788+0000 7f45ff7fe700 1 --2- 172.21.15.45:0/1991495587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56208bf13520 0x56208bf13930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.788+0000 7f460492d700 1 --2- 172.21.15.45:0/1991495587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208bf13e70 0x56208bf1a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.788+0000 7f45fffff700 1 -- 172.21.15.45:0/1991495587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208bf13e70 msgr2=0x56208bf1a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.788+0000 7f45fffff700 1 --2- 172.21.15.45:0/1991495587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208bf13e70 0x56208bf1a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.788+0000 7f45fffff700 1 -- 172.21.15.45:0/1991495587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56208bf13520 msgr2=0x56208bf13930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.788+0000 7f45fffff700 1 --2- 172.21.15.45:0/1991495587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56208bf13520 0x56208bf13930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.788+0000 7f45fffff700 1 -- 172.21.15.45:0/1991495587 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56208bcb3360 con 0x56208bf12650 2024-05-10T03:39:48.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.788+0000 7f460492d700 1 --2- 172.21.15.45:0/1991495587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208bf13e70 0x56208bf1a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:39:48.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.788+0000 7f45fffff700 1 --2- 172.21.15.45:0/1991495587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf12650 0x56208bf12aa0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f45f0011d20 tx=0x7f45f0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6b55fada09bd1d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:48.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.788+0000 7f45e67fc700 1 -- 172.21.15.45:0/1991495587 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f000ed20 con 0x56208bf12650 2024-05-10T03:39:48.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.788+0000 7f45e67fc700 1 -- 172.21.15.45:0/1991495587 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f45f0021070 con 0x56208bf12650 2024-05-10T03:39:48.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.788+0000 7f45e67fc700 1 -- 172.21.15.45:0/1991495587 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f001d6b0 con 0x56208bf12650 2024-05-10T03:39:48.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.789+0000 7f46166d4b80 1 -- 172.21.15.45:0/1991495587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf12650 msgr2=0x56208bf12aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.789+0000 7f46166d4b80 1 --2- 172.21.15.45:0/1991495587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf12650 0x56208bf12aa0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f45f0011d20 tx=0x7f45f0014000 comp rx=0 tx=0).stop 2024-05-10T03:39:48.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.789+0000 7f46166d4b80 1 -- 172.21.15.45:0/1991495587 shutdown_connections 2024-05-10T03:39:48.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.789+0000 7f46166d4b80 1 --2- 172.21.15.45:0/1991495587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208bf13e70 0x56208bf1a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.789+0000 7f46166d4b80 1 --2- 172.21.15.45:0/1991495587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf12650 0x56208bf12aa0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.789+0000 7f46166d4b80 1 --2- 172.21.15.45:0/1991495587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56208bf13520 0x56208bf13930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.789+0000 7f46166d4b80 1 -- 172.21.15.45:0/1991495587 >> 172.21.15.45:0/1991495587 conn(0x56208be74a10 msgr2=0x56208bf0cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:48.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.789+0000 7f46166d4b80 1 -- 172.21.15.45:0/1991495587 shutdown_connections 2024-05-10T03:39:48.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.789+0000 7f46166d4b80 1 -- 172.21.15.45:0/1991495587 wait complete. 2024-05-10T03:39:48.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.790+0000 7f46166d4b80 1 -- start start 2024-05-10T03:39:48.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.790+0000 7f46166d4b80 1 Processor -- start 2024-05-10T03:39:48.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.790+0000 7f46166d4b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf12650 0x56208bf1c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.790+0000 7f46166d4b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208bf13520 0x56208bf1cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.790+0000 7f46166d4b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56208bf13e70 0x56208bf23ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.790+0000 7f46166d4b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56208bdce510 con 0x56208bf12650 2024-05-10T03:39:48.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.790+0000 7f46166d4b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x56208bdce1b0 con 0x56208bf13e70 2024-05-10T03:39:48.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.790+0000 7f46166d4b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x56208bcb5650 con 0x56208bf13520 2024-05-10T03:39:48.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.790+0000 7f46166d4b80 10 client.0 _ll_register_callbacks cb 0x56208bdd7ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:39:48.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.790+0000 7f45fffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf12650 0x56208bf1c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.790+0000 7f45fffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf12650 0x56208bf1c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43752/0 (socket says 172.21.15.45:43752) 2024-05-10T03:39:48.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.790+0000 7f45fffff700 1 -- 172.21.15.45:0/2333557341 learned_addr learned my addr 172.21.15.45:0/2333557341 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:48.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.791+0000 7f45ff7fe700 1 --2- 172.21.15.45:0/2333557341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208bf13520 0x56208bf1cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.791+0000 7f460492d700 1 --2- 172.21.15.45:0/2333557341 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56208bf13e70 0x56208bf23ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.791+0000 7f45fffff700 1 -- 172.21.15.45:0/2333557341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208bf13520 msgr2=0x56208bf1cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.791+0000 7f45fffff700 1 --2- 172.21.15.45:0/2333557341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208bf13520 0x56208bf1cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.791+0000 7f45fffff700 1 -- 172.21.15.45:0/2333557341 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56208bf13e70 msgr2=0x56208bf23ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.791+0000 7f45fffff700 1 --2- 172.21.15.45:0/2333557341 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56208bf13e70 0x56208bf23ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.791+0000 7f45fffff700 1 -- 172.21.15.45:0/2333557341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f0017070 con 0x56208bf12650 2024-05-10T03:39:48.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.791+0000 7f460492d700 1 --2- 172.21.15.45:0/2333557341 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56208bf13e70 0x56208bf23ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:48.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.791+0000 7f45fffff700 1 --2- 172.21.15.45:0/2333557341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf12650 0x56208bf1c640 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f45f000edd0 tx=0x7f45f000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47226adfaca492ab server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:48.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.791+0000 7f45df7fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:39:48.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.791+0000 7f45df7fe700 1 -- 172.21.15.45:0/2333557341 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f00053d0 con 0x56208bf12650 2024-05-10T03:39:48.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.791+0000 7f45df7fe700 1 -- 172.21.15.45:0/2333557341 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f45f0005530 con 0x56208bf12650 2024-05-10T03:39:48.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.791+0000 7f46166d4b80 1 -- 172.21.15.45:0/2333557341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56208bd8b220 con 0x56208bf12650 2024-05-10T03:39:48.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.791+0000 7f45df7fe700 1 -- 172.21.15.45:0/2333557341 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45f00056f0 con 0x56208bf12650 2024-05-10T03:39:48.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.791+0000 7f46166d4b80 10 client.15261 fetch_fsmap learned FSMap version 27 2024-05-10T03:39:48.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.791+0000 7f46166d4b80 1 -- 172.21.15.45:0/2333557341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56208bc5fb10 con 0x56208bf12650 2024-05-10T03:39:48.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.792+0000 7f45df7fe700 1 -- 172.21.15.45:0/2333557341 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x56208bd8b220 con 0x56208bf12650 2024-05-10T03:39:48.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.792+0000 7f45df7fe700 1 -- 172.21.15.45:0/2333557341 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f45f001c980 con 0x56208bf12650 2024-05-10T03:39:48.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.792+0000 7f46166d4b80 10 client.15261 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T03:39:48.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.792+0000 7f46166d4b80 10 client.15261 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-10T03:39:48.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.792+0000 7f46166d4b80 20 client.15261 populate_metadata read hostname 'smithi045' 2024-05-10T03:39:48.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.792+0000 7f46166d4b80 1 --2- 172.21.15.45:0/2333557341 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x56208bf27b80 0x56208bf2c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.792+0000 7f46166d4b80 4 client.15261 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:39:48.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.792+0000 7f46166d4b80 1 -- 172.21.15.45:0/2333557341 --> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56208bee1730 con 0x56208bf27b80 2024-05-10T03:39:48.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.792+0000 7f45ff7fe700 1 --2- 172.21.15.45:0/2333557341 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x56208bf27b80 0x56208bf2c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.793+0000 7f45df7fe700 10 client.15261 ms_handle_connect on v2:172.21.15.154:6838/1506563336 2024-05-10T03:39:48.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.793+0000 7f45ff7fe700 1 --2- 172.21.15.45:0/2333557341 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x56208bf27b80 0x56208bf2c8b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c8a0a716b3f42e49 server_cookie=1443d09d0f5afad2 in_seq=0 out_seq=0 2024-05-10T03:39:48.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.794+0000 7f45df7fe700 1 -- 172.21.15.45:0/2333557341 <== mds.2 v2:172.21.15.154:6838/1506563336 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56208bee1730 con 0x56208bf27b80 2024-05-10T03:39:48.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.794+0000 7f45df7fe700 10 client.15261 handle_command_reply: tid=0 2024-05-10T03:39:48.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.794+0000 7f46166d4b80 1 client.15261 shutdown 2024-05-10T03:39:48.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.794+0000 7f46166d4b80 1 -- 172.21.15.45:0/2333557341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf12650 msgr2=0x56208bf1c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.794+0000 7f46166d4b80 1 --2- 172.21.15.45:0/2333557341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf12650 0x56208bf1c640 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f45f000edd0 tx=0x7f45f000ee00 comp rx=0 tx=0).stop 2024-05-10T03:39:48.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.794+0000 7f46166d4b80 1 -- 172.21.15.45:0/2333557341 shutdown_connections 2024-05-10T03:39:48.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.794+0000 7f46166d4b80 1 --2- 172.21.15.45:0/2333557341 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x56208bf27b80 0x56208bf2c8b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.794+0000 7f46166d4b80 1 --2- 172.21.15.45:0/2333557341 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56208bf13e70 0x56208bf23ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.794+0000 7f46166d4b80 1 --2- 172.21.15.45:0/2333557341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf12650 0x56208bf1c640 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.794+0000 7f46166d4b80 1 --2- 172.21.15.45:0/2333557341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208bf13520 0x56208bf1cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.794+0000 7f45df7fe700 0 client.15261 ms_handle_reset on v2:172.21.15.154:6838/1506563336 2024-05-10T03:39:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.794+0000 7f46166d4b80 1 -- 172.21.15.45:0/2333557341 >> 172.21.15.45:0/2333557341 conn(0x56208be74a10 msgr2=0x56208bf0cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.794+0000 7f46166d4b80 1 -- 172.21.15.45:0/2333557341 shutdown_connections 2024-05-10T03:39:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.794+0000 7f46166d4b80 1 -- 172.21.15.45:0/2333557341 wait complete. 2024-05-10T03:39:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.794+0000 7f46166d4b80 20 client.15261 trim_cache size 0 max 16384 2024-05-10T03:39:48.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.813+0000 7f46166d4b80 1 Processor -- start 2024-05-10T03:39:48.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.813+0000 7f46166d4b80 1 -- start start 2024-05-10T03:39:48.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.814+0000 7f46166d4b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf12650 0x56208bf1b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.814+0000 7f46166d4b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208bf13520 0x56208bf1d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.814+0000 7f46166d4b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56208bf13e70 0x56208bf0dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.814+0000 7f46166d4b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56208be2b150 con 0x56208bf12650 2024-05-10T03:39:48.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.814+0000 7f46166d4b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x56208be2f010 con 0x56208bf13e70 2024-05-10T03:39:48.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.814+0000 7f46166d4b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x56208bf077c0 con 0x56208bf13520 2024-05-10T03:39:48.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.814+0000 7f45fffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf12650 0x56208bf1b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.814+0000 7f45fffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf12650 0x56208bf1b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43754/0 (socket says 172.21.15.45:43754) 2024-05-10T03:39:48.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.814+0000 7f45fffff700 1 -- 172.21.15.45:0/2663038764 learned_addr learned my addr 172.21.15.45:0/2663038764 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:48.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.814+0000 7f45ff7fe700 1 --2- 172.21.15.45:0/2663038764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208bf13520 0x56208bf1d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.814+0000 7f460492d700 1 --2- 172.21.15.45:0/2663038764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56208bf13e70 0x56208bf0dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.814+0000 7f45fffff700 1 -- 172.21.15.45:0/2663038764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208bf13520 msgr2=0x56208bf1d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.814+0000 7f45fffff700 1 --2- 172.21.15.45:0/2663038764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208bf13520 0x56208bf1d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.814+0000 7f45fffff700 1 -- 172.21.15.45:0/2663038764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56208bf13e70 msgr2=0x56208bf0dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.814+0000 7f45fffff700 1 --2- 172.21.15.45:0/2663038764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56208bf13e70 0x56208bf0dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.814+0000 7f45fffff700 1 -- 172.21.15.45:0/2663038764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56208bdf8510 con 0x56208bf12650 2024-05-10T03:39:48.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.814+0000 7f45ff7fe700 1 --2- 172.21.15.45:0/2663038764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208bf13520 0x56208bf1d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:48.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.814+0000 7f45fffff700 1 --2- 172.21.15.45:0/2663038764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf12650 0x56208bf1b300 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f45f001cfd0 tx=0x7f45f001ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c78d1aace38e45a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:48.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.814+0000 7f45e6ffd700 1 -- 172.21.15.45:0/2663038764 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f00265a0 con 0x56208bf12650 2024-05-10T03:39:48.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.814+0000 7f45e6ffd700 1 -- 172.21.15.45:0/2663038764 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f45f0004500 con 0x56208bf12650 2024-05-10T03:39:48.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.815+0000 7f45e6ffd700 1 -- 172.21.15.45:0/2663038764 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f001c410 con 0x56208bf12650 2024-05-10T03:39:48.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.815+0000 7f46166d4b80 1 -- 172.21.15.45:0/2663038764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf12650 msgr2=0x56208bf1b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.815+0000 7f46166d4b80 1 --2- 172.21.15.45:0/2663038764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf12650 0x56208bf1b300 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f45f001cfd0 tx=0x7f45f001ce30 comp rx=0 tx=0).stop 2024-05-10T03:39:48.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.815+0000 7f46166d4b80 1 -- 172.21.15.45:0/2663038764 shutdown_connections 2024-05-10T03:39:48.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.815+0000 7f46166d4b80 1 --2- 172.21.15.45:0/2663038764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56208bf13e70 0x56208bf0dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.815+0000 7f46166d4b80 1 --2- 172.21.15.45:0/2663038764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf12650 0x56208bf1b300 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.815+0000 7f46166d4b80 1 --2- 172.21.15.45:0/2663038764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208bf13520 0x56208bf1d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.815+0000 7f46166d4b80 1 -- 172.21.15.45:0/2663038764 >> 172.21.15.45:0/2663038764 conn(0x56208be74a10 msgr2=0x56208bf16750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:48.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.815+0000 7f46166d4b80 1 -- 172.21.15.45:0/2663038764 shutdown_connections 2024-05-10T03:39:48.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.815+0000 7f46166d4b80 1 -- 172.21.15.45:0/2663038764 wait complete. 2024-05-10T03:39:48.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.816+0000 7f46166d4b80 1 -- start start 2024-05-10T03:39:48.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.816+0000 7f46166d4b80 1 Processor -- start 2024-05-10T03:39:48.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.817+0000 7f46166d4b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208bf12650 0x56208bf21930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.817+0000 7f46166d4b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56208bf13520 0x56208bf21e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.817+0000 7f46166d4b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf13e70 0x56208bf1ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.817+0000 7f46166d4b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56208bf205f0 con 0x56208bf13e70 2024-05-10T03:39:48.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.817+0000 7f46166d4b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x56208bf20760 con 0x56208bf13520 2024-05-10T03:39:48.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.817+0000 7f46166d4b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x56208bf20920 con 0x56208bf12650 2024-05-10T03:39:48.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.817+0000 7f46166d4b80 10 client.0 _ll_register_callbacks cb 0x56208bdd7ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:39:48.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.817+0000 7f460492d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf13e70 0x56208bf1ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.817+0000 7f460492d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf13e70 0x56208bf1ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43760/0 (socket says 172.21.15.45:43760) 2024-05-10T03:39:48.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.817+0000 7f45fffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208bf12650 0x56208bf21930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.817+0000 7f460492d700 1 -- 172.21.15.45:0/3344400987 learned_addr learned my addr 172.21.15.45:0/3344400987 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:48.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.817+0000 7f45ff7fe700 1 --2- 172.21.15.45:0/3344400987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56208bf13520 0x56208bf21e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.817+0000 7f460492d700 1 -- 172.21.15.45:0/3344400987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208bf12650 msgr2=0x56208bf21930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.817+0000 7f460492d700 1 --2- 172.21.15.45:0/3344400987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208bf12650 0x56208bf21930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.817+0000 7f460492d700 1 -- 172.21.15.45:0/3344400987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56208bf13520 msgr2=0x56208bf21e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.817+0000 7f460492d700 1 --2- 172.21.15.45:0/3344400987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56208bf13520 0x56208bf21e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.817+0000 7f460492d700 1 -- 172.21.15.45:0/3344400987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56208bc5fb10 con 0x56208bf13e70 2024-05-10T03:39:48.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.817+0000 7f460492d700 1 --2- 172.21.15.45:0/3344400987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf13e70 0x56208bf1ffa0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f45f80971d0 tx=0x7f45f809a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f386fdfc7914e9c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:48.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.817+0000 7f45df7fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:39:48.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.817+0000 7f45df7fe700 1 -- 172.21.15.45:0/3344400987 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f8011e70 con 0x56208bf13e70 2024-05-10T03:39:48.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.817+0000 7f45df7fe700 1 -- 172.21.15.45:0/3344400987 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f45f809b3d0 con 0x56208bf13e70 2024-05-10T03:39:48.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.817+0000 7f46166d4b80 1 -- 172.21.15.45:0/3344400987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f45f0021070 con 0x56208bf13e70 2024-05-10T03:39:48.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.818+0000 7f45df7fe700 1 -- 172.21.15.45:0/3344400987 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45f809acd0 con 0x56208bf13e70 2024-05-10T03:39:48.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.818+0000 7f46166d4b80 10 client.15267 fetch_fsmap learned FSMap version 27 2024-05-10T03:39:48.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.818+0000 7f46166d4b80 1 -- 172.21.15.45:0/3344400987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56208bcb7c80 con 0x56208bf13e70 2024-05-10T03:39:48.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.818+0000 7f45df7fe700 1 -- 172.21.15.45:0/3344400987 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f45f80b9020 con 0x56208bf13e70 2024-05-10T03:39:48.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.818+0000 7f45df7fe700 1 -- 172.21.15.45:0/3344400987 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f45f80a2c30 con 0x56208bf13e70 2024-05-10T03:39:48.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.818+0000 7f46166d4b80 10 client.15267 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T03:39:48.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.818+0000 7f46166d4b80 10 client.15267 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-10T03:39:48.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.818+0000 7f46166d4b80 20 client.15267 populate_metadata read hostname 'smithi045' 2024-05-10T03:39:48.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.818+0000 7f46166d4b80 1 --2- 172.21.15.45:0/3344400987 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x56208bf81450 0x56208bf7f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.818+0000 7f46166d4b80 4 client.15267 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T03:39:48.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.818+0000 7f46166d4b80 1 -- 172.21.15.45:0/3344400987 --> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56208be2ae70 con 0x56208bf81450 2024-05-10T03:39:48.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.818+0000 7f45fffff700 1 --2- 172.21.15.45:0/3344400987 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x56208bf81450 0x56208bf7f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.819+0000 7f45fffff700 1 --2- 172.21.15.45:0/3344400987 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x56208bf81450 0x56208bf7f400 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c19b991496531482 server_cookie=fd8c1841faec9f4a in_seq=0 out_seq=0 2024-05-10T03:39:48.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.819+0000 7f45df7fe700 10 client.15267 ms_handle_connect on v2:172.21.15.154:6838/1506563336 2024-05-10T03:39:48.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.819+0000 7f45df7fe700 1 -- 172.21.15.45:0/3344400987 <== mds.2 v2:172.21.15.154:6838/1506563336 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x56208be2ae70 con 0x56208bf81450 2024-05-10T03:39:48.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.819+0000 7f45df7fe700 10 client.15267 handle_command_reply: tid=0 2024-05-10T03:39:48.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.819+0000 7f46166d4b80 1 client.15267 shutdown 2024-05-10T03:39:48.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.819+0000 7f46166d4b80 1 -- 172.21.15.45:0/3344400987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf13e70 msgr2=0x56208bf1ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.819+0000 7f46166d4b80 1 --2- 172.21.15.45:0/3344400987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf13e70 0x56208bf1ffa0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f45f80971d0 tx=0x7f45f809a890 comp rx=0 tx=0).stop 2024-05-10T03:39:48.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.819+0000 7f46166d4b80 1 -- 172.21.15.45:0/3344400987 shutdown_connections 2024-05-10T03:39:48.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.819+0000 7f46166d4b80 1 --2- 172.21.15.45:0/3344400987 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x56208bf81450 0x56208bf7f400 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.819+0000 7f46166d4b80 1 --2- 172.21.15.45:0/3344400987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208bf12650 0x56208bf21930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.819+0000 7f46166d4b80 1 --2- 172.21.15.45:0/3344400987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56208bf13e70 0x56208bf1ffa0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.819+0000 7f46166d4b80 1 --2- 172.21.15.45:0/3344400987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56208bf13520 0x56208bf21e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.819+0000 7f45df7fe700 0 client.15267 ms_handle_reset on v2:172.21.15.154:6838/1506563336 2024-05-10T03:39:48.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.819+0000 7f46166d4b80 1 -- 172.21.15.45:0/3344400987 >> 172.21.15.45:0/3344400987 conn(0x56208be74a10 msgr2=0x56208bf16750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:48.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.819+0000 7f46166d4b80 1 -- 172.21.15.45:0/3344400987 shutdown_connections 2024-05-10T03:39:48.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.819+0000 7f46166d4b80 1 -- 172.21.15.45:0/3344400987 wait complete. 2024-05-10T03:39:48.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.820+0000 7f46166d4b80 20 client.15267 trim_cache size 0 max 16384 2024-05-10T03:39:48.828 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:39:48.828 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "d2a0bafa-0e7d-11ef-bc98-c7b262605968", 2024-05-10T03:39:48.828 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 2, 2024-05-10T03:39:48.829 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 24547, 2024-05-10T03:39:48.829 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2024-05-10T03:39:48.829 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2024-05-10T03:39:48.829 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2024-05-10T03:39:48.829 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 51.853434761999999, 2024-05-10T03:39:48.829 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 27, 2024-05-10T03:39:48.829 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 88, 2024-05-10T03:39:48.829 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 86, 2024-05-10T03:39:48.829 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 83.741555003000002 2024-05-10T03:39:48.829 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:39:48.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.820+0000 7f4606390700 1 -- 172.21.15.45:0/946529887 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f45e80a12e0 msgr2=0x7f45e80a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.820+0000 7f4606390700 1 --2- 172.21.15.45:0/946529887 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f45e80a12e0 0x7f45e80a37f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4600101ae0 tx=0x7f45f0009260 comp rx=0 tx=0).stop 2024-05-10T03:39:48.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.820+0000 7f4606390700 1 -- 172.21.15.45:0/946529887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4600102580 msgr2=0x7f4600103460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.820+0000 7f4606390700 1 --2- 172.21.15.45:0/946529887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4600102580 0x7f4600103460 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f45f800b070 tx=0x7f45f8009810 comp rx=0 tx=0).stop 2024-05-10T03:39:48.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.820+0000 7f4606390700 1 -- 172.21.15.45:0/946529887 shutdown_connections 2024-05-10T03:39:48.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.820+0000 7f4606390700 1 --2- 172.21.15.45:0/946529887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4600100ac0 0x7f4600104880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.820+0000 7f4606390700 1 --2- 172.21.15.45:0/946529887 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f45e80a12e0 0x7f45e80a37f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.820+0000 7f4606390700 1 --2- 172.21.15.45:0/946529887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4600102580 0x7f4600103460 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.820+0000 7f4606390700 1 --2- 172.21.15.45:0/946529887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4600101be0 0x7f4600102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.820+0000 7f4606390700 1 -- 172.21.15.45:0/946529887 >> 172.21.15.45:0/946529887 conn(0x7f46000fc0d0 msgr2=0x7f46000683c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:48.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.820+0000 7f4606390700 1 -- 172.21.15.45:0/946529887 shutdown_connections 2024-05-10T03:39:48.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.820+0000 7f4606390700 1 -- 172.21.15.45:0/946529887 wait complete. 2024-05-10T03:39:48.838 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-05-10T03:39:48.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.987+0000 7fb836504700 1 -- 172.21.15.45:0/62356277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb830100ac0 msgr2=0x7fb830100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.987+0000 7fb836504700 1 --2- 172.21.15.45:0/62356277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb830100ac0 0x7fb830100ed0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb820009990 tx=0x7fb820009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.987+0000 7fb836504700 1 -- 172.21.15.45:0/62356277 shutdown_connections 2024-05-10T03:39:48.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.987+0000 7fb836504700 1 --2- 172.21.15.45:0/62356277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb830102580 0x7fb830108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.987+0000 7fb836504700 1 --2- 172.21.15.45:0/62356277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb830100ac0 0x7fb830100ed0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.987+0000 7fb836504700 1 --2- 172.21.15.45:0/62356277 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb830101be0 0x7fb830101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.987+0000 7fb836504700 1 -- 172.21.15.45:0/62356277 >> 172.21.15.45:0/62356277 conn(0x7fb8300fc0d0 msgr2=0x7fb8300fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:48.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.987+0000 7fb836504700 1 -- 172.21.15.45:0/62356277 shutdown_connections 2024-05-10T03:39:48.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.987+0000 7fb836504700 1 -- 172.21.15.45:0/62356277 wait complete. 2024-05-10T03:39:48.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.988+0000 7fb836504700 1 Processor -- start 2024-05-10T03:39:48.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.988+0000 7fb836504700 1 -- start start 2024-05-10T03:39:48.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.988+0000 7fb836504700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb830100ac0 0x7fb830068e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.989+0000 7fb836504700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb830101be0 0x7fb83019f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.989+0000 7fb836504700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb830102580 0x7fb8301a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.989+0000 7fb836504700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8301a1c60 con 0x7fb830101be0 2024-05-10T03:39:48.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.989+0000 7fb836504700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8301a1dd0 con 0x7fb830102580 2024-05-10T03:39:48.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.989+0000 7fb836504700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8301a1f90 con 0x7fb830100ac0 2024-05-10T03:39:48.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.989+0000 7fb82f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb830101be0 0x7fb83019f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.989+0000 7fb82f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb830101be0 0x7fb83019f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43782/0 (socket says 172.21.15.45:43782) 2024-05-10T03:39:48.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.989+0000 7fb82ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb830100ac0 0x7fb830068e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.989+0000 7fb82f7fe700 1 -- 172.21.15.45:0/1087966557 learned_addr learned my addr 172.21.15.45:0/1087966557 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:48.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.989+0000 7fb834aa1700 1 --2- 172.21.15.45:0/1087966557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb830102580 0x7fb8301a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.989+0000 7fb82f7fe700 1 -- 172.21.15.45:0/1087966557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb830100ac0 msgr2=0x7fb830068e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.989+0000 7fb82f7fe700 1 --2- 172.21.15.45:0/1087966557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb830100ac0 0x7fb830068e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.989+0000 7fb82f7fe700 1 -- 172.21.15.45:0/1087966557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb830102580 msgr2=0x7fb8301a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:48.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.989+0000 7fb82f7fe700 1 --2- 172.21.15.45:0/1087966557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb830102580 0x7fb8301a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.989+0000 7fb82f7fe700 1 -- 172.21.15.45:0/1087966557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8200095f0 con 0x7fb830101be0 2024-05-10T03:39:48.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.989+0000 7fb834aa1700 1 --2- 172.21.15.45:0/1087966557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb830102580 0x7fb8301a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:39:48.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.989+0000 7fb82f7fe700 1 --2- 172.21.15.45:0/1087966557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb830101be0 0x7fb83019f140 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb82400e9a0 tx=0x7fb82400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:48.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.989+0000 7fb82d7fa700 1 -- 172.21.15.45:0/1087966557 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb824009790 con 0x7fb830101be0 2024-05-10T03:39:48.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.989+0000 7fb82d7fa700 1 -- 172.21.15.45:0/1087966557 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb824010430 con 0x7fb830101be0 2024-05-10T03:39:48.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.990+0000 7fb836504700 1 -- 172.21.15.45:0/1087966557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8301a2270 con 0x7fb830101be0 2024-05-10T03:39:48.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.990+0000 7fb82d7fa700 1 -- 172.21.15.45:0/1087966557 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb824018680 con 0x7fb830101be0 2024-05-10T03:39:48.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.990+0000 7fb836504700 1 -- 172.21.15.45:0/1087966557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8301a2780 con 0x7fb830101be0 2024-05-10T03:39:48.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.992+0000 7fb82d7fa700 1 -- 172.21.15.45:0/1087966557 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb8240187e0 con 0x7fb830101be0 2024-05-10T03:39:48.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.993+0000 7fb82d7fa700 1 --2- 172.21.15.45:0/1087966557 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb8180a1260 0x7fb8180a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.993+0000 7fb82d7fa700 1 -- 172.21.15.45:0/1087966557 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb824014070 con 0x7fb830101be0 2024-05-10T03:39:48.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.993+0000 7fb82ffff700 1 --2- 172.21.15.45:0/1087966557 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb8180a1260 0x7fb8180a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.993+0000 7fb82ffff700 1 --2- 172.21.15.45:0/1087966557 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb8180a1260 0x7fb8180a3770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb820006010 tx=0x7fb82001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:48.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.994+0000 7fb846848b80 1 Processor -- start 2024-05-10T03:39:48.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.994+0000 7fb846848b80 1 -- start start 2024-05-10T03:39:48.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.994+0000 7fb846848b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c68650 0x55db37c68aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.994+0000 7fb846848b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db37c69520 0x55db37c69930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.994+0000 7fb846848b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db37c69e70 0x55db37c70770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:48.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.994+0000 7fb846848b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db37b8f100 con 0x55db37c68650 2024-05-10T03:39:48.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.994+0000 7fb846848b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db37b8cac0 con 0x55db37c69520 2024-05-10T03:39:48.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.994+0000 7fb846848b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db37b883b0 con 0x55db37c69e70 2024-05-10T03:39:48.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.994+0000 7fb82ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c68650 0x55db37c68aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.994+0000 7fb82ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c68650 0x55db37c68aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43788/0 (socket says 172.21.15.45:43788) 2024-05-10T03:39:48.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.994+0000 7fb82ffff700 1 -- 172.21.15.45:0/2141699354 learned_addr learned my addr 172.21.15.45:0/2141699354 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:48.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.994+0000 7fb834aa1700 1 --2- 172.21.15.45:0/2141699354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db37c69e70 0x55db37c70770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.994+0000 7fb82f7fe700 1 --2- 172.21.15.45:0/2141699354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db37c69520 0x55db37c69930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:48.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.995+0000 7fb82ffff700 1 -- 172.21.15.45:0/2141699354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db37c69e70 msgr2=0x55db37c70770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.995+0000 7fb82ffff700 1 --2- 172.21.15.45:0/2141699354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db37c69e70 0x55db37c70770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.995+0000 7fb82ffff700 1 -- 172.21.15.45:0/2141699354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db37c69520 msgr2=0x55db37c69930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:48.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.995+0000 7fb82ffff700 1 --2- 172.21.15.45:0/2141699354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db37c69520 0x55db37c69930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:48.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.995+0000 7fb82ffff700 1 -- 172.21.15.45:0/2141699354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db37a09360 con 0x55db37c68650 2024-05-10T03:39:48.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.995+0000 7fb82f7fe700 1 --2- 172.21.15.45:0/2141699354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db37c69520 0x55db37c69930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:48.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.995+0000 7fb82ffff700 1 --2- 172.21.15.45:0/2141699354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c68650 0x55db37c68aa0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb82000b2e0 tx=0x7fb82001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c333aa0ddd1c14e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:49.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.995+0000 7fb8167fc700 1 -- 172.21.15.45:0/2141699354 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82002b070 con 0x55db37c68650 2024-05-10T03:39:49.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.995+0000 7fb8167fc700 1 -- 172.21.15.45:0/2141699354 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb82001e040 con 0x55db37c68650 2024-05-10T03:39:49.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.995+0000 7fb8167fc700 1 -- 172.21.15.45:0/2141699354 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8200249e0 con 0x55db37c68650 2024-05-10T03:39:49.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.996+0000 7fb846848b80 1 -- 172.21.15.45:0/2141699354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c68650 msgr2=0x55db37c68aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:49.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.996+0000 7fb846848b80 1 --2- 172.21.15.45:0/2141699354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c68650 0x55db37c68aa0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb82000b2e0 tx=0x7fb82001f000 comp rx=0 tx=0).stop 2024-05-10T03:39:49.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.996+0000 7fb846848b80 1 -- 172.21.15.45:0/2141699354 shutdown_connections 2024-05-10T03:39:49.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.996+0000 7fb846848b80 1 --2- 172.21.15.45:0/2141699354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db37c69e70 0x55db37c70770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.996+0000 7fb846848b80 1 --2- 172.21.15.45:0/2141699354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c68650 0x55db37c68aa0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.996+0000 7fb846848b80 1 --2- 172.21.15.45:0/2141699354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db37c69520 0x55db37c69930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.996+0000 7fb846848b80 1 -- 172.21.15.45:0/2141699354 >> 172.21.15.45:0/2141699354 conn(0x55db37bcaa10 msgr2=0x55db37c62f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:49.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.996+0000 7fb846848b80 1 -- 172.21.15.45:0/2141699354 shutdown_connections 2024-05-10T03:39:49.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.996+0000 7fb846848b80 1 -- 172.21.15.45:0/2141699354 wait complete. 2024-05-10T03:39:49.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.996+0000 7fb846848b80 1 -- start start 2024-05-10T03:39:49.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.997+0000 7fb846848b80 1 Processor -- start 2024-05-10T03:39:49.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.997+0000 7fb846848b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db37c68650 0x55db37c72590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.997+0000 7fb846848b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db37c69520 0x55db37c72ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.997+0000 7fb846848b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c69e70 0x55db37c79a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.997+0000 7fb846848b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db37b24510 con 0x55db37c69e70 2024-05-10T03:39:49.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.997+0000 7fb846848b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db37b241b0 con 0x55db37c68650 2024-05-10T03:39:49.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.997+0000 7fb846848b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db37a0b650 con 0x55db37c69520 2024-05-10T03:39:49.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.997+0000 7fb846848b80 10 client.0 _ll_register_callbacks cb 0x55db37b2dae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:39:49.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.997+0000 7fb834aa1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c69e70 0x55db37c79a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.997+0000 7fb834aa1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c69e70 0x55db37c79a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43802/0 (socket says 172.21.15.45:43802) 2024-05-10T03:39:49.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.997+0000 7fb834aa1700 1 -- 172.21.15.45:0/2437023015 learned_addr learned my addr 172.21.15.45:0/2437023015 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:49.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.997+0000 7fb82ffff700 1 --2- 172.21.15.45:0/2437023015 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db37c68650 0x55db37c72590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.998+0000 7fb834aa1700 1 -- 172.21.15.45:0/2437023015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db37c69520 msgr2=0x55db37c72ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:49.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.998+0000 7fb834aa1700 1 --2- 172.21.15.45:0/2437023015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db37c69520 0x55db37c72ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.998+0000 7fb834aa1700 1 -- 172.21.15.45:0/2437023015 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db37c68650 msgr2=0x55db37c72590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.998+0000 7fb834aa1700 1 --2- 172.21.15.45:0/2437023015 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db37c68650 0x55db37c72590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.998+0000 7fb834aa1700 1 -- 172.21.15.45:0/2437023015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8301098c0 con 0x55db37c69e70 2024-05-10T03:39:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.998+0000 7fb82ffff700 1 --2- 172.21.15.45:0/2437023015 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db37c68650 0x55db37c72590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.998+0000 7fb834aa1700 1 --2- 172.21.15.45:0/2437023015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c69e70 0x55db37c79a30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb828004640 tx=0x7fb828004720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3306be633525cc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.998+0000 7fb80f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:39:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.998+0000 7fb80f7fe700 1 -- 172.21.15.45:0/2437023015 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828007bf0 con 0x55db37c69e70 2024-05-10T03:39:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.998+0000 7fb80f7fe700 1 -- 172.21.15.45:0/2437023015 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb828007d50 con 0x55db37c69e70 2024-05-10T03:39:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.998+0000 7fb846848b80 1 -- 172.21.15.45:0/2437023015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55db37ae1220 con 0x55db37c69e70 2024-05-10T03:39:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.998+0000 7fb80f7fe700 1 -- 172.21.15.45:0/2437023015 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb828016430 con 0x55db37c69e70 2024-05-10T03:39:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.998+0000 7fb846848b80 10 client.15279 fetch_fsmap learned FSMap version 27 2024-05-10T03:39:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.998+0000 7fb846848b80 1 -- 172.21.15.45:0/2437023015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55db379b5b10 con 0x55db37c69e70 2024-05-10T03:39:49.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.998+0000 7fb80f7fe700 1 -- 172.21.15.45:0/2437023015 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55db37ae1220 con 0x55db37c69e70 2024-05-10T03:39:49.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.999+0000 7fb80f7fe700 1 -- 172.21.15.45:0/2437023015 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb82801e6b0 con 0x55db37c69e70 2024-05-10T03:39:49.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.999+0000 7fb846848b80 10 client.15279 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T03:39:49.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.999+0000 7fb846848b80 10 client.15279 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-10T03:39:49.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.999+0000 7fb846848b80 20 client.15279 populate_metadata read hostname 'smithi045' 2024-05-10T03:39:49.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.999+0000 7fb846848b80 1 --2- 172.21.15.45:0/2437023015 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55db37c7d0f0 0x55db37c82a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.999+0000 7fb846848b80 4 client.15279 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:39:49.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.999+0000 7fb846848b80 1 -- 172.21.15.45:0/2437023015 --> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55db37c37730 con 0x55db37c7d0f0 2024-05-10T03:39:49.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:48.999+0000 7fb82ffff700 1 --2- 172.21.15.45:0/2437023015 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55db37c7d0f0 0x55db37c82a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.000+0000 7fb82ffff700 1 --2- 172.21.15.45:0/2437023015 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55db37c7d0f0 0x55db37c82a20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=24714b97026ec754 server_cookie=9ae065d998fe696d in_seq=0 out_seq=0 2024-05-10T03:39:49.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.000+0000 7fb80f7fe700 10 client.15279 ms_handle_connect on v2:172.21.15.106:6836/3047487403 2024-05-10T03:39:49.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.000+0000 7fb80f7fe700 1 -- 172.21.15.45:0/2437023015 <== mds.1 v2:172.21.15.106:6836/3047487403 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55db37c37730 con 0x55db37c7d0f0 2024-05-10T03:39:49.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.000+0000 7fb80f7fe700 10 client.15279 handle_command_reply: tid=0 2024-05-10T03:39:49.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.000+0000 7fb846848b80 1 client.15279 shutdown 2024-05-10T03:39:49.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.000+0000 7fb846848b80 1 -- 172.21.15.45:0/2437023015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c69e70 msgr2=0x55db37c79a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:49.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.000+0000 7fb846848b80 1 --2- 172.21.15.45:0/2437023015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c69e70 0x55db37c79a30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb828004640 tx=0x7fb828004720 comp rx=0 tx=0).stop 2024-05-10T03:39:49.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.001+0000 7fb846848b80 1 -- 172.21.15.45:0/2437023015 shutdown_connections 2024-05-10T03:39:49.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.001+0000 7fb846848b80 1 --2- 172.21.15.45:0/2437023015 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55db37c7d0f0 0x55db37c82a20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.001+0000 7fb846848b80 1 --2- 172.21.15.45:0/2437023015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c69e70 0x55db37c79a30 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.001+0000 7fb846848b80 1 --2- 172.21.15.45:0/2437023015 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db37c68650 0x55db37c72590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.001+0000 7fb80f7fe700 0 client.15279 ms_handle_reset on v2:172.21.15.106:6836/3047487403 2024-05-10T03:39:49.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.001+0000 7fb846848b80 1 --2- 172.21.15.45:0/2437023015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db37c69520 0x55db37c72ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.001+0000 7fb846848b80 1 -- 172.21.15.45:0/2437023015 >> 172.21.15.45:0/2437023015 conn(0x55db37bcaa10 msgr2=0x55db37c62f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:49.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.001+0000 7fb846848b80 1 -- 172.21.15.45:0/2437023015 shutdown_connections 2024-05-10T03:39:49.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.001+0000 7fb846848b80 1 -- 172.21.15.45:0/2437023015 wait complete. 2024-05-10T03:39:49.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.001+0000 7fb846848b80 20 client.15279 trim_cache size 0 max 16384 2024-05-10T03:39:49.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.020+0000 7fb846848b80 1 Processor -- start 2024-05-10T03:39:49.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.020+0000 7fb846848b80 1 -- start start 2024-05-10T03:39:49.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.020+0000 7fb846848b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db37c68650 0x55db37c70cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.020+0000 7fb846848b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c69520 0x55db37c798e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.020+0000 7fb846848b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db37c69e70 0x55db37c711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.020+0000 7fb846848b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db37b81150 con 0x55db37c69520 2024-05-10T03:39:49.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.020+0000 7fb846848b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db37b85010 con 0x55db37c69e70 2024-05-10T03:39:49.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.020+0000 7fb846848b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db37b275a0 con 0x55db37c68650 2024-05-10T03:39:49.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.020+0000 7fb82f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c69520 0x55db37c798e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.020+0000 7fb82f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c69520 0x55db37c798e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43814/0 (socket says 172.21.15.45:43814) 2024-05-10T03:39:49.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.020+0000 7fb82f7fe700 1 -- 172.21.15.45:0/812870724 learned_addr learned my addr 172.21.15.45:0/812870724 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:49.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.020+0000 7fb834aa1700 1 --2- 172.21.15.45:0/812870724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db37c69e70 0x55db37c711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.020+0000 7fb82ffff700 1 --2- 172.21.15.45:0/812870724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db37c68650 0x55db37c70cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.020+0000 7fb82f7fe700 1 -- 172.21.15.45:0/812870724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db37c68650 msgr2=0x55db37c70cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:49.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.020+0000 7fb82f7fe700 1 --2- 172.21.15.45:0/812870724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db37c68650 0x55db37c70cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.020+0000 7fb82f7fe700 1 -- 172.21.15.45:0/812870724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db37c69e70 msgr2=0x55db37c711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:49.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.020+0000 7fb82f7fe700 1 --2- 172.21.15.45:0/812870724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db37c69e70 0x55db37c711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.021+0000 7fb82f7fe700 1 -- 172.21.15.45:0/812870724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db37b4e510 con 0x55db37c69520 2024-05-10T03:39:49.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.021+0000 7fb834aa1700 1 --2- 172.21.15.45:0/812870724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db37c69e70 0x55db37c711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:49.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.021+0000 7fb82f7fe700 1 --2- 172.21.15.45:0/812870724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c69520 0x55db37c798e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb8240ca650 tx=0x7fb82409a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2681d1b792165c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:49.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.021+0000 7fb816ffd700 1 -- 172.21.15.45:0/812870724 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8240ca870 con 0x55db37c69520 2024-05-10T03:39:49.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.021+0000 7fb816ffd700 1 -- 172.21.15.45:0/812870724 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb824010910 con 0x55db37c69520 2024-05-10T03:39:49.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.021+0000 7fb816ffd700 1 -- 172.21.15.45:0/812870724 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8240996b0 con 0x55db37c69520 2024-05-10T03:39:49.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.022+0000 7fb846848b80 1 -- 172.21.15.45:0/812870724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c69520 msgr2=0x55db37c798e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:49.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.022+0000 7fb846848b80 1 --2- 172.21.15.45:0/812870724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c69520 0x55db37c798e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb8240ca650 tx=0x7fb82409a760 comp rx=0 tx=0).stop 2024-05-10T03:39:49.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.022+0000 7fb846848b80 1 -- 172.21.15.45:0/812870724 shutdown_connections 2024-05-10T03:39:49.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.022+0000 7fb846848b80 1 --2- 172.21.15.45:0/812870724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db37c68650 0x55db37c70cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.022+0000 7fb846848b80 1 --2- 172.21.15.45:0/812870724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db37c69e70 0x55db37c711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.022+0000 7fb846848b80 1 --2- 172.21.15.45:0/812870724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c69520 0x55db37c798e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.022+0000 7fb846848b80 1 -- 172.21.15.45:0/812870724 >> 172.21.15.45:0/812870724 conn(0x55db37bcaa10 msgr2=0x55db37c63bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:49.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.022+0000 7fb846848b80 1 -- 172.21.15.45:0/812870724 shutdown_connections 2024-05-10T03:39:49.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.022+0000 7fb846848b80 1 -- 172.21.15.45:0/812870724 wait complete. 2024-05-10T03:39:49.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.022+0000 7fb846848b80 1 -- start start 2024-05-10T03:39:49.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.022+0000 7fb846848b80 1 Processor -- start 2024-05-10T03:39:49.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.023+0000 7fb846848b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db37c68650 0x55db37c759d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.023+0000 7fb846848b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db37c69520 0x55db37c75f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.023+0000 7fb846848b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c69e70 0x55db37c78e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.023+0000 7fb846848b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db37c79390 con 0x55db37c69e70 2024-05-10T03:39:49.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.023+0000 7fb846848b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db37c79500 con 0x55db37c69520 2024-05-10T03:39:49.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.023+0000 7fb846848b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db37c796c0 con 0x55db37c68650 2024-05-10T03:39:49.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.023+0000 7fb846848b80 10 client.0 _ll_register_callbacks cb 0x55db37b2dae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:39:49.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.023+0000 7fb834aa1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c69e70 0x55db37c78e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.023+0000 7fb834aa1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c69e70 0x55db37c78e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43824/0 (socket says 172.21.15.45:43824) 2024-05-10T03:39:49.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.023+0000 7fb834aa1700 1 -- 172.21.15.45:0/1717384096 learned_addr learned my addr 172.21.15.45:0/1717384096 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:49.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.023+0000 7fb82ffff700 1 --2- 172.21.15.45:0/1717384096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db37c68650 0x55db37c759d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.023+0000 7fb82f7fe700 1 --2- 172.21.15.45:0/1717384096 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db37c69520 0x55db37c75f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.023+0000 7fb834aa1700 1 -- 172.21.15.45:0/1717384096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db37c68650 msgr2=0x55db37c759d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:49.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.023+0000 7fb834aa1700 1 --2- 172.21.15.45:0/1717384096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db37c68650 0x55db37c759d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.023+0000 7fb834aa1700 1 -- 172.21.15.45:0/1717384096 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db37c69520 msgr2=0x55db37c75f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:49.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.023+0000 7fb834aa1700 1 --2- 172.21.15.45:0/1717384096 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db37c69520 0x55db37c75f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.023+0000 7fb834aa1700 1 -- 172.21.15.45:0/1717384096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8301a2780 con 0x55db37c69e70 2024-05-10T03:39:49.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.023+0000 7fb82ffff700 1 --2- 172.21.15.45:0/1717384096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db37c68650 0x55db37c759d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:49.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.024+0000 7fb834aa1700 1 --2- 172.21.15.45:0/1717384096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c69e70 0x55db37c78e50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x55db37c63670 tx=0x7fb828007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff660c430bc96ae server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:49.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.024+0000 7fb80f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:39:49.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.024+0000 7fb80f7fe700 1 -- 172.21.15.45:0/1717384096 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8280077e0 con 0x55db37c69e70 2024-05-10T03:39:49.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.024+0000 7fb80f7fe700 1 -- 172.21.15.45:0/1717384096 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb82801ed30 con 0x55db37c69e70 2024-05-10T03:39:49.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.024+0000 7fb846848b80 1 -- 172.21.15.45:0/1717384096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb82001e040 con 0x55db37c69e70 2024-05-10T03:39:49.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.024+0000 7fb80f7fe700 1 -- 172.21.15.45:0/1717384096 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb828004c60 con 0x55db37c69e70 2024-05-10T03:39:49.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.024+0000 7fb846848b80 10 client.15285 fetch_fsmap learned FSMap version 27 2024-05-10T03:39:49.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.024+0000 7fb846848b80 1 -- 172.21.15.45:0/1717384096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55db37a0dc80 con 0x55db37c69e70 2024-05-10T03:39:49.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.024+0000 7fb80f7fe700 1 -- 172.21.15.45:0/1717384096 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb82001e040 con 0x55db37c69e70 2024-05-10T03:39:49.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.024+0000 7fb80f7fe700 1 -- 172.21.15.45:0/1717384096 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb82801f9e0 con 0x55db37c69e70 2024-05-10T03:39:49.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.024+0000 7fb846848b80 10 client.15285 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T03:39:49.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.024+0000 7fb846848b80 10 client.15285 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-10T03:39:49.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.024+0000 7fb846848b80 20 client.15285 populate_metadata read hostname 'smithi045' 2024-05-10T03:39:49.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.024+0000 7fb846848b80 1 --2- 172.21.15.45:0/1717384096 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55db37cd74a0 0x55db37cd5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.024+0000 7fb846848b80 4 client.15285 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T03:39:49.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.024+0000 7fb846848b80 1 -- 172.21.15.45:0/1717384096 --> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55db37b80e70 con 0x55db37cd74a0 2024-05-10T03:39:49.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.025+0000 7fb82ffff700 1 --2- 172.21.15.45:0/1717384096 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55db37cd74a0 0x55db37cd5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.025+0000 7fb80f7fe700 10 client.15285 ms_handle_connect on v2:172.21.15.106:6836/3047487403 2024-05-10T03:39:49.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.025+0000 7fb82ffff700 1 --2- 172.21.15.45:0/1717384096 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55db37cd74a0 0x55db37cd5450 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e80477b35a8ef2de server_cookie=f6adef02cf996f09 in_seq=0 out_seq=0 2024-05-10T03:39:49.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.025+0000 7fb80f7fe700 1 -- 172.21.15.45:0/1717384096 <== mds.1 v2:172.21.15.106:6836/3047487403 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55db37b80e70 con 0x55db37cd74a0 2024-05-10T03:39:49.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.025+0000 7fb80f7fe700 10 client.15285 handle_command_reply: tid=0 2024-05-10T03:39:49.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.025+0000 7fb846848b80 1 client.15285 shutdown 2024-05-10T03:39:49.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.026+0000 7fb846848b80 1 -- 172.21.15.45:0/1717384096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c69e70 msgr2=0x55db37c78e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:49.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.026+0000 7fb846848b80 1 --2- 172.21.15.45:0/1717384096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c69e70 0x55db37c78e50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x55db37c63670 tx=0x7fb828007ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.026+0000 7fb846848b80 1 -- 172.21.15.45:0/1717384096 shutdown_connections 2024-05-10T03:39:49.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.026+0000 7fb846848b80 1 --2- 172.21.15.45:0/1717384096 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55db37cd74a0 0x55db37cd5450 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.026+0000 7fb846848b80 1 --2- 172.21.15.45:0/1717384096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db37c68650 0x55db37c759d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.026+0000 7fb846848b80 1 --2- 172.21.15.45:0/1717384096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db37c69e70 0x55db37c78e50 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.026+0000 7fb80f7fe700 0 client.15285 ms_handle_reset on v2:172.21.15.106:6836/3047487403 2024-05-10T03:39:49.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.026+0000 7fb846848b80 1 --2- 172.21.15.45:0/1717384096 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db37c69520 0x55db37c75f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.026+0000 7fb846848b80 1 -- 172.21.15.45:0/1717384096 >> 172.21.15.45:0/1717384096 conn(0x55db37bcaa10 msgr2=0x55db37c86a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:49.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.026+0000 7fb846848b80 1 -- 172.21.15.45:0/1717384096 shutdown_connections 2024-05-10T03:39:49.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.026+0000 7fb846848b80 1 -- 172.21.15.45:0/1717384096 wait complete. 2024-05-10T03:39:49.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.026+0000 7fb846848b80 20 client.15285 trim_cache size 0 max 16384 2024-05-10T03:39:49.035 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:39:49.035 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "d2a0bafa-0e7d-11ef-bc98-c7b262605968", 2024-05-10T03:39:49.035 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 1, 2024-05-10T03:39:49.035 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 24548, 2024-05-10T03:39:49.035 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2024-05-10T03:39:49.035 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2024-05-10T03:39:49.036 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2024-05-10T03:39:49.036 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 53.080576958000002, 2024-05-10T03:39:49.036 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 27, 2024-05-10T03:39:49.036 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 88, 2024-05-10T03:39:49.036 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 86, 2024-05-10T03:39:49.036 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 85.772484227000007 2024-05-10T03:39:49.036 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:39:49.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.026+0000 7fb836504700 1 -- 172.21.15.45:0/1087966557 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb8180a1260 msgr2=0x7fb8180a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:49.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.026+0000 7fb836504700 1 --2- 172.21.15.45:0/1087966557 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb8180a1260 0x7fb8180a3770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb820006010 tx=0x7fb82001a040 comp rx=0 tx=0).stop 2024-05-10T03:39:49.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.026+0000 7fb836504700 1 -- 172.21.15.45:0/1087966557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb830101be0 msgr2=0x7fb83019f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:49.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.026+0000 7fb836504700 1 --2- 172.21.15.45:0/1087966557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb830101be0 0x7fb83019f140 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb82400e9a0 tx=0x7fb82400ecb0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.027+0000 7fb836504700 1 -- 172.21.15.45:0/1087966557 shutdown_connections 2024-05-10T03:39:49.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.027+0000 7fb836504700 1 --2- 172.21.15.45:0/1087966557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb830100ac0 0x7fb830068e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.027+0000 7fb836504700 1 --2- 172.21.15.45:0/1087966557 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb8180a1260 0x7fb8180a3770 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.027+0000 7fb836504700 1 --2- 172.21.15.45:0/1087966557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb830102580 0x7fb8301a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.027+0000 7fb836504700 1 --2- 172.21.15.45:0/1087966557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb830101be0 0x7fb83019f140 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.027+0000 7fb836504700 1 -- 172.21.15.45:0/1087966557 >> 172.21.15.45:0/1087966557 conn(0x7fb8300fc0d0 msgr2=0x7fb830104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:49.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.027+0000 7fb836504700 1 -- 172.21.15.45:0/1087966557 shutdown_connections 2024-05-10T03:39:49.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.027+0000 7fb836504700 1 -- 172.21.15.45:0/1087966557 wait complete. 2024-05-10T03:39:49.043 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-10T03:39:49.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.192+0000 7f98685e2700 1 -- 172.21.15.45:0/1375074060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9860102580 msgr2=0x7f9860108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:49.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.192+0000 7f98685e2700 1 --2- 172.21.15.45:0/1375074060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9860102580 0x7f9860108e30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f985800b0a0 tx=0x7f985800b3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.192+0000 7f98685e2700 1 -- 172.21.15.45:0/1375074060 shutdown_connections 2024-05-10T03:39:49.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.192+0000 7f98685e2700 1 --2- 172.21.15.45:0/1375074060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9860100ac0 0x7f9860100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.192+0000 7f98685e2700 1 --2- 172.21.15.45:0/1375074060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9860102580 0x7f9860108e30 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.192+0000 7f98685e2700 1 --2- 172.21.15.45:0/1375074060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9860101be0 0x7f9860101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.192+0000 7f98685e2700 1 -- 172.21.15.45:0/1375074060 >> 172.21.15.45:0/1375074060 conn(0x7f98600fc0d0 msgr2=0x7f98600fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:49.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.192+0000 7f98685e2700 1 -- 172.21.15.45:0/1375074060 shutdown_connections 2024-05-10T03:39:49.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.192+0000 7f98685e2700 1 -- 172.21.15.45:0/1375074060 wait complete. 2024-05-10T03:39:49.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.193+0000 7f98685e2700 1 Processor -- start 2024-05-10T03:39:49.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.193+0000 7f98685e2700 1 -- start start 2024-05-10T03:39:49.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.193+0000 7f98685e2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9860100ac0 0x7f98601980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.193+0000 7f98685e2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9860101be0 0x7f9860198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.193+0000 7f98685e2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9860102580 0x7f986019f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.193+0000 7f98685e2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986019fb10 con 0x7f9860101be0 2024-05-10T03:39:49.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.193+0000 7f98685e2700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986019fc50 con 0x7f9860102580 2024-05-10T03:39:49.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.193+0000 7f98685e2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986019fde0 con 0x7f9860100ac0 2024-05-10T03:39:49.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.193+0000 7f9865b7d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9860101be0 0x7f9860198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.193+0000 7f9865b7d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9860101be0 0x7f9860198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43842/0 (socket says 172.21.15.45:43842) 2024-05-10T03:39:49.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.193+0000 7f9865b7d700 1 -- 172.21.15.45:0/1368208664 learned_addr learned my addr 172.21.15.45:0/1368208664 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:49.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.193+0000 7f986637e700 1 --2- 172.21.15.45:0/1368208664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9860100ac0 0x7f98601980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.193+0000 7f9866b7f700 1 --2- 172.21.15.45:0/1368208664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9860102580 0x7f986019f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.194+0000 7f9865b7d700 1 -- 172.21.15.45:0/1368208664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9860100ac0 msgr2=0x7f98601980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:49.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.194+0000 7f9865b7d700 1 --2- 172.21.15.45:0/1368208664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9860100ac0 0x7f98601980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.194+0000 7f9865b7d700 1 -- 172.21.15.45:0/1368208664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9860102580 msgr2=0x7f986019f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:49.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.194+0000 7f9865b7d700 1 --2- 172.21.15.45:0/1368208664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9860102580 0x7f986019f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.194+0000 7f9865b7d700 1 -- 172.21.15.45:0/1368208664 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9858009d00 con 0x7f9860101be0 2024-05-10T03:39:49.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.194+0000 7f9865b7d700 1 --2- 172.21.15.45:0/1368208664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9860101be0 0x7f9860198600 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f985000c9e0 tx=0x7f985000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:49.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.194+0000 7f98577fe700 1 -- 172.21.15.45:0/1368208664 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9850007ac0 con 0x7f9860101be0 2024-05-10T03:39:49.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.194+0000 7f98577fe700 1 -- 172.21.15.45:0/1368208664 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f985000ce80 con 0x7f9860101be0 2024-05-10T03:39:49.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.194+0000 7f98685e2700 1 -- 172.21.15.45:0/1368208664 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98601a00c0 con 0x7f9860101be0 2024-05-10T03:39:49.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.194+0000 7f98577fe700 1 -- 172.21.15.45:0/1368208664 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9850018660 con 0x7f9860101be0 2024-05-10T03:39:49.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.194+0000 7f98685e2700 1 -- 172.21.15.45:0/1368208664 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98601a05d0 con 0x7f9860101be0 2024-05-10T03:39:49.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.197+0000 7f98577fe700 1 -- 172.21.15.45:0/1368208664 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f985000f450 con 0x7f9860101be0 2024-05-10T03:39:49.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.198+0000 7f98577fe700 1 --2- 172.21.15.45:0/1368208664 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f984c0a1260 0x7f984c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.198+0000 7f986637e700 1 --2- 172.21.15.45:0/1368208664 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f984c0a1260 0x7f984c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.198+0000 7f98577fe700 1 -- 172.21.15.45:0/1368208664 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f98500cccb0 con 0x7f9860101be0 2024-05-10T03:39:49.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.198+0000 7f986637e700 1 --2- 172.21.15.45:0/1368208664 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f984c0a1260 0x7f984c0a3770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9860101ae0 tx=0x7f985c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:49.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.198+0000 7f9878926b80 1 Processor -- start 2024-05-10T03:39:49.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.199+0000 7f9878926b80 1 -- start start 2024-05-10T03:39:49.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.199+0000 7f9878926b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddb650 0x555aa8ddbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.199+0000 7f9878926b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555aa8ddc520 0x555aa8ddc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.199+0000 7f9878926b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa8ddce70 0x555aa8de3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.199+0000 7f9878926b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa8d02100 con 0x555aa8ddb650 2024-05-10T03:39:49.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.199+0000 7f9878926b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa8cffac0 con 0x555aa8ddc520 2024-05-10T03:39:49.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.199+0000 7f9878926b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa8cfb3b0 con 0x555aa8ddce70 2024-05-10T03:39:49.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.199+0000 7f986637e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddb650 0x555aa8ddbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.199+0000 7f986637e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddb650 0x555aa8ddbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43852/0 (socket says 172.21.15.45:43852) 2024-05-10T03:39:49.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.199+0000 7f986637e700 1 -- 172.21.15.45:0/747063403 learned_addr learned my addr 172.21.15.45:0/747063403 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:49.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.199+0000 7f9865b7d700 1 --2- 172.21.15.45:0/747063403 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555aa8ddc520 0x555aa8ddc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.199+0000 7f9866b7f700 1 --2- 172.21.15.45:0/747063403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa8ddce70 0x555aa8de3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.200+0000 7f986637e700 1 -- 172.21.15.45:0/747063403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa8ddce70 msgr2=0x555aa8de3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:49.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.200+0000 7f986637e700 1 --2- 172.21.15.45:0/747063403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa8ddce70 0x555aa8de3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.200+0000 7f986637e700 1 -- 172.21.15.45:0/747063403 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555aa8ddc520 msgr2=0x555aa8ddc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:49.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.200+0000 7f986637e700 1 --2- 172.21.15.45:0/747063403 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555aa8ddc520 0x555aa8ddc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.200+0000 7f986637e700 1 -- 172.21.15.45:0/747063403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555aa8b7c360 con 0x555aa8ddb650 2024-05-10T03:39:49.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.200+0000 7f9865b7d700 1 --2- 172.21.15.45:0/747063403 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555aa8ddc520 0x555aa8ddc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:39:49.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.200+0000 7f9866b7f700 1 --2- 172.21.15.45:0/747063403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa8ddce70 0x555aa8de3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:49.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.200+0000 7f986637e700 1 --2- 172.21.15.45:0/747063403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddb650 0x555aa8ddbaa0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f985c011d20 tx=0x7f985c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149b9545925c0d61 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:49.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.200+0000 7f9854ff9700 1 -- 172.21.15.45:0/747063403 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c00ebd0 con 0x555aa8ddb650 2024-05-10T03:39:49.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.200+0000 7f9854ff9700 1 -- 172.21.15.45:0/747063403 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f985c021070 con 0x555aa8ddb650 2024-05-10T03:39:49.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.200+0000 7f9854ff9700 1 -- 172.21.15.45:0/747063403 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c01d670 con 0x555aa8ddb650 2024-05-10T03:39:49.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.201+0000 7f9878926b80 1 -- 172.21.15.45:0/747063403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddb650 msgr2=0x555aa8ddbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:49.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.201+0000 7f9878926b80 1 --2- 172.21.15.45:0/747063403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddb650 0x555aa8ddbaa0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f985c011d20 tx=0x7f985c014000 comp rx=0 tx=0).stop 2024-05-10T03:39:49.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.201+0000 7f9878926b80 1 -- 172.21.15.45:0/747063403 shutdown_connections 2024-05-10T03:39:49.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.201+0000 7f9878926b80 1 --2- 172.21.15.45:0/747063403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa8ddce70 0x555aa8de3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.201+0000 7f9878926b80 1 --2- 172.21.15.45:0/747063403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddb650 0x555aa8ddbaa0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.201+0000 7f9878926b80 1 --2- 172.21.15.45:0/747063403 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555aa8ddc520 0x555aa8ddc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.201+0000 7f9878926b80 1 -- 172.21.15.45:0/747063403 >> 172.21.15.45:0/747063403 conn(0x555aa8d3da10 msgr2=0x555aa8dd5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:49.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.201+0000 7f9878926b80 1 -- 172.21.15.45:0/747063403 shutdown_connections 2024-05-10T03:39:49.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.201+0000 7f9878926b80 1 -- 172.21.15.45:0/747063403 wait complete. 2024-05-10T03:39:49.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.201+0000 7f9878926b80 1 -- start start 2024-05-10T03:39:49.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.202+0000 7f9878926b80 1 Processor -- start 2024-05-10T03:39:49.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.202+0000 7f9878926b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddb650 0x555aa8de5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.202+0000 7f9878926b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555aa8ddc520 0x555aa8de5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.202+0000 7f9878926b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa8ddce70 0x555aa8decb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.202+0000 7f9878926b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa8c97510 con 0x555aa8ddb650 2024-05-10T03:39:49.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.202+0000 7f9878926b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa8c971b0 con 0x555aa8ddc520 2024-05-10T03:39:49.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.202+0000 7f9878926b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa8b7e650 con 0x555aa8ddce70 2024-05-10T03:39:49.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.202+0000 7f9878926b80 10 client.0 _ll_register_callbacks cb 0x555aa8ca0ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:39:49.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.202+0000 7f986637e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddb650 0x555aa8de5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.202+0000 7f986637e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddb650 0x555aa8de5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43868/0 (socket says 172.21.15.45:43868) 2024-05-10T03:39:49.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.202+0000 7f986637e700 1 -- 172.21.15.45:0/1555224548 learned_addr learned my addr 172.21.15.45:0/1555224548 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:49.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.202+0000 7f9865b7d700 1 --2- 172.21.15.45:0/1555224548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555aa8ddc520 0x555aa8de5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.202+0000 7f9866b7f700 1 --2- 172.21.15.45:0/1555224548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa8ddce70 0x555aa8decb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.202+0000 7f986637e700 1 -- 172.21.15.45:0/1555224548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa8ddce70 msgr2=0x555aa8decb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:49.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.202+0000 7f986637e700 1 --2- 172.21.15.45:0/1555224548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa8ddce70 0x555aa8decb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.202+0000 7f986637e700 1 -- 172.21.15.45:0/1555224548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555aa8ddc520 msgr2=0x555aa8de5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:49.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.202+0000 7f986637e700 1 --2- 172.21.15.45:0/1555224548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555aa8ddc520 0x555aa8de5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.202+0000 7f986637e700 1 -- 172.21.15.45:0/1555224548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98601a05d0 con 0x555aa8ddb650 2024-05-10T03:39:49.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.202+0000 7f9866b7f700 1 --2- 172.21.15.45:0/1555224548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa8ddce70 0x555aa8decb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:39:49.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.203+0000 7f986637e700 1 --2- 172.21.15.45:0/1555224548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddb650 0x555aa8de5660 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f985c00ed40 tx=0x7f985c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d15dd7738c76e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:49.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.203+0000 7f9849ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:39:49.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.203+0000 7f9849ffb700 1 -- 172.21.15.45:0/1555224548 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c005350 con 0x555aa8ddb650 2024-05-10T03:39:49.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.203+0000 7f9849ffb700 1 -- 172.21.15.45:0/1555224548 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f985c0054b0 con 0x555aa8ddb650 2024-05-10T03:39:49.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.203+0000 7f9878926b80 1 -- 172.21.15.45:0/1555224548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555aa8c54220 con 0x555aa8ddb650 2024-05-10T03:39:49.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.203+0000 7f9849ffb700 1 -- 172.21.15.45:0/1555224548 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f985c005670 con 0x555aa8ddb650 2024-05-10T03:39:49.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.203+0000 7f9878926b80 10 client.15297 fetch_fsmap learned FSMap version 27 2024-05-10T03:39:49.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.203+0000 7f9878926b80 1 -- 172.21.15.45:0/1555224548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f985c017070 con 0x555aa8ddb650 2024-05-10T03:39:49.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.203+0000 7f9849ffb700 1 -- 172.21.15.45:0/1555224548 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x555aa8c54220 con 0x555aa8ddb650 2024-05-10T03:39:49.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.203+0000 7f9849ffb700 1 -- 172.21.15.45:0/1555224548 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f985c004c40 con 0x555aa8ddb650 2024-05-10T03:39:49.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.204+0000 7f9878926b80 10 client.15297 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T03:39:49.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.204+0000 7f9878926b80 10 client.15297 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T03:39:49.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.204+0000 7f9878926b80 20 client.15297 populate_metadata read hostname 'smithi045' 2024-05-10T03:39:49.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.204+0000 7f9878926b80 1 --2- 172.21.15.45:0/1555224548 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x555aa8df05f0 0x555aa8df58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.204+0000 7f9878926b80 4 client.15297 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:39:49.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.204+0000 7f9878926b80 1 -- 172.21.15.45:0/1555224548 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555aa8daa730 con 0x555aa8df05f0 2024-05-10T03:39:49.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.204+0000 7f9865b7d700 1 --2- 172.21.15.45:0/1555224548 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x555aa8df05f0 0x555aa8df58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.204+0000 7f9849ffb700 10 client.15297 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:39:49.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.204+0000 7f9865b7d700 1 --2- 172.21.15.45:0/1555224548 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x555aa8df05f0 0x555aa8df58f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca17c1f413214c51 server_cookie=2df84496d4ddcb1a in_seq=0 out_seq=0 2024-05-10T03:39:49.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.205+0000 7f9849ffb700 1 -- 172.21.15.45:0/1555224548 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555aa8daa730 con 0x555aa8df05f0 2024-05-10T03:39:49.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.205+0000 7f9849ffb700 10 client.15297 handle_command_reply: tid=0 2024-05-10T03:39:49.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.205+0000 7f9878926b80 1 client.15297 shutdown 2024-05-10T03:39:49.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.205+0000 7f9878926b80 1 -- 172.21.15.45:0/1555224548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddb650 msgr2=0x555aa8de5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:49.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.205+0000 7f9878926b80 1 --2- 172.21.15.45:0/1555224548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddb650 0x555aa8de5660 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f985c00ed40 tx=0x7f985c00ee20 comp rx=0 tx=0).stop 2024-05-10T03:39:49.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.205+0000 7f9878926b80 1 -- 172.21.15.45:0/1555224548 shutdown_connections 2024-05-10T03:39:49.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.205+0000 7f9878926b80 1 --2- 172.21.15.45:0/1555224548 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x555aa8df05f0 0x555aa8df58f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.205+0000 7f9878926b80 1 --2- 172.21.15.45:0/1555224548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa8ddce70 0x555aa8decb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.205+0000 7f9878926b80 1 --2- 172.21.15.45:0/1555224548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddb650 0x555aa8de5660 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.205+0000 7f9878926b80 1 --2- 172.21.15.45:0/1555224548 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555aa8ddc520 0x555aa8de5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.205+0000 7f9849ffb700 0 client.15297 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:39:49.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.205+0000 7f9878926b80 1 -- 172.21.15.45:0/1555224548 >> 172.21.15.45:0/1555224548 conn(0x555aa8d3da10 msgr2=0x555aa8dd5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:49.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.205+0000 7f9878926b80 1 -- 172.21.15.45:0/1555224548 shutdown_connections 2024-05-10T03:39:49.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.205+0000 7f9878926b80 1 -- 172.21.15.45:0/1555224548 wait complete. 2024-05-10T03:39:49.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.205+0000 7f9878926b80 20 client.15297 trim_cache size 0 max 16384 2024-05-10T03:39:49.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:48 smithi154 ceph-mon[46565]: pgmap v269: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:39:49.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:48 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2557184366' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:39:49.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.225+0000 7f9878926b80 1 Processor -- start 2024-05-10T03:39:49.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.225+0000 7f9878926b80 1 -- start start 2024-05-10T03:39:49.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.225+0000 7f9878926b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555aa8ddb650 0x555aa8de6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.225+0000 7f9878926b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa8ddc520 0x555aa8dd6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.225+0000 7f9878926b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddce70 0x555aa8ddf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.225+0000 7f9878926b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa8cb92b0 con 0x555aa8ddce70 2024-05-10T03:39:49.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.225+0000 7f9878926b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa8cf4150 con 0x555aa8ddb650 2024-05-10T03:39:49.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.225+0000 7f9878926b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa8cf8010 con 0x555aa8ddc520 2024-05-10T03:39:49.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.225+0000 7f9866b7f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddce70 0x555aa8ddf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.225+0000 7f9866b7f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddce70 0x555aa8ddf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43884/0 (socket says 172.21.15.45:43884) 2024-05-10T03:39:49.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.225+0000 7f9866b7f700 1 -- 172.21.15.45:0/2503867751 learned_addr learned my addr 172.21.15.45:0/2503867751 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:49.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.226+0000 7f986637e700 1 --2- 172.21.15.45:0/2503867751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555aa8ddb650 0x555aa8de6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.226+0000 7f9865b7d700 1 --2- 172.21.15.45:0/2503867751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa8ddc520 0x555aa8dd6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.226+0000 7f9866b7f700 1 -- 172.21.15.45:0/2503867751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa8ddc520 msgr2=0x555aa8dd6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:49.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.226+0000 7f9866b7f700 1 --2- 172.21.15.45:0/2503867751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa8ddc520 0x555aa8dd6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.226+0000 7f9866b7f700 1 -- 172.21.15.45:0/2503867751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555aa8ddb650 msgr2=0x555aa8de6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:49.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.226+0000 7f9866b7f700 1 --2- 172.21.15.45:0/2503867751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555aa8ddb650 0x555aa8de6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.226+0000 7f9866b7f700 1 -- 172.21.15.45:0/2503867751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555aa8b28b10 con 0x555aa8ddce70 2024-05-10T03:39:49.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.226+0000 7f986637e700 1 --2- 172.21.15.45:0/2503867751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555aa8ddb650 0x555aa8de6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:49.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.226+0000 7f9866b7f700 1 --2- 172.21.15.45:0/2503867751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddce70 0x555aa8ddf750 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9858015000 tx=0x7f98580060c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e362c4b5453c08e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:49.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.226+0000 7f98557fa700 1 -- 172.21.15.45:0/2503867751 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985800e040 con 0x555aa8ddce70 2024-05-10T03:39:49.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.226+0000 7f98557fa700 1 -- 172.21.15.45:0/2503867751 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f98580077c0 con 0x555aa8ddce70 2024-05-10T03:39:49.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.226+0000 7f98557fa700 1 -- 172.21.15.45:0/2503867751 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98580052e0 con 0x555aa8ddce70 2024-05-10T03:39:49.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.227+0000 7f9878926b80 1 -- 172.21.15.45:0/2503867751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddce70 msgr2=0x555aa8ddf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:49.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.227+0000 7f9878926b80 1 --2- 172.21.15.45:0/2503867751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddce70 0x555aa8ddf750 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9858015000 tx=0x7f98580060c0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.227+0000 7f9878926b80 1 -- 172.21.15.45:0/2503867751 shutdown_connections 2024-05-10T03:39:49.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.227+0000 7f9878926b80 1 --2- 172.21.15.45:0/2503867751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddce70 0x555aa8ddf750 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.227+0000 7f9878926b80 1 --2- 172.21.15.45:0/2503867751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555aa8ddb650 0x555aa8de6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.227+0000 7f9878926b80 1 --2- 172.21.15.45:0/2503867751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa8ddc520 0x555aa8dd6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.227+0000 7f9878926b80 1 -- 172.21.15.45:0/2503867751 >> 172.21.15.45:0/2503867751 conn(0x555aa8d3da10 msgr2=0x555aa8dd2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:49.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.227+0000 7f9878926b80 1 -- 172.21.15.45:0/2503867751 shutdown_connections 2024-05-10T03:39:49.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.227+0000 7f9878926b80 1 -- 172.21.15.45:0/2503867751 wait complete. 2024-05-10T03:39:49.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.227+0000 7f9878926b80 1 -- start start 2024-05-10T03:39:49.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.228+0000 7f9878926b80 1 Processor -- start 2024-05-10T03:39:49.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.228+0000 7f9878926b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddb650 0x555aa8de8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.228+0000 7f9878926b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555aa8ddc520 0x555aa8de9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.228+0000 7f9878926b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa8ddce70 0x555aa8dea190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.228+0000 7f9878926b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa8dea6d0 con 0x555aa8ddb650 2024-05-10T03:39:49.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.228+0000 7f9878926b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa8dea840 con 0x555aa8ddc520 2024-05-10T03:39:49.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.228+0000 7f9878926b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa8deaa00 con 0x555aa8ddce70 2024-05-10T03:39:49.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.228+0000 7f986637e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddb650 0x555aa8de8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.228+0000 7f9878926b80 10 client.0 _ll_register_callbacks cb 0x555aa8ca0ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:39:49.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.228+0000 7f986637e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddb650 0x555aa8de8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43890/0 (socket says 172.21.15.45:43890) 2024-05-10T03:39:49.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.228+0000 7f986637e700 1 -- 172.21.15.45:0/2468819623 learned_addr learned my addr 172.21.15.45:0/2468819623 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:49.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.228+0000 7f9866b7f700 1 --2- 172.21.15.45:0/2468819623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa8ddce70 0x555aa8dea190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.228+0000 7f9865b7d700 1 --2- 172.21.15.45:0/2468819623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555aa8ddc520 0x555aa8de9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.228+0000 7f986637e700 1 -- 172.21.15.45:0/2468819623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa8ddce70 msgr2=0x555aa8dea190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:49.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.228+0000 7f986637e700 1 --2- 172.21.15.45:0/2468819623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa8ddce70 0x555aa8dea190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.228+0000 7f986637e700 1 -- 172.21.15.45:0/2468819623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555aa8ddc520 msgr2=0x555aa8de9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:39:49.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.228+0000 7f986637e700 1 --2- 172.21.15.45:0/2468819623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555aa8ddc520 0x555aa8de9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.228+0000 7f986637e700 1 -- 172.21.15.45:0/2468819623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98601098c0 con 0x555aa8ddb650 2024-05-10T03:39:49.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.228+0000 7f9866b7f700 1 --2- 172.21.15.45:0/2468819623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa8ddce70 0x555aa8dea190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:49.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.229+0000 7f986637e700 1 --2- 172.21.15.45:0/2468819623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddb650 0x555aa8de8dc0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f985c00ed40 tx=0x7f985c0268b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b34131a02d3ffd4f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:49.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.229+0000 7f9849ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:39:49.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.229+0000 7f9849ffb700 1 -- 172.21.15.45:0/2468819623 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c005560 con 0x555aa8ddb650 2024-05-10T03:39:49.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.229+0000 7f9849ffb700 1 -- 172.21.15.45:0/2468819623 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f985c026980 con 0x555aa8ddb650 2024-05-10T03:39:49.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.229+0000 7f9878926b80 1 -- 172.21.15.45:0/2468819623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555aa8dd7b70 con 0x555aa8ddb650 2024-05-10T03:39:49.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.229+0000 7f9849ffb700 1 -- 172.21.15.45:0/2468819623 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f985c0056c0 con 0x555aa8ddb650 2024-05-10T03:39:49.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.229+0000 7f9878926b80 10 client.15303 fetch_fsmap learned FSMap version 27 2024-05-10T03:39:49.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.229+0000 7f9878926b80 1 -- 172.21.15.45:0/2468819623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x555aa8cc1510 con 0x555aa8ddb650 2024-05-10T03:39:49.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.229+0000 7f9849ffb700 1 -- 172.21.15.45:0/2468819623 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x555aa8dd7b70 con 0x555aa8ddb650 2024-05-10T03:39:49.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.229+0000 7f9849ffb700 1 -- 172.21.15.45:0/2468819623 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f985c004780 con 0x555aa8ddb650 2024-05-10T03:39:49.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.230+0000 7f9878926b80 10 client.15303 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T03:39:49.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.230+0000 7f9878926b80 10 client.15303 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T03:39:49.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.230+0000 7f9878926b80 20 client.15303 populate_metadata read hostname 'smithi045' 2024-05-10T03:39:49.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.230+0000 7f9878926b80 1 --2- 172.21.15.45:0/2468819623 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x555aa8e49950 0x555aa8e47eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:49.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.230+0000 7f9878926b80 4 client.15303 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T03:39:49.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.230+0000 7f9878926b80 1 -- 172.21.15.45:0/2468819623 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f985c021070 con 0x555aa8e49950 2024-05-10T03:39:49.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.230+0000 7f9865b7d700 1 --2- 172.21.15.45:0/2468819623 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x555aa8e49950 0x555aa8e47eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:49.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.230+0000 7f9849ffb700 10 client.15303 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:39:49.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.230+0000 7f9865b7d700 1 --2- 172.21.15.45:0/2468819623 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x555aa8e49950 0x555aa8e47eb0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6298863c8d0157c server_cookie=b0ec6f4aa14e0db4 in_seq=0 out_seq=0 2024-05-10T03:39:49.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.231+0000 7f9849ffb700 1 -- 172.21.15.45:0/2468819623 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x7f985c021070 con 0x555aa8e49950 2024-05-10T03:39:49.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.231+0000 7f9849ffb700 10 client.15303 handle_command_reply: tid=0 2024-05-10T03:39:49.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.231+0000 7f9878926b80 1 client.15303 shutdown 2024-05-10T03:39:49.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.231+0000 7f9878926b80 1 -- 172.21.15.45:0/2468819623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddb650 msgr2=0x555aa8de8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:49.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.231+0000 7f9878926b80 1 --2- 172.21.15.45:0/2468819623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddb650 0x555aa8de8dc0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f985c00ed40 tx=0x7f985c0268b0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.231+0000 7f9878926b80 1 -- 172.21.15.45:0/2468819623 shutdown_connections 2024-05-10T03:39:49.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.231+0000 7f9878926b80 1 --2- 172.21.15.45:0/2468819623 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x555aa8e49950 0x555aa8e47eb0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.231+0000 7f9878926b80 1 --2- 172.21.15.45:0/2468819623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa8ddce70 0x555aa8dea190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.231+0000 7f9878926b80 1 --2- 172.21.15.45:0/2468819623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555aa8ddb650 0x555aa8de8dc0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.231+0000 7f9878926b80 1 --2- 172.21.15.45:0/2468819623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555aa8ddc520 0x555aa8de9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.231+0000 7f9849ffb700 0 client.15303 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:39:49.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.231+0000 7f9878926b80 1 -- 172.21.15.45:0/2468819623 >> 172.21.15.45:0/2468819623 conn(0x555aa8d3da10 msgr2=0x555aa8dd2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:49.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.231+0000 7f9878926b80 1 -- 172.21.15.45:0/2468819623 shutdown_connections 2024-05-10T03:39:49.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.231+0000 7f9878926b80 1 -- 172.21.15.45:0/2468819623 wait complete. 2024-05-10T03:39:49.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.231+0000 7f9878926b80 20 client.15303 trim_cache size 0 max 16384 2024-05-10T03:39:49.241 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:39:49.241 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "d2a0bafa-0e7d-11ef-bc98-c7b262605968", 2024-05-10T03:39:49.241 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2024-05-10T03:39:49.241 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 24590, 2024-05-10T03:39:49.241 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2024-05-10T03:39:49.241 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2024-05-10T03:39:49.241 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2024-05-10T03:39:49.241 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 72.672825023000001, 2024-05-10T03:39:49.241 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 27, 2024-05-10T03:39:49.241 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 88, 2024-05-10T03:39:49.241 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 86, 2024-05-10T03:39:49.241 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 78.529052911999997 2024-05-10T03:39:49.242 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:39:49.242 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.231+0000 7f98685e2700 1 -- 172.21.15.45:0/1368208664 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f984c0a1260 msgr2=0x7f984c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:49.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.231+0000 7f98685e2700 1 --2- 172.21.15.45:0/1368208664 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f984c0a1260 0x7f984c0a3770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9860101ae0 tx=0x7f985c009260 comp rx=0 tx=0).stop 2024-05-10T03:39:49.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.231+0000 7f98685e2700 1 -- 172.21.15.45:0/1368208664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9860101be0 msgr2=0x7f9860198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:49.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.231+0000 7f98685e2700 1 --2- 172.21.15.45:0/1368208664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9860101be0 0x7f9860198600 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f985000c9e0 tx=0x7f985000ccf0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.232+0000 7f98685e2700 1 -- 172.21.15.45:0/1368208664 shutdown_connections 2024-05-10T03:39:49.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.232+0000 7f98685e2700 1 --2- 172.21.15.45:0/1368208664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9860100ac0 0x7f98601980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.232+0000 7f98685e2700 1 --2- 172.21.15.45:0/1368208664 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f984c0a1260 0x7f984c0a3770 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.232+0000 7f98685e2700 1 --2- 172.21.15.45:0/1368208664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9860102580 0x7f986019f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.232+0000 7f98685e2700 1 --2- 172.21.15.45:0/1368208664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9860101be0 0x7f9860198600 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:49.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.232+0000 7f98685e2700 1 -- 172.21.15.45:0/1368208664 >> 172.21.15.45:0/1368208664 conn(0x7f98600fc0d0 msgr2=0x7f98600fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:49.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.232+0000 7f98685e2700 1 -- 172.21.15.45:0/1368208664 shutdown_connections 2024-05-10T03:39:49.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:49.232+0000 7f98685e2700 1 -- 172.21.15.45:0/1368208664 wait complete. 2024-05-10T03:39:49.247 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:48 smithi045 ceph-mon[42520]: pgmap v269: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:39:49.247 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:48 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2557184366' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:39:49.248 INFO:tasks.cephadm:Setup complete, yielding 2024-05-10T03:39:49.249 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-10T03:39:49.259 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi045.front.sepia.ceph.com 2024-05-10T03:39:49.260 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- bash -c 'ceph orch status' 2024-05-10T03:39:49.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:48 smithi106 ceph-mon[46996]: pgmap v269: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:39:49.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:48 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2557184366' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:39:49.509 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:50.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.598+0000 7f22adba6700 1 -- 172.21.15.45:0/2462506751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22a8101cb0 msgr2=0x7f22a81020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:50.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.598+0000 7f22adba6700 1 --2- 172.21.15.45:0/2462506751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22a8101cb0 0x7f22a81020c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f229c009990 tx=0x7f229c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:50.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.598+0000 7f22adba6700 1 -- 172.21.15.45:0/2462506751 shutdown_connections 2024-05-10T03:39:50.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.598+0000 7f22adba6700 1 --2- 172.21.15.45:0/2462506751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22a8102650 0x7f22a8108f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:50.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.598+0000 7f22adba6700 1 --2- 172.21.15.45:0/2462506751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22a8100b80 0x7f22a8100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:50.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.598+0000 7f22adba6700 1 --2- 172.21.15.45:0/2462506751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22a8101cb0 0x7f22a81020c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.598+0000 7f22adba6700 1 -- 172.21.15.45:0/2462506751 >> 172.21.15.45:0/2462506751 conn(0x7f22a80fc1c0 msgr2=0x7f22a80fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.598+0000 7f22adba6700 1 -- 172.21.15.45:0/2462506751 shutdown_connections 2024-05-10T03:39:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.598+0000 7f22adba6700 1 -- 172.21.15.45:0/2462506751 wait complete. 2024-05-10T03:39:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.599+0000 7f22adba6700 1 Processor -- start 2024-05-10T03:39:50.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.599+0000 7f22adba6700 1 -- start start 2024-05-10T03:39:50.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.599+0000 7f22adba6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22a8100b80 0x7f22a8104b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:50.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.599+0000 7f22adba6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22a8101cb0 0x7f22a8102ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:50.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.599+0000 7f22adba6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22a8102650 0x7f22a8103650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:50.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.599+0000 7f22adba6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a8103d80 con 0x7f22a8102650 2024-05-10T03:39:50.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.599+0000 7f22adba6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a81a21d0 con 0x7f22a8100b80 2024-05-10T03:39:50.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.599+0000 7f22adba6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a81a2310 con 0x7f22a8101cb0 2024-05-10T03:39:50.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.600+0000 7f22a7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22a8102650 0x7f22a8103650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:50.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.600+0000 7f22a7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22a8102650 0x7f22a8103650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43920/0 (socket says 172.21.15.45:43920) 2024-05-10T03:39:50.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.600+0000 7f22a7fff700 1 -- 172.21.15.45:0/816784996 learned_addr learned my addr 172.21.15.45:0/816784996 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:50.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.600+0000 7f22a77fe700 1 --2- 172.21.15.45:0/816784996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22a8100b80 0x7f22a8104b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:50.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.600+0000 7f22a6ffd700 1 --2- 172.21.15.45:0/816784996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22a8101cb0 0x7f22a8102ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:50.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.600+0000 7f22a7fff700 1 -- 172.21.15.45:0/816784996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22a8101cb0 msgr2=0x7f22a8102ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:50.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.600+0000 7f22a7fff700 1 --2- 172.21.15.45:0/816784996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22a8101cb0 0x7f22a8102ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:50.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.600+0000 7f22a7fff700 1 -- 172.21.15.45:0/816784996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22a8100b80 msgr2=0x7f22a8104b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:50.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.600+0000 7f22a7fff700 1 --2- 172.21.15.45:0/816784996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22a8100b80 0x7f22a8104b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:50.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.600+0000 7f22a7fff700 1 -- 172.21.15.45:0/816784996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229c0095f0 con 0x7f22a8102650 2024-05-10T03:39:50.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.600+0000 7f22a6ffd700 1 --2- 172.21.15.45:0/816784996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22a8101cb0 0x7f22a8102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:50.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.600+0000 7f22a7fff700 1 --2- 172.21.15.45:0/816784996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22a8102650 0x7f22a8103650 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f22a000ef60 tx=0x7f22a000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:50.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.600+0000 7f22a4ff9700 1 -- 172.21.15.45:0/816784996 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a0018070 con 0x7f22a8102650 2024-05-10T03:39:50.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.600+0000 7f22a4ff9700 1 -- 172.21.15.45:0/816784996 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f22a000f040 con 0x7f22a8102650 2024-05-10T03:39:50.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.600+0000 7f22a4ff9700 1 -- 172.21.15.45:0/816784996 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a000ce10 con 0x7f22a8102650 2024-05-10T03:39:50.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.600+0000 7f22adba6700 1 -- 172.21.15.45:0/816784996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a81a2510 con 0x7f22a8102650 2024-05-10T03:39:50.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.601+0000 7f22adba6700 1 -- 172.21.15.45:0/816784996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a81a29c0 con 0x7f22a8102650 2024-05-10T03:39:50.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.602+0000 7f22adba6700 1 -- 172.21.15.45:0/816784996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a80ffe80 con 0x7f22a8102650 2024-05-10T03:39:50.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.603+0000 7f22a4ff9700 1 -- 172.21.15.45:0/816784996 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f22a0004ad0 con 0x7f22a8102650 2024-05-10T03:39:50.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.604+0000 7f22a4ff9700 1 --2- 172.21.15.45:0/816784996 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f22900a11b0 0x7f22900a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:50.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.604+0000 7f22a4ff9700 1 -- 172.21.15.45:0/816784996 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f22a00cd2c0 con 0x7f22a8102650 2024-05-10T03:39:50.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.604+0000 7f22a77fe700 1 --2- 172.21.15.45:0/816784996 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f22900a11b0 0x7f22900a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:50.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.604+0000 7f22a77fe700 1 --2- 172.21.15.45:0/816784996 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f22900a11b0 0x7f22900a36c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f22a8104860 tx=0x7f2298009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:50.610 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.608+0000 7f22a4ff9700 1 -- 172.21.15.45:0/816784996 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f22a0096670 con 0x7f22a8102650 2024-05-10T03:39:50.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.839+0000 7f22adba6700 1 -- 172.21.15.45:0/816784996 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f22a80fe260 con 0x7f22900a11b0 2024-05-10T03:39:50.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.840+0000 7f22a4ff9700 1 -- 172.21.15.45:0/816784996 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f22a80fe260 con 0x7f22900a11b0 2024-05-10T03:39:50.842 INFO:teuthology.orchestra.run.smithi045.stdout:Backend: cephadm 2024-05-10T03:39:50.842 INFO:teuthology.orchestra.run.smithi045.stdout:Available: Yes 2024-05-10T03:39:50.842 INFO:teuthology.orchestra.run.smithi045.stdout:Paused: No 2024-05-10T03:39:50.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.842+0000 7f22adba6700 1 -- 172.21.15.45:0/816784996 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f22900a11b0 msgr2=0x7f22900a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:50.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.842+0000 7f22adba6700 1 --2- 172.21.15.45:0/816784996 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f22900a11b0 0x7f22900a36c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f22a8104860 tx=0x7f2298009260 comp rx=0 tx=0).stop 2024-05-10T03:39:50.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.842+0000 7f22adba6700 1 -- 172.21.15.45:0/816784996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22a8102650 msgr2=0x7f22a8103650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:50.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.842+0000 7f22adba6700 1 --2- 172.21.15.45:0/816784996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22a8102650 0x7f22a8103650 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f22a000ef60 tx=0x7f22a000ef90 comp rx=0 tx=0).stop 2024-05-10T03:39:50.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.842+0000 7f22adba6700 1 -- 172.21.15.45:0/816784996 shutdown_connections 2024-05-10T03:39:50.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.842+0000 7f22adba6700 1 --2- 172.21.15.45:0/816784996 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f22900a11b0 0x7f22900a36c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:50.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.842+0000 7f22adba6700 1 --2- 172.21.15.45:0/816784996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22a8102650 0x7f22a8103650 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:50.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.842+0000 7f22adba6700 1 --2- 172.21.15.45:0/816784996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22a8100b80 0x7f22a8104b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:50.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.842+0000 7f22adba6700 1 --2- 172.21.15.45:0/816784996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22a8101cb0 0x7f22a8102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:50.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.842+0000 7f22adba6700 1 -- 172.21.15.45:0/816784996 >> 172.21.15.45:0/816784996 conn(0x7f22a80fc1c0 msgr2=0x7f22a80fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:50.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.842+0000 7f22adba6700 1 -- 172.21.15.45:0/816784996 shutdown_connections 2024-05-10T03:39:50.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:50.842+0000 7f22adba6700 1 -- 172.21.15.45:0/816784996 wait complete. 2024-05-10T03:39:51.167 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:50 smithi045 ceph-mon[42520]: pgmap v270: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-10T03:39:51.284 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- bash -c 'ceph orch ps' 2024-05-10T03:39:51.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:50 smithi106 ceph-mon[46996]: pgmap v270: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-10T03:39:51.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:50 smithi154 ceph-mon[46565]: pgmap v270: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-10T03:39:51.545 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:52.283 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:51 smithi045 ceph-mon[42520]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:52.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:51 smithi106 ceph-mon[46996]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:52.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:51 smithi154 ceph-mon[46565]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:52.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.627+0000 7fecd10de700 1 -- 172.21.15.45:0/287078014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feccc109b80 msgr2=0x7feccc10c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:52.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.627+0000 7fecd10de700 1 --2- 172.21.15.45:0/287078014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feccc109b80 0x7feccc10c060 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fecc400b0a0 tx=0x7fecc400b3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:52.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.627+0000 7fecd10de700 1 -- 172.21.15.45:0/287078014 shutdown_connections 2024-05-10T03:39:52.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.627+0000 7fecd10de700 1 --2- 172.21.15.45:0/287078014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feccc109b80 0x7feccc10c060 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:52.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.627+0000 7fecd10de700 1 --2- 172.21.15.45:0/287078014 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feccc0750b0 0x7feccc073580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:52.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.627+0000 7fecd10de700 1 --2- 172.21.15.45:0/287078014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feccc073ac0 0x7feccc073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:52.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.627+0000 7fecd10de700 1 -- 172.21.15.45:0/287078014 >> 172.21.15.45:0/287078014 conn(0x7feccc0fd300 msgr2=0x7feccc0ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:52.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.627+0000 7fecd10de700 1 -- 172.21.15.45:0/287078014 shutdown_connections 2024-05-10T03:39:52.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.627+0000 7fecd10de700 1 -- 172.21.15.45:0/287078014 wait complete. 2024-05-10T03:39:52.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.628+0000 7fecd10de700 1 Processor -- start 2024-05-10T03:39:52.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.628+0000 7fecd10de700 1 -- start start 2024-05-10T03:39:52.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.629+0000 7fecd10de700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feccc073ac0 0x7feccc19a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:52.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.629+0000 7fecd10de700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feccc0750b0 0x7feccc19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:52.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.629+0000 7fecd10de700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feccc109b80 0x7feccc19b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:52.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.629+0000 7fecd10de700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc19be80 con 0x7feccc109b80 2024-05-10T03:39:52.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.629+0000 7fecd10de700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc19bfc0 con 0x7feccc0750b0 2024-05-10T03:39:52.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.629+0000 7fecd10de700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc19c180 con 0x7feccc073ac0 2024-05-10T03:39:52.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.629+0000 7feccb59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feccc109b80 0x7feccc19b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:52.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.629+0000 7feccb59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feccc109b80 0x7feccc19b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43942/0 (socket says 172.21.15.45:43942) 2024-05-10T03:39:52.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.629+0000 7feccb59e700 1 -- 172.21.15.45:0/3093903480 learned_addr learned my addr 172.21.15.45:0/3093903480 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:52.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.629+0000 7fecca59c700 1 --2- 172.21.15.45:0/3093903480 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feccc0750b0 0x7feccc19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:52.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.629+0000 7feccad9d700 1 --2- 172.21.15.45:0/3093903480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feccc073ac0 0x7feccc19a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:52.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.629+0000 7feccb59e700 1 -- 172.21.15.45:0/3093903480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feccc073ac0 msgr2=0x7feccc19a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:52.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.629+0000 7feccb59e700 1 --2- 172.21.15.45:0/3093903480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feccc073ac0 0x7feccc19a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:52.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.629+0000 7feccb59e700 1 -- 172.21.15.45:0/3093903480 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feccc0750b0 msgr2=0x7feccc19aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:52.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.629+0000 7feccb59e700 1 --2- 172.21.15.45:0/3093903480 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feccc0750b0 0x7feccc19aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:52.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.629+0000 7feccb59e700 1 -- 172.21.15.45:0/3093903480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc4009d00 con 0x7feccc109b80 2024-05-10T03:39:52.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.629+0000 7fecca59c700 1 --2- 172.21.15.45:0/3093903480 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feccc0750b0 0x7feccc19aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:39:52.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.630+0000 7feccb59e700 1 --2- 172.21.15.45:0/3093903480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feccc109b80 0x7feccc19b820 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fecc400b830 tx=0x7fecc4009440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:52.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.630+0000 7fecb3fff700 1 -- 172.21.15.45:0/3093903480 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc400e040 con 0x7feccc109b80 2024-05-10T03:39:52.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.630+0000 7fecb3fff700 1 -- 172.21.15.45:0/3093903480 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fecc4004d60 con 0x7feccc109b80 2024-05-10T03:39:52.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.630+0000 7fecd10de700 1 -- 172.21.15.45:0/3093903480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feccc19c400 con 0x7feccc109b80 2024-05-10T03:39:52.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.630+0000 7fecb3fff700 1 -- 172.21.15.45:0/3093903480 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc401d480 con 0x7feccc109b80 2024-05-10T03:39:52.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.630+0000 7fecd10de700 1 -- 172.21.15.45:0/3093903480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feccc1a2c40 con 0x7feccc109b80 2024-05-10T03:39:52.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.631+0000 7fecd10de700 1 -- 172.21.15.45:0/3093903480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feccc108a20 con 0x7feccc109b80 2024-05-10T03:39:52.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.633+0000 7fecb3fff700 1 -- 172.21.15.45:0/3093903480 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fecc40040b0 con 0x7feccc109b80 2024-05-10T03:39:52.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.633+0000 7fecb3fff700 1 --2- 172.21.15.45:0/3093903480 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fecb40a11b0 0x7fecb40a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:52.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.634+0000 7fecb3fff700 1 -- 172.21.15.45:0/3093903480 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fecc40ceb00 con 0x7feccc109b80 2024-05-10T03:39:52.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.634+0000 7feccad9d700 1 --2- 172.21.15.45:0/3093903480 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fecb40a11b0 0x7fecb40a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:52.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.634+0000 7feccad9d700 1 --2- 172.21.15.45:0/3093903480 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fecb40a11b0 0x7fecb40a36c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fecbc005950 tx=0x7fecbc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:52.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.637+0000 7fecb3fff700 1 -- 172.21.15.45:0/3093903480 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fecc4097eb0 con 0x7feccc109b80 2024-05-10T03:39:52.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.859+0000 7fecd10de700 1 -- 172.21.15.45:0/3093903480 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feccc10f8d0 con 0x7fecb40a11b0 2024-05-10T03:39:52.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.874+0000 7fecb3fff700 1 -- 172.21.15.45:0/3093903480 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7feccc10f8d0 con 0x7fecb40a11b0 2024-05-10T03:39:52.876 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-10T03:39:52.877 INFO:teuthology.orchestra.run.smithi045.stdout:mds.a smithi045 running (84s) 16s ago 83s 85.3M - 18.2.2-1330-g50174015 0e8066d08b37 540ad2c9f461 2024-05-10T03:39:52.877 INFO:teuthology.orchestra.run.smithi045.stdout:mds.b smithi106 running (82s) 17s ago 82s 101M - 18.2.2-1330-g50174015 0e8066d08b37 41c32d8b9b23 2024-05-10T03:39:52.877 INFO:teuthology.orchestra.run.smithi045.stdout:mds.c smithi154 running (91s) 17s ago 91s 85.5M - 18.2.2-1330-g50174015 0e8066d08b37 4e880b69dbe1 2024-05-10T03:39:52.877 INFO:teuthology.orchestra.run.smithi045.stdout:mds.d smithi045 running (97s) 16s ago 96s 82.2M - 18.2.2-1330-g50174015 0e8066d08b37 c2b005224166 2024-05-10T03:39:52.877 INFO:teuthology.orchestra.run.smithi045.stdout:mds.e smithi106 running (95s) 17s ago 95s 85.8M - 18.2.2-1330-g50174015 0e8066d08b37 84e63105af13 2024-05-10T03:39:52.877 INFO:teuthology.orchestra.run.smithi045.stdout:mds.f smithi154 running (93s) 17s ago 93s 85.3M - 18.2.2-1330-g50174015 0e8066d08b37 7c3e8f1a87ad 2024-05-10T03:39:52.877 INFO:teuthology.orchestra.run.smithi045.stdout:mds.g smithi045 running (86s) 16s ago 85s 85.4M - 18.2.2-1330-g50174015 0e8066d08b37 e43dfc2f33d2 2024-05-10T03:39:52.877 INFO:teuthology.orchestra.run.smithi045.stdout:mds.h smithi106 running (89s) 17s ago 89s 86.8M - 18.2.2-1330-g50174015 0e8066d08b37 c54486f03134 2024-05-10T03:39:52.877 INFO:teuthology.orchestra.run.smithi045.stdout:mds.i smithi154 running (88s) 17s ago 87s 85.4M - 18.2.2-1330-g50174015 0e8066d08b37 562ff4b73ff5 2024-05-10T03:39:52.877 INFO:teuthology.orchestra.run.smithi045.stdout:mds.j smithi045 running (98s) 16s ago 98s 82.8M - 18.2.2-1330-g50174015 0e8066d08b37 feb00f4e3c49 2024-05-10T03:39:52.877 INFO:teuthology.orchestra.run.smithi045.stdout:mds.k smithi106 running (100s) 17s ago 100s 87.9M - 18.2.2-1330-g50174015 0e8066d08b37 35db0d1f7cb5 2024-05-10T03:39:52.877 INFO:teuthology.orchestra.run.smithi045.stdout:mds.l smithi154 running (102s) 17s ago 102s 84.9M - 18.2.2-1330-g50174015 0e8066d08b37 d3d56278b277 2024-05-10T03:39:52.877 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.x smithi045 *:9283,8765 running (7m) 16s ago 7m 598M - 18.2.2-1330-g50174015 0e8066d08b37 c851df018759 2024-05-10T03:39:52.877 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.y smithi106 *:8443,8765 running (5m) 17s ago 5m 525M - 18.2.2-1330-g50174015 0e8066d08b37 1c2c049c0173 2024-05-10T03:39:52.878 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.z smithi154 *:8443,8765 running (5m) 17s ago 5m 526M - 18.2.2-1330-g50174015 0e8066d08b37 6ddb02f561db 2024-05-10T03:39:52.878 INFO:teuthology.orchestra.run.smithi045.stdout:mon.a smithi045 running (7m) 16s ago 7m 159M 2048M 18.2.2-1330-g50174015 0e8066d08b37 8adf55387e85 2024-05-10T03:39:52.878 INFO:teuthology.orchestra.run.smithi045.stdout:mon.b smithi106 running (5m) 17s ago 5m 129M 2048M 18.2.2-1330-g50174015 0e8066d08b37 0c0c0707c756 2024-05-10T03:39:52.878 INFO:teuthology.orchestra.run.smithi045.stdout:mon.c smithi154 running (5m) 17s ago 5m 128M 2048M 18.2.2-1330-g50174015 0e8066d08b37 a477806f49dd 2024-05-10T03:39:52.878 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (5m) 16s ago 5m 138M 4279M 18.2.2-1330-g50174015 0e8066d08b37 f2c78148e55d 2024-05-10T03:39:52.878 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi106 running (4m) 17s ago 4m 218M 4278M 18.2.2-1330-g50174015 0e8066d08b37 e2b00e8eb94b 2024-05-10T03:39:52.878 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi154 running (4m) 17s ago 4m 219M 4278M 18.2.2-1330-g50174015 0e8066d08b37 f30281c8ed38 2024-05-10T03:39:52.878 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi045 running (4m) 16s ago 4m 133M 4279M 18.2.2-1330-g50174015 0e8066d08b37 20e2e9a18950 2024-05-10T03:39:52.878 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi106 running (4m) 17s ago 4m 130M 4278M 18.2.2-1330-g50174015 0e8066d08b37 21f29f47b3d1 2024-05-10T03:39:52.878 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi154 running (3m) 17s ago 3m 135M 4278M 18.2.2-1330-g50174015 0e8066d08b37 8f77b8a8906d 2024-05-10T03:39:52.878 INFO:teuthology.orchestra.run.smithi045.stdout:osd.6 smithi045 running (3m) 16s ago 3m 127M 4279M 18.2.2-1330-g50174015 0e8066d08b37 f042f41154c1 2024-05-10T03:39:52.878 INFO:teuthology.orchestra.run.smithi045.stdout:osd.7 smithi106 running (3m) 17s ago 3m 132M 4278M 18.2.2-1330-g50174015 0e8066d08b37 df42c53631d5 2024-05-10T03:39:52.878 INFO:teuthology.orchestra.run.smithi045.stdout:osd.8 smithi154 running (2m) 17s ago 2m 129M 4278M 18.2.2-1330-g50174015 0e8066d08b37 c4492812d78c 2024-05-10T03:39:52.879 INFO:teuthology.orchestra.run.smithi045.stdout:osd.9 smithi045 running (2m) 16s ago 2m 204M 4279M 18.2.2-1330-g50174015 0e8066d08b37 9f72ae4fcd83 2024-05-10T03:39:52.879 INFO:teuthology.orchestra.run.smithi045.stdout:osd.10 smithi106 running (2m) 17s ago 2m 130M 4278M 18.2.2-1330-g50174015 0e8066d08b37 eac61ab1a026 2024-05-10T03:39:52.879 INFO:teuthology.orchestra.run.smithi045.stdout:osd.11 smithi154 running (117s) 17s ago 117s 121M 4278M 18.2.2-1330-g50174015 0e8066d08b37 1a5ae02b157c 2024-05-10T03:39:52.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.876+0000 7fecd10de700 1 -- 172.21.15.45:0/3093903480 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fecb40a11b0 msgr2=0x7fecb40a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:52.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.876+0000 7fecd10de700 1 --2- 172.21.15.45:0/3093903480 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fecb40a11b0 0x7fecb40a36c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fecbc005950 tx=0x7fecbc00b410 comp rx=0 tx=0).stop 2024-05-10T03:39:52.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.876+0000 7fecd10de700 1 -- 172.21.15.45:0/3093903480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feccc109b80 msgr2=0x7feccc19b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:52.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.876+0000 7fecd10de700 1 --2- 172.21.15.45:0/3093903480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feccc109b80 0x7feccc19b820 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fecc400b830 tx=0x7fecc4009440 comp rx=0 tx=0).stop 2024-05-10T03:39:52.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.876+0000 7fecd10de700 1 -- 172.21.15.45:0/3093903480 shutdown_connections 2024-05-10T03:39:52.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.876+0000 7fecd10de700 1 --2- 172.21.15.45:0/3093903480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feccc073ac0 0x7feccc19a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:52.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.876+0000 7fecd10de700 1 --2- 172.21.15.45:0/3093903480 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fecb40a11b0 0x7fecb40a36c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:52.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.876+0000 7fecd10de700 1 --2- 172.21.15.45:0/3093903480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feccc109b80 0x7feccc19b820 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:52.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.876+0000 7fecd10de700 1 --2- 172.21.15.45:0/3093903480 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feccc0750b0 0x7feccc19aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:52.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.876+0000 7fecd10de700 1 -- 172.21.15.45:0/3093903480 >> 172.21.15.45:0/3093903480 conn(0x7feccc0fd300 msgr2=0x7feccc105b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:52.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.876+0000 7fecd10de700 1 -- 172.21.15.45:0/3093903480 shutdown_connections 2024-05-10T03:39:52.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:52.876+0000 7fecd10de700 1 -- 172.21.15.45:0/3093903480 wait complete. 2024-05-10T03:39:53.191 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:52 smithi045 ceph-mon[42520]: pgmap v271: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:39:53.293 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- bash -c 'ceph orch ls' 2024-05-10T03:39:53.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:52 smithi106 ceph-mon[46996]: pgmap v271: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:39:53.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:52 smithi154 ceph-mon[46565]: pgmap v271: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:39:53.553 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:54.283 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:53 smithi045 ceph-mon[42520]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:54.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:53 smithi106 ceph-mon[46996]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:54.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:53 smithi154 ceph-mon[46565]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:54.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.623+0000 7f2332a18700 1 -- 172.21.15.45:0/3557630589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f232c06a590 msgr2=0x7f232c104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:54.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.623+0000 7f2332a18700 1 --2- 172.21.15.45:0/3557630589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f232c06a590 0x7f232c104840 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f231c009990 tx=0x7f231c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:54.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.623+0000 7f2332a18700 1 -- 172.21.15.45:0/3557630589 shutdown_connections 2024-05-10T03:39:54.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.623+0000 7f2332a18700 1 --2- 172.21.15.45:0/3557630589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f232c107980 0x7f232c109e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:54.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.623+0000 7f2332a18700 1 --2- 172.21.15.45:0/3557630589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f232c06a590 0x7f232c104840 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:54.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.623+0000 7f2332a18700 1 --2- 172.21.15.45:0/3557630589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f232c104e10 0x7f232c1072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:54.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.623+0000 7f2332a18700 1 -- 172.21.15.45:0/3557630589 >> 172.21.15.45:0/3557630589 conn(0x7f232c0fc210 msgr2=0x7f232c0fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:54.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.623+0000 7f2332a18700 1 -- 172.21.15.45:0/3557630589 shutdown_connections 2024-05-10T03:39:54.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.623+0000 7f2332a18700 1 -- 172.21.15.45:0/3557630589 wait complete. 2024-05-10T03:39:54.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.623+0000 7f2332a18700 1 Processor -- start 2024-05-10T03:39:54.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.624+0000 7f2332a18700 1 -- start start 2024-05-10T03:39:54.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.624+0000 7f2332a18700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f232c06a590 0x7f232c1981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:54.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.624+0000 7f2332a18700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f232c104e10 0x7f232c198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:54.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.624+0000 7f2332a18700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f232c107980 0x7f232c1994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:54.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.624+0000 7f2332a18700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c199b30 con 0x7f232c06a590 2024-05-10T03:39:54.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.624+0000 7f2332a18700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c199c70 con 0x7f232c104e10 2024-05-10T03:39:54.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.624+0000 7f2332a18700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c199e30 con 0x7f232c107980 2024-05-10T03:39:54.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.624+0000 7f232bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f232c06a590 0x7f232c1981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:54.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.624+0000 7f232bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f232c06a590 0x7f232c1981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43962/0 (socket says 172.21.15.45:43962) 2024-05-10T03:39:54.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.624+0000 7f232bfff700 1 -- 172.21.15.45:0/4120202715 learned_addr learned my addr 172.21.15.45:0/4120202715 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:54.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.624+0000 7f2330fb5700 1 --2- 172.21.15.45:0/4120202715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f232c107980 0x7f232c1994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:54.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.624+0000 7f232b7fe700 1 --2- 172.21.15.45:0/4120202715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f232c104e10 0x7f232c198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:54.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.625+0000 7f232bfff700 1 -- 172.21.15.45:0/4120202715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f232c107980 msgr2=0x7f232c1994d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:54.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.625+0000 7f232bfff700 1 --2- 172.21.15.45:0/4120202715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f232c107980 0x7f232c1994d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:54.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.625+0000 7f232bfff700 1 -- 172.21.15.45:0/4120202715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f232c104e10 msgr2=0x7f232c198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:54.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.625+0000 7f232bfff700 1 --2- 172.21.15.45:0/4120202715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f232c104e10 0x7f232c198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:54.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.625+0000 7f232bfff700 1 -- 172.21.15.45:0/4120202715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c0095f0 con 0x7f232c06a590 2024-05-10T03:39:54.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.625+0000 7f232bfff700 1 --2- 172.21.15.45:0/4120202715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f232c06a590 0x7f232c1981e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f231c005b40 tx=0x7f231c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.625+0000 7f23297fa700 1 -- 172.21.15.45:0/4120202715 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c01d070 con 0x7f232c06a590 2024-05-10T03:39:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.625+0000 7f23297fa700 1 -- 172.21.15.45:0/4120202715 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f231c00fb80 con 0x7f232c06a590 2024-05-10T03:39:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.625+0000 7f2332a18700 1 -- 172.21.15.45:0/4120202715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232c19a0b0 con 0x7f232c06a590 2024-05-10T03:39:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.625+0000 7f23297fa700 1 -- 172.21.15.45:0/4120202715 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c0173f0 con 0x7f232c06a590 2024-05-10T03:39:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.625+0000 7f2332a18700 1 -- 172.21.15.45:0/4120202715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232c1a08f0 con 0x7f232c06a590 2024-05-10T03:39:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.626+0000 7f2332a18700 1 -- 172.21.15.45:0/4120202715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232c0fddc0 con 0x7f232c06a590 2024-05-10T03:39:54.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.629+0000 7f23297fa700 1 -- 172.21.15.45:0/4120202715 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f231c022470 con 0x7f232c06a590 2024-05-10T03:39:54.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.629+0000 7f23297fa700 1 --2- 172.21.15.45:0/4120202715 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f23140a11b0 0x7f23140a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:54.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.629+0000 7f232b7fe700 1 --2- 172.21.15.45:0/4120202715 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f23140a11b0 0x7f23140a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:54.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.629+0000 7f23297fa700 1 -- 172.21.15.45:0/4120202715 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f231c0ce3c0 con 0x7f232c06a590 2024-05-10T03:39:54.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.630+0000 7f232b7fe700 1 --2- 172.21.15.45:0/4120202715 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f23140a11b0 0x7f23140a36c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2320005950 tx=0x7f23200058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.633+0000 7f23297fa700 1 -- 172.21.15.45:0/4120202715 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f231c097770 con 0x7f232c06a590 2024-05-10T03:39:54.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.856+0000 7f2332a18700 1 -- 172.21.15.45:0/4120202715 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f232c10d6f0 con 0x7f23140a11b0 2024-05-10T03:39:54.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.862+0000 7f23297fa700 1 -- 172.21.15.45:0/4120202715 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+985 (secure 0 0 0) 0x7f232c10d6f0 con 0x7f23140a11b0 2024-05-10T03:39:54.865 INFO:teuthology.orchestra.run.smithi045.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-10T03:39:54.865 INFO:teuthology.orchestra.run.smithi045.stdout:mds.all 12/12 19s ago 106s smithi045=a;smithi045=d;smithi045=g;smithi045=j;smithi106=b;smithi106=e;smithi106=h;smithi106=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l;count:12 2024-05-10T03:39:54.865 INFO:teuthology.orchestra.run.smithi045.stdout:mgr 3/3 19s ago 5m smithi045=x;smithi106=y;smithi154=z;count:3 2024-05-10T03:39:54.865 INFO:teuthology.orchestra.run.smithi045.stdout:mon 3/3 19s ago 6m smithi045:172.21.15.45=a;smithi106:172.21.15.106=b;smithi154:172.21.15.154=c;count:3 2024-05-10T03:39:54.865 INFO:teuthology.orchestra.run.smithi045.stdout:osd 12 19s ago - 2024-05-10T03:39:54.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.865+0000 7f2332a18700 1 -- 172.21.15.45:0/4120202715 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f23140a11b0 msgr2=0x7f23140a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:54.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.865+0000 7f2332a18700 1 --2- 172.21.15.45:0/4120202715 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f23140a11b0 0x7f23140a36c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2320005950 tx=0x7f23200058e0 comp rx=0 tx=0).stop 2024-05-10T03:39:54.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.865+0000 7f2332a18700 1 -- 172.21.15.45:0/4120202715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f232c06a590 msgr2=0x7f232c1981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:54.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.865+0000 7f2332a18700 1 --2- 172.21.15.45:0/4120202715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f232c06a590 0x7f232c1981e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f231c005b40 tx=0x7f231c00f690 comp rx=0 tx=0).stop 2024-05-10T03:39:54.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.865+0000 7f2332a18700 1 -- 172.21.15.45:0/4120202715 shutdown_connections 2024-05-10T03:39:54.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.865+0000 7f2332a18700 1 --2- 172.21.15.45:0/4120202715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f232c107980 0x7f232c1994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:54.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.865+0000 7f2332a18700 1 --2- 172.21.15.45:0/4120202715 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f23140a11b0 0x7f23140a36c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:54.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.865+0000 7f2332a18700 1 --2- 172.21.15.45:0/4120202715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f232c06a590 0x7f232c1981e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:54.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.865+0000 7f2332a18700 1 --2- 172.21.15.45:0/4120202715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f232c104e10 0x7f232c198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:54.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.865+0000 7f2332a18700 1 -- 172.21.15.45:0/4120202715 >> 172.21.15.45:0/4120202715 conn(0x7f232c0fc210 msgr2=0x7f232c103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:54.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.865+0000 7f2332a18700 1 -- 172.21.15.45:0/4120202715 shutdown_connections 2024-05-10T03:39:54.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:54.865+0000 7f2332a18700 1 -- 172.21.15.45:0/4120202715 wait complete. 2024-05-10T03:39:55.183 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:54 smithi045 ceph-mon[42520]: pgmap v272: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:39:55.292 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- bash -c 'ceph orch host ls' 2024-05-10T03:39:55.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:54 smithi106 ceph-mon[46996]: pgmap v272: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:39:55.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:54 smithi154 ceph-mon[46565]: pgmap v272: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:39:55.549 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:56.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:55 smithi045 ceph-mon[42520]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:56.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:55 smithi106 ceph-mon[46996]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:56.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:55 smithi154 ceph-mon[46565]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:56.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.612+0000 7f9ec3b7b700 1 -- 172.21.15.45:0/2831101227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ebc100570 msgr2=0x7f9ebc102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:56.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.612+0000 7f9ec3b7b700 1 --2- 172.21.15.45:0/2831101227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ebc100570 0x7f9ebc102990 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8009990 tx=0x7f9eb8009ca0 comp rx=0 tx=0).stop 2024-05-10T03:39:56.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.612+0000 7f9ec3b7b700 1 -- 172.21.15.45:0/2831101227 shutdown_connections 2024-05-10T03:39:56.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.612+0000 7f9ec3b7b700 1 --2- 172.21.15.45:0/2831101227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ebc105830 0x7f9ebc105c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:56.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.612+0000 7f9ec3b7b700 1 --2- 172.21.15.45:0/2831101227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ebc100570 0x7f9ebc102990 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:56.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.612+0000 7f9ec3b7b700 1 --2- 172.21.15.45:0/2831101227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ebc102ed0 0x7f9ebc1052f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:56.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.612+0000 7f9ec3b7b700 1 -- 172.21.15.45:0/2831101227 >> 172.21.15.45:0/2831101227 conn(0x7f9ebc0fc1c0 msgr2=0x7f9ebc0fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:56.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.612+0000 7f9ec3b7b700 1 -- 172.21.15.45:0/2831101227 shutdown_connections 2024-05-10T03:39:56.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.612+0000 7f9ec3b7b700 1 -- 172.21.15.45:0/2831101227 wait complete. 2024-05-10T03:39:56.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.613+0000 7f9ec3b7b700 1 Processor -- start 2024-05-10T03:39:56.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.613+0000 7f9ec3b7b700 1 -- start start 2024-05-10T03:39:56.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.613+0000 7f9ec3b7b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ebc100570 0x7f9ebc19e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:56.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.613+0000 7f9ec3b7b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ebc102ed0 0x7f9ebc19ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:56.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.613+0000 7f9ec3b7b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ebc105830 0x7f9ebc19fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:56.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.613+0000 7f9ec3b7b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc1a0160 con 0x7f9ebc102ed0 2024-05-10T03:39:56.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.613+0000 7f9ec3b7b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc1a02a0 con 0x7f9ebc100570 2024-05-10T03:39:56.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.613+0000 7f9ec3b7b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc1a0460 con 0x7f9ebc105830 2024-05-10T03:39:56.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.613+0000 7f9ec1116700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ebc102ed0 0x7f9ebc19ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:56.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.614+0000 7f9ec1116700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ebc102ed0 0x7f9ebc19ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43970/0 (socket says 172.21.15.45:43970) 2024-05-10T03:39:56.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.614+0000 7f9ec1116700 1 -- 172.21.15.45:0/1132310019 learned_addr learned my addr 172.21.15.45:0/1132310019 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:56.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.614+0000 7f9ec2118700 1 --2- 172.21.15.45:0/1132310019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ebc105830 0x7f9ebc19fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:56.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.614+0000 7f9ec1917700 1 --2- 172.21.15.45:0/1132310019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ebc100570 0x7f9ebc19e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:56.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.614+0000 7f9ec1116700 1 -- 172.21.15.45:0/1132310019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ebc105830 msgr2=0x7f9ebc19fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:56.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.614+0000 7f9ec1116700 1 --2- 172.21.15.45:0/1132310019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ebc105830 0x7f9ebc19fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:56.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.614+0000 7f9ec1116700 1 -- 172.21.15.45:0/1132310019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ebc100570 msgr2=0x7f9ebc19e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:56.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.614+0000 7f9ec1116700 1 --2- 172.21.15.45:0/1132310019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ebc100570 0x7f9ebc19e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:56.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.614+0000 7f9ec1116700 1 -- 172.21.15.45:0/1132310019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb80095f0 con 0x7f9ebc102ed0 2024-05-10T03:39:56.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.614+0000 7f9ec1116700 1 --2- 172.21.15.45:0/1132310019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ebc102ed0 0x7f9ebc19ed50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000d980 tx=0x7f9eb000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:56.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.614+0000 7f9eaeffd700 1 -- 172.21.15.45:0/1132310019 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0004220 con 0x7f9ebc102ed0 2024-05-10T03:39:56.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.614+0000 7f9eaeffd700 1 -- 172.21.15.45:0/1132310019 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9eb0007640 con 0x7f9ebc102ed0 2024-05-10T03:39:56.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.614+0000 7f9eaeffd700 1 -- 172.21.15.45:0/1132310019 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb000f690 con 0x7f9ebc102ed0 2024-05-10T03:39:56.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.614+0000 7f9ec3b7b700 1 -- 172.21.15.45:0/1132310019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ebc1a0740 con 0x7f9ebc102ed0 2024-05-10T03:39:56.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.615+0000 7f9ec3b7b700 1 -- 172.21.15.45:0/1132310019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ebc1a6f20 con 0x7f9ebc102ed0 2024-05-10T03:39:56.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.616+0000 7f9ec3b7b700 1 -- 172.21.15.45:0/1132310019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ebc0fdd70 con 0x7f9ebc102ed0 2024-05-10T03:39:56.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.617+0000 7f9eaeffd700 1 -- 172.21.15.45:0/1132310019 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f9eb0004410 con 0x7f9ebc102ed0 2024-05-10T03:39:56.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.618+0000 7f9eaeffd700 1 --2- 172.21.15.45:0/1132310019 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9ea80a1230 0x7f9ea80a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:56.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.618+0000 7f9eaeffd700 1 -- 172.21.15.45:0/1132310019 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f9eb00cd060 con 0x7f9ebc102ed0 2024-05-10T03:39:56.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.618+0000 7f9ec1917700 1 --2- 172.21.15.45:0/1132310019 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9ea80a1230 0x7f9ea80a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:56.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.618+0000 7f9ec1917700 1 --2- 172.21.15.45:0/1132310019 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9ea80a1230 0x7f9ea80a3740 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800b2e0 tx=0x7f9eb801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:56.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.622+0000 7f9eaeffd700 1 -- 172.21.15.45:0/1132310019 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9eb0096380 con 0x7f9ebc102ed0 2024-05-10T03:39:56.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.843+0000 7f9ec3b7b700 1 -- 172.21.15.45:0/1132310019 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ebc061650 con 0x7f9ea80a1230 2024-05-10T03:39:56.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.844+0000 7f9eaeffd700 1 -- 172.21.15.45:0/1132310019 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f9ebc061650 con 0x7f9ea80a1230 2024-05-10T03:39:56.847 INFO:teuthology.orchestra.run.smithi045.stdout:HOST ADDR LABELS STATUS 2024-05-10T03:39:56.847 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045 172.21.15.45 2024-05-10T03:39:56.847 INFO:teuthology.orchestra.run.smithi045.stdout:smithi106 172.21.15.106 2024-05-10T03:39:56.847 INFO:teuthology.orchestra.run.smithi045.stdout:smithi154 172.21.15.154 2024-05-10T03:39:56.847 INFO:teuthology.orchestra.run.smithi045.stdout:3 hosts in cluster 2024-05-10T03:39:56.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.847+0000 7f9ec3b7b700 1 -- 172.21.15.45:0/1132310019 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9ea80a1230 msgr2=0x7f9ea80a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:56.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.847+0000 7f9ec3b7b700 1 --2- 172.21.15.45:0/1132310019 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9ea80a1230 0x7f9ea80a3740 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800b2e0 tx=0x7f9eb801a040 comp rx=0 tx=0).stop 2024-05-10T03:39:56.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.847+0000 7f9ec3b7b700 1 -- 172.21.15.45:0/1132310019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ebc102ed0 msgr2=0x7f9ebc19ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:56.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.847+0000 7f9ec3b7b700 1 --2- 172.21.15.45:0/1132310019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ebc102ed0 0x7f9ebc19ed50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000d980 tx=0x7f9eb000dc90 comp rx=0 tx=0).stop 2024-05-10T03:39:56.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.847+0000 7f9ec3b7b700 1 -- 172.21.15.45:0/1132310019 shutdown_connections 2024-05-10T03:39:56.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.847+0000 7f9ec3b7b700 1 --2- 172.21.15.45:0/1132310019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ebc105830 0x7f9ebc19fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:56.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.847+0000 7f9ec3b7b700 1 --2- 172.21.15.45:0/1132310019 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9ea80a1230 0x7f9ea80a3740 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:56.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.847+0000 7f9ec3b7b700 1 --2- 172.21.15.45:0/1132310019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ebc100570 0x7f9ebc19e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:56.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.847+0000 7f9ec3b7b700 1 --2- 172.21.15.45:0/1132310019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ebc102ed0 0x7f9ebc19ed50 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:56.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.847+0000 7f9ec3b7b700 1 -- 172.21.15.45:0/1132310019 >> 172.21.15.45:0/1132310019 conn(0x7f9ebc0fc1c0 msgr2=0x7f9ebc101470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:56.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.847+0000 7f9ec3b7b700 1 -- 172.21.15.45:0/1132310019 shutdown_connections 2024-05-10T03:39:56.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:56.847+0000 7f9ec3b7b700 1 -- 172.21.15.45:0/1132310019 wait complete. 2024-05-10T03:39:57.132 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:56 smithi045 ceph-mon[42520]: pgmap v273: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T03:39:57.250 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- bash -c 'ceph orch device ls' 2024-05-10T03:39:57.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:56 smithi106 ceph-mon[46996]: pgmap v273: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T03:39:57.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:56 smithi154 ceph-mon[46565]: pgmap v273: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T03:39:57.508 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:39:58.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:58 smithi045 ceph-mon[42520]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:58.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:58 smithi106 ceph-mon[46996]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:58.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:58 smithi154 ceph-mon[46565]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:39:58.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.590+0000 7f14da544700 1 -- 172.21.15.45:0/3597867734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d41037b0 msgr2=0x7f14d410a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:58.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.590+0000 7f14da544700 1 --2- 172.21.15.45:0/3597867734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d41037b0 0x7f14d410a060 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00b0a0 tx=0x7f14cc00b3b0 comp rx=0 tx=0).stop 2024-05-10T03:39:58.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.590+0000 7f14da544700 1 -- 172.21.15.45:0/3597867734 shutdown_connections 2024-05-10T03:39:58.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.590+0000 7f14da544700 1 --2- 172.21.15.45:0/3597867734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14d4101ce0 0x7f14d41020f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:58.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.590+0000 7f14da544700 1 --2- 172.21.15.45:0/3597867734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d41037b0 0x7f14d410a060 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:58.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.590+0000 7f14da544700 1 --2- 172.21.15.45:0/3597867734 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14d4102e10 0x7f14d4103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:58.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.590+0000 7f14da544700 1 -- 172.21.15.45:0/3597867734 >> 172.21.15.45:0/3597867734 conn(0x7f14d40fd320 msgr2=0x7f14d40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:58.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.590+0000 7f14da544700 1 -- 172.21.15.45:0/3597867734 shutdown_connections 2024-05-10T03:39:58.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.590+0000 7f14da544700 1 -- 172.21.15.45:0/3597867734 wait complete. 2024-05-10T03:39:58.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.591+0000 7f14da544700 1 Processor -- start 2024-05-10T03:39:58.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.591+0000 7f14da544700 1 -- start start 2024-05-10T03:39:58.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.592+0000 7f14da544700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14d4101ce0 0x7f14d4198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:58.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.592+0000 7f14da544700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14d4102e10 0x7f14d4198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:58.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.592+0000 7f14da544700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d41037b0 0x7f14d41995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:58.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.592+0000 7f14da544700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d4199c50 con 0x7f14d41037b0 2024-05-10T03:39:58.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.592+0000 7f14da544700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d4199d90 con 0x7f14d4101ce0 2024-05-10T03:39:58.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.592+0000 7f14da544700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d4199f50 con 0x7f14d4102e10 2024-05-10T03:39:58.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.592+0000 7f14d8ae1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d41037b0 0x7f14d41995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:58.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.592+0000 7f14d8ae1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d41037b0 0x7f14d41995f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36420/0 (socket says 172.21.15.45:36420) 2024-05-10T03:39:58.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.592+0000 7f14d8ae1700 1 -- 172.21.15.45:0/2833264365 learned_addr learned my addr 172.21.15.45:0/2833264365 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:39:58.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.592+0000 7f14d3fff700 1 --2- 172.21.15.45:0/2833264365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14d4101ce0 0x7f14d4198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:58.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.592+0000 7f14d37fe700 1 --2- 172.21.15.45:0/2833264365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14d4102e10 0x7f14d4198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:58.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.593+0000 7f14d8ae1700 1 -- 172.21.15.45:0/2833264365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14d4102e10 msgr2=0x7f14d4198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:58.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.593+0000 7f14d8ae1700 1 --2- 172.21.15.45:0/2833264365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14d4102e10 0x7f14d4198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:58.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.593+0000 7f14d8ae1700 1 -- 172.21.15.45:0/2833264365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14d4101ce0 msgr2=0x7f14d4198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:58.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.593+0000 7f14d8ae1700 1 --2- 172.21.15.45:0/2833264365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14d4101ce0 0x7f14d4198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:58.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.593+0000 7f14d8ae1700 1 -- 172.21.15.45:0/2833264365 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14cc009d00 con 0x7f14d41037b0 2024-05-10T03:39:58.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.593+0000 7f14d8ae1700 1 --2- 172.21.15.45:0/2833264365 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d41037b0 0x7f14d41995f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00b830 tx=0x7f14cc009440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:58.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.593+0000 7f14d17fa700 1 -- 172.21.15.45:0/2833264365 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc00e040 con 0x7f14d41037b0 2024-05-10T03:39:58.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.593+0000 7f14da544700 1 -- 172.21.15.45:0/2833264365 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d419a1d0 con 0x7f14d41037b0 2024-05-10T03:39:58.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.593+0000 7f14d17fa700 1 -- 172.21.15.45:0/2833264365 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f14cc004d60 con 0x7f14d41037b0 2024-05-10T03:39:58.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.593+0000 7f14d17fa700 1 -- 172.21.15.45:0/2833264365 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc01d480 con 0x7f14d41037b0 2024-05-10T03:39:58.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.593+0000 7f14da544700 1 -- 172.21.15.45:0/2833264365 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d41a0a10 con 0x7f14d41037b0 2024-05-10T03:39:58.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.594+0000 7f14da544700 1 -- 172.21.15.45:0/2833264365 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d4108f00 con 0x7f14d41037b0 2024-05-10T03:39:58.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.595+0000 7f14d17fa700 1 -- 172.21.15.45:0/2833264365 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f14cc0040b0 con 0x7f14d41037b0 2024-05-10T03:39:58.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.596+0000 7f14d17fa700 1 --2- 172.21.15.45:0/2833264365 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f14bc0a11b0 0x7f14bc0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:39:58.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.596+0000 7f14d3fff700 1 --2- 172.21.15.45:0/2833264365 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f14bc0a11b0 0x7f14bc0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:39:58.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.596+0000 7f14d17fa700 1 -- 172.21.15.45:0/2833264365 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f14cc0ceb00 con 0x7f14d41037b0 2024-05-10T03:39:58.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.597+0000 7f14d3fff700 1 --2- 172.21.15.45:0/2833264365 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f14bc0a11b0 0x7f14bc0a36c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f14d4102d10 tx=0x7f14c400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:39:58.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.600+0000 7f14d17fa700 1 -- 172.21.15.45:0/2833264365 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f14cc097eb0 con 0x7f14d41037b0 2024-05-10T03:39:58.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.821+0000 7f14da544700 1 -- 172.21.15.45:0/2833264365 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f14d410d780 con 0x7f14bc0a11b0 2024-05-10T03:39:58.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.823+0000 7f14d17fa700 1 -- 172.21.15.45:0/2833264365 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7f14d410d780 con 0x7f14bc0a11b0 2024-05-10T03:39:58.826 INFO:teuthology.orchestra.run.smithi045.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-05-10T03:39:58.826 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75120098480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-05-10T03:39:58.826 INFO:teuthology.orchestra.run.smithi045.stdout:smithi106 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204013R400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-05-10T03:39:58.826 INFO:teuthology.orchestra.run.smithi045.stdout:smithi154 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233003B400BGN 372G No 118s ago Has a FileSystem, LVM detected 2024-05-10T03:39:58.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.826+0000 7f14da544700 1 -- 172.21.15.45:0/2833264365 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f14bc0a11b0 msgr2=0x7f14bc0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:58.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.826+0000 7f14da544700 1 --2- 172.21.15.45:0/2833264365 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f14bc0a11b0 0x7f14bc0a36c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f14d4102d10 tx=0x7f14c400b410 comp rx=0 tx=0).stop 2024-05-10T03:39:58.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.826+0000 7f14da544700 1 -- 172.21.15.45:0/2833264365 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d41037b0 msgr2=0x7f14d41995f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:39:58.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.826+0000 7f14da544700 1 --2- 172.21.15.45:0/2833264365 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d41037b0 0x7f14d41995f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00b830 tx=0x7f14cc009440 comp rx=0 tx=0).stop 2024-05-10T03:39:58.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.826+0000 7f14da544700 1 -- 172.21.15.45:0/2833264365 shutdown_connections 2024-05-10T03:39:58.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.826+0000 7f14da544700 1 --2- 172.21.15.45:0/2833264365 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f14bc0a11b0 0x7f14bc0a36c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:58.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.826+0000 7f14da544700 1 --2- 172.21.15.45:0/2833264365 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14d41037b0 0x7f14d41995f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:58.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.826+0000 7f14da544700 1 --2- 172.21.15.45:0/2833264365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14d4101ce0 0x7f14d4198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:58.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.826+0000 7f14da544700 1 --2- 172.21.15.45:0/2833264365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14d4102e10 0x7f14d4198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:39:58.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.826+0000 7f14da544700 1 -- 172.21.15.45:0/2833264365 >> 172.21.15.45:0/2833264365 conn(0x7f14d40fd320 msgr2=0x7f14d4106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:39:58.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.826+0000 7f14da544700 1 -- 172.21.15.45:0/2833264365 shutdown_connections 2024-05-10T03:39:58.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:39:58.826+0000 7f14da544700 1 -- 172.21.15.45:0/2833264365 wait complete. 2024-05-10T03:39:59.107 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:39:59 smithi045 ceph-mon[42520]: pgmap v274: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:39:59.223 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-10T03:39:59.232 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi045.front.sepia.ceph.com 2024-05-10T03:39:59.232 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-10T03:39:59.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:39:59 smithi106 ceph-mon[46996]: pgmap v274: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:39:59.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:39:59 smithi154 ceph-mon[46565]: pgmap v274: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:39:59.491 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:40:00.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:00 smithi045 ceph-mon[42520]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:40:00.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:00 smithi045 ceph-mon[42520]: overall HEALTH_OK 2024-05-10T03:40:00.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:00 smithi106 ceph-mon[46996]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:40:00.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:00 smithi106 ceph-mon[46996]: overall HEALTH_OK 2024-05-10T03:40:00.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:00 smithi154 ceph-mon[46565]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:40:00.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:00 smithi154 ceph-mon[46565]: overall HEALTH_OK 2024-05-10T03:40:00.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.551+0000 7ffaeb26c700 1 -- 172.21.15.45:0/679416310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffae4100ec0 msgr2=0x7ffae41012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:00.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.551+0000 7ffaeb26c700 1 --2- 172.21.15.45:0/679416310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffae4100ec0 0x7ffae41012d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ffad4009990 tx=0x7ffad4009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:00.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.551+0000 7ffaeb26c700 1 -- 172.21.15.45:0/679416310 shutdown_connections 2024-05-10T03:40:00.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.551+0000 7ffaeb26c700 1 --2- 172.21.15.45:0/679416310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae4100570 0x7ffae4100980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:00.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.551+0000 7ffaeb26c700 1 --2- 172.21.15.45:0/679416310 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffae4101810 0x7ffae4101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:00.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.551+0000 7ffaeb26c700 1 --2- 172.21.15.45:0/679416310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffae4100ec0 0x7ffae41012d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:00.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.551+0000 7ffaeb26c700 1 -- 172.21.15.45:0/679416310 >> 172.21.15.45:0/679416310 conn(0x7ffae40fc1c0 msgr2=0x7ffae40fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:00.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.551+0000 7ffaeb26c700 1 -- 172.21.15.45:0/679416310 shutdown_connections 2024-05-10T03:40:00.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.551+0000 7ffaeb26c700 1 -- 172.21.15.45:0/679416310 wait complete. 2024-05-10T03:40:00.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.552+0000 7ffaeb26c700 1 Processor -- start 2024-05-10T03:40:00.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.552+0000 7ffaeb26c700 1 -- start start 2024-05-10T03:40:00.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.552+0000 7ffaeb26c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae4100570 0x7ffae419a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.552+0000 7ffaeb26c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffae4100ec0 0x7ffae419a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.552+0000 7ffaeb26c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffae4101810 0x7ffae419b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.552+0000 7ffaeb26c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae419bce0 con 0x7ffae4100ec0 2024-05-10T03:40:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.552+0000 7ffaeb26c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae419be20 con 0x7ffae4101810 2024-05-10T03:40:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.552+0000 7ffaeb26c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae419bfe0 con 0x7ffae4100570 2024-05-10T03:40:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.552+0000 7ffae8807700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffae4100ec0 0x7ffae419a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.552+0000 7ffae8807700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffae4100ec0 0x7ffae419a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36440/0 (socket says 172.21.15.45:36440) 2024-05-10T03:40:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.552+0000 7ffae8807700 1 -- 172.21.15.45:0/94669598 learned_addr learned my addr 172.21.15.45:0/94669598 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.553+0000 7ffae9008700 1 --2- 172.21.15.45:0/94669598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae4100570 0x7ffae419a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.553+0000 7ffae9809700 1 --2- 172.21.15.45:0/94669598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffae4101810 0x7ffae419b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.553+0000 7ffae8807700 1 -- 172.21.15.45:0/94669598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae4100570 msgr2=0x7ffae419a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.553+0000 7ffae8807700 1 --2- 172.21.15.45:0/94669598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae4100570 0x7ffae419a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.553+0000 7ffae8807700 1 -- 172.21.15.45:0/94669598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffae4101810 msgr2=0x7ffae419b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:00.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.553+0000 7ffae8807700 1 --2- 172.21.15.45:0/94669598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffae4101810 0x7ffae419b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:00.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.553+0000 7ffae8807700 1 -- 172.21.15.45:0/94669598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad40095f0 con 0x7ffae4100ec0 2024-05-10T03:40:00.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.553+0000 7ffae8807700 1 --2- 172.21.15.45:0/94669598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffae4100ec0 0x7ffae419a920 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ffad4005b40 tx=0x7ffad400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:00.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.553+0000 7ffada7fc700 1 -- 172.21.15.45:0/94669598 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad401d070 con 0x7ffae4100ec0 2024-05-10T03:40:00.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.553+0000 7ffada7fc700 1 -- 172.21.15.45:0/94669598 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ffad4022470 con 0x7ffae4100ec0 2024-05-10T03:40:00.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.553+0000 7ffaeb26c700 1 -- 172.21.15.45:0/94669598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae419c260 con 0x7ffae4100ec0 2024-05-10T03:40:00.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.553+0000 7ffada7fc700 1 -- 172.21.15.45:0/94669598 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad4017650 con 0x7ffae4100ec0 2024-05-10T03:40:00.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.553+0000 7ffaeb26c700 1 -- 172.21.15.45:0/94669598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae41a2aa0 con 0x7ffae4100ec0 2024-05-10T03:40:00.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.555+0000 7ffaeb26c700 1 -- 172.21.15.45:0/94669598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffae410ba60 con 0x7ffae4100ec0 2024-05-10T03:40:00.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.556+0000 7ffada7fc700 1 -- 172.21.15.45:0/94669598 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ffad4022950 con 0x7ffae4100ec0 2024-05-10T03:40:00.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.556+0000 7ffada7fc700 1 --2- 172.21.15.45:0/94669598 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ffad00a11b0 0x7ffad00a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:00.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.557+0000 7ffae9008700 1 --2- 172.21.15.45:0/94669598 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ffad00a11b0 0x7ffad00a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:00.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.557+0000 7ffada7fc700 1 -- 172.21.15.45:0/94669598 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ffad40cde00 con 0x7ffae4100ec0 2024-05-10T03:40:00.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.557+0000 7ffae9008700 1 --2- 172.21.15.45:0/94669598 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ffad00a11b0 0x7ffad00a36c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffae0005950 tx=0x7ffae000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:00.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.561+0000 7ffada7fc700 1 -- 172.21.15.45:0/94669598 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ffad405dd60 con 0x7ffae4100ec0 2024-05-10T03:40:00.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.822+0000 7ffaeb26c700 1 -- 172.21.15.45:0/94669598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffae404edc0 con 0x7ffae4100ec0 2024-05-10T03:40:00.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.823+0000 7ffada7fc700 1 -- 172.21.15.45:0/94669598 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+2934 (secure 0 0 0) 0x7ffad4027b90 con 0x7ffae4100ec0 2024-05-10T03:40:00.826 INFO:teuthology.orchestra.run.smithi045.stdout:e27 2024-05-10T03:40:00.826 INFO:teuthology.orchestra.run.smithi045.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-10T03:40:00.826 INFO:teuthology.orchestra.run.smithi045.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-10T03:40:00.826 INFO:teuthology.orchestra.run.smithi045.stdout:legacy client fscid: 1 2024-05-10T03:40:00.826 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:40:00.826 INFO:teuthology.orchestra.run.smithi045.stdout:Filesystem 'cephfs' (1) 2024-05-10T03:40:00.826 INFO:teuthology.orchestra.run.smithi045.stdout:fs_name cephfs 2024-05-10T03:40:00.826 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 27 2024-05-10T03:40:00.826 INFO:teuthology.orchestra.run.smithi045.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-05-10T03:40:00.826 INFO:teuthology.orchestra.run.smithi045.stdout:created 2024-05-10T03:38:36.555290+0000 2024-05-10T03:40:00.826 INFO:teuthology.orchestra.run.smithi045.stdout:modified 2024-05-10T03:39:00.010786+0000 2024-05-10T03:40:00.826 INFO:teuthology.orchestra.run.smithi045.stdout:tableserver 0 2024-05-10T03:40:00.827 INFO:teuthology.orchestra.run.smithi045.stdout:root 0 2024-05-10T03:40:00.827 INFO:teuthology.orchestra.run.smithi045.stdout:session_timeout 300 2024-05-10T03:40:00.827 INFO:teuthology.orchestra.run.smithi045.stdout:session_autoclose 300 2024-05-10T03:40:00.827 INFO:teuthology.orchestra.run.smithi045.stdout:max_file_size 1099511627776 2024-05-10T03:40:00.827 INFO:teuthology.orchestra.run.smithi045.stdout:max_xattr_size 65536 2024-05-10T03:40:00.827 INFO:teuthology.orchestra.run.smithi045.stdout:required_client_features {} 2024-05-10T03:40:00.827 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure 0 2024-05-10T03:40:00.827 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure_osd_epoch 0 2024-05-10T03:40:00.827 INFO:teuthology.orchestra.run.smithi045.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-10T03:40:00.827 INFO:teuthology.orchestra.run.smithi045.stdout:max_mds 5 2024-05-10T03:40:00.827 INFO:teuthology.orchestra.run.smithi045.stdout:in 0,1,2,3,4 2024-05-10T03:40:00.827 INFO:teuthology.orchestra.run.smithi045.stdout:up {0=24590,1=24548,2=24547,3=24526,4=24521} 2024-05-10T03:40:00.828 INFO:teuthology.orchestra.run.smithi045.stdout:failed 2024-05-10T03:40:00.828 INFO:teuthology.orchestra.run.smithi045.stdout:damaged 2024-05-10T03:40:00.828 INFO:teuthology.orchestra.run.smithi045.stdout:stopped 2024-05-10T03:40:00.828 INFO:teuthology.orchestra.run.smithi045.stdout:data_pools [3,4] 2024-05-10T03:40:00.828 INFO:teuthology.orchestra.run.smithi045.stdout:metadata_pool 2 2024-05-10T03:40:00.828 INFO:teuthology.orchestra.run.smithi045.stdout:inline_data disabled 2024-05-10T03:40:00.828 INFO:teuthology.orchestra.run.smithi045.stdout:balancer 2024-05-10T03:40:00.828 INFO:teuthology.orchestra.run.smithi045.stdout:bal_rank_mask -1 2024-05-10T03:40:00.828 INFO:teuthology.orchestra.run.smithi045.stdout:standby_count_wanted 0 2024-05-10T03:40:00.828 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b{0:24590} state up:active seq 3 addr [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] compat {c=[1],r=[1],i=[7ff]}] 2024-05-10T03:40:00.828 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.f{0:24514} state up:standby-replay seq 1 addr [v2:172.21.15.154:6834/4037121210,v1:172.21.15.154:6835/4037121210] compat {c=[1],r=[1],i=[7ff]}] 2024-05-10T03:40:00.828 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.h{1:24548} state up:active seq 10 addr [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] compat {c=[1],r=[1],i=[7ff]}] 2024-05-10T03:40:00.828 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.k{1:24491} state up:standby-replay seq 1 addr [v2:172.21.15.106:6832/3404247109,v1:172.21.15.106:6833/3404247109] compat {c=[1],r=[1],i=[7ff]}] 2024-05-10T03:40:00.828 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.i{2:24547} state up:active seq 9 addr [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] compat {c=[1],r=[1],i=[7ff]}] 2024-05-10T03:40:00.829 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.l{2:24475} state up:standby-replay seq 1 addr [v2:172.21.15.154:6832/4274344062,v1:172.21.15.154:6833/4274344062] compat {c=[1],r=[1],i=[7ff]}] 2024-05-10T03:40:00.829 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c{3:24526} state up:active seq 11 addr [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] compat {c=[1],r=[1],i=[7ff]}] 2024-05-10T03:40:00.829 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a{3:14637} state up:standby-replay seq 1 addr [v2:172.21.15.45:6840/1355456195,v1:172.21.15.45:6841/1355456195] compat {c=[1],r=[1],i=[7ff]}] 2024-05-10T03:40:00.829 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.e{4:24521} state up:active seq 12 addr [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] compat {c=[1],r=[1],i=[7ff]}] 2024-05-10T03:40:00.829 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.g{4:14625} state up:standby-replay seq 1 addr [v2:172.21.15.45:6838/4007419304,v1:172.21.15.45:6839/4007419304] compat {c=[1],r=[1],i=[7ff]}] 2024-05-10T03:40:00.829 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:40:00.829 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:40:00.829 INFO:teuthology.orchestra.run.smithi045.stdout:Standby daemons: 2024-05-10T03:40:00.829 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:40:00.829 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.j{-1:14553} state up:standby seq 1 addr [v2:172.21.15.45:6834/378320264,v1:172.21.15.45:6835/378320264] compat {c=[1],r=[1],i=[7ff]}] 2024-05-10T03:40:00.829 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d{-1:14565} state up:standby seq 1 addr [v2:172.21.15.45:6836/3032381796,v1:172.21.15.45:6837/3032381796] compat {c=[1],r=[1],i=[7ff]}] 2024-05-10T03:40:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.825+0000 7ffaeb26c700 1 -- 172.21.15.45:0/94669598 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ffad00a11b0 msgr2=0x7ffad00a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.825+0000 7ffaeb26c700 1 --2- 172.21.15.45:0/94669598 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ffad00a11b0 0x7ffad00a36c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffae0005950 tx=0x7ffae000b410 comp rx=0 tx=0).stop 2024-05-10T03:40:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.825+0000 7ffaeb26c700 1 -- 172.21.15.45:0/94669598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffae4100ec0 msgr2=0x7ffae419a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.825+0000 7ffaeb26c700 1 --2- 172.21.15.45:0/94669598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffae4100ec0 0x7ffae419a920 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ffad4005b40 tx=0x7ffad400f690 comp rx=0 tx=0).stop 2024-05-10T03:40:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.825+0000 7ffaeb26c700 1 -- 172.21.15.45:0/94669598 shutdown_connections 2024-05-10T03:40:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.825+0000 7ffaeb26c700 1 --2- 172.21.15.45:0/94669598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae4100570 0x7ffae419a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:00.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.825+0000 7ffaeb26c700 1 --2- 172.21.15.45:0/94669598 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ffad00a11b0 0x7ffad00a36c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:00.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.825+0000 7ffaeb26c700 1 --2- 172.21.15.45:0/94669598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffae4101810 0x7ffae419b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:00.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.825+0000 7ffaeb26c700 1 --2- 172.21.15.45:0/94669598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffae4100ec0 0x7ffae419a920 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:00.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.825+0000 7ffaeb26c700 1 -- 172.21.15.45:0/94669598 >> 172.21.15.45:0/94669598 conn(0x7ffae40fc1c0 msgr2=0x7ffae4108ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:00.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.826+0000 7ffaeb26c700 1 -- 172.21.15.45:0/94669598 shutdown_connections 2024-05-10T03:40:00.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:00.826+0000 7ffaeb26c700 1 -- 172.21.15.45:0/94669598 wait complete. 2024-05-10T03:40:00.831 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 27 2024-05-10T03:40:01.124 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:01 smithi045 ceph-mon[42520]: pgmap v275: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-10T03:40:01.124 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:01 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/94669598' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-10T03:40:01.226 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- bash -c 'ceph osd dump' 2024-05-10T03:40:01.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:01 smithi106 ceph-mon[46996]: pgmap v275: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-10T03:40:01.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:01 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/94669598' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-10T03:40:01.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:01 smithi154 ceph-mon[46565]: pgmap v275: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-10T03:40:01.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:01 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/94669598' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-10T03:40:01.483 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:40:02.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.496+0000 7f9c29751700 1 -- 172.21.15.45:0/3438484206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c24101ce0 msgr2=0x7f9c241020f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:02.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.496+0000 7f9c29751700 1 --2- 172.21.15.45:0/3438484206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c24101ce0 0x7f9c241020f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009990 tx=0x7f9c18009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:02.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.496+0000 7f9c29751700 1 -- 172.21.15.45:0/3438484206 shutdown_connections 2024-05-10T03:40:02.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.496+0000 7f9c29751700 1 --2- 172.21.15.45:0/3438484206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c24102680 0x7f9c24108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:02.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.496+0000 7f9c29751700 1 --2- 172.21.15.45:0/3438484206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c24100bb0 0x7f9c24100fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:02.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.496+0000 7f9c29751700 1 --2- 172.21.15.45:0/3438484206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c24101ce0 0x7f9c241020f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:02.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.496+0000 7f9c29751700 1 -- 172.21.15.45:0/3438484206 >> 172.21.15.45:0/3438484206 conn(0x7f9c240fc210 msgr2=0x7f9c240fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:02.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.497+0000 7f9c29751700 1 -- 172.21.15.45:0/3438484206 shutdown_connections 2024-05-10T03:40:02.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.497+0000 7f9c29751700 1 -- 172.21.15.45:0/3438484206 wait complete. 2024-05-10T03:40:02.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.497+0000 7f9c29751700 1 Processor -- start 2024-05-10T03:40:02.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.497+0000 7f9c29751700 1 -- start start 2024-05-10T03:40:02.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.498+0000 7f9c29751700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c24100bb0 0x7f9c24198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:02.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.498+0000 7f9c29751700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c24101ce0 0x7f9c24198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:02.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.498+0000 7f9c29751700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c24102680 0x7f9c24199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:02.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.498+0000 7f9c29751700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c24199b90 con 0x7f9c24100bb0 2024-05-10T03:40:02.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.498+0000 7f9c29751700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c24199cd0 con 0x7f9c24102680 2024-05-10T03:40:02.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.498+0000 7f9c29751700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c24199e90 con 0x7f9c24101ce0 2024-05-10T03:40:02.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.498+0000 7f9c22ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c24100bb0 0x7f9c24198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:02.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.498+0000 7f9c22ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c24100bb0 0x7f9c24198240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36458/0 (socket says 172.21.15.45:36458) 2024-05-10T03:40:02.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.498+0000 7f9c22ffd700 1 -- 172.21.15.45:0/3988424434 learned_addr learned my addr 172.21.15.45:0/3988424434 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:02.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.498+0000 7f9c227fc700 1 --2- 172.21.15.45:0/3988424434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c24101ce0 0x7f9c24198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:02.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.498+0000 7f9c237fe700 1 --2- 172.21.15.45:0/3988424434 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c24102680 0x7f9c24199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:02.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.498+0000 7f9c22ffd700 1 -- 172.21.15.45:0/3988424434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c24101ce0 msgr2=0x7f9c24198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:02.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.498+0000 7f9c22ffd700 1 --2- 172.21.15.45:0/3988424434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c24101ce0 0x7f9c24198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:02.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.498+0000 7f9c22ffd700 1 -- 172.21.15.45:0/3988424434 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c24102680 msgr2=0x7f9c24199530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:02.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.498+0000 7f9c22ffd700 1 --2- 172.21.15.45:0/3988424434 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c24102680 0x7f9c24199530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:02.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.498+0000 7f9c22ffd700 1 -- 172.21.15.45:0/3988424434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c180095f0 con 0x7f9c24100bb0 2024-05-10T03:40:02.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.498+0000 7f9c227fc700 1 --2- 172.21.15.45:0/3988424434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c24101ce0 0x7f9c24198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:02.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.498+0000 7f9c237fe700 1 --2- 172.21.15.45:0/3988424434 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c24102680 0x7f9c24199530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:02.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.498+0000 7f9c22ffd700 1 --2- 172.21.15.45:0/3988424434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c24100bb0 0x7f9c24198240 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400d950 tx=0x7f9c1400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:02.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.499+0000 7f9c0bfff700 1 -- 172.21.15.45:0/3988424434 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1400bb60 con 0x7f9c24100bb0 2024-05-10T03:40:02.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.499+0000 7f9c29751700 1 -- 172.21.15.45:0/3988424434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c2419a170 con 0x7f9c24100bb0 2024-05-10T03:40:02.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.499+0000 7f9c0bfff700 1 -- 172.21.15.45:0/3988424434 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9c14007620 con 0x7f9c24100bb0 2024-05-10T03:40:02.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.499+0000 7f9c0bfff700 1 -- 172.21.15.45:0/3988424434 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1400f620 con 0x7f9c24100bb0 2024-05-10T03:40:02.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.499+0000 7f9c29751700 1 -- 172.21.15.45:0/3988424434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c241a0950 con 0x7f9c24100bb0 2024-05-10T03:40:02.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.500+0000 7f9c29751700 1 -- 172.21.15.45:0/3988424434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c240ffeb0 con 0x7f9c24100bb0 2024-05-10T03:40:02.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.502+0000 7f9c0bfff700 1 -- 172.21.15.45:0/3988424434 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f9c14010460 con 0x7f9c24100bb0 2024-05-10T03:40:02.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.503+0000 7f9c0bfff700 1 --2- 172.21.15.45:0/3988424434 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9c0c0a11b0 0x7f9c0c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:02.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.503+0000 7f9c227fc700 1 --2- 172.21.15.45:0/3988424434 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9c0c0a11b0 0x7f9c0c0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:02.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.503+0000 7f9c0bfff700 1 -- 172.21.15.45:0/3988424434 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f9c140cd600 con 0x7f9c24100bb0 2024-05-10T03:40:02.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.504+0000 7f9c227fc700 1 --2- 172.21.15.45:0/3988424434 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9c0c0a11b0 0x7f9c0c0a36c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800b7f0 tx=0x7f9c1801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:02.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.507+0000 7f9c0bfff700 1 -- 172.21.15.45:0/3988424434 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9c140968c0 con 0x7f9c24100bb0 2024-05-10T03:40:02.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.721+0000 7f9c29751700 1 -- 172.21.15.45:0/3988424434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f9c2404edc0 con 0x7f9c24100bb0 2024-05-10T03:40:02.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.722+0000 7f9c0bfff700 1 -- 172.21.15.45:0/3988424434 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v88) v1 ==== 56+0+5606 (secure 0 0 0) 0x7f9c14099ee0 con 0x7f9c24100bb0 2024-05-10T03:40:02.725 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 88 2024-05-10T03:40:02.725 INFO:teuthology.orchestra.run.smithi045.stdout:fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 2024-05-10T03:40:02.725 INFO:teuthology.orchestra.run.smithi045.stdout:created 2024-05-10T03:32:36.839939+0000 2024-05-10T03:40:02.725 INFO:teuthology.orchestra.run.smithi045.stdout:modified 2024-05-10T03:39:27.064512+0000 2024-05-10T03:40:02.725 INFO:teuthology.orchestra.run.smithi045.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-10T03:40:02.725 INFO:teuthology.orchestra.run.smithi045.stdout:crush_version 27 2024-05-10T03:40:02.725 INFO:teuthology.orchestra.run.smithi045.stdout:full_ratio 0.95 2024-05-10T03:40:02.725 INFO:teuthology.orchestra.run.smithi045.stdout:backfillfull_ratio 0.9 2024-05-10T03:40:02.726 INFO:teuthology.orchestra.run.smithi045.stdout:nearfull_ratio 0.85 2024-05-10T03:40:02.726 INFO:teuthology.orchestra.run.smithi045.stdout:require_min_compat_client luminous 2024-05-10T03:40:02.726 INFO:teuthology.orchestra.run.smithi045.stdout:min_compat_client luminous 2024-05-10T03:40:02.726 INFO:teuthology.orchestra.run.smithi045.stdout:require_osd_release reef 2024-05-10T03:40:02.726 INFO:teuthology.orchestra.run.smithi045.stdout:stretch_mode_enabled false 2024-05-10T03:40:02.726 INFO:teuthology.orchestra.run.smithi045.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-05-10T03:40:02.726 INFO:teuthology.orchestra.run.smithi045.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-05-10T03:40:02.726 INFO:teuthology.orchestra.run.smithi045.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-05-10T03:40:02.726 INFO:teuthology.orchestra.run.smithi045.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 86 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-05-10T03:40:02.726 INFO:teuthology.orchestra.run.smithi045.stdout:max_osd 12 2024-05-10T03:40:02.726 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 up in weight 1 up_from 8 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.45:6802/2233620683,v1:172.21.15.45:6803/2233620683] [v2:172.21.15.45:6804/2233620683,v1:172.21.15.45:6805/2233620683] exists,up 42ed038c-208a-4440-8150-f6933533b3b6 2024-05-10T03:40:02.726 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 up in weight 1 up_from 13 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.106:6800/3117600187,v1:172.21.15.106:6801/3117600187] [v2:172.21.15.106:6802/3117600187,v1:172.21.15.106:6803/3117600187] exists,up 69265bae-5027-4810-978d-3d10eb35797c 2024-05-10T03:40:02.726 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 up in weight 1 up_from 18 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6800/2777220958,v1:172.21.15.154:6801/2777220958] [v2:172.21.15.154:6802/2777220958,v1:172.21.15.154:6803/2777220958] exists,up 56824828-0b1e-4068-b8c8-cbad269da7ef 2024-05-10T03:40:02.727 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 up in weight 1 up_from 25 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.45:6810/1188039324,v1:172.21.15.45:6811/1188039324] [v2:172.21.15.45:6812/1188039324,v1:172.21.15.45:6813/1188039324] exists,up 0df18033-7b88-4497-8241-b9acff5f7ba5 2024-05-10T03:40:02.727 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 up in weight 1 up_from 33 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.106:6808/4186845524,v1:172.21.15.106:6809/4186845524] [v2:172.21.15.106:6810/4186845524,v1:172.21.15.106:6811/4186845524] exists,up 896f8ecb-bda0-4f80-90d2-c5987ab61f65 2024-05-10T03:40:02.727 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 up in weight 1 up_from 38 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6808/3929679049,v1:172.21.15.154:6809/3929679049] [v2:172.21.15.154:6810/3929679049,v1:172.21.15.154:6811/3929679049] exists,up d5a4d9e4-2772-4d72-8963-dd47761c059a 2024-05-10T03:40:02.727 INFO:teuthology.orchestra.run.smithi045.stdout:osd.6 up in weight 1 up_from 45 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.45:6818/202946315,v1:172.21.15.45:6819/202946315] [v2:172.21.15.45:6820/202946315,v1:172.21.15.45:6821/202946315] exists,up d9010ff1-37d7-4426-aa77-6eed69de3567 2024-05-10T03:40:02.727 INFO:teuthology.orchestra.run.smithi045.stdout:osd.7 up in weight 1 up_from 50 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.106:6816/1689864237,v1:172.21.15.106:6817/1689864237] [v2:172.21.15.106:6818/1689864237,v1:172.21.15.106:6819/1689864237] exists,up 3e965b02-cc0b-4223-af80-97420f33102b 2024-05-10T03:40:02.727 INFO:teuthology.orchestra.run.smithi045.stdout:osd.8 up in weight 1 up_from 57 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6816/1548564532,v1:172.21.15.154:6817/1548564532] [v2:172.21.15.154:6818/1548564532,v1:172.21.15.154:6819/1548564532] exists,up 160c752d-e4ae-4670-aeed-db069ce61452 2024-05-10T03:40:02.727 INFO:teuthology.orchestra.run.smithi045.stdout:osd.9 up in weight 1 up_from 64 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.45:6826/3092314087,v1:172.21.15.45:6827/3092314087] [v2:172.21.15.45:6828/3092314087,v1:172.21.15.45:6829/3092314087] exists,up bc033cd1-677d-4728-b27e-d85b7ad79f7c 2024-05-10T03:40:02.727 INFO:teuthology.orchestra.run.smithi045.stdout:osd.10 up in weight 1 up_from 69 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.106:6824/2680590999,v1:172.21.15.106:6825/2680590999] [v2:172.21.15.106:6826/2680590999,v1:172.21.15.106:6827/2680590999] exists,up 12f8e54b-8eb1-4410-8df7-c8ab651f3e02 2024-05-10T03:40:02.727 INFO:teuthology.orchestra.run.smithi045.stdout:osd.11 up in weight 1 up_from 76 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6824/3779086590,v1:172.21.15.154:6825/3779086590] [v2:172.21.15.154:6826/3779086590,v1:172.21.15.154:6827/3779086590] exists,up 43642c0b-911a-44ce-a6d4-54482dc7897a 2024-05-10T03:40:02.727 INFO:teuthology.orchestra.run.smithi045.stdout:pg_upmap_items 2.b [2,4] 2024-05-10T03:40:02.727 INFO:teuthology.orchestra.run.smithi045.stdout:pg_upmap_items 2.14 [2,4] 2024-05-10T03:40:02.727 INFO:teuthology.orchestra.run.smithi045.stdout:pg_upmap_items 2.1a [8,1] 2024-05-10T03:40:02.727 INFO:teuthology.orchestra.run.smithi045.stdout:pg_upmap_items 2.1c [8,11] 2024-05-10T03:40:02.727 INFO:teuthology.orchestra.run.smithi045.stdout:pg_upmap_items 3.c [5,8] 2024-05-10T03:40:02.728 INFO:teuthology.orchestra.run.smithi045.stdout:pg_upmap_items 3.17 [4,6] 2024-05-10T03:40:02.728 INFO:teuthology.orchestra.run.smithi045.stdout:pg_upmap_items 3.1e [3,9] 2024-05-10T03:40:02.728 INFO:teuthology.orchestra.run.smithi045.stdout:pg_upmap_items 3.24 [4,9] 2024-05-10T03:40:02.728 INFO:teuthology.orchestra.run.smithi045.stdout:pg_upmap_items 3.31 [4,8] 2024-05-10T03:40:02.728 INFO:teuthology.orchestra.run.smithi045.stdout:pg_upmap_items 3.33 [5,9] 2024-05-10T03:40:02.728 INFO:teuthology.orchestra.run.smithi045.stdout:blocklist 172.21.15.45:6801/485502847 expires 2024-05-11T03:33:25.801965+0000 2024-05-10T03:40:02.728 INFO:teuthology.orchestra.run.smithi045.stdout:blocklist 172.21.15.45:6800/485502847 expires 2024-05-11T03:33:25.801965+0000 2024-05-10T03:40:02.728 INFO:teuthology.orchestra.run.smithi045.stdout:blocklist 172.21.15.45:0/477110319 expires 2024-05-11T03:33:25.801965+0000 2024-05-10T03:40:02.728 INFO:teuthology.orchestra.run.smithi045.stdout:blocklist 172.21.15.45:6800/534860598 expires 2024-05-11T03:33:02.846802+0000 2024-05-10T03:40:02.728 INFO:teuthology.orchestra.run.smithi045.stdout:blocklist 172.21.15.45:0/2249239510 expires 2024-05-11T03:33:25.801965+0000 2024-05-10T03:40:02.728 INFO:teuthology.orchestra.run.smithi045.stdout:blocklist 172.21.15.45:0/2903615785 expires 2024-05-11T03:33:02.846802+0000 2024-05-10T03:40:02.728 INFO:teuthology.orchestra.run.smithi045.stdout:blocklist 172.21.15.45:6801/534860598 expires 2024-05-11T03:33:02.846802+0000 2024-05-10T03:40:02.728 INFO:teuthology.orchestra.run.smithi045.stdout:blocklist 172.21.15.45:0/2125492352 expires 2024-05-11T03:33:02.846802+0000 2024-05-10T03:40:02.728 INFO:teuthology.orchestra.run.smithi045.stdout:blocklist 172.21.15.45:0/3226767328 expires 2024-05-11T03:33:02.846802+0000 2024-05-10T03:40:02.728 INFO:teuthology.orchestra.run.smithi045.stdout:blocklist 172.21.15.45:0/4077940265 expires 2024-05-11T03:33:25.801965+0000 2024-05-10T03:40:02.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.725+0000 7f9c29751700 1 -- 172.21.15.45:0/3988424434 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9c0c0a11b0 msgr2=0x7f9c0c0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:02.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.725+0000 7f9c29751700 1 --2- 172.21.15.45:0/3988424434 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9c0c0a11b0 0x7f9c0c0a36c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800b7f0 tx=0x7f9c1801a040 comp rx=0 tx=0).stop 2024-05-10T03:40:02.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.725+0000 7f9c29751700 1 -- 172.21.15.45:0/3988424434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c24100bb0 msgr2=0x7f9c24198240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:02.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.725+0000 7f9c29751700 1 --2- 172.21.15.45:0/3988424434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c24100bb0 0x7f9c24198240 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400d950 tx=0x7f9c1400dd10 comp rx=0 tx=0).stop 2024-05-10T03:40:02.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.725+0000 7f9c29751700 1 -- 172.21.15.45:0/3988424434 shutdown_connections 2024-05-10T03:40:02.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.725+0000 7f9c29751700 1 --2- 172.21.15.45:0/3988424434 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9c0c0a11b0 0x7f9c0c0a36c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:02.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.725+0000 7f9c29751700 1 --2- 172.21.15.45:0/3988424434 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c24102680 0x7f9c24199530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:02.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.725+0000 7f9c29751700 1 --2- 172.21.15.45:0/3988424434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c24100bb0 0x7f9c24198240 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:02.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.725+0000 7f9c29751700 1 --2- 172.21.15.45:0/3988424434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c24101ce0 0x7f9c24198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:02.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.725+0000 7f9c29751700 1 -- 172.21.15.45:0/3988424434 >> 172.21.15.45:0/3988424434 conn(0x7f9c240fc210 msgr2=0x7f9c240fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:02.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.725+0000 7f9c29751700 1 -- 172.21.15.45:0/3988424434 shutdown_connections 2024-05-10T03:40:02.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:02.725+0000 7f9c29751700 1 -- 172.21.15.45:0/3988424434 wait complete. 2024-05-10T03:40:03.173 INFO:teuthology.run_tasks:Running task fs.ready... 2024-05-10T03:40:03.185 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:40:03.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:03 smithi045 ceph-mon[42520]: pgmap v276: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:40:03.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:03 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3988424434' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-10T03:40:03.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.346+0000 7fcf4b3e7700 1 -- 172.21.15.45:0/4183013698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf44102580 msgr2=0x7fcf44108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:03.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.346+0000 7fcf4b3e7700 1 --2- 172.21.15.45:0/4183013698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf44102580 0x7fcf44108e30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00b0a0 tx=0x7fcf3c00b3b0 comp rx=0 tx=0).stop 2024-05-10T03:40:03.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.347+0000 7fcf4b3e7700 1 -- 172.21.15.45:0/4183013698 shutdown_connections 2024-05-10T03:40:03.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.347+0000 7fcf4b3e7700 1 --2- 172.21.15.45:0/4183013698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf44102580 0x7fcf44108e30 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:03.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.347+0000 7fcf4b3e7700 1 --2- 172.21.15.45:0/4183013698 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf44100ac0 0x7fcf44100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:03.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.347+0000 7fcf4b3e7700 1 --2- 172.21.15.45:0/4183013698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf44101be0 0x7fcf44101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:03.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.347+0000 7fcf4b3e7700 1 -- 172.21.15.45:0/4183013698 >> 172.21.15.45:0/4183013698 conn(0x7fcf440fc0d0 msgr2=0x7fcf440fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:03.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.347+0000 7fcf4b3e7700 1 -- 172.21.15.45:0/4183013698 shutdown_connections 2024-05-10T03:40:03.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.347+0000 7fcf4b3e7700 1 -- 172.21.15.45:0/4183013698 wait complete. 2024-05-10T03:40:03.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.348+0000 7fcf4b3e7700 1 Processor -- start 2024-05-10T03:40:03.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.348+0000 7fcf4b3e7700 1 -- start start 2024-05-10T03:40:03.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.348+0000 7fcf4b3e7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf44100ac0 0x7fcf441981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:03.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.348+0000 7fcf4b3e7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf44101be0 0x7fcf441986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:03.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.348+0000 7fcf4b3e7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf44102580 0x7fcf4419f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:03.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.348+0000 7fcf4b3e7700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4419fc90 con 0x7fcf44102580 2024-05-10T03:40:03.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.348+0000 7fcf4b3e7700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4419fe00 con 0x7fcf44101be0 2024-05-10T03:40:03.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.348+0000 7fcf4b3e7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4419ffc0 con 0x7fcf44100ac0 2024-05-10T03:40:03.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.348+0000 7fcf49984700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf44102580 0x7fcf4419f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:03.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.348+0000 7fcf49984700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf44102580 0x7fcf4419f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36480/0 (socket says 172.21.15.45:36480) 2024-05-10T03:40:03.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.348+0000 7fcf49984700 1 -- 172.21.15.45:0/4249193339 learned_addr learned my addr 172.21.15.45:0/4249193339 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:03.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.348+0000 7fcf48982700 1 --2- 172.21.15.45:0/4249193339 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf44101be0 0x7fcf441986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:03.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.348+0000 7fcf49183700 1 --2- 172.21.15.45:0/4249193339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf44100ac0 0x7fcf441981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:03.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.348+0000 7fcf49984700 1 -- 172.21.15.45:0/4249193339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf44100ac0 msgr2=0x7fcf441981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:03.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.349+0000 7fcf49984700 1 --2- 172.21.15.45:0/4249193339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf44100ac0 0x7fcf441981b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:03.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.349+0000 7fcf49984700 1 -- 172.21.15.45:0/4249193339 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf44101be0 msgr2=0x7fcf441986f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:03.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.349+0000 7fcf49984700 1 --2- 172.21.15.45:0/4249193339 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf44101be0 0x7fcf441986f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:03.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.349+0000 7fcf49984700 1 -- 172.21.15.45:0/4249193339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c009d00 con 0x7fcf44102580 2024-05-10T03:40:03.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.349+0000 7fcf49984700 1 --2- 172.21.15.45:0/4249193339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf44102580 0x7fcf4419f680 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009820 tx=0x7fcf3c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:03.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.349+0000 7fcf3a7fc700 1 -- 172.21.15.45:0/4249193339 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c00e040 con 0x7fcf44102580 2024-05-10T03:40:03.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.349+0000 7fcf3a7fc700 1 -- 172.21.15.45:0/4249193339 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcf3c004c50 con 0x7fcf44102580 2024-05-10T03:40:03.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.349+0000 7fcf4b3e7700 1 -- 172.21.15.45:0/4249193339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf441a0240 con 0x7fcf44102580 2024-05-10T03:40:03.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.349+0000 7fcf3a7fc700 1 -- 172.21.15.45:0/4249193339 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c0053b0 con 0x7fcf44102580 2024-05-10T03:40:03.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.349+0000 7fcf4b3e7700 1 -- 172.21.15.45:0/4249193339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf441a06c0 con 0x7fcf44102580 2024-05-10T03:40:03.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.350+0000 7fcf4b3e7700 1 -- 172.21.15.45:0/4249193339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf440694d0 con 0x7fcf44102580 2024-05-10T03:40:03.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.352+0000 7fcf3a7fc700 1 -- 172.21.15.45:0/4249193339 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fcf3c005510 con 0x7fcf44102580 2024-05-10T03:40:03.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.352+0000 7fcf3a7fc700 1 --2- 172.21.15.45:0/4249193339 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcf300a11b0 0x7fcf300a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:03.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.352+0000 7fcf3a7fc700 1 -- 172.21.15.45:0/4249193339 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fcf3c0ce1f0 con 0x7fcf44102580 2024-05-10T03:40:03.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.352+0000 7fcf49183700 1 --2- 172.21.15.45:0/4249193339 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcf300a11b0 0x7fcf300a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:03.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.353+0000 7fcf49183700 1 --2- 172.21.15.45:0/4249193339 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcf300a11b0 0x7fcf300a36c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcf44101ae0 tx=0x7fcf40009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:03.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.356+0000 7fcf3a7fc700 1 -- 172.21.15.45:0/4249193339 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fcf3c0975a0 con 0x7fcf44102580 2024-05-10T03:40:03.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:03 smithi106 ceph-mon[46996]: pgmap v276: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:40:03.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:03 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3988424434' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-10T03:40:03.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:03 smithi154 ceph-mon[46565]: pgmap v276: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:40:03.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:03 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3988424434' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-10T03:40:03.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.575+0000 7fcf4b3e7700 1 -- 172.21.15.45:0/4249193339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf4410c460 con 0x7fcf44102580 2024-05-10T03:40:03.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.577+0000 7fcf3a7fc700 1 -- 172.21.15.45:0/4249193339 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+24508 (secure 0 0 0) 0x7fcf3c09abc0 con 0x7fcf44102580 2024-05-10T03:40:03.581 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:40:03.582 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":88,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:39:27.064512+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:38:34.871801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:38:35.935386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T03:38:39.029903+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:40:03.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.579+0000 7fcf4b3e7700 1 -- 172.21.15.45:0/4249193339 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcf300a11b0 msgr2=0x7fcf300a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:03.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.579+0000 7fcf4b3e7700 1 --2- 172.21.15.45:0/4249193339 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcf300a11b0 0x7fcf300a36c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcf44101ae0 tx=0x7fcf40009260 comp rx=0 tx=0).stop 2024-05-10T03:40:03.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.579+0000 7fcf4b3e7700 1 -- 172.21.15.45:0/4249193339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf44102580 msgr2=0x7fcf4419f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:03.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.579+0000 7fcf4b3e7700 1 --2- 172.21.15.45:0/4249193339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf44102580 0x7fcf4419f680 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009820 tx=0x7fcf3c007a00 comp rx=0 tx=0).stop 2024-05-10T03:40:03.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.579+0000 7fcf4b3e7700 1 -- 172.21.15.45:0/4249193339 shutdown_connections 2024-05-10T03:40:03.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.579+0000 7fcf4b3e7700 1 --2- 172.21.15.45:0/4249193339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf44100ac0 0x7fcf441981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:03.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.579+0000 7fcf4b3e7700 1 --2- 172.21.15.45:0/4249193339 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcf300a11b0 0x7fcf300a36c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:03.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.579+0000 7fcf4b3e7700 1 --2- 172.21.15.45:0/4249193339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf44102580 0x7fcf4419f680 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:03.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.579+0000 7fcf4b3e7700 1 --2- 172.21.15.45:0/4249193339 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf44101be0 0x7fcf441986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:03.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.579+0000 7fcf4b3e7700 1 -- 172.21.15.45:0/4249193339 >> 172.21.15.45:0/4249193339 conn(0x7fcf440fc0d0 msgr2=0x7fcf440fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:03.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.580+0000 7fcf4b3e7700 1 -- 172.21.15.45:0/4249193339 shutdown_connections 2024-05-10T03:40:03.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.580+0000 7fcf4b3e7700 1 -- 172.21.15.45:0/4249193339 wait complete. 2024-05-10T03:40:03.600 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T03:35:20.339400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T03:38:34.871801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T03:38:35.935386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-10T03:38:39.029903+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-10T03:40:03.600 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T03:40:03.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.754+0000 7f08a62d6700 1 -- 172.21.15.45:0/3648921692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a0107970 msgr2=0x7f08a0109d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:03.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.754+0000 7f08a62d6700 1 --2- 172.21.15.45:0/3648921692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a0107970 0x7f08a0109d90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f089800b0a0 tx=0x7f089800b3b0 comp rx=0 tx=0).stop 2024-05-10T03:40:03.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.754+0000 7f08a62d6700 1 -- 172.21.15.45:0/3648921692 shutdown_connections 2024-05-10T03:40:03.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.754+0000 7f08a62d6700 1 --2- 172.21.15.45:0/3648921692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a0107970 0x7f08a0109d90 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:03.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.754+0000 7f08a62d6700 1 --2- 172.21.15.45:0/3648921692 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08a01026b0 0x7f08a0104ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:03.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.754+0000 7f08a62d6700 1 --2- 172.21.15.45:0/3648921692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08a0105010 0x7f08a0107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:03.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.754+0000 7f08a62d6700 1 -- 172.21.15.45:0/3648921692 >> 172.21.15.45:0/3648921692 conn(0x7f08a00fc0d0 msgr2=0x7f08a00fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:03.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.754+0000 7f08a62d6700 1 -- 172.21.15.45:0/3648921692 shutdown_connections 2024-05-10T03:40:03.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.754+0000 7f08a62d6700 1 -- 172.21.15.45:0/3648921692 wait complete. 2024-05-10T03:40:03.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.755+0000 7f08a62d6700 1 Processor -- start 2024-05-10T03:40:03.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.755+0000 7f08a62d6700 1 -- start start 2024-05-10T03:40:03.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.755+0000 7f08a62d6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08a01026b0 0x7f08a01980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:03.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.755+0000 7f08a62d6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a0105010 0x7f08a0198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:03.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.755+0000 7f08a62d6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08a0107970 0x7f08a019f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:03.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.755+0000 7f08a62d6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a019fbb0 con 0x7f08a0105010 2024-05-10T03:40:03.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.755+0000 7f08a62d6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a019fd20 con 0x7f08a01026b0 2024-05-10T03:40:03.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.755+0000 7f08a62d6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a019fee0 con 0x7f08a0107970 2024-05-10T03:40:03.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.755+0000 7f089f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a0105010 0x7f08a0198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:03.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.755+0000 7f089f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a0105010 0x7f08a0198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36498/0 (socket says 172.21.15.45:36498) 2024-05-10T03:40:03.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.755+0000 7f089f7fe700 1 -- 172.21.15.45:0/1413947564 learned_addr learned my addr 172.21.15.45:0/1413947564 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:03.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.755+0000 7f089ffff700 1 --2- 172.21.15.45:0/1413947564 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08a01026b0 0x7f08a01980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:03.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.755+0000 7f08a4873700 1 --2- 172.21.15.45:0/1413947564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08a0107970 0x7f08a019f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:03.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.756+0000 7f089f7fe700 1 -- 172.21.15.45:0/1413947564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08a0107970 msgr2=0x7f08a019f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:03.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.756+0000 7f089f7fe700 1 --2- 172.21.15.45:0/1413947564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08a0107970 0x7f08a019f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:03.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.756+0000 7f089f7fe700 1 -- 172.21.15.45:0/1413947564 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08a01026b0 msgr2=0x7f08a01980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:03.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.756+0000 7f089f7fe700 1 --2- 172.21.15.45:0/1413947564 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08a01026b0 0x7f08a01980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:03.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.756+0000 7f089f7fe700 1 -- 172.21.15.45:0/1413947564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0890009520 con 0x7f08a0105010 2024-05-10T03:40:03.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.756+0000 7f089f7fe700 1 --2- 172.21.15.45:0/1413947564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a0105010 0x7f08a0198610 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f089400e9a0 tx=0x7f089400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:03.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.756+0000 7f089d7fa700 1 -- 172.21.15.45:0/1413947564 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0894009790 con 0x7f08a0105010 2024-05-10T03:40:03.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.756+0000 7f089d7fa700 1 -- 172.21.15.45:0/1413947564 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f089400cbd0 con 0x7f08a0105010 2024-05-10T03:40:03.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.756+0000 7f08a62d6700 1 -- 172.21.15.45:0/1413947564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0898009d00 con 0x7f08a0105010 2024-05-10T03:40:03.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.756+0000 7f089d7fa700 1 -- 172.21.15.45:0/1413947564 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0894018680 con 0x7f08a0105010 2024-05-10T03:40:03.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.756+0000 7f08a62d6700 1 -- 172.21.15.45:0/1413947564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a01a0590 con 0x7f08a0105010 2024-05-10T03:40:03.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.757+0000 7f08a62d6700 1 -- 172.21.15.45:0/1413947564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a00fdc80 con 0x7f08a0105010 2024-05-10T03:40:03.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.758+0000 7f089d7fa700 1 -- 172.21.15.45:0/1413947564 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f08940188a0 con 0x7f08a0105010 2024-05-10T03:40:03.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.759+0000 7f089d7fa700 1 --2- 172.21.15.45:0/1413947564 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f08880a12e0 0x7f08880a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:03.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.759+0000 7f089d7fa700 1 -- 172.21.15.45:0/1413947564 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f0894014070 con 0x7f08a0105010 2024-05-10T03:40:03.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.759+0000 7f089ffff700 1 --2- 172.21.15.45:0/1413947564 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f08880a12e0 0x7f08880a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:03.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.760+0000 7f089ffff700 1 --2- 172.21.15.45:0/1413947564 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f08880a12e0 0x7f08880a37f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f08a0068de0 tx=0x7f0890009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:03.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.763+0000 7f089d7fa700 1 -- 172.21.15.45:0/1413947564 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0894096790 con 0x7f08a0105010 2024-05-10T03:40:03.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.978+0000 7f08a62d6700 1 -- 172.21.15.45:0/1413947564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f08a010d500 con 0x7f08a0105010 2024-05-10T03:40:03.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.978+0000 7f089d7fa700 1 -- 172.21.15.45:0/1413947564 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f08940260a0 con 0x7f08a0105010 2024-05-10T03:40:03.981 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-05-10T03:40:03.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.981+0000 7f08a62d6700 1 -- 172.21.15.45:0/1413947564 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f08880a12e0 msgr2=0x7f08880a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:03.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.981+0000 7f08a62d6700 1 --2- 172.21.15.45:0/1413947564 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f08880a12e0 0x7f08880a37f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f08a0068de0 tx=0x7f0890009260 comp rx=0 tx=0).stop 2024-05-10T03:40:03.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.981+0000 7f08a62d6700 1 -- 172.21.15.45:0/1413947564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a0105010 msgr2=0x7f08a0198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:03.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.981+0000 7f08a62d6700 1 --2- 172.21.15.45:0/1413947564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a0105010 0x7f08a0198610 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f089400e9a0 tx=0x7f089400ecb0 comp rx=0 tx=0).stop 2024-05-10T03:40:03.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.981+0000 7f08a62d6700 1 -- 172.21.15.45:0/1413947564 shutdown_connections 2024-05-10T03:40:03.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.981+0000 7f08a62d6700 1 --2- 172.21.15.45:0/1413947564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08a0107970 0x7f08a019f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:03.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.981+0000 7f08a62d6700 1 --2- 172.21.15.45:0/1413947564 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f08880a12e0 0x7f08880a37f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:03.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.981+0000 7f08a62d6700 1 --2- 172.21.15.45:0/1413947564 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08a01026b0 0x7f08a01980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:03.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.981+0000 7f08a62d6700 1 --2- 172.21.15.45:0/1413947564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a0105010 0x7f08a0198610 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:03.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.981+0000 7f08a62d6700 1 -- 172.21.15.45:0/1413947564 >> 172.21.15.45:0/1413947564 conn(0x7f08a00fc0d0 msgr2=0x7f08a01034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:03.985 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.981+0000 7f08a62d6700 1 -- 172.21.15.45:0/1413947564 shutdown_connections 2024-05-10T03:40:03.985 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:03.981+0000 7f08a62d6700 1 -- 172.21.15.45:0/1413947564 wait complete. 2024-05-10T03:40:03.998 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T03:40:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.151+0000 7fe0d3ab6700 1 -- 172.21.15.45:0/1874968187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0cc101c90 msgr2=0x7fe0cc1020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.151+0000 7fe0d3ab6700 1 --2- 172.21.15.45:0/1874968187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0cc101c90 0x7fe0cc1020a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009990 tx=0x7fe0bc009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.151+0000 7fe0d3ab6700 1 -- 172.21.15.45:0/1874968187 shutdown_connections 2024-05-10T03:40:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.151+0000 7fe0d3ab6700 1 --2- 172.21.15.45:0/1874968187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0cc102630 0x7fe0cc108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.151+0000 7fe0d3ab6700 1 --2- 172.21.15.45:0/1874968187 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0cc100b70 0x7fe0cc100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.151+0000 7fe0d3ab6700 1 --2- 172.21.15.45:0/1874968187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0cc101c90 0x7fe0cc1020a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.151+0000 7fe0d3ab6700 1 -- 172.21.15.45:0/1874968187 >> 172.21.15.45:0/1874968187 conn(0x7fe0cc0fc180 msgr2=0x7fe0cc0fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:04.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.151+0000 7fe0d3ab6700 1 -- 172.21.15.45:0/1874968187 shutdown_connections 2024-05-10T03:40:04.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.151+0000 7fe0d3ab6700 1 -- 172.21.15.45:0/1874968187 wait complete. 2024-05-10T03:40:04.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.152+0000 7fe0d3ab6700 1 Processor -- start 2024-05-10T03:40:04.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.152+0000 7fe0d3ab6700 1 -- start start 2024-05-10T03:40:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.152+0000 7fe0d3ab6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0cc100b70 0x7fe0cc06a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.152+0000 7fe0d3ab6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0cc101c90 0x7fe0cc19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.152+0000 7fe0d3ab6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0cc102630 0x7fe0cc19f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.152+0000 7fe0d3ab6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc19fa60 con 0x7fe0cc102630 2024-05-10T03:40:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.152+0000 7fe0d3ab6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc19fbd0 con 0x7fe0cc101c90 2024-05-10T03:40:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.152+0000 7fe0d3ab6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc19fd90 con 0x7fe0cc100b70 2024-05-10T03:40:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.152+0000 7fe0d1852700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0cc100b70 0x7fe0cc06a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.152+0000 7fe0d2053700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0cc102630 0x7fe0cc19f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.152+0000 7fe0d1852700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0cc100b70 0x7fe0cc06a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:46688/0 (socket says 172.21.15.45:46688) 2024-05-10T03:40:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.152+0000 7fe0d1852700 1 -- 172.21.15.45:0/2717738697 learned_addr learned my addr 172.21.15.45:0/2717738697 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.152+0000 7fe0d2053700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0cc102630 0x7fe0cc19f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36510/0 (socket says 172.21.15.45:36510) 2024-05-10T03:40:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.152+0000 7fe0d1051700 1 --2- 172.21.15.45:0/2717738697 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0cc101c90 0x7fe0cc19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.153+0000 7fe0d1852700 1 -- 172.21.15.45:0/2717738697 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0cc101c90 msgr2=0x7fe0cc19ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.153+0000 7fe0d1852700 1 --2- 172.21.15.45:0/2717738697 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0cc101c90 0x7fe0cc19ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.153+0000 7fe0d1852700 1 -- 172.21.15.45:0/2717738697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0cc102630 msgr2=0x7fe0cc19f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.153+0000 7fe0d1852700 1 --2- 172.21.15.45:0/2717738697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0cc102630 0x7fe0cc19f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.153+0000 7fe0d1852700 1 -- 172.21.15.45:0/2717738697 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc0095f0 con 0x7fe0cc100b70 2024-05-10T03:40:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.153+0000 7fe0d2053700 1 --2- 172.21.15.45:0/2717738697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0cc102630 0x7fe0cc19f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:40:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.153+0000 7fe0d1852700 1 --2- 172.21.15.45:0/2717738697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0cc100b70 0x7fe0cc06a250 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800d950 tx=0x7fe0c800dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.153+0000 7fe0c2ffd700 1 -- 172.21.15.45:0/2717738697 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8004220 con 0x7fe0cc100b70 2024-05-10T03:40:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.153+0000 7fe0c2ffd700 1 -- 172.21.15.45:0/2717738697 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe0c8004380 con 0x7fe0cc100b70 2024-05-10T03:40:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.153+0000 7fe0d3ab6700 1 -- 172.21.15.45:0/2717738697 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0cc1a0070 con 0x7fe0cc100b70 2024-05-10T03:40:04.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.153+0000 7fe0c2ffd700 1 -- 172.21.15.45:0/2717738697 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8003c50 con 0x7fe0cc100b70 2024-05-10T03:40:04.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.153+0000 7fe0d3ab6700 1 -- 172.21.15.45:0/2717738697 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0cc1a0580 con 0x7fe0cc100b70 2024-05-10T03:40:04.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.155+0000 7fe0d3ab6700 1 -- 172.21.15.45:0/2717738697 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0cc107d80 con 0x7fe0cc100b70 2024-05-10T03:40:04.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.156+0000 7fe0c2ffd700 1 -- 172.21.15.45:0/2717738697 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fe0c800fc70 con 0x7fe0cc100b70 2024-05-10T03:40:04.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.156+0000 7fe0c2ffd700 1 --2- 172.21.15.45:0/2717738697 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe0b80a1260 0x7fe0b80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:04.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.157+0000 7fe0d1051700 1 --2- 172.21.15.45:0/2717738697 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe0b80a1260 0x7fe0b80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:04.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.157+0000 7fe0c2ffd700 1 -- 172.21.15.45:0/2717738697 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fe0c80cc7d0 con 0x7fe0cc100b70 2024-05-10T03:40:04.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.157+0000 7fe0d1051700 1 --2- 172.21.15.45:0/2717738697 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe0b80a1260 0x7fe0b80a3770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc00b2e0 tx=0x7fe0bc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:04.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.160+0000 7fe0c2ffd700 1 -- 172.21.15.45:0/2717738697 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe0c8095af0 con 0x7fe0cc100b70 2024-05-10T03:40:04.283 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:04 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/4249193339' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:40:04.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:04 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1413947564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:40:04.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.376+0000 7fe0d3ab6700 1 -- 172.21.15.45:0/2717738697 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe0cc10c440 con 0x7fe0cc100b70 2024-05-10T03:40:04.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.377+0000 7fe0c2ffd700 1 -- 172.21.15.45:0/2717738697 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe0c8099110 con 0x7fe0cc100b70 2024-05-10T03:40:04.379 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-05-10T03:40:04.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.379+0000 7fe0d3ab6700 1 -- 172.21.15.45:0/2717738697 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe0b80a1260 msgr2=0x7fe0b80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:04.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.379+0000 7fe0d3ab6700 1 --2- 172.21.15.45:0/2717738697 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe0b80a1260 0x7fe0b80a3770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc00b2e0 tx=0x7fe0bc01a040 comp rx=0 tx=0).stop 2024-05-10T03:40:04.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.379+0000 7fe0d3ab6700 1 -- 172.21.15.45:0/2717738697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0cc100b70 msgr2=0x7fe0cc06a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:04.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.379+0000 7fe0d3ab6700 1 --2- 172.21.15.45:0/2717738697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0cc100b70 0x7fe0cc06a250 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800d950 tx=0x7fe0c800dc60 comp rx=0 tx=0).stop 2024-05-10T03:40:04.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.379+0000 7fe0d3ab6700 1 -- 172.21.15.45:0/2717738697 shutdown_connections 2024-05-10T03:40:04.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.379+0000 7fe0d3ab6700 1 --2- 172.21.15.45:0/2717738697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0cc100b70 0x7fe0cc06a250 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.379+0000 7fe0d3ab6700 1 --2- 172.21.15.45:0/2717738697 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe0b80a1260 0x7fe0b80a3770 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.379+0000 7fe0d3ab6700 1 --2- 172.21.15.45:0/2717738697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0cc102630 0x7fe0cc19f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.379+0000 7fe0d3ab6700 1 --2- 172.21.15.45:0/2717738697 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0cc101c90 0x7fe0cc19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.379+0000 7fe0d3ab6700 1 -- 172.21.15.45:0/2717738697 >> 172.21.15.45:0/2717738697 conn(0x7fe0cc0fc180 msgr2=0x7fe0cc104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:04.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.379+0000 7fe0d3ab6700 1 -- 172.21.15.45:0/2717738697 shutdown_connections 2024-05-10T03:40:04.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.379+0000 7fe0d3ab6700 1 -- 172.21.15.45:0/2717738697 wait complete. 2024-05-10T03:40:04.396 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T03:40:04.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:04 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/4249193339' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:40:04.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:04 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1413947564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:40:04.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:04 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/4249193339' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:40:04.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:04 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1413947564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:40:04.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.547+0000 7f299af46700 1 -- 172.21.15.45:0/1659451726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2994101bd0 msgr2=0x7f2994101fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.547+0000 7f299af46700 1 --2- 172.21.15.45:0/1659451726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2994101bd0 0x7f2994101fe0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2988009990 tx=0x7f2988009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.548+0000 7f299af46700 1 -- 172.21.15.45:0/1659451726 shutdown_connections 2024-05-10T03:40:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.548+0000 7f299af46700 1 --2- 172.21.15.45:0/1659451726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2994103690 0x7f2994109f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.548+0000 7f299af46700 1 --2- 172.21.15.45:0/1659451726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2994101bd0 0x7f2994101fe0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.548+0000 7f299af46700 1 --2- 172.21.15.45:0/1659451726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2994102cf0 0x7f2994103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.548+0000 7f299af46700 1 -- 172.21.15.45:0/1659451726 >> 172.21.15.45:0/1659451726 conn(0x7f29940fd1e0 msgr2=0x7f29940ff690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.548+0000 7f299af46700 1 -- 172.21.15.45:0/1659451726 shutdown_connections 2024-05-10T03:40:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.548+0000 7f299af46700 1 -- 172.21.15.45:0/1659451726 wait complete. 2024-05-10T03:40:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.548+0000 7f299af46700 1 Processor -- start 2024-05-10T03:40:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.548+0000 7f299af46700 1 -- start start 2024-05-10T03:40:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.549+0000 7f299af46700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2994101bd0 0x7f2994198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.549+0000 7f299af46700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2994102cf0 0x7f2994198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:04.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.549+0000 7f299af46700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2994103690 0x7f299419f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:04.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.549+0000 7f299af46700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299419fb10 con 0x7f2994103690 2024-05-10T03:40:04.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.549+0000 7f299af46700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299419fc80 con 0x7f2994102cf0 2024-05-10T03:40:04.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.549+0000 7f299af46700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299419fe40 con 0x7f2994101bd0 2024-05-10T03:40:04.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.549+0000 7f29994e3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2994103690 0x7f299419f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:04.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.549+0000 7f29994e3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2994103690 0x7f299419f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36532/0 (socket says 172.21.15.45:36532) 2024-05-10T03:40:04.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.549+0000 7f29994e3700 1 -- 172.21.15.45:0/2772156788 learned_addr learned my addr 172.21.15.45:0/2772156788 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:04.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.549+0000 7f2998ce2700 1 --2- 172.21.15.45:0/2772156788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2994101bd0 0x7f2994198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:04.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.549+0000 7f2993fff700 1 --2- 172.21.15.45:0/2772156788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2994102cf0 0x7f2994198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:04.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.549+0000 7f29994e3700 1 -- 172.21.15.45:0/2772156788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2994101bd0 msgr2=0x7f2994198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:04.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.549+0000 7f29994e3700 1 --2- 172.21.15.45:0/2772156788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2994101bd0 0x7f2994198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.549+0000 7f29994e3700 1 -- 172.21.15.45:0/2772156788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2994102cf0 msgr2=0x7f2994198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:04.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.549+0000 7f29994e3700 1 --2- 172.21.15.45:0/2772156788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2994102cf0 0x7f2994198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.549+0000 7f29994e3700 1 -- 172.21.15.45:0/2772156788 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29880095f0 con 0x7f2994103690 2024-05-10T03:40:04.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.549+0000 7f29994e3700 1 --2- 172.21.15.45:0/2772156788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2994103690 0x7f299419f500 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f298c00ef30 tx=0x7f298c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:04.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.550+0000 7f2991ffb700 1 -- 172.21.15.45:0/2772156788 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c018070 con 0x7f2994103690 2024-05-10T03:40:04.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.550+0000 7f2991ffb700 1 -- 172.21.15.45:0/2772156788 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f298c00f040 con 0x7f2994103690 2024-05-10T03:40:04.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.550+0000 7f299af46700 1 -- 172.21.15.45:0/2772156788 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29941a00c0 con 0x7f2994103690 2024-05-10T03:40:04.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.550+0000 7f2991ffb700 1 -- 172.21.15.45:0/2772156788 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c00cd50 con 0x7f2994103690 2024-05-10T03:40:04.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.550+0000 7f299af46700 1 -- 172.21.15.45:0/2772156788 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29941a0580 con 0x7f2994103690 2024-05-10T03:40:04.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.551+0000 7f299af46700 1 -- 172.21.15.45:0/2772156788 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2994108de0 con 0x7f2994103690 2024-05-10T03:40:04.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.552+0000 7f2991ffb700 1 -- 172.21.15.45:0/2772156788 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f298c003a00 con 0x7f2994103690 2024-05-10T03:40:04.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.553+0000 7f2991ffb700 1 --2- 172.21.15.45:0/2772156788 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f29840a12e0 0x7f29840a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:04.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.553+0000 7f2998ce2700 1 --2- 172.21.15.45:0/2772156788 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f29840a12e0 0x7f29840a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:04.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.553+0000 7f2991ffb700 1 -- 172.21.15.45:0/2772156788 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f298c0cc870 con 0x7f2994103690 2024-05-10T03:40:04.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.554+0000 7f2998ce2700 1 --2- 172.21.15.45:0/2772156788 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f29840a12e0 0x7f29840a37f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2988006010 tx=0x7f298801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:04.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.558+0000 7f2991ffb700 1 -- 172.21.15.45:0/2772156788 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f298c095bc0 con 0x7f2994103690 2024-05-10T03:40:04.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.784+0000 7f299af46700 1 -- 172.21.15.45:0/2772156788 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f29940678b0 con 0x7f2994103690 2024-05-10T03:40:04.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.784+0000 7f2991ffb700 1 -- 172.21.15.45:0/2772156788 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f29940678b0 con 0x7f2994103690 2024-05-10T03:40:04.787 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2024-05-10T03:40:04.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.786+0000 7f299af46700 1 -- 172.21.15.45:0/2772156788 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f29840a12e0 msgr2=0x7f29840a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:04.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.786+0000 7f299af46700 1 --2- 172.21.15.45:0/2772156788 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f29840a12e0 0x7f29840a37f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2988006010 tx=0x7f298801a040 comp rx=0 tx=0).stop 2024-05-10T03:40:04.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.786+0000 7f299af46700 1 -- 172.21.15.45:0/2772156788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2994103690 msgr2=0x7f299419f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:04.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.786+0000 7f299af46700 1 --2- 172.21.15.45:0/2772156788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2994103690 0x7f299419f500 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f298c00ef30 tx=0x7f298c00c3a0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.787+0000 7f299af46700 1 -- 172.21.15.45:0/2772156788 shutdown_connections 2024-05-10T03:40:04.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.787+0000 7f299af46700 1 --2- 172.21.15.45:0/2772156788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2994101bd0 0x7f2994198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.787+0000 7f299af46700 1 --2- 172.21.15.45:0/2772156788 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f29840a12e0 0x7f29840a37f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.787+0000 7f299af46700 1 --2- 172.21.15.45:0/2772156788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2994103690 0x7f299419f500 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.787+0000 7f299af46700 1 --2- 172.21.15.45:0/2772156788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2994102cf0 0x7f2994198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.787+0000 7f299af46700 1 -- 172.21.15.45:0/2772156788 >> 172.21.15.45:0/2772156788 conn(0x7f29940fd1e0 msgr2=0x7f2994105f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:04.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.787+0000 7f299af46700 1 -- 172.21.15.45:0/2772156788 shutdown_connections 2024-05-10T03:40:04.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.787+0000 7f299af46700 1 -- 172.21.15.45:0/2772156788 wait complete. 2024-05-10T03:40:04.804 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-10T03:40:04.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.954+0000 7f9bfc533700 1 -- 172.21.15.45:0/2491640667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bf4107880 msgr2=0x7f9bf4109d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:04.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.954+0000 7f9bfc533700 1 --2- 172.21.15.45:0/2491640667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bf4107880 0x7f9bf4109d90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9bec00b0a0 tx=0x7f9bec00b3b0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.954+0000 7f9bfc533700 1 -- 172.21.15.45:0/2491640667 shutdown_connections 2024-05-10T03:40:04.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.954+0000 7f9bfc533700 1 --2- 172.21.15.45:0/2491640667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf4069090 0x7f9bf4104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.954+0000 7f9bfc533700 1 --2- 172.21.15.45:0/2491640667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bf4107880 0x7f9bf4109d90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.954+0000 7f9bfc533700 1 --2- 172.21.15.45:0/2491640667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bf4104d10 0x7f9bf41071f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.954+0000 7f9bfc533700 1 -- 172.21.15.45:0/2491640667 >> 172.21.15.45:0/2491640667 conn(0x7f9bf40fc0d0 msgr2=0x7f9bf40fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:04.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.954+0000 7f9bfc533700 1 -- 172.21.15.45:0/2491640667 shutdown_connections 2024-05-10T03:40:04.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.954+0000 7f9bfc533700 1 -- 172.21.15.45:0/2491640667 wait complete. 2024-05-10T03:40:04.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.955+0000 7f9bfc533700 1 Processor -- start 2024-05-10T03:40:04.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.955+0000 7f9bfc533700 1 -- start start 2024-05-10T03:40:04.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.955+0000 7f9bfc533700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bf4069090 0x7f9bf41980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:04.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.955+0000 7f9bfc533700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf4104d10 0x7f9bf4198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:04.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.955+0000 7f9bfc533700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bf4107880 0x7f9bf419f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:04.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.955+0000 7f9bfc533700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf419fbb0 con 0x7f9bf4107880 2024-05-10T03:40:04.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.955+0000 7f9bfc533700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf419fd20 con 0x7f9bf4069090 2024-05-10T03:40:04.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.955+0000 7f9bfc533700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf419fee0 con 0x7f9bf4104d10 2024-05-10T03:40:04.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.956+0000 7f9bfaad0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bf4107880 0x7f9bf419f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:04.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.956+0000 7f9bfaad0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bf4107880 0x7f9bf419f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36552/0 (socket says 172.21.15.45:36552) 2024-05-10T03:40:04.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.956+0000 7f9bfaad0700 1 -- 172.21.15.45:0/3015728433 learned_addr learned my addr 172.21.15.45:0/3015728433 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:04.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.956+0000 7f9bfa2cf700 1 --2- 172.21.15.45:0/3015728433 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bf4069090 0x7f9bf41980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:04.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.956+0000 7f9bf9ace700 1 --2- 172.21.15.45:0/3015728433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf4104d10 0x7f9bf4198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.956+0000 7f9bfaad0700 1 -- 172.21.15.45:0/3015728433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf4104d10 msgr2=0x7f9bf4198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.956+0000 7f9bfaad0700 1 --2- 172.21.15.45:0/3015728433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf4104d10 0x7f9bf4198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.956+0000 7f9bfaad0700 1 -- 172.21.15.45:0/3015728433 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bf4069090 msgr2=0x7f9bf41980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.956+0000 7f9bfaad0700 1 --2- 172.21.15.45:0/3015728433 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bf4069090 0x7f9bf41980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.956+0000 7f9bfaad0700 1 -- 172.21.15.45:0/3015728433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec009d00 con 0x7f9bf4107880 2024-05-10T03:40:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.956+0000 7f9bfaad0700 1 --2- 172.21.15.45:0/3015728433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bf4107880 0x7f9bf419f5a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9bec00b830 tx=0x7f9bec009440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.956+0000 7f9beb7fe700 1 -- 172.21.15.45:0/3015728433 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec00e040 con 0x7f9bf4107880 2024-05-10T03:40:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.956+0000 7f9bfc533700 1 -- 172.21.15.45:0/3015728433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf41a0160 con 0x7f9bf4107880 2024-05-10T03:40:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.956+0000 7f9beb7fe700 1 -- 172.21.15.45:0/3015728433 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9bec004d60 con 0x7f9bf4107880 2024-05-10T03:40:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.956+0000 7f9beb7fe700 1 -- 172.21.15.45:0/3015728433 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec01d480 con 0x7f9bf4107880 2024-05-10T03:40:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.956+0000 7f9bfc533700 1 -- 172.21.15.45:0/3015728433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf41a05e0 con 0x7f9bf4107880 2024-05-10T03:40:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.957+0000 7f9bfc533700 1 -- 172.21.15.45:0/3015728433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf40fdc80 con 0x7f9bf4107880 2024-05-10T03:40:04.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.959+0000 7f9beb7fe700 1 -- 172.21.15.45:0/3015728433 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f9bec0040b0 con 0x7f9bf4107880 2024-05-10T03:40:04.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.959+0000 7f9beb7fe700 1 --2- 172.21.15.45:0/3015728433 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9be00a1260 0x7f9be00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:04.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.960+0000 7f9beb7fe700 1 -- 172.21.15.45:0/3015728433 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f9bec0ce6e0 con 0x7f9bf4107880 2024-05-10T03:40:04.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.960+0000 7f9bfa2cf700 1 --2- 172.21.15.45:0/3015728433 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9be00a1260 0x7f9be00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:04.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.960+0000 7f9bfa2cf700 1 --2- 172.21.15.45:0/3015728433 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9be00a1260 0x7f9be00a3770 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40694a0 tx=0x7f9bf0007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:04.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:04.963+0000 7f9beb7fe700 1 -- 172.21.15.45:0/3015728433 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9bec097a90 con 0x7f9bf4107880 2024-05-10T03:40:05.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.179+0000 7f9bfc533700 1 -- 172.21.15.45:0/3015728433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9bf410d500 con 0x7f9bf4107880 2024-05-10T03:40:05.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.179+0000 7f9beb7fe700 1 -- 172.21.15.45:0/3015728433 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9bec09b0b0 con 0x7f9bf4107880 2024-05-10T03:40:05.182 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-05-10T03:40:05.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.182+0000 7f9bfc533700 1 -- 172.21.15.45:0/3015728433 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9be00a1260 msgr2=0x7f9be00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:05.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.182+0000 7f9bfc533700 1 --2- 172.21.15.45:0/3015728433 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9be00a1260 0x7f9be00a3770 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40694a0 tx=0x7f9bf0007400 comp rx=0 tx=0).stop 2024-05-10T03:40:05.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.182+0000 7f9bfc533700 1 -- 172.21.15.45:0/3015728433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bf4107880 msgr2=0x7f9bf419f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:05.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.182+0000 7f9bfc533700 1 --2- 172.21.15.45:0/3015728433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bf4107880 0x7f9bf419f5a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9bec00b830 tx=0x7f9bec009440 comp rx=0 tx=0).stop 2024-05-10T03:40:05.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.182+0000 7f9bfc533700 1 -- 172.21.15.45:0/3015728433 shutdown_connections 2024-05-10T03:40:05.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.182+0000 7f9bfc533700 1 --2- 172.21.15.45:0/3015728433 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9be00a1260 0x7f9be00a3770 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:05.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.182+0000 7f9bfc533700 1 --2- 172.21.15.45:0/3015728433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bf4107880 0x7f9bf419f5a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:05.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.182+0000 7f9bfc533700 1 --2- 172.21.15.45:0/3015728433 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bf4069090 0x7f9bf41980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:05.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.182+0000 7f9bfc533700 1 --2- 172.21.15.45:0/3015728433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf4104d10 0x7f9bf4198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:05.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.182+0000 7f9bfc533700 1 -- 172.21.15.45:0/3015728433 >> 172.21.15.45:0/3015728433 conn(0x7f9bf40fc0d0 msgr2=0x7f9bf4103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:05.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.182+0000 7f9bfc533700 1 -- 172.21.15.45:0/3015728433 shutdown_connections 2024-05-10T03:40:05.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.182+0000 7f9bfc533700 1 -- 172.21.15.45:0/3015728433 wait complete. 2024-05-10T03:40:05.198 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:05 smithi045 ceph-mon[42520]: pgmap v277: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:40:05.198 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:05 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2717738697' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:40:05.198 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:05 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2772156788' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:40:05.199 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:40:05.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.345+0000 7f2fb0753700 1 -- 172.21.15.45:0/559945567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fa8102580 msgr2=0x7f2fa8108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:05.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.345+0000 7f2fb0753700 1 --2- 172.21.15.45:0/559945567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fa8102580 0x7f2fa8108e30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000b0a0 tx=0x7f2fa000b3b0 comp rx=0 tx=0).stop 2024-05-10T03:40:05.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.345+0000 7f2fb0753700 1 -- 172.21.15.45:0/559945567 shutdown_connections 2024-05-10T03:40:05.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.345+0000 7f2fb0753700 1 --2- 172.21.15.45:0/559945567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fa8102580 0x7f2fa8108e30 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:05.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.346+0000 7f2fb0753700 1 --2- 172.21.15.45:0/559945567 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fa8100ac0 0x7f2fa8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:05.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.346+0000 7f2fb0753700 1 --2- 172.21.15.45:0/559945567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fa8101be0 0x7f2fa8101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:05.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.346+0000 7f2fb0753700 1 -- 172.21.15.45:0/559945567 >> 172.21.15.45:0/559945567 conn(0x7f2fa80fc0d0 msgr2=0x7f2fa80fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:05.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.346+0000 7f2fb0753700 1 -- 172.21.15.45:0/559945567 shutdown_connections 2024-05-10T03:40:05.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.346+0000 7f2fb0753700 1 -- 172.21.15.45:0/559945567 wait complete. 2024-05-10T03:40:05.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.346+0000 7f2fb0753700 1 Processor -- start 2024-05-10T03:40:05.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.346+0000 7f2fb0753700 1 -- start start 2024-05-10T03:40:05.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.347+0000 7f2fb0753700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fa8100ac0 0x7f2fa8104880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:05.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.347+0000 7f2fb0753700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fa8101be0 0x7f2fa8102f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:05.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.347+0000 7f2fb0753700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fa8102580 0x7f2fa8103460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:05.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.347+0000 7f2fb0753700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa8103b40 con 0x7f2fa8100ac0 2024-05-10T03:40:05.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.347+0000 7f2fb0753700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa8103cb0 con 0x7f2fa8102580 2024-05-10T03:40:05.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.347+0000 7f2fb0753700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa81a2210 con 0x7f2fa8101be0 2024-05-10T03:40:05.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.347+0000 7f2fae4ef700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fa8100ac0 0x7f2fa8104880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:05.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.347+0000 7f2fae4ef700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fa8100ac0 0x7f2fa8104880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36582/0 (socket says 172.21.15.45:36582) 2024-05-10T03:40:05.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.347+0000 7f2fae4ef700 1 -- 172.21.15.45:0/495286477 learned_addr learned my addr 172.21.15.45:0/495286477 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:05.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.347+0000 7f2fadcee700 1 --2- 172.21.15.45:0/495286477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fa8101be0 0x7f2fa8102f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:05.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.347+0000 7f2faecf0700 1 --2- 172.21.15.45:0/495286477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fa8102580 0x7f2fa8103460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:05.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.347+0000 7f2fae4ef700 1 -- 172.21.15.45:0/495286477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fa8101be0 msgr2=0x7f2fa8102f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:05.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.347+0000 7f2fae4ef700 1 --2- 172.21.15.45:0/495286477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fa8101be0 0x7f2fa8102f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:05.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.347+0000 7f2fae4ef700 1 -- 172.21.15.45:0/495286477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fa8102580 msgr2=0x7f2fa8103460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:05.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.347+0000 7f2fae4ef700 1 --2- 172.21.15.45:0/495286477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fa8102580 0x7f2fa8103460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:05.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.347+0000 7f2fae4ef700 1 -- 172.21.15.45:0/495286477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa0009d00 con 0x7f2fa8100ac0 2024-05-10T03:40:05.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.347+0000 7f2fae4ef700 1 --2- 172.21.15.45:0/495286477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fa8100ac0 0x7f2fa8104880 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400d950 tx=0x7f2fa400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:05.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.348+0000 7f2f9f7fe700 1 -- 172.21.15.45:0/495286477 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4004220 con 0x7f2fa8100ac0 2024-05-10T03:40:05.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.348+0000 7f2f9f7fe700 1 -- 172.21.15.45:0/495286477 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2fa4004380 con 0x7f2fa8100ac0 2024-05-10T03:40:05.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.348+0000 7f2f9f7fe700 1 -- 172.21.15.45:0/495286477 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4003c50 con 0x7f2fa8100ac0 2024-05-10T03:40:05.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.348+0000 7f2fb0753700 1 -- 172.21.15.45:0/495286477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa81a2470 con 0x7f2fa8100ac0 2024-05-10T03:40:05.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.348+0000 7f2fb0753700 1 -- 172.21.15.45:0/495286477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa81a2900 con 0x7f2fa8100ac0 2024-05-10T03:40:05.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.349+0000 7f2fb0753700 1 -- 172.21.15.45:0/495286477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa80694d0 con 0x7f2fa8100ac0 2024-05-10T03:40:05.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.350+0000 7f2f9f7fe700 1 -- 172.21.15.45:0/495286477 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2fa400fc70 con 0x7f2fa8100ac0 2024-05-10T03:40:05.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.351+0000 7f2f9f7fe700 1 --2- 172.21.15.45:0/495286477 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2f940a11b0 0x7f2f940a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:05.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.351+0000 7f2fadcee700 1 --2- 172.21.15.45:0/495286477 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2f940a11b0 0x7f2f940a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:05.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.351+0000 7f2f9f7fe700 1 -- 172.21.15.45:0/495286477 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f2fa40ccfa0 con 0x7f2fa8100ac0 2024-05-10T03:40:05.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.352+0000 7f2fadcee700 1 --2- 172.21.15.45:0/495286477 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2f940a11b0 0x7f2f940a36c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8104220 tx=0x7f2f98009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:05.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.355+0000 7f2f9f7fe700 1 -- 172.21.15.45:0/495286477 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2fa40962c0 con 0x7f2fa8100ac0 2024-05-10T03:40:05.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:05 smithi106 ceph-mon[46996]: pgmap v277: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:40:05.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:05 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2717738697' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:40:05.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:05 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2772156788' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:40:05.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:05 smithi154 ceph-mon[46565]: pgmap v277: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:40:05.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:05 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2717738697' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:40:05.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:05 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2772156788' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:40:05.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.623+0000 7f2fb0753700 1 -- 172.21.15.45:0/495286477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fa810c410 con 0x7f2fa8100ac0 2024-05-10T03:40:05.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.624+0000 7f2f9f7fe700 1 -- 172.21.15.45:0/495286477 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10926 (secure 0 0 0) 0x7f2fa4017090 con 0x7f2fa8100ac0 2024-05-10T03:40:05.627 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:40:05.627 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/378320264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":378320264},{"type":"v1","addr":"172.21.15.45:6835","nonce":378320264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3032381796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3032381796},{"type":"v1","addr":"172.21.15.45:6837","nonce":3032381796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T03:38:36.555290+0000","modified":"2024-05-10T03:39:00.010786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24548,"mds_2":24547,"mds_3":24526,"mds_4":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14625":{"gid":14625,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6839/4007419304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":4007419304},{"type":"v1","addr":"172.21.15.45:6839","nonce":4007419304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14637":{"gid":14637,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6841/1355456195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1355456195},{"type":"v1","addr":"172.21.15.45:6841","nonce":1355456195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/4037121210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":4037121210},{"type":"v1","addr":"172.21.15.154:6835","nonce":4037121210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24521":{"gid":24521,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.106:6835/4162885659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4162885659},{"type":"v1","addr":"172.21.15.106:6835","nonce":4162885659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.154:6837/608167481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":608167481},{"type":"v1","addr":"172.21.15.154:6837","nonce":608167481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/1506563336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1506563336},{"type":"v1","addr":"172.21.15.154:6839","nonce":1506563336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.106:6837/3047487403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":3047487403},{"type":"v1","addr":"172.21.15.106:6837","nonce":3047487403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6839/3533867856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":3533867856},{"type":"v1","addr":"172.21.15.106:6839","nonce":3533867856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T03:40:05.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.627+0000 7f2fb0753700 1 -- 172.21.15.45:0/495286477 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2f940a11b0 msgr2=0x7f2f940a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:05.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.627+0000 7f2fb0753700 1 --2- 172.21.15.45:0/495286477 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2f940a11b0 0x7f2f940a36c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8104220 tx=0x7f2f98009260 comp rx=0 tx=0).stop 2024-05-10T03:40:05.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.627+0000 7f2fb0753700 1 -- 172.21.15.45:0/495286477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fa8100ac0 msgr2=0x7f2fa8104880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:05.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.627+0000 7f2fb0753700 1 --2- 172.21.15.45:0/495286477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fa8100ac0 0x7f2fa8104880 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400d950 tx=0x7f2fa400dc60 comp rx=0 tx=0).stop 2024-05-10T03:40:05.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.627+0000 7f2fb0753700 1 -- 172.21.15.45:0/495286477 shutdown_connections 2024-05-10T03:40:05.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.627+0000 7f2fb0753700 1 --2- 172.21.15.45:0/495286477 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2f940a11b0 0x7f2f940a36c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:05.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.627+0000 7f2fb0753700 1 --2- 172.21.15.45:0/495286477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fa8102580 0x7f2fa8103460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:05.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.627+0000 7f2fb0753700 1 --2- 172.21.15.45:0/495286477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fa8100ac0 0x7f2fa8104880 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:05.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.627+0000 7f2fb0753700 1 --2- 172.21.15.45:0/495286477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fa8101be0 0x7f2fa8102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:05.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.627+0000 7f2fb0753700 1 -- 172.21.15.45:0/495286477 >> 172.21.15.45:0/495286477 conn(0x7f2fa80fc0d0 msgr2=0x7f2fa80683c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:05.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.627+0000 7f2fb0753700 1 -- 172.21.15.45:0/495286477 shutdown_connections 2024-05-10T03:40:05.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.627+0000 7f2fb0753700 1 -- 172.21.15.45:0/495286477 wait complete. 2024-05-10T03:40:05.631 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 27 2024-05-10T03:40:05.644 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:40:05.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.791+0000 7f257e616700 1 -- 172.21.15.45:0/1451312319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2578104d10 msgr2=0x7f25781071f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:05.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.791+0000 7f257e616700 1 --2- 172.21.15.45:0/1451312319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2578104d10 0x7f25781071f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f256c009990 tx=0x7f256c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:05.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.791+0000 7f257e616700 1 -- 172.21.15.45:0/1451312319 shutdown_connections 2024-05-10T03:40:05.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.791+0000 7f257e616700 1 --2- 172.21.15.45:0/1451312319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2578107880 0x7f2578109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:05.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.791+0000 7f257e616700 1 --2- 172.21.15.45:0/1451312319 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2578069090 0x7f2578104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:05.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.791+0000 7f257e616700 1 --2- 172.21.15.45:0/1451312319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2578104d10 0x7f25781071f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:05.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.791+0000 7f257e616700 1 -- 172.21.15.45:0/1451312319 >> 172.21.15.45:0/1451312319 conn(0x7f25780fc0d0 msgr2=0x7f25780fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:05.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.792+0000 7f257e616700 1 -- 172.21.15.45:0/1451312319 shutdown_connections 2024-05-10T03:40:05.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.792+0000 7f257e616700 1 -- 172.21.15.45:0/1451312319 wait complete. 2024-05-10T03:40:05.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.792+0000 7f257e616700 1 Processor -- start 2024-05-10T03:40:05.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.792+0000 7f257e616700 1 -- start start 2024-05-10T03:40:05.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.793+0000 7f257e616700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2578069090 0x7f2578101f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:05.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.793+0000 7f257e616700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2578104d10 0x7f2578100620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:05.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.793+0000 7f257e616700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2578107880 0x7f2578100b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:05.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.793+0000 7f257e616700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2578101240 con 0x7f2578104d10 2024-05-10T03:40:05.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.793+0000 7f257e616700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25781013b0 con 0x7f2578107880 2024-05-10T03:40:05.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.793+0000 7f257e616700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25781a2180 con 0x7f2578069090 2024-05-10T03:40:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.793+0000 7f25777fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2578104d10 0x7f2578100620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.793+0000 7f25777fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2578104d10 0x7f2578100620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36598/0 (socket says 172.21.15.45:36598) 2024-05-10T03:40:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.793+0000 7f25777fe700 1 -- 172.21.15.45:0/4015759874 learned_addr learned my addr 172.21.15.45:0/4015759874 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.793+0000 7f2577fff700 1 --2- 172.21.15.45:0/4015759874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2578069090 0x7f2578101f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.793+0000 7f257cbb3700 1 --2- 172.21.15.45:0/4015759874 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2578107880 0x7f2578100b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.793+0000 7f25777fe700 1 -- 172.21.15.45:0/4015759874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2578069090 msgr2=0x7f2578101f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.793+0000 7f25777fe700 1 --2- 172.21.15.45:0/4015759874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2578069090 0x7f2578101f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.793+0000 7f25777fe700 1 -- 172.21.15.45:0/4015759874 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2578107880 msgr2=0x7f2578100b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.793+0000 7f25777fe700 1 --2- 172.21.15.45:0/4015759874 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2578107880 0x7f2578100b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.793+0000 7f25777fe700 1 -- 172.21.15.45:0/4015759874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256c0095f0 con 0x7f2578104d10 2024-05-10T03:40:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.793+0000 7f25777fe700 1 --2- 172.21.15.45:0/4015759874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2578104d10 0x7f2578100620 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f256c000c00 tx=0x7f256c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.794+0000 7f25757fa700 1 -- 172.21.15.45:0/4015759874 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c01d070 con 0x7f2578104d10 2024-05-10T03:40:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.794+0000 7f25757fa700 1 -- 172.21.15.45:0/4015759874 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f256c00fdb0 con 0x7f2578104d10 2024-05-10T03:40:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.794+0000 7f257e616700 1 -- 172.21.15.45:0/4015759874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25781a2380 con 0x7f2578104d10 2024-05-10T03:40:05.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.794+0000 7f25757fa700 1 -- 172.21.15.45:0/4015759874 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c017650 con 0x7f2578104d10 2024-05-10T03:40:05.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.794+0000 7f257e616700 1 -- 172.21.15.45:0/4015759874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25781a2800 con 0x7f2578104d10 2024-05-10T03:40:05.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.795+0000 7f257e616700 1 -- 172.21.15.45:0/4015759874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25780fdc80 con 0x7f2578104d10 2024-05-10T03:40:05.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.796+0000 7f25757fa700 1 -- 172.21.15.45:0/4015759874 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f256c021410 con 0x7f2578104d10 2024-05-10T03:40:05.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.797+0000 7f25757fa700 1 --2- 172.21.15.45:0/4015759874 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f25600a1230 0x7f25600a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:05.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.797+0000 7f2577fff700 1 --2- 172.21.15.45:0/4015759874 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f25600a1230 0x7f25600a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:05.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.797+0000 7f25757fa700 1 -- 172.21.15.45:0/4015759874 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f256c021e40 con 0x7f2578104d10 2024-05-10T03:40:05.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.798+0000 7f2577fff700 1 --2- 172.21.15.45:0/4015759874 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f25600a1230 0x7f25600a3740 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f25780694a0 tx=0x7f256800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:05.803 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:05.801+0000 7f25757fa700 1 -- 172.21.15.45:0/4015759874 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f256c097b20 con 0x7f2578104d10 2024-05-10T03:40:06.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.021+0000 7f257e616700 1 -- 172.21.15.45:0/4015759874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f257810d550 con 0x7f2578104d10 2024-05-10T03:40:06.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.022+0000 7f25757fa700 1 -- 172.21.15.45:0/4015759874 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+24508 (secure 0 0 0) 0x7f256c09b140 con 0x7f2578104d10 2024-05-10T03:40:06.025 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:40:06.026 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":88,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:39:27.064512+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:38:34.871801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:38:35.935386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T03:38:39.029903+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:40:06.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.025+0000 7f257e616700 1 -- 172.21.15.45:0/4015759874 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f25600a1230 msgr2=0x7f25600a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:06.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.025+0000 7f257e616700 1 --2- 172.21.15.45:0/4015759874 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f25600a1230 0x7f25600a3740 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f25780694a0 tx=0x7f256800b410 comp rx=0 tx=0).stop 2024-05-10T03:40:06.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.025+0000 7f257e616700 1 -- 172.21.15.45:0/4015759874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2578104d10 msgr2=0x7f2578100620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:06.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.025+0000 7f257e616700 1 --2- 172.21.15.45:0/4015759874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2578104d10 0x7f2578100620 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f256c000c00 tx=0x7f256c00f690 comp rx=0 tx=0).stop 2024-05-10T03:40:06.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.025+0000 7f257e616700 1 -- 172.21.15.45:0/4015759874 shutdown_connections 2024-05-10T03:40:06.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.025+0000 7f257e616700 1 --2- 172.21.15.45:0/4015759874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2578069090 0x7f2578101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.025+0000 7f257e616700 1 --2- 172.21.15.45:0/4015759874 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f25600a1230 0x7f25600a3740 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.025+0000 7f257e616700 1 --2- 172.21.15.45:0/4015759874 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2578107880 0x7f2578100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.025+0000 7f257e616700 1 --2- 172.21.15.45:0/4015759874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2578104d10 0x7f2578100620 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.025+0000 7f257e616700 1 -- 172.21.15.45:0/4015759874 >> 172.21.15.45:0/4015759874 conn(0x7f25780fc0d0 msgr2=0x7f2578102f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:06.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.025+0000 7f257e616700 1 -- 172.21.15.45:0/4015759874 shutdown_connections 2024-05-10T03:40:06.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.025+0000 7f257e616700 1 -- 172.21.15.45:0/4015759874 wait complete. 2024-05-10T03:40:06.043 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T03:35:20.339400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T03:38:34.871801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T03:38:35.935386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-10T03:38:39.029903+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-10T03:40:06.044 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T03:40:06.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.195+0000 7fcc407d9700 1 -- 172.21.15.45:0/1566528667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc381036c0 msgr2=0x7fcc38109f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:06.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.195+0000 7fcc407d9700 1 --2- 172.21.15.45:0/1566528667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc381036c0 0x7fcc38109f70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000b0a0 tx=0x7fcc3000b3b0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.195+0000 7fcc407d9700 1 -- 172.21.15.45:0/1566528667 shutdown_connections 2024-05-10T03:40:06.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.195+0000 7fcc407d9700 1 --2- 172.21.15.45:0/1566528667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc38101c00 0x7fcc38102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.195+0000 7fcc407d9700 1 --2- 172.21.15.45:0/1566528667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc381036c0 0x7fcc38109f70 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.195+0000 7fcc407d9700 1 --2- 172.21.15.45:0/1566528667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc38102d20 0x7fcc38103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.195+0000 7fcc407d9700 1 -- 172.21.15.45:0/1566528667 >> 172.21.15.45:0/1566528667 conn(0x7fcc380fd210 msgr2=0x7fcc380ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:06.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.195+0000 7fcc407d9700 1 -- 172.21.15.45:0/1566528667 shutdown_connections 2024-05-10T03:40:06.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.195+0000 7fcc407d9700 1 -- 172.21.15.45:0/1566528667 wait complete. 2024-05-10T03:40:06.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.195+0000 7fcc407d9700 1 Processor -- start 2024-05-10T03:40:06.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.196+0000 7fcc407d9700 1 -- start start 2024-05-10T03:40:06.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.196+0000 7fcc407d9700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc38101c00 0x7fcc38198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:06.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.196+0000 7fcc407d9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc38102d20 0x7fcc381986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:06.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.196+0000 7fcc407d9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc381036c0 0x7fcc3819f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:06.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.196+0000 7fcc407d9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3819fc60 con 0x7fcc381036c0 2024-05-10T03:40:06.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.196+0000 7fcc407d9700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3819fdd0 con 0x7fcc38101c00 2024-05-10T03:40:06.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.196+0000 7fcc407d9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3819ff90 con 0x7fcc38102d20 2024-05-10T03:40:06.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.196+0000 7fcc3ed76700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc381036c0 0x7fcc3819f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:06.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.196+0000 7fcc3e575700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc38101c00 0x7fcc38198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:06.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.196+0000 7fcc3ed76700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc381036c0 0x7fcc3819f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36602/0 (socket says 172.21.15.45:36602) 2024-05-10T03:40:06.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.196+0000 7fcc3ed76700 1 -- 172.21.15.45:0/3532782987 learned_addr learned my addr 172.21.15.45:0/3532782987 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:06.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.196+0000 7fcc3dd74700 1 --2- 172.21.15.45:0/3532782987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc38102d20 0x7fcc381986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:06.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.196+0000 7fcc3ed76700 1 -- 172.21.15.45:0/3532782987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc38102d20 msgr2=0x7fcc381986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:06.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.196+0000 7fcc3ed76700 1 --2- 172.21.15.45:0/3532782987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc38102d20 0x7fcc381986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.196+0000 7fcc3ed76700 1 -- 172.21.15.45:0/3532782987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc38101c00 msgr2=0x7fcc38198180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:06.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.196+0000 7fcc3ed76700 1 --2- 172.21.15.45:0/3532782987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc38101c00 0x7fcc38198180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.196+0000 7fcc3ed76700 1 -- 172.21.15.45:0/3532782987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc30009d00 con 0x7fcc381036c0 2024-05-10T03:40:06.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.197+0000 7fcc3ed76700 1 --2- 172.21.15.45:0/3532782987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc381036c0 0x7fcc3819f650 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000b070 tx=0x7fcc30004dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:06.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.197+0000 7fcc2f7fe700 1 -- 172.21.15.45:0/3532782987 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3000e040 con 0x7fcc381036c0 2024-05-10T03:40:06.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.197+0000 7fcc2f7fe700 1 -- 172.21.15.45:0/3532782987 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcc300078d0 con 0x7fcc381036c0 2024-05-10T03:40:06.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.197+0000 7fcc2f7fe700 1 -- 172.21.15.45:0/3532782987 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3001b7a0 con 0x7fcc381036c0 2024-05-10T03:40:06.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.197+0000 7fcc407d9700 1 -- 172.21.15.45:0/3532782987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc381a0210 con 0x7fcc381036c0 2024-05-10T03:40:06.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.197+0000 7fcc407d9700 1 -- 172.21.15.45:0/3532782987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc381a0640 con 0x7fcc381036c0 2024-05-10T03:40:06.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.198+0000 7fcc407d9700 1 -- 172.21.15.45:0/3532782987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc38108e10 con 0x7fcc381036c0 2024-05-10T03:40:06.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.199+0000 7fcc2f7fe700 1 -- 172.21.15.45:0/3532782987 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fcc3001b900 con 0x7fcc381036c0 2024-05-10T03:40:06.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.200+0000 7fcc2f7fe700 1 --2- 172.21.15.45:0/3532782987 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcc240a1260 0x7fcc240a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:06.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.200+0000 7fcc2f7fe700 1 -- 172.21.15.45:0/3532782987 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fcc300cec60 con 0x7fcc381036c0 2024-05-10T03:40:06.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.200+0000 7fcc3e575700 1 --2- 172.21.15.45:0/3532782987 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcc240a1260 0x7fcc240a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:06.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.201+0000 7fcc3e575700 1 --2- 172.21.15.45:0/3532782987 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcc240a1260 0x7fcc240a3770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcc38102c20 tx=0x7fcc3400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:06.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.204+0000 7fcc2f7fe700 1 -- 172.21.15.45:0/3532782987 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fcc30098010 con 0x7fcc381036c0 2024-05-10T03:40:06.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:06 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3015728433' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:40:06.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:06 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/495286477' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:40:06.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:06 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/4015759874' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:40:06.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:06 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3015728433' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:40:06.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:06 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/495286477' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:40:06.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:06 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/4015759874' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:40:06.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.424+0000 7fcc407d9700 1 -- 172.21.15.45:0/3532782987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcc3810d5a0 con 0x7fcc381036c0 2024-05-10T03:40:06.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.424+0000 7fcc2f7fe700 1 -- 172.21.15.45:0/3532782987 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc3009b630 con 0x7fcc381036c0 2024-05-10T03:40:06.427 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-05-10T03:40:06.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.427+0000 7fcc407d9700 1 -- 172.21.15.45:0/3532782987 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcc240a1260 msgr2=0x7fcc240a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:06.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.427+0000 7fcc407d9700 1 --2- 172.21.15.45:0/3532782987 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcc240a1260 0x7fcc240a3770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcc38102c20 tx=0x7fcc3400b410 comp rx=0 tx=0).stop 2024-05-10T03:40:06.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.427+0000 7fcc407d9700 1 -- 172.21.15.45:0/3532782987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc381036c0 msgr2=0x7fcc3819f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:06.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.427+0000 7fcc407d9700 1 --2- 172.21.15.45:0/3532782987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc381036c0 0x7fcc3819f650 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000b070 tx=0x7fcc30004dc0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.427+0000 7fcc407d9700 1 -- 172.21.15.45:0/3532782987 shutdown_connections 2024-05-10T03:40:06.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.427+0000 7fcc407d9700 1 --2- 172.21.15.45:0/3532782987 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcc240a1260 0x7fcc240a3770 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.427+0000 7fcc407d9700 1 --2- 172.21.15.45:0/3532782987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc381036c0 0x7fcc3819f650 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.427+0000 7fcc407d9700 1 --2- 172.21.15.45:0/3532782987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc38101c00 0x7fcc38198180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.427+0000 7fcc407d9700 1 --2- 172.21.15.45:0/3532782987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc38102d20 0x7fcc381986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.427+0000 7fcc407d9700 1 -- 172.21.15.45:0/3532782987 >> 172.21.15.45:0/3532782987 conn(0x7fcc380fd210 msgr2=0x7fcc38105f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:06.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.427+0000 7fcc407d9700 1 -- 172.21.15.45:0/3532782987 shutdown_connections 2024-05-10T03:40:06.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.427+0000 7fcc407d9700 1 -- 172.21.15.45:0/3532782987 wait complete. 2024-05-10T03:40:06.444 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T03:40:06.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:06 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3015728433' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:40:06.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:06 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/495286477' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:40:06.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:06 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/4015759874' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:40:06.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.593+0000 7fe075d0a700 1 -- 172.21.15.45:0/1112787778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe070100af0 msgr2=0x7fe070100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:06.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.593+0000 7fe075d0a700 1 --2- 172.21.15.45:0/1112787778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe070100af0 0x7fe070100f00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe060009990 tx=0x7fe060009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.593+0000 7fe075d0a700 1 -- 172.21.15.45:0/1112787778 shutdown_connections 2024-05-10T03:40:06.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.593+0000 7fe075d0a700 1 --2- 172.21.15.45:0/1112787778 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0701025b0 0x7fe070108e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.593+0000 7fe075d0a700 1 --2- 172.21.15.45:0/1112787778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe070100af0 0x7fe070100f00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.593+0000 7fe075d0a700 1 --2- 172.21.15.45:0/1112787778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe070101c10 0x7fe070102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.593+0000 7fe075d0a700 1 -- 172.21.15.45:0/1112787778 >> 172.21.15.45:0/1112787778 conn(0x7fe0700fc0e0 msgr2=0x7fe0700fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:06.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.593+0000 7fe075d0a700 1 -- 172.21.15.45:0/1112787778 shutdown_connections 2024-05-10T03:40:06.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.593+0000 7fe075d0a700 1 -- 172.21.15.45:0/1112787778 wait complete. 2024-05-10T03:40:06.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.594+0000 7fe075d0a700 1 Processor -- start 2024-05-10T03:40:06.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.594+0000 7fe075d0a700 1 -- start start 2024-05-10T03:40:06.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.594+0000 7fe075d0a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe070100af0 0x7fe070073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:06.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.594+0000 7fe075d0a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe070101c10 0x7fe07019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:06.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.594+0000 7fe075d0a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0701025b0 0x7fe07019f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:06.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.594+0000 7fe075d0a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07019fac0 con 0x7fe0701025b0 2024-05-10T03:40:06.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.594+0000 7fe075d0a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07019fc30 con 0x7fe070100af0 2024-05-10T03:40:06.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.594+0000 7fe075d0a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07019fdf0 con 0x7fe070101c10 2024-05-10T03:40:06.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.595+0000 7fe06ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0701025b0 0x7fe07019f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:06.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.595+0000 7fe06ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0701025b0 0x7fe07019f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36620/0 (socket says 172.21.15.45:36620) 2024-05-10T03:40:06.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.595+0000 7fe06ffff700 1 -- 172.21.15.45:0/2140511157 learned_addr learned my addr 172.21.15.45:0/2140511157 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:06.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.595+0000 7fe06f7fe700 1 --2- 172.21.15.45:0/2140511157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe070100af0 0x7fe070073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:06.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.595+0000 7fe06effd700 1 --2- 172.21.15.45:0/2140511157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe070101c10 0x7fe07019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:06.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.595+0000 7fe06ffff700 1 -- 172.21.15.45:0/2140511157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe070101c10 msgr2=0x7fe07019cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:06.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.595+0000 7fe06ffff700 1 --2- 172.21.15.45:0/2140511157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe070101c10 0x7fe07019cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.595+0000 7fe06ffff700 1 -- 172.21.15.45:0/2140511157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe070100af0 msgr2=0x7fe070073eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:06.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.595+0000 7fe06ffff700 1 --2- 172.21.15.45:0/2140511157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe070100af0 0x7fe070073eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.595+0000 7fe06ffff700 1 -- 172.21.15.45:0/2140511157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0600095f0 con 0x7fe0701025b0 2024-05-10T03:40:06.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.595+0000 7fe06effd700 1 --2- 172.21.15.45:0/2140511157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe070101c10 0x7fe07019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:06.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.595+0000 7fe06ffff700 1 --2- 172.21.15.45:0/2140511157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0701025b0 0x7fe07019f3c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe06800ef30 tx=0x7fe06800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:06.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.595+0000 7fe06cff9700 1 -- 172.21.15.45:0/2140511157 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe068018070 con 0x7fe0701025b0 2024-05-10T03:40:06.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.595+0000 7fe06cff9700 1 -- 172.21.15.45:0/2140511157 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe06800f040 con 0x7fe0701025b0 2024-05-10T03:40:06.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.595+0000 7fe06cff9700 1 -- 172.21.15.45:0/2140511157 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06800ce00 con 0x7fe0701025b0 2024-05-10T03:40:06.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.595+0000 7fe075d0a700 1 -- 172.21.15.45:0/2140511157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0701a0070 con 0x7fe0701025b0 2024-05-10T03:40:06.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.595+0000 7fe075d0a700 1 -- 172.21.15.45:0/2140511157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0701a0530 con 0x7fe0701025b0 2024-05-10T03:40:06.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.597+0000 7fe075d0a700 1 -- 172.21.15.45:0/2140511157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe070107d00 con 0x7fe0701025b0 2024-05-10T03:40:06.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.598+0000 7fe06cff9700 1 -- 172.21.15.45:0/2140511157 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fe068003a00 con 0x7fe0701025b0 2024-05-10T03:40:06.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.598+0000 7fe06cff9700 1 --2- 172.21.15.45:0/2140511157 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe05c0a12e0 0x7fe05c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:06.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.599+0000 7fe06f7fe700 1 --2- 172.21.15.45:0/2140511157 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe05c0a12e0 0x7fe05c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:06.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.599+0000 7fe06cff9700 1 -- 172.21.15.45:0/2140511157 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fe0680cc8c0 con 0x7fe0701025b0 2024-05-10T03:40:06.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.599+0000 7fe06f7fe700 1 --2- 172.21.15.45:0/2140511157 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe05c0a12e0 0x7fe05c0a37f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe060006010 tx=0x7fe06001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:06.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.603+0000 7fe06cff9700 1 -- 172.21.15.45:0/2140511157 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe068095c10 con 0x7fe0701025b0 2024-05-10T03:40:06.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.820+0000 7fe075d0a700 1 -- 172.21.15.45:0/2140511157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe07002ce20 con 0x7fe0701025b0 2024-05-10T03:40:06.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.821+0000 7fe06cff9700 1 -- 172.21.15.45:0/2140511157 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe068099230 con 0x7fe0701025b0 2024-05-10T03:40:06.823 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-05-10T03:40:06.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.823+0000 7fe075d0a700 1 -- 172.21.15.45:0/2140511157 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe05c0a12e0 msgr2=0x7fe05c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:06.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.823+0000 7fe075d0a700 1 --2- 172.21.15.45:0/2140511157 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe05c0a12e0 0x7fe05c0a37f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe060006010 tx=0x7fe06001a040 comp rx=0 tx=0).stop 2024-05-10T03:40:06.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.823+0000 7fe075d0a700 1 -- 172.21.15.45:0/2140511157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0701025b0 msgr2=0x7fe07019f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:06.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.823+0000 7fe075d0a700 1 --2- 172.21.15.45:0/2140511157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0701025b0 0x7fe07019f3c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe06800ef30 tx=0x7fe06800c3a0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.823+0000 7fe075d0a700 1 -- 172.21.15.45:0/2140511157 shutdown_connections 2024-05-10T03:40:06.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.823+0000 7fe075d0a700 1 --2- 172.21.15.45:0/2140511157 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe05c0a12e0 0x7fe05c0a37f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.823+0000 7fe075d0a700 1 --2- 172.21.15.45:0/2140511157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0701025b0 0x7fe07019f3c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.823+0000 7fe075d0a700 1 --2- 172.21.15.45:0/2140511157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe070100af0 0x7fe070073eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.823+0000 7fe075d0a700 1 --2- 172.21.15.45:0/2140511157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe070101c10 0x7fe07019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.823+0000 7fe075d0a700 1 -- 172.21.15.45:0/2140511157 >> 172.21.15.45:0/2140511157 conn(0x7fe0700fc0e0 msgr2=0x7fe070104e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:06.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.823+0000 7fe075d0a700 1 -- 172.21.15.45:0/2140511157 shutdown_connections 2024-05-10T03:40:06.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.823+0000 7fe075d0a700 1 -- 172.21.15.45:0/2140511157 wait complete. 2024-05-10T03:40:06.840 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T03:40:06.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.990+0000 7f71920b1700 1 -- 172.21.15.45:0/1634131820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f718c1026d0 msgr2=0x7f718c104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:06.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.990+0000 7f71920b1700 1 --2- 172.21.15.45:0/1634131820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f718c1026d0 0x7f718c104af0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f717c009990 tx=0x7f717c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.990+0000 7f71920b1700 1 -- 172.21.15.45:0/1634131820 shutdown_connections 2024-05-10T03:40:06.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.991+0000 7f71920b1700 1 --2- 172.21.15.45:0/1634131820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f718c107990 0x7f718c109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.991+0000 7f71920b1700 1 --2- 172.21.15.45:0/1634131820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f718c1026d0 0x7f718c104af0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.991+0000 7f71920b1700 1 --2- 172.21.15.45:0/1634131820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f718c105030 0x7f718c107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.991+0000 7f71920b1700 1 -- 172.21.15.45:0/1634131820 >> 172.21.15.45:0/1634131820 conn(0x7f718c0fc0f0 msgr2=0x7f718c0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:06.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.991+0000 7f71920b1700 1 -- 172.21.15.45:0/1634131820 shutdown_connections 2024-05-10T03:40:06.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.991+0000 7f71920b1700 1 -- 172.21.15.45:0/1634131820 wait complete. 2024-05-10T03:40:06.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.991+0000 7f71920b1700 1 Processor -- start 2024-05-10T03:40:06.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.991+0000 7f71920b1700 1 -- start start 2024-05-10T03:40:06.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.992+0000 7f71920b1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f718c1026d0 0x7f718c198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:06.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.992+0000 7f71920b1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f718c105030 0x7f718c198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:06.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.992+0000 7f71920b1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f718c107990 0x7f718c19f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:06.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.992+0000 7f71920b1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c19fb20 con 0x7f718c1026d0 2024-05-10T03:40:06.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.992+0000 7f71920b1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c19fc90 con 0x7f718c105030 2024-05-10T03:40:06.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.992+0000 7f71920b1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c19fe50 con 0x7f718c107990 2024-05-10T03:40:06.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.992+0000 7f718b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f718c1026d0 0x7f718c198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:06.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.992+0000 7f718b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f718c1026d0 0x7f718c198040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36640/0 (socket says 172.21.15.45:36640) 2024-05-10T03:40:06.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.992+0000 7f718b7fe700 1 -- 172.21.15.45:0/2969424628 learned_addr learned my addr 172.21.15.45:0/2969424628 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:06.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.992+0000 7f718affd700 1 --2- 172.21.15.45:0/2969424628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f718c105030 0x7f718c198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:06.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.992+0000 7f718bfff700 1 --2- 172.21.15.45:0/2969424628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f718c107990 0x7f718c19f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:06.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.992+0000 7f718b7fe700 1 -- 172.21.15.45:0/2969424628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f718c107990 msgr2=0x7f718c19f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:06.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.992+0000 7f718b7fe700 1 --2- 172.21.15.45:0/2969424628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f718c107990 0x7f718c19f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.992+0000 7f718b7fe700 1 -- 172.21.15.45:0/2969424628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f718c105030 msgr2=0x7f718c198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:06.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.992+0000 7f718b7fe700 1 --2- 172.21.15.45:0/2969424628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f718c105030 0x7f718c198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:06.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.992+0000 7f718b7fe700 1 -- 172.21.15.45:0/2969424628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7174009520 con 0x7f718c1026d0 2024-05-10T03:40:06.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.992+0000 7f718b7fe700 1 --2- 172.21.15.45:0/2969424628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f718c1026d0 0x7f718c198040 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f717c0098e0 tx=0x7f717c00bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:06.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.993+0000 7f7188ff9700 1 -- 172.21.15.45:0/2969424628 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c01d070 con 0x7f718c1026d0 2024-05-10T03:40:06.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.993+0000 7f7188ff9700 1 -- 172.21.15.45:0/2969424628 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f717c022470 con 0x7f718c1026d0 2024-05-10T03:40:06.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.993+0000 7f71920b1700 1 -- 172.21.15.45:0/2969424628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717c0095f0 con 0x7f718c1026d0 2024-05-10T03:40:06.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.993+0000 7f7188ff9700 1 -- 172.21.15.45:0/2969424628 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c017650 con 0x7f718c1026d0 2024-05-10T03:40:06.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.993+0000 7f71920b1700 1 -- 172.21.15.45:0/2969424628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f718c1a0360 con 0x7f718c1026d0 2024-05-10T03:40:06.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.994+0000 7f71920b1700 1 -- 172.21.15.45:0/2969424628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f718c0fdca0 con 0x7f718c1026d0 2024-05-10T03:40:06.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.995+0000 7f7188ff9700 1 -- 172.21.15.45:0/2969424628 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f717c022990 con 0x7f718c1026d0 2024-05-10T03:40:06.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.996+0000 7f7188ff9700 1 --2- 172.21.15.45:0/2969424628 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f71780a1260 0x7f71780a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:06.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.996+0000 7f718affd700 1 --2- 172.21.15.45:0/2969424628 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f71780a1260 0x7f71780a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:06.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.996+0000 7f7188ff9700 1 -- 172.21.15.45:0/2969424628 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f717c0ce2e0 con 0x7f718c1026d0 2024-05-10T03:40:07.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.996+0000 7f718affd700 1 --2- 172.21.15.45:0/2969424628 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f71780a1260 0x7f71780a3770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f718c1990e0 tx=0x7f7174009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:07.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:06.999+0000 7f7188ff9700 1 -- 172.21.15.45:0/2969424628 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f717c05dd60 con 0x7f718c1026d0 2024-05-10T03:40:07.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.219+0000 7f71920b1700 1 -- 172.21.15.45:0/2969424628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f718c10d630 con 0x7f718c1026d0 2024-05-10T03:40:07.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.220+0000 7f7188ff9700 1 -- 172.21.15.45:0/2969424628 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f717c097630 con 0x7f718c1026d0 2024-05-10T03:40:07.222 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2024-05-10T03:40:07.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.222+0000 7f71920b1700 1 -- 172.21.15.45:0/2969424628 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f71780a1260 msgr2=0x7f71780a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:07.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.222+0000 7f71920b1700 1 --2- 172.21.15.45:0/2969424628 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f71780a1260 0x7f71780a3770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f718c1990e0 tx=0x7f7174009260 comp rx=0 tx=0).stop 2024-05-10T03:40:07.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.222+0000 7f71920b1700 1 -- 172.21.15.45:0/2969424628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f718c1026d0 msgr2=0x7f718c198040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:07.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.222+0000 7f71920b1700 1 --2- 172.21.15.45:0/2969424628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f718c1026d0 0x7f718c198040 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f717c0098e0 tx=0x7f717c00bf80 comp rx=0 tx=0).stop 2024-05-10T03:40:07.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.222+0000 7f71920b1700 1 -- 172.21.15.45:0/2969424628 shutdown_connections 2024-05-10T03:40:07.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.222+0000 7f71920b1700 1 --2- 172.21.15.45:0/2969424628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f718c107990 0x7f718c19f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:07.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.222+0000 7f71920b1700 1 --2- 172.21.15.45:0/2969424628 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f71780a1260 0x7f71780a3770 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:07.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.222+0000 7f71920b1700 1 --2- 172.21.15.45:0/2969424628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f718c1026d0 0x7f718c198040 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:07.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.222+0000 7f71920b1700 1 --2- 172.21.15.45:0/2969424628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f718c105030 0x7f718c198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:07.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.222+0000 7f71920b1700 1 -- 172.21.15.45:0/2969424628 >> 172.21.15.45:0/2969424628 conn(0x7f718c0fc0f0 msgr2=0x7f718c1031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:07.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.222+0000 7f71920b1700 1 -- 172.21.15.45:0/2969424628 shutdown_connections 2024-05-10T03:40:07.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.222+0000 7f71920b1700 1 -- 172.21.15.45:0/2969424628 wait complete. 2024-05-10T03:40:07.238 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:07 smithi045 ceph-mon[42520]: pgmap v278: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T03:40:07.238 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:07 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3532782987' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:40:07.238 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:07 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2140511157' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:40:07.239 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-10T03:40:07.381 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:07 smithi106 ceph-mon[46996]: pgmap v278: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T03:40:07.381 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:07 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3532782987' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:40:07.381 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:07 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2140511157' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:40:07.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.389+0000 7f73895da700 1 -- 172.21.15.45:0/1623233661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73841025b0 msgr2=0x7f7384108e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:07.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.389+0000 7f73895da700 1 --2- 172.21.15.45:0/1623233661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73841025b0 0x7f7384108e60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f737c00b0a0 tx=0x7f737c00b3b0 comp rx=0 tx=0).stop 2024-05-10T03:40:07.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.389+0000 7f73895da700 1 -- 172.21.15.45:0/1623233661 shutdown_connections 2024-05-10T03:40:07.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.389+0000 7f73895da700 1 --2- 172.21.15.45:0/1623233661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7384100af0 0x7f7384100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:07.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.389+0000 7f73895da700 1 --2- 172.21.15.45:0/1623233661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73841025b0 0x7f7384108e60 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:07.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.389+0000 7f73895da700 1 --2- 172.21.15.45:0/1623233661 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7384101c10 0x7f7384102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:07.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.389+0000 7f73895da700 1 -- 172.21.15.45:0/1623233661 >> 172.21.15.45:0/1623233661 conn(0x7f73840fc0e0 msgr2=0x7f73840fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:07.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.389+0000 7f73895da700 1 -- 172.21.15.45:0/1623233661 shutdown_connections 2024-05-10T03:40:07.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.389+0000 7f73895da700 1 -- 172.21.15.45:0/1623233661 wait complete. 2024-05-10T03:40:07.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.389+0000 7f73895da700 1 Processor -- start 2024-05-10T03:40:07.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.390+0000 7f73895da700 1 -- start start 2024-05-10T03:40:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.390+0000 7f73895da700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7384100af0 0x7f7384073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.390+0000 7f73895da700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7384101c10 0x7f738419f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.390+0000 7f73895da700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73841025b0 0x7f73841a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.390+0000 7f73895da700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73841a1d90 con 0x7f7384100af0 2024-05-10T03:40:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.390+0000 7f73895da700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73841a1f00 con 0x7f73841025b0 2024-05-10T03:40:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.390+0000 7f73895da700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73841a20c0 con 0x7f7384101c10 2024-05-10T03:40:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.390+0000 7f7382ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7384100af0 0x7f7384073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.390+0000 7f7382ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7384100af0 0x7f7384073eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52284/0 (socket says 172.21.15.45:52284) 2024-05-10T03:40:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.390+0000 7f7382ffd700 1 -- 172.21.15.45:0/386283209 learned_addr learned my addr 172.21.15.45:0/386283209 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.390+0000 7f73827fc700 1 --2- 172.21.15.45:0/386283209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7384101c10 0x7f738419f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.390+0000 7f73837fe700 1 --2- 172.21.15.45:0/386283209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73841025b0 0x7f73841a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.390+0000 7f7382ffd700 1 -- 172.21.15.45:0/386283209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7384101c10 msgr2=0x7f738419f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:07.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.390+0000 7f7382ffd700 1 --2- 172.21.15.45:0/386283209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7384101c10 0x7f738419f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:07.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.390+0000 7f7382ffd700 1 -- 172.21.15.45:0/386283209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73841025b0 msgr2=0x7f73841a17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:07.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.390+0000 7f7382ffd700 1 --2- 172.21.15.45:0/386283209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73841025b0 0x7f73841a17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:07.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.390+0000 7f7382ffd700 1 -- 172.21.15.45:0/386283209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c009d00 con 0x7f7384100af0 2024-05-10T03:40:07.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.390+0000 7f73827fc700 1 --2- 172.21.15.45:0/386283209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7384101c10 0x7f738419f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:07.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.390+0000 7f73837fe700 1 --2- 172.21.15.45:0/386283209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73841025b0 0x7f73841a17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:07.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.391+0000 7f7382ffd700 1 --2- 172.21.15.45:0/386283209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7384100af0 0x7f7384073eb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f737400d950 tx=0x7f737400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:07.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.391+0000 7f736bfff700 1 -- 172.21.15.45:0/386283209 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7374004220 con 0x7f7384100af0 2024-05-10T03:40:07.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.391+0000 7f736bfff700 1 -- 172.21.15.45:0/386283209 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f737400de30 con 0x7f7384100af0 2024-05-10T03:40:07.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.391+0000 7f736bfff700 1 -- 172.21.15.45:0/386283209 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7374003dc0 con 0x7f7384100af0 2024-05-10T03:40:07.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.391+0000 7f73895da700 1 -- 172.21.15.45:0/386283209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73841a23a0 con 0x7f7384100af0 2024-05-10T03:40:07.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.391+0000 7f73895da700 1 -- 172.21.15.45:0/386283209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73841a2860 con 0x7f7384100af0 2024-05-10T03:40:07.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.392+0000 7f73895da700 1 -- 172.21.15.45:0/386283209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7384107d00 con 0x7f7384100af0 2024-05-10T03:40:07.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.393+0000 7f736bfff700 1 -- 172.21.15.45:0/386283209 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f7374004380 con 0x7f7384100af0 2024-05-10T03:40:07.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.394+0000 7f736bfff700 1 --2- 172.21.15.45:0/386283209 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f736c0a1260 0x7f736c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:07.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.394+0000 7f73827fc700 1 --2- 172.21.15.45:0/386283209 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f736c0a1260 0x7f736c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:07.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.394+0000 7f736bfff700 1 -- 172.21.15.45:0/386283209 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f73740cca30 con 0x7f7384100af0 2024-05-10T03:40:07.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.395+0000 7f73827fc700 1 --2- 172.21.15.45:0/386283209 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f736c0a1260 0x7f736c0a3770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7384073850 tx=0x7f7378009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:07.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.399+0000 7f736bfff700 1 -- 172.21.15.45:0/386283209 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7374095cf0 con 0x7f7384100af0 2024-05-10T03:40:07.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:07 smithi154 ceph-mon[46565]: pgmap v278: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T03:40:07.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:07 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3532782987' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:40:07.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:07 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2140511157' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:40:07.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.616+0000 7f73895da700 1 -- 172.21.15.45:0/386283209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f738410c680 con 0x7f7384100af0 2024-05-10T03:40:07.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.616+0000 7f736bfff700 1 -- 172.21.15.45:0/386283209 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7374099310 con 0x7f7384100af0 2024-05-10T03:40:07.619 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-05-10T03:40:07.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.619+0000 7f73895da700 1 -- 172.21.15.45:0/386283209 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f736c0a1260 msgr2=0x7f736c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:07.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.619+0000 7f73895da700 1 --2- 172.21.15.45:0/386283209 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f736c0a1260 0x7f736c0a3770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7384073850 tx=0x7f7378009260 comp rx=0 tx=0).stop 2024-05-10T03:40:07.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.619+0000 7f73895da700 1 -- 172.21.15.45:0/386283209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7384100af0 msgr2=0x7f7384073eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:07.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.619+0000 7f73895da700 1 --2- 172.21.15.45:0/386283209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7384100af0 0x7f7384073eb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f737400d950 tx=0x7f737400dd10 comp rx=0 tx=0).stop 2024-05-10T03:40:07.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.619+0000 7f73895da700 1 -- 172.21.15.45:0/386283209 shutdown_connections 2024-05-10T03:40:07.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.619+0000 7f73895da700 1 --2- 172.21.15.45:0/386283209 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f736c0a1260 0x7f736c0a3770 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:07.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.619+0000 7f73895da700 1 --2- 172.21.15.45:0/386283209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73841025b0 0x7f73841a17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:07.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.619+0000 7f73895da700 1 --2- 172.21.15.45:0/386283209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7384100af0 0x7f7384073eb0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:07.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.619+0000 7f73895da700 1 --2- 172.21.15.45:0/386283209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7384101c10 0x7f738419f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:07.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.619+0000 7f73895da700 1 -- 172.21.15.45:0/386283209 >> 172.21.15.45:0/386283209 conn(0x7f73840fc0e0 msgr2=0x7f7384104e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:07.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.619+0000 7f73895da700 1 -- 172.21.15.45:0/386283209 shutdown_connections 2024-05-10T03:40:07.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.619+0000 7f73895da700 1 -- 172.21.15.45:0/386283209 wait complete. 2024-05-10T03:40:07.636 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:40:07.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.783+0000 7ff016a32700 1 -- 172.21.15.45:0/4050231448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff010100ac0 msgr2=0x7ff010100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:07.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.783+0000 7ff016a32700 1 --2- 172.21.15.45:0/4050231448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff010100ac0 0x7ff010100ed0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff000009990 tx=0x7ff000009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:07.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.783+0000 7ff016a32700 1 -- 172.21.15.45:0/4050231448 shutdown_connections 2024-05-10T03:40:07.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.783+0000 7ff016a32700 1 --2- 172.21.15.45:0/4050231448 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff010102580 0x7ff010108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:07.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.783+0000 7ff016a32700 1 --2- 172.21.15.45:0/4050231448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff010100ac0 0x7ff010100ed0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:07.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.783+0000 7ff016a32700 1 --2- 172.21.15.45:0/4050231448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff010101be0 0x7ff010101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:07.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.783+0000 7ff016a32700 1 -- 172.21.15.45:0/4050231448 >> 172.21.15.45:0/4050231448 conn(0x7ff0100fc0d0 msgr2=0x7ff0100fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:07.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.783+0000 7ff016a32700 1 -- 172.21.15.45:0/4050231448 shutdown_connections 2024-05-10T03:40:07.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.783+0000 7ff016a32700 1 -- 172.21.15.45:0/4050231448 wait complete. 2024-05-10T03:40:07.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.784+0000 7ff016a32700 1 Processor -- start 2024-05-10T03:40:07.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.784+0000 7ff016a32700 1 -- start start 2024-05-10T03:40:07.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.784+0000 7ff016a32700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff010100ac0 0x7ff010068e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:07.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.784+0000 7ff016a32700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff010101be0 0x7ff01019ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:07.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.784+0000 7ff016a32700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff010102580 0x7ff01019f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:07.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.784+0000 7ff016a32700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01019fb10 con 0x7ff010102580 2024-05-10T03:40:07.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.784+0000 7ff016a32700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01019fc80 con 0x7ff010101be0 2024-05-10T03:40:07.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.784+0000 7ff016a32700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01019fe40 con 0x7ff010100ac0 2024-05-10T03:40:07.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.784+0000 7ff014fcf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff010102580 0x7ff01019f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:07.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.784+0000 7ff014fcf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff010102580 0x7ff01019f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52298/0 (socket says 172.21.15.45:52298) 2024-05-10T03:40:07.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.784+0000 7ff014fcf700 1 -- 172.21.15.45:0/2594320617 learned_addr learned my addr 172.21.15.45:0/2594320617 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:07.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.785+0000 7ff00ffff700 1 --2- 172.21.15.45:0/2594320617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff010100ac0 0x7ff010068e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:07.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.785+0000 7ff00f7fe700 1 --2- 172.21.15.45:0/2594320617 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff010101be0 0x7ff01019ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:07.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.785+0000 7ff014fcf700 1 -- 172.21.15.45:0/2594320617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff010100ac0 msgr2=0x7ff010068e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:07.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.785+0000 7ff014fcf700 1 --2- 172.21.15.45:0/2594320617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff010100ac0 0x7ff010068e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:07.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.785+0000 7ff014fcf700 1 -- 172.21.15.45:0/2594320617 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff010101be0 msgr2=0x7ff01019ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:07.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.785+0000 7ff014fcf700 1 --2- 172.21.15.45:0/2594320617 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff010101be0 0x7ff01019ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:07.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.785+0000 7ff014fcf700 1 -- 172.21.15.45:0/2594320617 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0000095f0 con 0x7ff010102580 2024-05-10T03:40:07.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.785+0000 7ff00ffff700 1 --2- 172.21.15.45:0/2594320617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff010100ac0 0x7ff010068e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:07.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.785+0000 7ff00f7fe700 1 --2- 172.21.15.45:0/2594320617 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff010101be0 0x7ff01019ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:07.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.785+0000 7ff014fcf700 1 --2- 172.21.15.45:0/2594320617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff010102580 0x7ff01019f410 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff00800ef30 tx=0x7ff00800c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:07.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.785+0000 7ff00d7fa700 1 -- 172.21.15.45:0/2594320617 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff008018070 con 0x7ff010102580 2024-05-10T03:40:07.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.785+0000 7ff00d7fa700 1 -- 172.21.15.45:0/2594320617 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff00800f040 con 0x7ff010102580 2024-05-10T03:40:07.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.785+0000 7ff016a32700 1 -- 172.21.15.45:0/2594320617 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0101a00c0 con 0x7ff010102580 2024-05-10T03:40:07.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.785+0000 7ff00d7fa700 1 -- 172.21.15.45:0/2594320617 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff008004020 con 0x7ff010102580 2024-05-10T03:40:07.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.785+0000 7ff016a32700 1 -- 172.21.15.45:0/2594320617 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0101a0580 con 0x7ff010102580 2024-05-10T03:40:07.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.786+0000 7ff016a32700 1 -- 172.21.15.45:0/2594320617 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff010107cd0 con 0x7ff010102580 2024-05-10T03:40:07.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.788+0000 7ff00d7fa700 1 -- 172.21.15.45:0/2594320617 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ff00800caa0 con 0x7ff010102580 2024-05-10T03:40:07.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.789+0000 7ff00d7fa700 1 --2- 172.21.15.45:0/2594320617 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7feff80a11b0 0x7feff80a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:07.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.789+0000 7ff00ffff700 1 --2- 172.21.15.45:0/2594320617 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7feff80a11b0 0x7feff80a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:07.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.789+0000 7ff00d7fa700 1 -- 172.21.15.45:0/2594320617 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ff0080cd2d0 con 0x7ff010102580 2024-05-10T03:40:07.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.789+0000 7ff00ffff700 1 --2- 172.21.15.45:0/2594320617 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7feff80a11b0 0x7feff80a36c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff00000b8e0 tx=0x7ff00001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:07.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:07.793+0000 7ff00d7fa700 1 -- 172.21.15.45:0/2594320617 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff008096680 con 0x7ff010102580 2024-05-10T03:40:08.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.064+0000 7ff016a32700 1 -- 172.21.15.45:0/2594320617 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0100694d0 con 0x7ff010102580 2024-05-10T03:40:08.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.065+0000 7ff00d7fa700 1 -- 172.21.15.45:0/2594320617 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10926 (secure 0 0 0) 0x7ff008099ca0 con 0x7ff010102580 2024-05-10T03:40:08.067 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:40:08.068 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/378320264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":378320264},{"type":"v1","addr":"172.21.15.45:6835","nonce":378320264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3032381796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3032381796},{"type":"v1","addr":"172.21.15.45:6837","nonce":3032381796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T03:38:36.555290+0000","modified":"2024-05-10T03:39:00.010786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24548,"mds_2":24547,"mds_3":24526,"mds_4":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14625":{"gid":14625,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6839/4007419304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":4007419304},{"type":"v1","addr":"172.21.15.45:6839","nonce":4007419304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14637":{"gid":14637,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6841/1355456195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1355456195},{"type":"v1","addr":"172.21.15.45:6841","nonce":1355456195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/4037121210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":4037121210},{"type":"v1","addr":"172.21.15.154:6835","nonce":4037121210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24521":{"gid":24521,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.106:6835/4162885659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4162885659},{"type":"v1","addr":"172.21.15.106:6835","nonce":4162885659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.154:6837/608167481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":608167481},{"type":"v1","addr":"172.21.15.154:6837","nonce":608167481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/1506563336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1506563336},{"type":"v1","addr":"172.21.15.154:6839","nonce":1506563336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.106:6837/3047487403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":3047487403},{"type":"v1","addr":"172.21.15.106:6837","nonce":3047487403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6839/3533867856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":3533867856},{"type":"v1","addr":"172.21.15.106:6839","nonce":3533867856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T03:40:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.068+0000 7ff016a32700 1 -- 172.21.15.45:0/2594320617 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7feff80a11b0 msgr2=0x7feff80a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.068+0000 7ff016a32700 1 --2- 172.21.15.45:0/2594320617 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7feff80a11b0 0x7feff80a36c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff00000b8e0 tx=0x7ff00001a040 comp rx=0 tx=0).stop 2024-05-10T03:40:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.068+0000 7ff016a32700 1 -- 172.21.15.45:0/2594320617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff010102580 msgr2=0x7ff01019f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.068+0000 7ff016a32700 1 --2- 172.21.15.45:0/2594320617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff010102580 0x7ff01019f410 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff00800ef30 tx=0x7ff00800c450 comp rx=0 tx=0).stop 2024-05-10T03:40:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.068+0000 7ff016a32700 1 -- 172.21.15.45:0/2594320617 shutdown_connections 2024-05-10T03:40:08.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.068+0000 7ff016a32700 1 --2- 172.21.15.45:0/2594320617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff010100ac0 0x7ff010068e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.068+0000 7ff016a32700 1 --2- 172.21.15.45:0/2594320617 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7feff80a11b0 0x7feff80a36c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.068+0000 7ff016a32700 1 --2- 172.21.15.45:0/2594320617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff010102580 0x7ff01019f410 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.068+0000 7ff016a32700 1 --2- 172.21.15.45:0/2594320617 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff010101be0 0x7ff01019ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.068+0000 7ff016a32700 1 -- 172.21.15.45:0/2594320617 >> 172.21.15.45:0/2594320617 conn(0x7ff0100fc0d0 msgr2=0x7ff010104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:08.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.068+0000 7ff016a32700 1 -- 172.21.15.45:0/2594320617 shutdown_connections 2024-05-10T03:40:08.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.068+0000 7ff016a32700 1 -- 172.21.15.45:0/2594320617 wait complete. 2024-05-10T03:40:08.071 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 27 2024-05-10T03:40:08.085 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:40:08.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.231+0000 7f1aa18e8700 1 -- 172.21.15.45:0/4058232211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a9c101c10 msgr2=0x7f1a9c102020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:08.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.231+0000 7f1aa18e8700 1 --2- 172.21.15.45:0/4058232211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a9c101c10 0x7f1a9c102020 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1a90009990 tx=0x7f1a90009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.231+0000 7f1aa18e8700 1 -- 172.21.15.45:0/4058232211 shutdown_connections 2024-05-10T03:40:08.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.231+0000 7f1aa18e8700 1 --2- 172.21.15.45:0/4058232211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a9c100af0 0x7f1a9c100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.231+0000 7f1aa18e8700 1 --2- 172.21.15.45:0/4058232211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a9c1025b0 0x7f1a9c108e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.231+0000 7f1aa18e8700 1 --2- 172.21.15.45:0/4058232211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a9c101c10 0x7f1a9c102020 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.231+0000 7f1aa18e8700 1 -- 172.21.15.45:0/4058232211 >> 172.21.15.45:0/4058232211 conn(0x7f1a9c0fc0e0 msgr2=0x7f1a9c0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:08.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.231+0000 7f1aa18e8700 1 -- 172.21.15.45:0/4058232211 shutdown_connections 2024-05-10T03:40:08.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.231+0000 7f1aa18e8700 1 -- 172.21.15.45:0/4058232211 wait complete. 2024-05-10T03:40:08.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.232+0000 7f1aa18e8700 1 Processor -- start 2024-05-10T03:40:08.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.232+0000 7f1aa18e8700 1 -- start start 2024-05-10T03:40:08.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.233+0000 7f1aa18e8700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a9c100af0 0x7f1a9c10b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.233+0000 7f1aa18e8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a9c101c10 0x7f1a9c109a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.233+0000 7f1aa18e8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a9c1025b0 0x7f1a9c109f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.233+0000 7f1aa18e8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c10a630 con 0x7f1a9c1025b0 2024-05-10T03:40:08.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.233+0000 7f1aa18e8700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c10a7a0 con 0x7f1a9c100af0 2024-05-10T03:40:08.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.233+0000 7f1aa18e8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c1a2130 con 0x7f1a9c101c10 2024-05-10T03:40:08.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.233+0000 7f1a9b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a9c1025b0 0x7f1a9c109f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.233+0000 7f1a9b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a9c1025b0 0x7f1a9c109f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52312/0 (socket says 172.21.15.45:52312) 2024-05-10T03:40:08.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.233+0000 7f1a9b7fe700 1 -- 172.21.15.45:0/3659869317 learned_addr learned my addr 172.21.15.45:0/3659869317 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:08.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.233+0000 7f1a9a7fc700 1 --2- 172.21.15.45:0/3659869317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a9c101c10 0x7f1a9c109a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.233+0000 7f1a9affd700 1 --2- 172.21.15.45:0/3659869317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a9c100af0 0x7f1a9c10b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.233+0000 7f1a9b7fe700 1 -- 172.21.15.45:0/3659869317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a9c101c10 msgr2=0x7f1a9c109a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:08.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.233+0000 7f1a9b7fe700 1 --2- 172.21.15.45:0/3659869317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a9c101c10 0x7f1a9c109a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.233+0000 7f1a9b7fe700 1 -- 172.21.15.45:0/3659869317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a9c100af0 msgr2=0x7f1a9c10b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:08.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.233+0000 7f1a9b7fe700 1 --2- 172.21.15.45:0/3659869317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a9c100af0 0x7f1a9c10b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.233+0000 7f1a9b7fe700 1 -- 172.21.15.45:0/3659869317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a900095f0 con 0x7f1a9c1025b0 2024-05-10T03:40:08.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.233+0000 7f1a9b7fe700 1 --2- 172.21.15.45:0/3659869317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a9c1025b0 0x7f1a9c109f50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1a94007ee0 tx=0x7f1a9400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:08.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.233+0000 7f1aa08e6700 1 -- 172.21.15.45:0/3659869317 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a94017070 con 0x7f1a9c1025b0 2024-05-10T03:40:08.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.234+0000 7f1aa18e8700 1 -- 172.21.15.45:0/3659869317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9c1a2390 con 0x7f1a9c1025b0 2024-05-10T03:40:08.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.234+0000 7f1aa08e6700 1 -- 172.21.15.45:0/3659869317 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1a9400f040 con 0x7f1a9c1025b0 2024-05-10T03:40:08.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.234+0000 7f1aa08e6700 1 -- 172.21.15.45:0/3659869317 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a94005760 con 0x7f1a9c1025b0 2024-05-10T03:40:08.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.234+0000 7f1aa18e8700 1 -- 172.21.15.45:0/3659869317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a9c1a2820 con 0x7f1a9c1025b0 2024-05-10T03:40:08.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.235+0000 7f1aa18e8700 1 -- 172.21.15.45:0/3659869317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a9c107d00 con 0x7f1a9c1025b0 2024-05-10T03:40:08.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.236+0000 7f1aa08e6700 1 -- 172.21.15.45:0/3659869317 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f1a940058c0 con 0x7f1a9c1025b0 2024-05-10T03:40:08.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.237+0000 7f1aa08e6700 1 --2- 172.21.15.45:0/3659869317 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1a840a11b0 0x7f1a840a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.237+0000 7f1aa08e6700 1 -- 172.21.15.45:0/3659869317 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f1a940cca50 con 0x7f1a9c1025b0 2024-05-10T03:40:08.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.237+0000 7f1a9affd700 1 --2- 172.21.15.45:0/3659869317 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1a840a11b0 0x7f1a840a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.238+0000 7f1a9affd700 1 --2- 172.21.15.45:0/3659869317 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1a840a11b0 0x7f1a840a36c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c101b10 tx=0x7f1a8c00b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:08.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.240+0000 7f1aa08e6700 1 -- 172.21.15.45:0/3659869317 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1a94095d70 con 0x7f1a9c1025b0 2024-05-10T03:40:08.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:08 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2969424628' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:40:08.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:08 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/386283209' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:40:08.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.460+0000 7f1aa18e8700 1 -- 172.21.15.45:0/3659869317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a9c10d570 con 0x7f1a9c1025b0 2024-05-10T03:40:08.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.462+0000 7f1aa08e6700 1 -- 172.21.15.45:0/3659869317 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+24508 (secure 0 0 0) 0x7f1a94009390 con 0x7f1a9c1025b0 2024-05-10T03:40:08.465 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:40:08.466 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":88,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:39:27.064512+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:38:34.871801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:38:35.935386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T03:38:39.029903+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:40:08.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.464+0000 7f1aa18e8700 1 -- 172.21.15.45:0/3659869317 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1a840a11b0 msgr2=0x7f1a840a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:08.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.464+0000 7f1aa18e8700 1 --2- 172.21.15.45:0/3659869317 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1a840a11b0 0x7f1a840a36c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c101b10 tx=0x7f1a8c00b5b0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.464+0000 7f1aa18e8700 1 -- 172.21.15.45:0/3659869317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a9c1025b0 msgr2=0x7f1a9c109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:08.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.464+0000 7f1aa18e8700 1 --2- 172.21.15.45:0/3659869317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a9c1025b0 0x7f1a9c109f50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1a94007ee0 tx=0x7f1a9400d3b0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.464+0000 7f1aa18e8700 1 -- 172.21.15.45:0/3659869317 shutdown_connections 2024-05-10T03:40:08.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.464+0000 7f1aa18e8700 1 --2- 172.21.15.45:0/3659869317 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1a840a11b0 0x7f1a840a36c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.464+0000 7f1aa18e8700 1 --2- 172.21.15.45:0/3659869317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a9c1025b0 0x7f1a9c109f50 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.464+0000 7f1aa18e8700 1 --2- 172.21.15.45:0/3659869317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a9c100af0 0x7f1a9c10b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.464+0000 7f1aa18e8700 1 --2- 172.21.15.45:0/3659869317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a9c101c10 0x7f1a9c109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.464+0000 7f1aa18e8700 1 -- 172.21.15.45:0/3659869317 >> 172.21.15.45:0/3659869317 conn(0x7f1a9c0fc0e0 msgr2=0x7f1a9c104e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:08.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.465+0000 7f1aa18e8700 1 -- 172.21.15.45:0/3659869317 shutdown_connections 2024-05-10T03:40:08.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.465+0000 7f1aa18e8700 1 -- 172.21.15.45:0/3659869317 wait complete. 2024-05-10T03:40:08.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:08 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2969424628' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:40:08.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:08 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/386283209' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:40:08.481 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:08 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2969424628' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:40:08.481 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:08 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/386283209' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:40:08.483 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-10T03:38:36.555290+0000', 'modified': '2024-05-10T03:39:00.010786+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24590, 'mds_1': 24548, 'mds_2': 24547, 'mds_3': 24526, 'mds_4': 24521}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14625': {'gid': 14625, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.45:6839/4007419304', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6838', 'nonce': 4007419304}, {'type': 'v1', 'addr': '172.21.15.45:6839', 'nonce': 4007419304}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_14637': {'gid': 14637, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.45:6841/1355456195', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6840', 'nonce': 1355456195}, {'type': 'v1', 'addr': '172.21.15.45:6841', 'nonce': 1355456195}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24475': {'gid': 24475, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6833/4274344062', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6832', 'nonce': 4274344062}, {'type': 'v1', 'addr': '172.21.15.154:6833', 'nonce': 4274344062}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24491': {'gid': 24491, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.106:6833/3404247109', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6832', 'nonce': 3404247109}, {'type': 'v1', 'addr': '172.21.15.106:6833', 'nonce': 3404247109}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24514': {'gid': 24514, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6835/4037121210', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 4037121210}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 4037121210}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24521': {'gid': 24521, 'name': 'e', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.106:6835/4162885659', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6834', 'nonce': 4162885659}, {'type': 'v1', 'addr': '172.21.15.106:6835', 'nonce': 4162885659}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24526': {'gid': 24526, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.154:6837/608167481', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6836', 'nonce': 608167481}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 608167481}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24547': {'gid': 24547, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.154:6839/1506563336', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6838', 'nonce': 1506563336}, {'type': 'v1', 'addr': '172.21.15.154:6839', 'nonce': 1506563336}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24548': {'gid': 24548, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.106:6837/3047487403', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6836', 'nonce': 3047487403}, {'type': 'v1', 'addr': '172.21.15.106:6837', 'nonce': 3047487403}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24590': {'gid': 24590, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.106:6839/3533867856', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6838', 'nonce': 3533867856}, {'type': 'v1', 'addr': '172.21.15.106:6839', 'nonce': 3533867856}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-10T03:40:08.483 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-10T03:40:08.484 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-05-10T03:40:08.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.633+0000 7fccb96e8700 1 -- 172.21.15.45:0/2281920049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccb41079a0 msgr2=0x7fccb4109dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:08.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.633+0000 7fccb96e8700 1 --2- 172.21.15.45:0/2281920049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccb41079a0 0x7fccb4109dc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fccac00b0a0 tx=0x7fccac00b3b0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.633+0000 7fccb96e8700 1 -- 172.21.15.45:0/2281920049 shutdown_connections 2024-05-10T03:40:08.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.633+0000 7fccb96e8700 1 --2- 172.21.15.45:0/2281920049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccb41026e0 0x7fccb4104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.633+0000 7fccb96e8700 1 --2- 172.21.15.45:0/2281920049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccb41079a0 0x7fccb4109dc0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.633+0000 7fccb96e8700 1 --2- 172.21.15.45:0/2281920049 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccb4105040 0x7fccb4107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.633+0000 7fccb96e8700 1 -- 172.21.15.45:0/2281920049 >> 172.21.15.45:0/2281920049 conn(0x7fccb40fc0e0 msgr2=0x7fccb40fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:08.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.633+0000 7fccb96e8700 1 -- 172.21.15.45:0/2281920049 shutdown_connections 2024-05-10T03:40:08.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.633+0000 7fccb96e8700 1 -- 172.21.15.45:0/2281920049 wait complete. 2024-05-10T03:40:08.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.633+0000 7fccb96e8700 1 Processor -- start 2024-05-10T03:40:08.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.634+0000 7fccb96e8700 1 -- start start 2024-05-10T03:40:08.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.634+0000 7fccb96e8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccb41026e0 0x7fccb4101f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.634+0000 7fccb96e8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccb4105040 0x7fccb41005f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.634+0000 7fccb96e8700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccb41079a0 0x7fccb4100b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.634+0000 7fccb96e8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb4101210 con 0x7fccb41026e0 2024-05-10T03:40:08.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.634+0000 7fccb96e8700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb4101380 con 0x7fccb41079a0 2024-05-10T03:40:08.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.634+0000 7fccb96e8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb41a21b0 con 0x7fccb4105040 2024-05-10T03:40:08.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.634+0000 7fccb2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccb41026e0 0x7fccb4101f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.634+0000 7fccb2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccb41026e0 0x7fccb4101f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52338/0 (socket says 172.21.15.45:52338) 2024-05-10T03:40:08.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.634+0000 7fccb2ffd700 1 -- 172.21.15.45:0/626845735 learned_addr learned my addr 172.21.15.45:0/626845735 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:08.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.634+0000 7fccaa7fc700 1 --2- 172.21.15.45:0/626845735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccb4105040 0x7fccb41005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.634+0000 7fccb37fe700 1 --2- 172.21.15.45:0/626845735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccb41079a0 0x7fccb4100b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.634+0000 7fccb2ffd700 1 -- 172.21.15.45:0/626845735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccb4105040 msgr2=0x7fccb41005f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:08.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.634+0000 7fccb2ffd700 1 --2- 172.21.15.45:0/626845735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccb4105040 0x7fccb41005f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.634+0000 7fccb2ffd700 1 -- 172.21.15.45:0/626845735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccb41079a0 msgr2=0x7fccb4100b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:08.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.634+0000 7fccb2ffd700 1 --2- 172.21.15.45:0/626845735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccb41079a0 0x7fccb4100b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.634+0000 7fccb2ffd700 1 -- 172.21.15.45:0/626845735 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccac009d00 con 0x7fccb41026e0 2024-05-10T03:40:08.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.634+0000 7fccb37fe700 1 --2- 172.21.15.45:0/626845735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccb41079a0 0x7fccb4100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:40:08.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.635+0000 7fccb2ffd700 1 --2- 172.21.15.45:0/626845735 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccb41026e0 0x7fccb4101f50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fcca400d950 tx=0x7fcca400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:08.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.635+0000 7fccb0ff9700 1 -- 172.21.15.45:0/626845735 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca4004220 con 0x7fccb41026e0 2024-05-10T03:40:08.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.635+0000 7fccb96e8700 1 -- 172.21.15.45:0/626845735 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb41a2410 con 0x7fccb41026e0 2024-05-10T03:40:08.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.635+0000 7fccb0ff9700 1 -- 172.21.15.45:0/626845735 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcca4007620 con 0x7fccb41026e0 2024-05-10T03:40:08.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.635+0000 7fccb0ff9700 1 -- 172.21.15.45:0/626845735 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca4005700 con 0x7fccb41026e0 2024-05-10T03:40:08.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.635+0000 7fccb96e8700 1 -- 172.21.15.45:0/626845735 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb41a2940 con 0x7fccb41026e0 2024-05-10T03:40:08.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.637+0000 7fccb0ff9700 1 -- 172.21.15.45:0/626845735 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fcca400b750 con 0x7fccb41026e0 2024-05-10T03:40:08.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.638+0000 7fccb0ff9700 1 --2- 172.21.15.45:0/626845735 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcca00a1260 0x7fcca00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.638+0000 7fccb0ff9700 1 -- 172.21.15.45:0/626845735 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fcca40ccc00 con 0x7fccb41026e0 2024-05-10T03:40:08.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.638+0000 7fccaa7fc700 1 --2- 172.21.15.45:0/626845735 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcca00a1260 0x7fcca00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.639+0000 7fccc9a2cb80 1 Processor -- start 2024-05-10T03:40:08.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.639+0000 7fccc9a2cb80 1 -- start start 2024-05-10T03:40:08.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.639+0000 7fccaa7fc700 1 --2- 172.21.15.45:0/626845735 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcca00a1260 0x7fcca00a3770 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fccb41018f0 tx=0x7fcc9c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:08.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.639+0000 7fccc9a2cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565026cf2650 0x565026cf2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.639+0000 7fccc9a2cb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf3520 0x565026cf3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.639+0000 7fccc9a2cb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565026cf3e70 0x565026cfa770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.639+0000 7fccc9a2cb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x565026c19100 con 0x565026cf3520 2024-05-10T03:40:08.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.639+0000 7fccc9a2cb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x565026c16ac0 con 0x565026cf3e70 2024-05-10T03:40:08.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.639+0000 7fccc9a2cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x565026c123b0 con 0x565026cf2650 2024-05-10T03:40:08.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.639+0000 7fccaa7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf3520 0x565026cf3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.640+0000 7fccb2ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565026cf2650 0x565026cf2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.639+0000 7fccaa7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf3520 0x565026cf3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52346/0 (socket says 172.21.15.45:52346) 2024-05-10T03:40:08.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.640+0000 7fccaa7fc700 1 -- 172.21.15.45:0/1179877435 learned_addr learned my addr 172.21.15.45:0/1179877435 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:08.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.640+0000 7fccb37fe700 1 --2- 172.21.15.45:0/1179877435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565026cf3e70 0x565026cfa770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.640+0000 7fccb2ffd700 1 -- 172.21.15.45:0/1179877435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565026cf3e70 msgr2=0x565026cfa770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:08.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.640+0000 7fccb2ffd700 1 --2- 172.21.15.45:0/1179877435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565026cf3e70 0x565026cfa770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.640+0000 7fccb2ffd700 1 -- 172.21.15.45:0/1179877435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf3520 msgr2=0x565026cf3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:08.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.640+0000 7fccb2ffd700 1 --2- 172.21.15.45:0/1179877435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf3520 0x565026cf3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.640+0000 7fccb2ffd700 1 -- 172.21.15.45:0/1179877435 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565026a93360 con 0x565026cf2650 2024-05-10T03:40:08.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.640+0000 7fccaa7fc700 1 --2- 172.21.15.45:0/1179877435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf3520 0x565026cf3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:40:08.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.640+0000 7fccb2ffd700 1 --2- 172.21.15.45:0/1179877435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565026cf2650 0x565026cf2aa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcca40ca240 tx=0x7fcca409a3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f740a88d8f07eb3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:08.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.640+0000 7fcca97fa700 1 -- 172.21.15.45:0/1179877435 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca40a2000 con 0x565026cf2650 2024-05-10T03:40:08.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.640+0000 7fcca97fa700 1 -- 172.21.15.45:0/1179877435 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcca4097f20 con 0x565026cf2650 2024-05-10T03:40:08.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.640+0000 7fcca97fa700 1 -- 172.21.15.45:0/1179877435 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca4099340 con 0x565026cf2650 2024-05-10T03:40:08.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.641+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/1179877435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565026cf2650 msgr2=0x565026cf2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:08.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.641+0000 7fccc9a2cb80 1 --2- 172.21.15.45:0/1179877435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565026cf2650 0x565026cf2aa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcca40ca240 tx=0x7fcca409a3d0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.641+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/1179877435 shutdown_connections 2024-05-10T03:40:08.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.641+0000 7fccc9a2cb80 1 --2- 172.21.15.45:0/1179877435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565026cf2650 0x565026cf2aa0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.641+0000 7fccc9a2cb80 1 --2- 172.21.15.45:0/1179877435 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565026cf3e70 0x565026cfa770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.641+0000 7fccc9a2cb80 1 --2- 172.21.15.45:0/1179877435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf3520 0x565026cf3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.641+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/1179877435 >> 172.21.15.45:0/1179877435 conn(0x565026c54a10 msgr2=0x565026cecf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:08.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.641+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/1179877435 shutdown_connections 2024-05-10T03:40:08.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.641+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/1179877435 wait complete. 2024-05-10T03:40:08.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.642+0000 7fccc9a2cb80 1 -- start start 2024-05-10T03:40:08.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.642+0000 7fccc9a2cb80 1 Processor -- start 2024-05-10T03:40:08.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.642+0000 7fccc9a2cb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565026cf2650 0x565026cfc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.642+0000 7fccc9a2cb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf3520 0x565026cfca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.642+0000 7fccc9a2cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565026cf3e70 0x565026d03970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.642+0000 7fccc9a2cb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x565026bae510 con 0x565026cf3520 2024-05-10T03:40:08.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.642+0000 7fccc9a2cb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x565026bae1b0 con 0x565026cf2650 2024-05-10T03:40:08.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.642+0000 7fccc9a2cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x565026a95650 con 0x565026cf3e70 2024-05-10T03:40:08.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.642+0000 7fccc9a2cb80 10 client.0 _ll_register_callbacks cb 0x565026bb7ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:08.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.642+0000 7fccaa7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf3520 0x565026cfca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.643+0000 7fccaa7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf3520 0x565026cfca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52348/0 (socket says 172.21.15.45:52348) 2024-05-10T03:40:08.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.643+0000 7fccaa7fc700 1 -- 172.21.15.45:0/2388357946 learned_addr learned my addr 172.21.15.45:0/2388357946 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:08.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.643+0000 7fccb37fe700 1 --2- 172.21.15.45:0/2388357946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565026cf3e70 0x565026d03970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.643+0000 7fccb2ffd700 1 --2- 172.21.15.45:0/2388357946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565026cf2650 0x565026cfc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.643+0000 7fccaa7fc700 1 -- 172.21.15.45:0/2388357946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565026cf3e70 msgr2=0x565026d03970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:08.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.643+0000 7fccaa7fc700 1 --2- 172.21.15.45:0/2388357946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565026cf3e70 0x565026d03970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.643+0000 7fccaa7fc700 1 -- 172.21.15.45:0/2388357946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565026cf2650 msgr2=0x565026cfc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:08.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.643+0000 7fccaa7fc700 1 --2- 172.21.15.45:0/2388357946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565026cf2650 0x565026cfc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.643+0000 7fccaa7fc700 1 -- 172.21.15.45:0/2388357946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc9c010ae0 con 0x565026cf3520 2024-05-10T03:40:08.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.643+0000 7fccaa7fc700 1 --2- 172.21.15.45:0/2388357946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf3520 0x565026cfca10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0117f0 tx=0x7fcc9c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c3e41e9a5ba3aad server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:08.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.643+0000 7fcc9a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:08.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.643+0000 7fcc9a7fc700 1 -- 172.21.15.45:0/2388357946 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c01f840 con 0x565026cf3520 2024-05-10T03:40:08.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.643+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/2388357946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565026b6b220 con 0x565026cf3520 2024-05-10T03:40:08.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.643+0000 7fcc9a7fc700 1 -- 172.21.15.45:0/2388357946 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fcc9c017070 con 0x565026cf3520 2024-05-10T03:40:08.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.644+0000 7fcc9a7fc700 1 -- 172.21.15.45:0/2388357946 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc9c01f9a0 con 0x565026cf3520 2024-05-10T03:40:08.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.644+0000 7fccc9a2cb80 10 client.15435 fetch_fsmap learned FSMap version 27 2024-05-10T03:40:08.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.644+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/2388357946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fccb41a2940 con 0x565026cf3520 2024-05-10T03:40:08.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.644+0000 7fcc9a7fc700 1 -- 172.21.15.45:0/2388357946 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x565026b6b220 con 0x565026cf3520 2024-05-10T03:40:08.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.644+0000 7fcc9a7fc700 1 -- 172.21.15.45:0/2388357946 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fcc9c01e450 con 0x565026cf3520 2024-05-10T03:40:08.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.644+0000 7fccc9a2cb80 10 client.15435 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T03:40:08.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.644+0000 7fccc9a2cb80 10 client.15435 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-10T03:40:08.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.644+0000 7fccc9a2cb80 20 client.15435 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:08.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.644+0000 7fccc9a2cb80 1 --2- 172.21.15.45:0/2388357946 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x565026d07bc0 0x565026d0c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.644+0000 7fccc9a2cb80 4 client.15435 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:40:08.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.644+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/2388357946 --> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565026cc1730 con 0x565026d07bc0 2024-05-10T03:40:08.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.644+0000 7fccb2ffd700 1 --2- 172.21.15.45:0/2388357946 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x565026d07bc0 0x565026d0c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.645+0000 7fcc9a7fc700 10 client.15435 ms_handle_connect on v2:172.21.15.106:6834/4162885659 2024-05-10T03:40:08.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.645+0000 7fccb2ffd700 1 --2- 172.21.15.45:0/2388357946 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x565026d07bc0 0x565026d0c8f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e84a3e1da342cd6f server_cookie=45c6d409e9fbb710 in_seq=0 out_seq=0 2024-05-10T03:40:08.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.646+0000 7fcc9a7fc700 1 -- 172.21.15.45:0/2388357946 <== mds.4 v2:172.21.15.106:6834/4162885659 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x565026cc1730 con 0x565026d07bc0 2024-05-10T03:40:08.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.646+0000 7fcc9a7fc700 10 client.15435 handle_command_reply: tid=0 2024-05-10T03:40:08.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.646+0000 7fccc9a2cb80 1 client.15435 shutdown 2024-05-10T03:40:08.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.646+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/2388357946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf3520 msgr2=0x565026cfca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:08.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.646+0000 7fccc9a2cb80 1 --2- 172.21.15.45:0/2388357946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf3520 0x565026cfca10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0117f0 tx=0x7fcc9c0047c0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.646+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/2388357946 shutdown_connections 2024-05-10T03:40:08.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.646+0000 7fccc9a2cb80 1 --2- 172.21.15.45:0/2388357946 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x565026d07bc0 0x565026d0c8f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.646+0000 7fccc9a2cb80 1 --2- 172.21.15.45:0/2388357946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565026cf3e70 0x565026d03970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.646+0000 7fccc9a2cb80 1 --2- 172.21.15.45:0/2388357946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565026cf2650 0x565026cfc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.646+0000 7fcc9a7fc700 0 client.15435 ms_handle_reset on v2:172.21.15.106:6834/4162885659 2024-05-10T03:40:08.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.646+0000 7fccc9a2cb80 1 --2- 172.21.15.45:0/2388357946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf3520 0x565026cfca10 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.646+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/2388357946 >> 172.21.15.45:0/2388357946 conn(0x565026c54a10 msgr2=0x565026cecf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:08.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.646+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/2388357946 shutdown_connections 2024-05-10T03:40:08.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.646+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/2388357946 wait complete. 2024-05-10T03:40:08.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.646+0000 7fccc9a2cb80 20 client.15435 trim_cache size 0 max 16384 2024-05-10T03:40:08.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.665+0000 7fccc9a2cb80 1 Processor -- start 2024-05-10T03:40:08.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.665+0000 7fccc9a2cb80 1 -- start start 2024-05-10T03:40:08.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.666+0000 7fccc9a2cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565026cf2650 0x565026cecf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.666+0000 7fccc9a2cb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf3520 0x565026d01920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.666+0000 7fccc9a2cb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565026cf3e70 0x565026d01e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.666+0000 7fccc9a2cb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x565026cf4280 con 0x565026cf3520 2024-05-10T03:40:08.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.666+0000 7fccc9a2cb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x565026bd02b0 con 0x565026cf3e70 2024-05-10T03:40:08.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.666+0000 7fccc9a2cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x565026c0b150 con 0x565026cf2650 2024-05-10T03:40:08.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.666+0000 7fccaa7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf3520 0x565026d01920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.666+0000 7fccaa7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf3520 0x565026d01920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52352/0 (socket says 172.21.15.45:52352) 2024-05-10T03:40:08.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.666+0000 7fccaa7fc700 1 -- 172.21.15.45:0/822661296 learned_addr learned my addr 172.21.15.45:0/822661296 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:08.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.666+0000 7fccb37fe700 1 --2- 172.21.15.45:0/822661296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565026cf3e70 0x565026d01e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.666+0000 7fccb2ffd700 1 --2- 172.21.15.45:0/822661296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565026cf2650 0x565026cecf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.666+0000 7fccaa7fc700 1 -- 172.21.15.45:0/822661296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565026cf2650 msgr2=0x565026cecf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:08.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.666+0000 7fccaa7fc700 1 --2- 172.21.15.45:0/822661296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565026cf2650 0x565026cecf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.666+0000 7fccaa7fc700 1 -- 172.21.15.45:0/822661296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565026cf3e70 msgr2=0x565026d01e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:08.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.666+0000 7fccaa7fc700 1 --2- 172.21.15.45:0/822661296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565026cf3e70 0x565026d01e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.666+0000 7fccaa7fc700 1 -- 172.21.15.45:0/822661296 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565026a3fb10 con 0x565026cf3520 2024-05-10T03:40:08.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.666+0000 7fccaa7fc700 1 --2- 172.21.15.45:0/822661296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf3520 0x565026d01920 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c01e880 tx=0x7fcc9c01edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e42443aa84d044 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:08.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.667+0000 7fcca9ffb700 1 -- 172.21.15.45:0/822661296 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c01ea20 con 0x565026cf3520 2024-05-10T03:40:08.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.667+0000 7fcca9ffb700 1 -- 172.21.15.45:0/822661296 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcc9c015070 con 0x565026cf3520 2024-05-10T03:40:08.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.667+0000 7fcca9ffb700 1 -- 172.21.15.45:0/822661296 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c01fe70 con 0x565026cf3520 2024-05-10T03:40:08.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.667+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/822661296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf3520 msgr2=0x565026d01920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:08.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.667+0000 7fccc9a2cb80 1 --2- 172.21.15.45:0/822661296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf3520 0x565026d01920 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c01e880 tx=0x7fcc9c01edd0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.668+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/822661296 shutdown_connections 2024-05-10T03:40:08.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.668+0000 7fccc9a2cb80 1 --2- 172.21.15.45:0/822661296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565026cf2650 0x565026cecf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.668+0000 7fccc9a2cb80 1 --2- 172.21.15.45:0/822661296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565026cf3e70 0x565026d01e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.668+0000 7fccc9a2cb80 1 --2- 172.21.15.45:0/822661296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf3520 0x565026d01920 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.668+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/822661296 >> 172.21.15.45:0/822661296 conn(0x565026c54a10 msgr2=0x565026cf2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:08.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.668+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/822661296 shutdown_connections 2024-05-10T03:40:08.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.668+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/822661296 wait complete. 2024-05-10T03:40:08.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.668+0000 7fccc9a2cb80 1 -- start start 2024-05-10T03:40:08.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.668+0000 7fccc9a2cb80 1 Processor -- start 2024-05-10T03:40:08.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.668+0000 7fccc9a2cb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf2650 0x565026cffc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.668+0000 7fccc9a2cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565026cf3520 0x565026d00160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.668+0000 7fccc9a2cb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565026cf3e70 0x565026d00fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.668+0000 7fccc9a2cb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x565026d014e0 con 0x565026cf2650 2024-05-10T03:40:08.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.668+0000 7fccc9a2cb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x565026d01650 con 0x565026cf3e70 2024-05-10T03:40:08.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.668+0000 7fccc9a2cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x565026d01810 con 0x565026cf3520 2024-05-10T03:40:08.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.668+0000 7fccc9a2cb80 10 client.0 _ll_register_callbacks cb 0x565026bb7ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:08.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.668+0000 7fccb2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf2650 0x565026cffc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.668+0000 7fccb2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf2650 0x565026cffc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52366/0 (socket says 172.21.15.45:52366) 2024-05-10T03:40:08.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.669+0000 7fccb2ffd700 1 -- 172.21.15.45:0/2764635601 learned_addr learned my addr 172.21.15.45:0/2764635601 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:08.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.669+0000 7fccaa7fc700 1 --2- 172.21.15.45:0/2764635601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565026cf3520 0x565026d00160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.669+0000 7fccb37fe700 1 --2- 172.21.15.45:0/2764635601 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565026cf3e70 0x565026d00fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.669+0000 7fccb2ffd700 1 -- 172.21.15.45:0/2764635601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565026cf3520 msgr2=0x565026d00160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:08.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.669+0000 7fccb2ffd700 1 --2- 172.21.15.45:0/2764635601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565026cf3520 0x565026d00160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.669+0000 7fccb2ffd700 1 -- 172.21.15.45:0/2764635601 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565026cf3e70 msgr2=0x565026d00fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:08.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.669+0000 7fccb2ffd700 1 --2- 172.21.15.45:0/2764635601 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565026cf3e70 0x565026d00fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.669+0000 7fccb2ffd700 1 -- 172.21.15.45:0/2764635601 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb41a2940 con 0x565026cf2650 2024-05-10T03:40:08.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.669+0000 7fccb2ffd700 1 --2- 172.21.15.45:0/2764635601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf2650 0x565026cffc20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fcca400b540 tx=0x7fcca4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad96a6f64501f83 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:08.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.669+0000 7fcc9a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:08.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.669+0000 7fcc9a7fc700 1 -- 172.21.15.45:0/2764635601 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca40ca5b0 con 0x565026cf2650 2024-05-10T03:40:08.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.669+0000 7fcc9a7fc700 1 -- 172.21.15.45:0/2764635601 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fcca40a2000 con 0x565026cf2650 2024-05-10T03:40:08.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.669+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/2764635601 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcca4097f20 con 0x565026cf2650 2024-05-10T03:40:08.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.669+0000 7fcc9a7fc700 1 -- 172.21.15.45:0/2764635601 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcca4099070 con 0x565026cf2650 2024-05-10T03:40:08.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.669+0000 7fccc9a2cb80 10 client.15441 fetch_fsmap learned FSMap version 27 2024-05-10T03:40:08.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.669+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/2764635601 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x565026bd8510 con 0x565026cf2650 2024-05-10T03:40:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.670+0000 7fcc9a7fc700 1 -- 172.21.15.45:0/2764635601 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcca4097f20 con 0x565026cf2650 2024-05-10T03:40:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.670+0000 7fcc9a7fc700 1 -- 172.21.15.45:0/2764635601 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fcca4065310 con 0x565026cf2650 2024-05-10T03:40:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.670+0000 7fccc9a2cb80 10 client.15441 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T03:40:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.670+0000 7fccc9a2cb80 10 client.15441 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-10T03:40:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.670+0000 7fccc9a2cb80 20 client.15441 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.670+0000 7fccc9a2cb80 1 --2- 172.21.15.45:0/2764635601 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x565026d60ca0 0x565026d5ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.670+0000 7fccc9a2cb80 4 client.15441 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T03:40:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.670+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/2764635601 --> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] -- command(tid 0: {"prefix": "status"}) v1 -- 0x565026c0ae70 con 0x565026d60ca0 2024-05-10T03:40:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.670+0000 7fccaa7fc700 1 --2- 172.21.15.45:0/2764635601 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x565026d60ca0 0x565026d5ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.671+0000 7fcc9a7fc700 10 client.15441 ms_handle_connect on v2:172.21.15.106:6834/4162885659 2024-05-10T03:40:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.671+0000 7fccaa7fc700 1 --2- 172.21.15.45:0/2764635601 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x565026d60ca0 0x565026d5ec50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bcf5f1c079d1fdc server_cookie=54f0db17cdc10e8 in_seq=0 out_seq=0 2024-05-10T03:40:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.671+0000 7fcc9a7fc700 1 -- 172.21.15.45:0/2764635601 <== mds.4 v2:172.21.15.106:6834/4162885659 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x565026c0ae70 con 0x565026d60ca0 2024-05-10T03:40:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.671+0000 7fcc9a7fc700 10 client.15441 handle_command_reply: tid=0 2024-05-10T03:40:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.671+0000 7fccc9a2cb80 1 client.15441 shutdown 2024-05-10T03:40:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.671+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/2764635601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf2650 msgr2=0x565026cffc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:08.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.671+0000 7fccc9a2cb80 1 --2- 172.21.15.45:0/2764635601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf2650 0x565026cffc20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fcca400b540 tx=0x7fcca4000bc0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.671+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/2764635601 shutdown_connections 2024-05-10T03:40:08.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.671+0000 7fccc9a2cb80 1 --2- 172.21.15.45:0/2764635601 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x565026d60ca0 0x565026d5ec50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.671+0000 7fccc9a2cb80 1 --2- 172.21.15.45:0/2764635601 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565026cf3e70 0x565026d00fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.671+0000 7fcc9a7fc700 0 client.15441 ms_handle_reset on v2:172.21.15.106:6834/4162885659 2024-05-10T03:40:08.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.671+0000 7fccc9a2cb80 1 --2- 172.21.15.45:0/2764635601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565026cf2650 0x565026cffc20 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.671+0000 7fccc9a2cb80 1 --2- 172.21.15.45:0/2764635601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565026cf3520 0x565026d00160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.671+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/2764635601 >> 172.21.15.45:0/2764635601 conn(0x565026c54a10 msgr2=0x565026cf2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:08.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.671+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/2764635601 shutdown_connections 2024-05-10T03:40:08.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.671+0000 7fccc9a2cb80 1 -- 172.21.15.45:0/2764635601 wait complete. 2024-05-10T03:40:08.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.671+0000 7fccc9a2cb80 20 client.15441 trim_cache size 0 max 16384 2024-05-10T03:40:08.683 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:40:08.683 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "d2a0bafa-0e7d-11ef-bc98-c7b262605968", 2024-05-10T03:40:08.683 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 4, 2024-05-10T03:40:08.683 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 24521, 2024-05-10T03:40:08.683 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2024-05-10T03:40:08.683 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2024-05-10T03:40:08.684 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2024-05-10T03:40:08.684 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 69.683750438000004, 2024-05-10T03:40:08.684 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 27, 2024-05-10T03:40:08.684 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 88, 2024-05-10T03:40:08.684 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 86, 2024-05-10T03:40:08.684 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 110.84381386299999 2024-05-10T03:40:08.684 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:40:08.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.672+0000 7fccb96e8700 1 -- 172.21.15.45:0/626845735 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcca00a1260 msgr2=0x7fcca00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:08.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.672+0000 7fccb96e8700 1 --2- 172.21.15.45:0/626845735 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcca00a1260 0x7fcca00a3770 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fccb41018f0 tx=0x7fcc9c00b410 comp rx=0 tx=0).stop 2024-05-10T03:40:08.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.672+0000 7fccb96e8700 1 -- 172.21.15.45:0/626845735 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccb41026e0 msgr2=0x7fccb4101f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:08.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.672+0000 7fccb96e8700 1 --2- 172.21.15.45:0/626845735 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccb41026e0 0x7fccb4101f50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fcca400d950 tx=0x7fcca400dc60 comp rx=0 tx=0).stop 2024-05-10T03:40:08.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.672+0000 7fccb96e8700 1 -- 172.21.15.45:0/626845735 shutdown_connections 2024-05-10T03:40:08.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.672+0000 7fccb96e8700 1 --2- 172.21.15.45:0/626845735 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcca00a1260 0x7fcca00a3770 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.672+0000 7fccb96e8700 1 --2- 172.21.15.45:0/626845735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccb41079a0 0x7fccb4100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.672+0000 7fccb96e8700 1 --2- 172.21.15.45:0/626845735 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccb41026e0 0x7fccb4101f50 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.672+0000 7fccb96e8700 1 --2- 172.21.15.45:0/626845735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccb4105040 0x7fccb41005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.672+0000 7fccb96e8700 1 -- 172.21.15.45:0/626845735 >> 172.21.15.45:0/626845735 conn(0x7fccb40fc0e0 msgr2=0x7fccb4103520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:08.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.672+0000 7fccb96e8700 1 -- 172.21.15.45:0/626845735 shutdown_connections 2024-05-10T03:40:08.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.672+0000 7fccb96e8700 1 -- 172.21.15.45:0/626845735 wait complete. 2024-05-10T03:40:08.690 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-10T03:40:08.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.836+0000 7fd8cc9fc700 1 -- 172.21.15.45:0/2305360053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8c8100ac0 msgr2=0x7fd8c8100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:08.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.836+0000 7fd8cc9fc700 1 --2- 172.21.15.45:0/2305360053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8c8100ac0 0x7fd8c8100ed0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009990 tx=0x7fd8b8009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.836+0000 7fd8cc9fc700 1 -- 172.21.15.45:0/2305360053 shutdown_connections 2024-05-10T03:40:08.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.836+0000 7fd8cc9fc700 1 --2- 172.21.15.45:0/2305360053 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8c8102580 0x7fd8c8108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.836+0000 7fd8cc9fc700 1 --2- 172.21.15.45:0/2305360053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8c8100ac0 0x7fd8c8100ed0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.836+0000 7fd8cc9fc700 1 --2- 172.21.15.45:0/2305360053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8c8101be0 0x7fd8c8101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.836+0000 7fd8cc9fc700 1 -- 172.21.15.45:0/2305360053 >> 172.21.15.45:0/2305360053 conn(0x7fd8c80fc0d0 msgr2=0x7fd8c80fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:08.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.837+0000 7fd8cc9fc700 1 -- 172.21.15.45:0/2305360053 shutdown_connections 2024-05-10T03:40:08.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.837+0000 7fd8cc9fc700 1 -- 172.21.15.45:0/2305360053 wait complete. 2024-05-10T03:40:08.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.837+0000 7fd8cc9fc700 1 Processor -- start 2024-05-10T03:40:08.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.838+0000 7fd8cc9fc700 1 -- start start 2024-05-10T03:40:08.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.838+0000 7fd8cc9fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8c8100ac0 0x7fd8c8068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.838+0000 7fd8cc9fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8c8101be0 0x7fd8c819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.838+0000 7fd8cc9fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8c8102580 0x7fd8c819f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.838+0000 7fd8cc9fc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c819fa80 con 0x7fd8c8102580 2024-05-10T03:40:08.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.838+0000 7fd8cc9fc700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c819fbf0 con 0x7fd8c8101be0 2024-05-10T03:40:08.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.838+0000 7fd8cc9fc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c819fdb0 con 0x7fd8c8100ac0 2024-05-10T03:40:08.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.838+0000 7fd8c6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8c8102580 0x7fd8c819f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.838+0000 7fd8c6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8c8102580 0x7fd8c819f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52386/0 (socket says 172.21.15.45:52386) 2024-05-10T03:40:08.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.838+0000 7fd8c6d9d700 1 -- 172.21.15.45:0/667792968 learned_addr learned my addr 172.21.15.45:0/667792968 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:08.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.838+0000 7fd8c659c700 1 --2- 172.21.15.45:0/667792968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8c8100ac0 0x7fd8c8068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.838+0000 7fd8bdd9b700 1 --2- 172.21.15.45:0/667792968 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8c8101be0 0x7fd8c819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.838+0000 7fd8c6d9d700 1 -- 172.21.15.45:0/667792968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8c8100ac0 msgr2=0x7fd8c8068e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:08.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.838+0000 7fd8c6d9d700 1 --2- 172.21.15.45:0/667792968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8c8100ac0 0x7fd8c8068e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.838+0000 7fd8c6d9d700 1 -- 172.21.15.45:0/667792968 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8c8101be0 msgr2=0x7fd8c819cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:08.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.838+0000 7fd8c6d9d700 1 --2- 172.21.15.45:0/667792968 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8c8101be0 0x7fd8c819cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.838+0000 7fd8c6d9d700 1 -- 172.21.15.45:0/667792968 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b80095f0 con 0x7fd8c8102580 2024-05-10T03:40:08.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.839+0000 7fd8c6d9d700 1 --2- 172.21.15.45:0/667792968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8c8102580 0x7fd8c819f380 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000ef30 tx=0x7fd8c000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:08.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.839+0000 7fd8bffff700 1 -- 172.21.15.45:0/667792968 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0018070 con 0x7fd8c8102580 2024-05-10T03:40:08.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.839+0000 7fd8bffff700 1 -- 172.21.15.45:0/667792968 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd8c000f040 con 0x7fd8c8102580 2024-05-10T03:40:08.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.839+0000 7fd8cc9fc700 1 -- 172.21.15.45:0/667792968 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c81a0030 con 0x7fd8c8102580 2024-05-10T03:40:08.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.839+0000 7fd8bffff700 1 -- 172.21.15.45:0/667792968 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c000cd50 con 0x7fd8c8102580 2024-05-10T03:40:08.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.839+0000 7fd8cc9fc700 1 -- 172.21.15.45:0/667792968 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c81a04f0 con 0x7fd8c8102580 2024-05-10T03:40:08.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.842+0000 7fd8bffff700 1 -- 172.21.15.45:0/667792968 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fd8c0004000 con 0x7fd8c8102580 2024-05-10T03:40:08.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.843+0000 7fd8bffff700 1 --2- 172.21.15.45:0/667792968 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd8b40a1260 0x7fd8b40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.843+0000 7fd8bffff700 1 -- 172.21.15.45:0/667792968 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fd8c00cc8f0 con 0x7fd8c8102580 2024-05-10T03:40:08.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.843+0000 7fd8c659c700 1 --2- 172.21.15.45:0/667792968 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd8b40a1260 0x7fd8b40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.844+0000 7fd8dcd40b80 1 Processor -- start 2024-05-10T03:40:08.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.844+0000 7fd8dcd40b80 1 -- start start 2024-05-10T03:40:08.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.844+0000 7fd8c659c700 1 --2- 172.21.15.45:0/667792968 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd8b40a1260 0x7fd8b40a3770 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8006010 tx=0x7fd8b801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:08.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.844+0000 7fd8dcd40b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236b650 0x55a47236baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.844+0000 7fd8dcd40b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a47236c520 0x55a47236c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.844+0000 7fd8dcd40b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a47236ce70 0x55a472373770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.844+0000 7fd8dcd40b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a472292100 con 0x55a47236b650 2024-05-10T03:40:08.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.844+0000 7fd8dcd40b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a47228fac0 con 0x55a47236c520 2024-05-10T03:40:08.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.844+0000 7fd8dcd40b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a47228b3b0 con 0x55a47236ce70 2024-05-10T03:40:08.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.844+0000 7fd8c659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236b650 0x55a47236baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.844+0000 7fd8c659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236b650 0x55a47236baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52392/0 (socket says 172.21.15.45:52392) 2024-05-10T03:40:08.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.844+0000 7fd8c659c700 1 -- 172.21.15.45:0/2559108654 learned_addr learned my addr 172.21.15.45:0/2559108654 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:08.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.844+0000 7fd8c6d9d700 1 --2- 172.21.15.45:0/2559108654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a47236ce70 0x55a472373770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.844+0000 7fd8bdd9b700 1 --2- 172.21.15.45:0/2559108654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a47236c520 0x55a47236c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.845+0000 7fd8c659c700 1 -- 172.21.15.45:0/2559108654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a47236ce70 msgr2=0x55a472373770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:08.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.845+0000 7fd8c659c700 1 --2- 172.21.15.45:0/2559108654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a47236ce70 0x55a472373770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.845+0000 7fd8c659c700 1 -- 172.21.15.45:0/2559108654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a47236c520 msgr2=0x55a47236c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:08.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.845+0000 7fd8c659c700 1 --2- 172.21.15.45:0/2559108654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a47236c520 0x55a47236c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.845+0000 7fd8c659c700 1 -- 172.21.15.45:0/2559108654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a47210c360 con 0x55a47236b650 2024-05-10T03:40:08.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.845+0000 7fd8c6d9d700 1 --2- 172.21.15.45:0/2559108654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a47236ce70 0x55a472373770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:40:08.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.845+0000 7fd8c659c700 1 --2- 172.21.15.45:0/2559108654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236b650 0x55a47236baa0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd8b800b2e0 tx=0x7fd8b801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5881299c2da27e1f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:08.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.845+0000 7fd8bcd99700 1 -- 172.21.15.45:0/2559108654 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b802b070 con 0x55a47236b650 2024-05-10T03:40:08.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.845+0000 7fd8bcd99700 1 -- 172.21.15.45:0/2559108654 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd8b801e040 con 0x55a47236b650 2024-05-10T03:40:08.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.845+0000 7fd8bcd99700 1 -- 172.21.15.45:0/2559108654 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80249c0 con 0x55a47236b650 2024-05-10T03:40:08.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.846+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/2559108654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236b650 msgr2=0x55a47236baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:08.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.846+0000 7fd8dcd40b80 1 --2- 172.21.15.45:0/2559108654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236b650 0x55a47236baa0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd8b800b2e0 tx=0x7fd8b801f000 comp rx=0 tx=0).stop 2024-05-10T03:40:08.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.846+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/2559108654 shutdown_connections 2024-05-10T03:40:08.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.846+0000 7fd8dcd40b80 1 --2- 172.21.15.45:0/2559108654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a47236ce70 0x55a472373770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.846+0000 7fd8dcd40b80 1 --2- 172.21.15.45:0/2559108654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236b650 0x55a47236baa0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.846+0000 7fd8dcd40b80 1 --2- 172.21.15.45:0/2559108654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a47236c520 0x55a47236c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.846+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/2559108654 >> 172.21.15.45:0/2559108654 conn(0x55a4722cda10 msgr2=0x55a472365f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:08.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.846+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/2559108654 shutdown_connections 2024-05-10T03:40:08.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.846+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/2559108654 wait complete. 2024-05-10T03:40:08.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.847+0000 7fd8dcd40b80 1 -- start start 2024-05-10T03:40:08.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.847+0000 7fd8dcd40b80 1 Processor -- start 2024-05-10T03:40:08.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.847+0000 7fd8dcd40b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236b650 0x55a4723755c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.847+0000 7fd8dcd40b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a47236c520 0x55a472375b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.847+0000 7fd8dcd40b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a47236ce70 0x55a47237ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.847+0000 7fd8dcd40b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a472227510 con 0x55a47236b650 2024-05-10T03:40:08.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.847+0000 7fd8dcd40b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4722271b0 con 0x55a47236c520 2024-05-10T03:40:08.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.847+0000 7fd8dcd40b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a47210e650 con 0x55a47236ce70 2024-05-10T03:40:08.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.847+0000 7fd8dcd40b80 10 client.0 _ll_register_callbacks cb 0x55a472230ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:08.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.847+0000 7fd8c659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236b650 0x55a4723755c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.847+0000 7fd8c659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236b650 0x55a4723755c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52406/0 (socket says 172.21.15.45:52406) 2024-05-10T03:40:08.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.847+0000 7fd8c659c700 1 -- 172.21.15.45:0/986324850 learned_addr learned my addr 172.21.15.45:0/986324850 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:08.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.847+0000 7fd8bdd9b700 1 --2- 172.21.15.45:0/986324850 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a47236c520 0x55a472375b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.848+0000 7fd8c6d9d700 1 --2- 172.21.15.45:0/986324850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a47236ce70 0x55a47237ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.848+0000 7fd8c659c700 1 -- 172.21.15.45:0/986324850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a47236ce70 msgr2=0x55a47237ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:08.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.848+0000 7fd8c659c700 1 --2- 172.21.15.45:0/986324850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a47236ce70 0x55a47237ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.848+0000 7fd8c659c700 1 -- 172.21.15.45:0/986324850 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a47236c520 msgr2=0x55a472375b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:08.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.848+0000 7fd8c659c700 1 --2- 172.21.15.45:0/986324850 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a47236c520 0x55a472375b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.848+0000 7fd8c659c700 1 -- 172.21.15.45:0/986324850 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c81a04f0 con 0x55a47236b650 2024-05-10T03:40:08.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.848+0000 7fd8c6d9d700 1 --2- 172.21.15.45:0/986324850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a47236ce70 0x55a47237ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:40:08.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.848+0000 7fd8c659c700 1 --2- 172.21.15.45:0/986324850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236b650 0x55a4723755c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009990 tx=0x7fd8b800f760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5717b42a4e0eff5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:08.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.848+0000 7fd8adffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:08.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.848+0000 7fd8adffb700 1 -- 172.21.15.45:0/986324850 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b802b040 con 0x55a47236b650 2024-05-10T03:40:08.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.848+0000 7fd8adffb700 1 -- 172.21.15.45:0/986324850 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fd8b8037440 con 0x55a47236b650 2024-05-10T03:40:08.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.848+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/986324850 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a4721e4220 con 0x55a47236b650 2024-05-10T03:40:08.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.848+0000 7fd8adffb700 1 -- 172.21.15.45:0/986324850 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8b8037600 con 0x55a47236b650 2024-05-10T03:40:08.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.848+0000 7fd8dcd40b80 10 client.15453 fetch_fsmap learned FSMap version 27 2024-05-10T03:40:08.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.848+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/986324850 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fd8c81098c0 con 0x55a47236b650 2024-05-10T03:40:08.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.849+0000 7fd8adffb700 1 -- 172.21.15.45:0/986324850 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55a4721e4220 con 0x55a47236b650 2024-05-10T03:40:08.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.849+0000 7fd8adffb700 1 -- 172.21.15.45:0/986324850 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd8b80175b0 con 0x55a47236b650 2024-05-10T03:40:08.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.849+0000 7fd8dcd40b80 10 client.15453 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T03:40:08.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.849+0000 7fd8dcd40b80 10 client.15453 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T03:40:08.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.849+0000 7fd8dcd40b80 20 client.15453 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:08.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.849+0000 7fd8dcd40b80 1 --2- 172.21.15.45:0/986324850 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x55a4723806f0 0x55a472385420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.849+0000 7fd8dcd40b80 4 client.15453 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:40:08.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.849+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/986324850 --> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a47233a730 con 0x55a4723806f0 2024-05-10T03:40:08.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.849+0000 7fd8bdd9b700 1 --2- 172.21.15.45:0/986324850 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x55a4723806f0 0x55a472385420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.850+0000 7fd8bdd9b700 1 --2- 172.21.15.45:0/986324850 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x55a4723806f0 0x55a472385420 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a6aaceb515291778 server_cookie=b3b3d8eefa01c79b in_seq=0 out_seq=0 2024-05-10T03:40:08.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.850+0000 7fd8adffb700 10 client.15453 ms_handle_connect on v2:172.21.15.154:6836/608167481 2024-05-10T03:40:08.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.850+0000 7fd8adffb700 1 -- 172.21.15.45:0/986324850 <== mds.3 v2:172.21.15.154:6836/608167481 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a47233a730 con 0x55a4723806f0 2024-05-10T03:40:08.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.850+0000 7fd8adffb700 10 client.15453 handle_command_reply: tid=0 2024-05-10T03:40:08.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.850+0000 7fd8dcd40b80 1 client.15453 shutdown 2024-05-10T03:40:08.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.850+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/986324850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236b650 msgr2=0x55a4723755c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:08.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.850+0000 7fd8dcd40b80 1 --2- 172.21.15.45:0/986324850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236b650 0x55a4723755c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009990 tx=0x7fd8b800f760 comp rx=0 tx=0).stop 2024-05-10T03:40:08.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.851+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/986324850 shutdown_connections 2024-05-10T03:40:08.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.851+0000 7fd8dcd40b80 1 --2- 172.21.15.45:0/986324850 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x55a4723806f0 0x55a472385420 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.851+0000 7fd8dcd40b80 1 --2- 172.21.15.45:0/986324850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a47236ce70 0x55a47237ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.851+0000 7fd8dcd40b80 1 --2- 172.21.15.45:0/986324850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236b650 0x55a4723755c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.851+0000 7fd8adffb700 0 client.15453 ms_handle_reset on v2:172.21.15.154:6836/608167481 2024-05-10T03:40:08.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.851+0000 7fd8dcd40b80 1 --2- 172.21.15.45:0/986324850 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a47236c520 0x55a472375b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.851+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/986324850 >> 172.21.15.45:0/986324850 conn(0x55a4722cda10 msgr2=0x55a472365f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:08.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.851+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/986324850 shutdown_connections 2024-05-10T03:40:08.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.851+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/986324850 wait complete. 2024-05-10T03:40:08.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.851+0000 7fd8dcd40b80 20 client.15453 trim_cache size 0 max 16384 2024-05-10T03:40:08.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.870+0000 7fd8dcd40b80 1 Processor -- start 2024-05-10T03:40:08.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.870+0000 7fd8dcd40b80 1 -- start start 2024-05-10T03:40:08.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.870+0000 7fd8dcd40b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a47236b650 0x55a47237aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.870+0000 7fd8dcd40b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a47236c520 0x55a47237af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.870+0000 7fd8dcd40b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236ce70 0x55a4723739e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.870+0000 7fd8dcd40b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a472284150 con 0x55a47236ce70 2024-05-10T03:40:08.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.870+0000 7fd8dcd40b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a472288010 con 0x55a47236b650 2024-05-10T03:40:08.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.870+0000 7fd8dcd40b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a472362ce0 con 0x55a47236c520 2024-05-10T03:40:08.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.870+0000 7fd8c6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236ce70 0x55a4723739e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.871+0000 7fd8c6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236ce70 0x55a4723739e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52422/0 (socket says 172.21.15.45:52422) 2024-05-10T03:40:08.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.871+0000 7fd8c6d9d700 1 -- 172.21.15.45:0/1158751880 learned_addr learned my addr 172.21.15.45:0/1158751880 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:08.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.871+0000 7fd8bdd9b700 1 --2- 172.21.15.45:0/1158751880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a47236c520 0x55a47237af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.871+0000 7fd8c659c700 1 --2- 172.21.15.45:0/1158751880 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a47236b650 0x55a47237aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.871+0000 7fd8c6d9d700 1 -- 172.21.15.45:0/1158751880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a47236c520 msgr2=0x55a47237af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:08.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.871+0000 7fd8c6d9d700 1 --2- 172.21.15.45:0/1158751880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a47236c520 0x55a47237af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.871+0000 7fd8c6d9d700 1 -- 172.21.15.45:0/1158751880 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a47236b650 msgr2=0x55a47237aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:08.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.871+0000 7fd8c6d9d700 1 --2- 172.21.15.45:0/1158751880 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a47236b650 0x55a47237aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.871+0000 7fd8c6d9d700 1 -- 172.21.15.45:0/1158751880 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4720b8b10 con 0x55a47236ce70 2024-05-10T03:40:08.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.871+0000 7fd8c6d9d700 1 --2- 172.21.15.45:0/1158751880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236ce70 0x55a4723739e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00c9f60 tx=0x7fd8c0099440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c65c09466f75fdc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:08.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.871+0000 7fd8bd59a700 1 -- 172.21.15.45:0/1158751880 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c00b2210 con 0x55a47236ce70 2024-05-10T03:40:08.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.871+0000 7fd8bd59a700 1 -- 172.21.15.45:0/1158751880 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd8c009a000 con 0x55a47236ce70 2024-05-10T03:40:08.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.871+0000 7fd8bd59a700 1 -- 172.21.15.45:0/1158751880 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0099b60 con 0x55a47236ce70 2024-05-10T03:40:08.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.872+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/1158751880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236ce70 msgr2=0x55a4723739e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:08.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.872+0000 7fd8dcd40b80 1 --2- 172.21.15.45:0/1158751880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236ce70 0x55a4723739e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00c9f60 tx=0x7fd8c0099440 comp rx=0 tx=0).stop 2024-05-10T03:40:08.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.872+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/1158751880 shutdown_connections 2024-05-10T03:40:08.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.872+0000 7fd8dcd40b80 1 --2- 172.21.15.45:0/1158751880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236ce70 0x55a4723739e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.872+0000 7fd8dcd40b80 1 --2- 172.21.15.45:0/1158751880 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a47236b650 0x55a47237aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.872+0000 7fd8dcd40b80 1 --2- 172.21.15.45:0/1158751880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a47236c520 0x55a47237af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.872+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/1158751880 >> 172.21.15.45:0/1158751880 conn(0x55a4722cda10 msgr2=0x55a472366a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:08.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.872+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/1158751880 shutdown_connections 2024-05-10T03:40:08.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.872+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/1158751880 wait complete. 2024-05-10T03:40:08.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.872+0000 7fd8dcd40b80 1 -- start start 2024-05-10T03:40:08.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.872+0000 7fd8dcd40b80 1 Processor -- start 2024-05-10T03:40:08.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.873+0000 7fd8dcd40b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236b650 0x55a47237a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.873+0000 7fd8dcd40b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a47236c520 0x55a47237ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.873+0000 7fd8dcd40b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a47236ce70 0x55a472378fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.873+0000 7fd8dcd40b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a472379580 con 0x55a47236b650 2024-05-10T03:40:08.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.873+0000 7fd8dcd40b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4723796f0 con 0x55a47236c520 2024-05-10T03:40:08.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.873+0000 7fd8dcd40b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4723798b0 con 0x55a47236ce70 2024-05-10T03:40:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.873+0000 7fd8dcd40b80 10 client.0 _ll_register_callbacks cb 0x55a472230ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.873+0000 7fd8c659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236b650 0x55a47237a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.873+0000 7fd8c659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236b650 0x55a47237a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52428/0 (socket says 172.21.15.45:52428) 2024-05-10T03:40:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.873+0000 7fd8c659c700 1 -- 172.21.15.45:0/638705975 learned_addr learned my addr 172.21.15.45:0/638705975 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.873+0000 7fd8c6d9d700 1 --2- 172.21.15.45:0/638705975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a47236ce70 0x55a472378fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.873+0000 7fd8bdd9b700 1 --2- 172.21.15.45:0/638705975 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a47236c520 0x55a47237ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.873+0000 7fd8c659c700 1 -- 172.21.15.45:0/638705975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a47236ce70 msgr2=0x55a472378fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.873+0000 7fd8c659c700 1 --2- 172.21.15.45:0/638705975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a47236ce70 0x55a472378fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.873+0000 7fd8c659c700 1 -- 172.21.15.45:0/638705975 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a47236c520 msgr2=0x55a47237ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.873+0000 7fd8c659c700 1 --2- 172.21.15.45:0/638705975 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a47236c520 0x55a47237ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.873+0000 7fd8c659c700 1 -- 172.21.15.45:0/638705975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c81a0030 con 0x55a47236b650 2024-05-10T03:40:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.873+0000 7fd8c659c700 1 --2- 172.21.15.45:0/638705975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236b650 0x55a47237a840 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8005f50 tx=0x7fd8b8024680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6277ed17d591ec server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.873+0000 7fd8adffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.874+0000 7fd8adffb700 1 -- 172.21.15.45:0/638705975 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b802b050 con 0x55a47236b650 2024-05-10T03:40:08.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.874+0000 7fd8adffb700 1 -- 172.21.15.45:0/638705975 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fd8b8017c30 con 0x55a47236b650 2024-05-10T03:40:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.874+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/638705975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd8b801e040 con 0x55a47236b650 2024-05-10T03:40:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.874+0000 7fd8adffb700 1 -- 172.21.15.45:0/638705975 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8b80175f0 con 0x55a47236b650 2024-05-10T03:40:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.874+0000 7fd8dcd40b80 10 client.15459 fetch_fsmap learned FSMap version 27 2024-05-10T03:40:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.874+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/638705975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a472251510 con 0x55a47236b650 2024-05-10T03:40:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.874+0000 7fd8adffb700 1 -- 172.21.15.45:0/638705975 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd8b801e040 con 0x55a47236b650 2024-05-10T03:40:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.874+0000 7fd8adffb700 1 -- 172.21.15.45:0/638705975 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd8b803f040 con 0x55a47236b650 2024-05-10T03:40:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.874+0000 7fd8dcd40b80 10 client.15459 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T03:40:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.874+0000 7fd8dcd40b80 10 client.15459 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T03:40:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.874+0000 7fd8dcd40b80 20 client.15459 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.874+0000 7fd8dcd40b80 1 --2- 172.21.15.45:0/638705975 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x55a4723d9700 0x55a4723d7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.874+0000 7fd8dcd40b80 4 client.15459 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T03:40:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.874+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/638705975 --> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a472283e70 con 0x55a4723d9700 2024-05-10T03:40:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.875+0000 7fd8bdd9b700 1 --2- 172.21.15.45:0/638705975 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x55a4723d9700 0x55a4723d7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.875+0000 7fd8bdd9b700 1 --2- 172.21.15.45:0/638705975 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x55a4723d9700 0x55a4723d7c60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6ddbcb1d3a7a4650 server_cookie=66b3ea79c0ffa536 in_seq=0 out_seq=0 2024-05-10T03:40:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.875+0000 7fd8adffb700 10 client.15459 ms_handle_connect on v2:172.21.15.154:6836/608167481 2024-05-10T03:40:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.875+0000 7fd8adffb700 1 -- 172.21.15.45:0/638705975 <== mds.3 v2:172.21.15.154:6836/608167481 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55a472283e70 con 0x55a4723d9700 2024-05-10T03:40:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.875+0000 7fd8adffb700 10 client.15459 handle_command_reply: tid=0 2024-05-10T03:40:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.875+0000 7fd8dcd40b80 1 client.15459 shutdown 2024-05-10T03:40:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.875+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/638705975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236b650 msgr2=0x55a47237a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.875+0000 7fd8dcd40b80 1 --2- 172.21.15.45:0/638705975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236b650 0x55a47237a840 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8005f50 tx=0x7fd8b8024680 comp rx=0 tx=0).stop 2024-05-10T03:40:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.876+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/638705975 shutdown_connections 2024-05-10T03:40:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.876+0000 7fd8dcd40b80 1 --2- 172.21.15.45:0/638705975 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x55a4723d9700 0x55a4723d7c60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.876+0000 7fd8dcd40b80 1 --2- 172.21.15.45:0/638705975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a47236ce70 0x55a472378fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.876+0000 7fd8dcd40b80 1 --2- 172.21.15.45:0/638705975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a47236b650 0x55a47237a840 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.876+0000 7fd8adffb700 0 client.15459 ms_handle_reset on v2:172.21.15.154:6836/608167481 2024-05-10T03:40:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.876+0000 7fd8dcd40b80 1 --2- 172.21.15.45:0/638705975 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a47236c520 0x55a47237ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.876+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/638705975 >> 172.21.15.45:0/638705975 conn(0x55a4722cda10 msgr2=0x55a472389440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.876+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/638705975 shutdown_connections 2024-05-10T03:40:08.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.876+0000 7fd8dcd40b80 1 -- 172.21.15.45:0/638705975 wait complete. 2024-05-10T03:40:08.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.876+0000 7fd8dcd40b80 20 client.15459 trim_cache size 0 max 16384 2024-05-10T03:40:08.888 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:40:08.888 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "d2a0bafa-0e7d-11ef-bc98-c7b262605968", 2024-05-10T03:40:08.888 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 3, 2024-05-10T03:40:08.888 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 24526, 2024-05-10T03:40:08.888 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2024-05-10T03:40:08.888 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2024-05-10T03:40:08.888 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2024-05-10T03:40:08.889 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 70.893557565999998, 2024-05-10T03:40:08.889 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 27, 2024-05-10T03:40:08.889 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 88, 2024-05-10T03:40:08.889 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 86, 2024-05-10T03:40:08.889 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 107.514980714 2024-05-10T03:40:08.889 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:40:08.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.876+0000 7fd8cc9fc700 1 -- 172.21.15.45:0/667792968 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd8b40a1260 msgr2=0x7fd8b40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:08.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.876+0000 7fd8cc9fc700 1 --2- 172.21.15.45:0/667792968 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd8b40a1260 0x7fd8b40a3770 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8006010 tx=0x7fd8b801a040 comp rx=0 tx=0).stop 2024-05-10T03:40:08.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.876+0000 7fd8cc9fc700 1 -- 172.21.15.45:0/667792968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8c8102580 msgr2=0x7fd8c819f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:08.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.876+0000 7fd8cc9fc700 1 --2- 172.21.15.45:0/667792968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8c8102580 0x7fd8c819f380 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000ef30 tx=0x7fd8c000c3a0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.876+0000 7fd8cc9fc700 1 -- 172.21.15.45:0/667792968 shutdown_connections 2024-05-10T03:40:08.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.876+0000 7fd8cc9fc700 1 --2- 172.21.15.45:0/667792968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8c8100ac0 0x7fd8c8068e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.876+0000 7fd8cc9fc700 1 --2- 172.21.15.45:0/667792968 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd8b40a1260 0x7fd8b40a3770 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.876+0000 7fd8cc9fc700 1 --2- 172.21.15.45:0/667792968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8c8102580 0x7fd8c819f380 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.876+0000 7fd8cc9fc700 1 --2- 172.21.15.45:0/667792968 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8c8101be0 0x7fd8c819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:08.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.876+0000 7fd8cc9fc700 1 -- 172.21.15.45:0/667792968 >> 172.21.15.45:0/667792968 conn(0x7fd8c80fc0d0 msgr2=0x7fd8c8104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:08.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.876+0000 7fd8cc9fc700 1 -- 172.21.15.45:0/667792968 shutdown_connections 2024-05-10T03:40:08.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:08.877+0000 7fd8cc9fc700 1 -- 172.21.15.45:0/667792968 wait complete. 2024-05-10T03:40:08.894 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-05-10T03:40:09.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.041+0000 7f094996b700 1 -- 172.21.15.45:0/2479481832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0944102580 msgr2=0x7f0944108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.041+0000 7f094996b700 1 --2- 172.21.15.45:0/2479481832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0944102580 0x7f0944108e30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f093c00b0a0 tx=0x7f093c00b3b0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.042+0000 7f094996b700 1 -- 172.21.15.45:0/2479481832 shutdown_connections 2024-05-10T03:40:09.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.042+0000 7f094996b700 1 --2- 172.21.15.45:0/2479481832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0944102580 0x7f0944108e30 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.042+0000 7f094996b700 1 --2- 172.21.15.45:0/2479481832 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0944100ac0 0x7f0944100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.042+0000 7f094996b700 1 --2- 172.21.15.45:0/2479481832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0944101be0 0x7f0944101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.042+0000 7f094996b700 1 -- 172.21.15.45:0/2479481832 >> 172.21.15.45:0/2479481832 conn(0x7f09440fc0d0 msgr2=0x7f09440fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:09.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.042+0000 7f094996b700 1 -- 172.21.15.45:0/2479481832 shutdown_connections 2024-05-10T03:40:09.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.042+0000 7f094996b700 1 -- 172.21.15.45:0/2479481832 wait complete. 2024-05-10T03:40:09.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.042+0000 7f094996b700 1 Processor -- start 2024-05-10T03:40:09.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.043+0000 7f094996b700 1 -- start start 2024-05-10T03:40:09.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.043+0000 7f094996b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0944100ac0 0x7f0944068e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.043+0000 7f094996b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0944101be0 0x7f094419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.043+0000 7f094996b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0944102580 0x7f094419f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.043+0000 7f094996b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094419fb80 con 0x7f0944101be0 2024-05-10T03:40:09.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.043+0000 7f094996b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094419fcf0 con 0x7f0944100ac0 2024-05-10T03:40:09.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.043+0000 7f094996b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094419feb0 con 0x7f0944102580 2024-05-10T03:40:09.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.043+0000 7f09427fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0944101be0 0x7f094419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.043+0000 7f09427fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0944101be0 0x7f094419cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52450/0 (socket says 172.21.15.45:52450) 2024-05-10T03:40:09.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.043+0000 7f09427fc700 1 -- 172.21.15.45:0/2745075276 learned_addr learned my addr 172.21.15.45:0/2745075276 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:09.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.043+0000 7f0942ffd700 1 --2- 172.21.15.45:0/2745075276 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0944100ac0 0x7f0944068e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.043+0000 7f09427fc700 1 -- 172.21.15.45:0/2745075276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0944102580 msgr2=0x7f094419f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.043+0000 7f09437fe700 1 --2- 172.21.15.45:0/2745075276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0944102580 0x7f094419f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.043+0000 7f09427fc700 1 --2- 172.21.15.45:0/2745075276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0944102580 0x7f094419f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.043+0000 7f09427fc700 1 -- 172.21.15.45:0/2745075276 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0944100ac0 msgr2=0x7f0944068e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.043+0000 7f09427fc700 1 --2- 172.21.15.45:0/2745075276 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0944100ac0 0x7f0944068e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.043+0000 7f09427fc700 1 -- 172.21.15.45:0/2745075276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c009d00 con 0x7f0944101be0 2024-05-10T03:40:09.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.043+0000 7f09437fe700 1 --2- 172.21.15.45:0/2745075276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0944102580 0x7f094419f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:40:09.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.043+0000 7f0942ffd700 1 --2- 172.21.15.45:0/2745075276 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0944100ac0 0x7f0944068e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:40:09.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.043+0000 7f09427fc700 1 --2- 172.21.15.45:0/2745075276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0944101be0 0x7f094419cdf0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f093800e9a0 tx=0x7f093800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:09.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.044+0000 7f0948969700 1 -- 172.21.15.45:0/2745075276 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938009790 con 0x7f0944101be0 2024-05-10T03:40:09.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.044+0000 7f0948969700 1 -- 172.21.15.45:0/2745075276 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f093800cbd0 con 0x7f0944101be0 2024-05-10T03:40:09.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.044+0000 7f094996b700 1 -- 172.21.15.45:0/2745075276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09441a0130 con 0x7f0944101be0 2024-05-10T03:40:09.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.044+0000 7f0948969700 1 -- 172.21.15.45:0/2745075276 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938018730 con 0x7f0944101be0 2024-05-10T03:40:09.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.044+0000 7f094996b700 1 -- 172.21.15.45:0/2745075276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09441a0690 con 0x7f0944101be0 2024-05-10T03:40:09.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.046+0000 7f0948969700 1 -- 172.21.15.45:0/2745075276 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f0938018890 con 0x7f0944101be0 2024-05-10T03:40:09.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.047+0000 7f0948969700 1 --2- 172.21.15.45:0/2745075276 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f092c0a12e0 0x7f092c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.047+0000 7f0942ffd700 1 --2- 172.21.15.45:0/2745075276 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f092c0a12e0 0x7f092c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.047+0000 7f0948969700 1 -- 172.21.15.45:0/2745075276 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f0938014070 con 0x7f0944101be0 2024-05-10T03:40:09.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.047+0000 7f0942ffd700 1 --2- 172.21.15.45:0/2745075276 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f092c0a12e0 0x7f092c0a37f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0944101ae0 tx=0x7f0934009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:09.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.047+0000 7f0959cafb80 1 Processor -- start 2024-05-10T03:40:09.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.048+0000 7f0959cafb80 1 -- start start 2024-05-10T03:40:09.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.048+0000 7f0959cafb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560331c08650 0x560331c08aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.048+0000 7f0959cafb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09520 0x560331c09930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.048+0000 7f0959cafb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560331c09e70 0x560331c10770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.048+0000 7f0959cafb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560331b2f100 con 0x560331c09520 2024-05-10T03:40:09.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.048+0000 7f0959cafb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x560331b2cac0 con 0x560331c09e70 2024-05-10T03:40:09.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.048+0000 7f0959cafb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x560331b283b0 con 0x560331c08650 2024-05-10T03:40:09.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.048+0000 7f09427fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09520 0x560331c09930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.048+0000 7f09427fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09520 0x560331c09930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52466/0 (socket says 172.21.15.45:52466) 2024-05-10T03:40:09.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.048+0000 7f09427fc700 1 -- 172.21.15.45:0/3330767909 learned_addr learned my addr 172.21.15.45:0/3330767909 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:09.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.048+0000 7f0942ffd700 1 --2- 172.21.15.45:0/3330767909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560331c08650 0x560331c08aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.048+0000 7f09437fe700 1 --2- 172.21.15.45:0/3330767909 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560331c09e70 0x560331c10770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.049+0000 7f09427fc700 1 -- 172.21.15.45:0/3330767909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560331c08650 msgr2=0x560331c08aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:09.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.049+0000 7f09427fc700 1 --2- 172.21.15.45:0/3330767909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560331c08650 0x560331c08aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.049+0000 7f09427fc700 1 -- 172.21.15.45:0/3330767909 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560331c09e70 msgr2=0x560331c10770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:09.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.049+0000 7f09427fc700 1 --2- 172.21.15.45:0/3330767909 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560331c09e70 0x560331c10770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.049+0000 7f09427fc700 1 -- 172.21.15.45:0/3330767909 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603319a9360 con 0x560331c09520 2024-05-10T03:40:09.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.049+0000 7f0942ffd700 1 --2- 172.21.15.45:0/3330767909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560331c08650 0x560331c08aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.049+0000 7f09427fc700 1 --2- 172.21.15.45:0/3330767909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09520 0x560331c09930 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0938096a90 tx=0x7f093809a720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cab6f2aa372997f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.049+0000 7f0929ffb700 1 -- 172.21.15.45:0/3330767909 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093809de50 con 0x560331c09520 2024-05-10T03:40:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.049+0000 7f0929ffb700 1 -- 172.21.15.45:0/3330767909 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f09380a24a0 con 0x560331c09520 2024-05-10T03:40:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.049+0000 7f0929ffb700 1 -- 172.21.15.45:0/3330767909 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093800cea0 con 0x560331c09520 2024-05-10T03:40:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.050+0000 7f0959cafb80 1 -- 172.21.15.45:0/3330767909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09520 msgr2=0x560331c09930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.050+0000 7f0959cafb80 1 --2- 172.21.15.45:0/3330767909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09520 0x560331c09930 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0938096a90 tx=0x7f093809a720 comp rx=0 tx=0).stop 2024-05-10T03:40:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.050+0000 7f0959cafb80 1 -- 172.21.15.45:0/3330767909 shutdown_connections 2024-05-10T03:40:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.050+0000 7f0959cafb80 1 --2- 172.21.15.45:0/3330767909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560331c08650 0x560331c08aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.050+0000 7f0959cafb80 1 --2- 172.21.15.45:0/3330767909 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560331c09e70 0x560331c10770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.050+0000 7f0959cafb80 1 --2- 172.21.15.45:0/3330767909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09520 0x560331c09930 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.050+0000 7f0959cafb80 1 -- 172.21.15.45:0/3330767909 >> 172.21.15.45:0/3330767909 conn(0x560331b6aa10 msgr2=0x560331c02f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.050+0000 7f0959cafb80 1 -- 172.21.15.45:0/3330767909 shutdown_connections 2024-05-10T03:40:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.050+0000 7f0959cafb80 1 -- 172.21.15.45:0/3330767909 wait complete. 2024-05-10T03:40:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.050+0000 7f0959cafb80 1 -- start start 2024-05-10T03:40:09.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.051+0000 7f0959cafb80 1 Processor -- start 2024-05-10T03:40:09.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.051+0000 7f0959cafb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560331c08650 0x560331c12700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.051+0000 7f0959cafb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560331c09520 0x560331c12c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.051+0000 7f0959cafb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09e70 0x560331c19ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.051+0000 7f0959cafb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560331ac4510 con 0x560331c09e70 2024-05-10T03:40:09.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.051+0000 7f0959cafb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x560331ac41b0 con 0x560331c08650 2024-05-10T03:40:09.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.051+0000 7f0959cafb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603319ab650 con 0x560331c09520 2024-05-10T03:40:09.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.051+0000 7f0959cafb80 10 client.0 _ll_register_callbacks cb 0x560331acdae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:09.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.051+0000 7f09437fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09e70 0x560331c19ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.051+0000 7f09437fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09e70 0x560331c19ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52480/0 (socket says 172.21.15.45:52480) 2024-05-10T03:40:09.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.051+0000 7f0942ffd700 1 --2- 172.21.15.45:0/1128742047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560331c08650 0x560331c12700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.051+0000 7f09437fe700 1 -- 172.21.15.45:0/1128742047 learned_addr learned my addr 172.21.15.45:0/1128742047 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:09.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.051+0000 7f09427fc700 1 --2- 172.21.15.45:0/1128742047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560331c09520 0x560331c12c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.052+0000 7f0942ffd700 1 -- 172.21.15.45:0/1128742047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560331c09520 msgr2=0x560331c12c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:09.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.052+0000 7f0942ffd700 1 --2- 172.21.15.45:0/1128742047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560331c09520 0x560331c12c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.052+0000 7f0942ffd700 1 -- 172.21.15.45:0/1128742047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09e70 msgr2=0x560331c19ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:09.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.052+0000 7f0942ffd700 1 --2- 172.21.15.45:0/1128742047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09e70 0x560331c19ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.052+0000 7f0942ffd700 1 -- 172.21.15.45:0/1128742047 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09441a0690 con 0x560331c08650 2024-05-10T03:40:09.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.052+0000 7f09437fe700 1 --2- 172.21.15.45:0/1128742047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09e70 0x560331c19ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:40:09.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.052+0000 7f0942ffd700 1 --2- 172.21.15.45:0/1128742047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560331c08650 0x560331c12700 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f09441007b0 tx=0x7f09340047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b976a4cf52c8c66 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:09.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.052+0000 7f0922ffd700 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-05-10T03:40:09.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.052+0000 7f0922ffd700 1 -- 172.21.15.45:0/1128742047 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934020430 con 0x560331c08650 2024-05-10T03:40:09.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.052+0000 7f0922ffd700 1 -- 172.21.15.45:0/1128742047 <== mon.2 v2:172.21.15.106:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f0934020590 con 0x560331c08650 2024-05-10T03:40:09.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.052+0000 7f0959cafb80 1 -- 172.21.15.45:0/1128742047 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560331a81220 con 0x560331c08650 2024-05-10T03:40:09.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.052+0000 7f0922ffd700 1 -- 172.21.15.45:0/1128742047 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0934004830 con 0x560331c08650 2024-05-10T03:40:09.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.052+0000 7f0959cafb80 10 client.25352 fetch_fsmap learned FSMap version 27 2024-05-10T03:40:09.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.052+0000 7f0959cafb80 1 -- 172.21.15.45:0/1128742047 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x560331955b10 con 0x560331c08650 2024-05-10T03:40:09.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.052+0000 7f0922ffd700 1 -- 172.21.15.45:0/1128742047 <== mon.2 v2:172.21.15.106:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0934030020 con 0x560331c08650 2024-05-10T03:40:09.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.053+0000 7f0922ffd700 1 -- 172.21.15.45:0/1128742047 <== mon.2 v2:172.21.15.106:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f0934026020 con 0x560331c08650 2024-05-10T03:40:09.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.053+0000 7f0959cafb80 10 client.25352 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T03:40:09.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.053+0000 7f0959cafb80 10 client.25352 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-10T03:40:09.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.053+0000 7f0959cafb80 20 client.25352 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:09.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.053+0000 7f0959cafb80 1 --2- 172.21.15.45:0/1128742047 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x560331c1d7c0 0x560331c22ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.053+0000 7f0959cafb80 4 client.25352 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:40:09.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.053+0000 7f0959cafb80 1 -- 172.21.15.45:0/1128742047 --> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560331bd7730 con 0x560331c1d7c0 2024-05-10T03:40:09.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.053+0000 7f09427fc700 1 --2- 172.21.15.45:0/1128742047 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x560331c1d7c0 0x560331c22ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.053+0000 7f09427fc700 1 --2- 172.21.15.45:0/1128742047 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x560331c1d7c0 0x560331c22ac0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c1747f3a88cb0d56 server_cookie=76c2057c1ce5cbe7 in_seq=0 out_seq=0 2024-05-10T03:40:09.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.053+0000 7f0922ffd700 10 client.25352 ms_handle_connect on v2:172.21.15.154:6838/1506563336 2024-05-10T03:40:09.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.054+0000 7f0922ffd700 1 -- 172.21.15.45:0/1128742047 <== mds.2 v2:172.21.15.154:6838/1506563336 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560331bd7730 con 0x560331c1d7c0 2024-05-10T03:40:09.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.054+0000 7f0922ffd700 10 client.25352 handle_command_reply: tid=0 2024-05-10T03:40:09.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.054+0000 7f0959cafb80 1 client.25352 shutdown 2024-05-10T03:40:09.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.054+0000 7f0959cafb80 1 -- 172.21.15.45:0/1128742047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560331c08650 msgr2=0x560331c12700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.054+0000 7f0959cafb80 1 --2- 172.21.15.45:0/1128742047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560331c08650 0x560331c12700 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f09441007b0 tx=0x7f09340047c0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.054+0000 7f0959cafb80 1 -- 172.21.15.45:0/1128742047 shutdown_connections 2024-05-10T03:40:09.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.054+0000 7f0959cafb80 1 --2- 172.21.15.45:0/1128742047 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x560331c1d7c0 0x560331c22ac0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.054+0000 7f0959cafb80 1 --2- 172.21.15.45:0/1128742047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09e70 0x560331c19ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.055+0000 7f0922ffd700 0 client.25352 ms_handle_reset on v2:172.21.15.154:6838/1506563336 2024-05-10T03:40:09.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.055+0000 7f0959cafb80 1 --2- 172.21.15.45:0/1128742047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560331c08650 0x560331c12700 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.055+0000 7f0959cafb80 1 --2- 172.21.15.45:0/1128742047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560331c09520 0x560331c12c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.055+0000 7f0959cafb80 1 -- 172.21.15.45:0/1128742047 >> 172.21.15.45:0/1128742047 conn(0x560331b6aa10 msgr2=0x560331c02f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:09.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.055+0000 7f0959cafb80 1 -- 172.21.15.45:0/1128742047 shutdown_connections 2024-05-10T03:40:09.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.055+0000 7f0959cafb80 1 -- 172.21.15.45:0/1128742047 wait complete. 2024-05-10T03:40:09.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.055+0000 7f0959cafb80 20 client.25352 trim_cache size 0 max 16384 2024-05-10T03:40:09.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.074+0000 7f0959cafb80 1 Processor -- start 2024-05-10T03:40:09.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.074+0000 7f0959cafb80 1 -- start start 2024-05-10T03:40:09.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.074+0000 7f0959cafb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560331c08650 0x560331c09930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.074+0000 7f0959cafb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09520 0x560331bff130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.074+0000 7f0959cafb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560331c09e70 0x560331c11100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.074+0000 7f0959cafb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560331bffce0 con 0x560331c09520 2024-05-10T03:40:09.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.075+0000 7f0959cafb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x560331c1b8b0 con 0x560331c09e70 2024-05-10T03:40:09.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.075+0000 7f0959cafb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x560331bff670 con 0x560331c08650 2024-05-10T03:40:09.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.075+0000 7f09427fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09520 0x560331bff130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.075+0000 7f09427fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09520 0x560331bff130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52494/0 (socket says 172.21.15.45:52494) 2024-05-10T03:40:09.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.075+0000 7f09427fc700 1 -- 172.21.15.45:0/3789098552 learned_addr learned my addr 172.21.15.45:0/3789098552 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:09.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.075+0000 7f0942ffd700 1 --2- 172.21.15.45:0/3789098552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560331c08650 0x560331c09930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.075+0000 7f09437fe700 1 --2- 172.21.15.45:0/3789098552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560331c09e70 0x560331c11100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.075+0000 7f09427fc700 1 -- 172.21.15.45:0/3789098552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560331c08650 msgr2=0x560331c09930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:09.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.075+0000 7f09427fc700 1 --2- 172.21.15.45:0/3789098552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560331c08650 0x560331c09930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.075+0000 7f09427fc700 1 -- 172.21.15.45:0/3789098552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560331c09e70 msgr2=0x560331c11100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:09.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.075+0000 7f09427fc700 1 --2- 172.21.15.45:0/3789098552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560331c09e70 0x560331c11100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.075+0000 7f09427fc700 1 -- 172.21.15.45:0/3789098552 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560331aee510 con 0x560331c09520 2024-05-10T03:40:09.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.075+0000 7f09427fc700 1 --2- 172.21.15.45:0/3789098552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09520 0x560331bff130 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0938098370 tx=0x7f09380cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6316b80f44ede5d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:09.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.075+0000 7f092a7fc700 1 -- 172.21.15.45:0/3789098552 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09380caa50 con 0x560331c09520 2024-05-10T03:40:09.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.075+0000 7f092a7fc700 1 -- 172.21.15.45:0/3789098552 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f093809de50 con 0x560331c09520 2024-05-10T03:40:09.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.075+0000 7f092a7fc700 1 -- 172.21.15.45:0/3789098552 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09380a2010 con 0x560331c09520 2024-05-10T03:40:09.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.076+0000 7f0959cafb80 1 -- 172.21.15.45:0/3789098552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09520 msgr2=0x560331bff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.076+0000 7f0959cafb80 1 --2- 172.21.15.45:0/3789098552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09520 0x560331bff130 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0938098370 tx=0x7f09380cc040 comp rx=0 tx=0).stop 2024-05-10T03:40:09.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.076+0000 7f0959cafb80 1 -- 172.21.15.45:0/3789098552 shutdown_connections 2024-05-10T03:40:09.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.076+0000 7f0959cafb80 1 --2- 172.21.15.45:0/3789098552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560331c08650 0x560331c09930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.076+0000 7f0959cafb80 1 --2- 172.21.15.45:0/3789098552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560331c09e70 0x560331c11100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.076+0000 7f0959cafb80 1 --2- 172.21.15.45:0/3789098552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09520 0x560331bff130 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.076+0000 7f0959cafb80 1 -- 172.21.15.45:0/3789098552 >> 172.21.15.45:0/3789098552 conn(0x560331b6aa10 msgr2=0x560331c109f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:09.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.076+0000 7f0959cafb80 1 -- 172.21.15.45:0/3789098552 shutdown_connections 2024-05-10T03:40:09.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.076+0000 7f0959cafb80 1 -- 172.21.15.45:0/3789098552 wait complete. 2024-05-10T03:40:09.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.077+0000 7f0959cafb80 1 -- start start 2024-05-10T03:40:09.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.077+0000 7f0959cafb80 1 Processor -- start 2024-05-10T03:40:09.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.077+0000 7f0959cafb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560331c08650 0x560331c15b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.077+0000 7f0959cafb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09520 0x560331c16050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.077+0000 7f0959cafb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560331c09e70 0x560331c16f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.077+0000 7f0959cafb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560331c17470 con 0x560331c09520 2024-05-10T03:40:09.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.077+0000 7f0959cafb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x560331c175e0 con 0x560331c09e70 2024-05-10T03:40:09.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.077+0000 7f0959cafb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x560331c177a0 con 0x560331c08650 2024-05-10T03:40:09.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.077+0000 7f0959cafb80 10 client.0 _ll_register_callbacks cb 0x560331acdae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:09.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.078+0000 7f09427fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09520 0x560331c16050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.078+0000 7f09427fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09520 0x560331c16050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52498/0 (socket says 172.21.15.45:52498) 2024-05-10T03:40:09.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.078+0000 7f09427fc700 1 -- 172.21.15.45:0/1934958614 learned_addr learned my addr 172.21.15.45:0/1934958614 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:09.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.078+0000 7f0942ffd700 1 --2- 172.21.15.45:0/1934958614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560331c08650 0x560331c15b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.078+0000 7f09427fc700 1 -- 172.21.15.45:0/1934958614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560331c08650 msgr2=0x560331c15b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:09.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.078+0000 7f09427fc700 1 --2- 172.21.15.45:0/1934958614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560331c08650 0x560331c15b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.078+0000 7f09427fc700 1 -- 172.21.15.45:0/1934958614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560331c09e70 msgr2=0x560331c16f30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T03:40:09.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.078+0000 7f09427fc700 1 --2- 172.21.15.45:0/1934958614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560331c09e70 0x560331c16f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.078+0000 7f09427fc700 1 -- 172.21.15.45:0/1934958614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5603319a9360 con 0x560331c09520 2024-05-10T03:40:09.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.078+0000 7f09427fc700 1 --2- 172.21.15.45:0/1934958614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09520 0x560331c16050 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0938096520 tx=0x7f0938010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a52dd322324c2473 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:09.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.078+0000 7f0922ffd700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:09.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.078+0000 7f0922ffd700 1 -- 172.21.15.45:0/1934958614 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09380caa50 con 0x560331c09520 2024-05-10T03:40:09.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.078+0000 7f0922ffd700 1 -- 172.21.15.45:0/1934958614 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f09380109a0 con 0x560331c09520 2024-05-10T03:40:09.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.078+0000 7f0959cafb80 1 -- 172.21.15.45:0/1934958614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f09380a24a0 con 0x560331c09520 2024-05-10T03:40:09.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.079+0000 7f0922ffd700 1 -- 172.21.15.45:0/1934958614 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09380b2bd0 con 0x560331c09520 2024-05-10T03:40:09.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.079+0000 7f0959cafb80 10 client.15477 fetch_fsmap learned FSMap version 27 2024-05-10T03:40:09.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.079+0000 7f0959cafb80 1 -- 172.21.15.45:0/1934958614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5603319adc80 con 0x560331c09520 2024-05-10T03:40:09.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.079+0000 7f0922ffd700 1 -- 172.21.15.45:0/1934958614 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f09380a24a0 con 0x560331c09520 2024-05-10T03:40:09.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.079+0000 7f0922ffd700 1 -- 172.21.15.45:0/1934958614 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f0938018b40 con 0x560331c09520 2024-05-10T03:40:09.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.079+0000 7f0959cafb80 10 client.15477 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T03:40:09.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.079+0000 7f0959cafb80 10 client.15477 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-10T03:40:09.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.079+0000 7f0959cafb80 20 client.15477 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:09.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.079+0000 7f0959cafb80 1 --2- 172.21.15.45:0/1934958614 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x560331c76540 0x560331c74b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.079+0000 7f0959cafb80 4 client.15477 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T03:40:09.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.079+0000 7f0959cafb80 1 -- 172.21.15.45:0/1934958614 --> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560331b20e70 con 0x560331c76540 2024-05-10T03:40:09.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.079+0000 7f0942ffd700 1 --2- 172.21.15.45:0/1934958614 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x560331c76540 0x560331c74b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.080+0000 7f0922ffd700 10 client.15477 ms_handle_connect on v2:172.21.15.154:6838/1506563336 2024-05-10T03:40:09.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.080+0000 7f0942ffd700 1 --2- 172.21.15.45:0/1934958614 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x560331c76540 0x560331c74b70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=244070e5f466fcf8 server_cookie=7d51141836ba215f in_seq=0 out_seq=0 2024-05-10T03:40:09.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.080+0000 7f0922ffd700 1 -- 172.21.15.45:0/1934958614 <== mds.2 v2:172.21.15.154:6838/1506563336 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x560331b20e70 con 0x560331c76540 2024-05-10T03:40:09.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.080+0000 7f0922ffd700 10 client.15477 handle_command_reply: tid=0 2024-05-10T03:40:09.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.080+0000 7f0959cafb80 1 client.15477 shutdown 2024-05-10T03:40:09.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.080+0000 7f0959cafb80 1 -- 172.21.15.45:0/1934958614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09520 msgr2=0x560331c16050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.080+0000 7f0959cafb80 1 --2- 172.21.15.45:0/1934958614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09520 0x560331c16050 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0938096520 tx=0x7f0938010d70 comp rx=0 tx=0).stop 2024-05-10T03:40:09.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.080+0000 7f0959cafb80 1 -- 172.21.15.45:0/1934958614 shutdown_connections 2024-05-10T03:40:09.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.080+0000 7f0959cafb80 1 --2- 172.21.15.45:0/1934958614 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x560331c76540 0x560331c74b70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.080+0000 7f0959cafb80 1 --2- 172.21.15.45:0/1934958614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560331c08650 0x560331c15b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.080+0000 7f0959cafb80 1 --2- 172.21.15.45:0/1934958614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560331c09e70 0x560331c16f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.080+0000 7f0959cafb80 1 --2- 172.21.15.45:0/1934958614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560331c09520 0x560331c16050 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.080+0000 7f0922ffd700 0 client.15477 ms_handle_reset on v2:172.21.15.154:6838/1506563336 2024-05-10T03:40:09.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.080+0000 7f0959cafb80 1 -- 172.21.15.45:0/1934958614 >> 172.21.15.45:0/1934958614 conn(0x560331b6aa10 msgr2=0x560331c26ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:09.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.080+0000 7f0959cafb80 1 -- 172.21.15.45:0/1934958614 shutdown_connections 2024-05-10T03:40:09.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.080+0000 7f0959cafb80 1 -- 172.21.15.45:0/1934958614 wait complete. 2024-05-10T03:40:09.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.081+0000 7f0959cafb80 20 client.15477 trim_cache size 0 max 16384 2024-05-10T03:40:09.090 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:40:09.090 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "d2a0bafa-0e7d-11ef-bc98-c7b262605968", 2024-05-10T03:40:09.090 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 2, 2024-05-10T03:40:09.090 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 24547, 2024-05-10T03:40:09.090 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2024-05-10T03:40:09.091 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2024-05-10T03:40:09.091 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2024-05-10T03:40:09.091 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 72.115328333999997, 2024-05-10T03:40:09.091 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 27, 2024-05-10T03:40:09.091 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 88, 2024-05-10T03:40:09.091 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 86, 2024-05-10T03:40:09.091 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 104.003439622 2024-05-10T03:40:09.091 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:40:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.081+0000 7f094996b700 1 -- 172.21.15.45:0/2745075276 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f092c0a12e0 msgr2=0x7f092c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.081+0000 7f094996b700 1 --2- 172.21.15.45:0/2745075276 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f092c0a12e0 0x7f092c0a37f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0944101ae0 tx=0x7f0934009260 comp rx=0 tx=0).stop 2024-05-10T03:40:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.081+0000 7f094996b700 1 -- 172.21.15.45:0/2745075276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0944101be0 msgr2=0x7f094419cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.081+0000 7f094996b700 1 --2- 172.21.15.45:0/2745075276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0944101be0 0x7f094419cdf0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f093800e9a0 tx=0x7f093800ed60 comp rx=0 tx=0).stop 2024-05-10T03:40:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.081+0000 7f094996b700 1 -- 172.21.15.45:0/2745075276 shutdown_connections 2024-05-10T03:40:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.081+0000 7f094996b700 1 --2- 172.21.15.45:0/2745075276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0944102580 0x7f094419f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.081+0000 7f094996b700 1 --2- 172.21.15.45:0/2745075276 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f092c0a12e0 0x7f092c0a37f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.081+0000 7f094996b700 1 --2- 172.21.15.45:0/2745075276 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0944100ac0 0x7f0944068e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.081+0000 7f094996b700 1 --2- 172.21.15.45:0/2745075276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0944101be0 0x7f094419cdf0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.081+0000 7f094996b700 1 -- 172.21.15.45:0/2745075276 >> 172.21.15.45:0/2745075276 conn(0x7f09440fc0d0 msgr2=0x7f0944104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:09.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.081+0000 7f094996b700 1 -- 172.21.15.45:0/2745075276 shutdown_connections 2024-05-10T03:40:09.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.081+0000 7f094996b700 1 -- 172.21.15.45:0/2745075276 wait complete. 2024-05-10T03:40:09.099 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-05-10T03:40:09.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.247+0000 7f1de7ce2700 1 -- 172.21.15.45:0/638797112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1de0100ac0 msgr2=0x7f1de0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.247+0000 7f1de7ce2700 1 --2- 172.21.15.45:0/638797112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1de0100ac0 0x7f1de0100ed0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc009990 tx=0x7f1ddc009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.247+0000 7f1de7ce2700 1 -- 172.21.15.45:0/638797112 shutdown_connections 2024-05-10T03:40:09.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.247+0000 7f1de7ce2700 1 --2- 172.21.15.45:0/638797112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1de0102580 0x7f1de0108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.247+0000 7f1de7ce2700 1 --2- 172.21.15.45:0/638797112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1de0100ac0 0x7f1de0100ed0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.247+0000 7f1de7ce2700 1 --2- 172.21.15.45:0/638797112 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1de0101be0 0x7f1de0101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.247+0000 7f1de7ce2700 1 -- 172.21.15.45:0/638797112 >> 172.21.15.45:0/638797112 conn(0x7f1de00fc0d0 msgr2=0x7f1de00fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:09.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.247+0000 7f1de7ce2700 1 -- 172.21.15.45:0/638797112 shutdown_connections 2024-05-10T03:40:09.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.247+0000 7f1de7ce2700 1 -- 172.21.15.45:0/638797112 wait complete. 2024-05-10T03:40:09.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.248+0000 7f1de7ce2700 1 Processor -- start 2024-05-10T03:40:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.248+0000 7f1de7ce2700 1 -- start start 2024-05-10T03:40:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.248+0000 7f1de7ce2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1de0100ac0 0x7f1de0197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.248+0000 7f1de7ce2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1de0101be0 0x7f1de01984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.248+0000 7f1de7ce2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1de0102580 0x7f1de019f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.248+0000 7f1de7ce2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de019fa80 con 0x7f1de0100ac0 2024-05-10T03:40:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.248+0000 7f1de7ce2700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de019fbf0 con 0x7f1de0102580 2024-05-10T03:40:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.248+0000 7f1de7ce2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de019fdb0 con 0x7f1de0101be0 2024-05-10T03:40:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.248+0000 7f1de5a7e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1de0100ac0 0x7f1de0197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.248+0000 7f1de5a7e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1de0100ac0 0x7f1de0197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52508/0 (socket says 172.21.15.45:52508) 2024-05-10T03:40:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.248+0000 7f1de5a7e700 1 -- 172.21.15.45:0/3880819792 learned_addr learned my addr 172.21.15.45:0/3880819792 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.248+0000 7f1de627f700 1 --2- 172.21.15.45:0/3880819792 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1de0102580 0x7f1de019f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.248+0000 7f1de527d700 1 --2- 172.21.15.45:0/3880819792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1de0101be0 0x7f1de01984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.249+0000 7f1de5a7e700 1 -- 172.21.15.45:0/3880819792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1de0101be0 msgr2=0x7f1de01984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.249+0000 7f1de5a7e700 1 --2- 172.21.15.45:0/3880819792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1de0101be0 0x7f1de01984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.249+0000 7f1de5a7e700 1 -- 172.21.15.45:0/3880819792 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1de0102580 msgr2=0x7f1de019f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.249+0000 7f1de5a7e700 1 --2- 172.21.15.45:0/3880819792 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1de0102580 0x7f1de019f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.249+0000 7f1de5a7e700 1 -- 172.21.15.45:0/3880819792 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc0095f0 con 0x7f1de0100ac0 2024-05-10T03:40:09.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.249+0000 7f1de5a7e700 1 --2- 172.21.15.45:0/3880819792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1de0100ac0 0x7f1de0197fa0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0098e0 tx=0x7f1ddc005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:09.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.249+0000 7f1dd6ffd700 1 -- 172.21.15.45:0/3880819792 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc01d070 con 0x7f1de0100ac0 2024-05-10T03:40:09.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.249+0000 7f1dd6ffd700 1 -- 172.21.15.45:0/3880819792 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1ddc00be70 con 0x7f1de0100ac0 2024-05-10T03:40:09.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.249+0000 7f1de7ce2700 1 -- 172.21.15.45:0/3880819792 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de01a0030 con 0x7f1de0100ac0 2024-05-10T03:40:09.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.249+0000 7f1dd6ffd700 1 -- 172.21.15.45:0/3880819792 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc0173f0 con 0x7f1de0100ac0 2024-05-10T03:40:09.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.249+0000 7f1de7ce2700 1 -- 172.21.15.45:0/3880819792 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de01a04b0 con 0x7f1de0100ac0 2024-05-10T03:40:09.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.251+0000 7f1dd6ffd700 1 -- 172.21.15.45:0/3880819792 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f1ddc021410 con 0x7f1de0100ac0 2024-05-10T03:40:09.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.252+0000 7f1dd6ffd700 1 --2- 172.21.15.45:0/3880819792 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1dcc0a12e0 0x7f1dcc0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.252+0000 7f1dd6ffd700 1 -- 172.21.15.45:0/3880819792 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f1ddc0cde50 con 0x7f1de0100ac0 2024-05-10T03:40:09.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.252+0000 7f1de527d700 1 --2- 172.21.15.45:0/3880819792 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1dcc0a12e0 0x7f1dcc0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.253+0000 7f1de527d700 1 --2- 172.21.15.45:0/3880819792 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1dcc0a12e0 0x7f1dcc0a37f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1de0199040 tx=0x7f1dd0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:09.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.253+0000 7f1df8026b80 1 Processor -- start 2024-05-10T03:40:09.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.253+0000 7f1df8026b80 1 -- start start 2024-05-10T03:40:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.254+0000 7f1df8026b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ee2fa07650 0x55ee2fa07aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.254+0000 7f1df8026b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee2fa08520 0x55ee2fa08930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.254+0000 7f1df8026b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa08e70 0x55ee2fa0f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.254+0000 7f1df8026b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee2f92e100 con 0x55ee2fa08e70 2024-05-10T03:40:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.254+0000 7f1df8026b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee2f92bac0 con 0x55ee2fa07650 2024-05-10T03:40:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.254+0000 7f1df8026b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee2f9273b0 con 0x55ee2fa08520 2024-05-10T03:40:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.254+0000 7f1de627f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa08e70 0x55ee2fa0f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.254+0000 7f1de627f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa08e70 0x55ee2fa0f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52522/0 (socket says 172.21.15.45:52522) 2024-05-10T03:40:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.254+0000 7f1de627f700 1 -- 172.21.15.45:0/836385831 learned_addr learned my addr 172.21.15.45:0/836385831 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.254+0000 7f1de527d700 1 --2- 172.21.15.45:0/836385831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee2fa08520 0x55ee2fa08930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.254+0000 7f1de5a7e700 1 --2- 172.21.15.45:0/836385831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ee2fa07650 0x55ee2fa07aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.254+0000 7f1de627f700 1 -- 172.21.15.45:0/836385831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee2fa08520 msgr2=0x55ee2fa08930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.254+0000 7f1de627f700 1 --2- 172.21.15.45:0/836385831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee2fa08520 0x55ee2fa08930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.254+0000 7f1de627f700 1 -- 172.21.15.45:0/836385831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ee2fa07650 msgr2=0x55ee2fa07aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:09.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.254+0000 7f1de627f700 1 --2- 172.21.15.45:0/836385831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ee2fa07650 0x55ee2fa07aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.254+0000 7f1de627f700 1 -- 172.21.15.45:0/836385831 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee2f7a8360 con 0x55ee2fa08e70 2024-05-10T03:40:09.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.254+0000 7f1de5a7e700 1 --2- 172.21.15.45:0/836385831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ee2fa07650 0x55ee2fa07aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:09.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.254+0000 7f1de627f700 1 --2- 172.21.15.45:0/836385831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa08e70 0x55ee2fa0f770 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1dd80115d0 tx=0x7f1dd8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39cea74df55a0524 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:09.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.255+0000 7f1dcbfff700 1 -- 172.21.15.45:0/836385831 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd800e040 con 0x55ee2fa08e70 2024-05-10T03:40:09.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.255+0000 7f1dcbfff700 1 -- 172.21.15.45:0/836385831 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1dd800f040 con 0x55ee2fa08e70 2024-05-10T03:40:09.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.255+0000 7f1dcbfff700 1 -- 172.21.15.45:0/836385831 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd80047d0 con 0x55ee2fa08e70 2024-05-10T03:40:09.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.256+0000 7f1df8026b80 1 -- 172.21.15.45:0/836385831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa08e70 msgr2=0x55ee2fa0f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.256+0000 7f1df8026b80 1 --2- 172.21.15.45:0/836385831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa08e70 0x55ee2fa0f770 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1dd80115d0 tx=0x7f1dd8009920 comp rx=0 tx=0).stop 2024-05-10T03:40:09.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.256+0000 7f1df8026b80 1 -- 172.21.15.45:0/836385831 shutdown_connections 2024-05-10T03:40:09.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.256+0000 7f1df8026b80 1 --2- 172.21.15.45:0/836385831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa08e70 0x55ee2fa0f770 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.256+0000 7f1df8026b80 1 --2- 172.21.15.45:0/836385831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ee2fa07650 0x55ee2fa07aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.256+0000 7f1df8026b80 1 --2- 172.21.15.45:0/836385831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee2fa08520 0x55ee2fa08930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.256+0000 7f1df8026b80 1 -- 172.21.15.45:0/836385831 >> 172.21.15.45:0/836385831 conn(0x55ee2f969a10 msgr2=0x55ee2fa01f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.256+0000 7f1df8026b80 1 -- 172.21.15.45:0/836385831 shutdown_connections 2024-05-10T03:40:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.256+0000 7f1df8026b80 1 -- 172.21.15.45:0/836385831 wait complete. 2024-05-10T03:40:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.256+0000 7f1df8026b80 1 -- start start 2024-05-10T03:40:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.256+0000 7f1df8026b80 1 Processor -- start 2024-05-10T03:40:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.257+0000 7f1df8026b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee2fa07650 0x55ee2fa11600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.257+0000 7f1df8026b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa08520 0x55ee2fa11b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.257+0000 7f1df8026b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ee2fa08e70 0x55ee2fa18aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.257+0000 7f1df8026b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee2f8c3510 con 0x55ee2fa08520 2024-05-10T03:40:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.257+0000 7f1df8026b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee2f8c31b0 con 0x55ee2fa08e70 2024-05-10T03:40:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.257+0000 7f1df8026b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee2f7aa650 con 0x55ee2fa07650 2024-05-10T03:40:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.257+0000 7f1df8026b80 10 client.0 _ll_register_callbacks cb 0x55ee2f8ccae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.257+0000 7f1de527d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa08520 0x55ee2fa11b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.257+0000 7f1de527d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa08520 0x55ee2fa11b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52536/0 (socket says 172.21.15.45:52536) 2024-05-10T03:40:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.257+0000 7f1de527d700 1 -- 172.21.15.45:0/4247799492 learned_addr learned my addr 172.21.15.45:0/4247799492 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.257+0000 7f1de5a7e700 1 --2- 172.21.15.45:0/4247799492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee2fa07650 0x55ee2fa11600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.257+0000 7f1de527d700 1 -- 172.21.15.45:0/4247799492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee2fa07650 msgr2=0x55ee2fa11600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.257+0000 7f1de527d700 1 --2- 172.21.15.45:0/4247799492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee2fa07650 0x55ee2fa11600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.257+0000 7f1de527d700 1 -- 172.21.15.45:0/4247799492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ee2fa08e70 msgr2=0x55ee2fa18aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.257+0000 7f1de627f700 1 --2- 172.21.15.45:0/4247799492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ee2fa08e70 0x55ee2fa18aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.257+0000 7f1de527d700 1 --2- 172.21.15.45:0/4247799492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ee2fa08e70 0x55ee2fa18aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.257+0000 7f1de527d700 1 -- 172.21.15.45:0/4247799492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd80112b0 con 0x55ee2fa08520 2024-05-10T03:40:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.257+0000 7f1de627f700 1 --2- 172.21.15.45:0/4247799492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ee2fa08e70 0x55ee2fa18aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:40:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.257+0000 7f1de527d700 1 --2- 172.21.15.45:0/4247799492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa08520 0x55ee2fa11b40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1dd001e870 tx=0x7f1dd00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f26688630971e065 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.257+0000 7f1dc97fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.258+0000 7f1dc97fa700 1 -- 172.21.15.45:0/4247799492 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0004020 con 0x55ee2fa08520 2024-05-10T03:40:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.258+0000 7f1dc97fa700 1 -- 172.21.15.45:0/4247799492 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f1dd0004180 con 0x55ee2fa08520 2024-05-10T03:40:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.258+0000 7f1df8026b80 1 -- 172.21.15.45:0/4247799492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee2f880220 con 0x55ee2fa08520 2024-05-10T03:40:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.258+0000 7f1dc97fa700 1 -- 172.21.15.45:0/4247799492 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1dd0004340 con 0x55ee2fa08520 2024-05-10T03:40:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.258+0000 7f1df8026b80 10 client.15489 fetch_fsmap learned FSMap version 27 2024-05-10T03:40:09.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.258+0000 7f1df8026b80 1 -- 172.21.15.45:0/4247799492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55ee2f754b10 con 0x55ee2fa08520 2024-05-10T03:40:09.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.258+0000 7f1dc97fa700 1 -- 172.21.15.45:0/4247799492 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55ee2f880220 con 0x55ee2fa08520 2024-05-10T03:40:09.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.258+0000 7f1dc97fa700 1 -- 172.21.15.45:0/4247799492 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1dd0003a50 con 0x55ee2fa08520 2024-05-10T03:40:09.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.258+0000 7f1df8026b80 10 client.15489 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T03:40:09.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.258+0000 7f1df8026b80 10 client.15489 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-10T03:40:09.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.258+0000 7f1df8026b80 20 client.15489 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:09.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.258+0000 7f1df8026b80 1 --2- 172.21.15.45:0/4247799492 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55ee2fa1bc20 0x55ee2fa21ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.259+0000 7f1df8026b80 4 client.15489 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:40:09.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.259+0000 7f1df8026b80 1 -- 172.21.15.45:0/4247799492 --> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee2f9d6730 con 0x55ee2fa1bc20 2024-05-10T03:40:09.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.259+0000 7f1de5a7e700 1 --2- 172.21.15.45:0/4247799492 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55ee2fa1bc20 0x55ee2fa21ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.259+0000 7f1dc97fa700 10 client.15489 ms_handle_connect on v2:172.21.15.106:6836/3047487403 2024-05-10T03:40:09.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.259+0000 7f1de5a7e700 1 --2- 172.21.15.45:0/4247799492 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55ee2fa1bc20 0x55ee2fa21ab0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dd25917a265171f server_cookie=bf81413e7fc2a931 in_seq=0 out_seq=0 2024-05-10T03:40:09.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.260+0000 7f1dc97fa700 1 -- 172.21.15.45:0/4247799492 <== mds.1 v2:172.21.15.106:6836/3047487403 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ee2f9d6730 con 0x55ee2fa1bc20 2024-05-10T03:40:09.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.260+0000 7f1dc97fa700 10 client.15489 handle_command_reply: tid=0 2024-05-10T03:40:09.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.260+0000 7f1df8026b80 1 client.15489 shutdown 2024-05-10T03:40:09.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.260+0000 7f1df8026b80 1 -- 172.21.15.45:0/4247799492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa08520 msgr2=0x55ee2fa11b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.260+0000 7f1df8026b80 1 --2- 172.21.15.45:0/4247799492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa08520 0x55ee2fa11b40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1dd001e870 tx=0x7f1dd00047c0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.260+0000 7f1df8026b80 1 -- 172.21.15.45:0/4247799492 shutdown_connections 2024-05-10T03:40:09.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.260+0000 7f1df8026b80 1 --2- 172.21.15.45:0/4247799492 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55ee2fa1bc20 0x55ee2fa21ab0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.260+0000 7f1df8026b80 1 --2- 172.21.15.45:0/4247799492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee2fa07650 0x55ee2fa11600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.260+0000 7f1df8026b80 1 --2- 172.21.15.45:0/4247799492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ee2fa08e70 0x55ee2fa18aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.260+0000 7f1df8026b80 1 --2- 172.21.15.45:0/4247799492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa08520 0x55ee2fa11b40 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.260+0000 7f1dc97fa700 0 client.15489 ms_handle_reset on v2:172.21.15.106:6836/3047487403 2024-05-10T03:40:09.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.260+0000 7f1df8026b80 1 -- 172.21.15.45:0/4247799492 >> 172.21.15.45:0/4247799492 conn(0x55ee2f969a10 msgr2=0x55ee2fa01f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:09.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.260+0000 7f1df8026b80 1 -- 172.21.15.45:0/4247799492 shutdown_connections 2024-05-10T03:40:09.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.260+0000 7f1df8026b80 1 -- 172.21.15.45:0/4247799492 wait complete. 2024-05-10T03:40:09.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.261+0000 7f1df8026b80 20 client.15489 trim_cache size 0 max 16384 2024-05-10T03:40:09.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.280+0000 7f1df8026b80 1 Processor -- start 2024-05-10T03:40:09.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.280+0000 7f1df8026b80 1 -- start start 2024-05-10T03:40:09.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.280+0000 7f1df8026b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa07650 0x55ee2fa08930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.280+0000 7f1df8026b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ee2fa08520 0x55ee2fa16a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.280+0000 7f1df8026b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee2fa08e70 0x55ee2fa16f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.280+0000 7f1df8026b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee2f880220 con 0x55ee2fa07650 2024-05-10T03:40:09.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.280+0000 7f1df8026b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee2f8e52b0 con 0x55ee2fa08520 2024-05-10T03:40:09.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.280+0000 7f1df8026b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee2f920150 con 0x55ee2fa08e70 2024-05-10T03:40:09.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:09 smithi045 ceph-mon[42520]: pgmap v279: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:40:09.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:09 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2594320617' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:40:09.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:09 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3659869317' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:40:09.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.280+0000 7f1de5a7e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa07650 0x55ee2fa08930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.280+0000 7f1de5a7e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa07650 0x55ee2fa08930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52546/0 (socket says 172.21.15.45:52546) 2024-05-10T03:40:09.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.280+0000 7f1de5a7e700 1 -- 172.21.15.45:0/1562757984 learned_addr learned my addr 172.21.15.45:0/1562757984 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:09.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.281+0000 7f1de627f700 1 --2- 172.21.15.45:0/1562757984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee2fa08e70 0x55ee2fa16f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.281+0000 7f1de527d700 1 --2- 172.21.15.45:0/1562757984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ee2fa08520 0x55ee2fa16a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.281+0000 7f1de5a7e700 1 -- 172.21.15.45:0/1562757984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee2fa08e70 msgr2=0x55ee2fa16f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:09.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.281+0000 7f1de5a7e700 1 --2- 172.21.15.45:0/1562757984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee2fa08e70 0x55ee2fa16f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.281+0000 7f1de5a7e700 1 -- 172.21.15.45:0/1562757984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ee2fa08520 msgr2=0x55ee2fa16a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:09.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.281+0000 7f1de5a7e700 1 --2- 172.21.15.45:0/1562757984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ee2fa08520 0x55ee2fa16a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.281+0000 7f1de5a7e700 1 -- 172.21.15.45:0/1562757984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee2f8ed510 con 0x55ee2fa07650 2024-05-10T03:40:09.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.281+0000 7f1de527d700 1 --2- 172.21.15.45:0/1562757984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ee2fa08520 0x55ee2fa16a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:40:09.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.281+0000 7f1de5a7e700 1 --2- 172.21.15.45:0/1562757984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa07650 0x55ee2fa08930 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc09abc0 tx=0x7f1ddc021a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65cacbb632deb544 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:09.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.281+0000 7f1dd4ff9700 1 -- 172.21.15.45:0/1562757984 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc09aec0 con 0x55ee2fa07650 2024-05-10T03:40:09.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.281+0000 7f1dd4ff9700 1 -- 172.21.15.45:0/1562757984 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1ddc09ecf0 con 0x55ee2fa07650 2024-05-10T03:40:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.281+0000 7f1dd4ff9700 1 -- 172.21.15.45:0/1562757984 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc09b380 con 0x55ee2fa07650 2024-05-10T03:40:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.282+0000 7f1df8026b80 1 -- 172.21.15.45:0/1562757984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa07650 msgr2=0x55ee2fa08930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.282+0000 7f1df8026b80 1 --2- 172.21.15.45:0/1562757984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa07650 0x55ee2fa08930 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc09abc0 tx=0x7f1ddc021a60 comp rx=0 tx=0).stop 2024-05-10T03:40:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.282+0000 7f1df8026b80 1 -- 172.21.15.45:0/1562757984 shutdown_connections 2024-05-10T03:40:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.282+0000 7f1df8026b80 1 --2- 172.21.15.45:0/1562757984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee2fa08e70 0x55ee2fa16f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.282+0000 7f1df8026b80 1 --2- 172.21.15.45:0/1562757984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa07650 0x55ee2fa08930 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.282+0000 7f1df8026b80 1 --2- 172.21.15.45:0/1562757984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ee2fa08520 0x55ee2fa16a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.282+0000 7f1df8026b80 1 -- 172.21.15.45:0/1562757984 >> 172.21.15.45:0/1562757984 conn(0x55ee2f969a10 msgr2=0x55ee2fa0b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.282+0000 7f1df8026b80 1 -- 172.21.15.45:0/1562757984 shutdown_connections 2024-05-10T03:40:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.282+0000 7f1df8026b80 1 -- 172.21.15.45:0/1562757984 wait complete. 2024-05-10T03:40:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.282+0000 7f1df8026b80 1 -- start start 2024-05-10T03:40:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.283+0000 7f1df8026b80 1 Processor -- start 2024-05-10T03:40:09.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.283+0000 7f1df8026b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee2fa07650 0x55ee2fa145d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.283+0000 7f1df8026b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ee2fa08520 0x55ee2fa14b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.283+0000 7f1df8026b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa08e70 0x55ee2fa159f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.283+0000 7f1df8026b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee2fa15f30 con 0x55ee2fa08e70 2024-05-10T03:40:09.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.283+0000 7f1df8026b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee2fa160a0 con 0x55ee2fa08520 2024-05-10T03:40:09.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.283+0000 7f1df8026b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee2fa16260 con 0x55ee2fa07650 2024-05-10T03:40:09.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.283+0000 7f1df8026b80 10 client.0 _ll_register_callbacks cb 0x55ee2f8ccae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:09.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.283+0000 7f1de627f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa08e70 0x55ee2fa159f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.283+0000 7f1de627f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa08e70 0x55ee2fa159f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52552/0 (socket says 172.21.15.45:52552) 2024-05-10T03:40:09.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.283+0000 7f1de627f700 1 -- 172.21.15.45:0/1506507104 learned_addr learned my addr 172.21.15.45:0/1506507104 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:09.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.283+0000 7f1de527d700 1 --2- 172.21.15.45:0/1506507104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ee2fa08520 0x55ee2fa14b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.284+0000 7f1de5a7e700 1 --2- 172.21.15.45:0/1506507104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee2fa07650 0x55ee2fa145d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.284+0000 7f1de627f700 1 -- 172.21.15.45:0/1506507104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee2fa07650 msgr2=0x55ee2fa145d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:09.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.284+0000 7f1de627f700 1 --2- 172.21.15.45:0/1506507104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee2fa07650 0x55ee2fa145d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.284+0000 7f1de627f700 1 -- 172.21.15.45:0/1506507104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ee2fa08520 msgr2=0x55ee2fa14b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:09.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.284+0000 7f1de627f700 1 --2- 172.21.15.45:0/1506507104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ee2fa08520 0x55ee2fa14b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.284+0000 7f1de627f700 1 -- 172.21.15.45:0/1506507104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de01a04b0 con 0x55ee2fa08e70 2024-05-10T03:40:09.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.284+0000 7f1de627f700 1 --2- 172.21.15.45:0/1506507104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa08e70 0x55ee2fa159f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8011c70 tx=0x7f1dd8009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d510043ec9ad6c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:09.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.284+0000 7f1dc97fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:09.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.284+0000 7f1dc97fa700 1 -- 172.21.15.45:0/1506507104 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd800e040 con 0x55ee2fa08e70 2024-05-10T03:40:09.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.284+0000 7f1dc97fa700 1 -- 172.21.15.45:0/1506507104 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f1dd8007710 con 0x55ee2fa08e70 2024-05-10T03:40:09.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.284+0000 7f1df8026b80 1 -- 172.21.15.45:0/1506507104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee2fa03b70 con 0x55ee2fa08e70 2024-05-10T03:40:09.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.284+0000 7f1dc97fa700 1 -- 172.21.15.45:0/1506507104 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1dd8006000 con 0x55ee2fa08e70 2024-05-10T03:40:09.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.284+0000 7f1df8026b80 10 client.15495 fetch_fsmap learned FSMap version 27 2024-05-10T03:40:09.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.284+0000 7f1df8026b80 1 -- 172.21.15.45:0/1506507104 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55ee2f7acc80 con 0x55ee2fa08e70 2024-05-10T03:40:09.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.285+0000 7f1dc97fa700 1 -- 172.21.15.45:0/1506507104 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55ee2fa03b70 con 0x55ee2fa08e70 2024-05-10T03:40:09.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.285+0000 7f1dc97fa700 1 -- 172.21.15.45:0/1506507104 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1dd8028c60 con 0x55ee2fa08e70 2024-05-10T03:40:09.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.285+0000 7f1df8026b80 10 client.15495 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T03:40:09.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.285+0000 7f1df8026b80 10 client.15495 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-10T03:40:09.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.285+0000 7f1df8026b80 20 client.15495 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:09.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.285+0000 7f1df8026b80 1 --2- 172.21.15.45:0/1506507104 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55ee2fa75640 0x55ee2fa73ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.285+0000 7f1df8026b80 4 client.15495 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T03:40:09.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.285+0000 7f1df8026b80 1 -- 172.21.15.45:0/1506507104 --> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f1dd800f040 con 0x55ee2fa75640 2024-05-10T03:40:09.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.285+0000 7f1de5a7e700 1 --2- 172.21.15.45:0/1506507104 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55ee2fa75640 0x55ee2fa73ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.286+0000 7f1dc97fa700 10 client.15495 ms_handle_connect on v2:172.21.15.106:6836/3047487403 2024-05-10T03:40:09.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.286+0000 7f1de5a7e700 1 --2- 172.21.15.45:0/1506507104 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55ee2fa75640 0x55ee2fa73ba0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8287152e5ae4faba server_cookie=93a63db23fa29018 in_seq=0 out_seq=0 2024-05-10T03:40:09.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.286+0000 7f1dc97fa700 1 -- 172.21.15.45:0/1506507104 <== mds.1 v2:172.21.15.106:6836/3047487403 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x7f1dd800f040 con 0x55ee2fa75640 2024-05-10T03:40:09.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.286+0000 7f1dc97fa700 10 client.15495 handle_command_reply: tid=0 2024-05-10T03:40:09.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.286+0000 7f1df8026b80 1 client.15495 shutdown 2024-05-10T03:40:09.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.286+0000 7f1df8026b80 1 -- 172.21.15.45:0/1506507104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa08e70 msgr2=0x55ee2fa159f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.286+0000 7f1df8026b80 1 --2- 172.21.15.45:0/1506507104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa08e70 0x55ee2fa159f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8011c70 tx=0x7f1dd8009510 comp rx=0 tx=0).stop 2024-05-10T03:40:09.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.286+0000 7f1df8026b80 1 -- 172.21.15.45:0/1506507104 shutdown_connections 2024-05-10T03:40:09.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.286+0000 7f1df8026b80 1 --2- 172.21.15.45:0/1506507104 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55ee2fa75640 0x55ee2fa73ba0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.286+0000 7f1df8026b80 1 --2- 172.21.15.45:0/1506507104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee2fa07650 0x55ee2fa145d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.286+0000 7f1df8026b80 1 --2- 172.21.15.45:0/1506507104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ee2fa08e70 0x55ee2fa159f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.286+0000 7f1df8026b80 1 --2- 172.21.15.45:0/1506507104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ee2fa08520 0x55ee2fa14b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.286+0000 7f1dc97fa700 0 client.15495 ms_handle_reset on v2:172.21.15.106:6836/3047487403 2024-05-10T03:40:09.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.286+0000 7f1df8026b80 1 -- 172.21.15.45:0/1506507104 >> 172.21.15.45:0/1506507104 conn(0x55ee2f969a10 msgr2=0x55ee2fa0f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:09.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.286+0000 7f1df8026b80 1 -- 172.21.15.45:0/1506507104 shutdown_connections 2024-05-10T03:40:09.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.286+0000 7f1df8026b80 1 -- 172.21.15.45:0/1506507104 wait complete. 2024-05-10T03:40:09.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.286+0000 7f1df8026b80 20 client.15495 trim_cache size 0 max 16384 2024-05-10T03:40:09.297 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:40:09.297 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "d2a0bafa-0e7d-11ef-bc98-c7b262605968", 2024-05-10T03:40:09.297 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 1, 2024-05-10T03:40:09.297 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 24548, 2024-05-10T03:40:09.297 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2024-05-10T03:40:09.297 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2024-05-10T03:40:09.297 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2024-05-10T03:40:09.297 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 73.342025227999997, 2024-05-10T03:40:09.297 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 27, 2024-05-10T03:40:09.297 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 88, 2024-05-10T03:40:09.297 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 86, 2024-05-10T03:40:09.297 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 106.033932415 2024-05-10T03:40:09.298 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:40:09.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.287+0000 7f1de7ce2700 1 -- 172.21.15.45:0/3880819792 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1dcc0a12e0 msgr2=0x7f1dcc0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.287+0000 7f1de7ce2700 1 --2- 172.21.15.45:0/3880819792 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1dcc0a12e0 0x7f1dcc0a37f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1de0199040 tx=0x7f1dd0009260 comp rx=0 tx=0).stop 2024-05-10T03:40:09.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.287+0000 7f1de7ce2700 1 -- 172.21.15.45:0/3880819792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1de0100ac0 msgr2=0x7f1de0197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.287+0000 7f1de7ce2700 1 --2- 172.21.15.45:0/3880819792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1de0100ac0 0x7f1de0197fa0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0098e0 tx=0x7f1ddc005b00 comp rx=0 tx=0).stop 2024-05-10T03:40:09.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.287+0000 7f1de7ce2700 1 -- 172.21.15.45:0/3880819792 shutdown_connections 2024-05-10T03:40:09.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.287+0000 7f1de7ce2700 1 --2- 172.21.15.45:0/3880819792 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1dcc0a12e0 0x7f1dcc0a37f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.287+0000 7f1de7ce2700 1 --2- 172.21.15.45:0/3880819792 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1de0102580 0x7f1de019f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.287+0000 7f1de7ce2700 1 --2- 172.21.15.45:0/3880819792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1de0100ac0 0x7f1de0197fa0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.287+0000 7f1de7ce2700 1 --2- 172.21.15.45:0/3880819792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1de0101be0 0x7f1de01984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.287+0000 7f1de7ce2700 1 -- 172.21.15.45:0/3880819792 >> 172.21.15.45:0/3880819792 conn(0x7f1de00fc0d0 msgr2=0x7f1de00fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:09.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.287+0000 7f1de7ce2700 1 -- 172.21.15.45:0/3880819792 shutdown_connections 2024-05-10T03:40:09.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.287+0000 7f1de7ce2700 1 -- 172.21.15.45:0/3880819792 wait complete. 2024-05-10T03:40:09.305 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-10T03:40:09.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:09 smithi106 ceph-mon[46996]: pgmap v279: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:40:09.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:09 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2594320617' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:40:09.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:09 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3659869317' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:40:09.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.453+0000 7fc8980c0700 1 -- 172.21.15.45:0/3155394128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc890102580 msgr2=0x7fc890108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.453+0000 7fc8980c0700 1 --2- 172.21.15.45:0/3155394128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc890102580 0x7fc890108e30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc88800b0a0 tx=0x7fc88800b3b0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.453+0000 7fc8980c0700 1 -- 172.21.15.45:0/3155394128 shutdown_connections 2024-05-10T03:40:09.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.453+0000 7fc8980c0700 1 --2- 172.21.15.45:0/3155394128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc890100ac0 0x7fc890100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.453+0000 7fc8980c0700 1 --2- 172.21.15.45:0/3155394128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc890102580 0x7fc890108e30 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.453+0000 7fc8980c0700 1 --2- 172.21.15.45:0/3155394128 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc890101be0 0x7fc890101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.453+0000 7fc8980c0700 1 -- 172.21.15.45:0/3155394128 >> 172.21.15.45:0/3155394128 conn(0x7fc8900fc0d0 msgr2=0x7fc8900fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:09.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.453+0000 7fc8980c0700 1 -- 172.21.15.45:0/3155394128 shutdown_connections 2024-05-10T03:40:09.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.453+0000 7fc8980c0700 1 -- 172.21.15.45:0/3155394128 wait complete. 2024-05-10T03:40:09.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.454+0000 7fc8980c0700 1 Processor -- start 2024-05-10T03:40:09.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.454+0000 7fc8980c0700 1 -- start start 2024-05-10T03:40:09.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.454+0000 7fc8980c0700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc890100ac0 0x7fc890196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.454+0000 7fc8980c0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc890101be0 0x7fc8901974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.454+0000 7fc8980c0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc890102580 0x7fc89019e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.454+0000 7fc8980c0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89019ea40 con 0x7fc890102580 2024-05-10T03:40:09.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.454+0000 7fc8980c0700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89019ebb0 con 0x7fc890100ac0 2024-05-10T03:40:09.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.454+0000 7fc8980c0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89019ed70 con 0x7fc890101be0 2024-05-10T03:40:09.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.454+0000 7fc89665d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc890102580 0x7fc89019e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.454+0000 7fc89665d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc890102580 0x7fc89019e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52556/0 (socket says 172.21.15.45:52556) 2024-05-10T03:40:09.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.454+0000 7fc89665d700 1 -- 172.21.15.45:0/3018666404 learned_addr learned my addr 172.21.15.45:0/3018666404 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:09.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.454+0000 7fc895e5c700 1 --2- 172.21.15.45:0/3018666404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc890100ac0 0x7fc890196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.454+0000 7fc89565b700 1 --2- 172.21.15.45:0/3018666404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc890101be0 0x7fc8901974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.455+0000 7fc89665d700 1 -- 172.21.15.45:0/3018666404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc890101be0 msgr2=0x7fc8901974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.455+0000 7fc89665d700 1 --2- 172.21.15.45:0/3018666404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc890101be0 0x7fc8901974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.455+0000 7fc89665d700 1 -- 172.21.15.45:0/3018666404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc890100ac0 msgr2=0x7fc890196f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.455+0000 7fc89665d700 1 --2- 172.21.15.45:0/3018666404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc890100ac0 0x7fc890196f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.455+0000 7fc89665d700 1 -- 172.21.15.45:0/3018666404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc888009d00 con 0x7fc890102580 2024-05-10T03:40:09.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.455+0000 7fc89665d700 1 --2- 172.21.15.45:0/3018666404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc890102580 0x7fc89019e430 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc88800b070 tx=0x7fc888009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:09.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.455+0000 7fc886ffd700 1 -- 172.21.15.45:0/3018666404 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88800e040 con 0x7fc890102580 2024-05-10T03:40:09.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.455+0000 7fc886ffd700 1 -- 172.21.15.45:0/3018666404 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc88800be40 con 0x7fc890102580 2024-05-10T03:40:09.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.455+0000 7fc8980c0700 1 -- 172.21.15.45:0/3018666404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc890068500 con 0x7fc890102580 2024-05-10T03:40:09.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.455+0000 7fc886ffd700 1 -- 172.21.15.45:0/3018666404 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88801b6c0 con 0x7fc890102580 2024-05-10T03:40:09.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.455+0000 7fc8980c0700 1 -- 172.21.15.45:0/3018666404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8900689b0 con 0x7fc890102580 2024-05-10T03:40:09.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.457+0000 7fc886ffd700 1 -- 172.21.15.45:0/3018666404 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fc88801d470 con 0x7fc890102580 2024-05-10T03:40:09.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.458+0000 7fc886ffd700 1 --2- 172.21.15.45:0/3018666404 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc87c0a1260 0x7fc87c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.459+0000 7fc895e5c700 1 --2- 172.21.15.45:0/3018666404 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc87c0a1260 0x7fc87c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.459+0000 7fc886ffd700 1 -- 172.21.15.45:0/3018666404 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc8880cd990 con 0x7fc890102580 2024-05-10T03:40:09.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.459+0000 7fc895e5c700 1 --2- 172.21.15.45:0/3018666404 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc87c0a1260 0x7fc87c0a3770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc890101ae0 tx=0x7fc88c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:09.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.459+0000 7fc8a8404b80 1 Processor -- start 2024-05-10T03:40:09.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.460+0000 7fc8a8404b80 1 -- start start 2024-05-10T03:40:09.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.460+0000 7fc8a8404b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc8650 0x559f77dc8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.460+0000 7fc8a8404b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f77dc9520 0x559f77dc9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.460+0000 7fc8a8404b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559f77dc9e70 0x559f77dd0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.460+0000 7fc8a8404b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f77cef100 con 0x559f77dc8650 2024-05-10T03:40:09.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.460+0000 7fc8a8404b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f77cecac0 con 0x559f77dc9e70 2024-05-10T03:40:09.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.460+0000 7fc8a8404b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f77ce83b0 con 0x559f77dc9520 2024-05-10T03:40:09.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.460+0000 7fc895e5c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc8650 0x559f77dc8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.460+0000 7fc895e5c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc8650 0x559f77dc8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52566/0 (socket says 172.21.15.45:52566) 2024-05-10T03:40:09.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.460+0000 7fc895e5c700 1 -- 172.21.15.45:0/3923694683 learned_addr learned my addr 172.21.15.45:0/3923694683 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:09.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.460+0000 7fc89565b700 1 --2- 172.21.15.45:0/3923694683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f77dc9520 0x559f77dc9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.460+0000 7fc89665d700 1 --2- 172.21.15.45:0/3923694683 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559f77dc9e70 0x559f77dd0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.460+0000 7fc895e5c700 1 -- 172.21.15.45:0/3923694683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f77dc9520 msgr2=0x559f77dc9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:09.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.460+0000 7fc895e5c700 1 --2- 172.21.15.45:0/3923694683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f77dc9520 0x559f77dc9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.460+0000 7fc895e5c700 1 -- 172.21.15.45:0/3923694683 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559f77dc9e70 msgr2=0x559f77dd0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:09.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.460+0000 7fc895e5c700 1 --2- 172.21.15.45:0/3923694683 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559f77dc9e70 0x559f77dd0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.460+0000 7fc895e5c700 1 -- 172.21.15.45:0/3923694683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f77b69360 con 0x559f77dc8650 2024-05-10T03:40:09.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.460+0000 7fc89665d700 1 --2- 172.21.15.45:0/3923694683 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559f77dc9e70 0x559f77dd0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:09.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.461+0000 7fc895e5c700 1 --2- 172.21.15.45:0/3923694683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc8650 0x559f77dc8aa0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc88c011d20 tx=0x7fc88c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5bcc91f63a4528 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:09.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.461+0000 7fc87bfff700 1 -- 172.21.15.45:0/3923694683 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c00edd0 con 0x559f77dc8650 2024-05-10T03:40:09.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.461+0000 7fc87bfff700 1 -- 172.21.15.45:0/3923694683 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc88c021070 con 0x559f77dc8650 2024-05-10T03:40:09.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.461+0000 7fc87bfff700 1 -- 172.21.15.45:0/3923694683 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c01d7d0 con 0x559f77dc8650 2024-05-10T03:40:09.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.462+0000 7fc8a8404b80 1 -- 172.21.15.45:0/3923694683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc8650 msgr2=0x559f77dc8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.462+0000 7fc8a8404b80 1 --2- 172.21.15.45:0/3923694683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc8650 0x559f77dc8aa0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc88c011d20 tx=0x7fc88c014000 comp rx=0 tx=0).stop 2024-05-10T03:40:09.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.462+0000 7fc8a8404b80 1 -- 172.21.15.45:0/3923694683 shutdown_connections 2024-05-10T03:40:09.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.462+0000 7fc8a8404b80 1 --2- 172.21.15.45:0/3923694683 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559f77dc9e70 0x559f77dd0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.462+0000 7fc8a8404b80 1 --2- 172.21.15.45:0/3923694683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc8650 0x559f77dc8aa0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.462+0000 7fc8a8404b80 1 --2- 172.21.15.45:0/3923694683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f77dc9520 0x559f77dc9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.462+0000 7fc8a8404b80 1 -- 172.21.15.45:0/3923694683 >> 172.21.15.45:0/3923694683 conn(0x559f77d2aa10 msgr2=0x559f77dc2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:09.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.462+0000 7fc8a8404b80 1 -- 172.21.15.45:0/3923694683 shutdown_connections 2024-05-10T03:40:09.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.462+0000 7fc8a8404b80 1 -- 172.21.15.45:0/3923694683 wait complete. 2024-05-10T03:40:09.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.462+0000 7fc8a8404b80 1 -- start start 2024-05-10T03:40:09.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.462+0000 7fc8a8404b80 1 Processor -- start 2024-05-10T03:40:09.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.463+0000 7fc8a8404b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559f77dc8650 0x559f77dd2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.463+0000 7fc8a8404b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f77dc9520 0x559f77dd2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.463+0000 7fc8a8404b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc9e70 0x559f77dd9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.463+0000 7fc8a8404b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f77c84510 con 0x559f77dc9e70 2024-05-10T03:40:09.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.463+0000 7fc8a8404b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f77c841b0 con 0x559f77dc8650 2024-05-10T03:40:09.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.463+0000 7fc8a8404b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f77b6b650 con 0x559f77dc9520 2024-05-10T03:40:09.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.463+0000 7fc8a8404b80 10 client.0 _ll_register_callbacks cb 0x559f77c8dae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:09.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.463+0000 7fc89665d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc9e70 0x559f77dd9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.463+0000 7fc89665d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc9e70 0x559f77dd9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52570/0 (socket says 172.21.15.45:52570) 2024-05-10T03:40:09.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.463+0000 7fc89665d700 1 -- 172.21.15.45:0/3933106035 learned_addr learned my addr 172.21.15.45:0/3933106035 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:09.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.463+0000 7fc89565b700 1 --2- 172.21.15.45:0/3933106035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f77dc9520 0x559f77dd2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.463+0000 7fc895e5c700 1 --2- 172.21.15.45:0/3933106035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559f77dc8650 0x559f77dd2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.464+0000 7fc89665d700 1 -- 172.21.15.45:0/3933106035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f77dc9520 msgr2=0x559f77dd2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:09.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.464+0000 7fc89665d700 1 --2- 172.21.15.45:0/3933106035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f77dc9520 0x559f77dd2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.464+0000 7fc89665d700 1 -- 172.21.15.45:0/3933106035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559f77dc8650 msgr2=0x559f77dd2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:09.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.464+0000 7fc89665d700 1 --2- 172.21.15.45:0/3933106035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559f77dc8650 0x559f77dd2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.464+0000 7fc89665d700 1 -- 172.21.15.45:0/3933106035 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc88c017070 con 0x559f77dc9e70 2024-05-10T03:40:09.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.464+0000 7fc89565b700 1 --2- 172.21.15.45:0/3933106035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f77dc9520 0x559f77dd2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:40:09.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.464+0000 7fc89665d700 1 --2- 172.21.15.45:0/3933106035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc9e70 0x559f77dd9b20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc888097470 tx=0x7fc888003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a50be836cec928 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:09.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.464+0000 7fc8797fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:09.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.464+0000 7fc8797fa700 1 -- 172.21.15.45:0/3933106035 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88801aea0 con 0x559f77dc9e70 2024-05-10T03:40:09.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.464+0000 7fc8797fa700 1 -- 172.21.15.45:0/3933106035 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc88809b100 con 0x559f77dc9e70 2024-05-10T03:40:09.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.464+0000 7fc8a8404b80 1 -- 172.21.15.45:0/3933106035 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f77c41220 con 0x559f77dc9e70 2024-05-10T03:40:09.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.464+0000 7fc8797fa700 1 -- 172.21.15.45:0/3933106035 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc88809aa00 con 0x559f77dc9e70 2024-05-10T03:40:09.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.464+0000 7fc8a8404b80 10 client.15507 fetch_fsmap learned FSMap version 27 2024-05-10T03:40:09.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.464+0000 7fc8a8404b80 1 -- 172.21.15.45:0/3933106035 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559f77b15b10 con 0x559f77dc9e70 2024-05-10T03:40:09.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.465+0000 7fc8797fa700 1 -- 172.21.15.45:0/3933106035 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x559f77c41220 con 0x559f77dc9e70 2024-05-10T03:40:09.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.465+0000 7fc8797fa700 1 -- 172.21.15.45:0/3933106035 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc8880b31d0 con 0x559f77dc9e70 2024-05-10T03:40:09.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.465+0000 7fc8a8404b80 10 client.15507 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T03:40:09.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.465+0000 7fc8a8404b80 10 client.15507 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T03:40:09.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.465+0000 7fc8a8404b80 20 client.15507 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:09.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.465+0000 7fc8a8404b80 1 --2- 172.21.15.45:0/3933106035 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x559f77ddda30 0x559f77de2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.465+0000 7fc8a8404b80 4 client.15507 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:40:09.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.465+0000 7fc8a8404b80 1 -- 172.21.15.45:0/3933106035 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f77d97730 con 0x559f77ddda30 2024-05-10T03:40:09.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.465+0000 7fc895e5c700 1 --2- 172.21.15.45:0/3933106035 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x559f77ddda30 0x559f77de2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.466+0000 7fc895e5c700 1 --2- 172.21.15.45:0/3933106035 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x559f77ddda30 0x559f77de2740 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a529da0e28b0e8a7 server_cookie=d9ffcbf06950751f in_seq=0 out_seq=0 2024-05-10T03:40:09.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.466+0000 7fc8797fa700 10 client.15507 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:09.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.466+0000 7fc8797fa700 1 -- 172.21.15.45:0/3933106035 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559f77d97730 con 0x559f77ddda30 2024-05-10T03:40:09.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.466+0000 7fc8797fa700 10 client.15507 handle_command_reply: tid=0 2024-05-10T03:40:09.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.466+0000 7fc8a8404b80 1 client.15507 shutdown 2024-05-10T03:40:09.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.466+0000 7fc8a8404b80 1 -- 172.21.15.45:0/3933106035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc9e70 msgr2=0x559f77dd9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.466+0000 7fc8a8404b80 1 --2- 172.21.15.45:0/3933106035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc9e70 0x559f77dd9b20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc888097470 tx=0x7fc888003ea0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.467+0000 7fc8a8404b80 1 -- 172.21.15.45:0/3933106035 shutdown_connections 2024-05-10T03:40:09.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.467+0000 7fc8a8404b80 1 --2- 172.21.15.45:0/3933106035 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x559f77ddda30 0x559f77de2740 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.467+0000 7fc8a8404b80 1 --2- 172.21.15.45:0/3933106035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc9e70 0x559f77dd9b20 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.467+0000 7fc8a8404b80 1 --2- 172.21.15.45:0/3933106035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559f77dc8650 0x559f77dd2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.467+0000 7fc8797fa700 0 client.15507 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:09.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.467+0000 7fc8a8404b80 1 --2- 172.21.15.45:0/3933106035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f77dc9520 0x559f77dd2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.467+0000 7fc8a8404b80 1 -- 172.21.15.45:0/3933106035 >> 172.21.15.45:0/3933106035 conn(0x559f77d2aa10 msgr2=0x559f77dc2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:09.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.467+0000 7fc8a8404b80 1 -- 172.21.15.45:0/3933106035 shutdown_connections 2024-05-10T03:40:09.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.467+0000 7fc8a8404b80 1 -- 172.21.15.45:0/3933106035 wait complete. 2024-05-10T03:40:09.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.467+0000 7fc8a8404b80 20 client.15507 trim_cache size 0 max 16384 2024-05-10T03:40:09.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:09 smithi154 ceph-mon[46565]: pgmap v279: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:40:09.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:09 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2594320617' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:40:09.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:09 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3659869317' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:40:09.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.486+0000 7fc8a8404b80 1 Processor -- start 2024-05-10T03:40:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.486+0000 7fc8a8404b80 1 -- start start 2024-05-10T03:40:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.486+0000 7fc8a8404b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc8650 0x559f77dc2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.486+0000 7fc8a8404b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559f77dc9520 0x559f77dd7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.486+0000 7fc8a8404b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f77dc9e70 0x559f77dd8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.486+0000 7fc8a8404b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f77ca62b0 con 0x559f77dc8650 2024-05-10T03:40:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.486+0000 7fc8a8404b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f77ce1150 con 0x559f77dc9520 2024-05-10T03:40:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.486+0000 7fc8a8404b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f77ce5010 con 0x559f77dc9e70 2024-05-10T03:40:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.486+0000 7fc895e5c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc8650 0x559f77dc2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.486+0000 7fc895e5c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc8650 0x559f77dc2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52576/0 (socket says 172.21.15.45:52576) 2024-05-10T03:40:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.486+0000 7fc895e5c700 1 -- 172.21.15.45:0/3824632610 learned_addr learned my addr 172.21.15.45:0/3824632610 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.486+0000 7fc89665d700 1 --2- 172.21.15.45:0/3824632610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f77dc9e70 0x559f77dd8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.486+0000 7fc89565b700 1 --2- 172.21.15.45:0/3824632610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559f77dc9520 0x559f77dd7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.486+0000 7fc895e5c700 1 -- 172.21.15.45:0/3824632610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f77dc9e70 msgr2=0x559f77dd8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.486+0000 7fc895e5c700 1 --2- 172.21.15.45:0/3824632610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f77dc9e70 0x559f77dd8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.486+0000 7fc895e5c700 1 -- 172.21.15.45:0/3824632610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559f77dc9520 msgr2=0x559f77dd7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.486+0000 7fc895e5c700 1 --2- 172.21.15.45:0/3824632610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559f77dc9520 0x559f77dd7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.487+0000 7fc895e5c700 1 -- 172.21.15.45:0/3824632610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f77cae510 con 0x559f77dc8650 2024-05-10T03:40:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.487+0000 7fc89565b700 1 --2- 172.21.15.45:0/3824632610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559f77dc9520 0x559f77dd7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:40:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.487+0000 7fc895e5c700 1 --2- 172.21.15.45:0/3824632610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc8650 0x559f77dc2f40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc88c005950 tx=0x7fc88c009730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266aa824aedff2c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.487+0000 7fc884ff9700 1 -- 172.21.15.45:0/3824632610 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c004020 con 0x559f77dc8650 2024-05-10T03:40:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.487+0000 7fc884ff9700 1 -- 172.21.15.45:0/3824632610 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc88c005140 con 0x559f77dc8650 2024-05-10T03:40:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.487+0000 7fc884ff9700 1 -- 172.21.15.45:0/3824632610 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c004bb0 con 0x559f77dc8650 2024-05-10T03:40:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.488+0000 7fc8a8404b80 1 -- 172.21.15.45:0/3824632610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc8650 msgr2=0x559f77dc2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.488+0000 7fc8a8404b80 1 --2- 172.21.15.45:0/3824632610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc8650 0x559f77dc2f40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc88c005950 tx=0x7fc88c009730 comp rx=0 tx=0).stop 2024-05-10T03:40:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.488+0000 7fc8a8404b80 1 -- 172.21.15.45:0/3824632610 shutdown_connections 2024-05-10T03:40:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.488+0000 7fc8a8404b80 1 --2- 172.21.15.45:0/3824632610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f77dc9e70 0x559f77dd8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.488+0000 7fc8a8404b80 1 --2- 172.21.15.45:0/3824632610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc8650 0x559f77dc2f40 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.488+0000 7fc8a8404b80 1 --2- 172.21.15.45:0/3824632610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559f77dc9520 0x559f77dd7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.488+0000 7fc8a8404b80 1 -- 172.21.15.45:0/3824632610 >> 172.21.15.45:0/3824632610 conn(0x559f77d2aa10 msgr2=0x559f77dc3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.488+0000 7fc8a8404b80 1 -- 172.21.15.45:0/3824632610 shutdown_connections 2024-05-10T03:40:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.488+0000 7fc8a8404b80 1 -- 172.21.15.45:0/3824632610 wait complete. 2024-05-10T03:40:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.488+0000 7fc8a8404b80 1 -- start start 2024-05-10T03:40:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.488+0000 7fc8a8404b80 1 Processor -- start 2024-05-10T03:40:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.489+0000 7fc8a8404b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559f77dc8650 0x559f77dd5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.489+0000 7fc8a8404b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f77dc9520 0x559f77dd64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.489+0000 7fc8a8404b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc9e70 0x559f77dd7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.489+0000 7fc8a8404b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f77dd7870 con 0x559f77dc9e70 2024-05-10T03:40:09.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.489+0000 7fc8a8404b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f77dd79e0 con 0x559f77dc8650 2024-05-10T03:40:09.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.489+0000 7fc8a8404b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f77dd7ba0 con 0x559f77dc9520 2024-05-10T03:40:09.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.489+0000 7fc8a8404b80 10 client.0 _ll_register_callbacks cb 0x559f77c8dae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:09.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.489+0000 7fc89665d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc9e70 0x559f77dd7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.489+0000 7fc89665d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc9e70 0x559f77dd7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52590/0 (socket says 172.21.15.45:52590) 2024-05-10T03:40:09.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.489+0000 7fc89665d700 1 -- 172.21.15.45:0/622480125 learned_addr learned my addr 172.21.15.45:0/622480125 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:09.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.489+0000 7fc89565b700 1 --2- 172.21.15.45:0/622480125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f77dc9520 0x559f77dd64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.489+0000 7fc895e5c700 1 --2- 172.21.15.45:0/622480125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559f77dc8650 0x559f77dd5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.489+0000 7fc89665d700 1 -- 172.21.15.45:0/622480125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f77dc9520 msgr2=0x559f77dd64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:09.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.489+0000 7fc89665d700 1 --2- 172.21.15.45:0/622480125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f77dc9520 0x559f77dd64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.489+0000 7fc89665d700 1 -- 172.21.15.45:0/622480125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559f77dc8650 msgr2=0x559f77dd5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:09.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.489+0000 7fc89665d700 1 --2- 172.21.15.45:0/622480125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559f77dc8650 0x559f77dd5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.489+0000 7fc89665d700 1 -- 172.21.15.45:0/622480125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f77b69360 con 0x559f77dc9e70 2024-05-10T03:40:09.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.490+0000 7fc89665d700 1 --2- 172.21.15.45:0/622480125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc9e70 0x559f77dd7330 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc888009fd0 tx=0x7fc888099fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7115b5204bf7b923 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:09.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.490+0000 7fc8797fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:09.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.490+0000 7fc8797fa700 1 -- 172.21.15.45:0/622480125 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888096d40 con 0x559f77dc9e70 2024-05-10T03:40:09.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.490+0000 7fc8797fa700 1 -- 172.21.15.45:0/622480125 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc88801aea0 con 0x559f77dc9e70 2024-05-10T03:40:09.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.490+0000 7fc8a8404b80 1 -- 172.21.15.45:0/622480125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc88c021070 con 0x559f77dc9e70 2024-05-10T03:40:09.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.490+0000 7fc8797fa700 1 -- 172.21.15.45:0/622480125 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc88809b100 con 0x559f77dc9e70 2024-05-10T03:40:09.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.490+0000 7fc8a8404b80 10 client.15513 fetch_fsmap learned FSMap version 27 2024-05-10T03:40:09.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.490+0000 7fc8a8404b80 1 -- 172.21.15.45:0/622480125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559f77b6dc80 con 0x559f77dc9e70 2024-05-10T03:40:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.490+0000 7fc8797fa700 1 -- 172.21.15.45:0/622480125 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc88c021070 con 0x559f77dc9e70 2024-05-10T03:40:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.490+0000 7fc8797fa700 1 -- 172.21.15.45:0/622480125 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc8880a2a40 con 0x559f77dc9e70 2024-05-10T03:40:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.490+0000 7fc8a8404b80 10 client.15513 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T03:40:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.490+0000 7fc8a8404b80 10 client.15513 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T03:40:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.490+0000 7fc8a8404b80 20 client.15513 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.490+0000 7fc8a8404b80 1 --2- 172.21.15.45:0/622480125 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x559f77e36a00 0x559f77e34bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.490+0000 7fc8a8404b80 4 client.15513 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T03:40:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.490+0000 7fc8a8404b80 1 -- 172.21.15.45:0/622480125 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559f77ce0e70 con 0x559f77e36a00 2024-05-10T03:40:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.491+0000 7fc895e5c700 1 --2- 172.21.15.45:0/622480125 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x559f77e36a00 0x559f77e34bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.491+0000 7fc8797fa700 10 client.15513 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.491+0000 7fc895e5c700 1 --2- 172.21.15.45:0/622480125 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x559f77e36a00 0x559f77e34bd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3238b8618af3f63 server_cookie=a8140024d1dd71a5 in_seq=0 out_seq=0 2024-05-10T03:40:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.491+0000 7fc8797fa700 1 -- 172.21.15.45:0/622480125 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x559f77ce0e70 con 0x559f77e36a00 2024-05-10T03:40:09.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.491+0000 7fc8797fa700 10 client.15513 handle_command_reply: tid=0 2024-05-10T03:40:09.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.491+0000 7fc8a8404b80 1 client.15513 shutdown 2024-05-10T03:40:09.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.492+0000 7fc8a8404b80 1 -- 172.21.15.45:0/622480125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc9e70 msgr2=0x559f77dd7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.492+0000 7fc8a8404b80 1 --2- 172.21.15.45:0/622480125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc9e70 0x559f77dd7330 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc888009fd0 tx=0x7fc888099fe0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.492+0000 7fc8a8404b80 1 -- 172.21.15.45:0/622480125 shutdown_connections 2024-05-10T03:40:09.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.492+0000 7fc8a8404b80 1 --2- 172.21.15.45:0/622480125 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x559f77e36a00 0x559f77e34bd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.492+0000 7fc8a8404b80 1 --2- 172.21.15.45:0/622480125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f77dc9e70 0x559f77dd7330 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.492+0000 7fc8a8404b80 1 --2- 172.21.15.45:0/622480125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559f77dc8650 0x559f77dd5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.492+0000 7fc8a8404b80 1 --2- 172.21.15.45:0/622480125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f77dc9520 0x559f77dd64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.492+0000 7fc8797fa700 0 client.15513 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:09.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.492+0000 7fc8a8404b80 1 -- 172.21.15.45:0/622480125 >> 172.21.15.45:0/622480125 conn(0x559f77d2aa10 msgr2=0x559f77dc3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:09.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.492+0000 7fc8a8404b80 1 -- 172.21.15.45:0/622480125 shutdown_connections 2024-05-10T03:40:09.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.492+0000 7fc8a8404b80 1 -- 172.21.15.45:0/622480125 wait complete. 2024-05-10T03:40:09.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.492+0000 7fc8a8404b80 20 client.15513 trim_cache size 0 max 16384 2024-05-10T03:40:09.502 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:40:09.502 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "d2a0bafa-0e7d-11ef-bc98-c7b262605968", 2024-05-10T03:40:09.502 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2024-05-10T03:40:09.502 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 24590, 2024-05-10T03:40:09.502 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2024-05-10T03:40:09.502 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2024-05-10T03:40:09.502 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2024-05-10T03:40:09.502 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 92.934758747999993, 2024-05-10T03:40:09.502 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 27, 2024-05-10T03:40:09.503 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 88, 2024-05-10T03:40:09.503 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 86, 2024-05-10T03:40:09.503 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 98.790986988 2024-05-10T03:40:09.503 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:40:09.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.492+0000 7fc8980c0700 1 -- 172.21.15.45:0/3018666404 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc87c0a1260 msgr2=0x7fc87c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.492+0000 7fc8980c0700 1 --2- 172.21.15.45:0/3018666404 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc87c0a1260 0x7fc87c0a3770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc890101ae0 tx=0x7fc88c009260 comp rx=0 tx=0).stop 2024-05-10T03:40:09.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.492+0000 7fc8980c0700 1 -- 172.21.15.45:0/3018666404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc890102580 msgr2=0x7fc89019e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:09.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.492+0000 7fc8980c0700 1 --2- 172.21.15.45:0/3018666404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc890102580 0x7fc89019e430 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc88800b070 tx=0x7fc888009810 comp rx=0 tx=0).stop 2024-05-10T03:40:09.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.493+0000 7fc8980c0700 1 -- 172.21.15.45:0/3018666404 shutdown_connections 2024-05-10T03:40:09.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.493+0000 7fc8980c0700 1 --2- 172.21.15.45:0/3018666404 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc87c0a1260 0x7fc87c0a3770 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.493+0000 7fc8980c0700 1 --2- 172.21.15.45:0/3018666404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc890102580 0x7fc89019e430 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.493+0000 7fc8980c0700 1 --2- 172.21.15.45:0/3018666404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc890100ac0 0x7fc890196f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.493+0000 7fc8980c0700 1 --2- 172.21.15.45:0/3018666404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc890101be0 0x7fc8901974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:09.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.493+0000 7fc8980c0700 1 -- 172.21.15.45:0/3018666404 >> 172.21.15.45:0/3018666404 conn(0x7fc8900fc0d0 msgr2=0x7fc890104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:09.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.493+0000 7fc8980c0700 1 -- 172.21.15.45:0/3018666404 shutdown_connections 2024-05-10T03:40:09.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:09.493+0000 7fc8980c0700 1 -- 172.21.15.45:0/3018666404 wait complete. 2024-05-10T03:40:09.510 INFO:teuthology.run_tasks:Running task sequential... 2024-05-10T03:40:09.520 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-10T03:40:09.520 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-10T03:40:09.521 INFO:teuthology.task.print:Enabling mgr modules 2024-05-10T03:40:09.521 INFO:teuthology.run_tasks:Running task kclient... 2024-05-10T03:40:09.547 INFO:tasks.kclient:Mounting kernel clients... 2024-05-10T03:40:09.547 INFO:tasks.kclient:config is {'client.0': {}} 2024-05-10T03:40:09.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:40:09.547 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2024-05-10T03:40:09.567 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-10T03:40:09.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:40:09.568 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-10T03:40:09.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:40:09.651 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2024-05-10T03:40:09.759 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'rbytes': False, 'syntax': 'v1', 'mount_subvol_num': 1} 2024-05-10T03:40:09.759 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T03:40:09.760 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T03:40:09.760 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph fs ls 2024-05-10T03:40:10.017 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:40:10.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.958+0000 7efc21db5700 1 -- 172.21.15.45:0/2334098142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc1c106c60 msgr2=0x7efc1c107070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:10.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.958+0000 7efc21db5700 1 --2- 172.21.15.45:0/2334098142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc1c106c60 0x7efc1c107070 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009990 tx=0x7efc0c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:10.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.958+0000 7efc21db5700 1 -- 172.21.15.45:0/2334098142 shutdown_connections 2024-05-10T03:40:10.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.958+0000 7efc21db5700 1 --2- 172.21.15.45:0/2334098142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc1c100a40 0x7efc1c10ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:10.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.958+0000 7efc21db5700 1 --2- 172.21.15.45:0/2334098142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc1c106c60 0x7efc1c107070 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:10.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.958+0000 7efc21db5700 1 --2- 172.21.15.45:0/2334098142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc1c1000f0 0x7efc1c100500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:10.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.958+0000 7efc21db5700 1 -- 172.21.15.45:0/2334098142 >> 172.21.15.45:0/2334098142 conn(0x7efc1c0fbed0 msgr2=0x7efc1c0fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:10.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.958+0000 7efc21db5700 1 -- 172.21.15.45:0/2334098142 shutdown_connections 2024-05-10T03:40:10.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.958+0000 7efc21db5700 1 -- 172.21.15.45:0/2334098142 wait complete. 2024-05-10T03:40:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.959+0000 7efc21db5700 1 Processor -- start 2024-05-10T03:40:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.959+0000 7efc21db5700 1 -- start start 2024-05-10T03:40:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.960+0000 7efc21db5700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc1c1000f0 0x7efc1c19e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.960+0000 7efc21db5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc1c100a40 0x7efc1c19eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.960+0000 7efc21db5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc1c106c60 0x7efc1c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.960+0000 7efc21db5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c198b00 con 0x7efc1c100a40 2024-05-10T03:40:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.960+0000 7efc21db5700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c198c70 con 0x7efc1c1000f0 2024-05-10T03:40:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.960+0000 7efc21db5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c198e30 con 0x7efc1c106c60 2024-05-10T03:40:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.960+0000 7efc1affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc1c100a40 0x7efc1c19eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.960+0000 7efc1affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc1c100a40 0x7efc1c19eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52612/0 (socket says 172.21.15.45:52612) 2024-05-10T03:40:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.960+0000 7efc1affd700 1 -- 172.21.15.45:0/2382692763 learned_addr learned my addr 172.21.15.45:0/2382692763 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.960+0000 7efc1b7fe700 1 --2- 172.21.15.45:0/2382692763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc1c1000f0 0x7efc1c19e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.960+0000 7efc1bfff700 1 --2- 172.21.15.45:0/2382692763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc1c106c60 0x7efc1c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.960+0000 7efc1affd700 1 -- 172.21.15.45:0/2382692763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc1c106c60 msgr2=0x7efc1c198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.960+0000 7efc1affd700 1 --2- 172.21.15.45:0/2382692763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc1c106c60 0x7efc1c198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:10.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.960+0000 7efc1affd700 1 -- 172.21.15.45:0/2382692763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc1c1000f0 msgr2=0x7efc1c19e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:10.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.960+0000 7efc1affd700 1 --2- 172.21.15.45:0/2382692763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc1c1000f0 0x7efc1c19e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:10.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.960+0000 7efc1affd700 1 -- 172.21.15.45:0/2382692763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c0095f0 con 0x7efc1c100a40 2024-05-10T03:40:10.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.960+0000 7efc1affd700 1 --2- 172.21.15.45:0/2382692763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc1c100a40 0x7efc1c19eac0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7efc1000e970 tx=0x7efc1000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:10.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.961+0000 7efc18ff9700 1 -- 172.21.15.45:0/2382692763 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10009790 con 0x7efc1c100a40 2024-05-10T03:40:10.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.962+0000 7efc21db5700 1 -- 172.21.15.45:0/2382692763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1c199110 con 0x7efc1c100a40 2024-05-10T03:40:10.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.962+0000 7efc18ff9700 1 -- 172.21.15.45:0/2382692763 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efc1000eec0 con 0x7efc1c100a40 2024-05-10T03:40:10.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.962+0000 7efc18ff9700 1 -- 172.21.15.45:0/2382692763 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10005690 con 0x7efc1c100a40 2024-05-10T03:40:10.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.962+0000 7efc21db5700 1 -- 172.21.15.45:0/2382692763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1c1a5550 con 0x7efc1c100a40 2024-05-10T03:40:10.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.963+0000 7efc21db5700 1 -- 172.21.15.45:0/2382692763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc1c10a220 con 0x7efc1c100a40 2024-05-10T03:40:10.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.965+0000 7efc18ff9700 1 -- 172.21.15.45:0/2382692763 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7efc10004750 con 0x7efc1c100a40 2024-05-10T03:40:10.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.966+0000 7efc18ff9700 1 --2- 172.21.15.45:0/2382692763 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efc040a11b0 0x7efc040a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:10.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.966+0000 7efc18ff9700 1 -- 172.21.15.45:0/2382692763 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7efc10014070 con 0x7efc1c100a40 2024-05-10T03:40:10.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.966+0000 7efc1b7fe700 1 --2- 172.21.15.45:0/2382692763 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efc040a11b0 0x7efc040a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:10.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.966+0000 7efc1b7fe700 1 --2- 172.21.15.45:0/2382692763 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efc040a11b0 0x7efc040a36c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0059d0 tx=0x7efc0c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:10.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:10.969+0000 7efc18ff9700 1 -- 172.21.15.45:0/2382692763 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7efc10096500 con 0x7efc1c100a40 2024-05-10T03:40:11.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:11.233+0000 7efc21db5700 1 -- 172.21.15.45:0/2382692763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efc1c103410 con 0x7efc1c100a40 2024-05-10T03:40:11.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:11.233+0000 7efc18ff9700 1 -- 172.21.15.45:0/2382692763 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+88 (secure 0 0 0) 0x7efc10099b20 con 0x7efc1c100a40 2024-05-10T03:40:11.237 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-10T03:40:11.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:11.235+0000 7efc21db5700 1 -- 172.21.15.45:0/2382692763 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efc040a11b0 msgr2=0x7efc040a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:11.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:11.235+0000 7efc21db5700 1 --2- 172.21.15.45:0/2382692763 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efc040a11b0 0x7efc040a36c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efc0c0059d0 tx=0x7efc0c01a040 comp rx=0 tx=0).stop 2024-05-10T03:40:11.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:11.235+0000 7efc21db5700 1 -- 172.21.15.45:0/2382692763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc1c100a40 msgr2=0x7efc1c19eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:11.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:11.235+0000 7efc21db5700 1 --2- 172.21.15.45:0/2382692763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc1c100a40 0x7efc1c19eac0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7efc1000e970 tx=0x7efc1000ec80 comp rx=0 tx=0).stop 2024-05-10T03:40:11.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:11.235+0000 7efc21db5700 1 -- 172.21.15.45:0/2382692763 shutdown_connections 2024-05-10T03:40:11.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:11.235+0000 7efc21db5700 1 --2- 172.21.15.45:0/2382692763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc1c106c60 0x7efc1c198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:11.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:11.235+0000 7efc21db5700 1 --2- 172.21.15.45:0/2382692763 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efc040a11b0 0x7efc040a36c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:11.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:11.235+0000 7efc21db5700 1 --2- 172.21.15.45:0/2382692763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc1c1000f0 0x7efc1c19e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:11.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:11.235+0000 7efc21db5700 1 --2- 172.21.15.45:0/2382692763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc1c100a40 0x7efc1c19eac0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:11.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:11.235+0000 7efc21db5700 1 -- 172.21.15.45:0/2382692763 >> 172.21.15.45:0/2382692763 conn(0x7efc1c0fbed0 msgr2=0x7efc1c1080f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:11.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:11.235+0000 7efc21db5700 1 -- 172.21.15.45:0/2382692763 shutdown_connections 2024-05-10T03:40:11.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:11.236+0000 7efc21db5700 1 -- 172.21.15.45:0/2382692763 wait complete. 2024-05-10T03:40:11.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:11 smithi106 ceph-mon[46996]: pgmap v280: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-10T03:40:11.451 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:11 smithi045 ceph-mon[42520]: pgmap v280: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-10T03:40:11.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:11 smithi154 ceph-mon[46565]: pgmap v280: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-10T03:40:11.672 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-10T03:40:11.672 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T03:40:11.672 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2024-05-10T03:40:11.672 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T03:40:11.672 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T03:40:11.673 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-10T03:40:11.673 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T03:40:11.673 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T03:40:11.673 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T03:40:11.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:40:11.673 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2024-05-10T03:40:11.697 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T03:40:11.697 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T03:40:11.697 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T03:40:11.697 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:40:11.697 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2024-05-10T03:40:11.697 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:40:11.697 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T03:40:11.697 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2024-05-10T03:40:11.697 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2024-05-10T03:40:11.698 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T03:40:11.698 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2024-05-10T03:40:11.698 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2024-05-10T03:40:11.698 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T03:40:11.698 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2024-05-10T03:40:11.698 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2024-05-10T03:40:11.698 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-10T03:40:11.698 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 41716sec preferred_lft 41716sec 2024-05-10T03:40:11.698 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2024-05-10T03:40:11.698 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:40:11.698 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T03:40:11.698 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2024-05-10T03:40:11.699 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2024-05-10T03:40:11.699 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-10T03:40:11.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:40:11.699 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2024-05-10T03:40:11.699 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-05-10T03:40:11.699 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add name ceph-brx type bridge 2024-05-10T03:40:11.699 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr flush dev ceph-brx 2024-05-10T03:40:11.699 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set ceph-brx up 2024-05-10T03:40:11.699 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-10T03:40:11.699 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-05-10T03:40:11.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:40:11.843 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T03:40:11.875 INFO:teuthology.orchestra.run.smithi045.stdout:1 2024-05-10T03:40:11.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:40:11.877 DEBUG:teuthology.orchestra.run.smithi045:> route 2024-05-10T03:40:11.941 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2024-05-10T03:40:11.941 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T03:40:11.941 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-10T03:40:11.941 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-10T03:40:11.941 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T03:40:11.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:40:11.942 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2024-05-10T03:40:11.942 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-05-10T03:40:11.942 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-10T03:40:11.942 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-10T03:40:11.942 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-10T03:40:11.942 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-05-10T03:40:12.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:40:12.070 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2024-05-10T03:40:12.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:40:12.090 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2024-05-10T03:40:12.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:40:12.153 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2024-05-10T03:40:12.153 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-05-10T03:40:12.153 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T03:40:12.153 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-10T03:40:12.153 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-05-10T03:40:12.265 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-10T03:40:12.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:40:12.266 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2024-05-10T03:40:12.266 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-05-10T03:40:12.266 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-10T03:40:12.266 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-10T03:40:12.266 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-10T03:40:12.266 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-10T03:40:12.266 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-10T03:40:12.266 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-05-10T03:40:12.315 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:12 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2382692763' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-10T03:40:12.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:12 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2382692763' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-10T03:40:12.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:12 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2382692763' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-10T03:40:12.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:40:12.495 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2024-05-10T03:40:12.495 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-05-10T03:40:12.495 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2024-05-10T03:40:12.495 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.0 master ceph-brx 2024-05-10T03:40:12.496 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-05-10T03:40:12.610 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T03:40:12.610 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T03:40:12.630 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T03:40:12.631 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T03:40:12.631 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T03:40:12.692 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-05-10T03:40:12.692 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-05-10T03:40:12.692 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb 2024-05-10T03:40:12.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:40:12.693 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-05-10T03:40:12.806 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-05-10T03:40:12.806 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-05-10T03:40:12.806 INFO:teuthology.orchestra.run.smithi045.stdout:invalid new device string format 2024-05-10T03:40:12.942 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-05-10T03:40:12.942 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-05-10T03:40:12.942 INFO:teuthology.orchestra.run.smithi045.stdout:invalid new device string format 2024-05-10T03:40:12.943 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.106:3300,172.21.15.154:3300" 2024-05-10T03:40:12.943 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.45:3300,172.21.15.106:3300,172.21.15.154:3300:/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb 2024-05-10T03:40:12.943 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=d2a0bafa-0e7d-11ef-bc98-c7b262605968" will pass to kernel 2024-05-10T03:40:12.945 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T03:40:12.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:40:12.946 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T03:40:12.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:40:12.980 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T03:40:13.081 INFO:teuthology.orchestra.run.smithi045.stdout:client25391 2024-05-10T03:40:13.081 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-10T03:40:13.082 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:40:13.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:40:13.104 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T03:40:13.208 INFO:teuthology.orchestra.run.smithi045.stdout:client25391 2024-05-10T03:40:13.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:40:13.209 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T03:40:13.274 INFO:teuthology.orchestra.run.smithi045.stdout:client25391 2024-05-10T03:40:13.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:40:13.275 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968.client25391/status') 2024-05-10T03:40:13.283 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:13 smithi045 ceph-mon[42520]: pgmap v281: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:40:13.348 INFO:teuthology.orchestra.run.smithi045.stdout:instance: client.25391 (3)172.21.15.45:0/3869883521 2024-05-10T03:40:13.348 INFO:teuthology.orchestra.run.smithi045.stdout:blocklisted: false 2024-05-10T03:40:13.348 INFO:teuthology.orchestra.run.smithi045.stderr:0+1 records in 2024-05-10T03:40:13.348 INFO:teuthology.orchestra.run.smithi045.stderr:0+1 records out 2024-05-10T03:40:13.348 INFO:teuthology.orchestra.run.smithi045.stderr:71 bytes copied, 3.0819e-05 s, 2.3 MB/s 2024-05-10T03:40:13.350 INFO:teuthology.run_tasks:Running task exec... 2024-05-10T03:40:13.361 INFO:teuthology.task.exec:Executing custom commands... 2024-05-10T03:40:13.361 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi045.front.sepia.ceph.com 2024-05-10T03:40:13.361 DEBUG:teuthology.orchestra.run.smithi045:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-05-10T03:40:13.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:13 smithi106 ceph-mon[46996]: pgmap v281: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:40:13.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:13 smithi154 ceph-mon[46565]: pgmap v281: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T03:40:13.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.544+0000 7fb2fdb1f700 1 -- 172.21.15.45:0/466921680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2f8074110 msgr2=0x7fb2f8104740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:13.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.544+0000 7fb2fdb1f700 1 --2- 172.21.15.45:0/466921680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2f8074110 0x7fb2f8104740 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8009990 tx=0x7fb2e8009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:13.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.544+0000 7fb2fdb1f700 1 -- 172.21.15.45:0/466921680 shutdown_connections 2024-05-10T03:40:13.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.544+0000 7fb2fdb1f700 1 --2- 172.21.15.45:0/466921680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2f81078a0 0x7fb2f8109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:13.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.544+0000 7fb2fdb1f700 1 --2- 172.21.15.45:0/466921680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2f8074110 0x7fb2f8104740 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:13.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.544+0000 7fb2fdb1f700 1 --2- 172.21.15.45:0/466921680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f8104d30 0x7fb2f8107210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:13.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.544+0000 7fb2fdb1f700 1 -- 172.21.15.45:0/466921680 >> 172.21.15.45:0/466921680 conn(0x7fb2f80fc0f0 msgr2=0x7fb2f80fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:13.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.544+0000 7fb2fdb1f700 1 -- 172.21.15.45:0/466921680 shutdown_connections 2024-05-10T03:40:13.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.544+0000 7fb2fdb1f700 1 -- 172.21.15.45:0/466921680 wait complete. 2024-05-10T03:40:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.545+0000 7fb2fdb1f700 1 Processor -- start 2024-05-10T03:40:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.545+0000 7fb2fdb1f700 1 -- start start 2024-05-10T03:40:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.546+0000 7fb2fdb1f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2f8074110 0x7fb2f8198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.546+0000 7fb2fdb1f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2f8104d30 0x7fb2f81986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.546+0000 7fb2fdb1f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f81078a0 0x7fb2f819f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.546+0000 7fb2fdb1f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f819fbb0 con 0x7fb2f8074110 2024-05-10T03:40:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.546+0000 7fb2fdb1f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f819fcf0 con 0x7fb2f8104d30 2024-05-10T03:40:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.546+0000 7fb2fdb1f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f819fe80 con 0x7fb2f81078a0 2024-05-10T03:40:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.546+0000 7fb2f77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2f8074110 0x7fb2f8198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:13.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.546+0000 7fb2f77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2f8074110 0x7fb2f8198160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52640/0 (socket says 172.21.15.45:52640) 2024-05-10T03:40:13.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.546+0000 7fb2f77fe700 1 -- 172.21.15.45:0/1885000360 learned_addr learned my addr 172.21.15.45:0/1885000360 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:13.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.546+0000 7fb2f6ffd700 1 --2- 172.21.15.45:0/1885000360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2f8104d30 0x7fb2f81986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:13.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.546+0000 7fb2f7fff700 1 --2- 172.21.15.45:0/1885000360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f81078a0 0x7fb2f819f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:13.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.546+0000 7fb2f77fe700 1 -- 172.21.15.45:0/1885000360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f81078a0 msgr2=0x7fb2f819f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:13.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.546+0000 7fb2f77fe700 1 --2- 172.21.15.45:0/1885000360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f81078a0 0x7fb2f819f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:13.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.546+0000 7fb2f77fe700 1 -- 172.21.15.45:0/1885000360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2f8104d30 msgr2=0x7fb2f81986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:13.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.546+0000 7fb2f77fe700 1 --2- 172.21.15.45:0/1885000360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2f8104d30 0x7fb2f81986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:13.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.546+0000 7fb2f77fe700 1 -- 172.21.15.45:0/1885000360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e80095f0 con 0x7fb2f8074110 2024-05-10T03:40:13.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.546+0000 7fb2f6ffd700 1 --2- 172.21.15.45:0/1885000360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2f8104d30 0x7fb2f81986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:13.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.546+0000 7fb2f77fe700 1 --2- 172.21.15.45:0/1885000360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2f8074110 0x7fb2f8198160 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8000c00 tx=0x7fb2e8005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:13.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.547+0000 7fb2f4ff9700 1 -- 172.21.15.45:0/1885000360 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e801d070 con 0x7fb2f8074110 2024-05-10T03:40:13.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.547+0000 7fb2f4ff9700 1 -- 172.21.15.45:0/1885000360 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb2e800fe60 con 0x7fb2f8074110 2024-05-10T03:40:13.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.547+0000 7fb2fdb1f700 1 -- 172.21.15.45:0/1885000360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f81a0100 con 0x7fb2f8074110 2024-05-10T03:40:13.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.547+0000 7fb2f4ff9700 1 -- 172.21.15.45:0/1885000360 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e8017650 con 0x7fb2f8074110 2024-05-10T03:40:13.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.547+0000 7fb2fdb1f700 1 -- 172.21.15.45:0/1885000360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f81a0580 con 0x7fb2f8074110 2024-05-10T03:40:13.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.548+0000 7fb2fdb1f700 1 -- 172.21.15.45:0/1885000360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f80fdca0 con 0x7fb2f8074110 2024-05-10T03:40:13.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.549+0000 7fb2f4ff9700 1 -- 172.21.15.45:0/1885000360 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb2e8021410 con 0x7fb2f8074110 2024-05-10T03:40:13.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.550+0000 7fb2f4ff9700 1 --2- 172.21.15.45:0/1885000360 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb2e40a1230 0x7fb2e40a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:13.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.550+0000 7fb2f6ffd700 1 --2- 172.21.15.45:0/1885000360 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb2e40a1230 0x7fb2e40a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:13.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.550+0000 7fb2f4ff9700 1 -- 172.21.15.45:0/1885000360 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb2e80ce1a0 con 0x7fb2f8074110 2024-05-10T03:40:13.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.550+0000 7fb2f6ffd700 1 --2- 172.21.15.45:0/1885000360 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb2e40a1230 0x7fb2e40a3740 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb2f81991b0 tx=0x7fb2e0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:13.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.555+0000 7fb2f4ff9700 1 -- 172.21.15.45:0/1885000360 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb2e80974f0 con 0x7fb2f8074110 2024-05-10T03:40:13.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:13.827+0000 7fb2fdb1f700 1 -- 172.21.15.45:0/1885000360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) v1 -- 0x7fb2f810d4f0 con 0x7fb2f8074110 2024-05-10T03:40:14.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.056+0000 7fb2f4ff9700 1 -- 172.21.15.45:0/1885000360 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v28) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb2e809ab10 con 0x7fb2f8074110 2024-05-10T03:40:14.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.059+0000 7fb2fdb1f700 1 -- 172.21.15.45:0/1885000360 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb2e40a1230 msgr2=0x7fb2e40a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:14.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.060+0000 7fb2fdb1f700 1 --2- 172.21.15.45:0/1885000360 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb2e40a1230 0x7fb2e40a3740 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb2f81991b0 tx=0x7fb2e0009260 comp rx=0 tx=0).stop 2024-05-10T03:40:14.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.060+0000 7fb2fdb1f700 1 -- 172.21.15.45:0/1885000360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2f8074110 msgr2=0x7fb2f8198160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:14.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.060+0000 7fb2fdb1f700 1 --2- 172.21.15.45:0/1885000360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2f8074110 0x7fb2f8198160 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8000c00 tx=0x7fb2e8005b00 comp rx=0 tx=0).stop 2024-05-10T03:40:14.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.060+0000 7fb2fdb1f700 1 -- 172.21.15.45:0/1885000360 shutdown_connections 2024-05-10T03:40:14.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.060+0000 7fb2fdb1f700 1 --2- 172.21.15.45:0/1885000360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2f81078a0 0x7fb2f819f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.060+0000 7fb2fdb1f700 1 --2- 172.21.15.45:0/1885000360 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb2e40a1230 0x7fb2e40a3740 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.060+0000 7fb2fdb1f700 1 --2- 172.21.15.45:0/1885000360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2f8074110 0x7fb2f8198160 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.060+0000 7fb2fdb1f700 1 --2- 172.21.15.45:0/1885000360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2f8104d30 0x7fb2f81986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.060+0000 7fb2fdb1f700 1 -- 172.21.15.45:0/1885000360 >> 172.21.15.45:0/1885000360 conn(0x7fb2f80fc0f0 msgr2=0x7fb2f8102df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:14.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.060+0000 7fb2fdb1f700 1 -- 172.21.15.45:0/1885000360 shutdown_connections 2024-05-10T03:40:14.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.060+0000 7fb2fdb1f700 1 -- 172.21.15.45:0/1885000360 wait complete. 2024-05-10T03:40:14.079 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:14 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1885000360' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-10T03:40:14.080 DEBUG:teuthology.orchestra.run.smithi045:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-05-10T03:40:14.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.234+0000 7fc69651c700 1 -- 172.21.15.45:0/2020412066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc690102580 msgr2=0x7fc690108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:14.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.234+0000 7fc69651c700 1 --2- 172.21.15.45:0/2020412066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc690102580 0x7fc690108e30 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc68800b0a0 tx=0x7fc68800b3b0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.234+0000 7fc69651c700 1 -- 172.21.15.45:0/2020412066 shutdown_connections 2024-05-10T03:40:14.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.234+0000 7fc69651c700 1 --2- 172.21.15.45:0/2020412066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc690100ac0 0x7fc690100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.234+0000 7fc69651c700 1 --2- 172.21.15.45:0/2020412066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc690102580 0x7fc690108e30 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.234+0000 7fc69651c700 1 --2- 172.21.15.45:0/2020412066 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc690101be0 0x7fc690101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.234+0000 7fc69651c700 1 -- 172.21.15.45:0/2020412066 >> 172.21.15.45:0/2020412066 conn(0x7fc6900fc0f0 msgr2=0x7fc6900fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:14.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.234+0000 7fc69651c700 1 -- 172.21.15.45:0/2020412066 shutdown_connections 2024-05-10T03:40:14.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.234+0000 7fc69651c700 1 -- 172.21.15.45:0/2020412066 wait complete. 2024-05-10T03:40:14.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.235+0000 7fc69651c700 1 Processor -- start 2024-05-10T03:40:14.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.235+0000 7fc69651c700 1 -- start start 2024-05-10T03:40:14.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.235+0000 7fc69651c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc690100ac0 0x7fc690104880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:14.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.235+0000 7fc69651c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc690101be0 0x7fc690102f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:14.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.235+0000 7fc69651c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc690102580 0x7fc690103460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:14.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.235+0000 7fc69651c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc690103ac0 con 0x7fc690100ac0 2024-05-10T03:40:14.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.235+0000 7fc69651c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc690103c30 con 0x7fc690101be0 2024-05-10T03:40:14.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.235+0000 7fc69651c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc690103df0 con 0x7fc690102580 2024-05-10T03:40:14.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.235+0000 7fc68ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc690100ac0 0x7fc690104880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:14.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.235+0000 7fc68ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc690100ac0 0x7fc690104880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52654/0 (socket says 172.21.15.45:52654) 2024-05-10T03:40:14.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.235+0000 7fc68ffff700 1 -- 172.21.15.45:0/1160950095 learned_addr learned my addr 172.21.15.45:0/1160950095 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:14.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.235+0000 7fc68f7fe700 1 --2- 172.21.15.45:0/1160950095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc690101be0 0x7fc690102f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:14.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.235+0000 7fc694ab9700 1 --2- 172.21.15.45:0/1160950095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc690102580 0x7fc690103460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:14.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.235+0000 7fc68ffff700 1 -- 172.21.15.45:0/1160950095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc690102580 msgr2=0x7fc690103460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:14.242 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.235+0000 7fc68ffff700 1 --2- 172.21.15.45:0/1160950095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc690102580 0x7fc690103460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.242 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.236+0000 7fc68ffff700 1 -- 172.21.15.45:0/1160950095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc690101be0 msgr2=0x7fc690102f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:14.242 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.236+0000 7fc68ffff700 1 --2- 172.21.15.45:0/1160950095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc690101be0 0x7fc690102f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.242 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.236+0000 7fc68ffff700 1 -- 172.21.15.45:0/1160950095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc688009d00 con 0x7fc690100ac0 2024-05-10T03:40:14.242 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.236+0000 7fc694ab9700 1 --2- 172.21.15.45:0/1160950095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc690102580 0x7fc690103460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:40:14.242 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.236+0000 7fc68ffff700 1 --2- 172.21.15.45:0/1160950095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc690100ac0 0x7fc690104880 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc68000e940 tx=0x7fc68000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:14.242 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.236+0000 7fc68d7fa700 1 -- 172.21.15.45:0/1160950095 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68000cbd0 con 0x7fc690100ac0 2024-05-10T03:40:14.242 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.236+0000 7fc69651c700 1 -- 172.21.15.45:0/1160950095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6901a2450 con 0x7fc690100ac0 2024-05-10T03:40:14.242 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.236+0000 7fc68d7fa700 1 -- 172.21.15.45:0/1160950095 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc680004500 con 0x7fc690100ac0 2024-05-10T03:40:14.242 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.236+0000 7fc68d7fa700 1 -- 172.21.15.45:0/1160950095 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc680003e30 con 0x7fc690100ac0 2024-05-10T03:40:14.242 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.236+0000 7fc69651c700 1 -- 172.21.15.45:0/1160950095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6901a2960 con 0x7fc690100ac0 2024-05-10T03:40:14.242 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.237+0000 7fc69651c700 1 -- 172.21.15.45:0/1160950095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6900683a0 con 0x7fc690100ac0 2024-05-10T03:40:14.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.239+0000 7fc68d7fa700 1 -- 172.21.15.45:0/1160950095 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fc680004000 con 0x7fc690100ac0 2024-05-10T03:40:14.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.240+0000 7fc68d7fa700 1 --2- 172.21.15.45:0/1160950095 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc6780a11b0 0x7fc6780a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:14.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.240+0000 7fc68d7fa700 1 -- 172.21.15.45:0/1160950095 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc680014070 con 0x7fc690100ac0 2024-05-10T03:40:14.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.240+0000 7fc68f7fe700 1 --2- 172.21.15.45:0/1160950095 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc6780a11b0 0x7fc6780a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:14.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.241+0000 7fc68f7fe700 1 --2- 172.21.15.45:0/1160950095 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc6780a11b0 0x7fc6780a36c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc684005950 tx=0x7fc6840058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:14.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.244+0000 7fc68d7fa700 1 -- 172.21.15.45:0/1160950095 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc6800966b0 con 0x7fc690100ac0 2024-05-10T03:40:14.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:14 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1885000360' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-10T03:40:14.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:14 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1885000360' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-10T03:40:14.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.498+0000 7fc69651c700 1 -- 172.21.15.45:0/1160950095 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6900fe170 con 0x7fc6780a11b0 2024-05-10T03:40:14.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.505+0000 7fc68d7fa700 1 -- 172.21.15.45:0/1160950095 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3 (secure 0 0 0) 0x7fc6900fe170 con 0x7fc6780a11b0 2024-05-10T03:40:14.508 INFO:teuthology.orchestra.run.smithi045.stdout:{} 2024-05-10T03:40:14.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.507+0000 7fc69651c700 1 -- 172.21.15.45:0/1160950095 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc6780a11b0 msgr2=0x7fc6780a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:14.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.507+0000 7fc69651c700 1 --2- 172.21.15.45:0/1160950095 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc6780a11b0 0x7fc6780a36c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc684005950 tx=0x7fc6840058e0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.507+0000 7fc69651c700 1 -- 172.21.15.45:0/1160950095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc690100ac0 msgr2=0x7fc690104880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:14.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.507+0000 7fc69651c700 1 --2- 172.21.15.45:0/1160950095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc690100ac0 0x7fc690104880 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc68000e940 tx=0x7fc68000ed00 comp rx=0 tx=0).stop 2024-05-10T03:40:14.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.508+0000 7fc69651c700 1 -- 172.21.15.45:0/1160950095 shutdown_connections 2024-05-10T03:40:14.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.508+0000 7fc69651c700 1 --2- 172.21.15.45:0/1160950095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc690102580 0x7fc690103460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.508+0000 7fc69651c700 1 --2- 172.21.15.45:0/1160950095 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc6780a11b0 0x7fc6780a36c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.508+0000 7fc69651c700 1 --2- 172.21.15.45:0/1160950095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc690100ac0 0x7fc690104880 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.508+0000 7fc69651c700 1 --2- 172.21.15.45:0/1160950095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc690101be0 0x7fc690102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.508+0000 7fc69651c700 1 -- 172.21.15.45:0/1160950095 >> 172.21.15.45:0/1160950095 conn(0x7fc6900fc0f0 msgr2=0x7fc6900fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:14.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.508+0000 7fc69651c700 1 -- 172.21.15.45:0/1160950095 shutdown_connections 2024-05-10T03:40:14.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.508+0000 7fc69651c700 1 -- 172.21.15.45:0/1160950095 wait complete. 2024-05-10T03:40:14.526 INFO:teuthology.run_tasks:Running task check-counter... 2024-05-10T03:40:14.536 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-05-10T03:40:14.552 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:40:14.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.699+0000 7f74c949c700 1 -- 172.21.15.45:0/2703702428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c41026f0 msgr2=0x7f74c4104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:14.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.699+0000 7f74c949c700 1 --2- 172.21.15.45:0/2703702428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c41026f0 0x7f74c4104b10 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f74b4009990 tx=0x7f74b4009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.699+0000 7f74c949c700 1 -- 172.21.15.45:0/2703702428 shutdown_connections 2024-05-10T03:40:14.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.699+0000 7f74c949c700 1 --2- 172.21.15.45:0/2703702428 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74c41079b0 0x7f74c4109dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.699+0000 7f74c949c700 1 --2- 172.21.15.45:0/2703702428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c41026f0 0x7f74c4104b10 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.699+0000 7f74c949c700 1 --2- 172.21.15.45:0/2703702428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74c4105050 0x7f74c4107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.699+0000 7f74c949c700 1 -- 172.21.15.45:0/2703702428 >> 172.21.15.45:0/2703702428 conn(0x7f74c40fc110 msgr2=0x7f74c40fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:14.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.699+0000 7f74c949c700 1 -- 172.21.15.45:0/2703702428 shutdown_connections 2024-05-10T03:40:14.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.699+0000 7f74c949c700 1 -- 172.21.15.45:0/2703702428 wait complete. 2024-05-10T03:40:14.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.700+0000 7f74c949c700 1 Processor -- start 2024-05-10T03:40:14.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.700+0000 7f74c949c700 1 -- start start 2024-05-10T03:40:14.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.700+0000 7f74c949c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74c41026f0 0x7f74c4198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:14.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.700+0000 7f74c949c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74c4105050 0x7f74c4198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:14.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.700+0000 7f74c949c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c41079b0 0x7f74c419f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:14.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.700+0000 7f74c949c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c419fba0 con 0x7f74c41079b0 2024-05-10T03:40:14.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.700+0000 7f74c949c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c419fd10 con 0x7f74c4105050 2024-05-10T03:40:14.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.700+0000 7f74c949c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c419fed0 con 0x7f74c41026f0 2024-05-10T03:40:14.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.701+0000 7f74c37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c41079b0 0x7f74c419f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:14.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.701+0000 7f74c37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c41079b0 0x7f74c419f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52674/0 (socket says 172.21.15.45:52674) 2024-05-10T03:40:14.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.701+0000 7f74c37fe700 1 -- 172.21.15.45:0/1968759507 learned_addr learned my addr 172.21.15.45:0/1968759507 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:14.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.701+0000 7f74c2ffd700 1 --2- 172.21.15.45:0/1968759507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74c41026f0 0x7f74c4198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:14.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.701+0000 7f74c27fc700 1 --2- 172.21.15.45:0/1968759507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74c4105050 0x7f74c4198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:14.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.701+0000 7f74c37fe700 1 -- 172.21.15.45:0/1968759507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74c41026f0 msgr2=0x7f74c4198110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:14.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.701+0000 7f74c37fe700 1 --2- 172.21.15.45:0/1968759507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74c41026f0 0x7f74c4198110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.701+0000 7f74c37fe700 1 -- 172.21.15.45:0/1968759507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74c4105050 msgr2=0x7f74c4198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:14.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.701+0000 7f74c37fe700 1 --2- 172.21.15.45:0/1968759507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74c4105050 0x7f74c4198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.701+0000 7f74c37fe700 1 -- 172.21.15.45:0/1968759507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b40095f0 con 0x7f74c41079b0 2024-05-10T03:40:14.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.701+0000 7f74c37fe700 1 --2- 172.21.15.45:0/1968759507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c41079b0 0x7f74c419f590 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00ef90 tx=0x7f74bc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:14.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.701+0000 7f74abfff700 1 -- 172.21.15.45:0/1968759507 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc018070 con 0x7f74c41079b0 2024-05-10T03:40:14.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.701+0000 7f74c949c700 1 -- 172.21.15.45:0/1968759507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c41a0150 con 0x7f74c41079b0 2024-05-10T03:40:14.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.701+0000 7f74abfff700 1 -- 172.21.15.45:0/1968759507 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f74bc00f040 con 0x7f74c41079b0 2024-05-10T03:40:14.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.701+0000 7f74abfff700 1 -- 172.21.15.45:0/1968759507 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc00ce00 con 0x7f74c41079b0 2024-05-10T03:40:14.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.701+0000 7f74c949c700 1 -- 172.21.15.45:0/1968759507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c41a0660 con 0x7f74c41079b0 2024-05-10T03:40:14.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.703+0000 7f74c949c700 1 -- 172.21.15.45:0/1968759507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c40fdcc0 con 0x7f74c41079b0 2024-05-10T03:40:14.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.704+0000 7f74abfff700 1 -- 172.21.15.45:0/1968759507 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f74bc003a00 con 0x7f74c41079b0 2024-05-10T03:40:14.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.705+0000 7f74abfff700 1 --2- 172.21.15.45:0/1968759507 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f74ac0a11b0 0x7f74ac0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:14.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.705+0000 7f74abfff700 1 -- 172.21.15.45:0/1968759507 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f74bc0cd2d0 con 0x7f74c41079b0 2024-05-10T03:40:14.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.705+0000 7f74c2ffd700 1 --2- 172.21.15.45:0/1968759507 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f74ac0a11b0 0x7f74ac0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:14.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.705+0000 7f74c2ffd700 1 --2- 172.21.15.45:0/1968759507 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f74ac0a11b0 0x7f74ac0a36c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f74b400b2e0 tx=0x7f74b401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:14.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.708+0000 7f74abfff700 1 -- 172.21.15.45:0/1968759507 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f74bc096620 con 0x7f74c41079b0 2024-05-10T03:40:14.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.926+0000 7f74c949c700 1 -- 172.21.15.45:0/1968759507 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74c410d6a0 con 0x7f74c41079b0 2024-05-10T03:40:14.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.928+0000 7f74abfff700 1 -- 172.21.15.45:0/1968759507 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+24508 (secure 0 0 0) 0x7f74bc099c40 con 0x7f74c41079b0 2024-05-10T03:40:14.932 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:40:14.932 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":88,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:39:27.064512+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:38:34.871801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:38:35.935386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T03:38:39.029903+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:40:14.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.930+0000 7f74c949c700 1 -- 172.21.15.45:0/1968759507 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f74ac0a11b0 msgr2=0x7f74ac0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:14.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.930+0000 7f74c949c700 1 --2- 172.21.15.45:0/1968759507 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f74ac0a11b0 0x7f74ac0a36c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f74b400b2e0 tx=0x7f74b401a040 comp rx=0 tx=0).stop 2024-05-10T03:40:14.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.930+0000 7f74c949c700 1 -- 172.21.15.45:0/1968759507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c41079b0 msgr2=0x7f74c419f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:14.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.930+0000 7f74c949c700 1 --2- 172.21.15.45:0/1968759507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c41079b0 0x7f74c419f590 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00ef90 tx=0x7f74bc00c3a0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.930+0000 7f74c949c700 1 -- 172.21.15.45:0/1968759507 shutdown_connections 2024-05-10T03:40:14.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.930+0000 7f74c949c700 1 --2- 172.21.15.45:0/1968759507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74c41026f0 0x7f74c4198110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.930+0000 7f74c949c700 1 --2- 172.21.15.45:0/1968759507 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f74ac0a11b0 0x7f74ac0a36c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.930+0000 7f74c949c700 1 --2- 172.21.15.45:0/1968759507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74c41079b0 0x7f74c419f590 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.930+0000 7f74c949c700 1 --2- 172.21.15.45:0/1968759507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74c4105050 0x7f74c4198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:14.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.930+0000 7f74c949c700 1 -- 172.21.15.45:0/1968759507 >> 172.21.15.45:0/1968759507 conn(0x7f74c40fc110 msgr2=0x7f74c4103280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:14.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.931+0000 7f74c949c700 1 -- 172.21.15.45:0/1968759507 shutdown_connections 2024-05-10T03:40:14.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:14.931+0000 7f74c949c700 1 -- 172.21.15.45:0/1968759507 wait complete. 2024-05-10T03:40:14.949 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T03:35:20.339400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T03:38:34.871801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T03:38:35.935386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-10T03:38:39.029903+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-10T03:40:14.949 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T03:40:15.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.100+0000 7f5a18494700 1 -- 172.21.15.45:0/434954237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a10100ac0 msgr2=0x7f5a10100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:15.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.100+0000 7f5a18494700 1 --2- 172.21.15.45:0/434954237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a10100ac0 0x7f5a10100ed0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c009990 tx=0x7f5a0c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.100+0000 7f5a18494700 1 -- 172.21.15.45:0/434954237 shutdown_connections 2024-05-10T03:40:15.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.100+0000 7f5a18494700 1 --2- 172.21.15.45:0/434954237 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a10102580 0x7f5a10108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.100+0000 7f5a18494700 1 --2- 172.21.15.45:0/434954237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a10100ac0 0x7f5a10100ed0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.100+0000 7f5a18494700 1 --2- 172.21.15.45:0/434954237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a10101be0 0x7f5a10101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.100+0000 7f5a18494700 1 -- 172.21.15.45:0/434954237 >> 172.21.15.45:0/434954237 conn(0x7f5a100fc0d0 msgr2=0x7f5a100fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:15.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.100+0000 7f5a18494700 1 -- 172.21.15.45:0/434954237 shutdown_connections 2024-05-10T03:40:15.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.100+0000 7f5a18494700 1 -- 172.21.15.45:0/434954237 wait complete. 2024-05-10T03:40:15.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.100+0000 7f5a18494700 1 Processor -- start 2024-05-10T03:40:15.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.100+0000 7f5a18494700 1 -- start start 2024-05-10T03:40:15.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.101+0000 7f5a18494700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a10100ac0 0x7f5a10068e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:15.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.101+0000 7f5a18494700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a10101be0 0x7f5a1019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:15.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.101+0000 7f5a18494700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a10102580 0x7f5a1019f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:15.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.101+0000 7f5a18494700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1019fa90 con 0x7f5a10101be0 2024-05-10T03:40:15.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.101+0000 7f5a18494700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1019fc00 con 0x7f5a10100ac0 2024-05-10T03:40:15.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.101+0000 7f5a18494700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1019fdc0 con 0x7f5a10102580 2024-05-10T03:40:15.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.101+0000 7f5a15a2f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a10101be0 0x7f5a1019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:15.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.101+0000 7f5a15a2f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a10101be0 0x7f5a1019cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52682/0 (socket says 172.21.15.45:52682) 2024-05-10T03:40:15.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.101+0000 7f5a15a2f700 1 -- 172.21.15.45:0/3458421995 learned_addr learned my addr 172.21.15.45:0/3458421995 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:15.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.101+0000 7f5a16a31700 1 --2- 172.21.15.45:0/3458421995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a10102580 0x7f5a1019f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:15.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.101+0000 7f5a16230700 1 --2- 172.21.15.45:0/3458421995 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a10100ac0 0x7f5a10068e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:15.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.101+0000 7f5a15a2f700 1 -- 172.21.15.45:0/3458421995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a10102580 msgr2=0x7f5a1019f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:15.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.101+0000 7f5a15a2f700 1 --2- 172.21.15.45:0/3458421995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a10102580 0x7f5a1019f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.101+0000 7f5a15a2f700 1 -- 172.21.15.45:0/3458421995 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a10100ac0 msgr2=0x7f5a10068e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:15.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.101+0000 7f5a15a2f700 1 --2- 172.21.15.45:0/3458421995 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a10100ac0 0x7f5a10068e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.101+0000 7f5a15a2f700 1 -- 172.21.15.45:0/3458421995 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0c0095f0 con 0x7f5a10101be0 2024-05-10T03:40:15.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.101+0000 7f5a15a2f700 1 --2- 172.21.15.45:0/3458421995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a10101be0 0x7f5a1019cd80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5a0000d980 tx=0x7f5a0000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:15.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.102+0000 7f5a077fe700 1 -- 172.21.15.45:0/3458421995 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a00004220 con 0x7f5a10101be0 2024-05-10T03:40:15.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.102+0000 7f5a18494700 1 -- 172.21.15.45:0/3458421995 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a101a00a0 con 0x7f5a10101be0 2024-05-10T03:40:15.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.102+0000 7f5a077fe700 1 -- 172.21.15.45:0/3458421995 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5a00007640 con 0x7f5a10101be0 2024-05-10T03:40:15.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.102+0000 7f5a077fe700 1 -- 172.21.15.45:0/3458421995 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a00005720 con 0x7f5a10101be0 2024-05-10T03:40:15.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.102+0000 7f5a18494700 1 -- 172.21.15.45:0/3458421995 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a101a0600 con 0x7f5a10101be0 2024-05-10T03:40:15.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.103+0000 7f5a18494700 1 -- 172.21.15.45:0/3458421995 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a10107cd0 con 0x7f5a10101be0 2024-05-10T03:40:15.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.104+0000 7f5a077fe700 1 -- 172.21.15.45:0/3458421995 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f5a00004410 con 0x7f5a10101be0 2024-05-10T03:40:15.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.105+0000 7f5a077fe700 1 --2- 172.21.15.45:0/3458421995 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f59fc0a1260 0x7f59fc0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:15.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.105+0000 7f5a16230700 1 --2- 172.21.15.45:0/3458421995 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f59fc0a1260 0x7f59fc0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:15.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.105+0000 7f5a077fe700 1 -- 172.21.15.45:0/3458421995 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f5a000cd160 con 0x7f5a10101be0 2024-05-10T03:40:15.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.106+0000 7f5a16230700 1 --2- 172.21.15.45:0/3458421995 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f59fc0a1260 0x7f59fc0a3770 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c003930 tx=0x7f5a0c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:15.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.109+0000 7f5a077fe700 1 -- 172.21.15.45:0/3458421995 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5a00096480 con 0x7f5a10101be0 2024-05-10T03:40:15.283 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:15 smithi045 ceph-mon[42520]: pgmap v282: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-10T03:40:15.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:15 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1885000360' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-10T03:40:15.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:15 smithi045 ceph-mon[42520]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:40:15.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:15 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1968759507' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:40:15.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.342+0000 7f5a18494700 1 -- 172.21.15.45:0/3458421995 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5a100694d0 con 0x7f5a10101be0 2024-05-10T03:40:15.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.342+0000 7f5a077fe700 1 -- 172.21.15.45:0/3458421995 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5a000160a0 con 0x7f5a10101be0 2024-05-10T03:40:15.346 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-05-10T03:40:15.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.345+0000 7f5a18494700 1 -- 172.21.15.45:0/3458421995 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f59fc0a1260 msgr2=0x7f59fc0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:15.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.345+0000 7f5a18494700 1 --2- 172.21.15.45:0/3458421995 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f59fc0a1260 0x7f59fc0a3770 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c003930 tx=0x7f5a0c01a040 comp rx=0 tx=0).stop 2024-05-10T03:40:15.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.345+0000 7f5a18494700 1 -- 172.21.15.45:0/3458421995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a10101be0 msgr2=0x7f5a1019cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:15.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.345+0000 7f5a18494700 1 --2- 172.21.15.45:0/3458421995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a10101be0 0x7f5a1019cd80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5a0000d980 tx=0x7f5a0000dc90 comp rx=0 tx=0).stop 2024-05-10T03:40:15.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.345+0000 7f5a18494700 1 -- 172.21.15.45:0/3458421995 shutdown_connections 2024-05-10T03:40:15.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.345+0000 7f5a18494700 1 --2- 172.21.15.45:0/3458421995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a10102580 0x7f5a1019f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.345+0000 7f5a18494700 1 --2- 172.21.15.45:0/3458421995 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f59fc0a1260 0x7f59fc0a3770 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.345+0000 7f5a18494700 1 --2- 172.21.15.45:0/3458421995 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a10100ac0 0x7f5a10068e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.345+0000 7f5a18494700 1 --2- 172.21.15.45:0/3458421995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a10101be0 0x7f5a1019cd80 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.345+0000 7f5a18494700 1 -- 172.21.15.45:0/3458421995 >> 172.21.15.45:0/3458421995 conn(0x7f5a100fc0d0 msgr2=0x7f5a10104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:15.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.345+0000 7f5a18494700 1 -- 172.21.15.45:0/3458421995 shutdown_connections 2024-05-10T03:40:15.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.345+0000 7f5a18494700 1 -- 172.21.15.45:0/3458421995 wait complete. 2024-05-10T03:40:15.363 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T03:40:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:15 smithi106 ceph-mon[46996]: pgmap v282: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-10T03:40:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:15 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1885000360' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-10T03:40:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:15 smithi106 ceph-mon[46996]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:40:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:15 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1968759507' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:40:15.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:15 smithi154 ceph-mon[46565]: pgmap v282: 129 pgs: 129 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-10T03:40:15.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:15 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1885000360' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-10T03:40:15.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:15 smithi154 ceph-mon[46565]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:40:15.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:15 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1968759507' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:40:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.512+0000 7fb145dcb700 1 -- 172.21.15.45:0/1910226714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb140102cf0 msgr2=0x7fb140103100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.512+0000 7fb145dcb700 1 --2- 172.21.15.45:0/1910226714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb140102cf0 0x7fb140103100 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb134009990 tx=0x7fb134009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.512+0000 7fb145dcb700 1 -- 172.21.15.45:0/1910226714 shutdown_connections 2024-05-10T03:40:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.512+0000 7fb145dcb700 1 --2- 172.21.15.45:0/1910226714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb140103690 0x7fb140109f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.512+0000 7fb145dcb700 1 --2- 172.21.15.45:0/1910226714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb140101bd0 0x7fb140101fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.512+0000 7fb145dcb700 1 --2- 172.21.15.45:0/1910226714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb140102cf0 0x7fb140103100 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.512+0000 7fb145dcb700 1 -- 172.21.15.45:0/1910226714 >> 172.21.15.45:0/1910226714 conn(0x7fb1400fd1e0 msgr2=0x7fb1400ff690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:15.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.512+0000 7fb145dcb700 1 -- 172.21.15.45:0/1910226714 shutdown_connections 2024-05-10T03:40:15.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.512+0000 7fb145dcb700 1 -- 172.21.15.45:0/1910226714 wait complete. 2024-05-10T03:40:15.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.513+0000 7fb145dcb700 1 Processor -- start 2024-05-10T03:40:15.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.513+0000 7fb145dcb700 1 -- start start 2024-05-10T03:40:15.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.513+0000 7fb145dcb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb140101bd0 0x7fb140197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:15.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.513+0000 7fb145dcb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb140102cf0 0x7fb1401984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:15.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.513+0000 7fb145dcb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb140103690 0x7fb14019f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:15.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.513+0000 7fb145dcb700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14019fa80 con 0x7fb140103690 2024-05-10T03:40:15.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.513+0000 7fb145dcb700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14019fbf0 con 0x7fb140102cf0 2024-05-10T03:40:15.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.513+0000 7fb145dcb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14019fdb0 con 0x7fb140101bd0 2024-05-10T03:40:15.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.513+0000 7fb13ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb140103690 0x7fb14019f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:15.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.513+0000 7fb13ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb140103690 0x7fb14019f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52702/0 (socket says 172.21.15.45:52702) 2024-05-10T03:40:15.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.513+0000 7fb13ffff700 1 -- 172.21.15.45:0/4260960455 learned_addr learned my addr 172.21.15.45:0/4260960455 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:15.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.513+0000 7fb13f7fe700 1 --2- 172.21.15.45:0/4260960455 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb140101bd0 0x7fb140197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:15.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.514+0000 7fb13effd700 1 --2- 172.21.15.45:0/4260960455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb140102cf0 0x7fb1401984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:15.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.514+0000 7fb13ffff700 1 -- 172.21.15.45:0/4260960455 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb140101bd0 msgr2=0x7fb140197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:15.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.514+0000 7fb13ffff700 1 --2- 172.21.15.45:0/4260960455 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb140101bd0 0x7fb140197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.514+0000 7fb13ffff700 1 -- 172.21.15.45:0/4260960455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb140102cf0 msgr2=0x7fb1401984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:15.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.514+0000 7fb13ffff700 1 --2- 172.21.15.45:0/4260960455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb140102cf0 0x7fb1401984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.514+0000 7fb13ffff700 1 -- 172.21.15.45:0/4260960455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1340095f0 con 0x7fb140103690 2024-05-10T03:40:15.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.514+0000 7fb13ffff700 1 --2- 172.21.15.45:0/4260960455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb140103690 0x7fb14019f470 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb138007ee0 tx=0x7fb13800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:15.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.514+0000 7fb13cff9700 1 -- 172.21.15.45:0/4260960455 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb138017070 con 0x7fb140103690 2024-05-10T03:40:15.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.514+0000 7fb13cff9700 1 -- 172.21.15.45:0/4260960455 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb13800f040 con 0x7fb140103690 2024-05-10T03:40:15.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.514+0000 7fb145dcb700 1 -- 172.21.15.45:0/4260960455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1401a0090 con 0x7fb140103690 2024-05-10T03:40:15.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.514+0000 7fb13cff9700 1 -- 172.21.15.45:0/4260960455 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb138005610 con 0x7fb140103690 2024-05-10T03:40:15.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.514+0000 7fb145dcb700 1 -- 172.21.15.45:0/4260960455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1401a05a0 con 0x7fb140103690 2024-05-10T03:40:15.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.515+0000 7fb145dcb700 1 -- 172.21.15.45:0/4260960455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb140108de0 con 0x7fb140103690 2024-05-10T03:40:15.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.517+0000 7fb13cff9700 1 -- 172.21.15.45:0/4260960455 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb138005770 con 0x7fb140103690 2024-05-10T03:40:15.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.517+0000 7fb13cff9700 1 --2- 172.21.15.45:0/4260960455 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb1280a12e0 0x7fb1280a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:15.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.517+0000 7fb13f7fe700 1 --2- 172.21.15.45:0/4260960455 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb1280a12e0 0x7fb1280a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:15.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.517+0000 7fb13cff9700 1 -- 172.21.15.45:0/4260960455 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb1380cc9e0 con 0x7fb140103690 2024-05-10T03:40:15.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.518+0000 7fb13f7fe700 1 --2- 172.21.15.45:0/4260960455 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb1280a12e0 0x7fb1280a37f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb140102bf0 tx=0x7fb130007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:15.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.521+0000 7fb13cff9700 1 -- 172.21.15.45:0/4260960455 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb138095d00 con 0x7fb140103690 2024-05-10T03:40:15.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.739+0000 7fb145dcb700 1 -- 172.21.15.45:0/4260960455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb14010d510 con 0x7fb140103690 2024-05-10T03:40:15.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.740+0000 7fb13cff9700 1 -- 172.21.15.45:0/4260960455 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb138099320 con 0x7fb140103690 2024-05-10T03:40:15.743 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-05-10T03:40:15.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.742+0000 7fb145dcb700 1 -- 172.21.15.45:0/4260960455 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb1280a12e0 msgr2=0x7fb1280a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:15.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.742+0000 7fb145dcb700 1 --2- 172.21.15.45:0/4260960455 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb1280a12e0 0x7fb1280a37f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb140102bf0 tx=0x7fb130007400 comp rx=0 tx=0).stop 2024-05-10T03:40:15.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.742+0000 7fb145dcb700 1 -- 172.21.15.45:0/4260960455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb140103690 msgr2=0x7fb14019f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:15.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.742+0000 7fb145dcb700 1 --2- 172.21.15.45:0/4260960455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb140103690 0x7fb14019f470 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb138007ee0 tx=0x7fb13800d3b0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.743+0000 7fb145dcb700 1 -- 172.21.15.45:0/4260960455 shutdown_connections 2024-05-10T03:40:15.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.743+0000 7fb145dcb700 1 --2- 172.21.15.45:0/4260960455 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb140101bd0 0x7fb140197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.743+0000 7fb145dcb700 1 --2- 172.21.15.45:0/4260960455 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb1280a12e0 0x7fb1280a37f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.743+0000 7fb145dcb700 1 --2- 172.21.15.45:0/4260960455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb140103690 0x7fb14019f470 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.743+0000 7fb145dcb700 1 --2- 172.21.15.45:0/4260960455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb140102cf0 0x7fb1401984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.743+0000 7fb145dcb700 1 -- 172.21.15.45:0/4260960455 >> 172.21.15.45:0/4260960455 conn(0x7fb1400fd1e0 msgr2=0x7fb140105f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:15.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.743+0000 7fb145dcb700 1 -- 172.21.15.45:0/4260960455 shutdown_connections 2024-05-10T03:40:15.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.743+0000 7fb145dcb700 1 -- 172.21.15.45:0/4260960455 wait complete. 2024-05-10T03:40:15.761 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T03:40:15.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.909+0000 7fb5ffac6700 1 -- 172.21.15.45:0/1863367675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5f8100ac0 msgr2=0x7fb5f8100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:15.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.909+0000 7fb5ffac6700 1 --2- 172.21.15.45:0/1863367675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5f8100ac0 0x7fb5f8100ed0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400b0a0 tx=0x7fb5f400b3b0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.910+0000 7fb5ffac6700 1 -- 172.21.15.45:0/1863367675 shutdown_connections 2024-05-10T03:40:15.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.910+0000 7fb5ffac6700 1 --2- 172.21.15.45:0/1863367675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f8102580 0x7fb5f8108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.910+0000 7fb5ffac6700 1 --2- 172.21.15.45:0/1863367675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5f8100ac0 0x7fb5f8100ed0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.910+0000 7fb5ffac6700 1 --2- 172.21.15.45:0/1863367675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f8101be0 0x7fb5f8101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.910+0000 7fb5ffac6700 1 -- 172.21.15.45:0/1863367675 >> 172.21.15.45:0/1863367675 conn(0x7fb5f80fc0d0 msgr2=0x7fb5f80fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:15.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.910+0000 7fb5ffac6700 1 -- 172.21.15.45:0/1863367675 shutdown_connections 2024-05-10T03:40:15.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.910+0000 7fb5ffac6700 1 -- 172.21.15.45:0/1863367675 wait complete. 2024-05-10T03:40:15.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.910+0000 7fb5ffac6700 1 Processor -- start 2024-05-10T03:40:15.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.911+0000 7fb5ffac6700 1 -- start start 2024-05-10T03:40:15.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.911+0000 7fb5ffac6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f8100ac0 0x7fb5f819a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:15.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.911+0000 7fb5ffac6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5f8101be0 0x7fb5f819a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:15.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.911+0000 7fb5ffac6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f8102580 0x7fb5f81a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:15.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.911+0000 7fb5ffac6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f81a1e40 con 0x7fb5f8101be0 2024-05-10T03:40:15.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.911+0000 7fb5ffac6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f81a1fb0 con 0x7fb5f8102580 2024-05-10T03:40:15.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.911+0000 7fb5ffac6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f81a2170 con 0x7fb5f8100ac0 2024-05-10T03:40:15.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.911+0000 7fb5fd061700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5f8101be0 0x7fb5f819a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:15.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.911+0000 7fb5fd061700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5f8101be0 0x7fb5f819a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52730/0 (socket says 172.21.15.45:52730) 2024-05-10T03:40:15.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.911+0000 7fb5fd061700 1 -- 172.21.15.45:0/3989402829 learned_addr learned my addr 172.21.15.45:0/3989402829 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:15.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.911+0000 7fb5fd862700 1 --2- 172.21.15.45:0/3989402829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f8100ac0 0x7fb5f819a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:15.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.911+0000 7fb5fe063700 1 --2- 172.21.15.45:0/3989402829 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f8102580 0x7fb5f81a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:15.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.911+0000 7fb5fd061700 1 -- 172.21.15.45:0/3989402829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f8100ac0 msgr2=0x7fb5f819a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:15.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.911+0000 7fb5fd061700 1 --2- 172.21.15.45:0/3989402829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f8100ac0 0x7fb5f819a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.911+0000 7fb5fd061700 1 -- 172.21.15.45:0/3989402829 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f8102580 msgr2=0x7fb5f81a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:15.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.911+0000 7fb5fd061700 1 --2- 172.21.15.45:0/3989402829 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f8102580 0x7fb5f81a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:15.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.911+0000 7fb5fd061700 1 -- 172.21.15.45:0/3989402829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f4009d00 con 0x7fb5f8101be0 2024-05-10T03:40:15.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.912+0000 7fb5fd061700 1 --2- 172.21.15.45:0/3989402829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5f8101be0 0x7fb5f819a8a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb5e800e9a0 tx=0x7fb5e800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:15.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.912+0000 7fb5eeffd700 1 -- 172.21.15.45:0/3989402829 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8009790 con 0x7fb5f8101be0 2024-05-10T03:40:15.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.912+0000 7fb5eeffd700 1 -- 172.21.15.45:0/3989402829 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb5e8010430 con 0x7fb5f8101be0 2024-05-10T03:40:15.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.912+0000 7fb5eeffd700 1 -- 172.21.15.45:0/3989402829 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8018680 con 0x7fb5f8101be0 2024-05-10T03:40:15.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.912+0000 7fb5ffac6700 1 -- 172.21.15.45:0/3989402829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f81a2450 con 0x7fb5f8101be0 2024-05-10T03:40:15.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.912+0000 7fb5ffac6700 1 -- 172.21.15.45:0/3989402829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f81a2910 con 0x7fb5f8101be0 2024-05-10T03:40:15.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.913+0000 7fb5ffac6700 1 -- 172.21.15.45:0/3989402829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f80694d0 con 0x7fb5f8101be0 2024-05-10T03:40:15.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.915+0000 7fb5eeffd700 1 -- 172.21.15.45:0/3989402829 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb5e8010910 con 0x7fb5f8101be0 2024-05-10T03:40:15.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.915+0000 7fb5eeffd700 1 --2- 172.21.15.45:0/3989402829 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb5e40a12e0 0x7fb5e40a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:15.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.915+0000 7fb5fd862700 1 --2- 172.21.15.45:0/3989402829 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb5e40a12e0 0x7fb5e40a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:15.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.915+0000 7fb5eeffd700 1 -- 172.21.15.45:0/3989402829 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb5e8014070 con 0x7fb5f8101be0 2024-05-10T03:40:15.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.916+0000 7fb5fd862700 1 --2- 172.21.15.45:0/3989402829 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb5e40a12e0 0x7fb5e40a37f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4000f80 tx=0x7fb5f40060c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:15.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:15.919+0000 7fb5eeffd700 1 -- 172.21.15.45:0/3989402829 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb5e80966b0 con 0x7fb5f8101be0 2024-05-10T03:40:16.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.141+0000 7fb5ffac6700 1 -- 172.21.15.45:0/3989402829 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb5f810c570 con 0x7fb5f8101be0 2024-05-10T03:40:16.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.141+0000 7fb5eeffd700 1 -- 172.21.15.45:0/3989402829 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb5e80105a0 con 0x7fb5f8101be0 2024-05-10T03:40:16.145 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2024-05-10T03:40:16.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.143+0000 7fb5ffac6700 1 -- 172.21.15.45:0/3989402829 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb5e40a12e0 msgr2=0x7fb5e40a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:16.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.143+0000 7fb5ffac6700 1 --2- 172.21.15.45:0/3989402829 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb5e40a12e0 0x7fb5e40a37f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4000f80 tx=0x7fb5f40060c0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.143+0000 7fb5ffac6700 1 -- 172.21.15.45:0/3989402829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5f8101be0 msgr2=0x7fb5f819a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:16.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.143+0000 7fb5ffac6700 1 --2- 172.21.15.45:0/3989402829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5f8101be0 0x7fb5f819a8a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb5e800e9a0 tx=0x7fb5e800ecb0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.143+0000 7fb5ffac6700 1 -- 172.21.15.45:0/3989402829 shutdown_connections 2024-05-10T03:40:16.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.143+0000 7fb5ffac6700 1 --2- 172.21.15.45:0/3989402829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5f8100ac0 0x7fb5f819a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.144+0000 7fb5ffac6700 1 --2- 172.21.15.45:0/3989402829 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb5e40a12e0 0x7fb5e40a37f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.144+0000 7fb5ffac6700 1 --2- 172.21.15.45:0/3989402829 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f8102580 0x7fb5f81a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.144+0000 7fb5ffac6700 1 --2- 172.21.15.45:0/3989402829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5f8101be0 0x7fb5f819a8a0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.144+0000 7fb5ffac6700 1 -- 172.21.15.45:0/3989402829 >> 172.21.15.45:0/3989402829 conn(0x7fb5f80fc0d0 msgr2=0x7fb5f80fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:16.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.144+0000 7fb5ffac6700 1 -- 172.21.15.45:0/3989402829 shutdown_connections 2024-05-10T03:40:16.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.144+0000 7fb5ffac6700 1 -- 172.21.15.45:0/3989402829 wait complete. 2024-05-10T03:40:16.161 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-10T03:40:16.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.311+0000 7f292d743700 1 -- 172.21.15.45:0/1369620221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2928105020 msgr2=0x7f2928107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:16.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.311+0000 7f292d743700 1 --2- 172.21.15.45:0/1369620221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2928105020 0x7f2928107440 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f291c009990 tx=0x7f291c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.311+0000 7f292d743700 1 -- 172.21.15.45:0/1369620221 shutdown_connections 2024-05-10T03:40:16.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.311+0000 7f292d743700 1 --2- 172.21.15.45:0/1369620221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2928107980 0x7f2928109da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.311+0000 7f292d743700 1 --2- 172.21.15.45:0/1369620221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29281026c0 0x7f2928104ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.311+0000 7f292d743700 1 --2- 172.21.15.45:0/1369620221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2928105020 0x7f2928107440 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.311+0000 7f292d743700 1 -- 172.21.15.45:0/1369620221 >> 172.21.15.45:0/1369620221 conn(0x7f29280fc0e0 msgr2=0x7f29280fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:16.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.311+0000 7f292d743700 1 -- 172.21.15.45:0/1369620221 shutdown_connections 2024-05-10T03:40:16.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.311+0000 7f292d743700 1 -- 172.21.15.45:0/1369620221 wait complete. 2024-05-10T03:40:16.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.312+0000 7f292d743700 1 Processor -- start 2024-05-10T03:40:16.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.313+0000 7f292d743700 1 -- start start 2024-05-10T03:40:16.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.313+0000 7f292d743700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29281026c0 0x7f2928198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:16.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.313+0000 7f292d743700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2928105020 0x7f2928198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:16.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.313+0000 7f292d743700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2928107980 0x7f292819f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:16.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.313+0000 7f292d743700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292819faf0 con 0x7f2928107980 2024-05-10T03:40:16.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.313+0000 7f292d743700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292819fc60 con 0x7f2928105020 2024-05-10T03:40:16.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.313+0000 7f292d743700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292819fe20 con 0x7f29281026c0 2024-05-10T03:40:16.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.313+0000 7f29277fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2928107980 0x7f292819f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:16.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.313+0000 7f29277fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2928107980 0x7f292819f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52746/0 (socket says 172.21.15.45:52746) 2024-05-10T03:40:16.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.313+0000 7f29277fe700 1 -- 172.21.15.45:0/3404996534 learned_addr learned my addr 172.21.15.45:0/3404996534 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:16.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.313+0000 7f2926ffd700 1 --2- 172.21.15.45:0/3404996534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29281026c0 0x7f2928198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:16.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.313+0000 7f29267fc700 1 --2- 172.21.15.45:0/3404996534 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2928105020 0x7f2928198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:16.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.313+0000 7f29277fe700 1 -- 172.21.15.45:0/3404996534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29281026c0 msgr2=0x7f2928198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:16.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.313+0000 7f29277fe700 1 --2- 172.21.15.45:0/3404996534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29281026c0 0x7f2928198010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.313+0000 7f29277fe700 1 -- 172.21.15.45:0/3404996534 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2928105020 msgr2=0x7f2928198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:16.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.313+0000 7f29277fe700 1 --2- 172.21.15.45:0/3404996534 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2928105020 0x7f2928198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.313+0000 7f29277fe700 1 -- 172.21.15.45:0/3404996534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291c0095f0 con 0x7f2928107980 2024-05-10T03:40:16.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.313+0000 7f29267fc700 1 --2- 172.21.15.45:0/3404996534 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2928105020 0x7f2928198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:16.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.314+0000 7f29277fe700 1 --2- 172.21.15.45:0/3404996534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2928107980 0x7f292819f4e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f292000ef90 tx=0x7f292000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:16.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.314+0000 7f290ffff700 1 -- 172.21.15.45:0/3404996534 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2920018070 con 0x7f2928107980 2024-05-10T03:40:16.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.314+0000 7f292d743700 1 -- 172.21.15.45:0/3404996534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29281a00a0 con 0x7f2928107980 2024-05-10T03:40:16.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.314+0000 7f290ffff700 1 -- 172.21.15.45:0/3404996534 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f292000f040 con 0x7f2928107980 2024-05-10T03:40:16.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.314+0000 7f290ffff700 1 -- 172.21.15.45:0/3404996534 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2920004020 con 0x7f2928107980 2024-05-10T03:40:16.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.314+0000 7f292d743700 1 -- 172.21.15.45:0/3404996534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29281a05b0 con 0x7f2928107980 2024-05-10T03:40:16.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.315+0000 7f292d743700 1 -- 172.21.15.45:0/3404996534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29280fdc90 con 0x7f2928107980 2024-05-10T03:40:16.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.317+0000 7f290ffff700 1 -- 172.21.15.45:0/3404996534 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2920004ad0 con 0x7f2928107980 2024-05-10T03:40:16.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.318+0000 7f290ffff700 1 --2- 172.21.15.45:0/3404996534 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f29100a1260 0x7f29100a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:16.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.318+0000 7f2926ffd700 1 --2- 172.21.15.45:0/3404996534 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f29100a1260 0x7f29100a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:16.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.318+0000 7f290ffff700 1 -- 172.21.15.45:0/3404996534 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f29200cd320 con 0x7f2928107980 2024-05-10T03:40:16.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.318+0000 7f2926ffd700 1 --2- 172.21.15.45:0/3404996534 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f29100a1260 0x7f29100a3770 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2928073e60 tx=0x7f2918009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:16.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.321+0000 7f290ffff700 1 -- 172.21.15.45:0/3404996534 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2920096670 con 0x7f2928107980 2024-05-10T03:40:16.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:16 smithi106 ceph-mon[46996]: from='client.15531 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:40:16.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:16 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3458421995' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:40:16.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:16 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/4260960455' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:40:16.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:16 smithi154 ceph-mon[46565]: from='client.15531 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:40:16.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:16 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3458421995' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:40:16.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:16 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/4260960455' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:40:16.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:16 smithi045 ceph-mon[42520]: from='client.15531 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T03:40:16.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:16 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3458421995' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:40:16.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:16 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/4260960455' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:40:16.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.540+0000 7f292d743700 1 -- 172.21.15.45:0/3404996534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2928068730 con 0x7f2928107980 2024-05-10T03:40:16.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.540+0000 7f290ffff700 1 -- 172.21.15.45:0/3404996534 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2920099c90 con 0x7f2928107980 2024-05-10T03:40:16.544 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-05-10T03:40:16.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.542+0000 7f292d743700 1 -- 172.21.15.45:0/3404996534 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f29100a1260 msgr2=0x7f29100a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:16.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.542+0000 7f292d743700 1 --2- 172.21.15.45:0/3404996534 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f29100a1260 0x7f29100a3770 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2928073e60 tx=0x7f2918009260 comp rx=0 tx=0).stop 2024-05-10T03:40:16.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.542+0000 7f292d743700 1 -- 172.21.15.45:0/3404996534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2928107980 msgr2=0x7f292819f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:16.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.542+0000 7f292d743700 1 --2- 172.21.15.45:0/3404996534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2928107980 0x7f292819f4e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f292000ef90 tx=0x7f292000c3a0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.543+0000 7f292d743700 1 -- 172.21.15.45:0/3404996534 shutdown_connections 2024-05-10T03:40:16.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.543+0000 7f292d743700 1 --2- 172.21.15.45:0/3404996534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29281026c0 0x7f2928198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.543+0000 7f292d743700 1 --2- 172.21.15.45:0/3404996534 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f29100a1260 0x7f29100a3770 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.543+0000 7f292d743700 1 --2- 172.21.15.45:0/3404996534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2928107980 0x7f292819f4e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.543+0000 7f292d743700 1 --2- 172.21.15.45:0/3404996534 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2928105020 0x7f2928198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.543+0000 7f292d743700 1 -- 172.21.15.45:0/3404996534 >> 172.21.15.45:0/3404996534 conn(0x7f29280fc0e0 msgr2=0x7f2928103150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:16.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.543+0000 7f292d743700 1 -- 172.21.15.45:0/3404996534 shutdown_connections 2024-05-10T03:40:16.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.543+0000 7f292d743700 1 -- 172.21.15.45:0/3404996534 wait complete. 2024-05-10T03:40:16.561 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:40:16.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.709+0000 7fa554b2d700 1 -- 172.21.15.45:0/2360461307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa550107880 msgr2=0x7fa550109d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:16.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.709+0000 7fa554b2d700 1 --2- 172.21.15.45:0/2360461307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa550107880 0x7fa550109d90 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa548009990 tx=0x7fa548009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.709+0000 7fa554b2d700 1 -- 172.21.15.45:0/2360461307 shutdown_connections 2024-05-10T03:40:16.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.709+0000 7fa554b2d700 1 --2- 172.21.15.45:0/2360461307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa550107880 0x7fa550109d90 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.709+0000 7fa554b2d700 1 --2- 172.21.15.45:0/2360461307 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa550069090 0x7fa550104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.709+0000 7fa554b2d700 1 --2- 172.21.15.45:0/2360461307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa550104d10 0x7fa5501071f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.709+0000 7fa554b2d700 1 -- 172.21.15.45:0/2360461307 >> 172.21.15.45:0/2360461307 conn(0x7fa5500fc0d0 msgr2=0x7fa5500fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:16.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.709+0000 7fa554b2d700 1 -- 172.21.15.45:0/2360461307 shutdown_connections 2024-05-10T03:40:16.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.709+0000 7fa554b2d700 1 -- 172.21.15.45:0/2360461307 wait complete. 2024-05-10T03:40:16.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.710+0000 7fa554b2d700 1 Processor -- start 2024-05-10T03:40:16.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.710+0000 7fa554b2d700 1 -- start start 2024-05-10T03:40:16.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.710+0000 7fa554b2d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa550069090 0x7fa550101f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:16.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.710+0000 7fa554b2d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa550104d10 0x7fa550100620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:16.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.710+0000 7fa554b2d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa550107880 0x7fa550100b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.710+0000 7fa554b2d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa550101240 con 0x7fa550069090 2024-05-10T03:40:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.710+0000 7fa554b2d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5501013b0 con 0x7fa550107880 2024-05-10T03:40:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.710+0000 7fa554b2d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5501a20c0 con 0x7fa550104d10 2024-05-10T03:40:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.710+0000 7fa54e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa550069090 0x7fa550101f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.710+0000 7fa54e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa550069090 0x7fa550101f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52768/0 (socket says 172.21.15.45:52768) 2024-05-10T03:40:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.711+0000 7fa54e59c700 1 -- 172.21.15.45:0/2622154596 learned_addr learned my addr 172.21.15.45:0/2622154596 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.711+0000 7fa54ed9d700 1 --2- 172.21.15.45:0/2622154596 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa550107880 0x7fa550100b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.711+0000 7fa54dd9b700 1 --2- 172.21.15.45:0/2622154596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa550104d10 0x7fa550100620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.711+0000 7fa54e59c700 1 -- 172.21.15.45:0/2622154596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa550104d10 msgr2=0x7fa550100620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.711+0000 7fa54e59c700 1 --2- 172.21.15.45:0/2622154596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa550104d10 0x7fa550100620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.711+0000 7fa54e59c700 1 -- 172.21.15.45:0/2622154596 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa550107880 msgr2=0x7fa550100b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.711+0000 7fa54e59c700 1 --2- 172.21.15.45:0/2622154596 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa550107880 0x7fa550100b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.711+0000 7fa54e59c700 1 -- 172.21.15.45:0/2622154596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5480095f0 con 0x7fa550069090 2024-05-10T03:40:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.711+0000 7fa54e59c700 1 --2- 172.21.15.45:0/2622154596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa550069090 0x7fa550101f80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa540007ee0 tx=0x7fa54000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:16.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.711+0000 7fa53f7fe700 1 -- 172.21.15.45:0/2622154596 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa540017070 con 0x7fa550069090 2024-05-10T03:40:16.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.711+0000 7fa554b2d700 1 -- 172.21.15.45:0/2622154596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5501a2320 con 0x7fa550069090 2024-05-10T03:40:16.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.711+0000 7fa53f7fe700 1 -- 172.21.15.45:0/2622154596 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa54000f040 con 0x7fa550069090 2024-05-10T03:40:16.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.711+0000 7fa53f7fe700 1 -- 172.21.15.45:0/2622154596 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa540004440 con 0x7fa550069090 2024-05-10T03:40:16.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.711+0000 7fa554b2d700 1 -- 172.21.15.45:0/2622154596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5501a2850 con 0x7fa550069090 2024-05-10T03:40:16.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.712+0000 7fa554b2d700 1 -- 172.21.15.45:0/2622154596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5500fdc80 con 0x7fa550069090 2024-05-10T03:40:16.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.714+0000 7fa53f7fe700 1 -- 172.21.15.45:0/2622154596 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fa540003a00 con 0x7fa550069090 2024-05-10T03:40:16.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.714+0000 7fa53f7fe700 1 --2- 172.21.15.45:0/2622154596 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa5380a11b0 0x7fa5380a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:16.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.715+0000 7fa53f7fe700 1 -- 172.21.15.45:0/2622154596 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fa5400ccae0 con 0x7fa550069090 2024-05-10T03:40:16.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.715+0000 7fa54dd9b700 1 --2- 172.21.15.45:0/2622154596 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa5380a11b0 0x7fa5380a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:16.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.715+0000 7fa54dd9b700 1 --2- 172.21.15.45:0/2622154596 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa5380a11b0 0x7fa5380a36c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa550101920 tx=0x7fa544009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:16.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.718+0000 7fa53f7fe700 1 -- 172.21.15.45:0/2622154596 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa540095e00 con 0x7fa550069090 2024-05-10T03:40:16.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.937+0000 7fa554b2d700 1 -- 172.21.15.45:0/2622154596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5500694d0 con 0x7fa550069090 2024-05-10T03:40:16.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.939+0000 7fa53f7fe700 1 -- 172.21.15.45:0/2622154596 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+24508 (secure 0 0 0) 0x7fa540099420 con 0x7fa550069090 2024-05-10T03:40:16.943 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:40:16.943 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":88,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:39:27.064512+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:38:34.871801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:38:35.935386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T03:38:39.029903+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:40:16.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.941+0000 7fa554b2d700 1 -- 172.21.15.45:0/2622154596 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa5380a11b0 msgr2=0x7fa5380a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:16.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.941+0000 7fa554b2d700 1 --2- 172.21.15.45:0/2622154596 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa5380a11b0 0x7fa5380a36c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa550101920 tx=0x7fa544009260 comp rx=0 tx=0).stop 2024-05-10T03:40:16.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.941+0000 7fa554b2d700 1 -- 172.21.15.45:0/2622154596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa550069090 msgr2=0x7fa550101f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:16.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.941+0000 7fa554b2d700 1 --2- 172.21.15.45:0/2622154596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa550069090 0x7fa550101f80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa540007ee0 tx=0x7fa54000d3b0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.941+0000 7fa554b2d700 1 -- 172.21.15.45:0/2622154596 shutdown_connections 2024-05-10T03:40:16.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.941+0000 7fa554b2d700 1 --2- 172.21.15.45:0/2622154596 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa5380a11b0 0x7fa5380a36c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.941+0000 7fa554b2d700 1 --2- 172.21.15.45:0/2622154596 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa550107880 0x7fa550100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.941+0000 7fa554b2d700 1 --2- 172.21.15.45:0/2622154596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa550069090 0x7fa550101f80 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.941+0000 7fa554b2d700 1 --2- 172.21.15.45:0/2622154596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa550104d10 0x7fa550100620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:16.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.941+0000 7fa554b2d700 1 -- 172.21.15.45:0/2622154596 >> 172.21.15.45:0/2622154596 conn(0x7fa5500fc0d0 msgr2=0x7fa550102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:16.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.942+0000 7fa554b2d700 1 -- 172.21.15.45:0/2622154596 shutdown_connections 2024-05-10T03:40:16.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:16.942+0000 7fa554b2d700 1 -- 172.21.15.45:0/2622154596 wait complete. 2024-05-10T03:40:16.960 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T03:35:20.339400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T03:38:34.871801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T03:38:35.935386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-10T03:38:39.029903+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-10T03:40:16.961 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T03:40:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.110+0000 7f0e14ac9700 1 -- 172.21.15.45:0/4196144559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e10102580 msgr2=0x7f0e10108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.110+0000 7f0e14ac9700 1 --2- 172.21.15.45:0/4196144559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e10102580 0x7f0e10108e30 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0e0800b0a0 tx=0x7f0e0800b3b0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.110+0000 7f0e14ac9700 1 -- 172.21.15.45:0/4196144559 shutdown_connections 2024-05-10T03:40:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.110+0000 7f0e14ac9700 1 --2- 172.21.15.45:0/4196144559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e10100ac0 0x7f0e10100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.110+0000 7f0e14ac9700 1 --2- 172.21.15.45:0/4196144559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e10102580 0x7f0e10108e30 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.110+0000 7f0e14ac9700 1 --2- 172.21.15.45:0/4196144559 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e10101be0 0x7f0e10101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.110+0000 7f0e14ac9700 1 -- 172.21.15.45:0/4196144559 >> 172.21.15.45:0/4196144559 conn(0x7f0e100fc0d0 msgr2=0x7f0e100fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:17.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.110+0000 7f0e14ac9700 1 -- 172.21.15.45:0/4196144559 shutdown_connections 2024-05-10T03:40:17.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.110+0000 7f0e14ac9700 1 -- 172.21.15.45:0/4196144559 wait complete. 2024-05-10T03:40:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.111+0000 7f0e14ac9700 1 Processor -- start 2024-05-10T03:40:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.111+0000 7f0e14ac9700 1 -- start start 2024-05-10T03:40:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.111+0000 7f0e14ac9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e10100ac0 0x7f0e101980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.112+0000 7f0e14ac9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e10101be0 0x7f0e101985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.112+0000 7f0e14ac9700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e10102580 0x7f0e1019f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.112+0000 7f0e14ac9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1019fb90 con 0x7f0e10101be0 2024-05-10T03:40:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.112+0000 7f0e14ac9700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1019fd00 con 0x7f0e10102580 2024-05-10T03:40:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.112+0000 7f0e14ac9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1019fec0 con 0x7f0e10100ac0 2024-05-10T03:40:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.112+0000 7f0e0dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e10101be0 0x7f0e101985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.112+0000 7f0e0dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e10101be0 0x7f0e101985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52800/0 (socket says 172.21.15.45:52800) 2024-05-10T03:40:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.112+0000 7f0e0dd9b700 1 -- 172.21.15.45:0/3034108237 learned_addr learned my addr 172.21.15.45:0/3034108237 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.112+0000 7f0e0e59c700 1 --2- 172.21.15.45:0/3034108237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e10100ac0 0x7f0e101980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.112+0000 7f0e0ed9d700 1 --2- 172.21.15.45:0/3034108237 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e10102580 0x7f0e1019f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.112+0000 7f0e0dd9b700 1 -- 172.21.15.45:0/3034108237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e10100ac0 msgr2=0x7f0e101980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.112+0000 7f0e0dd9b700 1 --2- 172.21.15.45:0/3034108237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e10100ac0 0x7f0e101980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.112+0000 7f0e0dd9b700 1 -- 172.21.15.45:0/3034108237 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e10102580 msgr2=0x7f0e1019f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.112+0000 7f0e0dd9b700 1 --2- 172.21.15.45:0/3034108237 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e10102580 0x7f0e1019f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.112+0000 7f0e0dd9b700 1 -- 172.21.15.45:0/3034108237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e08009d00 con 0x7f0e10101be0 2024-05-10T03:40:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.112+0000 7f0e0dd9b700 1 --2- 172.21.15.45:0/3034108237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e10101be0 0x7f0e101985f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400e9a0 tx=0x7f0e0400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.113+0000 7f0dff7fe700 1 -- 172.21.15.45:0/3034108237 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e04009790 con 0x7f0e10101be0 2024-05-10T03:40:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.113+0000 7f0dff7fe700 1 -- 172.21.15.45:0/3034108237 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0e04010430 con 0x7f0e10101be0 2024-05-10T03:40:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.113+0000 7f0e14ac9700 1 -- 172.21.15.45:0/3034108237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e101a01a0 con 0x7f0e10101be0 2024-05-10T03:40:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.113+0000 7f0dff7fe700 1 -- 172.21.15.45:0/3034108237 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e04018680 con 0x7f0e10101be0 2024-05-10T03:40:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.113+0000 7f0e14ac9700 1 -- 172.21.15.45:0/3034108237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e101a06b0 con 0x7f0e10101be0 2024-05-10T03:40:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.114+0000 7f0e14ac9700 1 -- 172.21.15.45:0/3034108237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e100694d0 con 0x7f0e10101be0 2024-05-10T03:40:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.115+0000 7f0dff7fe700 1 -- 172.21.15.45:0/3034108237 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f0e04010910 con 0x7f0e10101be0 2024-05-10T03:40:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.116+0000 7f0dff7fe700 1 --2- 172.21.15.45:0/3034108237 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0df80a1260 0x7f0df80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.116+0000 7f0e0e59c700 1 --2- 172.21.15.45:0/3034108237 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0df80a1260 0x7f0df80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:17.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.116+0000 7f0dff7fe700 1 -- 172.21.15.45:0/3034108237 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f0e04014070 con 0x7f0e10101be0 2024-05-10T03:40:17.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.116+0000 7f0e0e59c700 1 --2- 172.21.15.45:0/3034108237 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0df80a1260 0x7f0df80a3770 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0e10101ae0 tx=0x7f0e00007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:17.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.119+0000 7f0dff7fe700 1 -- 172.21.15.45:0/3034108237 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0e040966d0 con 0x7f0e10101be0 2024-05-10T03:40:17.283 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:17 smithi045 ceph-mon[42520]: pgmap v283: 129 pgs: 129 active+clean; 650 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-10T03:40:17.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:17 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3989402829' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:40:17.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:17 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3404996534' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:40:17.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:17 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2622154596' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:40:17.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.336+0000 7f0e14ac9700 1 -- 172.21.15.45:0/3034108237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0e101a09d0 con 0x7f0e10101be0 2024-05-10T03:40:17.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.337+0000 7f0dff7fe700 1 -- 172.21.15.45:0/3034108237 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0e040105a0 con 0x7f0e10101be0 2024-05-10T03:40:17.341 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-05-10T03:40:17.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.339+0000 7f0e14ac9700 1 -- 172.21.15.45:0/3034108237 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0df80a1260 msgr2=0x7f0df80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:17.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.339+0000 7f0e14ac9700 1 --2- 172.21.15.45:0/3034108237 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0df80a1260 0x7f0df80a3770 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0e10101ae0 tx=0x7f0e00007400 comp rx=0 tx=0).stop 2024-05-10T03:40:17.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.339+0000 7f0e14ac9700 1 -- 172.21.15.45:0/3034108237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e10101be0 msgr2=0x7f0e101985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:17.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.339+0000 7f0e14ac9700 1 --2- 172.21.15.45:0/3034108237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e10101be0 0x7f0e101985f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400e9a0 tx=0x7f0e0400ecb0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.339+0000 7f0e14ac9700 1 -- 172.21.15.45:0/3034108237 shutdown_connections 2024-05-10T03:40:17.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.339+0000 7f0e14ac9700 1 --2- 172.21.15.45:0/3034108237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e10100ac0 0x7f0e101980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.339+0000 7f0e14ac9700 1 --2- 172.21.15.45:0/3034108237 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0df80a1260 0x7f0df80a3770 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.339+0000 7f0e14ac9700 1 --2- 172.21.15.45:0/3034108237 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e10102580 0x7f0e1019f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.339+0000 7f0e14ac9700 1 --2- 172.21.15.45:0/3034108237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e10101be0 0x7f0e101985f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.339+0000 7f0e14ac9700 1 -- 172.21.15.45:0/3034108237 >> 172.21.15.45:0/3034108237 conn(0x7f0e100fc0d0 msgr2=0x7f0e100683c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:17.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.339+0000 7f0e14ac9700 1 -- 172.21.15.45:0/3034108237 shutdown_connections 2024-05-10T03:40:17.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.339+0000 7f0e14ac9700 1 -- 172.21.15.45:0/3034108237 wait complete. 2024-05-10T03:40:17.358 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T03:40:17.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:17 smithi106 ceph-mon[46996]: pgmap v283: 129 pgs: 129 active+clean; 650 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-10T03:40:17.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:17 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3989402829' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:40:17.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:17 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3404996534' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:40:17.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:17 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2622154596' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:40:17.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:17 smithi154 ceph-mon[46565]: pgmap v283: 129 pgs: 129 active+clean; 650 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-10T03:40:17.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:17 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3989402829' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:40:17.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:17 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3404996534' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:40:17.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:17 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2622154596' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:40:17.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.506+0000 7fc3c35ac700 1 -- 172.21.15.45:0/3333850417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3bc1004a0 msgr2=0x7fc3bc1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:17.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.506+0000 7fc3c35ac700 1 --2- 172.21.15.45:0/3333850417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3bc1004a0 0x7fc3bc1008b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009990 tx=0x7fc3b8009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.506+0000 7fc3c35ac700 1 -- 172.21.15.45:0/3333850417 shutdown_connections 2024-05-10T03:40:17.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.506+0000 7fc3c35ac700 1 --2- 172.21.15.45:0/3333850417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3bc101740 0x7fc3bc101b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.506+0000 7fc3c35ac700 1 --2- 172.21.15.45:0/3333850417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3bc1004a0 0x7fc3bc1008b0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.506+0000 7fc3c35ac700 1 --2- 172.21.15.45:0/3333850417 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3bc100df0 0x7fc3bc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.506+0000 7fc3c35ac700 1 -- 172.21.15.45:0/3333850417 >> 172.21.15.45:0/3333850417 conn(0x7fc3bc0fc0d0 msgr2=0x7fc3bc0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:17.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.507+0000 7fc3c35ac700 1 -- 172.21.15.45:0/3333850417 shutdown_connections 2024-05-10T03:40:17.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.507+0000 7fc3c35ac700 1 -- 172.21.15.45:0/3333850417 wait complete. 2024-05-10T03:40:17.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.507+0000 7fc3c35ac700 1 Processor -- start 2024-05-10T03:40:17.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.507+0000 7fc3c35ac700 1 -- start start 2024-05-10T03:40:17.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.508+0000 7fc3c35ac700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3bc1004a0 0x7fc3bc19a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:17.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.508+0000 7fc3c35ac700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3bc100df0 0x7fc3bc19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:17.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.508+0000 7fc3c35ac700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3bc101740 0x7fc3bc1a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:17.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.508+0000 7fc3c35ac700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc1a1c90 con 0x7fc3bc101740 2024-05-10T03:40:17.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.508+0000 7fc3c35ac700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc1a1e00 con 0x7fc3bc1004a0 2024-05-10T03:40:17.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.508+0000 7fc3c35ac700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc1a1fc0 con 0x7fc3bc100df0 2024-05-10T03:40:17.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.508+0000 7fc3c1b49700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3bc101740 0x7fc3bc1a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:17.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.508+0000 7fc3c1b49700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3bc101740 0x7fc3bc1a1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35054/0 (socket says 172.21.15.45:35054) 2024-05-10T03:40:17.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.508+0000 7fc3c1b49700 1 -- 172.21.15.45:0/425402833 learned_addr learned my addr 172.21.15.45:0/425402833 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:17.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.508+0000 7fc3c1348700 1 --2- 172.21.15.45:0/425402833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3bc1004a0 0x7fc3bc19a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:17.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.508+0000 7fc3c0b47700 1 --2- 172.21.15.45:0/425402833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3bc100df0 0x7fc3bc19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:17.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.508+0000 7fc3c1b49700 1 -- 172.21.15.45:0/425402833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3bc100df0 msgr2=0x7fc3bc19a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:17.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.508+0000 7fc3c1b49700 1 --2- 172.21.15.45:0/425402833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3bc100df0 0x7fc3bc19a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.508+0000 7fc3c1b49700 1 -- 172.21.15.45:0/425402833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3bc1004a0 msgr2=0x7fc3bc19a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:17.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.508+0000 7fc3c1b49700 1 --2- 172.21.15.45:0/425402833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3bc1004a0 0x7fc3bc19a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.508+0000 7fc3c1b49700 1 -- 172.21.15.45:0/425402833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b80095f0 con 0x7fc3bc101740 2024-05-10T03:40:17.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.508+0000 7fc3c1b49700 1 --2- 172.21.15.45:0/425402833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3bc101740 0x7fc3bc1a1680 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400ef90 tx=0x7fc3b400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:17.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.508+0000 7fc3b27fc700 1 -- 172.21.15.45:0/425402833 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4018070 con 0x7fc3bc101740 2024-05-10T03:40:17.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.508+0000 7fc3b27fc700 1 -- 172.21.15.45:0/425402833 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc3b400f040 con 0x7fc3bc101740 2024-05-10T03:40:17.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.508+0000 7fc3c35ac700 1 -- 172.21.15.45:0/425402833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3bc1a2240 con 0x7fc3bc101740 2024-05-10T03:40:17.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.509+0000 7fc3b27fc700 1 -- 172.21.15.45:0/425402833 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b400ce00 con 0x7fc3bc101740 2024-05-10T03:40:17.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.509+0000 7fc3c35ac700 1 -- 172.21.15.45:0/425402833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3bc1a27a0 con 0x7fc3bc101740 2024-05-10T03:40:17.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.510+0000 7fc3c35ac700 1 -- 172.21.15.45:0/425402833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3bc10b990 con 0x7fc3bc101740 2024-05-10T03:40:17.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.511+0000 7fc3b27fc700 1 -- 172.21.15.45:0/425402833 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fc3b4003a00 con 0x7fc3bc101740 2024-05-10T03:40:17.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.512+0000 7fc3b27fc700 1 --2- 172.21.15.45:0/425402833 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc3a80a12e0 0x7fc3a80a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:17.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.512+0000 7fc3c1348700 1 --2- 172.21.15.45:0/425402833 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc3a80a12e0 0x7fc3a80a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:17.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.512+0000 7fc3b27fc700 1 -- 172.21.15.45:0/425402833 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc3b40cd130 con 0x7fc3bc101740 2024-05-10T03:40:17.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.512+0000 7fc3c1348700 1 --2- 172.21.15.45:0/425402833 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc3a80a12e0 0x7fc3a80a37f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800b2e0 tx=0x7fc3b801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:17.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.515+0000 7fc3b27fc700 1 -- 172.21.15.45:0/425402833 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc3b40964e0 con 0x7fc3bc101740 2024-05-10T03:40:17.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.732+0000 7fc3c35ac700 1 -- 172.21.15.45:0/425402833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3bc10f720 con 0x7fc3bc101740 2024-05-10T03:40:17.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.733+0000 7fc3b27fc700 1 -- 172.21.15.45:0/425402833 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc3b4099b00 con 0x7fc3bc101740 2024-05-10T03:40:17.736 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-05-10T03:40:17.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.735+0000 7fc3c35ac700 1 -- 172.21.15.45:0/425402833 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc3a80a12e0 msgr2=0x7fc3a80a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:17.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.735+0000 7fc3c35ac700 1 --2- 172.21.15.45:0/425402833 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc3a80a12e0 0x7fc3a80a37f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800b2e0 tx=0x7fc3b801a040 comp rx=0 tx=0).stop 2024-05-10T03:40:17.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.735+0000 7fc3c35ac700 1 -- 172.21.15.45:0/425402833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3bc101740 msgr2=0x7fc3bc1a1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:17.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.735+0000 7fc3c35ac700 1 --2- 172.21.15.45:0/425402833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3bc101740 0x7fc3bc1a1680 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400ef90 tx=0x7fc3b400c3a0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.735+0000 7fc3c35ac700 1 -- 172.21.15.45:0/425402833 shutdown_connections 2024-05-10T03:40:17.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.735+0000 7fc3c35ac700 1 --2- 172.21.15.45:0/425402833 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc3a80a12e0 0x7fc3a80a37f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.735+0000 7fc3c35ac700 1 --2- 172.21.15.45:0/425402833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3bc101740 0x7fc3bc1a1680 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.735+0000 7fc3c35ac700 1 --2- 172.21.15.45:0/425402833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3bc1004a0 0x7fc3bc19a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.735+0000 7fc3c35ac700 1 --2- 172.21.15.45:0/425402833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3bc100df0 0x7fc3bc19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.735+0000 7fc3c35ac700 1 -- 172.21.15.45:0/425402833 >> 172.21.15.45:0/425402833 conn(0x7fc3bc0fc0d0 msgr2=0x7fc3bc108ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:17.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.735+0000 7fc3c35ac700 1 -- 172.21.15.45:0/425402833 shutdown_connections 2024-05-10T03:40:17.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.735+0000 7fc3c35ac700 1 -- 172.21.15.45:0/425402833 wait complete. 2024-05-10T03:40:17.754 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T03:40:17.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.903+0000 7fd30403b700 1 -- 172.21.15.45:0/2081419770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2fc102580 msgr2=0x7fd2fc108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:17.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.903+0000 7fd30403b700 1 --2- 172.21.15.45:0/2081419770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2fc102580 0x7fd2fc108e30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400b0a0 tx=0x7fd2f400b3b0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.903+0000 7fd30403b700 1 -- 172.21.15.45:0/2081419770 shutdown_connections 2024-05-10T03:40:17.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.903+0000 7fd30403b700 1 --2- 172.21.15.45:0/2081419770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2fc102580 0x7fd2fc108e30 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.903+0000 7fd30403b700 1 --2- 172.21.15.45:0/2081419770 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2fc100ac0 0x7fd2fc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.903+0000 7fd30403b700 1 --2- 172.21.15.45:0/2081419770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2fc101be0 0x7fd2fc101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.903+0000 7fd30403b700 1 -- 172.21.15.45:0/2081419770 >> 172.21.15.45:0/2081419770 conn(0x7fd2fc0fc0d0 msgr2=0x7fd2fc0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:17.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.903+0000 7fd30403b700 1 -- 172.21.15.45:0/2081419770 shutdown_connections 2024-05-10T03:40:17.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.903+0000 7fd30403b700 1 -- 172.21.15.45:0/2081419770 wait complete. 2024-05-10T03:40:17.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.904+0000 7fd30403b700 1 Processor -- start 2024-05-10T03:40:17.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.904+0000 7fd30403b700 1 -- start start 2024-05-10T03:40:17.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.904+0000 7fd30403b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2fc100ac0 0x7fd2fc10b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:17.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.904+0000 7fd30403b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2fc101be0 0x7fd2fc1099e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:17.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.904+0000 7fd30403b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2fc102580 0x7fd2fc109f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:17.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.904+0000 7fd30403b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc10a600 con 0x7fd2fc100ac0 2024-05-10T03:40:17.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.904+0000 7fd30403b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc10a770 con 0x7fd2fc101be0 2024-05-10T03:40:17.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.904+0000 7fd30403b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc1a2190 con 0x7fd2fc102580 2024-05-10T03:40:17.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.904+0000 7fd301dd7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2fc100ac0 0x7fd2fc10b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:17.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.904+0000 7fd301dd7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2fc100ac0 0x7fd2fc10b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35072/0 (socket says 172.21.15.45:35072) 2024-05-10T03:40:17.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.904+0000 7fd301dd7700 1 -- 172.21.15.45:0/3580168763 learned_addr learned my addr 172.21.15.45:0/3580168763 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:17.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.905+0000 7fd3015d6700 1 --2- 172.21.15.45:0/3580168763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2fc101be0 0x7fd2fc1099e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:17.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.905+0000 7fd3025d8700 1 --2- 172.21.15.45:0/3580168763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2fc102580 0x7fd2fc109f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:17.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.905+0000 7fd301dd7700 1 -- 172.21.15.45:0/3580168763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2fc102580 msgr2=0x7fd2fc109f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:17.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.905+0000 7fd301dd7700 1 --2- 172.21.15.45:0/3580168763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2fc102580 0x7fd2fc109f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.905+0000 7fd301dd7700 1 -- 172.21.15.45:0/3580168763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2fc101be0 msgr2=0x7fd2fc1099e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:17.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.905+0000 7fd301dd7700 1 --2- 172.21.15.45:0/3580168763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2fc101be0 0x7fd2fc1099e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:17.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.905+0000 7fd301dd7700 1 -- 172.21.15.45:0/3580168763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ec009520 con 0x7fd2fc100ac0 2024-05-10T03:40:17.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.905+0000 7fd3025d8700 1 --2- 172.21.15.45:0/3580168763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2fc102580 0x7fd2fc109f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:17.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.905+0000 7fd3015d6700 1 --2- 172.21.15.45:0/3580168763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2fc101be0 0x7fd2fc1099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:17.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.905+0000 7fd301dd7700 1 --2- 172.21.15.45:0/3580168763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2fc100ac0 0x7fd2fc10b340 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800e940 tx=0x7fd2f800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:17.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.905+0000 7fd2f2ffd700 1 -- 172.21.15.45:0/3580168763 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f800cbd0 con 0x7fd2fc100ac0 2024-05-10T03:40:17.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.905+0000 7fd30403b700 1 -- 172.21.15.45:0/3580168763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2f4009d00 con 0x7fd2fc100ac0 2024-05-10T03:40:17.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.905+0000 7fd2f2ffd700 1 -- 172.21.15.45:0/3580168763 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd2f8004500 con 0x7fd2fc100ac0 2024-05-10T03:40:17.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.905+0000 7fd2f2ffd700 1 -- 172.21.15.45:0/3580168763 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8003e30 con 0x7fd2fc100ac0 2024-05-10T03:40:17.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.905+0000 7fd30403b700 1 -- 172.21.15.45:0/3580168763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2fc1a2790 con 0x7fd2fc100ac0 2024-05-10T03:40:17.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.906+0000 7fd30403b700 1 -- 172.21.15.45:0/3580168763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2fc107cd0 con 0x7fd2fc100ac0 2024-05-10T03:40:17.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.908+0000 7fd2f2ffd700 1 -- 172.21.15.45:0/3580168763 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fd2f8004000 con 0x7fd2fc100ac0 2024-05-10T03:40:17.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.908+0000 7fd2f2ffd700 1 --2- 172.21.15.45:0/3580168763 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd2e80a1260 0x7fd2e80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:17.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.908+0000 7fd3015d6700 1 --2- 172.21.15.45:0/3580168763 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd2e80a1260 0x7fd2e80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:17.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.908+0000 7fd2f2ffd700 1 -- 172.21.15.45:0/3580168763 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fd2f8014070 con 0x7fd2fc100ac0 2024-05-10T03:40:17.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.909+0000 7fd3015d6700 1 --2- 172.21.15.45:0/3580168763 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd2e80a1260 0x7fd2e80a3770 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc10ace0 tx=0x7fd2ec009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:17.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:17.912+0000 7fd2f2ffd700 1 -- 172.21.15.45:0/3580168763 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd2f8096640 con 0x7fd2fc100ac0 2024-05-10T03:40:18.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.130+0000 7fd30403b700 1 -- 172.21.15.45:0/3580168763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd2fc10d580 con 0x7fd2fc100ac0 2024-05-10T03:40:18.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.131+0000 7fd2f2ffd700 1 -- 172.21.15.45:0/3580168763 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd2f80042b0 con 0x7fd2fc100ac0 2024-05-10T03:40:18.135 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2024-05-10T03:40:18.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.133+0000 7fd30403b700 1 -- 172.21.15.45:0/3580168763 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd2e80a1260 msgr2=0x7fd2e80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:18.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.133+0000 7fd30403b700 1 --2- 172.21.15.45:0/3580168763 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd2e80a1260 0x7fd2e80a3770 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc10ace0 tx=0x7fd2ec009260 comp rx=0 tx=0).stop 2024-05-10T03:40:18.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.133+0000 7fd30403b700 1 -- 172.21.15.45:0/3580168763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2fc100ac0 msgr2=0x7fd2fc10b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:18.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.133+0000 7fd30403b700 1 --2- 172.21.15.45:0/3580168763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2fc100ac0 0x7fd2fc10b340 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800e940 tx=0x7fd2f800ed00 comp rx=0 tx=0).stop 2024-05-10T03:40:18.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.133+0000 7fd30403b700 1 -- 172.21.15.45:0/3580168763 shutdown_connections 2024-05-10T03:40:18.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.133+0000 7fd30403b700 1 --2- 172.21.15.45:0/3580168763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2fc102580 0x7fd2fc109f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:18.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.133+0000 7fd30403b700 1 --2- 172.21.15.45:0/3580168763 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd2e80a1260 0x7fd2e80a3770 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:18.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.133+0000 7fd30403b700 1 --2- 172.21.15.45:0/3580168763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2fc100ac0 0x7fd2fc10b340 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:18.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.133+0000 7fd30403b700 1 --2- 172.21.15.45:0/3580168763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2fc101be0 0x7fd2fc1099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:18.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.133+0000 7fd30403b700 1 -- 172.21.15.45:0/3580168763 >> 172.21.15.45:0/3580168763 conn(0x7fd2fc0fc0d0 msgr2=0x7fd2fc104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:18.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.134+0000 7fd30403b700 1 -- 172.21.15.45:0/3580168763 shutdown_connections 2024-05-10T03:40:18.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.134+0000 7fd30403b700 1 -- 172.21.15.45:0/3580168763 wait complete. 2024-05-10T03:40:18.152 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-10T03:40:18.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.302+0000 7f19d40f5700 1 -- 172.21.15.45:0/2056338863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19cc069050 msgr2=0x7f19cc104760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:18.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.302+0000 7f19d40f5700 1 --2- 172.21.15.45:0/2056338863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19cc069050 0x7f19cc104760 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f19c8009990 tx=0x7f19c8009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:18.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.302+0000 7f19d40f5700 1 -- 172.21.15.45:0/2056338863 shutdown_connections 2024-05-10T03:40:18.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.302+0000 7f19d40f5700 1 --2- 172.21.15.45:0/2056338863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19cc1078a0 0x7f19cc109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:18.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.302+0000 7f19d40f5700 1 --2- 172.21.15.45:0/2056338863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19cc069050 0x7f19cc104760 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:18.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.302+0000 7f19d40f5700 1 --2- 172.21.15.45:0/2056338863 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19cc104d30 0x7f19cc107210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:18.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.302+0000 7f19d40f5700 1 -- 172.21.15.45:0/2056338863 >> 172.21.15.45:0/2056338863 conn(0x7f19cc0fc0d0 msgr2=0x7f19cc0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:18.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.302+0000 7f19d40f5700 1 -- 172.21.15.45:0/2056338863 shutdown_connections 2024-05-10T03:40:18.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.302+0000 7f19d40f5700 1 -- 172.21.15.45:0/2056338863 wait complete. 2024-05-10T03:40:18.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.303+0000 7f19d40f5700 1 Processor -- start 2024-05-10T03:40:18.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.303+0000 7f19d40f5700 1 -- start start 2024-05-10T03:40:18.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.303+0000 7f19d40f5700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19cc069050 0x7f19cc197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:18.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.303+0000 7f19d40f5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19cc104d30 0x7f19cc1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:18.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.303+0000 7f19d40f5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19cc1078a0 0x7f19cc19f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:18.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.303+0000 7f19d40f5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc19fa50 con 0x7f19cc104d30 2024-05-10T03:40:18.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.303+0000 7f19d40f5700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc19fbc0 con 0x7f19cc069050 2024-05-10T03:40:18.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.303+0000 7f19d40f5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc19fd80 con 0x7f19cc1078a0 2024-05-10T03:40:18.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.304+0000 7f19d1690700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19cc104d30 0x7f19cc1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:18.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.304+0000 7f19d1690700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19cc104d30 0x7f19cc1984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35102/0 (socket says 172.21.15.45:35102) 2024-05-10T03:40:18.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.304+0000 7f19d1690700 1 -- 172.21.15.45:0/3936615131 learned_addr learned my addr 172.21.15.45:0/3936615131 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:18.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.304+0000 7f19d1e91700 1 --2- 172.21.15.45:0/3936615131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19cc069050 0x7f19cc197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:18.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.304+0000 7f19d2692700 1 --2- 172.21.15.45:0/3936615131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19cc1078a0 0x7f19cc19f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:18.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.304+0000 7f19d1690700 1 -- 172.21.15.45:0/3936615131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19cc1078a0 msgr2=0x7f19cc19f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:18.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.304+0000 7f19d1690700 1 --2- 172.21.15.45:0/3936615131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19cc1078a0 0x7f19cc19f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:18.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.304+0000 7f19d1690700 1 -- 172.21.15.45:0/3936615131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19cc069050 msgr2=0x7f19cc197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:18.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.304+0000 7f19d1690700 1 --2- 172.21.15.45:0/3936615131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19cc069050 0x7f19cc197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:18.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.304+0000 7f19d1690700 1 -- 172.21.15.45:0/3936615131 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c80095f0 con 0x7f19cc104d30 2024-05-10T03:40:18.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.304+0000 7f19d2692700 1 --2- 172.21.15.45:0/3936615131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19cc1078a0 0x7f19cc19f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:18.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.304+0000 7f19d1690700 1 --2- 172.21.15.45:0/3936615131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19cc104d30 0x7f19cc1984b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f19c000d980 tx=0x7f19c000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:18.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.304+0000 7f19beffd700 1 -- 172.21.15.45:0/3936615131 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c0004220 con 0x7f19cc104d30 2024-05-10T03:40:18.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.304+0000 7f19beffd700 1 -- 172.21.15.45:0/3936615131 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f19c0007640 con 0x7f19cc104d30 2024-05-10T03:40:18.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.304+0000 7f19d40f5700 1 -- 172.21.15.45:0/3936615131 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19cc1a0060 con 0x7f19cc104d30 2024-05-10T03:40:18.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.304+0000 7f19beffd700 1 -- 172.21.15.45:0/3936615131 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c0005720 con 0x7f19cc104d30 2024-05-10T03:40:18.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.304+0000 7f19d40f5700 1 -- 172.21.15.45:0/3936615131 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19cc1a05c0 con 0x7f19cc104d30 2024-05-10T03:40:18.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.305+0000 7f19d40f5700 1 -- 172.21.15.45:0/3936615131 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19cc0fdc80 con 0x7f19cc104d30 2024-05-10T03:40:18.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.307+0000 7f19beffd700 1 -- 172.21.15.45:0/3936615131 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f19c0004750 con 0x7f19cc104d30 2024-05-10T03:40:18.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.307+0000 7f19beffd700 1 --2- 172.21.15.45:0/3936615131 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f19b80a12e0 0x7f19b80a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:18.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.308+0000 7f19beffd700 1 -- 172.21.15.45:0/3936615131 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f19c00cd090 con 0x7f19cc104d30 2024-05-10T03:40:18.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.308+0000 7f19d1e91700 1 --2- 172.21.15.45:0/3936615131 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f19b80a12e0 0x7f19b80a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:18.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.308+0000 7f19d1e91700 1 --2- 172.21.15.45:0/3936615131 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f19b80a12e0 0x7f19b80a37f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f19c800b2e0 tx=0x7f19c801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:18.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.311+0000 7f19beffd700 1 -- 172.21.15.45:0/3936615131 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f19c00963b0 con 0x7f19cc104d30 2024-05-10T03:40:18.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:18 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3034108237' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:40:18.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:18 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/425402833' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:40:18.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:18 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3034108237' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:40:18.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:18 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/425402833' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:40:18.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:18 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3034108237' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:40:18.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:18 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/425402833' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:40:18.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.531+0000 7f19d40f5700 1 -- 172.21.15.45:0/3936615131 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f19cc10d4c0 con 0x7f19cc104d30 2024-05-10T03:40:18.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.532+0000 7f19beffd700 1 -- 172.21.15.45:0/3936615131 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) v1 ==== 103+0+11 (secure 0 0 0) 0x7f19c0016020 con 0x7f19cc104d30 2024-05-10T03:40:18.535 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-05-10T03:40:18.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.534+0000 7f19d40f5700 1 -- 172.21.15.45:0/3936615131 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f19b80a12e0 msgr2=0x7f19b80a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:18.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.534+0000 7f19d40f5700 1 --2- 172.21.15.45:0/3936615131 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f19b80a12e0 0x7f19b80a37f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f19c800b2e0 tx=0x7f19c801a040 comp rx=0 tx=0).stop 2024-05-10T03:40:18.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.534+0000 7f19d40f5700 1 -- 172.21.15.45:0/3936615131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19cc104d30 msgr2=0x7f19cc1984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:18.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.534+0000 7f19d40f5700 1 --2- 172.21.15.45:0/3936615131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19cc104d30 0x7f19cc1984b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f19c000d980 tx=0x7f19c000dc90 comp rx=0 tx=0).stop 2024-05-10T03:40:18.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.534+0000 7f19d40f5700 1 -- 172.21.15.45:0/3936615131 shutdown_connections 2024-05-10T03:40:18.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.534+0000 7f19d40f5700 1 --2- 172.21.15.45:0/3936615131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19cc1078a0 0x7f19cc19f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:18.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.534+0000 7f19d40f5700 1 --2- 172.21.15.45:0/3936615131 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f19b80a12e0 0x7f19b80a37f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:18.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.534+0000 7f19d40f5700 1 --2- 172.21.15.45:0/3936615131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19cc069050 0x7f19cc197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:18.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.534+0000 7f19d40f5700 1 --2- 172.21.15.45:0/3936615131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19cc104d30 0x7f19cc1984b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:18.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.534+0000 7f19d40f5700 1 -- 172.21.15.45:0/3936615131 >> 172.21.15.45:0/3936615131 conn(0x7f19cc0fc0d0 msgr2=0x7f19cc102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:18.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.534+0000 7f19d40f5700 1 -- 172.21.15.45:0/3936615131 shutdown_connections 2024-05-10T03:40:18.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.534+0000 7f19d40f5700 1 -- 172.21.15.45:0/3936615131 wait complete. 2024-05-10T03:40:18.552 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-05-10T03:40:18.553 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:40:18.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.699+0000 7f1815a83700 1 -- 172.21.15.45:0/3250712850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1810100ac0 msgr2=0x7f1810100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:18.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.699+0000 7f1815a83700 1 --2- 172.21.15.45:0/3250712850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1810100ac0 0x7f1810100ed0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1800009990 tx=0x7f1800009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:18.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.699+0000 7f1815a83700 1 -- 172.21.15.45:0/3250712850 shutdown_connections 2024-05-10T03:40:18.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.699+0000 7f1815a83700 1 --2- 172.21.15.45:0/3250712850 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1810102580 0x7f1810108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:18.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.699+0000 7f1815a83700 1 --2- 172.21.15.45:0/3250712850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1810100ac0 0x7f1810100ed0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:18.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.699+0000 7f1815a83700 1 --2- 172.21.15.45:0/3250712850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1810101be0 0x7f1810101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:18.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.699+0000 7f1815a83700 1 -- 172.21.15.45:0/3250712850 >> 172.21.15.45:0/3250712850 conn(0x7f18100fc0d0 msgr2=0x7f18100fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:18.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.699+0000 7f1815a83700 1 -- 172.21.15.45:0/3250712850 shutdown_connections 2024-05-10T03:40:18.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.700+0000 7f1815a83700 1 -- 172.21.15.45:0/3250712850 wait complete. 2024-05-10T03:40:18.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.700+0000 7f1815a83700 1 Processor -- start 2024-05-10T03:40:18.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.701+0000 7f1815a83700 1 -- start start 2024-05-10T03:40:18.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.701+0000 7f1815a83700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1810100ac0 0x7f1810068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:18.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.701+0000 7f1815a83700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1810101be0 0x7f181019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:18.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.701+0000 7f1815a83700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1810102580 0x7f181019f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:18.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.701+0000 7f1815a83700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181019fb10 con 0x7f1810102580 2024-05-10T03:40:18.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.701+0000 7f1815a83700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181019fc80 con 0x7f1810101be0 2024-05-10T03:40:18.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.701+0000 7f1815a83700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181019fe40 con 0x7f1810100ac0 2024-05-10T03:40:18.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.701+0000 7f180ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1810102580 0x7f181019f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:18.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.701+0000 7f180ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1810102580 0x7f181019f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35122/0 (socket says 172.21.15.45:35122) 2024-05-10T03:40:18.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.701+0000 7f180ffff700 1 -- 172.21.15.45:0/2397531318 learned_addr learned my addr 172.21.15.45:0/2397531318 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:18.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.701+0000 7f180effd700 1 --2- 172.21.15.45:0/2397531318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1810101be0 0x7f181019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:18.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.701+0000 7f180f7fe700 1 --2- 172.21.15.45:0/2397531318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1810100ac0 0x7f1810068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:18.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.702+0000 7f180ffff700 1 -- 172.21.15.45:0/2397531318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1810100ac0 msgr2=0x7f1810068e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:18.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.702+0000 7f180ffff700 1 --2- 172.21.15.45:0/2397531318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1810100ac0 0x7f1810068e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:18.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.702+0000 7f180ffff700 1 -- 172.21.15.45:0/2397531318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1810101be0 msgr2=0x7f181019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:18.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.702+0000 7f180ffff700 1 --2- 172.21.15.45:0/2397531318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1810101be0 0x7f181019cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:18.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.702+0000 7f180ffff700 1 -- 172.21.15.45:0/2397531318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18000095f0 con 0x7f1810102580 2024-05-10T03:40:18.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.702+0000 7f180ffff700 1 --2- 172.21.15.45:0/2397531318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1810102580 0x7f181019f410 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f180800ef30 tx=0x7f180800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:18.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.702+0000 7f180cff9700 1 -- 172.21.15.45:0/2397531318 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1808018070 con 0x7f1810102580 2024-05-10T03:40:18.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.702+0000 7f1815a83700 1 -- 172.21.15.45:0/2397531318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18101a00c0 con 0x7f1810102580 2024-05-10T03:40:18.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.702+0000 7f180cff9700 1 -- 172.21.15.45:0/2397531318 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f180800f040 con 0x7f1810102580 2024-05-10T03:40:18.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.702+0000 7f180cff9700 1 -- 172.21.15.45:0/2397531318 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180800cd50 con 0x7f1810102580 2024-05-10T03:40:18.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.702+0000 7f1815a83700 1 -- 172.21.15.45:0/2397531318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18101a05d0 con 0x7f1810102580 2024-05-10T03:40:18.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.703+0000 7f1815a83700 1 -- 172.21.15.45:0/2397531318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1810107cd0 con 0x7f1810102580 2024-05-10T03:40:18.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.705+0000 7f180cff9700 1 -- 172.21.15.45:0/2397531318 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f1808003a00 con 0x7f1810102580 2024-05-10T03:40:18.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.706+0000 7f180cff9700 1 --2- 172.21.15.45:0/2397531318 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f17f80a11b0 0x7f17f80a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:18.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.706+0000 7f180cff9700 1 -- 172.21.15.45:0/2397531318 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f18080cd220 con 0x7f1810102580 2024-05-10T03:40:18.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.706+0000 7f180f7fe700 1 --2- 172.21.15.45:0/2397531318 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f17f80a11b0 0x7f17f80a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:18.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.707+0000 7f180f7fe700 1 --2- 172.21.15.45:0/2397531318 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f17f80a11b0 0x7f17f80a36c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1800006010 tx=0x7f180001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:18.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.710+0000 7f180cff9700 1 -- 172.21.15.45:0/2397531318 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f18080965d0 con 0x7f1810102580 2024-05-10T03:40:18.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.979+0000 7f1815a83700 1 -- 172.21.15.45:0/2397531318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f181010c3e0 con 0x7f1810102580 2024-05-10T03:40:18.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.980+0000 7f180cff9700 1 -- 172.21.15.45:0/2397531318 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+10926 (secure 0 0 0) 0x7f1808099bf0 con 0x7f1810102580 2024-05-10T03:40:18.984 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:40:18.984 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/378320264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":378320264},{"type":"v1","addr":"172.21.15.45:6835","nonce":378320264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3032381796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3032381796},{"type":"v1","addr":"172.21.15.45:6837","nonce":3032381796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T03:38:36.555290+0000","modified":"2024-05-10T03:40:14.047840+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24548,"mds_2":24547,"mds_3":24526,"mds_4":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14625":{"gid":14625,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6839/4007419304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":4007419304},{"type":"v1","addr":"172.21.15.45:6839","nonce":4007419304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14637":{"gid":14637,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6841/1355456195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1355456195},{"type":"v1","addr":"172.21.15.45:6841","nonce":1355456195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/4037121210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":4037121210},{"type":"v1","addr":"172.21.15.154:6835","nonce":4037121210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24521":{"gid":24521,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.106:6835/4162885659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4162885659},{"type":"v1","addr":"172.21.15.106:6835","nonce":4162885659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.154:6837/608167481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":608167481},{"type":"v1","addr":"172.21.15.154:6837","nonce":608167481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/1506563336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1506563336},{"type":"v1","addr":"172.21.15.154:6839","nonce":1506563336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.106:6837/3047487403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":3047487403},{"type":"v1","addr":"172.21.15.106:6837","nonce":3047487403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6839/3533867856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":3533867856},{"type":"v1","addr":"172.21.15.106:6839","nonce":3533867856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T03:40:18.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.982+0000 7f1815a83700 1 -- 172.21.15.45:0/2397531318 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f17f80a11b0 msgr2=0x7f17f80a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:18.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.982+0000 7f1815a83700 1 --2- 172.21.15.45:0/2397531318 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f17f80a11b0 0x7f17f80a36c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1800006010 tx=0x7f180001a040 comp rx=0 tx=0).stop 2024-05-10T03:40:18.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.982+0000 7f1815a83700 1 -- 172.21.15.45:0/2397531318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1810102580 msgr2=0x7f181019f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:18.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.982+0000 7f1815a83700 1 --2- 172.21.15.45:0/2397531318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1810102580 0x7f181019f410 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f180800ef30 tx=0x7f180800c3a0 comp rx=0 tx=0).stop 2024-05-10T03:40:18.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.982+0000 7f1815a83700 1 -- 172.21.15.45:0/2397531318 shutdown_connections 2024-05-10T03:40:18.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.982+0000 7f1815a83700 1 --2- 172.21.15.45:0/2397531318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1810100ac0 0x7f1810068e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:18.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.982+0000 7f1815a83700 1 --2- 172.21.15.45:0/2397531318 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f17f80a11b0 0x7f17f80a36c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:18.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.982+0000 7f1815a83700 1 --2- 172.21.15.45:0/2397531318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1810102580 0x7f181019f410 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:18.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.982+0000 7f1815a83700 1 --2- 172.21.15.45:0/2397531318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1810101be0 0x7f181019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:18.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.983+0000 7f1815a83700 1 -- 172.21.15.45:0/2397531318 >> 172.21.15.45:0/2397531318 conn(0x7f18100fc0d0 msgr2=0x7f1810104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:18.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.983+0000 7f1815a83700 1 -- 172.21.15.45:0/2397531318 shutdown_connections 2024-05-10T03:40:18.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:18.983+0000 7f1815a83700 1 -- 172.21.15.45:0/2397531318 wait complete. 2024-05-10T03:40:18.988 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 28 2024-05-10T03:40:19.001 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-05-10T03:40:19.001 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-05-10T03:40:19.001 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T03:40:19.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.148+0000 7f4068103700 1 -- 172.21.15.45:0/683170134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4060100ae0 msgr2=0x7f4060100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:19.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.148+0000 7f4068103700 1 --2- 172.21.15.45:0/683170134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4060100ae0 0x7f4060100ef0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f405c009990 tx=0x7f405c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:19.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.149+0000 7f4068103700 1 -- 172.21.15.45:0/683170134 shutdown_connections 2024-05-10T03:40:19.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.149+0000 7f4068103700 1 --2- 172.21.15.45:0/683170134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40601025a0 0x7f4060108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:19.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.149+0000 7f4068103700 1 --2- 172.21.15.45:0/683170134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4060100ae0 0x7f4060100ef0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:19.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.149+0000 7f4068103700 1 --2- 172.21.15.45:0/683170134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4060101c00 0x7f4060102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:19.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.149+0000 7f4068103700 1 -- 172.21.15.45:0/683170134 >> 172.21.15.45:0/683170134 conn(0x7f40600fc110 msgr2=0x7f40600fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:19.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.149+0000 7f4068103700 1 -- 172.21.15.45:0/683170134 shutdown_connections 2024-05-10T03:40:19.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.149+0000 7f4068103700 1 -- 172.21.15.45:0/683170134 wait complete. 2024-05-10T03:40:19.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.149+0000 7f4068103700 1 Processor -- start 2024-05-10T03:40:19.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.149+0000 7f4068103700 1 -- start start 2024-05-10T03:40:19.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.150+0000 7f4068103700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4060100ae0 0x7f4060198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:19.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.150+0000 7f4068103700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4060101c00 0x7f4060198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:19.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.150+0000 7f4068103700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40601025a0 0x7f406019f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:19.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.150+0000 7f4068103700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406019fc30 con 0x7f4060101c00 2024-05-10T03:40:19.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.150+0000 7f4068103700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406019fda0 con 0x7f4060100ae0 2024-05-10T03:40:19.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.150+0000 7f4068103700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406019ff60 con 0x7f40601025a0 2024-05-10T03:40:19.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.150+0000 7f406569e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4060101c00 0x7f4060198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:19.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.150+0000 7f406569e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4060101c00 0x7f4060198690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35146/0 (socket says 172.21.15.45:35146) 2024-05-10T03:40:19.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.150+0000 7f406569e700 1 -- 172.21.15.45:0/1105825527 learned_addr learned my addr 172.21.15.45:0/1105825527 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:19.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.150+0000 7f4065e9f700 1 --2- 172.21.15.45:0/1105825527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4060100ae0 0x7f4060198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:19.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.150+0000 7f40666a0700 1 --2- 172.21.15.45:0/1105825527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40601025a0 0x7f406019f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:19.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.150+0000 7f406569e700 1 -- 172.21.15.45:0/1105825527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40601025a0 msgr2=0x7f406019f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:19.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.150+0000 7f406569e700 1 --2- 172.21.15.45:0/1105825527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40601025a0 0x7f406019f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:19.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.150+0000 7f406569e700 1 -- 172.21.15.45:0/1105825527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4060100ae0 msgr2=0x7f4060198150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:19.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.150+0000 7f406569e700 1 --2- 172.21.15.45:0/1105825527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4060100ae0 0x7f4060198150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:19.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.150+0000 7f406569e700 1 -- 172.21.15.45:0/1105825527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c0095f0 con 0x7f4060101c00 2024-05-10T03:40:19.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.150+0000 7f406569e700 1 --2- 172.21.15.45:0/1105825527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4060101c00 0x7f4060198690 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f405000d950 tx=0x7f405000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:19.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.151+0000 7f4056ffd700 1 -- 172.21.15.45:0/1105825527 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405000f890 con 0x7f4060101c00 2024-05-10T03:40:19.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.151+0000 7f4056ffd700 1 -- 172.21.15.45:0/1105825527 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4050010460 con 0x7f4060101c00 2024-05-10T03:40:19.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.151+0000 7f4068103700 1 -- 172.21.15.45:0/1105825527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40601a0240 con 0x7f4060101c00 2024-05-10T03:40:19.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.151+0000 7f4056ffd700 1 -- 172.21.15.45:0/1105825527 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405000e610 con 0x7f4060101c00 2024-05-10T03:40:19.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.151+0000 7f4068103700 1 -- 172.21.15.45:0/1105825527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40601a07a0 con 0x7f4060101c00 2024-05-10T03:40:19.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.152+0000 7f4068103700 1 -- 172.21.15.45:0/1105825527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4060068730 con 0x7f4060101c00 2024-05-10T03:40:19.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.153+0000 7f4056ffd700 1 -- 172.21.15.45:0/1105825527 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f4050010960 con 0x7f4060101c00 2024-05-10T03:40:19.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.154+0000 7f4056ffd700 1 --2- 172.21.15.45:0/1105825527 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f404c0a1230 0x7f404c0a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:19.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.154+0000 7f4065e9f700 1 --2- 172.21.15.45:0/1105825527 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f404c0a1230 0x7f404c0a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:19.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.154+0000 7f4056ffd700 1 -- 172.21.15.45:0/1105825527 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f40500ccb30 con 0x7f4060101c00 2024-05-10T03:40:19.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.154+0000 7f4065e9f700 1 --2- 172.21.15.45:0/1105825527 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f404c0a1230 0x7f404c0a3740 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f405c003930 tx=0x7f405c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:19.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.158+0000 7f4056ffd700 1 -- 172.21.15.45:0/1105825527 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4050095df0 con 0x7f4060101c00 2024-05-10T03:40:19.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:19 smithi045 ceph-mon[42520]: pgmap v284: 129 pgs: 129 active+clean; 650 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-05-10T03:40:19.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:19 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3580168763' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:40:19.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:19 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3936615131' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:40:19.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:19 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2397531318' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:40:19.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.372+0000 7f4068103700 1 -- 172.21.15.45:0/1105825527 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40600fe1c0 con 0x7f404c0a1230 2024-05-10T03:40:19.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.385+0000 7f4056ffd700 1 -- 172.21.15.45:0/1105825527 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426722 (secure 0 0 0) 0x7f40600fe1c0 con 0x7f404c0a1230 2024-05-10T03:40:19.398 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:40:19.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.389+0000 7f4068103700 1 -- 172.21.15.45:0/1105825527 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f404c0a1230 msgr2=0x7f404c0a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:19.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.389+0000 7f4068103700 1 --2- 172.21.15.45:0/1105825527 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f404c0a1230 0x7f404c0a3740 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f405c003930 tx=0x7f405c01a040 comp rx=0 tx=0).stop 2024-05-10T03:40:19.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.389+0000 7f4068103700 1 -- 172.21.15.45:0/1105825527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4060101c00 msgr2=0x7f4060198690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:19.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.389+0000 7f4068103700 1 --2- 172.21.15.45:0/1105825527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4060101c00 0x7f4060198690 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f405000d950 tx=0x7f405000dc60 comp rx=0 tx=0).stop 2024-05-10T03:40:19.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.390+0000 7f4068103700 1 -- 172.21.15.45:0/1105825527 shutdown_connections 2024-05-10T03:40:19.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.390+0000 7f4068103700 1 --2- 172.21.15.45:0/1105825527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40601025a0 0x7f406019f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:19.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.390+0000 7f4068103700 1 --2- 172.21.15.45:0/1105825527 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f404c0a1230 0x7f404c0a3740 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:19.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.390+0000 7f4068103700 1 --2- 172.21.15.45:0/1105825527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4060100ae0 0x7f4060198150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:19.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.390+0000 7f4068103700 1 --2- 172.21.15.45:0/1105825527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4060101c00 0x7f4060198690 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:19.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.390+0000 7f4068103700 1 -- 172.21.15.45:0/1105825527 >> 172.21.15.45:0/1105825527 conn(0x7f40600fc110 msgr2=0x7f40600fdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:19.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.390+0000 7f4068103700 1 -- 172.21.15.45:0/1105825527 shutdown_connections 2024-05-10T03:40:19.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.390+0000 7f4068103700 1 -- 172.21.15.45:0/1105825527 wait complete. 2024-05-10T03:40:19.405 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-05-10T03:40:19.406 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:19 smithi106 ceph-mon[46996]: pgmap v284: 129 pgs: 129 active+clean; 650 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-05-10T03:40:19.406 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:19 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3580168763' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:40:19.406 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:19 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3936615131' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:40:19.406 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:19 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2397531318' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:40:19.408 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-05-10T03:40:17.905816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665479,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":910,"num_read_kb":577,"num_write":422,"num_write_kb":3086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1244630,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":350,"ondisk_log_size":350,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":362700,"kb_used_data":13812,"kb_used_omap":18,"kb_used_meta":348653,"kb_avail":1124579124,"statfs":{"total":1151940427776,"available":1151569022976,"internally_reserved":0,"allocated":14143488,"data_stored":7818669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19129,"internal_metadata":357020999},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4942,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":57,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003640"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076912+0000","last_change":"2024-05-10T03:38:36.586241+0000","last_active":"2024-05-10T03:39:26.076912+0000","last_peered":"2024-05-10T03:39:26.076912+0000","last_clean":"2024-05-10T03:39:26.076912+0000","last_became_active":"2024-05-10T03:38:36.585655+0000","last_became_peered":"2024-05-10T03:38:36.585655+0000","last_unstale":"2024-05-10T03:39:26.076912+0000","last_undegraded":"2024-05-10T03:39:26.076912+0000","last_fullsized":"2024-05-10T03:39:26.076912+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:58:24.614952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067299+0000","last_change":"2024-05-10T03:38:36.588174+0000","last_active":"2024-05-10T03:39:26.067299+0000","last_peered":"2024-05-10T03:39:26.067299+0000","last_clean":"2024-05-10T03:39:26.067299+0000","last_became_active":"2024-05-10T03:38:36.587843+0000","last_became_peered":"2024-05-10T03:38:36.587843+0000","last_unstale":"2024-05-10T03:39:26.067299+0000","last_undegraded":"2024-05-10T03:39:26.067299+0000","last_fullsized":"2024-05-10T03:39:26.067299+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:56.414407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067873+0000","last_change":"2024-05-10T03:38:36.587344+0000","last_active":"2024-05-10T03:39:26.067873+0000","last_peered":"2024-05-10T03:39:26.067873+0000","last_clean":"2024-05-10T03:39:26.067873+0000","last_became_active":"2024-05-10T03:38:36.586345+0000","last_became_peered":"2024-05-10T03:38:36.586345+0000","last_unstale":"2024-05-10T03:39:26.067873+0000","last_undegraded":"2024-05-10T03:39:26.067873+0000","last_fullsized":"2024-05-10T03:39:26.067873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:36.159864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.068208+0000","last_change":"2024-05-10T03:38:36.573019+0000","last_active":"2024-05-10T03:39:26.068208+0000","last_peered":"2024-05-10T03:39:26.068208+0000","last_clean":"2024-05-10T03:39:26.068208+0000","last_became_active":"2024-05-10T03:38:36.572667+0000","last_became_peered":"2024-05-10T03:38:36.572667+0000","last_unstale":"2024-05-10T03:39:26.068208+0000","last_undegraded":"2024-05-10T03:39:26.068208+0000","last_fullsized":"2024-05-10T03:39:26.068208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:24:23.722642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074998+0000","last_change":"2024-05-10T03:38:36.577069+0000","last_active":"2024-05-10T03:39:26.074998+0000","last_peered":"2024-05-10T03:39:26.074998+0000","last_clean":"2024-05-10T03:39:26.074998+0000","last_became_active":"2024-05-10T03:38:36.576683+0000","last_became_peered":"2024-05-10T03:38:36.576683+0000","last_unstale":"2024-05-10T03:39:26.074998+0000","last_undegraded":"2024-05-10T03:39:26.074998+0000","last_fullsized":"2024-05-10T03:39:26.074998+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:09:15.280098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073190+0000","last_change":"2024-05-10T03:38:36.577518+0000","last_active":"2024-05-10T03:39:26.073190+0000","last_peered":"2024-05-10T03:39:26.073190+0000","last_clean":"2024-05-10T03:39:26.073190+0000","last_became_active":"2024-05-10T03:38:36.577147+0000","last_became_peered":"2024-05-10T03:38:36.577147+0000","last_unstale":"2024-05-10T03:39:26.073190+0000","last_undegraded":"2024-05-10T03:39:26.073190+0000","last_fullsized":"2024-05-10T03:39:26.073190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:39:42.779405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078304+0000","last_change":"2024-05-10T03:38:36.594241+0000","last_active":"2024-05-10T03:39:26.078304+0000","last_peered":"2024-05-10T03:39:26.078304+0000","last_clean":"2024-05-10T03:39:26.078304+0000","last_became_active":"2024-05-10T03:38:36.593943+0000","last_became_peered":"2024-05-10T03:38:36.593943+0000","last_unstale":"2024-05-10T03:39:26.078304+0000","last_undegraded":"2024-05-10T03:39:26.078304+0000","last_fullsized":"2024-05-10T03:39:26.078304+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:00.521083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076927+0000","last_change":"2024-05-10T03:38:36.578318+0000","last_active":"2024-05-10T03:39:26.076927+0000","last_peered":"2024-05-10T03:39:26.076927+0000","last_clean":"2024-05-10T03:39:26.076927+0000","last_became_active":"2024-05-10T03:38:36.577967+0000","last_became_peered":"2024-05-10T03:38:36.577967+0000","last_unstale":"2024-05-10T03:39:26.076927+0000","last_undegraded":"2024-05-10T03:39:26.076927+0000","last_fullsized":"2024-05-10T03:39:26.076927+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:45:27.988368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075718+0000","last_change":"2024-05-10T03:38:36.590219+0000","last_active":"2024-05-10T03:39:26.075718+0000","last_peered":"2024-05-10T03:39:26.075718+0000","last_clean":"2024-05-10T03:39:26.075718+0000","last_became_active":"2024-05-10T03:38:36.589849+0000","last_became_peered":"2024-05-10T03:38:36.589849+0000","last_unstale":"2024-05-10T03:39:26.075718+0000","last_undegraded":"2024-05-10T03:39:26.075718+0000","last_fullsized":"2024-05-10T03:39:26.075718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:08:17.073204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072847+0000","last_change":"2024-05-10T03:38:36.580555+0000","last_active":"2024-05-10T03:39:26.072847+0000","last_peered":"2024-05-10T03:39:26.072847+0000","last_clean":"2024-05-10T03:39:26.072847+0000","last_became_active":"2024-05-10T03:38:36.577575+0000","last_became_peered":"2024-05-10T03:38:36.577575+0000","last_unstale":"2024-05-10T03:39:26.072847+0000","last_undegraded":"2024-05-10T03:39:26.072847+0000","last_fullsized":"2024-05-10T03:39:26.072847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:43:29.237054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078946+0000","last_change":"2024-05-10T03:38:36.586599+0000","last_active":"2024-05-10T03:39:26.078946+0000","last_peered":"2024-05-10T03:39:26.078946+0000","last_clean":"2024-05-10T03:39:26.078946+0000","last_became_active":"2024-05-10T03:38:36.585794+0000","last_became_peered":"2024-05-10T03:38:36.585794+0000","last_unstale":"2024-05-10T03:39:26.078946+0000","last_undegraded":"2024-05-10T03:39:26.078946+0000","last_fullsized":"2024-05-10T03:39:26.078946+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:25:18.337715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.068090+0000","last_change":"2024-05-10T03:38:36.578957+0000","last_active":"2024-05-10T03:39:26.068090+0000","last_peered":"2024-05-10T03:39:26.068090+0000","last_clean":"2024-05-10T03:39:26.068090+0000","last_became_active":"2024-05-10T03:38:36.578636+0000","last_became_peered":"2024-05-10T03:38:36.578636+0000","last_unstale":"2024-05-10T03:39:26.068090+0000","last_undegraded":"2024-05-10T03:39:26.068090+0000","last_fullsized":"2024-05-10T03:39:26.068090+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:55:38.830864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.079013+0000","last_change":"2024-05-10T03:39:27.079013+0000","last_active":"2024-05-10T03:39:27.079013+0000","last_peered":"2024-05-10T03:39:27.079013+0000","last_clean":"2024-05-10T03:39:27.079013+0000","last_became_active":"2024-05-10T03:39:27.078674+0000","last_became_peered":"2024-05-10T03:39:27.078674+0000","last_unstale":"2024-05-10T03:39:27.079013+0000","last_undegraded":"2024-05-10T03:39:27.079013+0000","last_fullsized":"2024-05-10T03:39:27.079013+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:59:52.547126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.066698+0000","last_change":"2024-05-10T03:38:36.590205+0000","last_active":"2024-05-10T03:39:26.066698+0000","last_peered":"2024-05-10T03:39:26.066698+0000","last_clean":"2024-05-10T03:39:26.066698+0000","last_became_active":"2024-05-10T03:38:36.589880+0000","last_became_peered":"2024-05-10T03:38:36.589880+0000","last_unstale":"2024-05-10T03:39:26.066698+0000","last_undegraded":"2024-05-10T03:39:26.066698+0000","last_fullsized":"2024-05-10T03:39:26.066698+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:22:26.374034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.077754+0000","last_change":"2024-05-10T03:39:27.077754+0000","last_active":"2024-05-10T03:39:27.077754+0000","last_peered":"2024-05-10T03:39:27.077754+0000","last_clean":"2024-05-10T03:39:27.077754+0000","last_became_active":"2024-05-10T03:39:27.077313+0000","last_became_peered":"2024-05-10T03:39:27.077313+0000","last_unstale":"2024-05-10T03:39:27.077754+0000","last_undegraded":"2024-05-10T03:39:27.077754+0000","last_fullsized":"2024-05-10T03:39:27.077754+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:36:49.331763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074838+0000","last_change":"2024-05-10T03:38:36.591061+0000","last_active":"2024-05-10T03:39:26.074838+0000","last_peered":"2024-05-10T03:39:26.074838+0000","last_clean":"2024-05-10T03:39:26.074838+0000","last_became_active":"2024-05-10T03:38:36.590698+0000","last_became_peered":"2024-05-10T03:38:36.590698+0000","last_unstale":"2024-05-10T03:39:26.074838+0000","last_undegraded":"2024-05-10T03:39:26.074838+0000","last_fullsized":"2024-05-10T03:39:26.074838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:44:43.130908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076823+0000","last_change":"2024-05-10T03:38:36.585990+0000","last_active":"2024-05-10T03:39:26.076823+0000","last_peered":"2024-05-10T03:39:26.076823+0000","last_clean":"2024-05-10T03:39:26.076823+0000","last_became_active":"2024-05-10T03:38:36.585221+0000","last_became_peered":"2024-05-10T03:38:36.585221+0000","last_unstale":"2024-05-10T03:39:26.076823+0000","last_undegraded":"2024-05-10T03:39:26.076823+0000","last_fullsized":"2024-05-10T03:39:26.076823+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:57:58.981790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074421+0000","last_change":"2024-05-10T03:38:36.586651+0000","last_active":"2024-05-10T03:39:26.074421+0000","last_peered":"2024-05-10T03:39:26.074421+0000","last_clean":"2024-05-10T03:39:26.074421+0000","last_became_active":"2024-05-10T03:38:36.586243+0000","last_became_peered":"2024-05-10T03:38:36.586243+0000","last_unstale":"2024-05-10T03:39:26.074421+0000","last_undegraded":"2024-05-10T03:39:26.074421+0000","last_fullsized":"2024-05-10T03:39:26.074421+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:15:58.148040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.071924+0000","last_change":"2024-05-10T03:38:36.583740+0000","last_active":"2024-05-10T03:39:26.071924+0000","last_peered":"2024-05-10T03:39:26.071924+0000","last_clean":"2024-05-10T03:39:26.071924+0000","last_became_active":"2024-05-10T03:38:36.583359+0000","last_became_peered":"2024-05-10T03:38:36.583359+0000","last_unstale":"2024-05-10T03:39:26.071924+0000","last_undegraded":"2024-05-10T03:39:26.071924+0000","last_fullsized":"2024-05-10T03:39:26.071924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:31:29.286667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072212+0000","last_change":"2024-05-10T03:38:40.605484+0000","last_active":"2024-05-10T03:39:26.072212+0000","last_peered":"2024-05-10T03:39:26.072212+0000","last_clean":"2024-05-10T03:39:26.072212+0000","last_became_active":"2024-05-10T03:38:40.605105+0000","last_became_peered":"2024-05-10T03:38:40.605105+0000","last_unstale":"2024-05-10T03:39:26.072212+0000","last_undegraded":"2024-05-10T03:39:26.072212+0000","last_fullsized":"2024-05-10T03:39:26.072212+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:11:34.548916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":109,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:40:15.131236+0000","last_change":"2024-05-10T03:38:36.093877+0000","last_active":"2024-05-10T03:40:15.131236+0000","last_peered":"2024-05-10T03:40:15.131236+0000","last_clean":"2024-05-10T03:40:15.131236+0000","last_became_active":"2024-05-10T03:38:36.093499+0000","last_became_peered":"2024-05-10T03:38:36.093499+0000","last_unstale":"2024-05-10T03:40:15.131236+0000","last_undegraded":"2024-05-10T03:40:15.131236+0000","last_fullsized":"2024-05-10T03:40:15.131236+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:42:17.171167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.080639+0000","last_change":"2024-05-10T03:39:27.080639+0000","last_active":"2024-05-10T03:39:27.080639+0000","last_peered":"2024-05-10T03:39:27.080639+0000","last_clean":"2024-05-10T03:39:27.080639+0000","last_became_active":"2024-05-10T03:39:27.080267+0000","last_became_peered":"2024-05-10T03:39:27.080267+0000","last_unstale":"2024-05-10T03:39:27.080639+0000","last_undegraded":"2024-05-10T03:39:27.080639+0000","last_fullsized":"2024-05-10T03:39:27.080639+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:56:51.282955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067286+0000","last_change":"2024-05-10T03:38:40.608982+0000","last_active":"2024-05-10T03:39:26.067286+0000","last_peered":"2024-05-10T03:39:26.067286+0000","last_clean":"2024-05-10T03:39:26.067286+0000","last_became_active":"2024-05-10T03:38:40.608619+0000","last_became_peered":"2024-05-10T03:38:40.608619+0000","last_unstale":"2024-05-10T03:39:26.067286+0000","last_undegraded":"2024-05-10T03:39:26.067286+0000","last_fullsized":"2024-05-10T03:39:26.067286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:35:56.411530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077808+0000","last_change":"2024-05-10T03:38:36.101669+0000","last_active":"2024-05-10T03:39:26.077808+0000","last_peered":"2024-05-10T03:39:26.077808+0000","last_clean":"2024-05-10T03:39:26.077808+0000","last_became_active":"2024-05-10T03:38:36.101231+0000","last_became_peered":"2024-05-10T03:38:36.101231+0000","last_unstale":"2024-05-10T03:39:26.077808+0000","last_undegraded":"2024-05-10T03:39:26.077808+0000","last_fullsized":"2024-05-10T03:39:26.077808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:42:21.992880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067320+0000","last_change":"2024-05-10T03:38:36.585580+0000","last_active":"2024-05-10T03:39:26.067320+0000","last_peered":"2024-05-10T03:39:26.067320+0000","last_clean":"2024-05-10T03:39:26.067320+0000","last_became_active":"2024-05-10T03:38:36.585239+0000","last_became_peered":"2024-05-10T03:38:36.585239+0000","last_unstale":"2024-05-10T03:39:26.067320+0000","last_undegraded":"2024-05-10T03:39:26.067320+0000","last_fullsized":"2024-05-10T03:39:26.067320+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:39:42.886154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067314+0000","last_change":"2024-05-10T03:38:40.610372+0000","last_active":"2024-05-10T03:39:26.067314+0000","last_peered":"2024-05-10T03:39:26.067314+0000","last_clean":"2024-05-10T03:39:26.067314+0000","last_became_active":"2024-05-10T03:38:40.609958+0000","last_became_peered":"2024-05-10T03:38:40.609958+0000","last_unstale":"2024-05-10T03:39:26.067314+0000","last_undegraded":"2024-05-10T03:39:26.067314+0000","last_fullsized":"2024-05-10T03:39:26.067314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:04:37.461729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075873+0000","last_change":"2024-05-10T03:38:36.091809+0000","last_active":"2024-05-10T03:39:26.075873+0000","last_peered":"2024-05-10T03:39:26.075873+0000","last_clean":"2024-05-10T03:39:26.075873+0000","last_became_active":"2024-05-10T03:38:36.091372+0000","last_became_peered":"2024-05-10T03:38:36.091372+0000","last_unstale":"2024-05-10T03:39:26.075873+0000","last_undegraded":"2024-05-10T03:39:26.075873+0000","last_fullsized":"2024-05-10T03:39:26.075873+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:25:01.784559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075357+0000","last_change":"2024-05-10T03:38:36.595389+0000","last_active":"2024-05-10T03:39:26.075357+0000","last_peered":"2024-05-10T03:39:26.075357+0000","last_clean":"2024-05-10T03:39:26.075357+0000","last_became_active":"2024-05-10T03:38:36.595011+0000","last_became_peered":"2024-05-10T03:38:36.595011+0000","last_unstale":"2024-05-10T03:39:26.075357+0000","last_undegraded":"2024-05-10T03:39:26.075357+0000","last_fullsized":"2024-05-10T03:39:26.075357+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:54:38.377508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067207+0000","last_change":"2024-05-10T03:38:40.605656+0000","last_active":"2024-05-10T03:39:26.067207+0000","last_peered":"2024-05-10T03:39:26.067207+0000","last_clean":"2024-05-10T03:39:26.067207+0000","last_became_active":"2024-05-10T03:38:40.605262+0000","last_became_peered":"2024-05-10T03:38:40.605262+0000","last_unstale":"2024-05-10T03:39:26.067207+0000","last_undegraded":"2024-05-10T03:39:26.067207+0000","last_fullsized":"2024-05-10T03:39:26.067207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:11:27.398282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.089175+0000","last_change":"2024-05-10T03:39:27.089175+0000","last_active":"2024-05-10T03:39:27.089175+0000","last_peered":"2024-05-10T03:39:27.089175+0000","last_clean":"2024-05-10T03:39:27.089175+0000","last_became_active":"2024-05-10T03:39:27.080923+0000","last_became_peered":"2024-05-10T03:39:27.080923+0000","last_unstale":"2024-05-10T03:39:27.089175+0000","last_undegraded":"2024-05-10T03:39:27.089175+0000","last_fullsized":"2024-05-10T03:39:27.089175+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:22.891201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073498+0000","last_change":"2024-05-10T03:38:36.587831+0000","last_active":"2024-05-10T03:39:26.073498+0000","last_peered":"2024-05-10T03:39:26.073498+0000","last_clean":"2024-05-10T03:39:26.073498+0000","last_became_active":"2024-05-10T03:38:36.587503+0000","last_became_peered":"2024-05-10T03:38:36.587503+0000","last_unstale":"2024-05-10T03:39:26.073498+0000","last_undegraded":"2024-05-10T03:39:26.073498+0000","last_fullsized":"2024-05-10T03:39:26.073498+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:52.335134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.071626+0000","last_change":"2024-05-10T03:38:40.601327+0000","last_active":"2024-05-10T03:39:26.071626+0000","last_peered":"2024-05-10T03:39:26.071626+0000","last_clean":"2024-05-10T03:39:26.071626+0000","last_became_active":"2024-05-10T03:38:40.600901+0000","last_became_peered":"2024-05-10T03:38:40.600901+0000","last_unstale":"2024-05-10T03:39:26.071626+0000","last_undegraded":"2024-05-10T03:39:26.071626+0000","last_fullsized":"2024-05-10T03:39:26.071626+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:28.285707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":102,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:40:13.129904+0000","last_change":"2024-05-10T03:38:36.094064+0000","last_active":"2024-05-10T03:40:13.129904+0000","last_peered":"2024-05-10T03:40:13.129904+0000","last_clean":"2024-05-10T03:40:13.129904+0000","last_became_active":"2024-05-10T03:38:36.093522+0000","last_became_peered":"2024-05-10T03:38:36.093522+0000","last_unstale":"2024-05-10T03:40:13.129904+0000","last_undegraded":"2024-05-10T03:40:13.129904+0000","last_fullsized":"2024-05-10T03:40:13.129904+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:25:14.257166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":77,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076617+0000","last_change":"2024-05-10T03:38:36.580553+0000","last_active":"2024-05-10T03:39:26.076617+0000","last_peered":"2024-05-10T03:39:26.076617+0000","last_clean":"2024-05-10T03:39:26.076617+0000","last_became_active":"2024-05-10T03:38:36.580160+0000","last_became_peered":"2024-05-10T03:38:36.580160+0000","last_unstale":"2024-05-10T03:39:26.076617+0000","last_undegraded":"2024-05-10T03:39:26.076617+0000","last_fullsized":"2024-05-10T03:39:26.076617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:01:14.373430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.071997+0000","last_change":"2024-05-10T03:38:40.609034+0000","last_active":"2024-05-10T03:39:26.071997+0000","last_peered":"2024-05-10T03:39:26.071997+0000","last_clean":"2024-05-10T03:39:26.071997+0000","last_became_active":"2024-05-10T03:38:40.608617+0000","last_became_peered":"2024-05-10T03:38:40.608617+0000","last_unstale":"2024-05-10T03:39:26.071997+0000","last_undegraded":"2024-05-10T03:39:26.071997+0000","last_fullsized":"2024-05-10T03:39:26.071997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:55:28.669881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.093057+0000","last_change":"2024-05-10T03:39:27.093057+0000","last_active":"2024-05-10T03:39:27.093057+0000","last_peered":"2024-05-10T03:39:27.093057+0000","last_clean":"2024-05-10T03:39:27.093057+0000","last_became_active":"2024-05-10T03:39:27.076537+0000","last_became_peered":"2024-05-10T03:39:27.076537+0000","last_unstale":"2024-05-10T03:39:27.093057+0000","last_undegraded":"2024-05-10T03:39:27.093057+0000","last_fullsized":"2024-05-10T03:39:27.093057+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:24.158984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073109+0000","last_change":"2024-05-10T03:38:36.569429+0000","last_active":"2024-05-10T03:39:26.073109+0000","last_peered":"2024-05-10T03:39:26.073109+0000","last_clean":"2024-05-10T03:39:26.073109+0000","last_became_active":"2024-05-10T03:38:36.569042+0000","last_became_peered":"2024-05-10T03:38:36.569042+0000","last_unstale":"2024-05-10T03:39:26.073109+0000","last_undegraded":"2024-05-10T03:39:26.073109+0000","last_fullsized":"2024-05-10T03:39:26.073109+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:45:14.912428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076732+0000","last_change":"2024-05-10T03:38:40.607734+0000","last_active":"2024-05-10T03:39:26.076732+0000","last_peered":"2024-05-10T03:39:26.076732+0000","last_clean":"2024-05-10T03:39:26.076732+0000","last_became_active":"2024-05-10T03:38:40.607331+0000","last_became_peered":"2024-05-10T03:38:40.607331+0000","last_unstale":"2024-05-10T03:39:26.076732+0000","last_undegraded":"2024-05-10T03:39:26.076732+0000","last_fullsized":"2024-05-10T03:39:26.076732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:45:08.360275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.069502+0000","last_change":"2024-05-10T03:38:36.083651+0000","last_active":"2024-05-10T03:39:26.069502+0000","last_peered":"2024-05-10T03:39:26.069502+0000","last_clean":"2024-05-10T03:39:26.069502+0000","last_became_active":"2024-05-10T03:38:36.083235+0000","last_became_peered":"2024-05-10T03:38:36.083235+0000","last_unstale":"2024-05-10T03:39:26.069502+0000","last_undegraded":"2024-05-10T03:39:26.069502+0000","last_fullsized":"2024-05-10T03:39:26.069502+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:28:43.179157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077120+0000","last_change":"2024-05-10T03:38:36.579055+0000","last_active":"2024-05-10T03:39:26.077120+0000","last_peered":"2024-05-10T03:39:26.077120+0000","last_clean":"2024-05-10T03:39:26.077120+0000","last_became_active":"2024-05-10T03:38:36.578200+0000","last_became_peered":"2024-05-10T03:38:36.578200+0000","last_unstale":"2024-05-10T03:39:26.077120+0000","last_undegraded":"2024-05-10T03:39:26.077120+0000","last_fullsized":"2024-05-10T03:39:26.077120+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:48:12.749264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067181+0000","last_change":"2024-05-10T03:38:40.603903+0000","last_active":"2024-05-10T03:39:26.067181+0000","last_peered":"2024-05-10T03:39:26.067181+0000","last_clean":"2024-05-10T03:39:26.067181+0000","last_became_active":"2024-05-10T03:38:40.603481+0000","last_became_peered":"2024-05-10T03:38:40.603481+0000","last_unstale":"2024-05-10T03:39:26.067181+0000","last_undegraded":"2024-05-10T03:39:26.067181+0000","last_fullsized":"2024-05-10T03:39:26.067181+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:44:48.526838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072175+0000","last_change":"2024-05-10T03:38:36.093549+0000","last_active":"2024-05-10T03:39:26.072175+0000","last_peered":"2024-05-10T03:39:26.072175+0000","last_clean":"2024-05-10T03:39:26.072175+0000","last_became_active":"2024-05-10T03:38:36.093244+0000","last_became_peered":"2024-05-10T03:38:36.093244+0000","last_unstale":"2024-05-10T03:39:26.072175+0000","last_undegraded":"2024-05-10T03:39:26.072175+0000","last_fullsized":"2024-05-10T03:39:26.072175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:11:55.727728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073706+0000","last_change":"2024-05-10T03:38:36.582623+0000","last_active":"2024-05-10T03:39:26.073706+0000","last_peered":"2024-05-10T03:39:26.073706+0000","last_clean":"2024-05-10T03:39:26.073706+0000","last_became_active":"2024-05-10T03:38:36.582262+0000","last_became_peered":"2024-05-10T03:38:36.582262+0000","last_unstale":"2024-05-10T03:39:26.073706+0000","last_undegraded":"2024-05-10T03:39:26.073706+0000","last_fullsized":"2024-05-10T03:39:26.073706+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:48.561206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077079+0000","last_change":"2024-05-10T03:38:40.602050+0000","last_active":"2024-05-10T03:39:26.077079+0000","last_peered":"2024-05-10T03:39:26.077079+0000","last_clean":"2024-05-10T03:39:26.077079+0000","last_became_active":"2024-05-10T03:38:40.601699+0000","last_became_peered":"2024-05-10T03:38:40.601699+0000","last_unstale":"2024-05-10T03:39:26.077079+0000","last_undegraded":"2024-05-10T03:39:26.077079+0000","last_fullsized":"2024-05-10T03:39:26.077079+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:56.778636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"88'5","reported_seq":173,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:40:14.130712+0000","last_change":"2024-05-10T03:38:36.095747+0000","last_active":"2024-05-10T03:40:14.130712+0000","last_peered":"2024-05-10T03:40:14.130712+0000","last_clean":"2024-05-10T03:40:14.130712+0000","last_became_active":"2024-05-10T03:38:36.095371+0000","last_became_peered":"2024-05-10T03:38:36.095371+0000","last_unstale":"2024-05-10T03:40:14.130712+0000","last_undegraded":"2024-05-10T03:40:14.130712+0000","last_fullsized":"2024-05-10T03:40:14.130712+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:02:37.435286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":150,"num_read_kb":150,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075561+0000","last_change":"2024-05-10T03:38:36.591321+0000","last_active":"2024-05-10T03:39:26.075561+0000","last_peered":"2024-05-10T03:39:26.075561+0000","last_clean":"2024-05-10T03:39:26.075561+0000","last_became_active":"2024-05-10T03:38:36.589852+0000","last_became_peered":"2024-05-10T03:38:36.589852+0000","last_unstale":"2024-05-10T03:39:26.075561+0000","last_undegraded":"2024-05-10T03:39:26.075561+0000","last_fullsized":"2024-05-10T03:39:26.075561+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:43.075901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073535+0000","last_change":"2024-05-10T03:38:40.605096+0000","last_active":"2024-05-10T03:39:26.073535+0000","last_peered":"2024-05-10T03:39:26.073535+0000","last_clean":"2024-05-10T03:39:26.073535+0000","last_became_active":"2024-05-10T03:38:40.604595+0000","last_became_peered":"2024-05-10T03:38:40.604595+0000","last_unstale":"2024-05-10T03:39:26.073535+0000","last_undegraded":"2024-05-10T03:39:26.073535+0000","last_fullsized":"2024-05-10T03:39:26.073535+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:14.547025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078938+0000","last_change":"2024-05-10T03:38:36.097214+0000","last_active":"2024-05-10T03:39:26.078938+0000","last_peered":"2024-05-10T03:39:26.078938+0000","last_clean":"2024-05-10T03:39:26.078938+0000","last_became_active":"2024-05-10T03:38:36.096835+0000","last_became_peered":"2024-05-10T03:38:36.096835+0000","last_unstale":"2024-05-10T03:39:26.078938+0000","last_undegraded":"2024-05-10T03:39:26.078938+0000","last_fullsized":"2024-05-10T03:39:26.078938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:50.757974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.081369+0000","last_change":"2024-05-10T03:39:27.081369+0000","last_active":"2024-05-10T03:39:27.081369+0000","last_peered":"2024-05-10T03:39:27.081369+0000","last_clean":"2024-05-10T03:39:27.081369+0000","last_became_active":"2024-05-10T03:39:27.080851+0000","last_became_peered":"2024-05-10T03:39:27.080851+0000","last_unstale":"2024-05-10T03:39:27.081369+0000","last_undegraded":"2024-05-10T03:39:27.081369+0000","last_fullsized":"2024-05-10T03:39:27.081369+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:11.552549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067592+0000","last_change":"2024-05-10T03:38:40.605627+0000","last_active":"2024-05-10T03:39:26.067592+0000","last_peered":"2024-05-10T03:39:26.067592+0000","last_clean":"2024-05-10T03:39:26.067592+0000","last_became_active":"2024-05-10T03:38:40.605116+0000","last_became_peered":"2024-05-10T03:38:40.605116+0000","last_unstale":"2024-05-10T03:39:26.067592+0000","last_undegraded":"2024-05-10T03:39:26.067592+0000","last_fullsized":"2024-05-10T03:39:26.067592+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:50:08.759725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073226+0000","last_change":"2024-05-10T03:38:36.102257+0000","last_active":"2024-05-10T03:39:26.073226+0000","last_peered":"2024-05-10T03:39:26.073226+0000","last_clean":"2024-05-10T03:39:26.073226+0000","last_became_active":"2024-05-10T03:38:36.101876+0000","last_became_peered":"2024-05-10T03:38:36.101876+0000","last_unstale":"2024-05-10T03:39:26.073226+0000","last_undegraded":"2024-05-10T03:39:26.073226+0000","last_fullsized":"2024-05-10T03:39:26.073226+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:38:01.164794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075466+0000","last_change":"2024-05-10T03:38:36.591746+0000","last_active":"2024-05-10T03:39:26.075466+0000","last_peered":"2024-05-10T03:39:26.075466+0000","last_clean":"2024-05-10T03:39:26.075466+0000","last_became_active":"2024-05-10T03:38:36.591474+0000","last_became_peered":"2024-05-10T03:38:36.591474+0000","last_unstale":"2024-05-10T03:39:26.075466+0000","last_undegraded":"2024-05-10T03:39:26.075466+0000","last_fullsized":"2024-05-10T03:39:26.075466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:18:02.773737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073900+0000","last_change":"2024-05-10T03:38:40.605956+0000","last_active":"2024-05-10T03:39:26.073900+0000","last_peered":"2024-05-10T03:39:26.073900+0000","last_clean":"2024-05-10T03:39:26.073900+0000","last_became_active":"2024-05-10T03:38:40.605466+0000","last_became_peered":"2024-05-10T03:38:40.605466+0000","last_unstale":"2024-05-10T03:39:26.073900+0000","last_undegraded":"2024-05-10T03:39:26.073900+0000","last_fullsized":"2024-05-10T03:39:26.073900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:07:44.234771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"88'37","reported_seq":235,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:40:14.152649+0000","last_change":"2024-05-10T03:39:27.083993+0000","last_active":"2024-05-10T03:40:14.152649+0000","last_peered":"2024-05-10T03:40:14.152649+0000","last_clean":"2024-05-10T03:40:14.152649+0000","last_became_active":"2024-05-10T03:39:27.075982+0000","last_became_peered":"2024-05-10T03:39:27.075982+0000","last_unstale":"2024-05-10T03:40:14.152649+0000","last_undegraded":"2024-05-10T03:40:14.152649+0000","last_fullsized":"2024-05-10T03:40:14.152649+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:10:49.852271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67940,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":154,"num_read_kb":138,"num_write":39,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":63312,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075545+0000","last_change":"2024-05-10T03:38:36.579560+0000","last_active":"2024-05-10T03:39:26.075545+0000","last_peered":"2024-05-10T03:39:26.075545+0000","last_clean":"2024-05-10T03:39:26.075545+0000","last_became_active":"2024-05-10T03:38:36.579217+0000","last_became_peered":"2024-05-10T03:38:36.579217+0000","last_unstale":"2024-05-10T03:39:26.075545+0000","last_undegraded":"2024-05-10T03:39:26.075545+0000","last_fullsized":"2024-05-10T03:39:26.075545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:11:50.208794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076114+0000","last_change":"2024-05-10T03:38:40.599253+0000","last_active":"2024-05-10T03:39:26.076114+0000","last_peered":"2024-05-10T03:39:26.076114+0000","last_clean":"2024-05-10T03:39:26.076114+0000","last_became_active":"2024-05-10T03:38:40.597818+0000","last_became_peered":"2024-05-10T03:38:40.597818+0000","last_unstale":"2024-05-10T03:39:26.076114+0000","last_undegraded":"2024-05-10T03:39:26.076114+0000","last_fullsized":"2024-05-10T03:39:26.076114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:48:37.286108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073316+0000","last_change":"2024-05-10T03:38:36.100727+0000","last_active":"2024-05-10T03:39:26.073316+0000","last_peered":"2024-05-10T03:39:26.073316+0000","last_clean":"2024-05-10T03:39:26.073316+0000","last_became_active":"2024-05-10T03:38:36.100381+0000","last_became_peered":"2024-05-10T03:38:36.100381+0000","last_unstale":"2024-05-10T03:39:26.073316+0000","last_undegraded":"2024-05-10T03:39:26.073316+0000","last_fullsized":"2024-05-10T03:39:26.073316+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:57:53.831417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.069729+0000","last_change":"2024-05-10T03:38:36.580924+0000","last_active":"2024-05-10T03:39:26.069729+0000","last_peered":"2024-05-10T03:39:26.069729+0000","last_clean":"2024-05-10T03:39:26.069729+0000","last_became_active":"2024-05-10T03:38:36.580598+0000","last_became_peered":"2024-05-10T03:38:36.580598+0000","last_unstale":"2024-05-10T03:39:26.069729+0000","last_undegraded":"2024-05-10T03:39:26.069729+0000","last_fullsized":"2024-05-10T03:39:26.069729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:33:12.007718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077561+0000","last_change":"2024-05-10T03:38:40.606934+0000","last_active":"2024-05-10T03:39:26.077561+0000","last_peered":"2024-05-10T03:39:26.077561+0000","last_clean":"2024-05-10T03:39:26.077561+0000","last_became_active":"2024-05-10T03:38:40.606451+0000","last_became_peered":"2024-05-10T03:38:40.606451+0000","last_unstale":"2024-05-10T03:39:26.077561+0000","last_undegraded":"2024-05-10T03:39:26.077561+0000","last_fullsized":"2024-05-10T03:39:26.077561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:03:43.562337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073308+0000","last_change":"2024-05-10T03:38:36.093109+0000","last_active":"2024-05-10T03:39:26.073308+0000","last_peered":"2024-05-10T03:39:26.073308+0000","last_clean":"2024-05-10T03:39:26.073308+0000","last_became_active":"2024-05-10T03:38:36.092623+0000","last_became_peered":"2024-05-10T03:38:36.092623+0000","last_unstale":"2024-05-10T03:39:26.073308+0000","last_undegraded":"2024-05-10T03:39:26.073308+0000","last_fullsized":"2024-05-10T03:39:26.073308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:27:10.367098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.079173+0000","last_change":"2024-05-10T03:38:36.582794+0000","last_active":"2024-05-10T03:39:26.079173+0000","last_peered":"2024-05-10T03:39:26.079173+0000","last_clean":"2024-05-10T03:39:26.079173+0000","last_became_active":"2024-05-10T03:38:36.582464+0000","last_became_peered":"2024-05-10T03:38:36.582464+0000","last_unstale":"2024-05-10T03:39:26.079173+0000","last_undegraded":"2024-05-10T03:39:26.079173+0000","last_fullsized":"2024-05-10T03:39:26.079173+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:58:19.665485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074568+0000","last_change":"2024-05-10T03:38:40.608696+0000","last_active":"2024-05-10T03:39:26.074568+0000","last_peered":"2024-05-10T03:39:26.074568+0000","last_clean":"2024-05-10T03:39:26.074568+0000","last_became_active":"2024-05-10T03:38:40.607868+0000","last_became_peered":"2024-05-10T03:38:40.607868+0000","last_unstale":"2024-05-10T03:39:26.074568+0000","last_undegraded":"2024-05-10T03:39:26.074568+0000","last_fullsized":"2024-05-10T03:39:26.074568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:27.154675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":101,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:40:14.148862+0000","last_change":"2024-05-10T03:38:36.093060+0000","last_active":"2024-05-10T03:40:14.148862+0000","last_peered":"2024-05-10T03:40:14.148862+0000","last_clean":"2024-05-10T03:40:14.148862+0000","last_became_active":"2024-05-10T03:38:36.092476+0000","last_became_peered":"2024-05-10T03:38:36.092476+0000","last_unstale":"2024-05-10T03:40:14.148862+0000","last_undegraded":"2024-05-10T03:40:14.148862+0000","last_fullsized":"2024-05-10T03:40:14.148862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:52:04.624230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":79,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078407+0000","last_change":"2024-05-10T03:38:36.594808+0000","last_active":"2024-05-10T03:39:26.078407+0000","last_peered":"2024-05-10T03:39:26.078407+0000","last_clean":"2024-05-10T03:39:26.078407+0000","last_became_active":"2024-05-10T03:38:36.594511+0000","last_became_peered":"2024-05-10T03:38:36.594511+0000","last_unstale":"2024-05-10T03:39:26.078407+0000","last_undegraded":"2024-05-10T03:39:26.078407+0000","last_fullsized":"2024-05-10T03:39:26.078407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:18:59.981485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070877+0000","last_change":"2024-05-10T03:38:40.605744+0000","last_active":"2024-05-10T03:39:26.070877+0000","last_peered":"2024-05-10T03:39:26.070877+0000","last_clean":"2024-05-10T03:39:26.070877+0000","last_became_active":"2024-05-10T03:38:40.605269+0000","last_became_peered":"2024-05-10T03:38:40.605269+0000","last_unstale":"2024-05-10T03:39:26.070877+0000","last_undegraded":"2024-05-10T03:39:26.070877+0000","last_fullsized":"2024-05-10T03:39:26.070877+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:21.881903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074955+0000","last_change":"2024-05-10T03:38:36.098918+0000","last_active":"2024-05-10T03:39:26.074955+0000","last_peered":"2024-05-10T03:39:26.074955+0000","last_clean":"2024-05-10T03:39:26.074955+0000","last_became_active":"2024-05-10T03:38:36.098586+0000","last_became_peered":"2024-05-10T03:38:36.098586+0000","last_unstale":"2024-05-10T03:39:26.074955+0000","last_undegraded":"2024-05-10T03:39:26.074955+0000","last_fullsized":"2024-05-10T03:39:26.074955+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:58:48.297763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072973+0000","last_change":"2024-05-10T03:38:36.581347+0000","last_active":"2024-05-10T03:39:26.072973+0000","last_peered":"2024-05-10T03:39:26.072973+0000","last_clean":"2024-05-10T03:39:26.072973+0000","last_became_active":"2024-05-10T03:38:36.581044+0000","last_became_peered":"2024-05-10T03:38:36.581044+0000","last_unstale":"2024-05-10T03:39:26.072973+0000","last_undegraded":"2024-05-10T03:39:26.072973+0000","last_fullsized":"2024-05-10T03:39:26.072973+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:23:43.885238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072974+0000","last_change":"2024-05-10T03:38:40.600521+0000","last_active":"2024-05-10T03:39:26.072974+0000","last_peered":"2024-05-10T03:39:26.072974+0000","last_clean":"2024-05-10T03:39:26.072974+0000","last_became_active":"2024-05-10T03:38:40.600016+0000","last_became_peered":"2024-05-10T03:38:40.600016+0000","last_unstale":"2024-05-10T03:39:26.072974+0000","last_undegraded":"2024-05-10T03:39:26.072974+0000","last_fullsized":"2024-05-10T03:39:26.072974+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:58:37.881367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075200+0000","last_change":"2024-05-10T03:38:36.094209+0000","last_active":"2024-05-10T03:39:26.075200+0000","last_peered":"2024-05-10T03:39:26.075200+0000","last_clean":"2024-05-10T03:39:26.075200+0000","last_became_active":"2024-05-10T03:38:36.093447+0000","last_became_peered":"2024-05-10T03:38:36.093447+0000","last_unstale":"2024-05-10T03:39:26.075200+0000","last_undegraded":"2024-05-10T03:39:26.075200+0000","last_fullsized":"2024-05-10T03:39:26.075200+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:24:20.540340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077847+0000","last_change":"2024-05-10T03:38:36.587832+0000","last_active":"2024-05-10T03:39:26.077847+0000","last_peered":"2024-05-10T03:39:26.077847+0000","last_clean":"2024-05-10T03:39:26.077847+0000","last_became_active":"2024-05-10T03:38:36.587475+0000","last_became_peered":"2024-05-10T03:38:36.587475+0000","last_unstale":"2024-05-10T03:39:26.077847+0000","last_undegraded":"2024-05-10T03:39:26.077847+0000","last_fullsized":"2024-05-10T03:39:26.077847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:47:53.318634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076509+0000","last_change":"2024-05-10T03:38:41.150879+0000","last_active":"2024-05-10T03:39:26.076509+0000","last_peered":"2024-05-10T03:39:26.076509+0000","last_clean":"2024-05-10T03:39:26.076509+0000","last_became_active":"2024-05-10T03:38:41.150350+0000","last_became_peered":"2024-05-10T03:38:41.150350+0000","last_unstale":"2024-05-10T03:39:26.076509+0000","last_undegraded":"2024-05-10T03:39:26.076509+0000","last_fullsized":"2024-05-10T03:39:26.076509+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:47:32.429040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074172+0000","last_change":"2024-05-10T03:38:36.095933+0000","last_active":"2024-05-10T03:39:26.074172+0000","last_peered":"2024-05-10T03:39:26.074172+0000","last_clean":"2024-05-10T03:39:26.074172+0000","last_became_active":"2024-05-10T03:38:36.095592+0000","last_became_peered":"2024-05-10T03:38:36.095592+0000","last_unstale":"2024-05-10T03:39:26.074172+0000","last_undegraded":"2024-05-10T03:39:26.074172+0000","last_fullsized":"2024-05-10T03:39:26.074172+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:52:21.729051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072554+0000","last_change":"2024-05-10T03:38:36.591747+0000","last_active":"2024-05-10T03:39:26.072554+0000","last_peered":"2024-05-10T03:39:26.072554+0000","last_clean":"2024-05-10T03:39:26.072554+0000","last_became_active":"2024-05-10T03:38:36.591432+0000","last_became_peered":"2024-05-10T03:38:36.591432+0000","last_unstale":"2024-05-10T03:39:26.072554+0000","last_undegraded":"2024-05-10T03:39:26.072554+0000","last_fullsized":"2024-05-10T03:39:26.072554+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:20:37.549054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070521+0000","last_change":"2024-05-10T03:38:40.597535+0000","last_active":"2024-05-10T03:39:26.070521+0000","last_peered":"2024-05-10T03:39:26.070521+0000","last_clean":"2024-05-10T03:39:26.070521+0000","last_became_active":"2024-05-10T03:38:40.597108+0000","last_became_peered":"2024-05-10T03:38:40.597108+0000","last_unstale":"2024-05-10T03:39:26.070521+0000","last_undegraded":"2024-05-10T03:39:26.070521+0000","last_fullsized":"2024-05-10T03:39:26.070521+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:31:21.765071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":100,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:40:13.128914+0000","last_change":"2024-05-10T03:38:36.099238+0000","last_active":"2024-05-10T03:40:13.128914+0000","last_peered":"2024-05-10T03:40:13.128914+0000","last_clean":"2024-05-10T03:40:13.128914+0000","last_became_active":"2024-05-10T03:38:36.098761+0000","last_became_peered":"2024-05-10T03:38:36.098761+0000","last_unstale":"2024-05-10T03:40:13.128914+0000","last_undegraded":"2024-05-10T03:40:13.128914+0000","last_fullsized":"2024-05-10T03:40:13.128914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:08:49.892665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072990+0000","last_change":"2024-05-10T03:38:36.580983+0000","last_active":"2024-05-10T03:39:26.072990+0000","last_peered":"2024-05-10T03:39:26.072990+0000","last_clean":"2024-05-10T03:39:26.072990+0000","last_became_active":"2024-05-10T03:38:36.580252+0000","last_became_peered":"2024-05-10T03:38:36.580252+0000","last_unstale":"2024-05-10T03:39:26.072990+0000","last_undegraded":"2024-05-10T03:39:26.072990+0000","last_fullsized":"2024-05-10T03:39:26.072990+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:16.265473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070165+0000","last_change":"2024-05-10T03:38:41.148651+0000","last_active":"2024-05-10T03:39:26.070165+0000","last_peered":"2024-05-10T03:39:26.070165+0000","last_clean":"2024-05-10T03:39:26.070165+0000","last_became_active":"2024-05-10T03:38:41.148192+0000","last_became_peered":"2024-05-10T03:38:41.148192+0000","last_unstale":"2024-05-10T03:39:26.070165+0000","last_undegraded":"2024-05-10T03:39:26.070165+0000","last_fullsized":"2024-05-10T03:39:26.070165+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:13:38.795763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072565+0000","last_change":"2024-05-10T03:38:36.577839+0000","last_active":"2024-05-10T03:39:26.072565+0000","last_peered":"2024-05-10T03:39:26.072565+0000","last_clean":"2024-05-10T03:39:26.072565+0000","last_became_active":"2024-05-10T03:38:36.576917+0000","last_became_peered":"2024-05-10T03:38:36.576917+0000","last_unstale":"2024-05-10T03:39:26.072565+0000","last_undegraded":"2024-05-10T03:39:26.072565+0000","last_fullsized":"2024-05-10T03:39:26.072565+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:52:05.825241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":98,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:40:11.142797+0000","last_change":"2024-05-10T03:38:36.099138+0000","last_active":"2024-05-10T03:40:11.142797+0000","last_peered":"2024-05-10T03:40:11.142797+0000","last_clean":"2024-05-10T03:40:11.142797+0000","last_became_active":"2024-05-10T03:38:36.098747+0000","last_became_peered":"2024-05-10T03:38:36.098747+0000","last_unstale":"2024-05-10T03:40:11.142797+0000","last_undegraded":"2024-05-10T03:40:11.142797+0000","last_fullsized":"2024-05-10T03:40:11.142797+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:18.236383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":74,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078995+0000","last_change":"2024-05-10T03:38:40.605489+0000","last_active":"2024-05-10T03:39:26.078995+0000","last_peered":"2024-05-10T03:39:26.078995+0000","last_clean":"2024-05-10T03:39:26.078995+0000","last_became_active":"2024-05-10T03:38:40.605040+0000","last_became_peered":"2024-05-10T03:38:40.605040+0000","last_unstale":"2024-05-10T03:39:26.078995+0000","last_undegraded":"2024-05-10T03:39:26.078995+0000","last_fullsized":"2024-05-10T03:39:26.078995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:52:08.592132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077045+0000","last_change":"2024-05-10T03:38:36.589325+0000","last_active":"2024-05-10T03:39:26.077045+0000","last_peered":"2024-05-10T03:39:26.077045+0000","last_clean":"2024-05-10T03:39:26.077045+0000","last_became_active":"2024-05-10T03:38:36.588976+0000","last_became_peered":"2024-05-10T03:38:36.588976+0000","last_unstale":"2024-05-10T03:39:26.077045+0000","last_undegraded":"2024-05-10T03:39:26.077045+0000","last_fullsized":"2024-05-10T03:39:26.077045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:40.849614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067440+0000","last_change":"2024-05-10T03:38:36.093701+0000","last_active":"2024-05-10T03:39:26.067440+0000","last_peered":"2024-05-10T03:39:26.067440+0000","last_clean":"2024-05-10T03:39:26.067440+0000","last_became_active":"2024-05-10T03:38:36.093362+0000","last_became_peered":"2024-05-10T03:38:36.093362+0000","last_unstale":"2024-05-10T03:39:26.067440+0000","last_undegraded":"2024-05-10T03:39:26.067440+0000","last_fullsized":"2024-05-10T03:39:26.067440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:42:00.208900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":330,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078251+0000","last_change":"2024-05-10T03:37:46.762875+0000","last_active":"2024-05-10T03:39:26.078251+0000","last_peered":"2024-05-10T03:39:26.078251+0000","last_clean":"2024-05-10T03:39:26.078251+0000","last_became_active":"2024-05-10T03:37:46.762448+0000","last_became_peered":"2024-05-10T03:37:46.762448+0000","last_unstale":"2024-05-10T03:39:26.078251+0000","last_undegraded":"2024-05-10T03:39:26.078251+0000","last_fullsized":"2024-05-10T03:39:26.078251+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:35:20.340567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:35:20.340567+0000","last_clean_scrub_stamp":"2024-05-10T03:35:20.340567+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:09:05.491303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073007+0000","last_change":"2024-05-10T03:38:41.150966+0000","last_active":"2024-05-10T03:39:26.073007+0000","last_peered":"2024-05-10T03:39:26.073007+0000","last_clean":"2024-05-10T03:39:26.073007+0000","last_became_active":"2024-05-10T03:38:41.150505+0000","last_became_peered":"2024-05-10T03:38:41.150505+0000","last_unstale":"2024-05-10T03:39:26.073007+0000","last_undegraded":"2024-05-10T03:39:26.073007+0000","last_fullsized":"2024-05-10T03:39:26.073007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:53.992369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.069834+0000","last_change":"2024-05-10T03:38:36.577457+0000","last_active":"2024-05-10T03:39:26.069834+0000","last_peered":"2024-05-10T03:39:26.069834+0000","last_clean":"2024-05-10T03:39:26.069834+0000","last_became_active":"2024-05-10T03:38:36.577105+0000","last_became_peered":"2024-05-10T03:38:36.577105+0000","last_unstale":"2024-05-10T03:39:26.069834+0000","last_undegraded":"2024-05-10T03:39:26.069834+0000","last_fullsized":"2024-05-10T03:39:26.069834+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:34:15.611496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078317+0000","last_change":"2024-05-10T03:38:36.094057+0000","last_active":"2024-05-10T03:39:26.078317+0000","last_peered":"2024-05-10T03:39:26.078317+0000","last_clean":"2024-05-10T03:39:26.078317+0000","last_became_active":"2024-05-10T03:38:36.093705+0000","last_became_peered":"2024-05-10T03:38:36.093705+0000","last_unstale":"2024-05-10T03:39:26.078317+0000","last_undegraded":"2024-05-10T03:39:26.078317+0000","last_fullsized":"2024-05-10T03:39:26.078317+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:00:10.138524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077005+0000","last_change":"2024-05-10T03:38:40.603522+0000","last_active":"2024-05-10T03:39:26.077005+0000","last_peered":"2024-05-10T03:39:26.077005+0000","last_clean":"2024-05-10T03:39:26.077005+0000","last_became_active":"2024-05-10T03:38:40.603058+0000","last_became_peered":"2024-05-10T03:38:40.603058+0000","last_unstale":"2024-05-10T03:39:26.077005+0000","last_undegraded":"2024-05-10T03:39:26.077005+0000","last_fullsized":"2024-05-10T03:39:26.077005+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:15:06.869163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075656+0000","last_change":"2024-05-10T03:38:36.099009+0000","last_active":"2024-05-10T03:39:26.075656+0000","last_peered":"2024-05-10T03:39:26.075656+0000","last_clean":"2024-05-10T03:39:26.075656+0000","last_became_active":"2024-05-10T03:38:36.098695+0000","last_became_peered":"2024-05-10T03:38:36.098695+0000","last_unstale":"2024-05-10T03:39:26.075656+0000","last_undegraded":"2024-05-10T03:39:26.075656+0000","last_fullsized":"2024-05-10T03:39:26.075656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:06.634752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070881+0000","last_change":"2024-05-10T03:38:36.576498+0000","last_active":"2024-05-10T03:39:26.070881+0000","last_peered":"2024-05-10T03:39:26.070881+0000","last_clean":"2024-05-10T03:39:26.070881+0000","last_became_active":"2024-05-10T03:38:36.576161+0000","last_became_peered":"2024-05-10T03:38:36.576161+0000","last_unstale":"2024-05-10T03:39:26.070881+0000","last_undegraded":"2024-05-10T03:39:26.070881+0000","last_fullsized":"2024-05-10T03:39:26.070881+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:09.353279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076991+0000","last_change":"2024-05-10T03:38:41.148317+0000","last_active":"2024-05-10T03:39:26.076991+0000","last_peered":"2024-05-10T03:39:26.076991+0000","last_clean":"2024-05-10T03:39:26.076991+0000","last_became_active":"2024-05-10T03:38:41.147907+0000","last_became_peered":"2024-05-10T03:38:41.147907+0000","last_unstale":"2024-05-10T03:39:26.076991+0000","last_undegraded":"2024-05-10T03:39:26.076991+0000","last_fullsized":"2024-05-10T03:39:26.076991+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:23:08.157296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'9","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074498+0000","last_change":"2024-05-10T03:38:36.096437+0000","last_active":"2024-05-10T03:39:26.074498+0000","last_peered":"2024-05-10T03:39:26.074498+0000","last_clean":"2024-05-10T03:39:26.074498+0000","last_became_active":"2024-05-10T03:38:36.096122+0000","last_became_peered":"2024-05-10T03:38:36.096122+0000","last_unstale":"2024-05-10T03:39:26.074498+0000","last_undegraded":"2024-05-10T03:39:26.074498+0000","last_fullsized":"2024-05-10T03:39:26.074498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:47:02.400065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077474+0000","last_change":"2024-05-10T03:38:36.574022+0000","last_active":"2024-05-10T03:39:26.077474+0000","last_peered":"2024-05-10T03:39:26.077474+0000","last_clean":"2024-05-10T03:39:26.077474+0000","last_became_active":"2024-05-10T03:38:36.573530+0000","last_became_peered":"2024-05-10T03:38:36.573530+0000","last_unstale":"2024-05-10T03:39:26.077474+0000","last_undegraded":"2024-05-10T03:39:26.077474+0000","last_fullsized":"2024-05-10T03:39:26.077474+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:35:32.574897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072099+0000","last_change":"2024-05-10T03:38:40.600341+0000","last_active":"2024-05-10T03:39:26.072099+0000","last_peered":"2024-05-10T03:39:26.072099+0000","last_clean":"2024-05-10T03:39:26.072099+0000","last_became_active":"2024-05-10T03:38:40.599944+0000","last_became_peered":"2024-05-10T03:38:40.599944+0000","last_unstale":"2024-05-10T03:39:26.072099+0000","last_undegraded":"2024-05-10T03:39:26.072099+0000","last_fullsized":"2024-05-10T03:39:26.072099+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:12:01.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067765+0000","last_change":"2024-05-10T03:38:36.091020+0000","last_active":"2024-05-10T03:39:26.067765+0000","last_peered":"2024-05-10T03:39:26.067765+0000","last_clean":"2024-05-10T03:39:26.067765+0000","last_became_active":"2024-05-10T03:38:36.090699+0000","last_became_peered":"2024-05-10T03:38:36.090699+0000","last_unstale":"2024-05-10T03:39:26.067765+0000","last_undegraded":"2024-05-10T03:39:26.067765+0000","last_fullsized":"2024-05-10T03:39:26.067765+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:44:12.546166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067252+0000","last_change":"2024-05-10T03:38:36.584279+0000","last_active":"2024-05-10T03:39:26.067252+0000","last_peered":"2024-05-10T03:39:26.067252+0000","last_clean":"2024-05-10T03:39:26.067252+0000","last_became_active":"2024-05-10T03:38:36.583897+0000","last_became_peered":"2024-05-10T03:38:36.583897+0000","last_unstale":"2024-05-10T03:39:26.067252+0000","last_undegraded":"2024-05-10T03:39:26.067252+0000","last_fullsized":"2024-05-10T03:39:26.067252+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:33:17.210334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067474+0000","last_change":"2024-05-10T03:38:41.151023+0000","last_active":"2024-05-10T03:39:26.067474+0000","last_peered":"2024-05-10T03:39:26.067474+0000","last_clean":"2024-05-10T03:39:26.067474+0000","last_became_active":"2024-05-10T03:38:41.150489+0000","last_became_peered":"2024-05-10T03:38:41.150489+0000","last_unstale":"2024-05-10T03:39:26.067474+0000","last_undegraded":"2024-05-10T03:39:26.067474+0000","last_fullsized":"2024-05-10T03:39:26.067474+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:57:57.440139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074840+0000","last_change":"2024-05-10T03:38:36.098990+0000","last_active":"2024-05-10T03:39:26.074840+0000","last_peered":"2024-05-10T03:39:26.074840+0000","last_clean":"2024-05-10T03:39:26.074840+0000","last_became_active":"2024-05-10T03:38:36.098649+0000","last_became_peered":"2024-05-10T03:38:36.098649+0000","last_unstale":"2024-05-10T03:39:26.074840+0000","last_undegraded":"2024-05-10T03:39:26.074840+0000","last_fullsized":"2024-05-10T03:39:26.074840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:38:09.915041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075102+0000","last_change":"2024-05-10T03:38:36.581286+0000","last_active":"2024-05-10T03:39:26.075102+0000","last_peered":"2024-05-10T03:39:26.075102+0000","last_clean":"2024-05-10T03:39:26.075102+0000","last_became_active":"2024-05-10T03:38:36.580927+0000","last_became_peered":"2024-05-10T03:38:36.580927+0000","last_unstale":"2024-05-10T03:39:26.075102+0000","last_undegraded":"2024-05-10T03:39:26.075102+0000","last_fullsized":"2024-05-10T03:39:26.075102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:10:38.663239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074691+0000","last_change":"2024-05-10T03:38:40.605668+0000","last_active":"2024-05-10T03:39:26.074691+0000","last_peered":"2024-05-10T03:39:26.074691+0000","last_clean":"2024-05-10T03:39:26.074691+0000","last_became_active":"2024-05-10T03:38:40.605156+0000","last_became_peered":"2024-05-10T03:38:40.605156+0000","last_unstale":"2024-05-10T03:39:26.074691+0000","last_undegraded":"2024-05-10T03:39:26.074691+0000","last_fullsized":"2024-05-10T03:39:26.074691+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:28:07.192875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077182+0000","last_change":"2024-05-10T03:38:36.090250+0000","last_active":"2024-05-10T03:39:26.077182+0000","last_peered":"2024-05-10T03:39:26.077182+0000","last_clean":"2024-05-10T03:39:26.077182+0000","last_became_active":"2024-05-10T03:38:36.089899+0000","last_became_peered":"2024-05-10T03:38:36.089899+0000","last_unstale":"2024-05-10T03:39:26.077182+0000","last_undegraded":"2024-05-10T03:39:26.077182+0000","last_fullsized":"2024-05-10T03:39:26.077182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:01:19.322065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076480+0000","last_change":"2024-05-10T03:38:36.575272+0000","last_active":"2024-05-10T03:39:26.076480+0000","last_peered":"2024-05-10T03:39:26.076480+0000","last_clean":"2024-05-10T03:39:26.076480+0000","last_became_active":"2024-05-10T03:38:36.574919+0000","last_became_peered":"2024-05-10T03:38:36.574919+0000","last_unstale":"2024-05-10T03:39:26.076480+0000","last_undegraded":"2024-05-10T03:39:26.076480+0000","last_fullsized":"2024-05-10T03:39:26.076480+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:51:33.825933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067385+0000","last_change":"2024-05-10T03:38:40.609082+0000","last_active":"2024-05-10T03:39:26.067385+0000","last_peered":"2024-05-10T03:39:26.067385+0000","last_clean":"2024-05-10T03:39:26.067385+0000","last_became_active":"2024-05-10T03:38:40.608636+0000","last_became_peered":"2024-05-10T03:38:40.608636+0000","last_unstale":"2024-05-10T03:39:26.067385+0000","last_undegraded":"2024-05-10T03:39:26.067385+0000","last_fullsized":"2024-05-10T03:39:26.067385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:18:05.288472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.071676+0000","last_change":"2024-05-10T03:38:36.101001+0000","last_active":"2024-05-10T03:39:26.071676+0000","last_peered":"2024-05-10T03:39:26.071676+0000","last_clean":"2024-05-10T03:39:26.071676+0000","last_became_active":"2024-05-10T03:38:36.100658+0000","last_became_peered":"2024-05-10T03:38:36.100658+0000","last_unstale":"2024-05-10T03:39:26.071676+0000","last_undegraded":"2024-05-10T03:39:26.071676+0000","last_fullsized":"2024-05-10T03:39:26.071676+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:15:51.963956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077340+0000","last_change":"2024-05-10T03:38:36.579314+0000","last_active":"2024-05-10T03:39:26.077340+0000","last_peered":"2024-05-10T03:39:26.077340+0000","last_clean":"2024-05-10T03:39:26.077340+0000","last_became_active":"2024-05-10T03:38:36.578747+0000","last_became_peered":"2024-05-10T03:38:36.578747+0000","last_unstale":"2024-05-10T03:39:26.077340+0000","last_undegraded":"2024-05-10T03:39:26.077340+0000","last_fullsized":"2024-05-10T03:39:26.077340+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:05:25.814887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067380+0000","last_change":"2024-05-10T03:38:41.149022+0000","last_active":"2024-05-10T03:39:26.067380+0000","last_peered":"2024-05-10T03:39:26.067380+0000","last_clean":"2024-05-10T03:39:26.067380+0000","last_became_active":"2024-05-10T03:38:41.148606+0000","last_became_peered":"2024-05-10T03:38:41.148606+0000","last_unstale":"2024-05-10T03:39:26.067380+0000","last_undegraded":"2024-05-10T03:39:26.067380+0000","last_fullsized":"2024-05-10T03:39:26.067380+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:24.039761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.088000+0000","last_change":"2024-05-10T03:39:27.088000+0000","last_active":"2024-05-10T03:39:27.088000+0000","last_peered":"2024-05-10T03:39:27.088000+0000","last_clean":"2024-05-10T03:39:27.088000+0000","last_became_active":"2024-05-10T03:39:27.078679+0000","last_became_peered":"2024-05-10T03:39:27.078679+0000","last_unstale":"2024-05-10T03:39:27.088000+0000","last_undegraded":"2024-05-10T03:39:27.088000+0000","last_fullsized":"2024-05-10T03:39:27.088000+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:32.644494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078840+0000","last_change":"2024-05-10T03:38:36.587225+0000","last_active":"2024-05-10T03:39:26.078840+0000","last_peered":"2024-05-10T03:39:26.078840+0000","last_clean":"2024-05-10T03:39:26.078840+0000","last_became_active":"2024-05-10T03:38:36.586906+0000","last_became_peered":"2024-05-10T03:38:36.586906+0000","last_unstale":"2024-05-10T03:39:26.078840+0000","last_undegraded":"2024-05-10T03:39:26.078840+0000","last_fullsized":"2024-05-10T03:39:26.078840+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:07.128604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075048+0000","last_change":"2024-05-10T03:38:40.600918+0000","last_active":"2024-05-10T03:39:26.075048+0000","last_peered":"2024-05-10T03:39:26.075048+0000","last_clean":"2024-05-10T03:39:26.075048+0000","last_became_active":"2024-05-10T03:38:40.600508+0000","last_became_peered":"2024-05-10T03:38:40.600508+0000","last_unstale":"2024-05-10T03:39:26.075048+0000","last_undegraded":"2024-05-10T03:39:26.075048+0000","last_fullsized":"2024-05-10T03:39:26.075048+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:02:59.589310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"88'6","reported_seq":102,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:40:13.129920+0000","last_change":"2024-05-10T03:38:36.100013+0000","last_active":"2024-05-10T03:40:13.129920+0000","last_peered":"2024-05-10T03:40:13.129920+0000","last_clean":"2024-05-10T03:40:13.129920+0000","last_became_active":"2024-05-10T03:38:36.099581+0000","last_became_peered":"2024-05-10T03:38:36.099581+0000","last_unstale":"2024-05-10T03:40:13.129920+0000","last_undegraded":"2024-05-10T03:40:13.129920+0000","last_fullsized":"2024-05-10T03:40:13.129920+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:07.195555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1436,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.079287+0000","last_change":"2024-05-10T03:38:36.586813+0000","last_active":"2024-05-10T03:39:26.079287+0000","last_peered":"2024-05-10T03:39:26.079287+0000","last_clean":"2024-05-10T03:39:26.079287+0000","last_became_active":"2024-05-10T03:38:36.586264+0000","last_became_peered":"2024-05-10T03:38:36.586264+0000","last_unstale":"2024-05-10T03:39:26.079287+0000","last_undegraded":"2024-05-10T03:39:26.079287+0000","last_fullsized":"2024-05-10T03:39:26.079287+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:57:06.239509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.066683+0000","last_change":"2024-05-10T03:38:40.606897+0000","last_active":"2024-05-10T03:39:26.066683+0000","last_peered":"2024-05-10T03:39:26.066683+0000","last_clean":"2024-05-10T03:39:26.066683+0000","last_became_active":"2024-05-10T03:38:40.606339+0000","last_became_peered":"2024-05-10T03:38:40.606339+0000","last_unstale":"2024-05-10T03:39:26.066683+0000","last_undegraded":"2024-05-10T03:39:26.066683+0000","last_fullsized":"2024-05-10T03:39:26.066683+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:13.706744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074765+0000","last_change":"2024-05-10T03:38:36.100689+0000","last_active":"2024-05-10T03:39:26.074765+0000","last_peered":"2024-05-10T03:39:26.074765+0000","last_clean":"2024-05-10T03:39:26.074765+0000","last_became_active":"2024-05-10T03:38:36.100352+0000","last_became_peered":"2024-05-10T03:38:36.100352+0000","last_unstale":"2024-05-10T03:39:26.074765+0000","last_undegraded":"2024-05-10T03:39:26.074765+0000","last_fullsized":"2024-05-10T03:39:26.074765+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:53:45.926237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.266329+0000","last_change":"2024-05-10T03:39:27.266329+0000","last_active":"2024-05-10T03:39:27.266329+0000","last_peered":"2024-05-10T03:39:27.266329+0000","last_clean":"2024-05-10T03:39:27.266329+0000","last_became_active":"2024-05-10T03:39:27.265905+0000","last_became_peered":"2024-05-10T03:39:27.265905+0000","last_unstale":"2024-05-10T03:39:27.266329+0000","last_undegraded":"2024-05-10T03:39:27.266329+0000","last_fullsized":"2024-05-10T03:39:27.266329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:24.604276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,8],"acting":[7,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072213+0000","last_change":"2024-05-10T03:38:40.600719+0000","last_active":"2024-05-10T03:39:26.072213+0000","last_peered":"2024-05-10T03:39:26.072213+0000","last_clean":"2024-05-10T03:39:26.072213+0000","last_became_active":"2024-05-10T03:38:40.600240+0000","last_became_peered":"2024-05-10T03:38:40.600240+0000","last_unstale":"2024-05-10T03:39:26.072213+0000","last_undegraded":"2024-05-10T03:39:26.072213+0000","last_fullsized":"2024-05-10T03:39:26.072213+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:41:47.877298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070778+0000","last_change":"2024-05-10T03:38:36.097691+0000","last_active":"2024-05-10T03:39:26.070778+0000","last_peered":"2024-05-10T03:39:26.070778+0000","last_clean":"2024-05-10T03:39:26.070778+0000","last_became_active":"2024-05-10T03:38:36.097266+0000","last_became_peered":"2024-05-10T03:38:36.097266+0000","last_unstale":"2024-05-10T03:39:26.070778+0000","last_undegraded":"2024-05-10T03:39:26.070778+0000","last_fullsized":"2024-05-10T03:39:26.070778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:27:57.272780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.079029+0000","last_change":"2024-05-10T03:38:36.575475+0000","last_active":"2024-05-10T03:39:26.079029+0000","last_peered":"2024-05-10T03:39:26.079029+0000","last_clean":"2024-05-10T03:39:26.079029+0000","last_became_active":"2024-05-10T03:38:36.575047+0000","last_became_peered":"2024-05-10T03:38:36.575047+0000","last_unstale":"2024-05-10T03:39:26.079029+0000","last_undegraded":"2024-05-10T03:39:26.079029+0000","last_fullsized":"2024-05-10T03:39:26.079029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:31:53.846070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077134+0000","last_change":"2024-05-10T03:38:36.585491+0000","last_active":"2024-05-10T03:39:26.077134+0000","last_peered":"2024-05-10T03:39:26.077134+0000","last_clean":"2024-05-10T03:39:26.077134+0000","last_became_active":"2024-05-10T03:38:36.585147+0000","last_became_peered":"2024-05-10T03:38:36.585147+0000","last_unstale":"2024-05-10T03:39:26.077134+0000","last_undegraded":"2024-05-10T03:39:26.077134+0000","last_fullsized":"2024-05-10T03:39:26.077134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:22.350420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072517+0000","last_change":"2024-05-10T03:38:36.584092+0000","last_active":"2024-05-10T03:39:26.072517+0000","last_peered":"2024-05-10T03:39:26.072517+0000","last_clean":"2024-05-10T03:39:26.072517+0000","last_became_active":"2024-05-10T03:38:36.583749+0000","last_became_peered":"2024-05-10T03:38:36.583749+0000","last_unstale":"2024-05-10T03:39:26.072517+0000","last_undegraded":"2024-05-10T03:39:26.072517+0000","last_fullsized":"2024-05-10T03:39:26.072517+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:10.882170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.071548+0000","last_change":"2024-05-10T03:38:36.573718+0000","last_active":"2024-05-10T03:39:26.071548+0000","last_peered":"2024-05-10T03:39:26.071548+0000","last_clean":"2024-05-10T03:39:26.071548+0000","last_became_active":"2024-05-10T03:38:36.573271+0000","last_became_peered":"2024-05-10T03:38:36.573271+0000","last_unstale":"2024-05-10T03:39:26.071548+0000","last_undegraded":"2024-05-10T03:39:26.071548+0000","last_fullsized":"2024-05-10T03:39:26.071548+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:38:13.798068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067000+0000","last_change":"2024-05-10T03:38:36.576975+0000","last_active":"2024-05-10T03:39:26.067000+0000","last_peered":"2024-05-10T03:39:26.067000+0000","last_clean":"2024-05-10T03:39:26.067000+0000","last_became_active":"2024-05-10T03:38:36.576640+0000","last_became_peered":"2024-05-10T03:38:36.576640+0000","last_unstale":"2024-05-10T03:39:26.067000+0000","last_undegraded":"2024-05-10T03:39:26.067000+0000","last_fullsized":"2024-05-10T03:39:26.067000+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:48:42.975793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.077884+0000","last_change":"2024-05-10T03:39:27.077884+0000","last_active":"2024-05-10T03:39:27.077884+0000","last_peered":"2024-05-10T03:39:27.077884+0000","last_clean":"2024-05-10T03:39:27.077884+0000","last_became_active":"2024-05-10T03:39:27.077475+0000","last_became_peered":"2024-05-10T03:39:27.077475+0000","last_unstale":"2024-05-10T03:39:27.077884+0000","last_undegraded":"2024-05-10T03:39:27.077884+0000","last_fullsized":"2024-05-10T03:39:27.077884+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:21:35.216448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076864+0000","last_change":"2024-05-10T03:38:36.589262+0000","last_active":"2024-05-10T03:39:26.076864+0000","last_peered":"2024-05-10T03:39:26.076864+0000","last_clean":"2024-05-10T03:39:26.076864+0000","last_became_active":"2024-05-10T03:38:36.588950+0000","last_became_peered":"2024-05-10T03:38:36.588950+0000","last_unstale":"2024-05-10T03:39:26.076864+0000","last_undegraded":"2024-05-10T03:39:26.076864+0000","last_fullsized":"2024-05-10T03:39:26.076864+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:08:43.124035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074184+0000","last_change":"2024-05-10T03:38:36.590472+0000","last_active":"2024-05-10T03:39:26.074184+0000","last_peered":"2024-05-10T03:39:26.074184+0000","last_clean":"2024-05-10T03:39:26.074184+0000","last_became_active":"2024-05-10T03:38:36.590115+0000","last_became_peered":"2024-05-10T03:38:36.590115+0000","last_unstale":"2024-05-10T03:39:26.074184+0000","last_undegraded":"2024-05-10T03:39:26.074184+0000","last_fullsized":"2024-05-10T03:39:26.074184+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:33:37.982529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077634+0000","last_change":"2024-05-10T03:38:36.575958+0000","last_active":"2024-05-10T03:39:26.077634+0000","last_peered":"2024-05-10T03:39:26.077634+0000","last_clean":"2024-05-10T03:39:26.077634+0000","last_became_active":"2024-05-10T03:38:36.572958+0000","last_became_peered":"2024-05-10T03:38:36.572958+0000","last_unstale":"2024-05-10T03:39:26.077634+0000","last_undegraded":"2024-05-10T03:39:26.077634+0000","last_fullsized":"2024-05-10T03:39:26.077634+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:30:39.111371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072295+0000","last_change":"2024-05-10T03:38:36.578225+0000","last_active":"2024-05-10T03:39:26.072295+0000","last_peered":"2024-05-10T03:39:26.072295+0000","last_clean":"2024-05-10T03:39:26.072295+0000","last_became_active":"2024-05-10T03:38:36.575920+0000","last_became_peered":"2024-05-10T03:38:36.575920+0000","last_unstale":"2024-05-10T03:39:26.072295+0000","last_undegraded":"2024-05-10T03:39:26.072295+0000","last_fullsized":"2024-05-10T03:39:26.072295+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:54:53.999971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077198+0000","last_change":"2024-05-10T03:38:36.577720+0000","last_active":"2024-05-10T03:39:26.077198+0000","last_peered":"2024-05-10T03:39:26.077198+0000","last_clean":"2024-05-10T03:39:26.077198+0000","last_became_active":"2024-05-10T03:38:36.577360+0000","last_became_peered":"2024-05-10T03:38:36.577360+0000","last_unstale":"2024-05-10T03:39:26.077198+0000","last_undegraded":"2024-05-10T03:39:26.077198+0000","last_fullsized":"2024-05-10T03:39:26.077198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:35:59.787050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075148+0000","last_change":"2024-05-10T03:38:36.588941+0000","last_active":"2024-05-10T03:39:26.075148+0000","last_peered":"2024-05-10T03:39:26.075148+0000","last_clean":"2024-05-10T03:39:26.075148+0000","last_became_active":"2024-05-10T03:38:36.587884+0000","last_became_peered":"2024-05-10T03:38:36.587884+0000","last_unstale":"2024-05-10T03:39:26.075148+0000","last_undegraded":"2024-05-10T03:39:26.075148+0000","last_fullsized":"2024-05-10T03:39:26.075148+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:26:10.064473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070771+0000","last_change":"2024-05-10T03:38:36.578917+0000","last_active":"2024-05-10T03:39:26.070771+0000","last_peered":"2024-05-10T03:39:26.070771+0000","last_clean":"2024-05-10T03:39:26.070771+0000","last_became_active":"2024-05-10T03:38:36.578508+0000","last_became_peered":"2024-05-10T03:38:36.578508+0000","last_unstale":"2024-05-10T03:39:26.070771+0000","last_undegraded":"2024-05-10T03:39:26.070771+0000","last_fullsized":"2024-05-10T03:39:26.070771+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:47.670854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077705+0000","last_change":"2024-05-10T03:38:36.578410+0000","last_active":"2024-05-10T03:39:26.077705+0000","last_peered":"2024-05-10T03:39:26.077705+0000","last_clean":"2024-05-10T03:39:26.077705+0000","last_became_active":"2024-05-10T03:38:36.578055+0000","last_became_peered":"2024-05-10T03:38:36.578055+0000","last_unstale":"2024-05-10T03:39:26.077705+0000","last_undegraded":"2024-05-10T03:39:26.077705+0000","last_fullsized":"2024-05-10T03:39:26.077705+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:39:03.551019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74877,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":784,"num_read_kb":468,"num_write":239,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":63894,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":229671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514526,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":999424,"data_stored":488705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.60599999999999998,"15min":0.57999999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":3.4089999999999998,"5min":3.4089999999999998,"15min":3.4089999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.56000000000000005,"15min":0.54900000000000004},"min":{"1min":0.44500000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.46500000000000002}]},{"osd":1,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67100000000000004,"15min":0.66600000000000004},"min":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51000000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83499999999999996,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.73199999999999998}]},{"osd":2,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.39800000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.67000000000000004,"5min":1.095,"15min":1.095},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.375,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":4,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.55400000000000005,"5min":0.433,"15min":0.433},"max":{"1min":0.91100000000000003,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.85399999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.66000000000000003}]},{"osd":5,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.64100000000000001,"15min":0.64900000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78200000000000003,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.71099999999999997,"15min":0.71599999999999997},"min":{"1min":0.46400000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.49399999999999999}]},{"osd":6,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.73999999999999999,"15min":0.72899999999999998},"min":{"1min":0.54900000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.56699999999999995},{"interface":"front","average":{"1min":1.236,"5min":0.84599999999999997,"15min":0.78100000000000003},"min":{"1min":0.51000000000000001,"5min":0.495,"15min":0.495},"max":{"1min":9.4440000000000008,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.83699999999999997,"15min":0.83599999999999997},"min":{"1min":0.68300000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.024,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.84799999999999998,"15min":0.85399999999999998},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.95999999999999996,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.69999999999999996}]},{"osd":8,"last update":"Fri May 10 03:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.63},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.82399999999999995}]},{"osd":9,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":0.92400000000000004,"15min":0.85599999999999998},"min":{"1min":0.67900000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":9.6400000000000006,"5min":9.6400000000000006,"15min":9.6400000000000006},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.006,"5min":0.878,"15min":0.85599999999999998},"min":{"1min":0.70899999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":3.371,"5min":3.371,"15min":3.371},"last":0.64400000000000002}]},{"osd":10,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.88,"15min":0.88100000000000001},"min":{"1min":0.76900000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.0329999999999999,"5min":1.379,"15min":1.379},"last":0.754},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.84799999999999998,"15min":0.84999999999999998},"min":{"1min":0.66100000000000003,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.052,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.85099999999999998}]}]},{"osd":10,"up_from":69,"seq":296352743458,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28672,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716480,"statfs":{"total":95995035648,"available":95965675520,"internally_reserved":0,"allocated":1695744,"data_stored":1142565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46500000000000002,"15min":0.46400000000000002},"min":{"1min":0.32900000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.38200000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68999999999999995,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.372}]},{"osd":2,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.62,"15min":0.61599999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.81699999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.48399999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.50600000000000001}]},{"osd":3,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.625,"15min":0.63300000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74299999999999999,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64500000000000002,"15min":0.64900000000000002},"min":{"1min":0.49099999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86099999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.442}]},{"osd":4,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.37,"5min":0.313,"15min":0.313},"max":{"1min":0.77800000000000002,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.433,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78100000000000003,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.52300000000000002}]},{"osd":5,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68200000000000005,"15min":0.68000000000000005},"min":{"1min":0.52100000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69999999999999996,"15min":0.69799999999999995},"min":{"1min":0.437,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95599999999999996,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.76100000000000001,"15min":0.77000000000000002},"min":{"1min":0.53500000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.012,"5min":1.026,"15min":1.026},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73799999999999999,"15min":0.73699999999999999},"min":{"1min":0.58799999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.622}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":8,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76200000000000001,"15min":0.76000000000000001},"min":{"1min":0.55800000000000005,"5min":0.498,"15min":0.498},"max":{"1min":0.94499999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.57899999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.99199999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.73399999999999999}]},{"osd":9,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81200000000000006,"15min":0.81399999999999995},"min":{"1min":0.61199999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.97599999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.81999999999999995,"15min":0.82799999999999996},"min":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.90900000000000003,"5min":1.216,"15min":1.216},"last":3.3780000000000001}]},{"osd":11,"last update":"Fri May 10 03:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.59999999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.92400000000000004,"5min":1.169,"15min":1.169},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79600000000000004,"15min":0.80000000000000004},"min":{"1min":0.56799999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.91800000000000004,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.65800000000000003}]}]},{"osd":9,"up_from":64,"seq":274877906982,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":1024000,"data_stored":491883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36043201},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.53900000000000003,"15min":0.55100000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.63600000000000001,"5min":0.879,"15min":0.879},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.57599999999999996,"15min":0.58799999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.93899999999999995,"5min":1.171,"15min":1.171},"last":0.42799999999999999}]},{"osd":1,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67600000000000005,"15min":0.67700000000000005},"min":{"1min":0.40699999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96999999999999997,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71299999999999997,"15min":0.72499999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.77500000000000002,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.68899999999999995}]},{"osd":2,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.76200000000000001,"15min":0.78400000000000003},"min":{"1min":0.52600000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.76900000000000002,"5min":1.137,"15min":1.137},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.78500000000000003,"15min":0.80800000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.84599999999999997,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.45400000000000001}]},{"osd":3,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.68500000000000005,"15min":0.70199999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.65000000000000002,"15min":0.67100000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.46300000000000002}]},{"osd":4,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88300000000000001,"5min":1.147,"15min":1.147},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76200000000000001,"15min":0.76600000000000001},"min":{"1min":0.54700000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.88100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.83899999999999997,"15min":0.85899999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.86699999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.502},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.86299999999999999,"15min":0.89200000000000002},"min":{"1min":0.54700000000000004,"5min":0.501,"15min":0.501},"max":{"1min":0.90500000000000003,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.65500000000000003}]},{"osd":6,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.51100000000000001}]},{"osd":7,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.91200000000000003,"15min":0.93799999999999994},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.997,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.94099999999999995,"15min":0.96899999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0169999999999999,"5min":1.377,"15min":1.377},"last":0.78100000000000003}]},{"osd":8,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.94799999999999995,"15min":0.98199999999999998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.92500000000000004,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.98599999999999999,"15min":1.01},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1140000000000001,"5min":1.579,"15min":1.579},"last":0.64200000000000002}]},{"osd":10,"last update":"Fri May 10 03:39:46 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.91600000000000004,"15min":0.93799999999999994},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0569999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.95499999999999996,"15min":0.96699999999999997},"min":{"1min":0.73699999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.093,"5min":1.385,"15min":1.385},"last":0.70699999999999996}]},{"osd":11,"last update":"Fri May 10 03:39:41 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.85499999999999998}]}]},{"osd":8,"up_from":57,"seq":244813135913,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1007616,"data_stored":487252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.40899999999999997}]},{"osd":1,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64300000000000002,"15min":0.64200000000000002},"min":{"1min":0.46200000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75700000000000001,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.69299999999999995}]},{"osd":2,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.47199999999999998,"15min":0.46600000000000003},"min":{"1min":0.35199999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.499,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71099999999999997,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.44}]},{"osd":3,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81799999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":3.7629999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.62,"15min":0.61299999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.625,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84599999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.68400000000000005,"15min":0.67900000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.627}]},{"osd":5,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":0.60699999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78800000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.37},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.497}]},{"osd":6,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.67000000000000004,"15min":0.66100000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71799999999999997,"15min":0.71699999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90500000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.58799999999999997}]},{"osd":7,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.52700000000000002,"5min":0.498,"15min":0.498},"max":{"1min":0.90400000000000003,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.58499999999999996,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0009999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.77000000000000002}]},{"osd":9,"last update":"Fri May 10 03:39:30 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.749,"15min":0.73299999999999998},"min":{"1min":0.61199999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.75600000000000001,"15min":0.73799999999999999},"min":{"1min":0.67500000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.70899999999999996}]},{"osd":10,"last update":"Fri May 10 03:39:49 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.79000000000000004,"15min":0.77400000000000002},"min":{"1min":0.68200000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.79400000000000004,"15min":0.77800000000000002},"min":{"1min":0.70699999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.113,"5min":1.127,"15min":1.127},"last":0.755}]},{"osd":11,"last update":"Fri May 10 03:39:39 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.66900000000000004}]}]},{"osd":7,"up_from":50,"seq":214748364845,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28596,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716556,"statfs":{"total":95995035648,"available":95965753344,"internally_reserved":0,"allocated":1613824,"data_stored":1084520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:37:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.437},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.502}]},{"osd":1,"last update":"Fri May 10 03:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.439,"15min":0.42899999999999999},"min":{"1min":0.311,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.55200000000000005,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.46000000000000002,"15min":0.44900000000000001},"min":{"1min":0.38400000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69999999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri May 10 03:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.46000000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.65600000000000003,"15min":0.626},"min":{"1min":0.52700000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95599999999999996,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.72899999999999998}]},{"osd":3,"last update":"Fri May 10 03:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.621,"15min":0.629},"min":{"1min":0.44600000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.86099999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.439,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.80400000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.628}]},{"osd":4,"last update":"Fri May 10 03:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35299999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69099999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.38400000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69199999999999995,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.46999999999999997}]},{"osd":5,"last update":"Fri May 10 03:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.69599999999999995,"15min":0.66100000000000003},"min":{"1min":0.54300000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90600000000000003,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.68999999999999995,"15min":0.66000000000000003},"min":{"1min":0.51700000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.878,"5min":2.806,"15min":2.806},"last":0.67100000000000004}]},{"osd":6,"last update":"Fri May 10 03:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70499999999999996,"15min":0.70899999999999996},"min":{"1min":0.55600000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.85999999999999999,"5min":1.002,"15min":1.002},"last":0.70099999999999996}]},{"osd":8,"last update":"Fri May 10 03:40:13 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.71699999999999997,"15min":0.70699999999999996},"min":{"1min":0.57399999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.746},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79000000000000004,"15min":0.79700000000000004},"min":{"1min":0.57299999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.81299999999999994}]},{"osd":9,"last update":"Fri May 10 03:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.97799999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74199999999999999,"15min":0.74299999999999999},"min":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.90100000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.83499999999999996}]},{"osd":10,"last update":"Fri May 10 03:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73799999999999999,"15min":0.74099999999999999},"min":{"1min":0.58199999999999996,"5min":0.505,"15min":0.505},"max":{"1min":0.88200000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.64700000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.82699999999999996,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.78000000000000003}]},{"osd":11,"last update":"Fri May 10 03:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.85299999999999998}]}]},{"osd":6,"up_from":45,"seq":193273528367,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":995328,"data_stored":483243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.505,"15min":0.46100000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.45800000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.628,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.51800000000000002}]},{"osd":1,"last update":"Fri May 10 03:39:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.56799999999999995,"15min":0.54800000000000004},"min":{"1min":0.45900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85099999999999998,"5min":1.113,"15min":1.113},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.873,"5min":0.69199999999999995,"15min":0.63800000000000001},"min":{"1min":0.53700000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":4.0439999999999996,"5min":4.0439999999999996,"15min":4.0439999999999996},"last":0.68200000000000005}]},{"osd":2,"last update":"Fri May 10 03:39:40 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.626,"15min":0.60799999999999998},"min":{"1min":0.441,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95399999999999996,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.748,"15min":0.70199999999999996},"min":{"1min":0.49199999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":3.8719999999999999,"5min":3.8719999999999999,"15min":3.8719999999999999},"last":0.76800000000000002}]},{"osd":3,"last update":"Fri May 10 03:39:40 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.625,"15min":0.56499999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":4.476,"5min":4.476,"15min":4.476},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.57299999999999995,"15min":0.55100000000000005},"min":{"1min":0.35499999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.441}]},{"osd":4,"last update":"Fri May 10 03:39:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.627,"15min":0.60699999999999998},"min":{"1min":0.48499999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90500000000000003,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.78300000000000003,"15min":0.73299999999999998},"min":{"1min":0.60299999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":4.0910000000000002,"5min":4.0910000000000002,"15min":4.0910000000000002},"last":0.61199999999999999}]},{"osd":5,"last update":"Fri May 10 03:39:40 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.69399999999999995,"15min":0.67900000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.75},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72699999999999998,"15min":0.71899999999999997},"min":{"1min":0.496,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.99399999999999999,"5min":1.01,"15min":1.01},"last":0.64300000000000002}]},{"osd":7,"last update":"Fri May 10 03:39:58 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.86799999999999999,"15min":0.83599999999999997},"min":{"1min":0.59499999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.9660000000000002,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.77300000000000002,"15min":0.75900000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.65800000000000003}]},{"osd":8,"last update":"Fri May 10 03:39:09 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.54800000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.96399999999999997,"5min":0.999,"15min":0.999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.88100000000000001,"15min":0.88900000000000001},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.86299999999999999}]},{"osd":9,"last update":"Fri May 10 03:39:30 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.95799999999999996,"15min":0.94599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":3.827,"5min":3.827,"15min":3.827},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.84599999999999997,"15min":0.84799999999999998},"min":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.58099999999999996}]},{"osd":10,"last update":"Fri May 10 03:39:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.006,"15min":0.99199999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":4.1340000000000003,"5min":4.1340000000000003,"15min":4.1340000000000003},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.876,"5min":0.88900000000000001,"15min":0.89100000000000001},"min":{"1min":0.67600000000000005,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.70599999999999996}]},{"osd":11,"last update":"Fri May 10 03:39:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":4.0049999999999999,"5min":4.0049999999999999,"15min":4.0049999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.79700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":1069056,"data_stored":552213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.54800000000000004,"15min":0.51400000000000001},"min":{"1min":0.41899999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.748,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54700000000000004,"15min":0.50900000000000001},"min":{"1min":0.41499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78300000000000003,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.53100000000000003}]},{"osd":2,"last update":"Fri May 10 03:39:27 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.55300000000000005,"15min":0.50800000000000001},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.82799999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.745},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.56499999999999995,"15min":0.51900000000000002},"min":{"1min":0.42099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.68500000000000005}]},{"osd":3,"last update":"Fri May 10 03:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60399999999999998,"15min":0.56899999999999995},"min":{"1min":0.38700000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.90400000000000003,"5min":1.528,"15min":1.528},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.61399999999999999,"15min":0.56599999999999995},"min":{"1min":0.55500000000000005,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86099999999999999,"5min":1.502,"15min":1.502},"last":0.56399999999999995}]},{"osd":4,"last update":"Fri May 10 03:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.41099999999999998},"min":{"1min":0.40799999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.66400000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.48199999999999998,"15min":0.42199999999999999},"min":{"1min":0.40200000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.79500000000000004,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.50800000000000001}]},{"osd":5,"last update":"Fri May 10 03:39:23 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.63600000000000001,"15min":0.61199999999999999},"min":{"1min":0.46300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.67600000000000005,"15min":0.64600000000000002},"min":{"1min":0.54500000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.72799999999999998}]},{"osd":6,"last update":"Fri May 10 03:39:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.67600000000000005,"15min":0.64600000000000002},"min":{"1min":0.53800000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0680000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.66700000000000004,"15min":0.64900000000000002},"min":{"1min":0.53900000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.94099999999999995,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.69999999999999996}]},{"osd":7,"last update":"Fri May 10 03:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.58199999999999996,"15min":0.55600000000000005},"min":{"1min":0.40799999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84699999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.627,"15min":0.58399999999999996},"min":{"1min":0.49299999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86699999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.63100000000000001}]},{"osd":8,"last update":"Fri May 10 03:40:13 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.69299999999999995,"15min":0.65400000000000003},"min":{"1min":0.67100000000000004,"5min":0.443,"15min":0.443},"max":{"1min":0.93600000000000005,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.871,"5min":0.76600000000000001,"15min":0.72299999999999998},"min":{"1min":0.65900000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0580000000000001,"5min":1.113,"15min":1.113},"last":0.77800000000000002}]},{"osd":9,"last update":"Fri May 10 03:39:33 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.77800000000000002,"15min":0.754},"min":{"1min":0.67600000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.871,"5min":0.78300000000000003,"15min":0.76800000000000002},"min":{"1min":0.60499999999999998,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.76200000000000001}]},{"osd":10,"last update":"Fri May 10 03:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":0.98799999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.60199999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.014,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.83399999999999996}]},{"osd":11,"last update":"Fri May 10 03:39:39 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.85399999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1019904,"data_stored":485013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 03:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.62,"15min":0.55600000000000005},"min":{"1min":0.44900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.98099999999999998,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.61599999999999999,"15min":0.54800000000000004},"min":{"1min":0.39600000000000002,"5min":0.316,"15min":0.316},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.57899999999999996}]},{"osd":2,"last update":"Fri May 10 03:39:22 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.64900000000000002,"15min":0.60699999999999998},"min":{"1min":0.434,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.87},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.66000000000000003,"15min":0.60199999999999998},"min":{"1min":0.50600000000000001,"5min":0.379,"15min":0.379},"max":{"1min":1.038,"5min":1.216,"15min":1.216},"last":0.96299999999999997}]},{"osd":3,"last update":"Fri May 10 03:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.89600000000000002}]},{"osd":4,"last update":"Fri May 10 03:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67100000000000004,"15min":0.61099999999999999},"min":{"1min":0.47099999999999997,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.101,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.64800000000000002,"15min":0.59099999999999997},"min":{"1min":0.45100000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.036,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.78400000000000003}]},{"osd":5,"last update":"Fri May 10 03:39:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.60999999999999999,"15min":0.59099999999999997},"min":{"1min":0.45700000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.72599999999999998,"15min":0.69599999999999995},"min":{"1min":0.56299999999999994,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":1.014}]},{"osd":6,"last update":"Fri May 10 03:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.69499999999999995,"15min":0.69299999999999995},"min":{"1min":0.40400000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.92900000000000005,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.71799999999999997,"15min":0.69899999999999995},"min":{"1min":0.53500000000000003,"5min":0.374,"15min":0.374},"max":{"1min":1.119,"5min":1.196,"15min":1.196},"last":1.107}]},{"osd":7,"last update":"Fri May 10 03:39:44 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.997},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":1.0629999999999999}]},{"osd":8,"last update":"Fri May 10 03:39:11 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.85699999999999998,"15min":0.84699999999999998},"min":{"1min":0.58099999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.86099999999999999,"15min":0.85199999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.232,"5min":1.373,"15min":1.373},"last":1.046}]},{"osd":9,"last update":"Fri May 10 03:39:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.83499999999999996,"15min":0.82099999999999995},"min":{"1min":0.55600000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.3089999999999999,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":1.135},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.70199999999999996,"15min":0.68100000000000005},"min":{"1min":0.42799999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.97599999999999998}]},{"osd":10,"last update":"Fri May 10 03:39:44 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.91000000000000003,"15min":0.89400000000000002},"min":{"1min":0.69699999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.264,"5min":1.446,"15min":1.446},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.92200000000000004,"15min":0.91000000000000003},"min":{"1min":0.66000000000000003,"5min":0.63,"15min":0.63},"max":{"1min":1.3200000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":1.091}]},{"osd":11,"last update":"Fri May 10 03:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.77100000000000002,"15min":0.76100000000000001},"min":{"1min":0.63800000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.95199999999999996,"15min":0.94299999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2789999999999999,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.1870000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":1011712,"data_stored":485152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.38800000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71799999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.41199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80100000000000005,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.81899999999999995}]},{"osd":1,"last update":"Fri May 10 03:39:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.57799999999999996,"15min":0.53500000000000003},"min":{"1min":0.39200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.625,"15min":0.56399999999999995},"min":{"1min":0.372,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.67500000000000004}]},{"osd":3,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.629,"15min":0.60299999999999998},"min":{"1min":0.53100000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61699999999999999,"15min":0.59899999999999998},"min":{"1min":0.50600000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.77200000000000002}]},{"osd":4,"last update":"Fri May 10 03:39:38 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.70299999999999996}]},{"osd":5,"last update":"Fri May 10 03:39:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.53200000000000003,"15min":0.50800000000000001},"min":{"1min":0.29599999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.56799999999999995,"15min":0.55200000000000005},"min":{"1min":0.36299999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80200000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.43099999999999999}]},{"osd":6,"last update":"Fri May 10 03:39:38 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.65500000000000003,"15min":0.63400000000000001},"min":{"1min":0.48199999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.73099999999999998,"15min":0.71699999999999997},"min":{"1min":0.59499999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.84499999999999997}]},{"osd":7,"last update":"Fri May 10 03:39:41 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.745},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.58499999999999996}]},{"osd":8,"last update":"Fri May 10 03:39:12 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.63900000000000001,"15min":0.63200000000000001},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.96299999999999997,"5min":0.995,"15min":0.995},"last":0.59499999999999997}]},{"osd":9,"last update":"Fri May 10 03:39:30 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.77000000000000002,"15min":0.75900000000000001},"min":{"1min":0.54800000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.83399999999999996,"15min":0.82399999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.80700000000000005}]},{"osd":10,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.71099999999999997,"15min":0.70499999999999996},"min":{"1min":0.51500000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89800000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.83399999999999996,"15min":0.81799999999999995},"min":{"1min":0.747,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.85999999999999999}]},{"osd":11,"last update":"Fri May 10 03:39:38 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.88600000000000001}]}]},{"osd":3,"up_from":25,"seq":107374182459,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1003520,"data_stored":482668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:43 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.42899999999999999,"15min":0.38600000000000001},"min":{"1min":0.314,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.47999999999999998,"15min":0.439},"min":{"1min":0.35799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77600000000000002,"5min":0.878,"15min":0.878},"last":0.46000000000000002}]},{"osd":1,"last update":"Fri May 10 03:39:43 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56999999999999995,"15min":0.53900000000000003},"min":{"1min":0.40699999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.89700000000000002,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59199999999999997,"15min":0.53900000000000003},"min":{"1min":0.39200000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.65400000000000003}]},{"osd":2,"last update":"Fri May 10 03:39:43 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.63200000000000001,"15min":0.60399999999999998},"min":{"1min":0.48899999999999999,"5min":0.38,"15min":0.38},"max":{"1min":1.0720000000000001,"5min":1.145,"15min":1.145},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.627,"15min":0.58399999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91900000000000004,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.71399999999999997}]},{"osd":4,"last update":"Fri May 10 03:40:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64600000000000002,"15min":0.61199999999999999},"min":{"1min":0.45600000000000002,"5min":0.433,"15min":0.433},"max":{"1min":1.0269999999999999,"5min":1.093,"15min":1.093},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67400000000000004,"15min":0.63300000000000001},"min":{"1min":0.51500000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.85599999999999998,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.56999999999999995}]},{"osd":5,"last update":"Fri May 10 03:39:21 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65200000000000002,"15min":0.63200000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.014,"5min":1.224,"15min":1.224},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66200000000000003,"15min":0.63},"min":{"1min":0.438,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.996,"5min":1.093,"15min":1.093},"last":0.77300000000000002}]},{"osd":6,"last update":"Fri May 10 03:39:38 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67600000000000005,"15min":0.67400000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2549999999999999,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42599999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.073,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.51100000000000001}]},{"osd":7,"last update":"Fri May 10 03:39:58 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.70599999999999996,"15min":0.69999999999999996},"min":{"1min":0.50700000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96399999999999997,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.439},{"interface":"front","average":{"1min":0.753,"5min":0.78300000000000003,"15min":0.78600000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.69899999999999995}]},{"osd":8,"last update":"Fri May 10 03:38:09 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.68899999999999995}]},{"osd":9,"last update":"Fri May 10 03:39:27 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.879,"15min":0.90300000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.81899999999999995,"15min":0.83599999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.625}]},{"osd":10,"last update":"Fri May 10 03:39:48 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.84799999999999998,"15min":0.85399999999999998},"min":{"1min":0.61599999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.139,"5min":1.27,"15min":1.27},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.89900000000000002,"15min":0.91100000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.73599999999999999}]},{"osd":11,"last update":"Fri May 10 03:39:38 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.75}]}]},{"osd":4,"up_from":33,"seq":141733920823,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1081344,"data_stored":555257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:37:59 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.47599999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.52400000000000002,"15min":0.51100000000000001},"min":{"1min":0.435,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.54000000000000004}]},{"osd":1,"last update":"Fri May 10 03:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.40000000000000002,"15min":0.36499999999999999},"min":{"1min":0.36499999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.58199999999999996,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.41599999999999998,"15min":0.38400000000000001},"min":{"1min":0.37,"5min":0.251,"15min":0.251},"max":{"1min":0.68999999999999995,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.60699999999999998}]},{"osd":2,"last update":"Fri May 10 03:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57699999999999996,"15min":0.55300000000000005},"min":{"1min":0.39900000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.75,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.621,"15min":0.56999999999999995},"min":{"1min":0.53000000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88800000000000001,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.71499999999999997}]},{"osd":3,"last update":"Fri May 10 03:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.62,"15min":0.57999999999999996},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.754},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58999999999999997,"15min":0.57299999999999995},"min":{"1min":0.44500000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.63600000000000001}]},{"osd":5,"last update":"Fri May 10 03:39:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61699999999999999,"15min":0.59499999999999997},"min":{"1min":0.497,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90500000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.63500000000000001,"15min":0.60499999999999998},"min":{"1min":0.47999999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.86599999999999999}]},{"osd":6,"last update":"Fri May 10 03:39:40 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.625,"15min":0.629},"min":{"1min":0.46100000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.77300000000000002,"15min":0.79900000000000004},"min":{"1min":0.505,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95199999999999996,"5min":3.714,"15min":3.714},"last":0.94099999999999995}]},{"osd":7,"last update":"Fri May 10 03:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.59699999999999998,"15min":0.56499999999999995},"min":{"1min":0.441,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.623,"15min":0.58599999999999997},"min":{"1min":0.55300000000000005,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.91600000000000004}]},{"osd":8,"last update":"Fri May 10 03:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.66400000000000003,"15min":0.64500000000000002},"min":{"1min":0.52200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.77900000000000003,"15min":0.76400000000000001},"min":{"1min":0.57499999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.96099999999999997}]},{"osd":9,"last update":"Fri May 10 03:39:31 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.81899999999999995,"15min":0.82299999999999995},"min":{"1min":0.53100000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92800000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.92700000000000005,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.98999999999999999}]},{"osd":10,"last update":"Fri May 10 03:39:44 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80200000000000005,"15min":0.80300000000000005},"min":{"1min":0.60399999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92200000000000004,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":1.026},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.71899999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.93500000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":1.0029999999999999}]},{"osd":11,"last update":"Fri May 10 03:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":1.069},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.88800000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757300,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1622016,"data_stored":1080198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58199999999999996,"15min":0.57199999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.86799999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.49399999999999999}]},{"osd":1,"last update":"Fri May 10 03:39:17 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59099999999999997,"15min":0.58399999999999996},"min":{"1min":0.441,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92600000000000005,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.48199999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.63900000000000001}]},{"osd":2,"last update":"Fri May 10 03:39:17 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.436,"15min":0.41799999999999998},"min":{"1min":0.32700000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69599999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.373},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.44600000000000001,"15min":0.438},"min":{"1min":0.312,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68400000000000005,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.35399999999999998}]},{"osd":3,"last update":"Fri May 10 03:39:17 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.88,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.47499999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78300000000000003,"5min":1.095,"15min":1.095},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri May 10 03:39:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.63400000000000001,"15min":0.623},"min":{"1min":0.45300000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.42299999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66000000000000003}]},{"osd":6,"last update":"Fri May 10 03:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.624,"15min":0.60599999999999998},"min":{"1min":0.54400000000000004,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.90500000000000003,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.69399999999999995,"15min":0.68600000000000005},"min":{"1min":0.45700000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.97699999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.44500000000000001}]},{"osd":7,"last update":"Fri May 10 03:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.72199999999999998,"15min":0.70199999999999996},"min":{"1min":0.51300000000000001,"5min":0.504,"15min":0.504},"max":{"1min":0.97499999999999998,"5min":1.044,"15min":1.044},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.60799999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93300000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.75}]},{"osd":8,"last update":"Fri May 10 03:39:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.64400000000000002,"15min":0.63600000000000001},"min":{"1min":0.39100000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.61199999999999999}]},{"osd":9,"last update":"Fri May 10 03:39:29 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.70199999999999996,"15min":0.68400000000000005},"min":{"1min":0.56100000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.753,"15min":0.73099999999999998},"min":{"1min":0.64600000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.71999999999999997}]},{"osd":10,"last update":"Fri May 10 03:39:46 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.71299999999999997,"15min":0.69899999999999995},"min":{"1min":0.54700000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91900000000000004,"5min":1.109,"15min":1.109},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.76000000000000001,"15min":0.752},"min":{"1min":0.64600000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.94899999999999995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.80700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":72164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":71112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":69628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T03:40:19.417 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T03:40:19.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:19 smithi154 ceph-mon[46565]: pgmap v284: 129 pgs: 129 active+clean; 650 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-05-10T03:40:19.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:19 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3580168763' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:40:19.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:19 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3936615131' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:40:19.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:19 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2397531318' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:40:19.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.596+0000 7f9770b5c700 1 -- 172.21.15.45:0/1244078927 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f976c100ac0 msgr2=0x7f976c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:19.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.596+0000 7f9770b5c700 1 --2- 172.21.15.45:0/1244078927 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f976c100ac0 0x7f976c100ed0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f975c009990 tx=0x7f975c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:19.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.596+0000 7f9770b5c700 1 -- 172.21.15.45:0/1244078927 shutdown_connections 2024-05-10T03:40:19.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.596+0000 7f9770b5c700 1 --2- 172.21.15.45:0/1244078927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f976c102580 0x7f976c108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:19.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.596+0000 7f9770b5c700 1 --2- 172.21.15.45:0/1244078927 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f976c100ac0 0x7f976c100ed0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:19.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.596+0000 7f9770b5c700 1 --2- 172.21.15.45:0/1244078927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f976c101be0 0x7f976c101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:19.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.596+0000 7f9770b5c700 1 -- 172.21.15.45:0/1244078927 >> 172.21.15.45:0/1244078927 conn(0x7f976c0fc0d0 msgr2=0x7f976c0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:19.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.596+0000 7f9770b5c700 1 -- 172.21.15.45:0/1244078927 shutdown_connections 2024-05-10T03:40:19.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.596+0000 7f9770b5c700 1 -- 172.21.15.45:0/1244078927 wait complete. 2024-05-10T03:40:19.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.597+0000 7f9770b5c700 1 Processor -- start 2024-05-10T03:40:19.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.597+0000 7f9770b5c700 1 -- start start 2024-05-10T03:40:19.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.597+0000 7f9770b5c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f976c100ac0 0x7f976c1980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:19.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.597+0000 7f9770b5c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f976c101be0 0x7f976c198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:19.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.597+0000 7f9770b5c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f976c102580 0x7f976c19f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:19.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.597+0000 7f9770b5c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c19fbb0 con 0x7f976c100ac0 2024-05-10T03:40:19.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.597+0000 7f9770b5c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c19fd20 con 0x7f976c101be0 2024-05-10T03:40:19.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.597+0000 7f9770b5c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c19fee0 con 0x7f976c102580 2024-05-10T03:40:19.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.597+0000 7f976a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f976c100ac0 0x7f976c1980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:19.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.597+0000 7f976a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f976c100ac0 0x7f976c1980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35168/0 (socket says 172.21.15.45:35168) 2024-05-10T03:40:19.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.597+0000 7f976a59c700 1 -- 172.21.15.45:0/4210518743 learned_addr learned my addr 172.21.15.45:0/4210518743 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:19.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.597+0000 7f9769d9b700 1 --2- 172.21.15.45:0/4210518743 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f976c101be0 0x7f976c198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:19.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.598+0000 7f976ad9d700 1 --2- 172.21.15.45:0/4210518743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f976c102580 0x7f976c19f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:19.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.598+0000 7f976a59c700 1 -- 172.21.15.45:0/4210518743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f976c102580 msgr2=0x7f976c19f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:19.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.598+0000 7f976a59c700 1 --2- 172.21.15.45:0/4210518743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f976c102580 0x7f976c19f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:19.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.598+0000 7f976a59c700 1 -- 172.21.15.45:0/4210518743 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f976c101be0 msgr2=0x7f976c198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:19.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.598+0000 7f976a59c700 1 --2- 172.21.15.45:0/4210518743 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f976c101be0 0x7f976c198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:19.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.598+0000 7f976a59c700 1 -- 172.21.15.45:0/4210518743 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c0095f0 con 0x7f976c100ac0 2024-05-10T03:40:19.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.598+0000 7f976ad9d700 1 --2- 172.21.15.45:0/4210518743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f976c102580 0x7f976c19f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:19.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.598+0000 7f976a59c700 1 --2- 172.21.15.45:0/4210518743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f976c100ac0 0x7f976c1980d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f975c0098e0 tx=0x7f975c005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:19.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.598+0000 7f975b7fe700 1 -- 172.21.15.45:0/4210518743 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c01d070 con 0x7f976c100ac0 2024-05-10T03:40:19.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.598+0000 7f975b7fe700 1 -- 172.21.15.45:0/4210518743 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f975c00be70 con 0x7f976c100ac0 2024-05-10T03:40:19.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.598+0000 7f9770b5c700 1 -- 172.21.15.45:0/4210518743 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f976c1a0160 con 0x7f976c100ac0 2024-05-10T03:40:19.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.598+0000 7f975b7fe700 1 -- 172.21.15.45:0/4210518743 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c017650 con 0x7f976c100ac0 2024-05-10T03:40:19.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.598+0000 7f9770b5c700 1 -- 172.21.15.45:0/4210518743 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f976c1a05e0 con 0x7f976c100ac0 2024-05-10T03:40:19.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.599+0000 7f9770b5c700 1 -- 172.21.15.45:0/4210518743 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f976c0694d0 con 0x7f976c100ac0 2024-05-10T03:40:19.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.601+0000 7f975b7fe700 1 -- 172.21.15.45:0/4210518743 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f975c021410 con 0x7f976c100ac0 2024-05-10T03:40:19.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.601+0000 7f975b7fe700 1 --2- 172.21.15.45:0/4210518743 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f97540a1230 0x7f97540a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:19.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.601+0000 7f975b7fe700 1 -- 172.21.15.45:0/4210518743 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f975c0ce820 con 0x7f976c100ac0 2024-05-10T03:40:19.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.601+0000 7f9769d9b700 1 --2- 172.21.15.45:0/4210518743 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f97540a1230 0x7f97540a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:19.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.602+0000 7f9769d9b700 1 --2- 172.21.15.45:0/4210518743 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f97540a1230 0x7f97540a3740 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f976c199170 tx=0x7f9760009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:19.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.605+0000 7f975b7fe700 1 -- 172.21.15.45:0/4210518743 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f975c097bd0 con 0x7f976c100ac0 2024-05-10T03:40:19.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.817+0000 7f9770b5c700 1 -- 172.21.15.45:0/4210518743 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f976c0fe190 con 0x7f97540a1230 2024-05-10T03:40:19.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.831+0000 7f975b7fe700 1 -- 172.21.15.45:0/4210518743 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426722 (secure 0 0 0) 0x7f976c0fe190 con 0x7f97540a1230 2024-05-10T03:40:19.839 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:40:19.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.835+0000 7f9770b5c700 1 -- 172.21.15.45:0/4210518743 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f97540a1230 msgr2=0x7f97540a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:19.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.835+0000 7f9770b5c700 1 --2- 172.21.15.45:0/4210518743 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f97540a1230 0x7f97540a3740 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f976c199170 tx=0x7f9760009260 comp rx=0 tx=0).stop 2024-05-10T03:40:19.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.835+0000 7f9770b5c700 1 -- 172.21.15.45:0/4210518743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f976c100ac0 msgr2=0x7f976c1980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:19.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.835+0000 7f9770b5c700 1 --2- 172.21.15.45:0/4210518743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f976c100ac0 0x7f976c1980d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f975c0098e0 tx=0x7f975c005b00 comp rx=0 tx=0).stop 2024-05-10T03:40:19.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.835+0000 7f9770b5c700 1 -- 172.21.15.45:0/4210518743 shutdown_connections 2024-05-10T03:40:19.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.835+0000 7f9770b5c700 1 --2- 172.21.15.45:0/4210518743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f976c102580 0x7f976c19f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:19.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.835+0000 7f9770b5c700 1 --2- 172.21.15.45:0/4210518743 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f97540a1230 0x7f97540a3740 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:19.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.835+0000 7f9770b5c700 1 --2- 172.21.15.45:0/4210518743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f976c100ac0 0x7f976c1980d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:19.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.835+0000 7f9770b5c700 1 --2- 172.21.15.45:0/4210518743 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f976c101be0 0x7f976c198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:19.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.835+0000 7f9770b5c700 1 -- 172.21.15.45:0/4210518743 >> 172.21.15.45:0/4210518743 conn(0x7f976c0fc0d0 msgr2=0x7f976c0fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:19.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.835+0000 7f9770b5c700 1 -- 172.21.15.45:0/4210518743 shutdown_connections 2024-05-10T03:40:19.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:19.835+0000 7f9770b5c700 1 -- 172.21.15.45:0/4210518743 wait complete. 2024-05-10T03:40:19.844 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-05-10T03:40:19.853 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-05-10T03:40:17.905816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665479,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":910,"num_read_kb":577,"num_write":422,"num_write_kb":3086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1244630,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":350,"ondisk_log_size":350,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":362700,"kb_used_data":13812,"kb_used_omap":18,"kb_used_meta":348653,"kb_avail":1124579124,"statfs":{"total":1151940427776,"available":1151569022976,"internally_reserved":0,"allocated":14143488,"data_stored":7818669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19129,"internal_metadata":357020999},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4942,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":57,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003640"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076912+0000","last_change":"2024-05-10T03:38:36.586241+0000","last_active":"2024-05-10T03:39:26.076912+0000","last_peered":"2024-05-10T03:39:26.076912+0000","last_clean":"2024-05-10T03:39:26.076912+0000","last_became_active":"2024-05-10T03:38:36.585655+0000","last_became_peered":"2024-05-10T03:38:36.585655+0000","last_unstale":"2024-05-10T03:39:26.076912+0000","last_undegraded":"2024-05-10T03:39:26.076912+0000","last_fullsized":"2024-05-10T03:39:26.076912+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:58:24.614952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067299+0000","last_change":"2024-05-10T03:38:36.588174+0000","last_active":"2024-05-10T03:39:26.067299+0000","last_peered":"2024-05-10T03:39:26.067299+0000","last_clean":"2024-05-10T03:39:26.067299+0000","last_became_active":"2024-05-10T03:38:36.587843+0000","last_became_peered":"2024-05-10T03:38:36.587843+0000","last_unstale":"2024-05-10T03:39:26.067299+0000","last_undegraded":"2024-05-10T03:39:26.067299+0000","last_fullsized":"2024-05-10T03:39:26.067299+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:56.414407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067873+0000","last_change":"2024-05-10T03:38:36.587344+0000","last_active":"2024-05-10T03:39:26.067873+0000","last_peered":"2024-05-10T03:39:26.067873+0000","last_clean":"2024-05-10T03:39:26.067873+0000","last_became_active":"2024-05-10T03:38:36.586345+0000","last_became_peered":"2024-05-10T03:38:36.586345+0000","last_unstale":"2024-05-10T03:39:26.067873+0000","last_undegraded":"2024-05-10T03:39:26.067873+0000","last_fullsized":"2024-05-10T03:39:26.067873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:36.159864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.068208+0000","last_change":"2024-05-10T03:38:36.573019+0000","last_active":"2024-05-10T03:39:26.068208+0000","last_peered":"2024-05-10T03:39:26.068208+0000","last_clean":"2024-05-10T03:39:26.068208+0000","last_became_active":"2024-05-10T03:38:36.572667+0000","last_became_peered":"2024-05-10T03:38:36.572667+0000","last_unstale":"2024-05-10T03:39:26.068208+0000","last_undegraded":"2024-05-10T03:39:26.068208+0000","last_fullsized":"2024-05-10T03:39:26.068208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:24:23.722642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074998+0000","last_change":"2024-05-10T03:38:36.577069+0000","last_active":"2024-05-10T03:39:26.074998+0000","last_peered":"2024-05-10T03:39:26.074998+0000","last_clean":"2024-05-10T03:39:26.074998+0000","last_became_active":"2024-05-10T03:38:36.576683+0000","last_became_peered":"2024-05-10T03:38:36.576683+0000","last_unstale":"2024-05-10T03:39:26.074998+0000","last_undegraded":"2024-05-10T03:39:26.074998+0000","last_fullsized":"2024-05-10T03:39:26.074998+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:09:15.280098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073190+0000","last_change":"2024-05-10T03:38:36.577518+0000","last_active":"2024-05-10T03:39:26.073190+0000","last_peered":"2024-05-10T03:39:26.073190+0000","last_clean":"2024-05-10T03:39:26.073190+0000","last_became_active":"2024-05-10T03:38:36.577147+0000","last_became_peered":"2024-05-10T03:38:36.577147+0000","last_unstale":"2024-05-10T03:39:26.073190+0000","last_undegraded":"2024-05-10T03:39:26.073190+0000","last_fullsized":"2024-05-10T03:39:26.073190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:39:42.779405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078304+0000","last_change":"2024-05-10T03:38:36.594241+0000","last_active":"2024-05-10T03:39:26.078304+0000","last_peered":"2024-05-10T03:39:26.078304+0000","last_clean":"2024-05-10T03:39:26.078304+0000","last_became_active":"2024-05-10T03:38:36.593943+0000","last_became_peered":"2024-05-10T03:38:36.593943+0000","last_unstale":"2024-05-10T03:39:26.078304+0000","last_undegraded":"2024-05-10T03:39:26.078304+0000","last_fullsized":"2024-05-10T03:39:26.078304+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:00.521083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076927+0000","last_change":"2024-05-10T03:38:36.578318+0000","last_active":"2024-05-10T03:39:26.076927+0000","last_peered":"2024-05-10T03:39:26.076927+0000","last_clean":"2024-05-10T03:39:26.076927+0000","last_became_active":"2024-05-10T03:38:36.577967+0000","last_became_peered":"2024-05-10T03:38:36.577967+0000","last_unstale":"2024-05-10T03:39:26.076927+0000","last_undegraded":"2024-05-10T03:39:26.076927+0000","last_fullsized":"2024-05-10T03:39:26.076927+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:45:27.988368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075718+0000","last_change":"2024-05-10T03:38:36.590219+0000","last_active":"2024-05-10T03:39:26.075718+0000","last_peered":"2024-05-10T03:39:26.075718+0000","last_clean":"2024-05-10T03:39:26.075718+0000","last_became_active":"2024-05-10T03:38:36.589849+0000","last_became_peered":"2024-05-10T03:38:36.589849+0000","last_unstale":"2024-05-10T03:39:26.075718+0000","last_undegraded":"2024-05-10T03:39:26.075718+0000","last_fullsized":"2024-05-10T03:39:26.075718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:08:17.073204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072847+0000","last_change":"2024-05-10T03:38:36.580555+0000","last_active":"2024-05-10T03:39:26.072847+0000","last_peered":"2024-05-10T03:39:26.072847+0000","last_clean":"2024-05-10T03:39:26.072847+0000","last_became_active":"2024-05-10T03:38:36.577575+0000","last_became_peered":"2024-05-10T03:38:36.577575+0000","last_unstale":"2024-05-10T03:39:26.072847+0000","last_undegraded":"2024-05-10T03:39:26.072847+0000","last_fullsized":"2024-05-10T03:39:26.072847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:43:29.237054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078946+0000","last_change":"2024-05-10T03:38:36.586599+0000","last_active":"2024-05-10T03:39:26.078946+0000","last_peered":"2024-05-10T03:39:26.078946+0000","last_clean":"2024-05-10T03:39:26.078946+0000","last_became_active":"2024-05-10T03:38:36.585794+0000","last_became_peered":"2024-05-10T03:38:36.585794+0000","last_unstale":"2024-05-10T03:39:26.078946+0000","last_undegraded":"2024-05-10T03:39:26.078946+0000","last_fullsized":"2024-05-10T03:39:26.078946+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:25:18.337715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.068090+0000","last_change":"2024-05-10T03:38:36.578957+0000","last_active":"2024-05-10T03:39:26.068090+0000","last_peered":"2024-05-10T03:39:26.068090+0000","last_clean":"2024-05-10T03:39:26.068090+0000","last_became_active":"2024-05-10T03:38:36.578636+0000","last_became_peered":"2024-05-10T03:38:36.578636+0000","last_unstale":"2024-05-10T03:39:26.068090+0000","last_undegraded":"2024-05-10T03:39:26.068090+0000","last_fullsized":"2024-05-10T03:39:26.068090+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:55:38.830864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.079013+0000","last_change":"2024-05-10T03:39:27.079013+0000","last_active":"2024-05-10T03:39:27.079013+0000","last_peered":"2024-05-10T03:39:27.079013+0000","last_clean":"2024-05-10T03:39:27.079013+0000","last_became_active":"2024-05-10T03:39:27.078674+0000","last_became_peered":"2024-05-10T03:39:27.078674+0000","last_unstale":"2024-05-10T03:39:27.079013+0000","last_undegraded":"2024-05-10T03:39:27.079013+0000","last_fullsized":"2024-05-10T03:39:27.079013+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:59:52.547126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.066698+0000","last_change":"2024-05-10T03:38:36.590205+0000","last_active":"2024-05-10T03:39:26.066698+0000","last_peered":"2024-05-10T03:39:26.066698+0000","last_clean":"2024-05-10T03:39:26.066698+0000","last_became_active":"2024-05-10T03:38:36.589880+0000","last_became_peered":"2024-05-10T03:38:36.589880+0000","last_unstale":"2024-05-10T03:39:26.066698+0000","last_undegraded":"2024-05-10T03:39:26.066698+0000","last_fullsized":"2024-05-10T03:39:26.066698+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:22:26.374034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.077754+0000","last_change":"2024-05-10T03:39:27.077754+0000","last_active":"2024-05-10T03:39:27.077754+0000","last_peered":"2024-05-10T03:39:27.077754+0000","last_clean":"2024-05-10T03:39:27.077754+0000","last_became_active":"2024-05-10T03:39:27.077313+0000","last_became_peered":"2024-05-10T03:39:27.077313+0000","last_unstale":"2024-05-10T03:39:27.077754+0000","last_undegraded":"2024-05-10T03:39:27.077754+0000","last_fullsized":"2024-05-10T03:39:27.077754+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:36:49.331763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074838+0000","last_change":"2024-05-10T03:38:36.591061+0000","last_active":"2024-05-10T03:39:26.074838+0000","last_peered":"2024-05-10T03:39:26.074838+0000","last_clean":"2024-05-10T03:39:26.074838+0000","last_became_active":"2024-05-10T03:38:36.590698+0000","last_became_peered":"2024-05-10T03:38:36.590698+0000","last_unstale":"2024-05-10T03:39:26.074838+0000","last_undegraded":"2024-05-10T03:39:26.074838+0000","last_fullsized":"2024-05-10T03:39:26.074838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:44:43.130908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076823+0000","last_change":"2024-05-10T03:38:36.585990+0000","last_active":"2024-05-10T03:39:26.076823+0000","last_peered":"2024-05-10T03:39:26.076823+0000","last_clean":"2024-05-10T03:39:26.076823+0000","last_became_active":"2024-05-10T03:38:36.585221+0000","last_became_peered":"2024-05-10T03:38:36.585221+0000","last_unstale":"2024-05-10T03:39:26.076823+0000","last_undegraded":"2024-05-10T03:39:26.076823+0000","last_fullsized":"2024-05-10T03:39:26.076823+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:57:58.981790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074421+0000","last_change":"2024-05-10T03:38:36.586651+0000","last_active":"2024-05-10T03:39:26.074421+0000","last_peered":"2024-05-10T03:39:26.074421+0000","last_clean":"2024-05-10T03:39:26.074421+0000","last_became_active":"2024-05-10T03:38:36.586243+0000","last_became_peered":"2024-05-10T03:38:36.586243+0000","last_unstale":"2024-05-10T03:39:26.074421+0000","last_undegraded":"2024-05-10T03:39:26.074421+0000","last_fullsized":"2024-05-10T03:39:26.074421+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:15:58.148040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.071924+0000","last_change":"2024-05-10T03:38:36.583740+0000","last_active":"2024-05-10T03:39:26.071924+0000","last_peered":"2024-05-10T03:39:26.071924+0000","last_clean":"2024-05-10T03:39:26.071924+0000","last_became_active":"2024-05-10T03:38:36.583359+0000","last_became_peered":"2024-05-10T03:38:36.583359+0000","last_unstale":"2024-05-10T03:39:26.071924+0000","last_undegraded":"2024-05-10T03:39:26.071924+0000","last_fullsized":"2024-05-10T03:39:26.071924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:31:29.286667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072212+0000","last_change":"2024-05-10T03:38:40.605484+0000","last_active":"2024-05-10T03:39:26.072212+0000","last_peered":"2024-05-10T03:39:26.072212+0000","last_clean":"2024-05-10T03:39:26.072212+0000","last_became_active":"2024-05-10T03:38:40.605105+0000","last_became_peered":"2024-05-10T03:38:40.605105+0000","last_unstale":"2024-05-10T03:39:26.072212+0000","last_undegraded":"2024-05-10T03:39:26.072212+0000","last_fullsized":"2024-05-10T03:39:26.072212+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:11:34.548916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":109,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:40:15.131236+0000","last_change":"2024-05-10T03:38:36.093877+0000","last_active":"2024-05-10T03:40:15.131236+0000","last_peered":"2024-05-10T03:40:15.131236+0000","last_clean":"2024-05-10T03:40:15.131236+0000","last_became_active":"2024-05-10T03:38:36.093499+0000","last_became_peered":"2024-05-10T03:38:36.093499+0000","last_unstale":"2024-05-10T03:40:15.131236+0000","last_undegraded":"2024-05-10T03:40:15.131236+0000","last_fullsized":"2024-05-10T03:40:15.131236+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:42:17.171167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.080639+0000","last_change":"2024-05-10T03:39:27.080639+0000","last_active":"2024-05-10T03:39:27.080639+0000","last_peered":"2024-05-10T03:39:27.080639+0000","last_clean":"2024-05-10T03:39:27.080639+0000","last_became_active":"2024-05-10T03:39:27.080267+0000","last_became_peered":"2024-05-10T03:39:27.080267+0000","last_unstale":"2024-05-10T03:39:27.080639+0000","last_undegraded":"2024-05-10T03:39:27.080639+0000","last_fullsized":"2024-05-10T03:39:27.080639+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:56:51.282955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067286+0000","last_change":"2024-05-10T03:38:40.608982+0000","last_active":"2024-05-10T03:39:26.067286+0000","last_peered":"2024-05-10T03:39:26.067286+0000","last_clean":"2024-05-10T03:39:26.067286+0000","last_became_active":"2024-05-10T03:38:40.608619+0000","last_became_peered":"2024-05-10T03:38:40.608619+0000","last_unstale":"2024-05-10T03:39:26.067286+0000","last_undegraded":"2024-05-10T03:39:26.067286+0000","last_fullsized":"2024-05-10T03:39:26.067286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:35:56.411530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077808+0000","last_change":"2024-05-10T03:38:36.101669+0000","last_active":"2024-05-10T03:39:26.077808+0000","last_peered":"2024-05-10T03:39:26.077808+0000","last_clean":"2024-05-10T03:39:26.077808+0000","last_became_active":"2024-05-10T03:38:36.101231+0000","last_became_peered":"2024-05-10T03:38:36.101231+0000","last_unstale":"2024-05-10T03:39:26.077808+0000","last_undegraded":"2024-05-10T03:39:26.077808+0000","last_fullsized":"2024-05-10T03:39:26.077808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:42:21.992880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067320+0000","last_change":"2024-05-10T03:38:36.585580+0000","last_active":"2024-05-10T03:39:26.067320+0000","last_peered":"2024-05-10T03:39:26.067320+0000","last_clean":"2024-05-10T03:39:26.067320+0000","last_became_active":"2024-05-10T03:38:36.585239+0000","last_became_peered":"2024-05-10T03:38:36.585239+0000","last_unstale":"2024-05-10T03:39:26.067320+0000","last_undegraded":"2024-05-10T03:39:26.067320+0000","last_fullsized":"2024-05-10T03:39:26.067320+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:39:42.886154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067314+0000","last_change":"2024-05-10T03:38:40.610372+0000","last_active":"2024-05-10T03:39:26.067314+0000","last_peered":"2024-05-10T03:39:26.067314+0000","last_clean":"2024-05-10T03:39:26.067314+0000","last_became_active":"2024-05-10T03:38:40.609958+0000","last_became_peered":"2024-05-10T03:38:40.609958+0000","last_unstale":"2024-05-10T03:39:26.067314+0000","last_undegraded":"2024-05-10T03:39:26.067314+0000","last_fullsized":"2024-05-10T03:39:26.067314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:04:37.461729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075873+0000","last_change":"2024-05-10T03:38:36.091809+0000","last_active":"2024-05-10T03:39:26.075873+0000","last_peered":"2024-05-10T03:39:26.075873+0000","last_clean":"2024-05-10T03:39:26.075873+0000","last_became_active":"2024-05-10T03:38:36.091372+0000","last_became_peered":"2024-05-10T03:38:36.091372+0000","last_unstale":"2024-05-10T03:39:26.075873+0000","last_undegraded":"2024-05-10T03:39:26.075873+0000","last_fullsized":"2024-05-10T03:39:26.075873+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:25:01.784559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075357+0000","last_change":"2024-05-10T03:38:36.595389+0000","last_active":"2024-05-10T03:39:26.075357+0000","last_peered":"2024-05-10T03:39:26.075357+0000","last_clean":"2024-05-10T03:39:26.075357+0000","last_became_active":"2024-05-10T03:38:36.595011+0000","last_became_peered":"2024-05-10T03:38:36.595011+0000","last_unstale":"2024-05-10T03:39:26.075357+0000","last_undegraded":"2024-05-10T03:39:26.075357+0000","last_fullsized":"2024-05-10T03:39:26.075357+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:54:38.377508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067207+0000","last_change":"2024-05-10T03:38:40.605656+0000","last_active":"2024-05-10T03:39:26.067207+0000","last_peered":"2024-05-10T03:39:26.067207+0000","last_clean":"2024-05-10T03:39:26.067207+0000","last_became_active":"2024-05-10T03:38:40.605262+0000","last_became_peered":"2024-05-10T03:38:40.605262+0000","last_unstale":"2024-05-10T03:39:26.067207+0000","last_undegraded":"2024-05-10T03:39:26.067207+0000","last_fullsized":"2024-05-10T03:39:26.067207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:11:27.398282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.089175+0000","last_change":"2024-05-10T03:39:27.089175+0000","last_active":"2024-05-10T03:39:27.089175+0000","last_peered":"2024-05-10T03:39:27.089175+0000","last_clean":"2024-05-10T03:39:27.089175+0000","last_became_active":"2024-05-10T03:39:27.080923+0000","last_became_peered":"2024-05-10T03:39:27.080923+0000","last_unstale":"2024-05-10T03:39:27.089175+0000","last_undegraded":"2024-05-10T03:39:27.089175+0000","last_fullsized":"2024-05-10T03:39:27.089175+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:22.891201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073498+0000","last_change":"2024-05-10T03:38:36.587831+0000","last_active":"2024-05-10T03:39:26.073498+0000","last_peered":"2024-05-10T03:39:26.073498+0000","last_clean":"2024-05-10T03:39:26.073498+0000","last_became_active":"2024-05-10T03:38:36.587503+0000","last_became_peered":"2024-05-10T03:38:36.587503+0000","last_unstale":"2024-05-10T03:39:26.073498+0000","last_undegraded":"2024-05-10T03:39:26.073498+0000","last_fullsized":"2024-05-10T03:39:26.073498+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:52.335134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.071626+0000","last_change":"2024-05-10T03:38:40.601327+0000","last_active":"2024-05-10T03:39:26.071626+0000","last_peered":"2024-05-10T03:39:26.071626+0000","last_clean":"2024-05-10T03:39:26.071626+0000","last_became_active":"2024-05-10T03:38:40.600901+0000","last_became_peered":"2024-05-10T03:38:40.600901+0000","last_unstale":"2024-05-10T03:39:26.071626+0000","last_undegraded":"2024-05-10T03:39:26.071626+0000","last_fullsized":"2024-05-10T03:39:26.071626+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:28.285707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":102,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:40:13.129904+0000","last_change":"2024-05-10T03:38:36.094064+0000","last_active":"2024-05-10T03:40:13.129904+0000","last_peered":"2024-05-10T03:40:13.129904+0000","last_clean":"2024-05-10T03:40:13.129904+0000","last_became_active":"2024-05-10T03:38:36.093522+0000","last_became_peered":"2024-05-10T03:38:36.093522+0000","last_unstale":"2024-05-10T03:40:13.129904+0000","last_undegraded":"2024-05-10T03:40:13.129904+0000","last_fullsized":"2024-05-10T03:40:13.129904+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:25:14.257166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":77,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076617+0000","last_change":"2024-05-10T03:38:36.580553+0000","last_active":"2024-05-10T03:39:26.076617+0000","last_peered":"2024-05-10T03:39:26.076617+0000","last_clean":"2024-05-10T03:39:26.076617+0000","last_became_active":"2024-05-10T03:38:36.580160+0000","last_became_peered":"2024-05-10T03:38:36.580160+0000","last_unstale":"2024-05-10T03:39:26.076617+0000","last_undegraded":"2024-05-10T03:39:26.076617+0000","last_fullsized":"2024-05-10T03:39:26.076617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:01:14.373430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.071997+0000","last_change":"2024-05-10T03:38:40.609034+0000","last_active":"2024-05-10T03:39:26.071997+0000","last_peered":"2024-05-10T03:39:26.071997+0000","last_clean":"2024-05-10T03:39:26.071997+0000","last_became_active":"2024-05-10T03:38:40.608617+0000","last_became_peered":"2024-05-10T03:38:40.608617+0000","last_unstale":"2024-05-10T03:39:26.071997+0000","last_undegraded":"2024-05-10T03:39:26.071997+0000","last_fullsized":"2024-05-10T03:39:26.071997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:55:28.669881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.093057+0000","last_change":"2024-05-10T03:39:27.093057+0000","last_active":"2024-05-10T03:39:27.093057+0000","last_peered":"2024-05-10T03:39:27.093057+0000","last_clean":"2024-05-10T03:39:27.093057+0000","last_became_active":"2024-05-10T03:39:27.076537+0000","last_became_peered":"2024-05-10T03:39:27.076537+0000","last_unstale":"2024-05-10T03:39:27.093057+0000","last_undegraded":"2024-05-10T03:39:27.093057+0000","last_fullsized":"2024-05-10T03:39:27.093057+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:24.158984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073109+0000","last_change":"2024-05-10T03:38:36.569429+0000","last_active":"2024-05-10T03:39:26.073109+0000","last_peered":"2024-05-10T03:39:26.073109+0000","last_clean":"2024-05-10T03:39:26.073109+0000","last_became_active":"2024-05-10T03:38:36.569042+0000","last_became_peered":"2024-05-10T03:38:36.569042+0000","last_unstale":"2024-05-10T03:39:26.073109+0000","last_undegraded":"2024-05-10T03:39:26.073109+0000","last_fullsized":"2024-05-10T03:39:26.073109+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:45:14.912428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076732+0000","last_change":"2024-05-10T03:38:40.607734+0000","last_active":"2024-05-10T03:39:26.076732+0000","last_peered":"2024-05-10T03:39:26.076732+0000","last_clean":"2024-05-10T03:39:26.076732+0000","last_became_active":"2024-05-10T03:38:40.607331+0000","last_became_peered":"2024-05-10T03:38:40.607331+0000","last_unstale":"2024-05-10T03:39:26.076732+0000","last_undegraded":"2024-05-10T03:39:26.076732+0000","last_fullsized":"2024-05-10T03:39:26.076732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:45:08.360275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.069502+0000","last_change":"2024-05-10T03:38:36.083651+0000","last_active":"2024-05-10T03:39:26.069502+0000","last_peered":"2024-05-10T03:39:26.069502+0000","last_clean":"2024-05-10T03:39:26.069502+0000","last_became_active":"2024-05-10T03:38:36.083235+0000","last_became_peered":"2024-05-10T03:38:36.083235+0000","last_unstale":"2024-05-10T03:39:26.069502+0000","last_undegraded":"2024-05-10T03:39:26.069502+0000","last_fullsized":"2024-05-10T03:39:26.069502+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:28:43.179157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077120+0000","last_change":"2024-05-10T03:38:36.579055+0000","last_active":"2024-05-10T03:39:26.077120+0000","last_peered":"2024-05-10T03:39:26.077120+0000","last_clean":"2024-05-10T03:39:26.077120+0000","last_became_active":"2024-05-10T03:38:36.578200+0000","last_became_peered":"2024-05-10T03:38:36.578200+0000","last_unstale":"2024-05-10T03:39:26.077120+0000","last_undegraded":"2024-05-10T03:39:26.077120+0000","last_fullsized":"2024-05-10T03:39:26.077120+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:48:12.749264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067181+0000","last_change":"2024-05-10T03:38:40.603903+0000","last_active":"2024-05-10T03:39:26.067181+0000","last_peered":"2024-05-10T03:39:26.067181+0000","last_clean":"2024-05-10T03:39:26.067181+0000","last_became_active":"2024-05-10T03:38:40.603481+0000","last_became_peered":"2024-05-10T03:38:40.603481+0000","last_unstale":"2024-05-10T03:39:26.067181+0000","last_undegraded":"2024-05-10T03:39:26.067181+0000","last_fullsized":"2024-05-10T03:39:26.067181+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:44:48.526838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072175+0000","last_change":"2024-05-10T03:38:36.093549+0000","last_active":"2024-05-10T03:39:26.072175+0000","last_peered":"2024-05-10T03:39:26.072175+0000","last_clean":"2024-05-10T03:39:26.072175+0000","last_became_active":"2024-05-10T03:38:36.093244+0000","last_became_peered":"2024-05-10T03:38:36.093244+0000","last_unstale":"2024-05-10T03:39:26.072175+0000","last_undegraded":"2024-05-10T03:39:26.072175+0000","last_fullsized":"2024-05-10T03:39:26.072175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:11:55.727728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073706+0000","last_change":"2024-05-10T03:38:36.582623+0000","last_active":"2024-05-10T03:39:26.073706+0000","last_peered":"2024-05-10T03:39:26.073706+0000","last_clean":"2024-05-10T03:39:26.073706+0000","last_became_active":"2024-05-10T03:38:36.582262+0000","last_became_peered":"2024-05-10T03:38:36.582262+0000","last_unstale":"2024-05-10T03:39:26.073706+0000","last_undegraded":"2024-05-10T03:39:26.073706+0000","last_fullsized":"2024-05-10T03:39:26.073706+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:48.561206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077079+0000","last_change":"2024-05-10T03:38:40.602050+0000","last_active":"2024-05-10T03:39:26.077079+0000","last_peered":"2024-05-10T03:39:26.077079+0000","last_clean":"2024-05-10T03:39:26.077079+0000","last_became_active":"2024-05-10T03:38:40.601699+0000","last_became_peered":"2024-05-10T03:38:40.601699+0000","last_unstale":"2024-05-10T03:39:26.077079+0000","last_undegraded":"2024-05-10T03:39:26.077079+0000","last_fullsized":"2024-05-10T03:39:26.077079+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:56.778636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"88'5","reported_seq":173,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:40:14.130712+0000","last_change":"2024-05-10T03:38:36.095747+0000","last_active":"2024-05-10T03:40:14.130712+0000","last_peered":"2024-05-10T03:40:14.130712+0000","last_clean":"2024-05-10T03:40:14.130712+0000","last_became_active":"2024-05-10T03:38:36.095371+0000","last_became_peered":"2024-05-10T03:38:36.095371+0000","last_unstale":"2024-05-10T03:40:14.130712+0000","last_undegraded":"2024-05-10T03:40:14.130712+0000","last_fullsized":"2024-05-10T03:40:14.130712+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:02:37.435286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":150,"num_read_kb":150,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075561+0000","last_change":"2024-05-10T03:38:36.591321+0000","last_active":"2024-05-10T03:39:26.075561+0000","last_peered":"2024-05-10T03:39:26.075561+0000","last_clean":"2024-05-10T03:39:26.075561+0000","last_became_active":"2024-05-10T03:38:36.589852+0000","last_became_peered":"2024-05-10T03:38:36.589852+0000","last_unstale":"2024-05-10T03:39:26.075561+0000","last_undegraded":"2024-05-10T03:39:26.075561+0000","last_fullsized":"2024-05-10T03:39:26.075561+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:43.075901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073535+0000","last_change":"2024-05-10T03:38:40.605096+0000","last_active":"2024-05-10T03:39:26.073535+0000","last_peered":"2024-05-10T03:39:26.073535+0000","last_clean":"2024-05-10T03:39:26.073535+0000","last_became_active":"2024-05-10T03:38:40.604595+0000","last_became_peered":"2024-05-10T03:38:40.604595+0000","last_unstale":"2024-05-10T03:39:26.073535+0000","last_undegraded":"2024-05-10T03:39:26.073535+0000","last_fullsized":"2024-05-10T03:39:26.073535+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:14.547025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078938+0000","last_change":"2024-05-10T03:38:36.097214+0000","last_active":"2024-05-10T03:39:26.078938+0000","last_peered":"2024-05-10T03:39:26.078938+0000","last_clean":"2024-05-10T03:39:26.078938+0000","last_became_active":"2024-05-10T03:38:36.096835+0000","last_became_peered":"2024-05-10T03:38:36.096835+0000","last_unstale":"2024-05-10T03:39:26.078938+0000","last_undegraded":"2024-05-10T03:39:26.078938+0000","last_fullsized":"2024-05-10T03:39:26.078938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:50.757974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.081369+0000","last_change":"2024-05-10T03:39:27.081369+0000","last_active":"2024-05-10T03:39:27.081369+0000","last_peered":"2024-05-10T03:39:27.081369+0000","last_clean":"2024-05-10T03:39:27.081369+0000","last_became_active":"2024-05-10T03:39:27.080851+0000","last_became_peered":"2024-05-10T03:39:27.080851+0000","last_unstale":"2024-05-10T03:39:27.081369+0000","last_undegraded":"2024-05-10T03:39:27.081369+0000","last_fullsized":"2024-05-10T03:39:27.081369+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:11.552549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067592+0000","last_change":"2024-05-10T03:38:40.605627+0000","last_active":"2024-05-10T03:39:26.067592+0000","last_peered":"2024-05-10T03:39:26.067592+0000","last_clean":"2024-05-10T03:39:26.067592+0000","last_became_active":"2024-05-10T03:38:40.605116+0000","last_became_peered":"2024-05-10T03:38:40.605116+0000","last_unstale":"2024-05-10T03:39:26.067592+0000","last_undegraded":"2024-05-10T03:39:26.067592+0000","last_fullsized":"2024-05-10T03:39:26.067592+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:50:08.759725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073226+0000","last_change":"2024-05-10T03:38:36.102257+0000","last_active":"2024-05-10T03:39:26.073226+0000","last_peered":"2024-05-10T03:39:26.073226+0000","last_clean":"2024-05-10T03:39:26.073226+0000","last_became_active":"2024-05-10T03:38:36.101876+0000","last_became_peered":"2024-05-10T03:38:36.101876+0000","last_unstale":"2024-05-10T03:39:26.073226+0000","last_undegraded":"2024-05-10T03:39:26.073226+0000","last_fullsized":"2024-05-10T03:39:26.073226+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:38:01.164794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075466+0000","last_change":"2024-05-10T03:38:36.591746+0000","last_active":"2024-05-10T03:39:26.075466+0000","last_peered":"2024-05-10T03:39:26.075466+0000","last_clean":"2024-05-10T03:39:26.075466+0000","last_became_active":"2024-05-10T03:38:36.591474+0000","last_became_peered":"2024-05-10T03:38:36.591474+0000","last_unstale":"2024-05-10T03:39:26.075466+0000","last_undegraded":"2024-05-10T03:39:26.075466+0000","last_fullsized":"2024-05-10T03:39:26.075466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:18:02.773737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073900+0000","last_change":"2024-05-10T03:38:40.605956+0000","last_active":"2024-05-10T03:39:26.073900+0000","last_peered":"2024-05-10T03:39:26.073900+0000","last_clean":"2024-05-10T03:39:26.073900+0000","last_became_active":"2024-05-10T03:38:40.605466+0000","last_became_peered":"2024-05-10T03:38:40.605466+0000","last_unstale":"2024-05-10T03:39:26.073900+0000","last_undegraded":"2024-05-10T03:39:26.073900+0000","last_fullsized":"2024-05-10T03:39:26.073900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:07:44.234771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"88'37","reported_seq":235,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:40:14.152649+0000","last_change":"2024-05-10T03:39:27.083993+0000","last_active":"2024-05-10T03:40:14.152649+0000","last_peered":"2024-05-10T03:40:14.152649+0000","last_clean":"2024-05-10T03:40:14.152649+0000","last_became_active":"2024-05-10T03:39:27.075982+0000","last_became_peered":"2024-05-10T03:39:27.075982+0000","last_unstale":"2024-05-10T03:40:14.152649+0000","last_undegraded":"2024-05-10T03:40:14.152649+0000","last_fullsized":"2024-05-10T03:40:14.152649+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:10:49.852271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67940,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":154,"num_read_kb":138,"num_write":39,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":63312,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075545+0000","last_change":"2024-05-10T03:38:36.579560+0000","last_active":"2024-05-10T03:39:26.075545+0000","last_peered":"2024-05-10T03:39:26.075545+0000","last_clean":"2024-05-10T03:39:26.075545+0000","last_became_active":"2024-05-10T03:38:36.579217+0000","last_became_peered":"2024-05-10T03:38:36.579217+0000","last_unstale":"2024-05-10T03:39:26.075545+0000","last_undegraded":"2024-05-10T03:39:26.075545+0000","last_fullsized":"2024-05-10T03:39:26.075545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:11:50.208794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076114+0000","last_change":"2024-05-10T03:38:40.599253+0000","last_active":"2024-05-10T03:39:26.076114+0000","last_peered":"2024-05-10T03:39:26.076114+0000","last_clean":"2024-05-10T03:39:26.076114+0000","last_became_active":"2024-05-10T03:38:40.597818+0000","last_became_peered":"2024-05-10T03:38:40.597818+0000","last_unstale":"2024-05-10T03:39:26.076114+0000","last_undegraded":"2024-05-10T03:39:26.076114+0000","last_fullsized":"2024-05-10T03:39:26.076114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:48:37.286108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073316+0000","last_change":"2024-05-10T03:38:36.100727+0000","last_active":"2024-05-10T03:39:26.073316+0000","last_peered":"2024-05-10T03:39:26.073316+0000","last_clean":"2024-05-10T03:39:26.073316+0000","last_became_active":"2024-05-10T03:38:36.100381+0000","last_became_peered":"2024-05-10T03:38:36.100381+0000","last_unstale":"2024-05-10T03:39:26.073316+0000","last_undegraded":"2024-05-10T03:39:26.073316+0000","last_fullsized":"2024-05-10T03:39:26.073316+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:57:53.831417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.069729+0000","last_change":"2024-05-10T03:38:36.580924+0000","last_active":"2024-05-10T03:39:26.069729+0000","last_peered":"2024-05-10T03:39:26.069729+0000","last_clean":"2024-05-10T03:39:26.069729+0000","last_became_active":"2024-05-10T03:38:36.580598+0000","last_became_peered":"2024-05-10T03:38:36.580598+0000","last_unstale":"2024-05-10T03:39:26.069729+0000","last_undegraded":"2024-05-10T03:39:26.069729+0000","last_fullsized":"2024-05-10T03:39:26.069729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:33:12.007718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077561+0000","last_change":"2024-05-10T03:38:40.606934+0000","last_active":"2024-05-10T03:39:26.077561+0000","last_peered":"2024-05-10T03:39:26.077561+0000","last_clean":"2024-05-10T03:39:26.077561+0000","last_became_active":"2024-05-10T03:38:40.606451+0000","last_became_peered":"2024-05-10T03:38:40.606451+0000","last_unstale":"2024-05-10T03:39:26.077561+0000","last_undegraded":"2024-05-10T03:39:26.077561+0000","last_fullsized":"2024-05-10T03:39:26.077561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:03:43.562337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073308+0000","last_change":"2024-05-10T03:38:36.093109+0000","last_active":"2024-05-10T03:39:26.073308+0000","last_peered":"2024-05-10T03:39:26.073308+0000","last_clean":"2024-05-10T03:39:26.073308+0000","last_became_active":"2024-05-10T03:38:36.092623+0000","last_became_peered":"2024-05-10T03:38:36.092623+0000","last_unstale":"2024-05-10T03:39:26.073308+0000","last_undegraded":"2024-05-10T03:39:26.073308+0000","last_fullsized":"2024-05-10T03:39:26.073308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:27:10.367098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.079173+0000","last_change":"2024-05-10T03:38:36.582794+0000","last_active":"2024-05-10T03:39:26.079173+0000","last_peered":"2024-05-10T03:39:26.079173+0000","last_clean":"2024-05-10T03:39:26.079173+0000","last_became_active":"2024-05-10T03:38:36.582464+0000","last_became_peered":"2024-05-10T03:38:36.582464+0000","last_unstale":"2024-05-10T03:39:26.079173+0000","last_undegraded":"2024-05-10T03:39:26.079173+0000","last_fullsized":"2024-05-10T03:39:26.079173+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:58:19.665485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074568+0000","last_change":"2024-05-10T03:38:40.608696+0000","last_active":"2024-05-10T03:39:26.074568+0000","last_peered":"2024-05-10T03:39:26.074568+0000","last_clean":"2024-05-10T03:39:26.074568+0000","last_became_active":"2024-05-10T03:38:40.607868+0000","last_became_peered":"2024-05-10T03:38:40.607868+0000","last_unstale":"2024-05-10T03:39:26.074568+0000","last_undegraded":"2024-05-10T03:39:26.074568+0000","last_fullsized":"2024-05-10T03:39:26.074568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:27.154675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":101,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:40:14.148862+0000","last_change":"2024-05-10T03:38:36.093060+0000","last_active":"2024-05-10T03:40:14.148862+0000","last_peered":"2024-05-10T03:40:14.148862+0000","last_clean":"2024-05-10T03:40:14.148862+0000","last_became_active":"2024-05-10T03:38:36.092476+0000","last_became_peered":"2024-05-10T03:38:36.092476+0000","last_unstale":"2024-05-10T03:40:14.148862+0000","last_undegraded":"2024-05-10T03:40:14.148862+0000","last_fullsized":"2024-05-10T03:40:14.148862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:52:04.624230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":79,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078407+0000","last_change":"2024-05-10T03:38:36.594808+0000","last_active":"2024-05-10T03:39:26.078407+0000","last_peered":"2024-05-10T03:39:26.078407+0000","last_clean":"2024-05-10T03:39:26.078407+0000","last_became_active":"2024-05-10T03:38:36.594511+0000","last_became_peered":"2024-05-10T03:38:36.594511+0000","last_unstale":"2024-05-10T03:39:26.078407+0000","last_undegraded":"2024-05-10T03:39:26.078407+0000","last_fullsized":"2024-05-10T03:39:26.078407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:18:59.981485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070877+0000","last_change":"2024-05-10T03:38:40.605744+0000","last_active":"2024-05-10T03:39:26.070877+0000","last_peered":"2024-05-10T03:39:26.070877+0000","last_clean":"2024-05-10T03:39:26.070877+0000","last_became_active":"2024-05-10T03:38:40.605269+0000","last_became_peered":"2024-05-10T03:38:40.605269+0000","last_unstale":"2024-05-10T03:39:26.070877+0000","last_undegraded":"2024-05-10T03:39:26.070877+0000","last_fullsized":"2024-05-10T03:39:26.070877+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:21.881903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074955+0000","last_change":"2024-05-10T03:38:36.098918+0000","last_active":"2024-05-10T03:39:26.074955+0000","last_peered":"2024-05-10T03:39:26.074955+0000","last_clean":"2024-05-10T03:39:26.074955+0000","last_became_active":"2024-05-10T03:38:36.098586+0000","last_became_peered":"2024-05-10T03:38:36.098586+0000","last_unstale":"2024-05-10T03:39:26.074955+0000","last_undegraded":"2024-05-10T03:39:26.074955+0000","last_fullsized":"2024-05-10T03:39:26.074955+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:58:48.297763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072973+0000","last_change":"2024-05-10T03:38:36.581347+0000","last_active":"2024-05-10T03:39:26.072973+0000","last_peered":"2024-05-10T03:39:26.072973+0000","last_clean":"2024-05-10T03:39:26.072973+0000","last_became_active":"2024-05-10T03:38:36.581044+0000","last_became_peered":"2024-05-10T03:38:36.581044+0000","last_unstale":"2024-05-10T03:39:26.072973+0000","last_undegraded":"2024-05-10T03:39:26.072973+0000","last_fullsized":"2024-05-10T03:39:26.072973+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:23:43.885238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072974+0000","last_change":"2024-05-10T03:38:40.600521+0000","last_active":"2024-05-10T03:39:26.072974+0000","last_peered":"2024-05-10T03:39:26.072974+0000","last_clean":"2024-05-10T03:39:26.072974+0000","last_became_active":"2024-05-10T03:38:40.600016+0000","last_became_peered":"2024-05-10T03:38:40.600016+0000","last_unstale":"2024-05-10T03:39:26.072974+0000","last_undegraded":"2024-05-10T03:39:26.072974+0000","last_fullsized":"2024-05-10T03:39:26.072974+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:58:37.881367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075200+0000","last_change":"2024-05-10T03:38:36.094209+0000","last_active":"2024-05-10T03:39:26.075200+0000","last_peered":"2024-05-10T03:39:26.075200+0000","last_clean":"2024-05-10T03:39:26.075200+0000","last_became_active":"2024-05-10T03:38:36.093447+0000","last_became_peered":"2024-05-10T03:38:36.093447+0000","last_unstale":"2024-05-10T03:39:26.075200+0000","last_undegraded":"2024-05-10T03:39:26.075200+0000","last_fullsized":"2024-05-10T03:39:26.075200+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:24:20.540340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077847+0000","last_change":"2024-05-10T03:38:36.587832+0000","last_active":"2024-05-10T03:39:26.077847+0000","last_peered":"2024-05-10T03:39:26.077847+0000","last_clean":"2024-05-10T03:39:26.077847+0000","last_became_active":"2024-05-10T03:38:36.587475+0000","last_became_peered":"2024-05-10T03:38:36.587475+0000","last_unstale":"2024-05-10T03:39:26.077847+0000","last_undegraded":"2024-05-10T03:39:26.077847+0000","last_fullsized":"2024-05-10T03:39:26.077847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:47:53.318634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076509+0000","last_change":"2024-05-10T03:38:41.150879+0000","last_active":"2024-05-10T03:39:26.076509+0000","last_peered":"2024-05-10T03:39:26.076509+0000","last_clean":"2024-05-10T03:39:26.076509+0000","last_became_active":"2024-05-10T03:38:41.150350+0000","last_became_peered":"2024-05-10T03:38:41.150350+0000","last_unstale":"2024-05-10T03:39:26.076509+0000","last_undegraded":"2024-05-10T03:39:26.076509+0000","last_fullsized":"2024-05-10T03:39:26.076509+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:47:32.429040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074172+0000","last_change":"2024-05-10T03:38:36.095933+0000","last_active":"2024-05-10T03:39:26.074172+0000","last_peered":"2024-05-10T03:39:26.074172+0000","last_clean":"2024-05-10T03:39:26.074172+0000","last_became_active":"2024-05-10T03:38:36.095592+0000","last_became_peered":"2024-05-10T03:38:36.095592+0000","last_unstale":"2024-05-10T03:39:26.074172+0000","last_undegraded":"2024-05-10T03:39:26.074172+0000","last_fullsized":"2024-05-10T03:39:26.074172+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:52:21.729051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072554+0000","last_change":"2024-05-10T03:38:36.591747+0000","last_active":"2024-05-10T03:39:26.072554+0000","last_peered":"2024-05-10T03:39:26.072554+0000","last_clean":"2024-05-10T03:39:26.072554+0000","last_became_active":"2024-05-10T03:38:36.591432+0000","last_became_peered":"2024-05-10T03:38:36.591432+0000","last_unstale":"2024-05-10T03:39:26.072554+0000","last_undegraded":"2024-05-10T03:39:26.072554+0000","last_fullsized":"2024-05-10T03:39:26.072554+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:20:37.549054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070521+0000","last_change":"2024-05-10T03:38:40.597535+0000","last_active":"2024-05-10T03:39:26.070521+0000","last_peered":"2024-05-10T03:39:26.070521+0000","last_clean":"2024-05-10T03:39:26.070521+0000","last_became_active":"2024-05-10T03:38:40.597108+0000","last_became_peered":"2024-05-10T03:38:40.597108+0000","last_unstale":"2024-05-10T03:39:26.070521+0000","last_undegraded":"2024-05-10T03:39:26.070521+0000","last_fullsized":"2024-05-10T03:39:26.070521+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:31:21.765071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":100,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:40:13.128914+0000","last_change":"2024-05-10T03:38:36.099238+0000","last_active":"2024-05-10T03:40:13.128914+0000","last_peered":"2024-05-10T03:40:13.128914+0000","last_clean":"2024-05-10T03:40:13.128914+0000","last_became_active":"2024-05-10T03:38:36.098761+0000","last_became_peered":"2024-05-10T03:38:36.098761+0000","last_unstale":"2024-05-10T03:40:13.128914+0000","last_undegraded":"2024-05-10T03:40:13.128914+0000","last_fullsized":"2024-05-10T03:40:13.128914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:08:49.892665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072990+0000","last_change":"2024-05-10T03:38:36.580983+0000","last_active":"2024-05-10T03:39:26.072990+0000","last_peered":"2024-05-10T03:39:26.072990+0000","last_clean":"2024-05-10T03:39:26.072990+0000","last_became_active":"2024-05-10T03:38:36.580252+0000","last_became_peered":"2024-05-10T03:38:36.580252+0000","last_unstale":"2024-05-10T03:39:26.072990+0000","last_undegraded":"2024-05-10T03:39:26.072990+0000","last_fullsized":"2024-05-10T03:39:26.072990+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:16.265473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070165+0000","last_change":"2024-05-10T03:38:41.148651+0000","last_active":"2024-05-10T03:39:26.070165+0000","last_peered":"2024-05-10T03:39:26.070165+0000","last_clean":"2024-05-10T03:39:26.070165+0000","last_became_active":"2024-05-10T03:38:41.148192+0000","last_became_peered":"2024-05-10T03:38:41.148192+0000","last_unstale":"2024-05-10T03:39:26.070165+0000","last_undegraded":"2024-05-10T03:39:26.070165+0000","last_fullsized":"2024-05-10T03:39:26.070165+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:13:38.795763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072565+0000","last_change":"2024-05-10T03:38:36.577839+0000","last_active":"2024-05-10T03:39:26.072565+0000","last_peered":"2024-05-10T03:39:26.072565+0000","last_clean":"2024-05-10T03:39:26.072565+0000","last_became_active":"2024-05-10T03:38:36.576917+0000","last_became_peered":"2024-05-10T03:38:36.576917+0000","last_unstale":"2024-05-10T03:39:26.072565+0000","last_undegraded":"2024-05-10T03:39:26.072565+0000","last_fullsized":"2024-05-10T03:39:26.072565+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:52:05.825241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":98,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:40:11.142797+0000","last_change":"2024-05-10T03:38:36.099138+0000","last_active":"2024-05-10T03:40:11.142797+0000","last_peered":"2024-05-10T03:40:11.142797+0000","last_clean":"2024-05-10T03:40:11.142797+0000","last_became_active":"2024-05-10T03:38:36.098747+0000","last_became_peered":"2024-05-10T03:38:36.098747+0000","last_unstale":"2024-05-10T03:40:11.142797+0000","last_undegraded":"2024-05-10T03:40:11.142797+0000","last_fullsized":"2024-05-10T03:40:11.142797+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:18.236383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":74,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078995+0000","last_change":"2024-05-10T03:38:40.605489+0000","last_active":"2024-05-10T03:39:26.078995+0000","last_peered":"2024-05-10T03:39:26.078995+0000","last_clean":"2024-05-10T03:39:26.078995+0000","last_became_active":"2024-05-10T03:38:40.605040+0000","last_became_peered":"2024-05-10T03:38:40.605040+0000","last_unstale":"2024-05-10T03:39:26.078995+0000","last_undegraded":"2024-05-10T03:39:26.078995+0000","last_fullsized":"2024-05-10T03:39:26.078995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:52:08.592132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077045+0000","last_change":"2024-05-10T03:38:36.589325+0000","last_active":"2024-05-10T03:39:26.077045+0000","last_peered":"2024-05-10T03:39:26.077045+0000","last_clean":"2024-05-10T03:39:26.077045+0000","last_became_active":"2024-05-10T03:38:36.588976+0000","last_became_peered":"2024-05-10T03:38:36.588976+0000","last_unstale":"2024-05-10T03:39:26.077045+0000","last_undegraded":"2024-05-10T03:39:26.077045+0000","last_fullsized":"2024-05-10T03:39:26.077045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:40.849614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067440+0000","last_change":"2024-05-10T03:38:36.093701+0000","last_active":"2024-05-10T03:39:26.067440+0000","last_peered":"2024-05-10T03:39:26.067440+0000","last_clean":"2024-05-10T03:39:26.067440+0000","last_became_active":"2024-05-10T03:38:36.093362+0000","last_became_peered":"2024-05-10T03:38:36.093362+0000","last_unstale":"2024-05-10T03:39:26.067440+0000","last_undegraded":"2024-05-10T03:39:26.067440+0000","last_fullsized":"2024-05-10T03:39:26.067440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:42:00.208900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":330,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078251+0000","last_change":"2024-05-10T03:37:46.762875+0000","last_active":"2024-05-10T03:39:26.078251+0000","last_peered":"2024-05-10T03:39:26.078251+0000","last_clean":"2024-05-10T03:39:26.078251+0000","last_became_active":"2024-05-10T03:37:46.762448+0000","last_became_peered":"2024-05-10T03:37:46.762448+0000","last_unstale":"2024-05-10T03:39:26.078251+0000","last_undegraded":"2024-05-10T03:39:26.078251+0000","last_fullsized":"2024-05-10T03:39:26.078251+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:35:20.340567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:35:20.340567+0000","last_clean_scrub_stamp":"2024-05-10T03:35:20.340567+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:09:05.491303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073007+0000","last_change":"2024-05-10T03:38:41.150966+0000","last_active":"2024-05-10T03:39:26.073007+0000","last_peered":"2024-05-10T03:39:26.073007+0000","last_clean":"2024-05-10T03:39:26.073007+0000","last_became_active":"2024-05-10T03:38:41.150505+0000","last_became_peered":"2024-05-10T03:38:41.150505+0000","last_unstale":"2024-05-10T03:39:26.073007+0000","last_undegraded":"2024-05-10T03:39:26.073007+0000","last_fullsized":"2024-05-10T03:39:26.073007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:53.992369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.069834+0000","last_change":"2024-05-10T03:38:36.577457+0000","last_active":"2024-05-10T03:39:26.069834+0000","last_peered":"2024-05-10T03:39:26.069834+0000","last_clean":"2024-05-10T03:39:26.069834+0000","last_became_active":"2024-05-10T03:38:36.577105+0000","last_became_peered":"2024-05-10T03:38:36.577105+0000","last_unstale":"2024-05-10T03:39:26.069834+0000","last_undegraded":"2024-05-10T03:39:26.069834+0000","last_fullsized":"2024-05-10T03:39:26.069834+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:34:15.611496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078317+0000","last_change":"2024-05-10T03:38:36.094057+0000","last_active":"2024-05-10T03:39:26.078317+0000","last_peered":"2024-05-10T03:39:26.078317+0000","last_clean":"2024-05-10T03:39:26.078317+0000","last_became_active":"2024-05-10T03:38:36.093705+0000","last_became_peered":"2024-05-10T03:38:36.093705+0000","last_unstale":"2024-05-10T03:39:26.078317+0000","last_undegraded":"2024-05-10T03:39:26.078317+0000","last_fullsized":"2024-05-10T03:39:26.078317+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:00:10.138524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077005+0000","last_change":"2024-05-10T03:38:40.603522+0000","last_active":"2024-05-10T03:39:26.077005+0000","last_peered":"2024-05-10T03:39:26.077005+0000","last_clean":"2024-05-10T03:39:26.077005+0000","last_became_active":"2024-05-10T03:38:40.603058+0000","last_became_peered":"2024-05-10T03:38:40.603058+0000","last_unstale":"2024-05-10T03:39:26.077005+0000","last_undegraded":"2024-05-10T03:39:26.077005+0000","last_fullsized":"2024-05-10T03:39:26.077005+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:15:06.869163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075656+0000","last_change":"2024-05-10T03:38:36.099009+0000","last_active":"2024-05-10T03:39:26.075656+0000","last_peered":"2024-05-10T03:39:26.075656+0000","last_clean":"2024-05-10T03:39:26.075656+0000","last_became_active":"2024-05-10T03:38:36.098695+0000","last_became_peered":"2024-05-10T03:38:36.098695+0000","last_unstale":"2024-05-10T03:39:26.075656+0000","last_undegraded":"2024-05-10T03:39:26.075656+0000","last_fullsized":"2024-05-10T03:39:26.075656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:06.634752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070881+0000","last_change":"2024-05-10T03:38:36.576498+0000","last_active":"2024-05-10T03:39:26.070881+0000","last_peered":"2024-05-10T03:39:26.070881+0000","last_clean":"2024-05-10T03:39:26.070881+0000","last_became_active":"2024-05-10T03:38:36.576161+0000","last_became_peered":"2024-05-10T03:38:36.576161+0000","last_unstale":"2024-05-10T03:39:26.070881+0000","last_undegraded":"2024-05-10T03:39:26.070881+0000","last_fullsized":"2024-05-10T03:39:26.070881+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:09.353279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076991+0000","last_change":"2024-05-10T03:38:41.148317+0000","last_active":"2024-05-10T03:39:26.076991+0000","last_peered":"2024-05-10T03:39:26.076991+0000","last_clean":"2024-05-10T03:39:26.076991+0000","last_became_active":"2024-05-10T03:38:41.147907+0000","last_became_peered":"2024-05-10T03:38:41.147907+0000","last_unstale":"2024-05-10T03:39:26.076991+0000","last_undegraded":"2024-05-10T03:39:26.076991+0000","last_fullsized":"2024-05-10T03:39:26.076991+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:23:08.157296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'9","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074498+0000","last_change":"2024-05-10T03:38:36.096437+0000","last_active":"2024-05-10T03:39:26.074498+0000","last_peered":"2024-05-10T03:39:26.074498+0000","last_clean":"2024-05-10T03:39:26.074498+0000","last_became_active":"2024-05-10T03:38:36.096122+0000","last_became_peered":"2024-05-10T03:38:36.096122+0000","last_unstale":"2024-05-10T03:39:26.074498+0000","last_undegraded":"2024-05-10T03:39:26.074498+0000","last_fullsized":"2024-05-10T03:39:26.074498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:47:02.400065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077474+0000","last_change":"2024-05-10T03:38:36.574022+0000","last_active":"2024-05-10T03:39:26.077474+0000","last_peered":"2024-05-10T03:39:26.077474+0000","last_clean":"2024-05-10T03:39:26.077474+0000","last_became_active":"2024-05-10T03:38:36.573530+0000","last_became_peered":"2024-05-10T03:38:36.573530+0000","last_unstale":"2024-05-10T03:39:26.077474+0000","last_undegraded":"2024-05-10T03:39:26.077474+0000","last_fullsized":"2024-05-10T03:39:26.077474+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:35:32.574897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072099+0000","last_change":"2024-05-10T03:38:40.600341+0000","last_active":"2024-05-10T03:39:26.072099+0000","last_peered":"2024-05-10T03:39:26.072099+0000","last_clean":"2024-05-10T03:39:26.072099+0000","last_became_active":"2024-05-10T03:38:40.599944+0000","last_became_peered":"2024-05-10T03:38:40.599944+0000","last_unstale":"2024-05-10T03:39:26.072099+0000","last_undegraded":"2024-05-10T03:39:26.072099+0000","last_fullsized":"2024-05-10T03:39:26.072099+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:12:01.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067765+0000","last_change":"2024-05-10T03:38:36.091020+0000","last_active":"2024-05-10T03:39:26.067765+0000","last_peered":"2024-05-10T03:39:26.067765+0000","last_clean":"2024-05-10T03:39:26.067765+0000","last_became_active":"2024-05-10T03:38:36.090699+0000","last_became_peered":"2024-05-10T03:38:36.090699+0000","last_unstale":"2024-05-10T03:39:26.067765+0000","last_undegraded":"2024-05-10T03:39:26.067765+0000","last_fullsized":"2024-05-10T03:39:26.067765+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:44:12.546166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067252+0000","last_change":"2024-05-10T03:38:36.584279+0000","last_active":"2024-05-10T03:39:26.067252+0000","last_peered":"2024-05-10T03:39:26.067252+0000","last_clean":"2024-05-10T03:39:26.067252+0000","last_became_active":"2024-05-10T03:38:36.583897+0000","last_became_peered":"2024-05-10T03:38:36.583897+0000","last_unstale":"2024-05-10T03:39:26.067252+0000","last_undegraded":"2024-05-10T03:39:26.067252+0000","last_fullsized":"2024-05-10T03:39:26.067252+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:33:17.210334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067474+0000","last_change":"2024-05-10T03:38:41.151023+0000","last_active":"2024-05-10T03:39:26.067474+0000","last_peered":"2024-05-10T03:39:26.067474+0000","last_clean":"2024-05-10T03:39:26.067474+0000","last_became_active":"2024-05-10T03:38:41.150489+0000","last_became_peered":"2024-05-10T03:38:41.150489+0000","last_unstale":"2024-05-10T03:39:26.067474+0000","last_undegraded":"2024-05-10T03:39:26.067474+0000","last_fullsized":"2024-05-10T03:39:26.067474+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:57:57.440139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074840+0000","last_change":"2024-05-10T03:38:36.098990+0000","last_active":"2024-05-10T03:39:26.074840+0000","last_peered":"2024-05-10T03:39:26.074840+0000","last_clean":"2024-05-10T03:39:26.074840+0000","last_became_active":"2024-05-10T03:38:36.098649+0000","last_became_peered":"2024-05-10T03:38:36.098649+0000","last_unstale":"2024-05-10T03:39:26.074840+0000","last_undegraded":"2024-05-10T03:39:26.074840+0000","last_fullsized":"2024-05-10T03:39:26.074840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:38:09.915041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075102+0000","last_change":"2024-05-10T03:38:36.581286+0000","last_active":"2024-05-10T03:39:26.075102+0000","last_peered":"2024-05-10T03:39:26.075102+0000","last_clean":"2024-05-10T03:39:26.075102+0000","last_became_active":"2024-05-10T03:38:36.580927+0000","last_became_peered":"2024-05-10T03:38:36.580927+0000","last_unstale":"2024-05-10T03:39:26.075102+0000","last_undegraded":"2024-05-10T03:39:26.075102+0000","last_fullsized":"2024-05-10T03:39:26.075102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:10:38.663239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074691+0000","last_change":"2024-05-10T03:38:40.605668+0000","last_active":"2024-05-10T03:39:26.074691+0000","last_peered":"2024-05-10T03:39:26.074691+0000","last_clean":"2024-05-10T03:39:26.074691+0000","last_became_active":"2024-05-10T03:38:40.605156+0000","last_became_peered":"2024-05-10T03:38:40.605156+0000","last_unstale":"2024-05-10T03:39:26.074691+0000","last_undegraded":"2024-05-10T03:39:26.074691+0000","last_fullsized":"2024-05-10T03:39:26.074691+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:28:07.192875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077182+0000","last_change":"2024-05-10T03:38:36.090250+0000","last_active":"2024-05-10T03:39:26.077182+0000","last_peered":"2024-05-10T03:39:26.077182+0000","last_clean":"2024-05-10T03:39:26.077182+0000","last_became_active":"2024-05-10T03:38:36.089899+0000","last_became_peered":"2024-05-10T03:38:36.089899+0000","last_unstale":"2024-05-10T03:39:26.077182+0000","last_undegraded":"2024-05-10T03:39:26.077182+0000","last_fullsized":"2024-05-10T03:39:26.077182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:01:19.322065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076480+0000","last_change":"2024-05-10T03:38:36.575272+0000","last_active":"2024-05-10T03:39:26.076480+0000","last_peered":"2024-05-10T03:39:26.076480+0000","last_clean":"2024-05-10T03:39:26.076480+0000","last_became_active":"2024-05-10T03:38:36.574919+0000","last_became_peered":"2024-05-10T03:38:36.574919+0000","last_unstale":"2024-05-10T03:39:26.076480+0000","last_undegraded":"2024-05-10T03:39:26.076480+0000","last_fullsized":"2024-05-10T03:39:26.076480+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:51:33.825933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067385+0000","last_change":"2024-05-10T03:38:40.609082+0000","last_active":"2024-05-10T03:39:26.067385+0000","last_peered":"2024-05-10T03:39:26.067385+0000","last_clean":"2024-05-10T03:39:26.067385+0000","last_became_active":"2024-05-10T03:38:40.608636+0000","last_became_peered":"2024-05-10T03:38:40.608636+0000","last_unstale":"2024-05-10T03:39:26.067385+0000","last_undegraded":"2024-05-10T03:39:26.067385+0000","last_fullsized":"2024-05-10T03:39:26.067385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:18:05.288472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.071676+0000","last_change":"2024-05-10T03:38:36.101001+0000","last_active":"2024-05-10T03:39:26.071676+0000","last_peered":"2024-05-10T03:39:26.071676+0000","last_clean":"2024-05-10T03:39:26.071676+0000","last_became_active":"2024-05-10T03:38:36.100658+0000","last_became_peered":"2024-05-10T03:38:36.100658+0000","last_unstale":"2024-05-10T03:39:26.071676+0000","last_undegraded":"2024-05-10T03:39:26.071676+0000","last_fullsized":"2024-05-10T03:39:26.071676+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:15:51.963956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077340+0000","last_change":"2024-05-10T03:38:36.579314+0000","last_active":"2024-05-10T03:39:26.077340+0000","last_peered":"2024-05-10T03:39:26.077340+0000","last_clean":"2024-05-10T03:39:26.077340+0000","last_became_active":"2024-05-10T03:38:36.578747+0000","last_became_peered":"2024-05-10T03:38:36.578747+0000","last_unstale":"2024-05-10T03:39:26.077340+0000","last_undegraded":"2024-05-10T03:39:26.077340+0000","last_fullsized":"2024-05-10T03:39:26.077340+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:05:25.814887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067380+0000","last_change":"2024-05-10T03:38:41.149022+0000","last_active":"2024-05-10T03:39:26.067380+0000","last_peered":"2024-05-10T03:39:26.067380+0000","last_clean":"2024-05-10T03:39:26.067380+0000","last_became_active":"2024-05-10T03:38:41.148606+0000","last_became_peered":"2024-05-10T03:38:41.148606+0000","last_unstale":"2024-05-10T03:39:26.067380+0000","last_undegraded":"2024-05-10T03:39:26.067380+0000","last_fullsized":"2024-05-10T03:39:26.067380+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:24.039761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.088000+0000","last_change":"2024-05-10T03:39:27.088000+0000","last_active":"2024-05-10T03:39:27.088000+0000","last_peered":"2024-05-10T03:39:27.088000+0000","last_clean":"2024-05-10T03:39:27.088000+0000","last_became_active":"2024-05-10T03:39:27.078679+0000","last_became_peered":"2024-05-10T03:39:27.078679+0000","last_unstale":"2024-05-10T03:39:27.088000+0000","last_undegraded":"2024-05-10T03:39:27.088000+0000","last_fullsized":"2024-05-10T03:39:27.088000+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:32.644494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078840+0000","last_change":"2024-05-10T03:38:36.587225+0000","last_active":"2024-05-10T03:39:26.078840+0000","last_peered":"2024-05-10T03:39:26.078840+0000","last_clean":"2024-05-10T03:39:26.078840+0000","last_became_active":"2024-05-10T03:38:36.586906+0000","last_became_peered":"2024-05-10T03:38:36.586906+0000","last_unstale":"2024-05-10T03:39:26.078840+0000","last_undegraded":"2024-05-10T03:39:26.078840+0000","last_fullsized":"2024-05-10T03:39:26.078840+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:07.128604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075048+0000","last_change":"2024-05-10T03:38:40.600918+0000","last_active":"2024-05-10T03:39:26.075048+0000","last_peered":"2024-05-10T03:39:26.075048+0000","last_clean":"2024-05-10T03:39:26.075048+0000","last_became_active":"2024-05-10T03:38:40.600508+0000","last_became_peered":"2024-05-10T03:38:40.600508+0000","last_unstale":"2024-05-10T03:39:26.075048+0000","last_undegraded":"2024-05-10T03:39:26.075048+0000","last_fullsized":"2024-05-10T03:39:26.075048+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:02:59.589310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"88'6","reported_seq":102,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:40:13.129920+0000","last_change":"2024-05-10T03:38:36.100013+0000","last_active":"2024-05-10T03:40:13.129920+0000","last_peered":"2024-05-10T03:40:13.129920+0000","last_clean":"2024-05-10T03:40:13.129920+0000","last_became_active":"2024-05-10T03:38:36.099581+0000","last_became_peered":"2024-05-10T03:38:36.099581+0000","last_unstale":"2024-05-10T03:40:13.129920+0000","last_undegraded":"2024-05-10T03:40:13.129920+0000","last_fullsized":"2024-05-10T03:40:13.129920+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:07.195555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1436,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.079287+0000","last_change":"2024-05-10T03:38:36.586813+0000","last_active":"2024-05-10T03:39:26.079287+0000","last_peered":"2024-05-10T03:39:26.079287+0000","last_clean":"2024-05-10T03:39:26.079287+0000","last_became_active":"2024-05-10T03:38:36.586264+0000","last_became_peered":"2024-05-10T03:38:36.586264+0000","last_unstale":"2024-05-10T03:39:26.079287+0000","last_undegraded":"2024-05-10T03:39:26.079287+0000","last_fullsized":"2024-05-10T03:39:26.079287+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:57:06.239509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.066683+0000","last_change":"2024-05-10T03:38:40.606897+0000","last_active":"2024-05-10T03:39:26.066683+0000","last_peered":"2024-05-10T03:39:26.066683+0000","last_clean":"2024-05-10T03:39:26.066683+0000","last_became_active":"2024-05-10T03:38:40.606339+0000","last_became_peered":"2024-05-10T03:38:40.606339+0000","last_unstale":"2024-05-10T03:39:26.066683+0000","last_undegraded":"2024-05-10T03:39:26.066683+0000","last_fullsized":"2024-05-10T03:39:26.066683+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:13.706744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074765+0000","last_change":"2024-05-10T03:38:36.100689+0000","last_active":"2024-05-10T03:39:26.074765+0000","last_peered":"2024-05-10T03:39:26.074765+0000","last_clean":"2024-05-10T03:39:26.074765+0000","last_became_active":"2024-05-10T03:38:36.100352+0000","last_became_peered":"2024-05-10T03:38:36.100352+0000","last_unstale":"2024-05-10T03:39:26.074765+0000","last_undegraded":"2024-05-10T03:39:26.074765+0000","last_fullsized":"2024-05-10T03:39:26.074765+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:53:45.926237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.266329+0000","last_change":"2024-05-10T03:39:27.266329+0000","last_active":"2024-05-10T03:39:27.266329+0000","last_peered":"2024-05-10T03:39:27.266329+0000","last_clean":"2024-05-10T03:39:27.266329+0000","last_became_active":"2024-05-10T03:39:27.265905+0000","last_became_peered":"2024-05-10T03:39:27.265905+0000","last_unstale":"2024-05-10T03:39:27.266329+0000","last_undegraded":"2024-05-10T03:39:27.266329+0000","last_fullsized":"2024-05-10T03:39:27.266329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:24.604276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,8],"acting":[7,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072213+0000","last_change":"2024-05-10T03:38:40.600719+0000","last_active":"2024-05-10T03:39:26.072213+0000","last_peered":"2024-05-10T03:39:26.072213+0000","last_clean":"2024-05-10T03:39:26.072213+0000","last_became_active":"2024-05-10T03:38:40.600240+0000","last_became_peered":"2024-05-10T03:38:40.600240+0000","last_unstale":"2024-05-10T03:39:26.072213+0000","last_undegraded":"2024-05-10T03:39:26.072213+0000","last_fullsized":"2024-05-10T03:39:26.072213+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:41:47.877298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070778+0000","last_change":"2024-05-10T03:38:36.097691+0000","last_active":"2024-05-10T03:39:26.070778+0000","last_peered":"2024-05-10T03:39:26.070778+0000","last_clean":"2024-05-10T03:39:26.070778+0000","last_became_active":"2024-05-10T03:38:36.097266+0000","last_became_peered":"2024-05-10T03:38:36.097266+0000","last_unstale":"2024-05-10T03:39:26.070778+0000","last_undegraded":"2024-05-10T03:39:26.070778+0000","last_fullsized":"2024-05-10T03:39:26.070778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:27:57.272780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.079029+0000","last_change":"2024-05-10T03:38:36.575475+0000","last_active":"2024-05-10T03:39:26.079029+0000","last_peered":"2024-05-10T03:39:26.079029+0000","last_clean":"2024-05-10T03:39:26.079029+0000","last_became_active":"2024-05-10T03:38:36.575047+0000","last_became_peered":"2024-05-10T03:38:36.575047+0000","last_unstale":"2024-05-10T03:39:26.079029+0000","last_undegraded":"2024-05-10T03:39:26.079029+0000","last_fullsized":"2024-05-10T03:39:26.079029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:31:53.846070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077134+0000","last_change":"2024-05-10T03:38:36.585491+0000","last_active":"2024-05-10T03:39:26.077134+0000","last_peered":"2024-05-10T03:39:26.077134+0000","last_clean":"2024-05-10T03:39:26.077134+0000","last_became_active":"2024-05-10T03:38:36.585147+0000","last_became_peered":"2024-05-10T03:38:36.585147+0000","last_unstale":"2024-05-10T03:39:26.077134+0000","last_undegraded":"2024-05-10T03:39:26.077134+0000","last_fullsized":"2024-05-10T03:39:26.077134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:22.350420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072517+0000","last_change":"2024-05-10T03:38:36.584092+0000","last_active":"2024-05-10T03:39:26.072517+0000","last_peered":"2024-05-10T03:39:26.072517+0000","last_clean":"2024-05-10T03:39:26.072517+0000","last_became_active":"2024-05-10T03:38:36.583749+0000","last_became_peered":"2024-05-10T03:38:36.583749+0000","last_unstale":"2024-05-10T03:39:26.072517+0000","last_undegraded":"2024-05-10T03:39:26.072517+0000","last_fullsized":"2024-05-10T03:39:26.072517+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:10.882170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.071548+0000","last_change":"2024-05-10T03:38:36.573718+0000","last_active":"2024-05-10T03:39:26.071548+0000","last_peered":"2024-05-10T03:39:26.071548+0000","last_clean":"2024-05-10T03:39:26.071548+0000","last_became_active":"2024-05-10T03:38:36.573271+0000","last_became_peered":"2024-05-10T03:38:36.573271+0000","last_unstale":"2024-05-10T03:39:26.071548+0000","last_undegraded":"2024-05-10T03:39:26.071548+0000","last_fullsized":"2024-05-10T03:39:26.071548+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:38:13.798068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067000+0000","last_change":"2024-05-10T03:38:36.576975+0000","last_active":"2024-05-10T03:39:26.067000+0000","last_peered":"2024-05-10T03:39:26.067000+0000","last_clean":"2024-05-10T03:39:26.067000+0000","last_became_active":"2024-05-10T03:38:36.576640+0000","last_became_peered":"2024-05-10T03:38:36.576640+0000","last_unstale":"2024-05-10T03:39:26.067000+0000","last_undegraded":"2024-05-10T03:39:26.067000+0000","last_fullsized":"2024-05-10T03:39:26.067000+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:48:42.975793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.077884+0000","last_change":"2024-05-10T03:39:27.077884+0000","last_active":"2024-05-10T03:39:27.077884+0000","last_peered":"2024-05-10T03:39:27.077884+0000","last_clean":"2024-05-10T03:39:27.077884+0000","last_became_active":"2024-05-10T03:39:27.077475+0000","last_became_peered":"2024-05-10T03:39:27.077475+0000","last_unstale":"2024-05-10T03:39:27.077884+0000","last_undegraded":"2024-05-10T03:39:27.077884+0000","last_fullsized":"2024-05-10T03:39:27.077884+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:21:35.216448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076864+0000","last_change":"2024-05-10T03:38:36.589262+0000","last_active":"2024-05-10T03:39:26.076864+0000","last_peered":"2024-05-10T03:39:26.076864+0000","last_clean":"2024-05-10T03:39:26.076864+0000","last_became_active":"2024-05-10T03:38:36.588950+0000","last_became_peered":"2024-05-10T03:38:36.588950+0000","last_unstale":"2024-05-10T03:39:26.076864+0000","last_undegraded":"2024-05-10T03:39:26.076864+0000","last_fullsized":"2024-05-10T03:39:26.076864+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:08:43.124035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074184+0000","last_change":"2024-05-10T03:38:36.590472+0000","last_active":"2024-05-10T03:39:26.074184+0000","last_peered":"2024-05-10T03:39:26.074184+0000","last_clean":"2024-05-10T03:39:26.074184+0000","last_became_active":"2024-05-10T03:38:36.590115+0000","last_became_peered":"2024-05-10T03:38:36.590115+0000","last_unstale":"2024-05-10T03:39:26.074184+0000","last_undegraded":"2024-05-10T03:39:26.074184+0000","last_fullsized":"2024-05-10T03:39:26.074184+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:33:37.982529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077634+0000","last_change":"2024-05-10T03:38:36.575958+0000","last_active":"2024-05-10T03:39:26.077634+0000","last_peered":"2024-05-10T03:39:26.077634+0000","last_clean":"2024-05-10T03:39:26.077634+0000","last_became_active":"2024-05-10T03:38:36.572958+0000","last_became_peered":"2024-05-10T03:38:36.572958+0000","last_unstale":"2024-05-10T03:39:26.077634+0000","last_undegraded":"2024-05-10T03:39:26.077634+0000","last_fullsized":"2024-05-10T03:39:26.077634+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:30:39.111371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072295+0000","last_change":"2024-05-10T03:38:36.578225+0000","last_active":"2024-05-10T03:39:26.072295+0000","last_peered":"2024-05-10T03:39:26.072295+0000","last_clean":"2024-05-10T03:39:26.072295+0000","last_became_active":"2024-05-10T03:38:36.575920+0000","last_became_peered":"2024-05-10T03:38:36.575920+0000","last_unstale":"2024-05-10T03:39:26.072295+0000","last_undegraded":"2024-05-10T03:39:26.072295+0000","last_fullsized":"2024-05-10T03:39:26.072295+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:54:53.999971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077198+0000","last_change":"2024-05-10T03:38:36.577720+0000","last_active":"2024-05-10T03:39:26.077198+0000","last_peered":"2024-05-10T03:39:26.077198+0000","last_clean":"2024-05-10T03:39:26.077198+0000","last_became_active":"2024-05-10T03:38:36.577360+0000","last_became_peered":"2024-05-10T03:38:36.577360+0000","last_unstale":"2024-05-10T03:39:26.077198+0000","last_undegraded":"2024-05-10T03:39:26.077198+0000","last_fullsized":"2024-05-10T03:39:26.077198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:35:59.787050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075148+0000","last_change":"2024-05-10T03:38:36.588941+0000","last_active":"2024-05-10T03:39:26.075148+0000","last_peered":"2024-05-10T03:39:26.075148+0000","last_clean":"2024-05-10T03:39:26.075148+0000","last_became_active":"2024-05-10T03:38:36.587884+0000","last_became_peered":"2024-05-10T03:38:36.587884+0000","last_unstale":"2024-05-10T03:39:26.075148+0000","last_undegraded":"2024-05-10T03:39:26.075148+0000","last_fullsized":"2024-05-10T03:39:26.075148+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:26:10.064473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070771+0000","last_change":"2024-05-10T03:38:36.578917+0000","last_active":"2024-05-10T03:39:26.070771+0000","last_peered":"2024-05-10T03:39:26.070771+0000","last_clean":"2024-05-10T03:39:26.070771+0000","last_became_active":"2024-05-10T03:38:36.578508+0000","last_became_peered":"2024-05-10T03:38:36.578508+0000","last_unstale":"2024-05-10T03:39:26.070771+0000","last_undegraded":"2024-05-10T03:39:26.070771+0000","last_fullsized":"2024-05-10T03:39:26.070771+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:47.670854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077705+0000","last_change":"2024-05-10T03:38:36.578410+0000","last_active":"2024-05-10T03:39:26.077705+0000","last_peered":"2024-05-10T03:39:26.077705+0000","last_clean":"2024-05-10T03:39:26.077705+0000","last_became_active":"2024-05-10T03:38:36.578055+0000","last_became_peered":"2024-05-10T03:38:36.578055+0000","last_unstale":"2024-05-10T03:39:26.077705+0000","last_undegraded":"2024-05-10T03:39:26.077705+0000","last_fullsized":"2024-05-10T03:39:26.077705+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:39:03.551019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74877,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":784,"num_read_kb":468,"num_write":239,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":63894,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":229671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514526,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":999424,"data_stored":488705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.60599999999999998,"15min":0.57999999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":3.4089999999999998,"5min":3.4089999999999998,"15min":3.4089999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.56000000000000005,"15min":0.54900000000000004},"min":{"1min":0.44500000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.46500000000000002}]},{"osd":1,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67100000000000004,"15min":0.66600000000000004},"min":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51000000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83499999999999996,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.73199999999999998}]},{"osd":2,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.39800000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.67000000000000004,"5min":1.095,"15min":1.095},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.375,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":4,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.55400000000000005,"5min":0.433,"15min":0.433},"max":{"1min":0.91100000000000003,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.85399999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.66000000000000003}]},{"osd":5,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.64100000000000001,"15min":0.64900000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78200000000000003,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.71099999999999997,"15min":0.71599999999999997},"min":{"1min":0.46400000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.49399999999999999}]},{"osd":6,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.73999999999999999,"15min":0.72899999999999998},"min":{"1min":0.54900000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.56699999999999995},{"interface":"front","average":{"1min":1.236,"5min":0.84599999999999997,"15min":0.78100000000000003},"min":{"1min":0.51000000000000001,"5min":0.495,"15min":0.495},"max":{"1min":9.4440000000000008,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.83699999999999997,"15min":0.83599999999999997},"min":{"1min":0.68300000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.024,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.84799999999999998,"15min":0.85399999999999998},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.95999999999999996,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.69999999999999996}]},{"osd":8,"last update":"Fri May 10 03:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.63},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.82399999999999995}]},{"osd":9,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":0.92400000000000004,"15min":0.85599999999999998},"min":{"1min":0.67900000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":9.6400000000000006,"5min":9.6400000000000006,"15min":9.6400000000000006},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.006,"5min":0.878,"15min":0.85599999999999998},"min":{"1min":0.70899999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":3.371,"5min":3.371,"15min":3.371},"last":0.64400000000000002}]},{"osd":10,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.88,"15min":0.88100000000000001},"min":{"1min":0.76900000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.0329999999999999,"5min":1.379,"15min":1.379},"last":0.754},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.84799999999999998,"15min":0.84999999999999998},"min":{"1min":0.66100000000000003,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.052,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.85099999999999998}]}]},{"osd":10,"up_from":69,"seq":296352743458,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28672,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716480,"statfs":{"total":95995035648,"available":95965675520,"internally_reserved":0,"allocated":1695744,"data_stored":1142565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46500000000000002,"15min":0.46400000000000002},"min":{"1min":0.32900000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.38200000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68999999999999995,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.372}]},{"osd":2,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.62,"15min":0.61599999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.81699999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.48399999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.50600000000000001}]},{"osd":3,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.625,"15min":0.63300000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74299999999999999,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64500000000000002,"15min":0.64900000000000002},"min":{"1min":0.49099999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86099999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.442}]},{"osd":4,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.37,"5min":0.313,"15min":0.313},"max":{"1min":0.77800000000000002,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.433,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78100000000000003,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.52300000000000002}]},{"osd":5,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68200000000000005,"15min":0.68000000000000005},"min":{"1min":0.52100000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69999999999999996,"15min":0.69799999999999995},"min":{"1min":0.437,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95599999999999996,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.76100000000000001,"15min":0.77000000000000002},"min":{"1min":0.53500000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.012,"5min":1.026,"15min":1.026},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73799999999999999,"15min":0.73699999999999999},"min":{"1min":0.58799999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.622}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":8,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76200000000000001,"15min":0.76000000000000001},"min":{"1min":0.55800000000000005,"5min":0.498,"15min":0.498},"max":{"1min":0.94499999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.57899999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.99199999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.73399999999999999}]},{"osd":9,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81200000000000006,"15min":0.81399999999999995},"min":{"1min":0.61199999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.97599999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.81999999999999995,"15min":0.82799999999999996},"min":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.90900000000000003,"5min":1.216,"15min":1.216},"last":3.3780000000000001}]},{"osd":11,"last update":"Fri May 10 03:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.59999999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.92400000000000004,"5min":1.169,"15min":1.169},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79600000000000004,"15min":0.80000000000000004},"min":{"1min":0.56799999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.91800000000000004,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.65800000000000003}]}]},{"osd":9,"up_from":64,"seq":274877906982,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":1024000,"data_stored":491883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36043201},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.53900000000000003,"15min":0.55100000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.63600000000000001,"5min":0.879,"15min":0.879},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.57599999999999996,"15min":0.58799999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.93899999999999995,"5min":1.171,"15min":1.171},"last":0.42799999999999999}]},{"osd":1,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67600000000000005,"15min":0.67700000000000005},"min":{"1min":0.40699999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96999999999999997,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71299999999999997,"15min":0.72499999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.77500000000000002,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.68899999999999995}]},{"osd":2,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.76200000000000001,"15min":0.78400000000000003},"min":{"1min":0.52600000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.76900000000000002,"5min":1.137,"15min":1.137},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.78500000000000003,"15min":0.80800000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.84599999999999997,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.45400000000000001}]},{"osd":3,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.68500000000000005,"15min":0.70199999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.65000000000000002,"15min":0.67100000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.46300000000000002}]},{"osd":4,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88300000000000001,"5min":1.147,"15min":1.147},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76200000000000001,"15min":0.76600000000000001},"min":{"1min":0.54700000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.88100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.83899999999999997,"15min":0.85899999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.86699999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.502},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.86299999999999999,"15min":0.89200000000000002},"min":{"1min":0.54700000000000004,"5min":0.501,"15min":0.501},"max":{"1min":0.90500000000000003,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.65500000000000003}]},{"osd":6,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.51100000000000001}]},{"osd":7,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.91200000000000003,"15min":0.93799999999999994},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.997,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.94099999999999995,"15min":0.96899999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0169999999999999,"5min":1.377,"15min":1.377},"last":0.78100000000000003}]},{"osd":8,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.94799999999999995,"15min":0.98199999999999998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.92500000000000004,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.98599999999999999,"15min":1.01},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1140000000000001,"5min":1.579,"15min":1.579},"last":0.64200000000000002}]},{"osd":10,"last update":"Fri May 10 03:39:46 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.91600000000000004,"15min":0.93799999999999994},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0569999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.95499999999999996,"15min":0.96699999999999997},"min":{"1min":0.73699999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.093,"5min":1.385,"15min":1.385},"last":0.70699999999999996}]},{"osd":11,"last update":"Fri May 10 03:39:41 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.85499999999999998}]}]},{"osd":8,"up_from":57,"seq":244813135913,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1007616,"data_stored":487252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.40899999999999997}]},{"osd":1,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64300000000000002,"15min":0.64200000000000002},"min":{"1min":0.46200000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75700000000000001,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.69299999999999995}]},{"osd":2,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.47199999999999998,"15min":0.46600000000000003},"min":{"1min":0.35199999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.499,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71099999999999997,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.44}]},{"osd":3,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81799999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":3.7629999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.62,"15min":0.61299999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.625,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84599999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.68400000000000005,"15min":0.67900000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.627}]},{"osd":5,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":0.60699999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78800000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.37},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.497}]},{"osd":6,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.67000000000000004,"15min":0.66100000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71799999999999997,"15min":0.71699999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90500000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.58799999999999997}]},{"osd":7,"last update":"Fri May 10 03:39:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.52700000000000002,"5min":0.498,"15min":0.498},"max":{"1min":0.90400000000000003,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.58499999999999996,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0009999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.77000000000000002}]},{"osd":9,"last update":"Fri May 10 03:39:30 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.749,"15min":0.73299999999999998},"min":{"1min":0.61199999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.75600000000000001,"15min":0.73799999999999999},"min":{"1min":0.67500000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.70899999999999996}]},{"osd":10,"last update":"Fri May 10 03:39:49 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.79000000000000004,"15min":0.77400000000000002},"min":{"1min":0.68200000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.79400000000000004,"15min":0.77800000000000002},"min":{"1min":0.70699999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.113,"5min":1.127,"15min":1.127},"last":0.755}]},{"osd":11,"last update":"Fri May 10 03:39:39 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.66900000000000004}]}]},{"osd":7,"up_from":50,"seq":214748364845,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28596,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716556,"statfs":{"total":95995035648,"available":95965753344,"internally_reserved":0,"allocated":1613824,"data_stored":1084520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:37:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.437},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.502}]},{"osd":1,"last update":"Fri May 10 03:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.439,"15min":0.42899999999999999},"min":{"1min":0.311,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.55200000000000005,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.46000000000000002,"15min":0.44900000000000001},"min":{"1min":0.38400000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69999999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri May 10 03:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.46000000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.65600000000000003,"15min":0.626},"min":{"1min":0.52700000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95599999999999996,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.72899999999999998}]},{"osd":3,"last update":"Fri May 10 03:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.621,"15min":0.629},"min":{"1min":0.44600000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.86099999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.439,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.80400000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.628}]},{"osd":4,"last update":"Fri May 10 03:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35299999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69099999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.38400000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69199999999999995,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.46999999999999997}]},{"osd":5,"last update":"Fri May 10 03:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.69599999999999995,"15min":0.66100000000000003},"min":{"1min":0.54300000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90600000000000003,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.68999999999999995,"15min":0.66000000000000003},"min":{"1min":0.51700000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.878,"5min":2.806,"15min":2.806},"last":0.67100000000000004}]},{"osd":6,"last update":"Fri May 10 03:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70499999999999996,"15min":0.70899999999999996},"min":{"1min":0.55600000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.85999999999999999,"5min":1.002,"15min":1.002},"last":0.70099999999999996}]},{"osd":8,"last update":"Fri May 10 03:40:13 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.71699999999999997,"15min":0.70699999999999996},"min":{"1min":0.57399999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.746},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79000000000000004,"15min":0.79700000000000004},"min":{"1min":0.57299999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.81299999999999994}]},{"osd":9,"last update":"Fri May 10 03:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.97799999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74199999999999999,"15min":0.74299999999999999},"min":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.90100000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.83499999999999996}]},{"osd":10,"last update":"Fri May 10 03:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73799999999999999,"15min":0.74099999999999999},"min":{"1min":0.58199999999999996,"5min":0.505,"15min":0.505},"max":{"1min":0.88200000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.64700000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.82699999999999996,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.78000000000000003}]},{"osd":11,"last update":"Fri May 10 03:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.85299999999999998}]}]},{"osd":6,"up_from":45,"seq":193273528367,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":995328,"data_stored":483243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.505,"15min":0.46100000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.45800000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.628,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.51800000000000002}]},{"osd":1,"last update":"Fri May 10 03:39:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.56799999999999995,"15min":0.54800000000000004},"min":{"1min":0.45900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85099999999999998,"5min":1.113,"15min":1.113},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.873,"5min":0.69199999999999995,"15min":0.63800000000000001},"min":{"1min":0.53700000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":4.0439999999999996,"5min":4.0439999999999996,"15min":4.0439999999999996},"last":0.68200000000000005}]},{"osd":2,"last update":"Fri May 10 03:39:40 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.626,"15min":0.60799999999999998},"min":{"1min":0.441,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95399999999999996,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.748,"15min":0.70199999999999996},"min":{"1min":0.49199999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":3.8719999999999999,"5min":3.8719999999999999,"15min":3.8719999999999999},"last":0.76800000000000002}]},{"osd":3,"last update":"Fri May 10 03:39:40 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.625,"15min":0.56499999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":4.476,"5min":4.476,"15min":4.476},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.57299999999999995,"15min":0.55100000000000005},"min":{"1min":0.35499999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.441}]},{"osd":4,"last update":"Fri May 10 03:39:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.627,"15min":0.60699999999999998},"min":{"1min":0.48499999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90500000000000003,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.78300000000000003,"15min":0.73299999999999998},"min":{"1min":0.60299999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":4.0910000000000002,"5min":4.0910000000000002,"15min":4.0910000000000002},"last":0.61199999999999999}]},{"osd":5,"last update":"Fri May 10 03:39:40 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.69399999999999995,"15min":0.67900000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.75},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72699999999999998,"15min":0.71899999999999997},"min":{"1min":0.496,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.99399999999999999,"5min":1.01,"15min":1.01},"last":0.64300000000000002}]},{"osd":7,"last update":"Fri May 10 03:39:58 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.86799999999999999,"15min":0.83599999999999997},"min":{"1min":0.59499999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.9660000000000002,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.77300000000000002,"15min":0.75900000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.65800000000000003}]},{"osd":8,"last update":"Fri May 10 03:39:09 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.54800000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.96399999999999997,"5min":0.999,"15min":0.999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.88100000000000001,"15min":0.88900000000000001},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.86299999999999999}]},{"osd":9,"last update":"Fri May 10 03:39:30 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.95799999999999996,"15min":0.94599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":3.827,"5min":3.827,"15min":3.827},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.84599999999999997,"15min":0.84799999999999998},"min":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.58099999999999996}]},{"osd":10,"last update":"Fri May 10 03:39:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.006,"15min":0.99199999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":4.1340000000000003,"5min":4.1340000000000003,"15min":4.1340000000000003},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.876,"5min":0.88900000000000001,"15min":0.89100000000000001},"min":{"1min":0.67600000000000005,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.70599999999999996}]},{"osd":11,"last update":"Fri May 10 03:39:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":4.0049999999999999,"5min":4.0049999999999999,"15min":4.0049999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.79700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":1069056,"data_stored":552213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.54800000000000004,"15min":0.51400000000000001},"min":{"1min":0.41899999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.748,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54700000000000004,"15min":0.50900000000000001},"min":{"1min":0.41499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78300000000000003,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.53100000000000003}]},{"osd":2,"last update":"Fri May 10 03:39:27 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.55300000000000005,"15min":0.50800000000000001},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.82799999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.745},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.56499999999999995,"15min":0.51900000000000002},"min":{"1min":0.42099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.68500000000000005}]},{"osd":3,"last update":"Fri May 10 03:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60399999999999998,"15min":0.56899999999999995},"min":{"1min":0.38700000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.90400000000000003,"5min":1.528,"15min":1.528},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.61399999999999999,"15min":0.56599999999999995},"min":{"1min":0.55500000000000005,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86099999999999999,"5min":1.502,"15min":1.502},"last":0.56399999999999995}]},{"osd":4,"last update":"Fri May 10 03:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.41099999999999998},"min":{"1min":0.40799999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.66400000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.48199999999999998,"15min":0.42199999999999999},"min":{"1min":0.40200000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.79500000000000004,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.50800000000000001}]},{"osd":5,"last update":"Fri May 10 03:39:23 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.63600000000000001,"15min":0.61199999999999999},"min":{"1min":0.46300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.67600000000000005,"15min":0.64600000000000002},"min":{"1min":0.54500000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.72799999999999998}]},{"osd":6,"last update":"Fri May 10 03:39:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.67600000000000005,"15min":0.64600000000000002},"min":{"1min":0.53800000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0680000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.66700000000000004,"15min":0.64900000000000002},"min":{"1min":0.53900000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.94099999999999995,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.69999999999999996}]},{"osd":7,"last update":"Fri May 10 03:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.58199999999999996,"15min":0.55600000000000005},"min":{"1min":0.40799999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84699999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.627,"15min":0.58399999999999996},"min":{"1min":0.49299999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86699999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.63100000000000001}]},{"osd":8,"last update":"Fri May 10 03:40:13 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.69299999999999995,"15min":0.65400000000000003},"min":{"1min":0.67100000000000004,"5min":0.443,"15min":0.443},"max":{"1min":0.93600000000000005,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.871,"5min":0.76600000000000001,"15min":0.72299999999999998},"min":{"1min":0.65900000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0580000000000001,"5min":1.113,"15min":1.113},"last":0.77800000000000002}]},{"osd":9,"last update":"Fri May 10 03:39:33 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.77800000000000002,"15min":0.754},"min":{"1min":0.67600000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.871,"5min":0.78300000000000003,"15min":0.76800000000000002},"min":{"1min":0.60499999999999998,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.76200000000000001}]},{"osd":10,"last update":"Fri May 10 03:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":0.98799999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.60199999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.014,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.83399999999999996}]},{"osd":11,"last update":"Fri May 10 03:39:39 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.85399999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1019904,"data_stored":485013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 03:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.62,"15min":0.55600000000000005},"min":{"1min":0.44900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.98099999999999998,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.61599999999999999,"15min":0.54800000000000004},"min":{"1min":0.39600000000000002,"5min":0.316,"15min":0.316},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.57899999999999996}]},{"osd":2,"last update":"Fri May 10 03:39:22 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.64900000000000002,"15min":0.60699999999999998},"min":{"1min":0.434,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.87},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.66000000000000003,"15min":0.60199999999999998},"min":{"1min":0.50600000000000001,"5min":0.379,"15min":0.379},"max":{"1min":1.038,"5min":1.216,"15min":1.216},"last":0.96299999999999997}]},{"osd":3,"last update":"Fri May 10 03:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.89600000000000002}]},{"osd":4,"last update":"Fri May 10 03:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67100000000000004,"15min":0.61099999999999999},"min":{"1min":0.47099999999999997,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.101,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.64800000000000002,"15min":0.59099999999999997},"min":{"1min":0.45100000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.036,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.78400000000000003}]},{"osd":5,"last update":"Fri May 10 03:39:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.60999999999999999,"15min":0.59099999999999997},"min":{"1min":0.45700000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.72599999999999998,"15min":0.69599999999999995},"min":{"1min":0.56299999999999994,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":1.014}]},{"osd":6,"last update":"Fri May 10 03:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.69499999999999995,"15min":0.69299999999999995},"min":{"1min":0.40400000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.92900000000000005,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.71799999999999997,"15min":0.69899999999999995},"min":{"1min":0.53500000000000003,"5min":0.374,"15min":0.374},"max":{"1min":1.119,"5min":1.196,"15min":1.196},"last":1.107}]},{"osd":7,"last update":"Fri May 10 03:39:44 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.997},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":1.0629999999999999}]},{"osd":8,"last update":"Fri May 10 03:39:11 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.85699999999999998,"15min":0.84699999999999998},"min":{"1min":0.58099999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.86099999999999999,"15min":0.85199999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.232,"5min":1.373,"15min":1.373},"last":1.046}]},{"osd":9,"last update":"Fri May 10 03:39:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.83499999999999996,"15min":0.82099999999999995},"min":{"1min":0.55600000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.3089999999999999,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":1.135},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.70199999999999996,"15min":0.68100000000000005},"min":{"1min":0.42799999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.97599999999999998}]},{"osd":10,"last update":"Fri May 10 03:39:44 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.91000000000000003,"15min":0.89400000000000002},"min":{"1min":0.69699999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.264,"5min":1.446,"15min":1.446},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.92200000000000004,"15min":0.91000000000000003},"min":{"1min":0.66000000000000003,"5min":0.63,"15min":0.63},"max":{"1min":1.3200000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":1.091}]},{"osd":11,"last update":"Fri May 10 03:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.77100000000000002,"15min":0.76100000000000001},"min":{"1min":0.63800000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.95199999999999996,"15min":0.94299999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2789999999999999,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.1870000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":1011712,"data_stored":485152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.38800000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71799999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.41199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80100000000000005,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.81899999999999995}]},{"osd":1,"last update":"Fri May 10 03:39:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.57799999999999996,"15min":0.53500000000000003},"min":{"1min":0.39200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.625,"15min":0.56399999999999995},"min":{"1min":0.372,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.67500000000000004}]},{"osd":3,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.629,"15min":0.60299999999999998},"min":{"1min":0.53100000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61699999999999999,"15min":0.59899999999999998},"min":{"1min":0.50600000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.77200000000000002}]},{"osd":4,"last update":"Fri May 10 03:39:38 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.70299999999999996}]},{"osd":5,"last update":"Fri May 10 03:39:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.53200000000000003,"15min":0.50800000000000001},"min":{"1min":0.29599999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.56799999999999995,"15min":0.55200000000000005},"min":{"1min":0.36299999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80200000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.43099999999999999}]},{"osd":6,"last update":"Fri May 10 03:39:38 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.65500000000000003,"15min":0.63400000000000001},"min":{"1min":0.48199999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.73099999999999998,"15min":0.71699999999999997},"min":{"1min":0.59499999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.84499999999999997}]},{"osd":7,"last update":"Fri May 10 03:39:41 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.745},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.58499999999999996}]},{"osd":8,"last update":"Fri May 10 03:39:12 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.63900000000000001,"15min":0.63200000000000001},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.96299999999999997,"5min":0.995,"15min":0.995},"last":0.59499999999999997}]},{"osd":9,"last update":"Fri May 10 03:39:30 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.77000000000000002,"15min":0.75900000000000001},"min":{"1min":0.54800000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.83399999999999996,"15min":0.82399999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.80700000000000005}]},{"osd":10,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.71099999999999997,"15min":0.70499999999999996},"min":{"1min":0.51500000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89800000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.83399999999999996,"15min":0.81799999999999995},"min":{"1min":0.747,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.85999999999999999}]},{"osd":11,"last update":"Fri May 10 03:39:38 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.88600000000000001}]}]},{"osd":3,"up_from":25,"seq":107374182459,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1003520,"data_stored":482668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:43 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.42899999999999999,"15min":0.38600000000000001},"min":{"1min":0.314,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.47999999999999998,"15min":0.439},"min":{"1min":0.35799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77600000000000002,"5min":0.878,"15min":0.878},"last":0.46000000000000002}]},{"osd":1,"last update":"Fri May 10 03:39:43 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56999999999999995,"15min":0.53900000000000003},"min":{"1min":0.40699999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.89700000000000002,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59199999999999997,"15min":0.53900000000000003},"min":{"1min":0.39200000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.65400000000000003}]},{"osd":2,"last update":"Fri May 10 03:39:43 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.63200000000000001,"15min":0.60399999999999998},"min":{"1min":0.48899999999999999,"5min":0.38,"15min":0.38},"max":{"1min":1.0720000000000001,"5min":1.145,"15min":1.145},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.627,"15min":0.58399999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91900000000000004,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.71399999999999997}]},{"osd":4,"last update":"Fri May 10 03:40:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64600000000000002,"15min":0.61199999999999999},"min":{"1min":0.45600000000000002,"5min":0.433,"15min":0.433},"max":{"1min":1.0269999999999999,"5min":1.093,"15min":1.093},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67400000000000004,"15min":0.63300000000000001},"min":{"1min":0.51500000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.85599999999999998,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.56999999999999995}]},{"osd":5,"last update":"Fri May 10 03:39:21 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65200000000000002,"15min":0.63200000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.014,"5min":1.224,"15min":1.224},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66200000000000003,"15min":0.63},"min":{"1min":0.438,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.996,"5min":1.093,"15min":1.093},"last":0.77300000000000002}]},{"osd":6,"last update":"Fri May 10 03:39:38 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67600000000000005,"15min":0.67400000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2549999999999999,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42599999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.073,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.51100000000000001}]},{"osd":7,"last update":"Fri May 10 03:39:58 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.70599999999999996,"15min":0.69999999999999996},"min":{"1min":0.50700000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96399999999999997,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.439},{"interface":"front","average":{"1min":0.753,"5min":0.78300000000000003,"15min":0.78600000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.69899999999999995}]},{"osd":8,"last update":"Fri May 10 03:38:09 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.68899999999999995}]},{"osd":9,"last update":"Fri May 10 03:39:27 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.879,"15min":0.90300000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.81899999999999995,"15min":0.83599999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.625}]},{"osd":10,"last update":"Fri May 10 03:39:48 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.84799999999999998,"15min":0.85399999999999998},"min":{"1min":0.61599999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.139,"5min":1.27,"15min":1.27},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.89900000000000002,"15min":0.91100000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.73599999999999999}]},{"osd":11,"last update":"Fri May 10 03:39:38 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.75}]}]},{"osd":4,"up_from":33,"seq":141733920823,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1081344,"data_stored":555257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:37:59 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.47599999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.52400000000000002,"15min":0.51100000000000001},"min":{"1min":0.435,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.54000000000000004}]},{"osd":1,"last update":"Fri May 10 03:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.40000000000000002,"15min":0.36499999999999999},"min":{"1min":0.36499999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.58199999999999996,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.41599999999999998,"15min":0.38400000000000001},"min":{"1min":0.37,"5min":0.251,"15min":0.251},"max":{"1min":0.68999999999999995,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.60699999999999998}]},{"osd":2,"last update":"Fri May 10 03:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57699999999999996,"15min":0.55300000000000005},"min":{"1min":0.39900000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.75,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.621,"15min":0.56999999999999995},"min":{"1min":0.53000000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88800000000000001,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.71499999999999997}]},{"osd":3,"last update":"Fri May 10 03:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.62,"15min":0.57999999999999996},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.754},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58999999999999997,"15min":0.57299999999999995},"min":{"1min":0.44500000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.63600000000000001}]},{"osd":5,"last update":"Fri May 10 03:39:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61699999999999999,"15min":0.59499999999999997},"min":{"1min":0.497,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90500000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.63500000000000001,"15min":0.60499999999999998},"min":{"1min":0.47999999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.86599999999999999}]},{"osd":6,"last update":"Fri May 10 03:39:40 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.625,"15min":0.629},"min":{"1min":0.46100000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.77300000000000002,"15min":0.79900000000000004},"min":{"1min":0.505,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95199999999999996,"5min":3.714,"15min":3.714},"last":0.94099999999999995}]},{"osd":7,"last update":"Fri May 10 03:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.59699999999999998,"15min":0.56499999999999995},"min":{"1min":0.441,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.623,"15min":0.58599999999999997},"min":{"1min":0.55300000000000005,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.91600000000000004}]},{"osd":8,"last update":"Fri May 10 03:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.66400000000000003,"15min":0.64500000000000002},"min":{"1min":0.52200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.77900000000000003,"15min":0.76400000000000001},"min":{"1min":0.57499999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.96099999999999997}]},{"osd":9,"last update":"Fri May 10 03:39:31 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.81899999999999995,"15min":0.82299999999999995},"min":{"1min":0.53100000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92800000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.92700000000000005,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.98999999999999999}]},{"osd":10,"last update":"Fri May 10 03:39:44 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80200000000000005,"15min":0.80300000000000005},"min":{"1min":0.60399999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92200000000000004,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":1.026},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.71899999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.93500000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":1.0029999999999999}]},{"osd":11,"last update":"Fri May 10 03:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":1.069},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.88800000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757300,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1622016,"data_stored":1080198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58199999999999996,"15min":0.57199999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.86799999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.49399999999999999}]},{"osd":1,"last update":"Fri May 10 03:39:17 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59099999999999997,"15min":0.58399999999999996},"min":{"1min":0.441,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92600000000000005,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.48199999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.63900000000000001}]},{"osd":2,"last update":"Fri May 10 03:39:17 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.436,"15min":0.41799999999999998},"min":{"1min":0.32700000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69599999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.373},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.44600000000000001,"15min":0.438},"min":{"1min":0.312,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68400000000000005,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.35399999999999998}]},{"osd":3,"last update":"Fri May 10 03:39:17 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.88,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.47499999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78300000000000003,"5min":1.095,"15min":1.095},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri May 10 03:39:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.63400000000000001,"15min":0.623},"min":{"1min":0.45300000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.42299999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66000000000000003}]},{"osd":6,"last update":"Fri May 10 03:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.624,"15min":0.60599999999999998},"min":{"1min":0.54400000000000004,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.90500000000000003,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.69399999999999995,"15min":0.68600000000000005},"min":{"1min":0.45700000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.97699999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.44500000000000001}]},{"osd":7,"last update":"Fri May 10 03:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.72199999999999998,"15min":0.70199999999999996},"min":{"1min":0.51300000000000001,"5min":0.504,"15min":0.504},"max":{"1min":0.97499999999999998,"5min":1.044,"15min":1.044},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.60799999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93300000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.75}]},{"osd":8,"last update":"Fri May 10 03:39:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.64400000000000002,"15min":0.63600000000000001},"min":{"1min":0.39100000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.61199999999999999}]},{"osd":9,"last update":"Fri May 10 03:39:29 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.70199999999999996,"15min":0.68400000000000005},"min":{"1min":0.56100000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.753,"15min":0.73099999999999998},"min":{"1min":0.64600000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.71999999999999997}]},{"osd":10,"last update":"Fri May 10 03:39:46 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.71299999999999997,"15min":0.69899999999999995},"min":{"1min":0.54700000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91900000000000004,"5min":1.109,"15min":1.109},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.76000000000000001,"15min":0.752},"min":{"1min":0.64600000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.94899999999999995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.80700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":72164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":71112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":69628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T03:40:19.897 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-05-10T03:40:19.897 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T03:40:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.046+0000 7fbb20024700 1 -- 172.21.15.45:0/934912682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb18107310 msgr2=0x7fbb18109730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.046+0000 7fbb20024700 1 --2- 172.21.15.45:0/934912682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb18107310 0x7fbb18109730 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fbb14009990 tx=0x7fbb14009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.047+0000 7fbb20024700 1 -- 172.21.15.45:0/934912682 shutdown_connections 2024-05-10T03:40:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.047+0000 7fbb20024700 1 --2- 172.21.15.45:0/934912682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb181020d0 0x7fbb181024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.047+0000 7fbb20024700 1 --2- 172.21.15.45:0/934912682 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb18109c70 0x7fbb1810c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.047+0000 7fbb20024700 1 --2- 172.21.15.45:0/934912682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb18107310 0x7fbb18109730 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.047+0000 7fbb20024700 1 -- 172.21.15.45:0/934912682 >> 172.21.15.45:0/934912682 conn(0x7fbb180fb8b0 msgr2=0x7fbb180fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.047+0000 7fbb20024700 1 -- 172.21.15.45:0/934912682 shutdown_connections 2024-05-10T03:40:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.047+0000 7fbb20024700 1 -- 172.21.15.45:0/934912682 wait complete. 2024-05-10T03:40:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.047+0000 7fbb20024700 1 Processor -- start 2024-05-10T03:40:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.047+0000 7fbb20024700 1 -- start start 2024-05-10T03:40:20.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.048+0000 7fbb20024700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb181020d0 0x7fbb1819a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:20.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.048+0000 7fbb20024700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb18107310 0x7fbb1819a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:20.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.048+0000 7fbb20024700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb18109c70 0x7fbb181a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:20.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.048+0000 7fbb20024700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb181a1d90 con 0x7fbb18109c70 2024-05-10T03:40:20.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.048+0000 7fbb20024700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb181a1f00 con 0x7fbb18107310 2024-05-10T03:40:20.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.048+0000 7fbb20024700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb181a20c0 con 0x7fbb181020d0 2024-05-10T03:40:20.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.048+0000 7fbb1e5c1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb18109c70 0x7fbb181a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:20.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.048+0000 7fbb1e5c1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb18109c70 0x7fbb181a1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35192/0 (socket says 172.21.15.45:35192) 2024-05-10T03:40:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.048+0000 7fbb1e5c1700 1 -- 172.21.15.45:0/2903399065 learned_addr learned my addr 172.21.15.45:0/2903399065 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.048+0000 7fbb1d5bf700 1 --2- 172.21.15.45:0/2903399065 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb18107310 0x7fbb1819a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.048+0000 7fbb1ddc0700 1 --2- 172.21.15.45:0/2903399065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb181020d0 0x7fbb1819a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.048+0000 7fbb1e5c1700 1 -- 172.21.15.45:0/2903399065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb181020d0 msgr2=0x7fbb1819a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.048+0000 7fbb1e5c1700 1 --2- 172.21.15.45:0/2903399065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb181020d0 0x7fbb1819a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.048+0000 7fbb1e5c1700 1 -- 172.21.15.45:0/2903399065 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb18107310 msgr2=0x7fbb1819a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.048+0000 7fbb1e5c1700 1 --2- 172.21.15.45:0/2903399065 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb18107310 0x7fbb1819a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.048+0000 7fbb1e5c1700 1 -- 172.21.15.45:0/2903399065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb140095f0 con 0x7fbb18109c70 2024-05-10T03:40:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.048+0000 7fbb1e5c1700 1 --2- 172.21.15.45:0/2903399065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb18109c70 0x7fbb181a1780 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbb10007ee0 tx=0x7fbb1000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.049+0000 7fbb0affd700 1 -- 172.21.15.45:0/2903399065 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb10017070 con 0x7fbb18109c70 2024-05-10T03:40:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.049+0000 7fbb0affd700 1 -- 172.21.15.45:0/2903399065 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbb1000f040 con 0x7fbb18109c70 2024-05-10T03:40:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.049+0000 7fbb20024700 1 -- 172.21.15.45:0/2903399065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb181a23a0 con 0x7fbb18109c70 2024-05-10T03:40:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.049+0000 7fbb0affd700 1 -- 172.21.15.45:0/2903399065 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb10005760 con 0x7fbb18109c70 2024-05-10T03:40:20.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.049+0000 7fbb20024700 1 -- 172.21.15.45:0/2903399065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb181a2860 con 0x7fbb18109c70 2024-05-10T03:40:20.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.050+0000 7fbb20024700 1 -- 172.21.15.45:0/2903399065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb180fd460 con 0x7fbb18109c70 2024-05-10T03:40:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.051+0000 7fbb0affd700 1 -- 172.21.15.45:0/2903399065 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fbb100058c0 con 0x7fbb18109c70 2024-05-10T03:40:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.052+0000 7fbb0affd700 1 --2- 172.21.15.45:0/2903399065 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fbb040a11b0 0x7fbb040a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.052+0000 7fbb1ddc0700 1 --2- 172.21.15.45:0/2903399065 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fbb040a11b0 0x7fbb040a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.052+0000 7fbb0affd700 1 -- 172.21.15.45:0/2903399065 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fbb100ccae0 con 0x7fbb18109c70 2024-05-10T03:40:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.053+0000 7fbb1ddc0700 1 --2- 172.21.15.45:0/2903399065 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fbb040a11b0 0x7fbb040a36c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbb18069a80 tx=0x7fbb0c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:20.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.056+0000 7fbb0affd700 1 -- 172.21.15.45:0/2903399065 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fbb10095e00 con 0x7fbb18109c70 2024-05-10T03:40:20.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.273+0000 7fbb20024700 1 -- 172.21.15.45:0/2903399065 --> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbb18061650 con 0x7fbb040a11b0 2024-05-10T03:40:20.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.287+0000 7fbb0affd700 1 -- 172.21.15.45:0/2903399065 <== mgr.14152 v2:172.21.15.45:6800/596110596 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426770 (secure 0 0 0) 0x7fbb18061650 con 0x7fbb040a11b0 2024-05-10T03:40:20.296 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:40:20.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.291+0000 7fbb20024700 1 -- 172.21.15.45:0/2903399065 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fbb040a11b0 msgr2=0x7fbb040a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:20.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.291+0000 7fbb20024700 1 --2- 172.21.15.45:0/2903399065 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fbb040a11b0 0x7fbb040a36c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbb18069a80 tx=0x7fbb0c009260 comp rx=0 tx=0).stop 2024-05-10T03:40:20.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.291+0000 7fbb20024700 1 -- 172.21.15.45:0/2903399065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb18109c70 msgr2=0x7fbb181a1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:20.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.291+0000 7fbb20024700 1 --2- 172.21.15.45:0/2903399065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb18109c70 0x7fbb181a1780 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbb10007ee0 tx=0x7fbb1000d3b0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.291+0000 7fbb20024700 1 -- 172.21.15.45:0/2903399065 shutdown_connections 2024-05-10T03:40:20.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.291+0000 7fbb20024700 1 --2- 172.21.15.45:0/2903399065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb181020d0 0x7fbb1819a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.291+0000 7fbb20024700 1 --2- 172.21.15.45:0/2903399065 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fbb040a11b0 0x7fbb040a36c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.291+0000 7fbb20024700 1 --2- 172.21.15.45:0/2903399065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb18109c70 0x7fbb181a1780 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.291+0000 7fbb20024700 1 --2- 172.21.15.45:0/2903399065 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb18107310 0x7fbb1819a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.291+0000 7fbb20024700 1 -- 172.21.15.45:0/2903399065 >> 172.21.15.45:0/2903399065 conn(0x7fbb180fb8b0 msgr2=0x7fbb18108150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:20.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.291+0000 7fbb20024700 1 -- 172.21.15.45:0/2903399065 shutdown_connections 2024-05-10T03:40:20.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.291+0000 7fbb20024700 1 -- 172.21.15.45:0/2903399065 wait complete. 2024-05-10T03:40:20.300 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-05-10T03:40:20.309 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2024-05-10T03:40:19.906427+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667999,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":947,"num_read_kb":605,"num_write":423,"num_write_kb":3089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1244630,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":351,"ondisk_log_size":351,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":362704,"kb_used_data":13816,"kb_used_omap":18,"kb_used_meta":348653,"kb_avail":1124579120,"statfs":{"total":1151940427776,"available":1151569018880,"internally_reserved":0,"allocated":14147584,"data_stored":7821189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19129,"internal_metadata":357020999},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7462,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":80,"num_write":6,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003669"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076912+0000","last_change":"2024-05-10T03:38:36.586241+0000","last_active":"2024-05-10T03:39:26.076912+0000","last_peered":"2024-05-10T03:39:26.076912+0000","last_clean":"2024-05-10T03:39:26.076912+0000","last_became_active":"2024-05-10T03:38:36.585655+0000","last_became_peered":"2024-05-10T03:38:36.585655+0000","last_unstale":"2024-05-10T03:39:26.076912+0000","last_undegraded":"2024-05-10T03:39:26.076912+0000","last_fullsized":"2024-05-10T03:39:26.076912+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:58:24.614952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067299+0000","last_change":"2024-05-10T03:38:36.588174+0000","last_active":"2024-05-10T03:39:26.067299+0000","last_peered":"2024-05-10T03:39:26.067299+0000","last_clean":"2024-05-10T03:39:26.067299+0000","last_became_active":"2024-05-10T03:38:36.587843+0000","last_became_peered":"2024-05-10T03:38:36.587843+0000","last_unstale":"2024-05-10T03:39:26.067299+0000","last_undegraded":"2024-05-10T03:39:26.067299+0000","last_fullsized":"2024-05-10T03:39:26.067299+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:56.414407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067873+0000","last_change":"2024-05-10T03:38:36.587344+0000","last_active":"2024-05-10T03:39:26.067873+0000","last_peered":"2024-05-10T03:39:26.067873+0000","last_clean":"2024-05-10T03:39:26.067873+0000","last_became_active":"2024-05-10T03:38:36.586345+0000","last_became_peered":"2024-05-10T03:38:36.586345+0000","last_unstale":"2024-05-10T03:39:26.067873+0000","last_undegraded":"2024-05-10T03:39:26.067873+0000","last_fullsized":"2024-05-10T03:39:26.067873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:36.159864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.068208+0000","last_change":"2024-05-10T03:38:36.573019+0000","last_active":"2024-05-10T03:39:26.068208+0000","last_peered":"2024-05-10T03:39:26.068208+0000","last_clean":"2024-05-10T03:39:26.068208+0000","last_became_active":"2024-05-10T03:38:36.572667+0000","last_became_peered":"2024-05-10T03:38:36.572667+0000","last_unstale":"2024-05-10T03:39:26.068208+0000","last_undegraded":"2024-05-10T03:39:26.068208+0000","last_fullsized":"2024-05-10T03:39:26.068208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:24:23.722642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074998+0000","last_change":"2024-05-10T03:38:36.577069+0000","last_active":"2024-05-10T03:39:26.074998+0000","last_peered":"2024-05-10T03:39:26.074998+0000","last_clean":"2024-05-10T03:39:26.074998+0000","last_became_active":"2024-05-10T03:38:36.576683+0000","last_became_peered":"2024-05-10T03:38:36.576683+0000","last_unstale":"2024-05-10T03:39:26.074998+0000","last_undegraded":"2024-05-10T03:39:26.074998+0000","last_fullsized":"2024-05-10T03:39:26.074998+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:09:15.280098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073190+0000","last_change":"2024-05-10T03:38:36.577518+0000","last_active":"2024-05-10T03:39:26.073190+0000","last_peered":"2024-05-10T03:39:26.073190+0000","last_clean":"2024-05-10T03:39:26.073190+0000","last_became_active":"2024-05-10T03:38:36.577147+0000","last_became_peered":"2024-05-10T03:38:36.577147+0000","last_unstale":"2024-05-10T03:39:26.073190+0000","last_undegraded":"2024-05-10T03:39:26.073190+0000","last_fullsized":"2024-05-10T03:39:26.073190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:39:42.779405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078304+0000","last_change":"2024-05-10T03:38:36.594241+0000","last_active":"2024-05-10T03:39:26.078304+0000","last_peered":"2024-05-10T03:39:26.078304+0000","last_clean":"2024-05-10T03:39:26.078304+0000","last_became_active":"2024-05-10T03:38:36.593943+0000","last_became_peered":"2024-05-10T03:38:36.593943+0000","last_unstale":"2024-05-10T03:39:26.078304+0000","last_undegraded":"2024-05-10T03:39:26.078304+0000","last_fullsized":"2024-05-10T03:39:26.078304+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:00.521083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076927+0000","last_change":"2024-05-10T03:38:36.578318+0000","last_active":"2024-05-10T03:39:26.076927+0000","last_peered":"2024-05-10T03:39:26.076927+0000","last_clean":"2024-05-10T03:39:26.076927+0000","last_became_active":"2024-05-10T03:38:36.577967+0000","last_became_peered":"2024-05-10T03:38:36.577967+0000","last_unstale":"2024-05-10T03:39:26.076927+0000","last_undegraded":"2024-05-10T03:39:26.076927+0000","last_fullsized":"2024-05-10T03:39:26.076927+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:45:27.988368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075718+0000","last_change":"2024-05-10T03:38:36.590219+0000","last_active":"2024-05-10T03:39:26.075718+0000","last_peered":"2024-05-10T03:39:26.075718+0000","last_clean":"2024-05-10T03:39:26.075718+0000","last_became_active":"2024-05-10T03:38:36.589849+0000","last_became_peered":"2024-05-10T03:38:36.589849+0000","last_unstale":"2024-05-10T03:39:26.075718+0000","last_undegraded":"2024-05-10T03:39:26.075718+0000","last_fullsized":"2024-05-10T03:39:26.075718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:08:17.073204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072847+0000","last_change":"2024-05-10T03:38:36.580555+0000","last_active":"2024-05-10T03:39:26.072847+0000","last_peered":"2024-05-10T03:39:26.072847+0000","last_clean":"2024-05-10T03:39:26.072847+0000","last_became_active":"2024-05-10T03:38:36.577575+0000","last_became_peered":"2024-05-10T03:38:36.577575+0000","last_unstale":"2024-05-10T03:39:26.072847+0000","last_undegraded":"2024-05-10T03:39:26.072847+0000","last_fullsized":"2024-05-10T03:39:26.072847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:43:29.237054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078946+0000","last_change":"2024-05-10T03:38:36.586599+0000","last_active":"2024-05-10T03:39:26.078946+0000","last_peered":"2024-05-10T03:39:26.078946+0000","last_clean":"2024-05-10T03:39:26.078946+0000","last_became_active":"2024-05-10T03:38:36.585794+0000","last_became_peered":"2024-05-10T03:38:36.585794+0000","last_unstale":"2024-05-10T03:39:26.078946+0000","last_undegraded":"2024-05-10T03:39:26.078946+0000","last_fullsized":"2024-05-10T03:39:26.078946+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:25:18.337715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.068090+0000","last_change":"2024-05-10T03:38:36.578957+0000","last_active":"2024-05-10T03:39:26.068090+0000","last_peered":"2024-05-10T03:39:26.068090+0000","last_clean":"2024-05-10T03:39:26.068090+0000","last_became_active":"2024-05-10T03:38:36.578636+0000","last_became_peered":"2024-05-10T03:38:36.578636+0000","last_unstale":"2024-05-10T03:39:26.068090+0000","last_undegraded":"2024-05-10T03:39:26.068090+0000","last_fullsized":"2024-05-10T03:39:26.068090+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:55:38.830864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.079013+0000","last_change":"2024-05-10T03:39:27.079013+0000","last_active":"2024-05-10T03:39:27.079013+0000","last_peered":"2024-05-10T03:39:27.079013+0000","last_clean":"2024-05-10T03:39:27.079013+0000","last_became_active":"2024-05-10T03:39:27.078674+0000","last_became_peered":"2024-05-10T03:39:27.078674+0000","last_unstale":"2024-05-10T03:39:27.079013+0000","last_undegraded":"2024-05-10T03:39:27.079013+0000","last_fullsized":"2024-05-10T03:39:27.079013+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:59:52.547126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.066698+0000","last_change":"2024-05-10T03:38:36.590205+0000","last_active":"2024-05-10T03:39:26.066698+0000","last_peered":"2024-05-10T03:39:26.066698+0000","last_clean":"2024-05-10T03:39:26.066698+0000","last_became_active":"2024-05-10T03:38:36.589880+0000","last_became_peered":"2024-05-10T03:38:36.589880+0000","last_unstale":"2024-05-10T03:39:26.066698+0000","last_undegraded":"2024-05-10T03:39:26.066698+0000","last_fullsized":"2024-05-10T03:39:26.066698+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:22:26.374034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.077754+0000","last_change":"2024-05-10T03:39:27.077754+0000","last_active":"2024-05-10T03:39:27.077754+0000","last_peered":"2024-05-10T03:39:27.077754+0000","last_clean":"2024-05-10T03:39:27.077754+0000","last_became_active":"2024-05-10T03:39:27.077313+0000","last_became_peered":"2024-05-10T03:39:27.077313+0000","last_unstale":"2024-05-10T03:39:27.077754+0000","last_undegraded":"2024-05-10T03:39:27.077754+0000","last_fullsized":"2024-05-10T03:39:27.077754+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:36:49.331763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074838+0000","last_change":"2024-05-10T03:38:36.591061+0000","last_active":"2024-05-10T03:39:26.074838+0000","last_peered":"2024-05-10T03:39:26.074838+0000","last_clean":"2024-05-10T03:39:26.074838+0000","last_became_active":"2024-05-10T03:38:36.590698+0000","last_became_peered":"2024-05-10T03:38:36.590698+0000","last_unstale":"2024-05-10T03:39:26.074838+0000","last_undegraded":"2024-05-10T03:39:26.074838+0000","last_fullsized":"2024-05-10T03:39:26.074838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:44:43.130908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076823+0000","last_change":"2024-05-10T03:38:36.585990+0000","last_active":"2024-05-10T03:39:26.076823+0000","last_peered":"2024-05-10T03:39:26.076823+0000","last_clean":"2024-05-10T03:39:26.076823+0000","last_became_active":"2024-05-10T03:38:36.585221+0000","last_became_peered":"2024-05-10T03:38:36.585221+0000","last_unstale":"2024-05-10T03:39:26.076823+0000","last_undegraded":"2024-05-10T03:39:26.076823+0000","last_fullsized":"2024-05-10T03:39:26.076823+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:57:58.981790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074421+0000","last_change":"2024-05-10T03:38:36.586651+0000","last_active":"2024-05-10T03:39:26.074421+0000","last_peered":"2024-05-10T03:39:26.074421+0000","last_clean":"2024-05-10T03:39:26.074421+0000","last_became_active":"2024-05-10T03:38:36.586243+0000","last_became_peered":"2024-05-10T03:38:36.586243+0000","last_unstale":"2024-05-10T03:39:26.074421+0000","last_undegraded":"2024-05-10T03:39:26.074421+0000","last_fullsized":"2024-05-10T03:39:26.074421+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:15:58.148040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.071924+0000","last_change":"2024-05-10T03:38:36.583740+0000","last_active":"2024-05-10T03:39:26.071924+0000","last_peered":"2024-05-10T03:39:26.071924+0000","last_clean":"2024-05-10T03:39:26.071924+0000","last_became_active":"2024-05-10T03:38:36.583359+0000","last_became_peered":"2024-05-10T03:38:36.583359+0000","last_unstale":"2024-05-10T03:39:26.071924+0000","last_undegraded":"2024-05-10T03:39:26.071924+0000","last_fullsized":"2024-05-10T03:39:26.071924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:31:29.286667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072212+0000","last_change":"2024-05-10T03:38:40.605484+0000","last_active":"2024-05-10T03:39:26.072212+0000","last_peered":"2024-05-10T03:39:26.072212+0000","last_clean":"2024-05-10T03:39:26.072212+0000","last_became_active":"2024-05-10T03:38:40.605105+0000","last_became_peered":"2024-05-10T03:38:40.605105+0000","last_unstale":"2024-05-10T03:39:26.072212+0000","last_undegraded":"2024-05-10T03:39:26.072212+0000","last_fullsized":"2024-05-10T03:39:26.072212+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:11:34.548916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":109,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:40:15.131236+0000","last_change":"2024-05-10T03:38:36.093877+0000","last_active":"2024-05-10T03:40:15.131236+0000","last_peered":"2024-05-10T03:40:15.131236+0000","last_clean":"2024-05-10T03:40:15.131236+0000","last_became_active":"2024-05-10T03:38:36.093499+0000","last_became_peered":"2024-05-10T03:38:36.093499+0000","last_unstale":"2024-05-10T03:40:15.131236+0000","last_undegraded":"2024-05-10T03:40:15.131236+0000","last_fullsized":"2024-05-10T03:40:15.131236+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:42:17.171167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.080639+0000","last_change":"2024-05-10T03:39:27.080639+0000","last_active":"2024-05-10T03:39:27.080639+0000","last_peered":"2024-05-10T03:39:27.080639+0000","last_clean":"2024-05-10T03:39:27.080639+0000","last_became_active":"2024-05-10T03:39:27.080267+0000","last_became_peered":"2024-05-10T03:39:27.080267+0000","last_unstale":"2024-05-10T03:39:27.080639+0000","last_undegraded":"2024-05-10T03:39:27.080639+0000","last_fullsized":"2024-05-10T03:39:27.080639+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:56:51.282955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067286+0000","last_change":"2024-05-10T03:38:40.608982+0000","last_active":"2024-05-10T03:39:26.067286+0000","last_peered":"2024-05-10T03:39:26.067286+0000","last_clean":"2024-05-10T03:39:26.067286+0000","last_became_active":"2024-05-10T03:38:40.608619+0000","last_became_peered":"2024-05-10T03:38:40.608619+0000","last_unstale":"2024-05-10T03:39:26.067286+0000","last_undegraded":"2024-05-10T03:39:26.067286+0000","last_fullsized":"2024-05-10T03:39:26.067286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:35:56.411530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077808+0000","last_change":"2024-05-10T03:38:36.101669+0000","last_active":"2024-05-10T03:39:26.077808+0000","last_peered":"2024-05-10T03:39:26.077808+0000","last_clean":"2024-05-10T03:39:26.077808+0000","last_became_active":"2024-05-10T03:38:36.101231+0000","last_became_peered":"2024-05-10T03:38:36.101231+0000","last_unstale":"2024-05-10T03:39:26.077808+0000","last_undegraded":"2024-05-10T03:39:26.077808+0000","last_fullsized":"2024-05-10T03:39:26.077808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:42:21.992880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067320+0000","last_change":"2024-05-10T03:38:36.585580+0000","last_active":"2024-05-10T03:39:26.067320+0000","last_peered":"2024-05-10T03:39:26.067320+0000","last_clean":"2024-05-10T03:39:26.067320+0000","last_became_active":"2024-05-10T03:38:36.585239+0000","last_became_peered":"2024-05-10T03:38:36.585239+0000","last_unstale":"2024-05-10T03:39:26.067320+0000","last_undegraded":"2024-05-10T03:39:26.067320+0000","last_fullsized":"2024-05-10T03:39:26.067320+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:39:42.886154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067314+0000","last_change":"2024-05-10T03:38:40.610372+0000","last_active":"2024-05-10T03:39:26.067314+0000","last_peered":"2024-05-10T03:39:26.067314+0000","last_clean":"2024-05-10T03:39:26.067314+0000","last_became_active":"2024-05-10T03:38:40.609958+0000","last_became_peered":"2024-05-10T03:38:40.609958+0000","last_unstale":"2024-05-10T03:39:26.067314+0000","last_undegraded":"2024-05-10T03:39:26.067314+0000","last_fullsized":"2024-05-10T03:39:26.067314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:04:37.461729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075873+0000","last_change":"2024-05-10T03:38:36.091809+0000","last_active":"2024-05-10T03:39:26.075873+0000","last_peered":"2024-05-10T03:39:26.075873+0000","last_clean":"2024-05-10T03:39:26.075873+0000","last_became_active":"2024-05-10T03:38:36.091372+0000","last_became_peered":"2024-05-10T03:38:36.091372+0000","last_unstale":"2024-05-10T03:39:26.075873+0000","last_undegraded":"2024-05-10T03:39:26.075873+0000","last_fullsized":"2024-05-10T03:39:26.075873+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:25:01.784559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075357+0000","last_change":"2024-05-10T03:38:36.595389+0000","last_active":"2024-05-10T03:39:26.075357+0000","last_peered":"2024-05-10T03:39:26.075357+0000","last_clean":"2024-05-10T03:39:26.075357+0000","last_became_active":"2024-05-10T03:38:36.595011+0000","last_became_peered":"2024-05-10T03:38:36.595011+0000","last_unstale":"2024-05-10T03:39:26.075357+0000","last_undegraded":"2024-05-10T03:39:26.075357+0000","last_fullsized":"2024-05-10T03:39:26.075357+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:54:38.377508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067207+0000","last_change":"2024-05-10T03:38:40.605656+0000","last_active":"2024-05-10T03:39:26.067207+0000","last_peered":"2024-05-10T03:39:26.067207+0000","last_clean":"2024-05-10T03:39:26.067207+0000","last_became_active":"2024-05-10T03:38:40.605262+0000","last_became_peered":"2024-05-10T03:38:40.605262+0000","last_unstale":"2024-05-10T03:39:26.067207+0000","last_undegraded":"2024-05-10T03:39:26.067207+0000","last_fullsized":"2024-05-10T03:39:26.067207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:11:27.398282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.089175+0000","last_change":"2024-05-10T03:39:27.089175+0000","last_active":"2024-05-10T03:39:27.089175+0000","last_peered":"2024-05-10T03:39:27.089175+0000","last_clean":"2024-05-10T03:39:27.089175+0000","last_became_active":"2024-05-10T03:39:27.080923+0000","last_became_peered":"2024-05-10T03:39:27.080923+0000","last_unstale":"2024-05-10T03:39:27.089175+0000","last_undegraded":"2024-05-10T03:39:27.089175+0000","last_fullsized":"2024-05-10T03:39:27.089175+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:22.891201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073498+0000","last_change":"2024-05-10T03:38:36.587831+0000","last_active":"2024-05-10T03:39:26.073498+0000","last_peered":"2024-05-10T03:39:26.073498+0000","last_clean":"2024-05-10T03:39:26.073498+0000","last_became_active":"2024-05-10T03:38:36.587503+0000","last_became_peered":"2024-05-10T03:38:36.587503+0000","last_unstale":"2024-05-10T03:39:26.073498+0000","last_undegraded":"2024-05-10T03:39:26.073498+0000","last_fullsized":"2024-05-10T03:39:26.073498+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:52.335134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.071626+0000","last_change":"2024-05-10T03:38:40.601327+0000","last_active":"2024-05-10T03:39:26.071626+0000","last_peered":"2024-05-10T03:39:26.071626+0000","last_clean":"2024-05-10T03:39:26.071626+0000","last_became_active":"2024-05-10T03:38:40.600901+0000","last_became_peered":"2024-05-10T03:38:40.600901+0000","last_unstale":"2024-05-10T03:39:26.071626+0000","last_undegraded":"2024-05-10T03:39:26.071626+0000","last_fullsized":"2024-05-10T03:39:26.071626+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:28.285707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":107,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:40:18.137047+0000","last_change":"2024-05-10T03:38:36.094064+0000","last_active":"2024-05-10T03:40:18.137047+0000","last_peered":"2024-05-10T03:40:18.137047+0000","last_clean":"2024-05-10T03:40:18.137047+0000","last_became_active":"2024-05-10T03:38:36.093522+0000","last_became_peered":"2024-05-10T03:38:36.093522+0000","last_unstale":"2024-05-10T03:40:18.137047+0000","last_undegraded":"2024-05-10T03:40:18.137047+0000","last_fullsized":"2024-05-10T03:40:18.137047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:25:14.257166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076617+0000","last_change":"2024-05-10T03:38:36.580553+0000","last_active":"2024-05-10T03:39:26.076617+0000","last_peered":"2024-05-10T03:39:26.076617+0000","last_clean":"2024-05-10T03:39:26.076617+0000","last_became_active":"2024-05-10T03:38:36.580160+0000","last_became_peered":"2024-05-10T03:38:36.580160+0000","last_unstale":"2024-05-10T03:39:26.076617+0000","last_undegraded":"2024-05-10T03:39:26.076617+0000","last_fullsized":"2024-05-10T03:39:26.076617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:01:14.373430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.071997+0000","last_change":"2024-05-10T03:38:40.609034+0000","last_active":"2024-05-10T03:39:26.071997+0000","last_peered":"2024-05-10T03:39:26.071997+0000","last_clean":"2024-05-10T03:39:26.071997+0000","last_became_active":"2024-05-10T03:38:40.608617+0000","last_became_peered":"2024-05-10T03:38:40.608617+0000","last_unstale":"2024-05-10T03:39:26.071997+0000","last_undegraded":"2024-05-10T03:39:26.071997+0000","last_fullsized":"2024-05-10T03:39:26.071997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:55:28.669881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.093057+0000","last_change":"2024-05-10T03:39:27.093057+0000","last_active":"2024-05-10T03:39:27.093057+0000","last_peered":"2024-05-10T03:39:27.093057+0000","last_clean":"2024-05-10T03:39:27.093057+0000","last_became_active":"2024-05-10T03:39:27.076537+0000","last_became_peered":"2024-05-10T03:39:27.076537+0000","last_unstale":"2024-05-10T03:39:27.093057+0000","last_undegraded":"2024-05-10T03:39:27.093057+0000","last_fullsized":"2024-05-10T03:39:27.093057+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:24.158984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073109+0000","last_change":"2024-05-10T03:38:36.569429+0000","last_active":"2024-05-10T03:39:26.073109+0000","last_peered":"2024-05-10T03:39:26.073109+0000","last_clean":"2024-05-10T03:39:26.073109+0000","last_became_active":"2024-05-10T03:38:36.569042+0000","last_became_peered":"2024-05-10T03:38:36.569042+0000","last_unstale":"2024-05-10T03:39:26.073109+0000","last_undegraded":"2024-05-10T03:39:26.073109+0000","last_fullsized":"2024-05-10T03:39:26.073109+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:45:14.912428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076732+0000","last_change":"2024-05-10T03:38:40.607734+0000","last_active":"2024-05-10T03:39:26.076732+0000","last_peered":"2024-05-10T03:39:26.076732+0000","last_clean":"2024-05-10T03:39:26.076732+0000","last_became_active":"2024-05-10T03:38:40.607331+0000","last_became_peered":"2024-05-10T03:38:40.607331+0000","last_unstale":"2024-05-10T03:39:26.076732+0000","last_undegraded":"2024-05-10T03:39:26.076732+0000","last_fullsized":"2024-05-10T03:39:26.076732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:45:08.360275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.069502+0000","last_change":"2024-05-10T03:38:36.083651+0000","last_active":"2024-05-10T03:39:26.069502+0000","last_peered":"2024-05-10T03:39:26.069502+0000","last_clean":"2024-05-10T03:39:26.069502+0000","last_became_active":"2024-05-10T03:38:36.083235+0000","last_became_peered":"2024-05-10T03:38:36.083235+0000","last_unstale":"2024-05-10T03:39:26.069502+0000","last_undegraded":"2024-05-10T03:39:26.069502+0000","last_fullsized":"2024-05-10T03:39:26.069502+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:28:43.179157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077120+0000","last_change":"2024-05-10T03:38:36.579055+0000","last_active":"2024-05-10T03:39:26.077120+0000","last_peered":"2024-05-10T03:39:26.077120+0000","last_clean":"2024-05-10T03:39:26.077120+0000","last_became_active":"2024-05-10T03:38:36.578200+0000","last_became_peered":"2024-05-10T03:38:36.578200+0000","last_unstale":"2024-05-10T03:39:26.077120+0000","last_undegraded":"2024-05-10T03:39:26.077120+0000","last_fullsized":"2024-05-10T03:39:26.077120+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:48:12.749264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067181+0000","last_change":"2024-05-10T03:38:40.603903+0000","last_active":"2024-05-10T03:39:26.067181+0000","last_peered":"2024-05-10T03:39:26.067181+0000","last_clean":"2024-05-10T03:39:26.067181+0000","last_became_active":"2024-05-10T03:38:40.603481+0000","last_became_peered":"2024-05-10T03:38:40.603481+0000","last_unstale":"2024-05-10T03:39:26.067181+0000","last_undegraded":"2024-05-10T03:39:26.067181+0000","last_fullsized":"2024-05-10T03:39:26.067181+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:44:48.526838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072175+0000","last_change":"2024-05-10T03:38:36.093549+0000","last_active":"2024-05-10T03:39:26.072175+0000","last_peered":"2024-05-10T03:39:26.072175+0000","last_clean":"2024-05-10T03:39:26.072175+0000","last_became_active":"2024-05-10T03:38:36.093244+0000","last_became_peered":"2024-05-10T03:38:36.093244+0000","last_unstale":"2024-05-10T03:39:26.072175+0000","last_undegraded":"2024-05-10T03:39:26.072175+0000","last_fullsized":"2024-05-10T03:39:26.072175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:11:55.727728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073706+0000","last_change":"2024-05-10T03:38:36.582623+0000","last_active":"2024-05-10T03:39:26.073706+0000","last_peered":"2024-05-10T03:39:26.073706+0000","last_clean":"2024-05-10T03:39:26.073706+0000","last_became_active":"2024-05-10T03:38:36.582262+0000","last_became_peered":"2024-05-10T03:38:36.582262+0000","last_unstale":"2024-05-10T03:39:26.073706+0000","last_undegraded":"2024-05-10T03:39:26.073706+0000","last_fullsized":"2024-05-10T03:39:26.073706+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:48.561206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077079+0000","last_change":"2024-05-10T03:38:40.602050+0000","last_active":"2024-05-10T03:39:26.077079+0000","last_peered":"2024-05-10T03:39:26.077079+0000","last_clean":"2024-05-10T03:39:26.077079+0000","last_became_active":"2024-05-10T03:38:40.601699+0000","last_became_peered":"2024-05-10T03:38:40.601699+0000","last_unstale":"2024-05-10T03:39:26.077079+0000","last_undegraded":"2024-05-10T03:39:26.077079+0000","last_fullsized":"2024-05-10T03:39:26.077079+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:56.778636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"88'5","reported_seq":183,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:40:19.137656+0000","last_change":"2024-05-10T03:38:36.095747+0000","last_active":"2024-05-10T03:40:19.137656+0000","last_peered":"2024-05-10T03:40:19.137656+0000","last_clean":"2024-05-10T03:40:19.137656+0000","last_became_active":"2024-05-10T03:38:36.095371+0000","last_became_peered":"2024-05-10T03:38:36.095371+0000","last_unstale":"2024-05-10T03:40:19.137656+0000","last_undegraded":"2024-05-10T03:40:19.137656+0000","last_fullsized":"2024-05-10T03:40:19.137656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:02:37.435286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":160,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075561+0000","last_change":"2024-05-10T03:38:36.591321+0000","last_active":"2024-05-10T03:39:26.075561+0000","last_peered":"2024-05-10T03:39:26.075561+0000","last_clean":"2024-05-10T03:39:26.075561+0000","last_became_active":"2024-05-10T03:38:36.589852+0000","last_became_peered":"2024-05-10T03:38:36.589852+0000","last_unstale":"2024-05-10T03:39:26.075561+0000","last_undegraded":"2024-05-10T03:39:26.075561+0000","last_fullsized":"2024-05-10T03:39:26.075561+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:43.075901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073535+0000","last_change":"2024-05-10T03:38:40.605096+0000","last_active":"2024-05-10T03:39:26.073535+0000","last_peered":"2024-05-10T03:39:26.073535+0000","last_clean":"2024-05-10T03:39:26.073535+0000","last_became_active":"2024-05-10T03:38:40.604595+0000","last_became_peered":"2024-05-10T03:38:40.604595+0000","last_unstale":"2024-05-10T03:39:26.073535+0000","last_undegraded":"2024-05-10T03:39:26.073535+0000","last_fullsized":"2024-05-10T03:39:26.073535+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:14.547025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078938+0000","last_change":"2024-05-10T03:38:36.097214+0000","last_active":"2024-05-10T03:39:26.078938+0000","last_peered":"2024-05-10T03:39:26.078938+0000","last_clean":"2024-05-10T03:39:26.078938+0000","last_became_active":"2024-05-10T03:38:36.096835+0000","last_became_peered":"2024-05-10T03:38:36.096835+0000","last_unstale":"2024-05-10T03:39:26.078938+0000","last_undegraded":"2024-05-10T03:39:26.078938+0000","last_fullsized":"2024-05-10T03:39:26.078938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:50.757974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.081369+0000","last_change":"2024-05-10T03:39:27.081369+0000","last_active":"2024-05-10T03:39:27.081369+0000","last_peered":"2024-05-10T03:39:27.081369+0000","last_clean":"2024-05-10T03:39:27.081369+0000","last_became_active":"2024-05-10T03:39:27.080851+0000","last_became_peered":"2024-05-10T03:39:27.080851+0000","last_unstale":"2024-05-10T03:39:27.081369+0000","last_undegraded":"2024-05-10T03:39:27.081369+0000","last_fullsized":"2024-05-10T03:39:27.081369+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:11.552549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067592+0000","last_change":"2024-05-10T03:38:40.605627+0000","last_active":"2024-05-10T03:39:26.067592+0000","last_peered":"2024-05-10T03:39:26.067592+0000","last_clean":"2024-05-10T03:39:26.067592+0000","last_became_active":"2024-05-10T03:38:40.605116+0000","last_became_peered":"2024-05-10T03:38:40.605116+0000","last_unstale":"2024-05-10T03:39:26.067592+0000","last_undegraded":"2024-05-10T03:39:26.067592+0000","last_fullsized":"2024-05-10T03:39:26.067592+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:50:08.759725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073226+0000","last_change":"2024-05-10T03:38:36.102257+0000","last_active":"2024-05-10T03:39:26.073226+0000","last_peered":"2024-05-10T03:39:26.073226+0000","last_clean":"2024-05-10T03:39:26.073226+0000","last_became_active":"2024-05-10T03:38:36.101876+0000","last_became_peered":"2024-05-10T03:38:36.101876+0000","last_unstale":"2024-05-10T03:39:26.073226+0000","last_undegraded":"2024-05-10T03:39:26.073226+0000","last_fullsized":"2024-05-10T03:39:26.073226+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:38:01.164794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075466+0000","last_change":"2024-05-10T03:38:36.591746+0000","last_active":"2024-05-10T03:39:26.075466+0000","last_peered":"2024-05-10T03:39:26.075466+0000","last_clean":"2024-05-10T03:39:26.075466+0000","last_became_active":"2024-05-10T03:38:36.591474+0000","last_became_peered":"2024-05-10T03:38:36.591474+0000","last_unstale":"2024-05-10T03:39:26.075466+0000","last_undegraded":"2024-05-10T03:39:26.075466+0000","last_fullsized":"2024-05-10T03:39:26.075466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:18:02.773737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073900+0000","last_change":"2024-05-10T03:38:40.605956+0000","last_active":"2024-05-10T03:39:26.073900+0000","last_peered":"2024-05-10T03:39:26.073900+0000","last_clean":"2024-05-10T03:39:26.073900+0000","last_became_active":"2024-05-10T03:38:40.605466+0000","last_became_peered":"2024-05-10T03:38:40.605466+0000","last_unstale":"2024-05-10T03:39:26.073900+0000","last_undegraded":"2024-05-10T03:39:26.073900+0000","last_fullsized":"2024-05-10T03:39:26.073900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:07:44.234771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"88'38","reported_seq":248,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:40:19.161790+0000","last_change":"2024-05-10T03:39:27.083993+0000","last_active":"2024-05-10T03:40:19.161790+0000","last_peered":"2024-05-10T03:40:19.161790+0000","last_clean":"2024-05-10T03:40:19.161790+0000","last_became_active":"2024-05-10T03:39:27.075982+0000","last_became_peered":"2024-05-10T03:39:27.075982+0000","last_unstale":"2024-05-10T03:40:19.161790+0000","last_undegraded":"2024-05-10T03:40:19.161790+0000","last_fullsized":"2024-05-10T03:40:19.161790+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:10:49.852271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70460,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":166,"num_read_kb":151,"num_write":40,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":63312,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075545+0000","last_change":"2024-05-10T03:38:36.579560+0000","last_active":"2024-05-10T03:39:26.075545+0000","last_peered":"2024-05-10T03:39:26.075545+0000","last_clean":"2024-05-10T03:39:26.075545+0000","last_became_active":"2024-05-10T03:38:36.579217+0000","last_became_peered":"2024-05-10T03:38:36.579217+0000","last_unstale":"2024-05-10T03:39:26.075545+0000","last_undegraded":"2024-05-10T03:39:26.075545+0000","last_fullsized":"2024-05-10T03:39:26.075545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:11:50.208794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076114+0000","last_change":"2024-05-10T03:38:40.599253+0000","last_active":"2024-05-10T03:39:26.076114+0000","last_peered":"2024-05-10T03:39:26.076114+0000","last_clean":"2024-05-10T03:39:26.076114+0000","last_became_active":"2024-05-10T03:38:40.597818+0000","last_became_peered":"2024-05-10T03:38:40.597818+0000","last_unstale":"2024-05-10T03:39:26.076114+0000","last_undegraded":"2024-05-10T03:39:26.076114+0000","last_fullsized":"2024-05-10T03:39:26.076114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:48:37.286108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073316+0000","last_change":"2024-05-10T03:38:36.100727+0000","last_active":"2024-05-10T03:39:26.073316+0000","last_peered":"2024-05-10T03:39:26.073316+0000","last_clean":"2024-05-10T03:39:26.073316+0000","last_became_active":"2024-05-10T03:38:36.100381+0000","last_became_peered":"2024-05-10T03:38:36.100381+0000","last_unstale":"2024-05-10T03:39:26.073316+0000","last_undegraded":"2024-05-10T03:39:26.073316+0000","last_fullsized":"2024-05-10T03:39:26.073316+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:57:53.831417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.069729+0000","last_change":"2024-05-10T03:38:36.580924+0000","last_active":"2024-05-10T03:39:26.069729+0000","last_peered":"2024-05-10T03:39:26.069729+0000","last_clean":"2024-05-10T03:39:26.069729+0000","last_became_active":"2024-05-10T03:38:36.580598+0000","last_became_peered":"2024-05-10T03:38:36.580598+0000","last_unstale":"2024-05-10T03:39:26.069729+0000","last_undegraded":"2024-05-10T03:39:26.069729+0000","last_fullsized":"2024-05-10T03:39:26.069729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:33:12.007718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077561+0000","last_change":"2024-05-10T03:38:40.606934+0000","last_active":"2024-05-10T03:39:26.077561+0000","last_peered":"2024-05-10T03:39:26.077561+0000","last_clean":"2024-05-10T03:39:26.077561+0000","last_became_active":"2024-05-10T03:38:40.606451+0000","last_became_peered":"2024-05-10T03:38:40.606451+0000","last_unstale":"2024-05-10T03:39:26.077561+0000","last_undegraded":"2024-05-10T03:39:26.077561+0000","last_fullsized":"2024-05-10T03:39:26.077561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:03:43.562337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073308+0000","last_change":"2024-05-10T03:38:36.093109+0000","last_active":"2024-05-10T03:39:26.073308+0000","last_peered":"2024-05-10T03:39:26.073308+0000","last_clean":"2024-05-10T03:39:26.073308+0000","last_became_active":"2024-05-10T03:38:36.092623+0000","last_became_peered":"2024-05-10T03:38:36.092623+0000","last_unstale":"2024-05-10T03:39:26.073308+0000","last_undegraded":"2024-05-10T03:39:26.073308+0000","last_fullsized":"2024-05-10T03:39:26.073308+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:27:10.367098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.079173+0000","last_change":"2024-05-10T03:38:36.582794+0000","last_active":"2024-05-10T03:39:26.079173+0000","last_peered":"2024-05-10T03:39:26.079173+0000","last_clean":"2024-05-10T03:39:26.079173+0000","last_became_active":"2024-05-10T03:38:36.582464+0000","last_became_peered":"2024-05-10T03:38:36.582464+0000","last_unstale":"2024-05-10T03:39:26.079173+0000","last_undegraded":"2024-05-10T03:39:26.079173+0000","last_fullsized":"2024-05-10T03:39:26.079173+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:58:19.665485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074568+0000","last_change":"2024-05-10T03:38:40.608696+0000","last_active":"2024-05-10T03:39:26.074568+0000","last_peered":"2024-05-10T03:39:26.074568+0000","last_clean":"2024-05-10T03:39:26.074568+0000","last_became_active":"2024-05-10T03:38:40.607868+0000","last_became_peered":"2024-05-10T03:38:40.607868+0000","last_unstale":"2024-05-10T03:39:26.074568+0000","last_undegraded":"2024-05-10T03:39:26.074568+0000","last_fullsized":"2024-05-10T03:39:26.074568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:27.154675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":101,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:40:14.148862+0000","last_change":"2024-05-10T03:38:36.093060+0000","last_active":"2024-05-10T03:40:14.148862+0000","last_peered":"2024-05-10T03:40:14.148862+0000","last_clean":"2024-05-10T03:40:14.148862+0000","last_became_active":"2024-05-10T03:38:36.092476+0000","last_became_peered":"2024-05-10T03:38:36.092476+0000","last_unstale":"2024-05-10T03:40:14.148862+0000","last_undegraded":"2024-05-10T03:40:14.148862+0000","last_fullsized":"2024-05-10T03:40:14.148862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:52:04.624230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":79,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078407+0000","last_change":"2024-05-10T03:38:36.594808+0000","last_active":"2024-05-10T03:39:26.078407+0000","last_peered":"2024-05-10T03:39:26.078407+0000","last_clean":"2024-05-10T03:39:26.078407+0000","last_became_active":"2024-05-10T03:38:36.594511+0000","last_became_peered":"2024-05-10T03:38:36.594511+0000","last_unstale":"2024-05-10T03:39:26.078407+0000","last_undegraded":"2024-05-10T03:39:26.078407+0000","last_fullsized":"2024-05-10T03:39:26.078407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:18:59.981485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070877+0000","last_change":"2024-05-10T03:38:40.605744+0000","last_active":"2024-05-10T03:39:26.070877+0000","last_peered":"2024-05-10T03:39:26.070877+0000","last_clean":"2024-05-10T03:39:26.070877+0000","last_became_active":"2024-05-10T03:38:40.605269+0000","last_became_peered":"2024-05-10T03:38:40.605269+0000","last_unstale":"2024-05-10T03:39:26.070877+0000","last_undegraded":"2024-05-10T03:39:26.070877+0000","last_fullsized":"2024-05-10T03:39:26.070877+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:41:21.881903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074955+0000","last_change":"2024-05-10T03:38:36.098918+0000","last_active":"2024-05-10T03:39:26.074955+0000","last_peered":"2024-05-10T03:39:26.074955+0000","last_clean":"2024-05-10T03:39:26.074955+0000","last_became_active":"2024-05-10T03:38:36.098586+0000","last_became_peered":"2024-05-10T03:38:36.098586+0000","last_unstale":"2024-05-10T03:39:26.074955+0000","last_undegraded":"2024-05-10T03:39:26.074955+0000","last_fullsized":"2024-05-10T03:39:26.074955+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:58:48.297763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072973+0000","last_change":"2024-05-10T03:38:36.581347+0000","last_active":"2024-05-10T03:39:26.072973+0000","last_peered":"2024-05-10T03:39:26.072973+0000","last_clean":"2024-05-10T03:39:26.072973+0000","last_became_active":"2024-05-10T03:38:36.581044+0000","last_became_peered":"2024-05-10T03:38:36.581044+0000","last_unstale":"2024-05-10T03:39:26.072973+0000","last_undegraded":"2024-05-10T03:39:26.072973+0000","last_fullsized":"2024-05-10T03:39:26.072973+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:23:43.885238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072974+0000","last_change":"2024-05-10T03:38:40.600521+0000","last_active":"2024-05-10T03:39:26.072974+0000","last_peered":"2024-05-10T03:39:26.072974+0000","last_clean":"2024-05-10T03:39:26.072974+0000","last_became_active":"2024-05-10T03:38:40.600016+0000","last_became_peered":"2024-05-10T03:38:40.600016+0000","last_unstale":"2024-05-10T03:39:26.072974+0000","last_undegraded":"2024-05-10T03:39:26.072974+0000","last_fullsized":"2024-05-10T03:39:26.072974+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:58:37.881367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075200+0000","last_change":"2024-05-10T03:38:36.094209+0000","last_active":"2024-05-10T03:39:26.075200+0000","last_peered":"2024-05-10T03:39:26.075200+0000","last_clean":"2024-05-10T03:39:26.075200+0000","last_became_active":"2024-05-10T03:38:36.093447+0000","last_became_peered":"2024-05-10T03:38:36.093447+0000","last_unstale":"2024-05-10T03:39:26.075200+0000","last_undegraded":"2024-05-10T03:39:26.075200+0000","last_fullsized":"2024-05-10T03:39:26.075200+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:24:20.540340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077847+0000","last_change":"2024-05-10T03:38:36.587832+0000","last_active":"2024-05-10T03:39:26.077847+0000","last_peered":"2024-05-10T03:39:26.077847+0000","last_clean":"2024-05-10T03:39:26.077847+0000","last_became_active":"2024-05-10T03:38:36.587475+0000","last_became_peered":"2024-05-10T03:38:36.587475+0000","last_unstale":"2024-05-10T03:39:26.077847+0000","last_undegraded":"2024-05-10T03:39:26.077847+0000","last_fullsized":"2024-05-10T03:39:26.077847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:47:53.318634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076509+0000","last_change":"2024-05-10T03:38:41.150879+0000","last_active":"2024-05-10T03:39:26.076509+0000","last_peered":"2024-05-10T03:39:26.076509+0000","last_clean":"2024-05-10T03:39:26.076509+0000","last_became_active":"2024-05-10T03:38:41.150350+0000","last_became_peered":"2024-05-10T03:38:41.150350+0000","last_unstale":"2024-05-10T03:39:26.076509+0000","last_undegraded":"2024-05-10T03:39:26.076509+0000","last_fullsized":"2024-05-10T03:39:26.076509+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:47:32.429040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074172+0000","last_change":"2024-05-10T03:38:36.095933+0000","last_active":"2024-05-10T03:39:26.074172+0000","last_peered":"2024-05-10T03:39:26.074172+0000","last_clean":"2024-05-10T03:39:26.074172+0000","last_became_active":"2024-05-10T03:38:36.095592+0000","last_became_peered":"2024-05-10T03:38:36.095592+0000","last_unstale":"2024-05-10T03:39:26.074172+0000","last_undegraded":"2024-05-10T03:39:26.074172+0000","last_fullsized":"2024-05-10T03:39:26.074172+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:52:21.729051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072554+0000","last_change":"2024-05-10T03:38:36.591747+0000","last_active":"2024-05-10T03:39:26.072554+0000","last_peered":"2024-05-10T03:39:26.072554+0000","last_clean":"2024-05-10T03:39:26.072554+0000","last_became_active":"2024-05-10T03:38:36.591432+0000","last_became_peered":"2024-05-10T03:38:36.591432+0000","last_unstale":"2024-05-10T03:39:26.072554+0000","last_undegraded":"2024-05-10T03:39:26.072554+0000","last_fullsized":"2024-05-10T03:39:26.072554+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:20:37.549054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070521+0000","last_change":"2024-05-10T03:38:40.597535+0000","last_active":"2024-05-10T03:39:26.070521+0000","last_peered":"2024-05-10T03:39:26.070521+0000","last_clean":"2024-05-10T03:39:26.070521+0000","last_became_active":"2024-05-10T03:38:40.597108+0000","last_became_peered":"2024-05-10T03:38:40.597108+0000","last_unstale":"2024-05-10T03:39:26.070521+0000","last_undegraded":"2024-05-10T03:39:26.070521+0000","last_fullsized":"2024-05-10T03:39:26.070521+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:31:21.765071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":100,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:40:13.128914+0000","last_change":"2024-05-10T03:38:36.099238+0000","last_active":"2024-05-10T03:40:13.128914+0000","last_peered":"2024-05-10T03:40:13.128914+0000","last_clean":"2024-05-10T03:40:13.128914+0000","last_became_active":"2024-05-10T03:38:36.098761+0000","last_became_peered":"2024-05-10T03:38:36.098761+0000","last_unstale":"2024-05-10T03:40:13.128914+0000","last_undegraded":"2024-05-10T03:40:13.128914+0000","last_fullsized":"2024-05-10T03:40:13.128914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:08:49.892665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072990+0000","last_change":"2024-05-10T03:38:36.580983+0000","last_active":"2024-05-10T03:39:26.072990+0000","last_peered":"2024-05-10T03:39:26.072990+0000","last_clean":"2024-05-10T03:39:26.072990+0000","last_became_active":"2024-05-10T03:38:36.580252+0000","last_became_peered":"2024-05-10T03:38:36.580252+0000","last_unstale":"2024-05-10T03:39:26.072990+0000","last_undegraded":"2024-05-10T03:39:26.072990+0000","last_fullsized":"2024-05-10T03:39:26.072990+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:16.265473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070165+0000","last_change":"2024-05-10T03:38:41.148651+0000","last_active":"2024-05-10T03:39:26.070165+0000","last_peered":"2024-05-10T03:39:26.070165+0000","last_clean":"2024-05-10T03:39:26.070165+0000","last_became_active":"2024-05-10T03:38:41.148192+0000","last_became_peered":"2024-05-10T03:38:41.148192+0000","last_unstale":"2024-05-10T03:39:26.070165+0000","last_undegraded":"2024-05-10T03:39:26.070165+0000","last_fullsized":"2024-05-10T03:39:26.070165+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:13:38.795763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072565+0000","last_change":"2024-05-10T03:38:36.577839+0000","last_active":"2024-05-10T03:39:26.072565+0000","last_peered":"2024-05-10T03:39:26.072565+0000","last_clean":"2024-05-10T03:39:26.072565+0000","last_became_active":"2024-05-10T03:38:36.576917+0000","last_became_peered":"2024-05-10T03:38:36.576917+0000","last_unstale":"2024-05-10T03:39:26.072565+0000","last_undegraded":"2024-05-10T03:39:26.072565+0000","last_fullsized":"2024-05-10T03:39:26.072565+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:52:05.825241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":103,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:40:16.151486+0000","last_change":"2024-05-10T03:38:36.099138+0000","last_active":"2024-05-10T03:40:16.151486+0000","last_peered":"2024-05-10T03:40:16.151486+0000","last_clean":"2024-05-10T03:40:16.151486+0000","last_became_active":"2024-05-10T03:38:36.098747+0000","last_became_peered":"2024-05-10T03:38:36.098747+0000","last_unstale":"2024-05-10T03:40:16.151486+0000","last_undegraded":"2024-05-10T03:40:16.151486+0000","last_fullsized":"2024-05-10T03:40:16.151486+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:18.236383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":79,"num_read_kb":79,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078995+0000","last_change":"2024-05-10T03:38:40.605489+0000","last_active":"2024-05-10T03:39:26.078995+0000","last_peered":"2024-05-10T03:39:26.078995+0000","last_clean":"2024-05-10T03:39:26.078995+0000","last_became_active":"2024-05-10T03:38:40.605040+0000","last_became_peered":"2024-05-10T03:38:40.605040+0000","last_unstale":"2024-05-10T03:39:26.078995+0000","last_undegraded":"2024-05-10T03:39:26.078995+0000","last_fullsized":"2024-05-10T03:39:26.078995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:52:08.592132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077045+0000","last_change":"2024-05-10T03:38:36.589325+0000","last_active":"2024-05-10T03:39:26.077045+0000","last_peered":"2024-05-10T03:39:26.077045+0000","last_clean":"2024-05-10T03:39:26.077045+0000","last_became_active":"2024-05-10T03:38:36.588976+0000","last_became_peered":"2024-05-10T03:38:36.588976+0000","last_unstale":"2024-05-10T03:39:26.077045+0000","last_undegraded":"2024-05-10T03:39:26.077045+0000","last_fullsized":"2024-05-10T03:39:26.077045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:40.849614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067440+0000","last_change":"2024-05-10T03:38:36.093701+0000","last_active":"2024-05-10T03:39:26.067440+0000","last_peered":"2024-05-10T03:39:26.067440+0000","last_clean":"2024-05-10T03:39:26.067440+0000","last_became_active":"2024-05-10T03:38:36.093362+0000","last_became_peered":"2024-05-10T03:38:36.093362+0000","last_unstale":"2024-05-10T03:39:26.067440+0000","last_undegraded":"2024-05-10T03:39:26.067440+0000","last_fullsized":"2024-05-10T03:39:26.067440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:42:00.208900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":330,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078251+0000","last_change":"2024-05-10T03:37:46.762875+0000","last_active":"2024-05-10T03:39:26.078251+0000","last_peered":"2024-05-10T03:39:26.078251+0000","last_clean":"2024-05-10T03:39:26.078251+0000","last_became_active":"2024-05-10T03:37:46.762448+0000","last_became_peered":"2024-05-10T03:37:46.762448+0000","last_unstale":"2024-05-10T03:39:26.078251+0000","last_undegraded":"2024-05-10T03:39:26.078251+0000","last_fullsized":"2024-05-10T03:39:26.078251+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:35:20.340567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:35:20.340567+0000","last_clean_scrub_stamp":"2024-05-10T03:35:20.340567+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:09:05.491303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.073007+0000","last_change":"2024-05-10T03:38:41.150966+0000","last_active":"2024-05-10T03:39:26.073007+0000","last_peered":"2024-05-10T03:39:26.073007+0000","last_clean":"2024-05-10T03:39:26.073007+0000","last_became_active":"2024-05-10T03:38:41.150505+0000","last_became_peered":"2024-05-10T03:38:41.150505+0000","last_unstale":"2024-05-10T03:39:26.073007+0000","last_undegraded":"2024-05-10T03:39:26.073007+0000","last_fullsized":"2024-05-10T03:39:26.073007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:47:53.992369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.069834+0000","last_change":"2024-05-10T03:38:36.577457+0000","last_active":"2024-05-10T03:39:26.069834+0000","last_peered":"2024-05-10T03:39:26.069834+0000","last_clean":"2024-05-10T03:39:26.069834+0000","last_became_active":"2024-05-10T03:38:36.577105+0000","last_became_peered":"2024-05-10T03:38:36.577105+0000","last_unstale":"2024-05-10T03:39:26.069834+0000","last_undegraded":"2024-05-10T03:39:26.069834+0000","last_fullsized":"2024-05-10T03:39:26.069834+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:34:15.611496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078317+0000","last_change":"2024-05-10T03:38:36.094057+0000","last_active":"2024-05-10T03:39:26.078317+0000","last_peered":"2024-05-10T03:39:26.078317+0000","last_clean":"2024-05-10T03:39:26.078317+0000","last_became_active":"2024-05-10T03:38:36.093705+0000","last_became_peered":"2024-05-10T03:38:36.093705+0000","last_unstale":"2024-05-10T03:39:26.078317+0000","last_undegraded":"2024-05-10T03:39:26.078317+0000","last_fullsized":"2024-05-10T03:39:26.078317+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:00:10.138524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077005+0000","last_change":"2024-05-10T03:38:40.603522+0000","last_active":"2024-05-10T03:39:26.077005+0000","last_peered":"2024-05-10T03:39:26.077005+0000","last_clean":"2024-05-10T03:39:26.077005+0000","last_became_active":"2024-05-10T03:38:40.603058+0000","last_became_peered":"2024-05-10T03:38:40.603058+0000","last_unstale":"2024-05-10T03:39:26.077005+0000","last_undegraded":"2024-05-10T03:39:26.077005+0000","last_fullsized":"2024-05-10T03:39:26.077005+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:15:06.869163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075656+0000","last_change":"2024-05-10T03:38:36.099009+0000","last_active":"2024-05-10T03:39:26.075656+0000","last_peered":"2024-05-10T03:39:26.075656+0000","last_clean":"2024-05-10T03:39:26.075656+0000","last_became_active":"2024-05-10T03:38:36.098695+0000","last_became_peered":"2024-05-10T03:38:36.098695+0000","last_unstale":"2024-05-10T03:39:26.075656+0000","last_undegraded":"2024-05-10T03:39:26.075656+0000","last_fullsized":"2024-05-10T03:39:26.075656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:06.634752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070881+0000","last_change":"2024-05-10T03:38:36.576498+0000","last_active":"2024-05-10T03:39:26.070881+0000","last_peered":"2024-05-10T03:39:26.070881+0000","last_clean":"2024-05-10T03:39:26.070881+0000","last_became_active":"2024-05-10T03:38:36.576161+0000","last_became_peered":"2024-05-10T03:38:36.576161+0000","last_unstale":"2024-05-10T03:39:26.070881+0000","last_undegraded":"2024-05-10T03:39:26.070881+0000","last_fullsized":"2024-05-10T03:39:26.070881+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:09.353279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076991+0000","last_change":"2024-05-10T03:38:41.148317+0000","last_active":"2024-05-10T03:39:26.076991+0000","last_peered":"2024-05-10T03:39:26.076991+0000","last_clean":"2024-05-10T03:39:26.076991+0000","last_became_active":"2024-05-10T03:38:41.147907+0000","last_became_peered":"2024-05-10T03:38:41.147907+0000","last_unstale":"2024-05-10T03:39:26.076991+0000","last_undegraded":"2024-05-10T03:39:26.076991+0000","last_fullsized":"2024-05-10T03:39:26.076991+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:23:08.157296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'9","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074498+0000","last_change":"2024-05-10T03:38:36.096437+0000","last_active":"2024-05-10T03:39:26.074498+0000","last_peered":"2024-05-10T03:39:26.074498+0000","last_clean":"2024-05-10T03:39:26.074498+0000","last_became_active":"2024-05-10T03:38:36.096122+0000","last_became_peered":"2024-05-10T03:38:36.096122+0000","last_unstale":"2024-05-10T03:39:26.074498+0000","last_undegraded":"2024-05-10T03:39:26.074498+0000","last_fullsized":"2024-05-10T03:39:26.074498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:47:02.400065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077474+0000","last_change":"2024-05-10T03:38:36.574022+0000","last_active":"2024-05-10T03:39:26.077474+0000","last_peered":"2024-05-10T03:39:26.077474+0000","last_clean":"2024-05-10T03:39:26.077474+0000","last_became_active":"2024-05-10T03:38:36.573530+0000","last_became_peered":"2024-05-10T03:38:36.573530+0000","last_unstale":"2024-05-10T03:39:26.077474+0000","last_undegraded":"2024-05-10T03:39:26.077474+0000","last_fullsized":"2024-05-10T03:39:26.077474+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:35:32.574897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072099+0000","last_change":"2024-05-10T03:38:40.600341+0000","last_active":"2024-05-10T03:39:26.072099+0000","last_peered":"2024-05-10T03:39:26.072099+0000","last_clean":"2024-05-10T03:39:26.072099+0000","last_became_active":"2024-05-10T03:38:40.599944+0000","last_became_peered":"2024-05-10T03:38:40.599944+0000","last_unstale":"2024-05-10T03:39:26.072099+0000","last_undegraded":"2024-05-10T03:39:26.072099+0000","last_fullsized":"2024-05-10T03:39:26.072099+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:12:01.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067765+0000","last_change":"2024-05-10T03:38:36.091020+0000","last_active":"2024-05-10T03:39:26.067765+0000","last_peered":"2024-05-10T03:39:26.067765+0000","last_clean":"2024-05-10T03:39:26.067765+0000","last_became_active":"2024-05-10T03:38:36.090699+0000","last_became_peered":"2024-05-10T03:38:36.090699+0000","last_unstale":"2024-05-10T03:39:26.067765+0000","last_undegraded":"2024-05-10T03:39:26.067765+0000","last_fullsized":"2024-05-10T03:39:26.067765+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:44:12.546166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067252+0000","last_change":"2024-05-10T03:38:36.584279+0000","last_active":"2024-05-10T03:39:26.067252+0000","last_peered":"2024-05-10T03:39:26.067252+0000","last_clean":"2024-05-10T03:39:26.067252+0000","last_became_active":"2024-05-10T03:38:36.583897+0000","last_became_peered":"2024-05-10T03:38:36.583897+0000","last_unstale":"2024-05-10T03:39:26.067252+0000","last_undegraded":"2024-05-10T03:39:26.067252+0000","last_fullsized":"2024-05-10T03:39:26.067252+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:33:17.210334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067474+0000","last_change":"2024-05-10T03:38:41.151023+0000","last_active":"2024-05-10T03:39:26.067474+0000","last_peered":"2024-05-10T03:39:26.067474+0000","last_clean":"2024-05-10T03:39:26.067474+0000","last_became_active":"2024-05-10T03:38:41.150489+0000","last_became_peered":"2024-05-10T03:38:41.150489+0000","last_unstale":"2024-05-10T03:39:26.067474+0000","last_undegraded":"2024-05-10T03:39:26.067474+0000","last_fullsized":"2024-05-10T03:39:26.067474+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:57:57.440139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074840+0000","last_change":"2024-05-10T03:38:36.098990+0000","last_active":"2024-05-10T03:39:26.074840+0000","last_peered":"2024-05-10T03:39:26.074840+0000","last_clean":"2024-05-10T03:39:26.074840+0000","last_became_active":"2024-05-10T03:38:36.098649+0000","last_became_peered":"2024-05-10T03:38:36.098649+0000","last_unstale":"2024-05-10T03:39:26.074840+0000","last_undegraded":"2024-05-10T03:39:26.074840+0000","last_fullsized":"2024-05-10T03:39:26.074840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:38:09.915041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075102+0000","last_change":"2024-05-10T03:38:36.581286+0000","last_active":"2024-05-10T03:39:26.075102+0000","last_peered":"2024-05-10T03:39:26.075102+0000","last_clean":"2024-05-10T03:39:26.075102+0000","last_became_active":"2024-05-10T03:38:36.580927+0000","last_became_peered":"2024-05-10T03:38:36.580927+0000","last_unstale":"2024-05-10T03:39:26.075102+0000","last_undegraded":"2024-05-10T03:39:26.075102+0000","last_fullsized":"2024-05-10T03:39:26.075102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:10:38.663239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074691+0000","last_change":"2024-05-10T03:38:40.605668+0000","last_active":"2024-05-10T03:39:26.074691+0000","last_peered":"2024-05-10T03:39:26.074691+0000","last_clean":"2024-05-10T03:39:26.074691+0000","last_became_active":"2024-05-10T03:38:40.605156+0000","last_became_peered":"2024-05-10T03:38:40.605156+0000","last_unstale":"2024-05-10T03:39:26.074691+0000","last_undegraded":"2024-05-10T03:39:26.074691+0000","last_fullsized":"2024-05-10T03:39:26.074691+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:28:07.192875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077182+0000","last_change":"2024-05-10T03:38:36.090250+0000","last_active":"2024-05-10T03:39:26.077182+0000","last_peered":"2024-05-10T03:39:26.077182+0000","last_clean":"2024-05-10T03:39:26.077182+0000","last_became_active":"2024-05-10T03:38:36.089899+0000","last_became_peered":"2024-05-10T03:38:36.089899+0000","last_unstale":"2024-05-10T03:39:26.077182+0000","last_undegraded":"2024-05-10T03:39:26.077182+0000","last_fullsized":"2024-05-10T03:39:26.077182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:01:19.322065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076480+0000","last_change":"2024-05-10T03:38:36.575272+0000","last_active":"2024-05-10T03:39:26.076480+0000","last_peered":"2024-05-10T03:39:26.076480+0000","last_clean":"2024-05-10T03:39:26.076480+0000","last_became_active":"2024-05-10T03:38:36.574919+0000","last_became_peered":"2024-05-10T03:38:36.574919+0000","last_unstale":"2024-05-10T03:39:26.076480+0000","last_undegraded":"2024-05-10T03:39:26.076480+0000","last_fullsized":"2024-05-10T03:39:26.076480+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:51:33.825933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067385+0000","last_change":"2024-05-10T03:38:40.609082+0000","last_active":"2024-05-10T03:39:26.067385+0000","last_peered":"2024-05-10T03:39:26.067385+0000","last_clean":"2024-05-10T03:39:26.067385+0000","last_became_active":"2024-05-10T03:38:40.608636+0000","last_became_peered":"2024-05-10T03:38:40.608636+0000","last_unstale":"2024-05-10T03:39:26.067385+0000","last_undegraded":"2024-05-10T03:39:26.067385+0000","last_fullsized":"2024-05-10T03:39:26.067385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:18:05.288472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.071676+0000","last_change":"2024-05-10T03:38:36.101001+0000","last_active":"2024-05-10T03:39:26.071676+0000","last_peered":"2024-05-10T03:39:26.071676+0000","last_clean":"2024-05-10T03:39:26.071676+0000","last_became_active":"2024-05-10T03:38:36.100658+0000","last_became_peered":"2024-05-10T03:38:36.100658+0000","last_unstale":"2024-05-10T03:39:26.071676+0000","last_undegraded":"2024-05-10T03:39:26.071676+0000","last_fullsized":"2024-05-10T03:39:26.071676+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:15:51.963956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077340+0000","last_change":"2024-05-10T03:38:36.579314+0000","last_active":"2024-05-10T03:39:26.077340+0000","last_peered":"2024-05-10T03:39:26.077340+0000","last_clean":"2024-05-10T03:39:26.077340+0000","last_became_active":"2024-05-10T03:38:36.578747+0000","last_became_peered":"2024-05-10T03:38:36.578747+0000","last_unstale":"2024-05-10T03:39:26.077340+0000","last_undegraded":"2024-05-10T03:39:26.077340+0000","last_fullsized":"2024-05-10T03:39:26.077340+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:05:25.814887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067380+0000","last_change":"2024-05-10T03:38:41.149022+0000","last_active":"2024-05-10T03:39:26.067380+0000","last_peered":"2024-05-10T03:39:26.067380+0000","last_clean":"2024-05-10T03:39:26.067380+0000","last_became_active":"2024-05-10T03:38:41.148606+0000","last_became_peered":"2024-05-10T03:38:41.148606+0000","last_unstale":"2024-05-10T03:39:26.067380+0000","last_undegraded":"2024-05-10T03:39:26.067380+0000","last_fullsized":"2024-05-10T03:39:26.067380+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:24.039761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.088000+0000","last_change":"2024-05-10T03:39:27.088000+0000","last_active":"2024-05-10T03:39:27.088000+0000","last_peered":"2024-05-10T03:39:27.088000+0000","last_clean":"2024-05-10T03:39:27.088000+0000","last_became_active":"2024-05-10T03:39:27.078679+0000","last_became_peered":"2024-05-10T03:39:27.078679+0000","last_unstale":"2024-05-10T03:39:27.088000+0000","last_undegraded":"2024-05-10T03:39:27.088000+0000","last_fullsized":"2024-05-10T03:39:27.088000+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:15:32.644494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.078840+0000","last_change":"2024-05-10T03:38:36.587225+0000","last_active":"2024-05-10T03:39:26.078840+0000","last_peered":"2024-05-10T03:39:26.078840+0000","last_clean":"2024-05-10T03:39:26.078840+0000","last_became_active":"2024-05-10T03:38:36.586906+0000","last_became_peered":"2024-05-10T03:38:36.586906+0000","last_unstale":"2024-05-10T03:39:26.078840+0000","last_undegraded":"2024-05-10T03:39:26.078840+0000","last_fullsized":"2024-05-10T03:39:26.078840+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:07.128604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075048+0000","last_change":"2024-05-10T03:38:40.600918+0000","last_active":"2024-05-10T03:39:26.075048+0000","last_peered":"2024-05-10T03:39:26.075048+0000","last_clean":"2024-05-10T03:39:26.075048+0000","last_became_active":"2024-05-10T03:38:40.600508+0000","last_became_peered":"2024-05-10T03:38:40.600508+0000","last_unstale":"2024-05-10T03:39:26.075048+0000","last_undegraded":"2024-05-10T03:39:26.075048+0000","last_fullsized":"2024-05-10T03:39:26.075048+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:02:59.589310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"88'6","reported_seq":107,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:40:17.135689+0000","last_change":"2024-05-10T03:38:36.100013+0000","last_active":"2024-05-10T03:40:17.135689+0000","last_peered":"2024-05-10T03:40:17.135689+0000","last_clean":"2024-05-10T03:40:17.135689+0000","last_became_active":"2024-05-10T03:38:36.099581+0000","last_became_peered":"2024-05-10T03:38:36.099581+0000","last_unstale":"2024-05-10T03:40:17.135689+0000","last_undegraded":"2024-05-10T03:40:17.135689+0000","last_fullsized":"2024-05-10T03:40:17.135689+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:07.195555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1436,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.079287+0000","last_change":"2024-05-10T03:38:36.586813+0000","last_active":"2024-05-10T03:39:26.079287+0000","last_peered":"2024-05-10T03:39:26.079287+0000","last_clean":"2024-05-10T03:39:26.079287+0000","last_became_active":"2024-05-10T03:38:36.586264+0000","last_became_peered":"2024-05-10T03:38:36.586264+0000","last_unstale":"2024-05-10T03:39:26.079287+0000","last_undegraded":"2024-05-10T03:39:26.079287+0000","last_fullsized":"2024-05-10T03:39:26.079287+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:57:06.239509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.066683+0000","last_change":"2024-05-10T03:38:40.606897+0000","last_active":"2024-05-10T03:39:26.066683+0000","last_peered":"2024-05-10T03:39:26.066683+0000","last_clean":"2024-05-10T03:39:26.066683+0000","last_became_active":"2024-05-10T03:38:40.606339+0000","last_became_peered":"2024-05-10T03:38:40.606339+0000","last_unstale":"2024-05-10T03:39:26.066683+0000","last_undegraded":"2024-05-10T03:39:26.066683+0000","last_fullsized":"2024-05-10T03:39:26.066683+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:13.706744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074765+0000","last_change":"2024-05-10T03:38:36.100689+0000","last_active":"2024-05-10T03:39:26.074765+0000","last_peered":"2024-05-10T03:39:26.074765+0000","last_clean":"2024-05-10T03:39:26.074765+0000","last_became_active":"2024-05-10T03:38:36.100352+0000","last_became_peered":"2024-05-10T03:38:36.100352+0000","last_unstale":"2024-05-10T03:39:26.074765+0000","last_undegraded":"2024-05-10T03:39:26.074765+0000","last_fullsized":"2024-05-10T03:39:26.074765+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:53:45.926237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.266329+0000","last_change":"2024-05-10T03:39:27.266329+0000","last_active":"2024-05-10T03:39:27.266329+0000","last_peered":"2024-05-10T03:39:27.266329+0000","last_clean":"2024-05-10T03:39:27.266329+0000","last_became_active":"2024-05-10T03:39:27.265905+0000","last_became_peered":"2024-05-10T03:39:27.265905+0000","last_unstale":"2024-05-10T03:39:27.266329+0000","last_undegraded":"2024-05-10T03:39:27.266329+0000","last_fullsized":"2024-05-10T03:39:27.266329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:24.604276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,8],"acting":[7,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072213+0000","last_change":"2024-05-10T03:38:40.600719+0000","last_active":"2024-05-10T03:39:26.072213+0000","last_peered":"2024-05-10T03:39:26.072213+0000","last_clean":"2024-05-10T03:39:26.072213+0000","last_became_active":"2024-05-10T03:38:40.600240+0000","last_became_peered":"2024-05-10T03:38:40.600240+0000","last_unstale":"2024-05-10T03:39:26.072213+0000","last_undegraded":"2024-05-10T03:39:26.072213+0000","last_fullsized":"2024-05-10T03:39:26.072213+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:39.572512+0000","last_clean_scrub_stamp":"2024-05-10T03:38:39.572512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:41:47.877298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070778+0000","last_change":"2024-05-10T03:38:36.097691+0000","last_active":"2024-05-10T03:39:26.070778+0000","last_peered":"2024-05-10T03:39:26.070778+0000","last_clean":"2024-05-10T03:39:26.070778+0000","last_became_active":"2024-05-10T03:38:36.097266+0000","last_became_peered":"2024-05-10T03:38:36.097266+0000","last_unstale":"2024-05-10T03:39:26.070778+0000","last_undegraded":"2024-05-10T03:39:26.070778+0000","last_fullsized":"2024-05-10T03:39:26.070778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:35.068890+0000","last_clean_scrub_stamp":"2024-05-10T03:38:35.068890+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:27:57.272780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.079029+0000","last_change":"2024-05-10T03:38:36.575475+0000","last_active":"2024-05-10T03:39:26.079029+0000","last_peered":"2024-05-10T03:39:26.079029+0000","last_clean":"2024-05-10T03:39:26.079029+0000","last_became_active":"2024-05-10T03:38:36.575047+0000","last_became_peered":"2024-05-10T03:38:36.575047+0000","last_unstale":"2024-05-10T03:39:26.079029+0000","last_undegraded":"2024-05-10T03:39:26.079029+0000","last_fullsized":"2024-05-10T03:39:26.079029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:31:53.846070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077134+0000","last_change":"2024-05-10T03:38:36.585491+0000","last_active":"2024-05-10T03:39:26.077134+0000","last_peered":"2024-05-10T03:39:26.077134+0000","last_clean":"2024-05-10T03:39:26.077134+0000","last_became_active":"2024-05-10T03:38:36.585147+0000","last_became_peered":"2024-05-10T03:38:36.585147+0000","last_unstale":"2024-05-10T03:39:26.077134+0000","last_undegraded":"2024-05-10T03:39:26.077134+0000","last_fullsized":"2024-05-10T03:39:26.077134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:22.350420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072517+0000","last_change":"2024-05-10T03:38:36.584092+0000","last_active":"2024-05-10T03:39:26.072517+0000","last_peered":"2024-05-10T03:39:26.072517+0000","last_clean":"2024-05-10T03:39:26.072517+0000","last_became_active":"2024-05-10T03:38:36.583749+0000","last_became_peered":"2024-05-10T03:38:36.583749+0000","last_unstale":"2024-05-10T03:39:26.072517+0000","last_undegraded":"2024-05-10T03:39:26.072517+0000","last_fullsized":"2024-05-10T03:39:26.072517+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:10.882170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.071548+0000","last_change":"2024-05-10T03:38:36.573718+0000","last_active":"2024-05-10T03:39:26.071548+0000","last_peered":"2024-05-10T03:39:26.071548+0000","last_clean":"2024-05-10T03:39:26.071548+0000","last_became_active":"2024-05-10T03:38:36.573271+0000","last_became_peered":"2024-05-10T03:38:36.573271+0000","last_unstale":"2024-05-10T03:39:26.071548+0000","last_undegraded":"2024-05-10T03:39:26.071548+0000","last_fullsized":"2024-05-10T03:39:26.071548+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:38:13.798068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.067000+0000","last_change":"2024-05-10T03:38:36.576975+0000","last_active":"2024-05-10T03:39:26.067000+0000","last_peered":"2024-05-10T03:39:26.067000+0000","last_clean":"2024-05-10T03:39:26.067000+0000","last_became_active":"2024-05-10T03:38:36.576640+0000","last_became_peered":"2024-05-10T03:38:36.576640+0000","last_unstale":"2024-05-10T03:39:26.067000+0000","last_undegraded":"2024-05-10T03:39:26.067000+0000","last_fullsized":"2024-05-10T03:39:26.067000+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T03:48:42.975793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T03:39:27.077884+0000","last_change":"2024-05-10T03:39:27.077884+0000","last_active":"2024-05-10T03:39:27.077884+0000","last_peered":"2024-05-10T03:39:27.077884+0000","last_clean":"2024-05-10T03:39:27.077884+0000","last_became_active":"2024-05-10T03:39:27.077475+0000","last_became_peered":"2024-05-10T03:39:27.077475+0000","last_unstale":"2024-05-10T03:39:27.077884+0000","last_undegraded":"2024-05-10T03:39:27.077884+0000","last_fullsized":"2024-05-10T03:39:27.077884+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:21:35.216448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.076864+0000","last_change":"2024-05-10T03:38:36.589262+0000","last_active":"2024-05-10T03:39:26.076864+0000","last_peered":"2024-05-10T03:39:26.076864+0000","last_clean":"2024-05-10T03:39:26.076864+0000","last_became_active":"2024-05-10T03:38:36.588950+0000","last_became_peered":"2024-05-10T03:38:36.588950+0000","last_unstale":"2024-05-10T03:39:26.076864+0000","last_undegraded":"2024-05-10T03:39:26.076864+0000","last_fullsized":"2024-05-10T03:39:26.076864+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:08:43.124035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.074184+0000","last_change":"2024-05-10T03:38:36.590472+0000","last_active":"2024-05-10T03:39:26.074184+0000","last_peered":"2024-05-10T03:39:26.074184+0000","last_clean":"2024-05-10T03:39:26.074184+0000","last_became_active":"2024-05-10T03:38:36.590115+0000","last_became_peered":"2024-05-10T03:38:36.590115+0000","last_unstale":"2024-05-10T03:39:26.074184+0000","last_undegraded":"2024-05-10T03:39:26.074184+0000","last_fullsized":"2024-05-10T03:39:26.074184+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:33:37.982529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077634+0000","last_change":"2024-05-10T03:38:36.575958+0000","last_active":"2024-05-10T03:39:26.077634+0000","last_peered":"2024-05-10T03:39:26.077634+0000","last_clean":"2024-05-10T03:39:26.077634+0000","last_became_active":"2024-05-10T03:38:36.572958+0000","last_became_peered":"2024-05-10T03:38:36.572958+0000","last_unstale":"2024-05-10T03:39:26.077634+0000","last_undegraded":"2024-05-10T03:39:26.077634+0000","last_fullsized":"2024-05-10T03:39:26.077634+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:30:39.111371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.072295+0000","last_change":"2024-05-10T03:38:36.578225+0000","last_active":"2024-05-10T03:39:26.072295+0000","last_peered":"2024-05-10T03:39:26.072295+0000","last_clean":"2024-05-10T03:39:26.072295+0000","last_became_active":"2024-05-10T03:38:36.575920+0000","last_became_peered":"2024-05-10T03:38:36.575920+0000","last_unstale":"2024-05-10T03:39:26.072295+0000","last_undegraded":"2024-05-10T03:39:26.072295+0000","last_fullsized":"2024-05-10T03:39:26.072295+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:54:53.999971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077198+0000","last_change":"2024-05-10T03:38:36.577720+0000","last_active":"2024-05-10T03:39:26.077198+0000","last_peered":"2024-05-10T03:39:26.077198+0000","last_clean":"2024-05-10T03:39:26.077198+0000","last_became_active":"2024-05-10T03:38:36.577360+0000","last_became_peered":"2024-05-10T03:38:36.577360+0000","last_unstale":"2024-05-10T03:39:26.077198+0000","last_undegraded":"2024-05-10T03:39:26.077198+0000","last_fullsized":"2024-05-10T03:39:26.077198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:35:59.787050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.075148+0000","last_change":"2024-05-10T03:38:36.588941+0000","last_active":"2024-05-10T03:39:26.075148+0000","last_peered":"2024-05-10T03:39:26.075148+0000","last_clean":"2024-05-10T03:39:26.075148+0000","last_became_active":"2024-05-10T03:38:36.587884+0000","last_became_peered":"2024-05-10T03:38:36.587884+0000","last_unstale":"2024-05-10T03:39:26.075148+0000","last_undegraded":"2024-05-10T03:39:26.075148+0000","last_fullsized":"2024-05-10T03:39:26.075148+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:26:10.064473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.070771+0000","last_change":"2024-05-10T03:38:36.578917+0000","last_active":"2024-05-10T03:39:26.070771+0000","last_peered":"2024-05-10T03:39:26.070771+0000","last_clean":"2024-05-10T03:39:26.070771+0000","last_became_active":"2024-05-10T03:38:36.578508+0000","last_became_peered":"2024-05-10T03:38:36.578508+0000","last_unstale":"2024-05-10T03:39:26.070771+0000","last_undegraded":"2024-05-10T03:39:26.070771+0000","last_fullsized":"2024-05-10T03:39:26.070771+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:47.670854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-10T03:39:26.077705+0000","last_change":"2024-05-10T03:38:36.578410+0000","last_active":"2024-05-10T03:39:26.077705+0000","last_peered":"2024-05-10T03:39:26.077705+0000","last_clean":"2024-05-10T03:39:26.077705+0000","last_became_active":"2024-05-10T03:38:36.578055+0000","last_became_peered":"2024-05-10T03:38:36.578055+0000","last_unstale":"2024-05-10T03:39:26.077705+0000","last_undegraded":"2024-05-10T03:39:26.077705+0000","last_fullsized":"2024-05-10T03:39:26.077705+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:38:36.070857+0000","last_clean_scrub_stamp":"2024-05-10T03:38:36.070857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:39:03.551019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":77397,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":821,"num_read_kb":496,"num_write":240,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":63894,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":232191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514526,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":999424,"data_stored":488705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.60599999999999998,"15min":0.57999999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":3.4089999999999998,"5min":3.4089999999999998,"15min":3.4089999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.56000000000000005,"15min":0.54900000000000004},"min":{"1min":0.44500000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.46500000000000002}]},{"osd":1,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67100000000000004,"15min":0.66600000000000004},"min":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51000000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83499999999999996,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.73199999999999998}]},{"osd":2,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.39800000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.67000000000000004,"5min":1.095,"15min":1.095},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.375,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":4,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.55400000000000005,"5min":0.433,"15min":0.433},"max":{"1min":0.91100000000000003,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.85399999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.66000000000000003}]},{"osd":5,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.64100000000000001,"15min":0.64900000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78200000000000003,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.71099999999999997,"15min":0.71599999999999997},"min":{"1min":0.46400000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.49399999999999999}]},{"osd":6,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.73999999999999999,"15min":0.72899999999999998},"min":{"1min":0.54900000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.56699999999999995},{"interface":"front","average":{"1min":1.236,"5min":0.84599999999999997,"15min":0.78100000000000003},"min":{"1min":0.51000000000000001,"5min":0.495,"15min":0.495},"max":{"1min":9.4440000000000008,"5min":9.4440000000000008,"15min":9.4440000000000008},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.83699999999999997,"15min":0.83599999999999997},"min":{"1min":0.68300000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.024,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.84799999999999998,"15min":0.85399999999999998},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.95999999999999996,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.69999999999999996}]},{"osd":8,"last update":"Fri May 10 03:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.63},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.82399999999999995}]},{"osd":9,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":0.92400000000000004,"15min":0.85599999999999998},"min":{"1min":0.67900000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":9.6400000000000006,"5min":9.6400000000000006,"15min":9.6400000000000006},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.006,"5min":0.878,"15min":0.85599999999999998},"min":{"1min":0.70899999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":3.371,"5min":3.371,"15min":3.371},"last":0.64400000000000002}]},{"osd":10,"last update":"Fri May 10 03:40:02 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.88,"15min":0.88100000000000001},"min":{"1min":0.76900000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.0329999999999999,"5min":1.379,"15min":1.379},"last":0.754},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.84799999999999998,"15min":0.84999999999999998},"min":{"1min":0.66100000000000003,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.052,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.85099999999999998}]}]},{"osd":10,"up_from":69,"seq":296352743459,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28676,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716476,"statfs":{"total":95995035648,"available":95965671424,"internally_reserved":0,"allocated":1699840,"data_stored":1145085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1598,"internal_metadata":27654594},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.441},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.67200000000000004}]},{"osd":1,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46500000000000002,"15min":0.46400000000000002},"min":{"1min":0.32900000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.309},{"interface":"front","average":{"1min":0.504,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.38200000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68999999999999995,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.38300000000000001}]},{"osd":2,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.62,"15min":0.61599999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.81699999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.48399999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.625,"15min":0.63300000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74299999999999999,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64500000000000002,"15min":0.64900000000000002},"min":{"1min":0.49099999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86099999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.46700000000000003}]},{"osd":4,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.37,"5min":0.313,"15min":0.313},"max":{"1min":0.77800000000000002,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.433,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78100000000000003,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.35099999999999998}]},{"osd":5,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68200000000000005,"15min":0.68000000000000005},"min":{"1min":0.52100000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69999999999999996,"15min":0.69799999999999995},"min":{"1min":0.437,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95599999999999996,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.57199999999999995}]},{"osd":6,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.76100000000000001,"15min":0.77000000000000002},"min":{"1min":0.53500000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.012,"5min":1.026,"15min":1.026},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73799999999999999,"15min":0.73699999999999999},"min":{"1min":0.58799999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":8,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76200000000000001,"15min":0.76000000000000001},"min":{"1min":0.55800000000000005,"5min":0.498,"15min":0.498},"max":{"1min":0.94499999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.57899999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.99199999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.65100000000000002}]},{"osd":9,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81200000000000006,"15min":0.81399999999999995},"min":{"1min":0.61199999999999999,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.97599999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.81999999999999995,"15min":0.82799999999999996},"min":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.90900000000000003,"5min":1.216,"15min":1.216},"last":0.73999999999999999}]},{"osd":11,"last update":"Fri May 10 03:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.59999999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.92400000000000004,"5min":1.169,"15min":1.169},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79600000000000004,"15min":0.80000000000000004},"min":{"1min":0.56799999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.91800000000000004,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.63100000000000001}]}]},{"osd":9,"up_from":64,"seq":274877906982,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":1024000,"data_stored":491883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36043201},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.53900000000000003,"15min":0.55100000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.63600000000000001,"5min":0.879,"15min":0.879},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.57599999999999996,"15min":0.58799999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.93899999999999995,"5min":1.171,"15min":1.171},"last":0.42799999999999999}]},{"osd":1,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67600000000000005,"15min":0.67700000000000005},"min":{"1min":0.40699999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96999999999999997,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71299999999999997,"15min":0.72499999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.77500000000000002,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.68899999999999995}]},{"osd":2,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.76200000000000001,"15min":0.78400000000000003},"min":{"1min":0.52600000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.76900000000000002,"5min":1.137,"15min":1.137},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.78500000000000003,"15min":0.80800000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.84599999999999997,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.45400000000000001}]},{"osd":3,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.68500000000000005,"15min":0.70199999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.65000000000000002,"15min":0.67100000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82199999999999995,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.46300000000000002}]},{"osd":4,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88300000000000001,"5min":1.147,"15min":1.147},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76200000000000001,"15min":0.76600000000000001},"min":{"1min":0.54700000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.88100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.83899999999999997,"15min":0.85899999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.86699999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.502},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.86299999999999999,"15min":0.89200000000000002},"min":{"1min":0.54700000000000004,"5min":0.501,"15min":0.501},"max":{"1min":0.90500000000000003,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.65500000000000003}]},{"osd":6,"last update":"Fri May 10 03:38:30 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.51100000000000001}]},{"osd":7,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.91200000000000003,"15min":0.93799999999999994},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.997,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.94099999999999995,"15min":0.96899999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0169999999999999,"5min":1.377,"15min":1.377},"last":0.78100000000000003}]},{"osd":8,"last update":"Fri May 10 03:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.94799999999999995,"15min":0.98199999999999998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.92500000000000004,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.98599999999999999,"15min":1.01},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1140000000000001,"5min":1.579,"15min":1.579},"last":0.64200000000000002}]},{"osd":10,"last update":"Fri May 10 03:39:46 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.91600000000000004,"15min":0.93799999999999994},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0569999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.95499999999999996,"15min":0.96699999999999997},"min":{"1min":0.73699999999999999,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.093,"5min":1.385,"15min":1.385},"last":0.70699999999999996}]},{"osd":11,"last update":"Fri May 10 03:39:41 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.85499999999999998}]}]},{"osd":8,"up_from":57,"seq":244813135914,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1007616,"data_stored":487252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:40:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55900000000000005,"15min":0.55300000000000005},"min":{"1min":0.375,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.74099999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.56299999999999994,"15min":0.55100000000000005},"min":{"1min":0.40899999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84599999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.53500000000000003}]},{"osd":1,"last update":"Fri May 10 03:40:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65000000000000002,"15min":0.64400000000000002},"min":{"1min":0.46300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85699999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.626,"15min":0.61299999999999999},"min":{"1min":0.501,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91000000000000003,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.71199999999999997}]},{"osd":2,"last update":"Fri May 10 03:40:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.48499999999999999,"15min":0.46999999999999997},"min":{"1min":0.34499999999999997,"5min":0.313,"15min":0.313},"max":{"1min":0.754,"5min":0.755,"15min":0.755},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.41799999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.85299999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.56499999999999995}]},{"osd":3,"last update":"Fri May 10 03:40:13 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.64000000000000001,"15min":0.60699999999999998},"min":{"1min":0.46600000000000003,"5min":0.376,"15min":0.376},"max":{"1min":3.7629999999999999,"5min":3.7629999999999999,"15min":3.7629999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.627,"15min":0.61499999999999999},"min":{"1min":0.46899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri May 10 03:40:13 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.63700000000000001,"15min":0.626},"min":{"1min":0.52100000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89100000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.69299999999999995,"15min":0.68200000000000005},"min":{"1min":0.49199999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.94199999999999995,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.58499999999999996}]},{"osd":5,"last update":"Fri May 10 03:40:13 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.37,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.39100000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.88900000000000001,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.60199999999999998}]},{"osd":6,"last update":"Fri May 10 03:40:13 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.68799999999999994,"15min":0.66700000000000004},"min":{"1min":0.51900000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72099999999999997,"15min":0.71799999999999997},"min":{"1min":0.54100000000000004,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88900000000000001,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.79300000000000004}]},{"osd":7,"last update":"Fri May 10 03:40:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.74099999999999999,"15min":0.73499999999999999},"min":{"1min":0.64300000000000002,"5min":0.498,"15min":0.498},"max":{"1min":0.94099999999999995,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.629},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.76300000000000001,"15min":0.749},"min":{"1min":0.64400000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.048,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.67900000000000005}]},{"osd":9,"last update":"Fri May 10 03:39:30 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.749,"15min":0.73299999999999998},"min":{"1min":0.61199999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.75600000000000001,"15min":0.73799999999999999},"min":{"1min":0.67500000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.70099999999999996}]},{"osd":10,"last update":"Fri May 10 03:39:49 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.79000000000000004,"15min":0.77400000000000002},"min":{"1min":0.68200000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.79400000000000004,"15min":0.77800000000000002},"min":{"1min":0.70699999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.113,"5min":1.127,"15min":1.127},"last":0.81299999999999994}]},{"osd":11,"last update":"Fri May 10 03:39:39 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.748},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.76500000000000001}]}]},{"osd":7,"up_from":50,"seq":214748364845,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28596,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716556,"statfs":{"total":95995035648,"available":95965753344,"internally_reserved":0,"allocated":1613824,"data_stored":1084520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:37:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.437},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.502}]},{"osd":1,"last update":"Fri May 10 03:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.439,"15min":0.42899999999999999},"min":{"1min":0.311,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.55200000000000005,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.46000000000000002,"15min":0.44900000000000001},"min":{"1min":0.38400000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69999999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri May 10 03:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.46000000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.65600000000000003,"15min":0.626},"min":{"1min":0.52700000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95599999999999996,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.72899999999999998}]},{"osd":3,"last update":"Fri May 10 03:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.621,"15min":0.629},"min":{"1min":0.44600000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.86099999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.439,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.80400000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.628}]},{"osd":4,"last update":"Fri May 10 03:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35299999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69099999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.38400000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69199999999999995,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.46999999999999997}]},{"osd":5,"last update":"Fri May 10 03:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.69599999999999995,"15min":0.66100000000000003},"min":{"1min":0.54300000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90600000000000003,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.68999999999999995,"15min":0.66000000000000003},"min":{"1min":0.51700000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.878,"5min":2.806,"15min":2.806},"last":0.67100000000000004}]},{"osd":6,"last update":"Fri May 10 03:39:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70499999999999996,"15min":0.70899999999999996},"min":{"1min":0.55600000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72499999999999998,"15min":0.73399999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.85999999999999999,"5min":1.002,"15min":1.002},"last":0.70099999999999996}]},{"osd":8,"last update":"Fri May 10 03:40:13 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.71699999999999997,"15min":0.70699999999999996},"min":{"1min":0.57399999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.746},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79000000000000004,"15min":0.79700000000000004},"min":{"1min":0.57299999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.81299999999999994}]},{"osd":9,"last update":"Fri May 10 03:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.97799999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74199999999999999,"15min":0.74299999999999999},"min":{"1min":0.57599999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.90100000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.83499999999999996}]},{"osd":10,"last update":"Fri May 10 03:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73799999999999999,"15min":0.74099999999999999},"min":{"1min":0.58199999999999996,"5min":0.505,"15min":0.505},"max":{"1min":0.88200000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.64700000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.82699999999999996,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.78000000000000003}]},{"osd":11,"last update":"Fri May 10 03:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.85299999999999998}]}]},{"osd":6,"up_from":45,"seq":193273528368,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":995328,"data_stored":483243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.505,"15min":0.46100000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.45800000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.628,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri May 10 03:39:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.56799999999999995,"15min":0.54800000000000004},"min":{"1min":0.45900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85099999999999998,"5min":1.113,"15min":1.113},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.873,"5min":0.69199999999999995,"15min":0.63800000000000001},"min":{"1min":0.53700000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":4.0439999999999996,"5min":4.0439999999999996,"15min":4.0439999999999996},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri May 10 03:39:40 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.626,"15min":0.60799999999999998},"min":{"1min":0.441,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95399999999999996,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.748,"15min":0.70199999999999996},"min":{"1min":0.49199999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":3.8719999999999999,"5min":3.8719999999999999,"15min":3.8719999999999999},"last":0.76600000000000001}]},{"osd":3,"last update":"Fri May 10 03:39:40 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.625,"15min":0.56499999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":4.476,"5min":4.476,"15min":4.476},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.57299999999999995,"15min":0.55100000000000005},"min":{"1min":0.35499999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.52100000000000002}]},{"osd":4,"last update":"Fri May 10 03:39:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.627,"15min":0.60699999999999998},"min":{"1min":0.48499999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90500000000000003,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.78300000000000003,"15min":0.73299999999999998},"min":{"1min":0.60299999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":4.0910000000000002,"5min":4.0910000000000002,"15min":4.0910000000000002},"last":0.69699999999999995}]},{"osd":5,"last update":"Fri May 10 03:39:40 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.69399999999999995,"15min":0.67900000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72699999999999998,"15min":0.71899999999999997},"min":{"1min":0.496,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.99399999999999999,"5min":1.01,"15min":1.01},"last":0.66100000000000003}]},{"osd":7,"last update":"Fri May 10 03:39:58 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.86799999999999999,"15min":0.83599999999999997},"min":{"1min":0.59499999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.9660000000000002,"5min":3.9660000000000002,"15min":3.9660000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.77300000000000002,"15min":0.75900000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.626}]},{"osd":8,"last update":"Fri May 10 03:40:14 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.56399999999999995,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.1000000000000001,"5min":0.92300000000000004,"15min":0.90300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":3.9199999999999999,"5min":3.9199999999999999,"15min":3.9199999999999999},"last":0.91700000000000004}]},{"osd":9,"last update":"Fri May 10 03:39:30 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.95799999999999996,"15min":0.94599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":3.827,"5min":3.827,"15min":3.827},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.84599999999999997,"15min":0.84799999999999998},"min":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.67900000000000005}]},{"osd":10,"last update":"Fri May 10 03:39:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.006,"15min":0.99199999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":4.1340000000000003,"5min":4.1340000000000003,"15min":4.1340000000000003},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.88900000000000001,"15min":0.89100000000000001},"min":{"1min":0.67600000000000005,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.749}]},{"osd":11,"last update":"Fri May 10 03:39:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":4.0049999999999999,"5min":4.0049999999999999,"15min":4.0049999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.84999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":1069056,"data_stored":552213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.54800000000000004,"15min":0.51400000000000001},"min":{"1min":0.41899999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.748,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54700000000000004,"15min":0.50900000000000001},"min":{"1min":0.41499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78300000000000003,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.53100000000000003}]},{"osd":2,"last update":"Fri May 10 03:39:27 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.55300000000000005,"15min":0.50800000000000001},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.82799999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.745},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.56499999999999995,"15min":0.51900000000000002},"min":{"1min":0.42099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.68500000000000005}]},{"osd":3,"last update":"Fri May 10 03:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60399999999999998,"15min":0.56899999999999995},"min":{"1min":0.38700000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.90400000000000003,"5min":1.528,"15min":1.528},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.61399999999999999,"15min":0.56599999999999995},"min":{"1min":0.55500000000000005,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86099999999999999,"5min":1.502,"15min":1.502},"last":0.56399999999999995}]},{"osd":4,"last update":"Fri May 10 03:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.41099999999999998},"min":{"1min":0.40799999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.66400000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.48199999999999998,"15min":0.42199999999999999},"min":{"1min":0.40200000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.79500000000000004,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.50800000000000001}]},{"osd":5,"last update":"Fri May 10 03:39:23 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.63600000000000001,"15min":0.61199999999999999},"min":{"1min":0.46300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.67600000000000005,"15min":0.64600000000000002},"min":{"1min":0.54500000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.72799999999999998}]},{"osd":6,"last update":"Fri May 10 03:39:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.67600000000000005,"15min":0.64600000000000002},"min":{"1min":0.53800000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0680000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.66700000000000004,"15min":0.64900000000000002},"min":{"1min":0.53900000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.94099999999999995,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.69999999999999996}]},{"osd":7,"last update":"Fri May 10 03:39:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.58199999999999996,"15min":0.55600000000000005},"min":{"1min":0.40799999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84699999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.627,"15min":0.58399999999999996},"min":{"1min":0.49299999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86699999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.63100000000000001}]},{"osd":8,"last update":"Fri May 10 03:40:13 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.69299999999999995,"15min":0.65400000000000003},"min":{"1min":0.67100000000000004,"5min":0.443,"15min":0.443},"max":{"1min":0.93600000000000005,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.871,"5min":0.76600000000000001,"15min":0.72299999999999998},"min":{"1min":0.65900000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0580000000000001,"5min":1.113,"15min":1.113},"last":0.77800000000000002}]},{"osd":9,"last update":"Fri May 10 03:39:33 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.77800000000000002,"15min":0.754},"min":{"1min":0.67600000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.871,"5min":0.78300000000000003,"15min":0.76800000000000002},"min":{"1min":0.60499999999999998,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.76200000000000001}]},{"osd":10,"last update":"Fri May 10 03:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":0.98799999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.60199999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.014,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.83399999999999996}]},{"osd":11,"last update":"Fri May 10 03:39:39 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.85399999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1019904,"data_stored":485013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 03:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.62,"15min":0.55600000000000005},"min":{"1min":0.44900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.98099999999999998,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.61599999999999999,"15min":0.54800000000000004},"min":{"1min":0.39600000000000002,"5min":0.316,"15min":0.316},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.85999999999999999}]},{"osd":2,"last update":"Fri May 10 03:39:22 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.64900000000000002,"15min":0.60699999999999998},"min":{"1min":0.434,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.66000000000000003,"15min":0.60199999999999998},"min":{"1min":0.50600000000000001,"5min":0.379,"15min":0.379},"max":{"1min":1.038,"5min":1.216,"15min":1.216},"last":0.83899999999999997}]},{"osd":3,"last update":"Fri May 10 03:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.5},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.67100000000000004}]},{"osd":4,"last update":"Fri May 10 03:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67100000000000004,"15min":0.61099999999999999},"min":{"1min":0.47099999999999997,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.101,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.64800000000000002,"15min":0.59099999999999997},"min":{"1min":0.45100000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.036,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.69499999999999995}]},{"osd":5,"last update":"Fri May 10 03:39:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.60999999999999999,"15min":0.59099999999999997},"min":{"1min":0.45700000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.72599999999999998,"15min":0.69599999999999995},"min":{"1min":0.56299999999999994,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri May 10 03:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.69499999999999995,"15min":0.69299999999999995},"min":{"1min":0.40400000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.92900000000000005,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.71799999999999997,"15min":0.69899999999999995},"min":{"1min":0.53500000000000003,"5min":0.374,"15min":0.374},"max":{"1min":1.119,"5min":1.196,"15min":1.196},"last":0.56399999999999995}]},{"osd":7,"last update":"Fri May 10 03:39:44 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.89200000000000002}]},{"osd":8,"last update":"Fri May 10 03:40:13 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.86799999999999999,"15min":0.84999999999999998},"min":{"1min":0.74399999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1579999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.86699999999999999,"15min":0.85399999999999998},"min":{"1min":0.66400000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.046,"5min":1.373,"15min":1.373},"last":0.91300000000000003}]},{"osd":9,"last update":"Fri May 10 03:39:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.83499999999999996,"15min":0.82099999999999995},"min":{"1min":0.55600000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.3089999999999999,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.753},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.70199999999999996,"15min":0.68100000000000005},"min":{"1min":0.42799999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.72099999999999997}]},{"osd":10,"last update":"Fri May 10 03:39:44 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.91000000000000003,"15min":0.89400000000000002},"min":{"1min":0.69699999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.264,"5min":1.446,"15min":1.446},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.92200000000000004,"15min":0.91000000000000003},"min":{"1min":0.66000000000000003,"5min":0.63,"15min":0.63},"max":{"1min":1.3200000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.95399999999999996}]},{"osd":11,"last update":"Fri May 10 03:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.77100000000000002,"15min":0.76100000000000001},"min":{"1min":0.63800000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.95199999999999996,"15min":0.94299999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2789999999999999,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.083}]}]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":1011712,"data_stored":485152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.38800000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71799999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.41199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80100000000000005,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.54100000000000004}]},{"osd":1,"last update":"Fri May 10 03:39:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.57799999999999996,"15min":0.53500000000000003},"min":{"1min":0.39200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.503},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.625,"15min":0.56399999999999995},"min":{"1min":0.372,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.439}]},{"osd":3,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.629,"15min":0.60299999999999998},"min":{"1min":0.53100000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61699999999999999,"15min":0.59899999999999998},"min":{"1min":0.50600000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.65700000000000003}]},{"osd":4,"last update":"Fri May 10 03:39:38 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri May 10 03:39:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.53200000000000003,"15min":0.50800000000000001},"min":{"1min":0.29599999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.56799999999999995,"15min":0.55200000000000005},"min":{"1min":0.36299999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80200000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.64000000000000001}]},{"osd":6,"last update":"Fri May 10 03:39:38 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.65500000000000003,"15min":0.63400000000000001},"min":{"1min":0.48199999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.73099999999999998,"15min":0.71699999999999997},"min":{"1min":0.59499999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.80400000000000005}]},{"osd":7,"last update":"Fri May 10 03:39:41 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.77400000000000002}]},{"osd":8,"last update":"Fri May 10 03:40:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.65500000000000003,"15min":0.63600000000000001},"min":{"1min":0.40600000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.66000000000000003,"15min":0.63900000000000001},"min":{"1min":0.432,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.72499999999999998}]},{"osd":9,"last update":"Fri May 10 03:39:30 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.77000000000000002,"15min":0.75900000000000001},"min":{"1min":0.54800000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.83399999999999996,"15min":0.82399999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.83099999999999996}]},{"osd":10,"last update":"Fri May 10 03:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.71099999999999997,"15min":0.70499999999999996},"min":{"1min":0.51500000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89800000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.83399999999999996,"15min":0.81799999999999995},"min":{"1min":0.747,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.876}]},{"osd":11,"last update":"Fri May 10 03:39:38 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.84399999999999997}]}]},{"osd":3,"up_from":25,"seq":107374182459,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1003520,"data_stored":482668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:39:43 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.42899999999999999,"15min":0.38600000000000001},"min":{"1min":0.314,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.47999999999999998,"15min":0.439},"min":{"1min":0.35799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77600000000000002,"5min":0.878,"15min":0.878},"last":0.46000000000000002}]},{"osd":1,"last update":"Fri May 10 03:39:43 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56999999999999995,"15min":0.53900000000000003},"min":{"1min":0.40699999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.89700000000000002,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59199999999999997,"15min":0.53900000000000003},"min":{"1min":0.39200000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.65400000000000003}]},{"osd":2,"last update":"Fri May 10 03:39:43 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.63200000000000001,"15min":0.60399999999999998},"min":{"1min":0.48899999999999999,"5min":0.38,"15min":0.38},"max":{"1min":1.0720000000000001,"5min":1.145,"15min":1.145},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.627,"15min":0.58399999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91900000000000004,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.71399999999999997}]},{"osd":4,"last update":"Fri May 10 03:40:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64600000000000002,"15min":0.61199999999999999},"min":{"1min":0.45600000000000002,"5min":0.433,"15min":0.433},"max":{"1min":1.0269999999999999,"5min":1.093,"15min":1.093},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67400000000000004,"15min":0.63300000000000001},"min":{"1min":0.51500000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.85599999999999998,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.56999999999999995}]},{"osd":5,"last update":"Fri May 10 03:39:21 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65200000000000002,"15min":0.63200000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.014,"5min":1.224,"15min":1.224},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66200000000000003,"15min":0.63},"min":{"1min":0.438,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.996,"5min":1.093,"15min":1.093},"last":0.77300000000000002}]},{"osd":6,"last update":"Fri May 10 03:39:38 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.67600000000000005,"15min":0.67400000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2549999999999999,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42599999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.073,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.51100000000000001}]},{"osd":7,"last update":"Fri May 10 03:39:58 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.70599999999999996,"15min":0.69999999999999996},"min":{"1min":0.50700000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.96399999999999997,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.439},{"interface":"front","average":{"1min":0.753,"5min":0.78300000000000003,"15min":0.78600000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.69899999999999995}]},{"osd":8,"last update":"Fri May 10 03:38:09 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.68899999999999995}]},{"osd":9,"last update":"Fri May 10 03:39:27 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.879,"15min":0.90300000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.81899999999999995,"15min":0.83599999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.625}]},{"osd":10,"last update":"Fri May 10 03:39:48 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.84799999999999998,"15min":0.85399999999999998},"min":{"1min":0.61599999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.139,"5min":1.27,"15min":1.27},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.89900000000000002,"15min":0.91100000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.73599999999999999}]},{"osd":11,"last update":"Fri May 10 03:39:38 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.75}]}]},{"osd":4,"up_from":33,"seq":141733920823,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1081344,"data_stored":555257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:37:59 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.47599999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.52400000000000002,"15min":0.51100000000000001},"min":{"1min":0.435,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.54000000000000004}]},{"osd":1,"last update":"Fri May 10 03:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.40000000000000002,"15min":0.36499999999999999},"min":{"1min":0.36499999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.58199999999999996,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.41599999999999998,"15min":0.38400000000000001},"min":{"1min":0.37,"5min":0.251,"15min":0.251},"max":{"1min":0.68999999999999995,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.60699999999999998}]},{"osd":2,"last update":"Fri May 10 03:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57699999999999996,"15min":0.55300000000000005},"min":{"1min":0.39900000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.75,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.621,"15min":0.56999999999999995},"min":{"1min":0.53000000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88800000000000001,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.71499999999999997}]},{"osd":3,"last update":"Fri May 10 03:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.62,"15min":0.57999999999999996},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.754},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58999999999999997,"15min":0.57299999999999995},"min":{"1min":0.44500000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.63600000000000001}]},{"osd":5,"last update":"Fri May 10 03:39:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61699999999999999,"15min":0.59499999999999997},"min":{"1min":0.497,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90500000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.63500000000000001,"15min":0.60499999999999998},"min":{"1min":0.47999999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.86599999999999999}]},{"osd":6,"last update":"Fri May 10 03:39:40 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.625,"15min":0.629},"min":{"1min":0.46100000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.77300000000000002,"15min":0.79900000000000004},"min":{"1min":0.505,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95199999999999996,"5min":3.714,"15min":3.714},"last":0.94099999999999995}]},{"osd":7,"last update":"Fri May 10 03:40:04 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.59699999999999998,"15min":0.56499999999999995},"min":{"1min":0.441,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.623,"15min":0.58599999999999997},"min":{"1min":0.55300000000000005,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.91600000000000004}]},{"osd":8,"last update":"Fri May 10 03:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.66400000000000003,"15min":0.64500000000000002},"min":{"1min":0.52200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.77900000000000003,"15min":0.76400000000000001},"min":{"1min":0.57499999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.96099999999999997}]},{"osd":9,"last update":"Fri May 10 03:39:31 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.81899999999999995,"15min":0.82299999999999995},"min":{"1min":0.53100000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92800000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.92700000000000005,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.98999999999999999}]},{"osd":10,"last update":"Fri May 10 03:39:44 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80200000000000005,"15min":0.80300000000000005},"min":{"1min":0.60399999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92200000000000004,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":1.026},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.71899999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.93500000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":1.0029999999999999}]},{"osd":11,"last update":"Fri May 10 03:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":1.069},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.88800000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757301,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1622016,"data_stored":1080198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 03:40:18 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.52300000000000002},"min":{"1min":0.442,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72199999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58999999999999997,"15min":0.57399999999999995},"min":{"1min":0.40500000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.877,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.63600000000000001}]},{"osd":1,"last update":"Fri May 10 03:40:18 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60099999999999998,"15min":0.58699999999999997},"min":{"1min":0.48399999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83099999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.625,"15min":0.60199999999999998},"min":{"1min":0.51800000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.86199999999999999,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.73199999999999998}]},{"osd":2,"last update":"Fri May 10 03:40:18 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.45200000000000001,"15min":0.42399999999999999},"min":{"1min":0.36199999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.61099999999999999,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.5},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.44},"min":{"1min":0.35399999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.66700000000000004,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.45400000000000001}]},{"osd":3,"last update":"Fri May 10 03:40:18 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.41799999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.79400000000000004,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.62},{"interface":"front","average":{"1min":0.62,"5min":0.60599999999999998,"15min":0.59299999999999997},"min":{"1min":0.46000000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.75800000000000001,"5min":1.095,"15min":1.095},"last":0.66600000000000004}]},{"osd":4,"last update":"Fri May 10 03:40:18 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.65400000000000003,"15min":0.63},"min":{"1min":0.55800000000000005,"5min":0.435,"15min":0.435},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.495,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89700000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.65500000000000003}]},{"osd":6,"last update":"Fri May 10 03:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.624,"15min":0.60599999999999998},"min":{"1min":0.54400000000000004,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.90500000000000003,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.69399999999999995,"15min":0.68600000000000005},"min":{"1min":0.45700000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.97699999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.82999999999999996}]},{"osd":7,"last update":"Fri May 10 03:39:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.72199999999999998,"15min":0.70199999999999996},"min":{"1min":0.51300000000000001,"5min":0.504,"15min":0.504},"max":{"1min":0.97499999999999998,"5min":1.044,"15min":1.044},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.60799999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93300000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.76700000000000002}]},{"osd":8,"last update":"Fri May 10 03:40:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.67100000000000004,"15min":0.64500000000000002},"min":{"1min":0.45700000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.01,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.61499999999999999,"15min":0.59499999999999997},"min":{"1min":0.47099999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85199999999999998,"5min":1.145,"15min":1.145},"last":0.70399999999999996}]},{"osd":9,"last update":"Fri May 10 03:39:29 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.70199999999999996,"15min":0.68400000000000005},"min":{"1min":0.56100000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.754},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.753,"15min":0.73099999999999998},"min":{"1min":0.64600000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.91600000000000004}]},{"osd":10,"last update":"Fri May 10 03:39:46 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.71299999999999997,"15min":0.69899999999999995},"min":{"1min":0.54700000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91900000000000004,"5min":1.109,"15min":1.109},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.76000000000000001,"15min":0.752},"min":{"1min":0.64600000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.94899999999999995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.81299999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":72164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":71112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":72148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T03:40:20.317 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:40:20.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.499+0000 7f1f48a88700 1 -- 172.21.15.45:0/1927992241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f44100ae0 msgr2=0x7f1f44100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:20.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.499+0000 7f1f48a88700 1 --2- 172.21.15.45:0/1927992241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f44100ae0 0x7f1f44100ef0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1f34009990 tx=0x7f1f34009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.500+0000 7f1f48a88700 1 -- 172.21.15.45:0/1927992241 shutdown_connections 2024-05-10T03:40:20.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.500+0000 7f1f48a88700 1 --2- 172.21.15.45:0/1927992241 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f441025a0 0x7f1f44108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.500+0000 7f1f48a88700 1 --2- 172.21.15.45:0/1927992241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f44100ae0 0x7f1f44100ef0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.500+0000 7f1f48a88700 1 --2- 172.21.15.45:0/1927992241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f44101c00 0x7f1f44102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.500+0000 7f1f48a88700 1 -- 172.21.15.45:0/1927992241 >> 172.21.15.45:0/1927992241 conn(0x7f1f440fc0f0 msgr2=0x7f1f440fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:20.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.500+0000 7f1f48a88700 1 -- 172.21.15.45:0/1927992241 shutdown_connections 2024-05-10T03:40:20.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.500+0000 7f1f48a88700 1 -- 172.21.15.45:0/1927992241 wait complete. 2024-05-10T03:40:20.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.501+0000 7f1f48a88700 1 Processor -- start 2024-05-10T03:40:20.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.501+0000 7f1f48a88700 1 -- start start 2024-05-10T03:40:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.501+0000 7f1f48a88700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f44100ae0 0x7f1f4406a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.501+0000 7f1f48a88700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f44101c00 0x7f1f4419cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.501+0000 7f1f48a88700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f441025a0 0x7f1f4419f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.501+0000 7f1f48a88700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4419fbf0 con 0x7f1f44100ae0 2024-05-10T03:40:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.501+0000 7f1f48a88700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4419fd60 con 0x7f1f441025a0 2024-05-10T03:40:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.501+0000 7f1f48a88700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4419ff20 con 0x7f1f44101c00 2024-05-10T03:40:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.501+0000 7f1f4259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f44100ae0 0x7f1f4406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.501+0000 7f1f4259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f44100ae0 0x7f1f4406a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35214/0 (socket says 172.21.15.45:35214) 2024-05-10T03:40:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.501+0000 7f1f4259c700 1 -- 172.21.15.45:0/2016741641 learned_addr learned my addr 172.21.15.45:0/2016741641 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.501+0000 7f1f42d9d700 1 --2- 172.21.15.45:0/2016741641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f441025a0 0x7f1f4419f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.501+0000 7f1f41d9b700 1 --2- 172.21.15.45:0/2016741641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f44101c00 0x7f1f4419cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.501+0000 7f1f4259c700 1 -- 172.21.15.45:0/2016741641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f44101c00 msgr2=0x7f1f4419cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.501+0000 7f1f4259c700 1 --2- 172.21.15.45:0/2016741641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f44101c00 0x7f1f4419cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.501+0000 7f1f4259c700 1 -- 172.21.15.45:0/2016741641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f441025a0 msgr2=0x7f1f4419f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:20.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.501+0000 7f1f4259c700 1 --2- 172.21.15.45:0/2016741641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f441025a0 0x7f1f4419f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.501+0000 7f1f4259c700 1 -- 172.21.15.45:0/2016741641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f340095f0 con 0x7f1f44100ae0 2024-05-10T03:40:20.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.501+0000 7f1f42d9d700 1 --2- 172.21.15.45:0/2016741641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f441025a0 0x7f1f4419f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:20.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.502+0000 7f1f4259c700 1 --2- 172.21.15.45:0/2016741641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f44100ae0 0x7f1f4406a500 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1f340095c0 tx=0x7f1f3400f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:20.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.502+0000 7f1f337fe700 1 -- 172.21.15.45:0/2016741641 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3401d070 con 0x7f1f44100ae0 2024-05-10T03:40:20.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.502+0000 7f1f48a88700 1 -- 172.21.15.45:0/2016741641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f441a01a0 con 0x7f1f44100ae0 2024-05-10T03:40:20.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.502+0000 7f1f337fe700 1 -- 172.21.15.45:0/2016741641 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1f3400f9d0 con 0x7f1f44100ae0 2024-05-10T03:40:20.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.502+0000 7f1f337fe700 1 -- 172.21.15.45:0/2016741641 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f34005630 con 0x7f1f44100ae0 2024-05-10T03:40:20.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.502+0000 7f1f48a88700 1 -- 172.21.15.45:0/2016741641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f441a05d0 con 0x7f1f44100ae0 2024-05-10T03:40:20.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.503+0000 7f1f48a88700 1 -- 172.21.15.45:0/2016741641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f44107cf0 con 0x7f1f44100ae0 2024-05-10T03:40:20.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.504+0000 7f1f337fe700 1 -- 172.21.15.45:0/2016741641 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f1f3400fb40 con 0x7f1f44100ae0 2024-05-10T03:40:20.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.505+0000 7f1f337fe700 1 --2- 172.21.15.45:0/2016741641 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1f2c0a11b0 0x7f1f2c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:20.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.505+0000 7f1f337fe700 1 -- 172.21.15.45:0/2016741641 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f1f340ce1b0 con 0x7f1f44100ae0 2024-05-10T03:40:20.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.505+0000 7f1f41d9b700 1 --2- 172.21.15.45:0/2016741641 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1f2c0a11b0 0x7f1f2c0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:20.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.506+0000 7f1f41d9b700 1 --2- 172.21.15.45:0/2016741641 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1f2c0a11b0 0x7f1f2c0a36c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1f38005950 tx=0x7f1f380058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:20.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.509+0000 7f1f337fe700 1 -- 172.21.15.45:0/2016741641 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1f34097500 con 0x7f1f44100ae0 2024-05-10T03:40:20.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.731+0000 7f1f48a88700 1 -- 172.21.15.45:0/2016741641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f4410c400 con 0x7f1f44100ae0 2024-05-10T03:40:20.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.733+0000 7f1f337fe700 1 -- 172.21.15.45:0/2016741641 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+24508 (secure 0 0 0) 0x7f1f3409ab20 con 0x7f1f44100ae0 2024-05-10T03:40:20.736 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:40:20.736 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":88,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:39:27.064512+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:38:34.871801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:38:35.935386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T03:38:39.029903+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:40:20.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.735+0000 7f1f48a88700 1 -- 172.21.15.45:0/2016741641 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1f2c0a11b0 msgr2=0x7f1f2c0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:20.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.735+0000 7f1f48a88700 1 --2- 172.21.15.45:0/2016741641 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1f2c0a11b0 0x7f1f2c0a36c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1f38005950 tx=0x7f1f380058e0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.735+0000 7f1f48a88700 1 -- 172.21.15.45:0/2016741641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f44100ae0 msgr2=0x7f1f4406a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:20.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.735+0000 7f1f48a88700 1 --2- 172.21.15.45:0/2016741641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f44100ae0 0x7f1f4406a500 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1f340095c0 tx=0x7f1f3400f460 comp rx=0 tx=0).stop 2024-05-10T03:40:20.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.735+0000 7f1f48a88700 1 -- 172.21.15.45:0/2016741641 shutdown_connections 2024-05-10T03:40:20.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.735+0000 7f1f48a88700 1 --2- 172.21.15.45:0/2016741641 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f1f2c0a11b0 0x7f1f2c0a36c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.735+0000 7f1f48a88700 1 --2- 172.21.15.45:0/2016741641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f441025a0 0x7f1f4419f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.735+0000 7f1f48a88700 1 --2- 172.21.15.45:0/2016741641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f44100ae0 0x7f1f4406a500 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.735+0000 7f1f48a88700 1 --2- 172.21.15.45:0/2016741641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f44101c00 0x7f1f4419cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.735+0000 7f1f48a88700 1 -- 172.21.15.45:0/2016741641 >> 172.21.15.45:0/2016741641 conn(0x7f1f440fc0f0 msgr2=0x7f1f44104e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:20.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.735+0000 7f1f48a88700 1 -- 172.21.15.45:0/2016741641 shutdown_connections 2024-05-10T03:40:20.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.735+0000 7f1f48a88700 1 -- 172.21.15.45:0/2016741641 wait complete. 2024-05-10T03:40:20.753 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T03:35:20.339400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T03:38:34.871801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T03:38:35.935386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-10T03:38:39.029903+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-10T03:40:20.754 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T03:40:20.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.903+0000 7f73b4362700 1 -- 172.21.15.45:0/3153854600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73ac1026b0 msgr2=0x7f73ac104ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:20.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.903+0000 7f73b4362700 1 --2- 172.21.15.45:0/3153854600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73ac1026b0 0x7f73ac104ad0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f73a8009990 tx=0x7f73a8009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.903+0000 7f73b4362700 1 -- 172.21.15.45:0/3153854600 shutdown_connections 2024-05-10T03:40:20.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.903+0000 7f73b4362700 1 --2- 172.21.15.45:0/3153854600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73ac107970 0x7f73ac109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.903+0000 7f73b4362700 1 --2- 172.21.15.45:0/3153854600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73ac1026b0 0x7f73ac104ad0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.903+0000 7f73b4362700 1 --2- 172.21.15.45:0/3153854600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73ac105010 0x7f73ac107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.903+0000 7f73b4362700 1 -- 172.21.15.45:0/3153854600 >> 172.21.15.45:0/3153854600 conn(0x7f73ac0fc0d0 msgr2=0x7f73ac0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:20.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.903+0000 7f73b4362700 1 -- 172.21.15.45:0/3153854600 shutdown_connections 2024-05-10T03:40:20.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.903+0000 7f73b4362700 1 -- 172.21.15.45:0/3153854600 wait complete. 2024-05-10T03:40:20.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.904+0000 7f73b4362700 1 Processor -- start 2024-05-10T03:40:20.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.904+0000 7f73b4362700 1 -- start start 2024-05-10T03:40:20.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.904+0000 7f73b4362700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73ac1026b0 0x7f73ac101f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:20.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.904+0000 7f73b4362700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73ac105010 0x7f73ac1005c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:20.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.904+0000 7f73b4362700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73ac107970 0x7f73ac100b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:20.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.904+0000 7f73b4362700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ac1011e0 con 0x7f73ac107970 2024-05-10T03:40:20.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.904+0000 7f73b4362700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ac101350 con 0x7f73ac105010 2024-05-10T03:40:20.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.904+0000 7f73b4362700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ac1a2070 con 0x7f73ac1026b0 2024-05-10T03:40:20.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.905+0000 7f73b28ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73ac107970 0x7f73ac100b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.905+0000 7f73b28ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73ac107970 0x7f73ac100b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35234/0 (socket says 172.21.15.45:35234) 2024-05-10T03:40:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.905+0000 7f73b28ff700 1 -- 172.21.15.45:0/3114180795 learned_addr learned my addr 172.21.15.45:0/3114180795 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.905+0000 7f73b18fd700 1 --2- 172.21.15.45:0/3114180795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73ac105010 0x7f73ac1005c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.905+0000 7f73b20fe700 1 --2- 172.21.15.45:0/3114180795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73ac1026b0 0x7f73ac101f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.905+0000 7f73b28ff700 1 -- 172.21.15.45:0/3114180795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73ac1026b0 msgr2=0x7f73ac101f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.905+0000 7f73b28ff700 1 --2- 172.21.15.45:0/3114180795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73ac1026b0 0x7f73ac101f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.905+0000 7f73b28ff700 1 -- 172.21.15.45:0/3114180795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73ac105010 msgr2=0x7f73ac1005c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.905+0000 7f73b28ff700 1 --2- 172.21.15.45:0/3114180795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73ac105010 0x7f73ac1005c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.905+0000 7f73b28ff700 1 -- 172.21.15.45:0/3114180795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a80095f0 con 0x7f73ac107970 2024-05-10T03:40:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.905+0000 7f73b28ff700 1 --2- 172.21.15.45:0/3114180795 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73ac107970 0x7f73ac100b00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f73a400ef90 tx=0x7f73a400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.905+0000 7f73a37fe700 1 -- 172.21.15.45:0/3114180795 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a4018070 con 0x7f73ac107970 2024-05-10T03:40:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.905+0000 7f73a37fe700 1 -- 172.21.15.45:0/3114180795 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f73a400f040 con 0x7f73ac107970 2024-05-10T03:40:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.905+0000 7f73b4362700 1 -- 172.21.15.45:0/3114180795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73ac1a2270 con 0x7f73ac107970 2024-05-10T03:40:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.905+0000 7f73a37fe700 1 -- 172.21.15.45:0/3114180795 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a400ce00 con 0x7f73ac107970 2024-05-10T03:40:20.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.905+0000 7f73b4362700 1 -- 172.21.15.45:0/3114180795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73ac1a2700 con 0x7f73ac107970 2024-05-10T03:40:20.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.906+0000 7f73b4362700 1 -- 172.21.15.45:0/3114180795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73ac0fdc80 con 0x7f73ac107970 2024-05-10T03:40:20.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.908+0000 7f73a37fe700 1 -- 172.21.15.45:0/3114180795 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f73a4003a00 con 0x7f73ac107970 2024-05-10T03:40:20.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.909+0000 7f73a37fe700 1 --2- 172.21.15.45:0/3114180795 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f73980a1260 0x7f73980a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:20.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.909+0000 7f73b20fe700 1 --2- 172.21.15.45:0/3114180795 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f73980a1260 0x7f73980a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:20.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.909+0000 7f73a37fe700 1 -- 172.21.15.45:0/3114180795 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f73a40cd1d0 con 0x7f73ac107970 2024-05-10T03:40:20.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.909+0000 7f73b20fe700 1 --2- 172.21.15.45:0/3114180795 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f73980a1260 0x7f73980a3770 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f73a800b2e0 tx=0x7f73a801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:20.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:20.913+0000 7f73a37fe700 1 -- 172.21.15.45:0/3114180795 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f73a4096580 con 0x7f73ac107970 2024-05-10T03:40:21.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.132+0000 7f73b4362700 1 -- 172.21.15.45:0/3114180795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f73ac10d500 con 0x7f73ac107970 2024-05-10T03:40:21.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.132+0000 7f73a37fe700 1 -- 172.21.15.45:0/3114180795 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f73a4099ba0 con 0x7f73ac107970 2024-05-10T03:40:21.136 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-05-10T03:40:21.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.135+0000 7f73b4362700 1 -- 172.21.15.45:0/3114180795 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f73980a1260 msgr2=0x7f73980a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:21.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.135+0000 7f73b4362700 1 --2- 172.21.15.45:0/3114180795 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f73980a1260 0x7f73980a3770 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f73a800b2e0 tx=0x7f73a801a040 comp rx=0 tx=0).stop 2024-05-10T03:40:21.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.135+0000 7f73b4362700 1 -- 172.21.15.45:0/3114180795 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73ac107970 msgr2=0x7f73ac100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:21.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.135+0000 7f73b4362700 1 --2- 172.21.15.45:0/3114180795 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73ac107970 0x7f73ac100b00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f73a400ef90 tx=0x7f73a400c3a0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.135+0000 7f73b4362700 1 -- 172.21.15.45:0/3114180795 shutdown_connections 2024-05-10T03:40:21.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.135+0000 7f73b4362700 1 --2- 172.21.15.45:0/3114180795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73ac1026b0 0x7f73ac101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.135+0000 7f73b4362700 1 --2- 172.21.15.45:0/3114180795 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f73980a1260 0x7f73980a3770 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.135+0000 7f73b4362700 1 --2- 172.21.15.45:0/3114180795 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73ac107970 0x7f73ac100b00 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.135+0000 7f73b4362700 1 --2- 172.21.15.45:0/3114180795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73ac105010 0x7f73ac1005c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.135+0000 7f73b4362700 1 -- 172.21.15.45:0/3114180795 >> 172.21.15.45:0/3114180795 conn(0x7f73ac0fc0d0 msgr2=0x7f73ac103180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:21.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.135+0000 7f73b4362700 1 -- 172.21.15.45:0/3114180795 shutdown_connections 2024-05-10T03:40:21.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.135+0000 7f73b4362700 1 -- 172.21.15.45:0/3114180795 wait complete. 2024-05-10T03:40:21.153 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T03:40:21.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.302+0000 7fe5a36c7700 1 -- 172.21.15.45:0/3788241512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe59c102590 msgr2=0x7fe59c108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:21.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.302+0000 7fe5a36c7700 1 --2- 172.21.15.45:0/3788241512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe59c102590 0x7fe59c108e40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe59400b0a0 tx=0x7fe59400b3b0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.302+0000 7fe5a36c7700 1 -- 172.21.15.45:0/3788241512 shutdown_connections 2024-05-10T03:40:21.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.302+0000 7fe5a36c7700 1 --2- 172.21.15.45:0/3788241512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe59c102590 0x7fe59c108e40 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.302+0000 7fe5a36c7700 1 --2- 172.21.15.45:0/3788241512 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe59c100ad0 0x7fe59c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.302+0000 7fe5a36c7700 1 --2- 172.21.15.45:0/3788241512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe59c101bf0 0x7fe59c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.302+0000 7fe5a36c7700 1 -- 172.21.15.45:0/3788241512 >> 172.21.15.45:0/3788241512 conn(0x7fe59c0fc0c0 msgr2=0x7fe59c0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:21.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.303+0000 7fe5a36c7700 1 -- 172.21.15.45:0/3788241512 shutdown_connections 2024-05-10T03:40:21.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.303+0000 7fe5a36c7700 1 -- 172.21.15.45:0/3788241512 wait complete. 2024-05-10T03:40:21.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.303+0000 7fe5a36c7700 1 Processor -- start 2024-05-10T03:40:21.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.303+0000 7fe5a36c7700 1 -- start start 2024-05-10T03:40:21.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.303+0000 7fe5a36c7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe59c100ad0 0x7fe59c1980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:21.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.303+0000 7fe5a36c7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe59c101bf0 0x7fe59c198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:21.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.304+0000 7fe5a36c7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe59c102590 0x7fe59c19f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:21.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.304+0000 7fe5a36c7700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c19fba0 con 0x7fe59c102590 2024-05-10T03:40:21.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.304+0000 7fe5a36c7700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c19fd10 con 0x7fe59c101bf0 2024-05-10T03:40:21.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.304+0000 7fe5a36c7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c19fed0 con 0x7fe59c100ad0 2024-05-10T03:40:21.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.304+0000 7fe5a1c64700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe59c102590 0x7fe59c19f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:21.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.304+0000 7fe5a1c64700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe59c102590 0x7fe59c19f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35248/0 (socket says 172.21.15.45:35248) 2024-05-10T03:40:21.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.304+0000 7fe5a0c62700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe59c101bf0 0x7fe59c198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:21.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.304+0000 7fe5a1463700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe59c100ad0 0x7fe59c1980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:21.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.304+0000 7fe5a1c64700 1 -- 172.21.15.45:0/2062752244 learned_addr learned my addr 172.21.15.45:0/2062752244 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:21.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.304+0000 7fe5a1c64700 1 -- 172.21.15.45:0/2062752244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe59c100ad0 msgr2=0x7fe59c1980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:21.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.304+0000 7fe5a1c64700 1 --2- 172.21.15.45:0/2062752244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe59c100ad0 0x7fe59c1980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.304+0000 7fe5a1c64700 1 -- 172.21.15.45:0/2062752244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe59c101bf0 msgr2=0x7fe59c198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:21.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.304+0000 7fe5a1c64700 1 --2- 172.21.15.45:0/2062752244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe59c101bf0 0x7fe59c198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.304+0000 7fe5a1c64700 1 -- 172.21.15.45:0/2062752244 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe594009d00 con 0x7fe59c102590 2024-05-10T03:40:21.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.304+0000 7fe5a1c64700 1 --2- 172.21.15.45:0/2062752244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe59c102590 0x7fe59c19f590 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe59400b830 tx=0x7fe5940093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:21.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.304+0000 7fe58e7fc700 1 -- 172.21.15.45:0/2062752244 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59400e040 con 0x7fe59c102590 2024-05-10T03:40:21.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.304+0000 7fe58e7fc700 1 -- 172.21.15.45:0/2062752244 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe594003e10 con 0x7fe59c102590 2024-05-10T03:40:21.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.305+0000 7fe5a36c7700 1 -- 172.21.15.45:0/2062752244 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe59c1a0150 con 0x7fe59c102590 2024-05-10T03:40:21.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.305+0000 7fe58e7fc700 1 -- 172.21.15.45:0/2062752244 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe594005540 con 0x7fe59c102590 2024-05-10T03:40:21.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.305+0000 7fe5a36c7700 1 -- 172.21.15.45:0/2062752244 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe59c1a0570 con 0x7fe59c102590 2024-05-10T03:40:21.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.306+0000 7fe5a36c7700 1 -- 172.21.15.45:0/2062752244 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe59c0678b0 con 0x7fe59c102590 2024-05-10T03:40:21.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.307+0000 7fe58e7fc700 1 -- 172.21.15.45:0/2062752244 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fe59401db80 con 0x7fe59c102590 2024-05-10T03:40:21.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.308+0000 7fe58e7fc700 1 --2- 172.21.15.45:0/2062752244 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe5880a1260 0x7fe5880a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:21.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.308+0000 7fe58e7fc700 1 -- 172.21.15.45:0/2062752244 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fe5940ce1a0 con 0x7fe59c102590 2024-05-10T03:40:21.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.308+0000 7fe5a1463700 1 --2- 172.21.15.45:0/2062752244 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe5880a1260 0x7fe5880a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:21.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.309+0000 7fe5a1463700 1 --2- 172.21.15.45:0/2062752244 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe5880a1260 0x7fe5880a3770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe59c101af0 tx=0x7fe598007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:21.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.312+0000 7fe58e7fc700 1 -- 172.21.15.45:0/2062752244 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe5940974f0 con 0x7fe59c102590 2024-05-10T03:40:21.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:21 smithi106 ceph-mon[46996]: from='client.15603 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T03:40:21.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:21 smithi106 ceph-mon[46996]: from='client.15609 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T03:40:21.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:21 smithi106 ceph-mon[46996]: pgmap v285: 129 pgs: 129 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1023 B/s wr, 12 op/s 2024-05-10T03:40:21.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:21 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2016741641' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:40:21.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:21 smithi154 ceph-mon[46565]: from='client.15603 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T03:40:21.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:21 smithi154 ceph-mon[46565]: from='client.15609 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T03:40:21.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:21 smithi154 ceph-mon[46565]: pgmap v285: 129 pgs: 129 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1023 B/s wr, 12 op/s 2024-05-10T03:40:21.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:21 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2016741641' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:40:21.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.527+0000 7fe5a36c7700 1 -- 172.21.15.45:0/2062752244 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe59c1a0890 con 0x7fe59c102590 2024-05-10T03:40:21.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.528+0000 7fe58e7fc700 1 -- 172.21.15.45:0/2062752244 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe59409ab10 con 0x7fe59c102590 2024-05-10T03:40:21.531 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-05-10T03:40:21.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:21 smithi045 ceph-mon[42520]: from='client.15603 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T03:40:21.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:21 smithi045 ceph-mon[42520]: from='client.15609 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T03:40:21.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:21 smithi045 ceph-mon[42520]: pgmap v285: 129 pgs: 129 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1023 B/s wr, 12 op/s 2024-05-10T03:40:21.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:21 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2016741641' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:40:21.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.530+0000 7fe5a36c7700 1 -- 172.21.15.45:0/2062752244 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe5880a1260 msgr2=0x7fe5880a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:21.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.530+0000 7fe5a36c7700 1 --2- 172.21.15.45:0/2062752244 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe5880a1260 0x7fe5880a3770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe59c101af0 tx=0x7fe598007400 comp rx=0 tx=0).stop 2024-05-10T03:40:21.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.530+0000 7fe5a36c7700 1 -- 172.21.15.45:0/2062752244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe59c102590 msgr2=0x7fe59c19f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:21.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.530+0000 7fe5a36c7700 1 --2- 172.21.15.45:0/2062752244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe59c102590 0x7fe59c19f590 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe59400b830 tx=0x7fe5940093b0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.530+0000 7fe5a36c7700 1 -- 172.21.15.45:0/2062752244 shutdown_connections 2024-05-10T03:40:21.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.530+0000 7fe5a36c7700 1 --2- 172.21.15.45:0/2062752244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe59c100ad0 0x7fe59c1980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.530+0000 7fe5a36c7700 1 --2- 172.21.15.45:0/2062752244 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe5880a1260 0x7fe5880a3770 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.530+0000 7fe5a36c7700 1 --2- 172.21.15.45:0/2062752244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe59c102590 0x7fe59c19f590 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.530+0000 7fe5a36c7700 1 --2- 172.21.15.45:0/2062752244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe59c101bf0 0x7fe59c198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.530+0000 7fe5a36c7700 1 -- 172.21.15.45:0/2062752244 >> 172.21.15.45:0/2062752244 conn(0x7fe59c0fc0c0 msgr2=0x7fe59c0fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:21.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.530+0000 7fe5a36c7700 1 -- 172.21.15.45:0/2062752244 shutdown_connections 2024-05-10T03:40:21.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.531+0000 7fe5a36c7700 1 -- 172.21.15.45:0/2062752244 wait complete. 2024-05-10T03:40:21.549 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T03:40:21.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.698+0000 7fcc2bdd5700 1 -- 172.21.15.45:0/2448909297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc24100ac0 msgr2=0x7fcc24100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:21.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.698+0000 7fcc2bdd5700 1 --2- 172.21.15.45:0/2448909297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc24100ac0 0x7fcc24100ed0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fcc18009990 tx=0x7fcc18009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.698+0000 7fcc2bdd5700 1 -- 172.21.15.45:0/2448909297 shutdown_connections 2024-05-10T03:40:21.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.698+0000 7fcc2bdd5700 1 --2- 172.21.15.45:0/2448909297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc24102580 0x7fcc24108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.698+0000 7fcc2bdd5700 1 --2- 172.21.15.45:0/2448909297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc24100ac0 0x7fcc24100ed0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.698+0000 7fcc2bdd5700 1 --2- 172.21.15.45:0/2448909297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc24101be0 0x7fcc24101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.698+0000 7fcc2bdd5700 1 -- 172.21.15.45:0/2448909297 >> 172.21.15.45:0/2448909297 conn(0x7fcc240fc0d0 msgr2=0x7fcc240fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:21.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.698+0000 7fcc2bdd5700 1 -- 172.21.15.45:0/2448909297 shutdown_connections 2024-05-10T03:40:21.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.698+0000 7fcc2bdd5700 1 -- 172.21.15.45:0/2448909297 wait complete. 2024-05-10T03:40:21.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.699+0000 7fcc2bdd5700 1 Processor -- start 2024-05-10T03:40:21.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.699+0000 7fcc2bdd5700 1 -- start start 2024-05-10T03:40:21.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.699+0000 7fcc2bdd5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc24100ac0 0x7fcc24104880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:21.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.699+0000 7fcc2bdd5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc24101be0 0x7fcc24102f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:21.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.699+0000 7fcc2bdd5700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc24102580 0x7fcc24103460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:21.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.699+0000 7fcc2bdd5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc24103b40 con 0x7fcc24101be0 2024-05-10T03:40:21.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.699+0000 7fcc2bdd5700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc24103cb0 con 0x7fcc24102580 2024-05-10T03:40:21.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.699+0000 7fcc2bdd5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc241a2060 con 0x7fcc24100ac0 2024-05-10T03:40:21.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.699+0000 7fcc29370700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc24101be0 0x7fcc24102f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:21.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.699+0000 7fcc29370700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc24101be0 0x7fcc24102f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35264/0 (socket says 172.21.15.45:35264) 2024-05-10T03:40:21.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.699+0000 7fcc29370700 1 -- 172.21.15.45:0/3929989783 learned_addr learned my addr 172.21.15.45:0/3929989783 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:21.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.699+0000 7fcc29b71700 1 --2- 172.21.15.45:0/3929989783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc24100ac0 0x7fcc24104880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:21.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.699+0000 7fcc2a372700 1 --2- 172.21.15.45:0/3929989783 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc24102580 0x7fcc24103460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:21.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.700+0000 7fcc29370700 1 -- 172.21.15.45:0/3929989783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc24100ac0 msgr2=0x7fcc24104880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:21.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.700+0000 7fcc29370700 1 --2- 172.21.15.45:0/3929989783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc24100ac0 0x7fcc24104880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.700+0000 7fcc29370700 1 -- 172.21.15.45:0/3929989783 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc24102580 msgr2=0x7fcc24103460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:21.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.700+0000 7fcc29370700 1 --2- 172.21.15.45:0/3929989783 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc24102580 0x7fcc24103460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.700+0000 7fcc29370700 1 -- 172.21.15.45:0/3929989783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc180095f0 con 0x7fcc24101be0 2024-05-10T03:40:21.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.700+0000 7fcc29370700 1 --2- 172.21.15.45:0/3929989783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc24101be0 0x7fcc24102f20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000e9a0 tx=0x7fcc2000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:21.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.700+0000 7fcc16ffd700 1 -- 172.21.15.45:0/3929989783 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc20009790 con 0x7fcc24101be0 2024-05-10T03:40:21.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.700+0000 7fcc16ffd700 1 -- 172.21.15.45:0/3929989783 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcc2000cbd0 con 0x7fcc24101be0 2024-05-10T03:40:21.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.700+0000 7fcc2bdd5700 1 -- 172.21.15.45:0/3929989783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc241a22c0 con 0x7fcc24101be0 2024-05-10T03:40:21.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.700+0000 7fcc16ffd700 1 -- 172.21.15.45:0/3929989783 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc20018730 con 0x7fcc24101be0 2024-05-10T03:40:21.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.700+0000 7fcc2bdd5700 1 -- 172.21.15.45:0/3929989783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc241a27a0 con 0x7fcc24101be0 2024-05-10T03:40:21.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.701+0000 7fcc2bdd5700 1 -- 172.21.15.45:0/3929989783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc240694d0 con 0x7fcc24101be0 2024-05-10T03:40:21.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.703+0000 7fcc16ffd700 1 -- 172.21.15.45:0/3929989783 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fcc20010430 con 0x7fcc24101be0 2024-05-10T03:40:21.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.704+0000 7fcc16ffd700 1 --2- 172.21.15.45:0/3929989783 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcc100a1260 0x7fcc100a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:21.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.704+0000 7fcc29b71700 1 --2- 172.21.15.45:0/3929989783 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcc100a1260 0x7fcc100a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:21.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.704+0000 7fcc16ffd700 1 -- 172.21.15.45:0/3929989783 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fcc20014070 con 0x7fcc24101be0 2024-05-10T03:40:21.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.705+0000 7fcc29b71700 1 --2- 172.21.15.45:0/3929989783 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcc100a1260 0x7fcc100a3770 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcc1800b8e0 tx=0x7fcc1801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:21.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.708+0000 7fcc16ffd700 1 -- 172.21.15.45:0/3929989783 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fcc200967f0 con 0x7fcc24101be0 2024-05-10T03:40:21.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.929+0000 7fcc2bdd5700 1 -- 172.21.15.45:0/3929989783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcc2410c620 con 0x7fcc24101be0 2024-05-10T03:40:21.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.929+0000 7fcc16ffd700 1 -- 172.21.15.45:0/3929989783 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcc20099e10 con 0x7fcc24101be0 2024-05-10T03:40:21.933 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2024-05-10T03:40:21.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.931+0000 7fcc2bdd5700 1 -- 172.21.15.45:0/3929989783 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcc100a1260 msgr2=0x7fcc100a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:21.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.931+0000 7fcc2bdd5700 1 --2- 172.21.15.45:0/3929989783 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcc100a1260 0x7fcc100a3770 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcc1800b8e0 tx=0x7fcc1801a040 comp rx=0 tx=0).stop 2024-05-10T03:40:21.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.931+0000 7fcc2bdd5700 1 -- 172.21.15.45:0/3929989783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc24101be0 msgr2=0x7fcc24102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:21.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.931+0000 7fcc2bdd5700 1 --2- 172.21.15.45:0/3929989783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc24101be0 0x7fcc24102f20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000e9a0 tx=0x7fcc2000ed60 comp rx=0 tx=0).stop 2024-05-10T03:40:21.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.931+0000 7fcc2bdd5700 1 -- 172.21.15.45:0/3929989783 shutdown_connections 2024-05-10T03:40:21.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.931+0000 7fcc2bdd5700 1 --2- 172.21.15.45:0/3929989783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc24100ac0 0x7fcc24104880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.931+0000 7fcc2bdd5700 1 --2- 172.21.15.45:0/3929989783 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcc100a1260 0x7fcc100a3770 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.931+0000 7fcc2bdd5700 1 --2- 172.21.15.45:0/3929989783 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc24102580 0x7fcc24103460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.931+0000 7fcc2bdd5700 1 --2- 172.21.15.45:0/3929989783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc24101be0 0x7fcc24102f20 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:21.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.931+0000 7fcc2bdd5700 1 -- 172.21.15.45:0/3929989783 >> 172.21.15.45:0/3929989783 conn(0x7fcc240fc0d0 msgr2=0x7fcc240fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:21.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.931+0000 7fcc2bdd5700 1 -- 172.21.15.45:0/3929989783 shutdown_connections 2024-05-10T03:40:21.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:21.932+0000 7fcc2bdd5700 1 -- 172.21.15.45:0/3929989783 wait complete. 2024-05-10T03:40:21.950 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-10T03:40:22.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.100+0000 7f2d8610e700 1 -- 172.21.15.45:0/965959995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d80100ac0 msgr2=0x7f2d80100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:22.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.100+0000 7f2d8610e700 1 --2- 172.21.15.45:0/965959995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d80100ac0 0x7f2d80100ed0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2d70009990 tx=0x7f2d70009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.100+0000 7f2d8610e700 1 -- 172.21.15.45:0/965959995 shutdown_connections 2024-05-10T03:40:22.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.100+0000 7f2d8610e700 1 --2- 172.21.15.45:0/965959995 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d80102580 0x7f2d80108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.100+0000 7f2d8610e700 1 --2- 172.21.15.45:0/965959995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d80100ac0 0x7f2d80100ed0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.100+0000 7f2d8610e700 1 --2- 172.21.15.45:0/965959995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d80101be0 0x7f2d80101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.100+0000 7f2d8610e700 1 -- 172.21.15.45:0/965959995 >> 172.21.15.45:0/965959995 conn(0x7f2d800fc0d0 msgr2=0x7f2d800fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:22.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.100+0000 7f2d8610e700 1 -- 172.21.15.45:0/965959995 shutdown_connections 2024-05-10T03:40:22.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.100+0000 7f2d8610e700 1 -- 172.21.15.45:0/965959995 wait complete. 2024-05-10T03:40:22.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.101+0000 7f2d8610e700 1 Processor -- start 2024-05-10T03:40:22.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.101+0000 7f2d8610e700 1 -- start start 2024-05-10T03:40:22.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.101+0000 7f2d8610e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d80100ac0 0x7f2d80068e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:22.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.101+0000 7f2d8610e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d80101be0 0x7f2d8019f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:22.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.101+0000 7f2d8610e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d80102580 0x7f2d801a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:22.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.101+0000 7f2d8610e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d801a1cb0 con 0x7f2d80100ac0 2024-05-10T03:40:22.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.101+0000 7f2d8610e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d801a1e20 con 0x7f2d80101be0 2024-05-10T03:40:22.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.102+0000 7f2d8610e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d801a1fe0 con 0x7f2d80102580 2024-05-10T03:40:22.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.102+0000 7f2d7f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d80100ac0 0x7f2d80068e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:22.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.102+0000 7f2d7f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d80100ac0 0x7f2d80068e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35282/0 (socket says 172.21.15.45:35282) 2024-05-10T03:40:22.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.102+0000 7f2d7f7fe700 1 -- 172.21.15.45:0/4257755097 learned_addr learned my addr 172.21.15.45:0/4257755097 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:22.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.102+0000 7f2d7effd700 1 --2- 172.21.15.45:0/4257755097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d80101be0 0x7f2d8019f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:22.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.102+0000 7f2d7ffff700 1 --2- 172.21.15.45:0/4257755097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d80102580 0x7f2d801a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:22.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.102+0000 7f2d7f7fe700 1 -- 172.21.15.45:0/4257755097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d80102580 msgr2=0x7f2d801a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:22.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.102+0000 7f2d7f7fe700 1 --2- 172.21.15.45:0/4257755097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d80102580 0x7f2d801a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.102+0000 7f2d7f7fe700 1 -- 172.21.15.45:0/4257755097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d80101be0 msgr2=0x7f2d8019f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:22.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.102+0000 7f2d7f7fe700 1 --2- 172.21.15.45:0/4257755097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d80101be0 0x7f2d8019f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.102+0000 7f2d7f7fe700 1 -- 172.21.15.45:0/4257755097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d700095f0 con 0x7f2d80100ac0 2024-05-10T03:40:22.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.102+0000 7f2d7f7fe700 1 --2- 172.21.15.45:0/4257755097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d80100ac0 0x7f2d80068e40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2d70000c00 tx=0x7f2d70005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:22.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.102+0000 7f2d7cff9700 1 -- 172.21.15.45:0/4257755097 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7001d070 con 0x7f2d80100ac0 2024-05-10T03:40:22.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.102+0000 7f2d7cff9700 1 -- 172.21.15.45:0/4257755097 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2d7000be70 con 0x7f2d80100ac0 2024-05-10T03:40:22.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.102+0000 7f2d8610e700 1 -- 172.21.15.45:0/4257755097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d801a2260 con 0x7f2d80100ac0 2024-05-10T03:40:22.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.102+0000 7f2d7cff9700 1 -- 172.21.15.45:0/4257755097 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d700173f0 con 0x7f2d80100ac0 2024-05-10T03:40:22.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.103+0000 7f2d8610e700 1 -- 172.21.15.45:0/4257755097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d801a26e0 con 0x7f2d80100ac0 2024-05-10T03:40:22.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.103+0000 7f2d8610e700 1 -- 172.21.15.45:0/4257755097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d80107cd0 con 0x7f2d80100ac0 2024-05-10T03:40:22.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.105+0000 7f2d7cff9700 1 -- 172.21.15.45:0/4257755097 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2d70021410 con 0x7f2d80100ac0 2024-05-10T03:40:22.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.105+0000 7f2d7cff9700 1 --2- 172.21.15.45:0/4257755097 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2d680a12e0 0x7f2d680a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:22.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.106+0000 7f2d7effd700 1 --2- 172.21.15.45:0/4257755097 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2d680a12e0 0x7f2d680a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:22.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.106+0000 7f2d7cff9700 1 -- 172.21.15.45:0/4257755097 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f2d700ce610 con 0x7f2d80100ac0 2024-05-10T03:40:22.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.106+0000 7f2d7effd700 1 --2- 172.21.15.45:0/4257755097 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2d680a12e0 0x7f2d680a37f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2d800687e0 tx=0x7f2d74009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:22.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.109+0000 7f2d7cff9700 1 -- 172.21.15.45:0/4257755097 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2d700979c0 con 0x7f2d80100ac0 2024-05-10T03:40:22.283 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:22 smithi045 ceph-mon[42520]: from='client.15615 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T03:40:22.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:22 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3114180795' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:40:22.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:22 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2062752244' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:40:22.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:22 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3929989783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:40:22.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.329+0000 7f2d8610e700 1 -- 172.21.15.45:0/4257755097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2d80069460 con 0x7f2d80100ac0 2024-05-10T03:40:22.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.329+0000 7f2d7cff9700 1 -- 172.21.15.45:0/4257755097 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2d7009afe0 con 0x7f2d80100ac0 2024-05-10T03:40:22.333 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-05-10T03:40:22.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.331+0000 7f2d8610e700 1 -- 172.21.15.45:0/4257755097 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2d680a12e0 msgr2=0x7f2d680a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:22.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.331+0000 7f2d8610e700 1 --2- 172.21.15.45:0/4257755097 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2d680a12e0 0x7f2d680a37f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2d800687e0 tx=0x7f2d74009260 comp rx=0 tx=0).stop 2024-05-10T03:40:22.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.331+0000 7f2d8610e700 1 -- 172.21.15.45:0/4257755097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d80100ac0 msgr2=0x7f2d80068e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:22.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.331+0000 7f2d8610e700 1 --2- 172.21.15.45:0/4257755097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d80100ac0 0x7f2d80068e40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2d70000c00 tx=0x7f2d70005b00 comp rx=0 tx=0).stop 2024-05-10T03:40:22.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.332+0000 7f2d8610e700 1 -- 172.21.15.45:0/4257755097 shutdown_connections 2024-05-10T03:40:22.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.332+0000 7f2d8610e700 1 --2- 172.21.15.45:0/4257755097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d80102580 0x7f2d801a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.332+0000 7f2d8610e700 1 --2- 172.21.15.45:0/4257755097 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2d680a12e0 0x7f2d680a37f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.332+0000 7f2d8610e700 1 --2- 172.21.15.45:0/4257755097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d80100ac0 0x7f2d80068e40 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.332+0000 7f2d8610e700 1 --2- 172.21.15.45:0/4257755097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d80101be0 0x7f2d8019f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.332+0000 7f2d8610e700 1 -- 172.21.15.45:0/4257755097 >> 172.21.15.45:0/4257755097 conn(0x7f2d800fc0d0 msgr2=0x7f2d80104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:22.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.332+0000 7f2d8610e700 1 -- 172.21.15.45:0/4257755097 shutdown_connections 2024-05-10T03:40:22.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.332+0000 7f2d8610e700 1 -- 172.21.15.45:0/4257755097 wait complete. 2024-05-10T03:40:22.350 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:40:22.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:22 smithi106 ceph-mon[46996]: from='client.15615 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T03:40:22.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:22 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3114180795' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:40:22.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:22 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2062752244' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:40:22.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:22 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3929989783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:40:22.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:22 smithi154 ceph-mon[46565]: from='client.15615 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T03:40:22.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:22 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3114180795' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:40:22.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:22 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2062752244' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:40:22.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:22 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3929989783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:40:22.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.496+0000 7f790e2e9700 1 -- 172.21.15.45:0/2464257860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7908107880 msgr2=0x7f7908109d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:22.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.496+0000 7f790e2e9700 1 --2- 172.21.15.45:0/2464257860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7908107880 0x7f7908109d90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f790000b0a0 tx=0x7f790000b3b0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.496+0000 7f790e2e9700 1 -- 172.21.15.45:0/2464257860 shutdown_connections 2024-05-10T03:40:22.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.496+0000 7f790e2e9700 1 --2- 172.21.15.45:0/2464257860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7908069090 0x7f7908104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.496+0000 7f790e2e9700 1 --2- 172.21.15.45:0/2464257860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7908107880 0x7f7908109d90 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.496+0000 7f790e2e9700 1 --2- 172.21.15.45:0/2464257860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7908104d10 0x7f79081071f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.496+0000 7f790e2e9700 1 -- 172.21.15.45:0/2464257860 >> 172.21.15.45:0/2464257860 conn(0x7f79080fc0d0 msgr2=0x7f79080fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:22.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.496+0000 7f790e2e9700 1 -- 172.21.15.45:0/2464257860 shutdown_connections 2024-05-10T03:40:22.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.496+0000 7f790e2e9700 1 -- 172.21.15.45:0/2464257860 wait complete. 2024-05-10T03:40:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.497+0000 7f790e2e9700 1 Processor -- start 2024-05-10T03:40:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.497+0000 7f790e2e9700 1 -- start start 2024-05-10T03:40:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.497+0000 7f790e2e9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7908069090 0x7f7908101f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.497+0000 7f790e2e9700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7908104d10 0x7f7908100620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.498+0000 7f790e2e9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7908107880 0x7f7908100b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.498+0000 7f790e2e9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7908101240 con 0x7f7908107880 2024-05-10T03:40:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.498+0000 7f790e2e9700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79081013b0 con 0x7f7908104d10 2024-05-10T03:40:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.498+0000 7f790e2e9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79081a2210 con 0x7f7908069090 2024-05-10T03:40:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.498+0000 7f790c886700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7908107880 0x7f7908100b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.498+0000 7f790c886700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7908107880 0x7f7908100b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35296/0 (socket says 172.21.15.45:35296) 2024-05-10T03:40:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.498+0000 7f790c886700 1 -- 172.21.15.45:0/596763356 learned_addr learned my addr 172.21.15.45:0/596763356 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:22.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.498+0000 7f7907fff700 1 --2- 172.21.15.45:0/596763356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7908069090 0x7f7908101f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:22.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.498+0000 7f79077fe700 1 --2- 172.21.15.45:0/596763356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7908104d10 0x7f7908100620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:22.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.498+0000 7f790c886700 1 -- 172.21.15.45:0/596763356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7908069090 msgr2=0x7f7908101f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:22.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.498+0000 7f790c886700 1 --2- 172.21.15.45:0/596763356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7908069090 0x7f7908101f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.498+0000 7f790c886700 1 -- 172.21.15.45:0/596763356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7908104d10 msgr2=0x7f7908100620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:22.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.498+0000 7f790c886700 1 --2- 172.21.15.45:0/596763356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7908104d10 0x7f7908100620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.498+0000 7f790c886700 1 -- 172.21.15.45:0/596763356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7900009d00 con 0x7f7908107880 2024-05-10T03:40:22.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.498+0000 7f790c886700 1 --2- 172.21.15.45:0/596763356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7908107880 0x7f7908100b60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f790000b070 tx=0x7f79000079b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:22.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.498+0000 7f79057fa700 1 -- 172.21.15.45:0/596763356 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790000e040 con 0x7f7908107880 2024-05-10T03:40:22.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.498+0000 7f79057fa700 1 -- 172.21.15.45:0/596763356 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7900003c00 con 0x7f7908107880 2024-05-10T03:40:22.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.498+0000 7f790e2e9700 1 -- 172.21.15.45:0/596763356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79081a2410 con 0x7f7908107880 2024-05-10T03:40:22.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.498+0000 7f79057fa700 1 -- 172.21.15.45:0/596763356 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790001b6c0 con 0x7f7908107880 2024-05-10T03:40:22.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.499+0000 7f790e2e9700 1 -- 172.21.15.45:0/596763356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79081a2830 con 0x7f7908107880 2024-05-10T03:40:22.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.500+0000 7f790e2e9700 1 -- 172.21.15.45:0/596763356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79080fdc80 con 0x7f7908107880 2024-05-10T03:40:22.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.502+0000 7f79057fa700 1 -- 172.21.15.45:0/596763356 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f790001d470 con 0x7f7908107880 2024-05-10T03:40:22.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.503+0000 7f79057fa700 1 --2- 172.21.15.45:0/596763356 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f78f00a11b0 0x7f78f00a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:22.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.503+0000 7f7907fff700 1 --2- 172.21.15.45:0/596763356 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f78f00a11b0 0x7f78f00a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:22.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.503+0000 7f79057fa700 1 -- 172.21.15.45:0/596763356 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f79000ce0f0 con 0x7f7908107880 2024-05-10T03:40:22.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.503+0000 7f7907fff700 1 --2- 172.21.15.45:0/596763356 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f78f00a11b0 0x7f78f00a36c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f79080694a0 tx=0x7f78f8007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:22.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.506+0000 7f79057fa700 1 -- 172.21.15.45:0/596763356 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7900097440 con 0x7f7908107880 2024-05-10T03:40:22.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.773+0000 7f790e2e9700 1 -- 172.21.15.45:0/596763356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f790810d610 con 0x7f7908107880 2024-05-10T03:40:22.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.773+0000 7f79057fa700 1 -- 172.21.15.45:0/596763356 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+10926 (secure 0 0 0) 0x7f790009aa60 con 0x7f7908107880 2024-05-10T03:40:22.777 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:40:22.777 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/378320264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":378320264},{"type":"v1","addr":"172.21.15.45:6835","nonce":378320264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3032381796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3032381796},{"type":"v1","addr":"172.21.15.45:6837","nonce":3032381796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T03:38:36.555290+0000","modified":"2024-05-10T03:40:14.047840+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24548,"mds_2":24547,"mds_3":24526,"mds_4":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14625":{"gid":14625,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6839/4007419304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":4007419304},{"type":"v1","addr":"172.21.15.45:6839","nonce":4007419304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14637":{"gid":14637,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6841/1355456195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1355456195},{"type":"v1","addr":"172.21.15.45:6841","nonce":1355456195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/4037121210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":4037121210},{"type":"v1","addr":"172.21.15.154:6835","nonce":4037121210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24521":{"gid":24521,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.106:6835/4162885659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4162885659},{"type":"v1","addr":"172.21.15.106:6835","nonce":4162885659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.154:6837/608167481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":608167481},{"type":"v1","addr":"172.21.15.154:6837","nonce":608167481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/1506563336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1506563336},{"type":"v1","addr":"172.21.15.154:6839","nonce":1506563336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.106:6837/3047487403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":3047487403},{"type":"v1","addr":"172.21.15.106:6837","nonce":3047487403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6839/3533867856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":3533867856},{"type":"v1","addr":"172.21.15.106:6839","nonce":3533867856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T03:40:22.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.776+0000 7f790e2e9700 1 -- 172.21.15.45:0/596763356 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f78f00a11b0 msgr2=0x7f78f00a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:22.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.776+0000 7f790e2e9700 1 --2- 172.21.15.45:0/596763356 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f78f00a11b0 0x7f78f00a36c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f79080694a0 tx=0x7f78f8007400 comp rx=0 tx=0).stop 2024-05-10T03:40:22.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.776+0000 7f790e2e9700 1 -- 172.21.15.45:0/596763356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7908107880 msgr2=0x7f7908100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:22.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.776+0000 7f790e2e9700 1 --2- 172.21.15.45:0/596763356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7908107880 0x7f7908100b60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f790000b070 tx=0x7f79000079b0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.776+0000 7f790e2e9700 1 -- 172.21.15.45:0/596763356 shutdown_connections 2024-05-10T03:40:22.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.776+0000 7f790e2e9700 1 --2- 172.21.15.45:0/596763356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7908069090 0x7f7908101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.776+0000 7f790e2e9700 1 --2- 172.21.15.45:0/596763356 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f78f00a11b0 0x7f78f00a36c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.776+0000 7f790e2e9700 1 --2- 172.21.15.45:0/596763356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7908107880 0x7f7908100b60 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.776+0000 7f790e2e9700 1 --2- 172.21.15.45:0/596763356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7908104d10 0x7f7908100620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.776+0000 7f790e2e9700 1 -- 172.21.15.45:0/596763356 >> 172.21.15.45:0/596763356 conn(0x7f79080fc0d0 msgr2=0x7f7908102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:22.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.776+0000 7f790e2e9700 1 -- 172.21.15.45:0/596763356 shutdown_connections 2024-05-10T03:40:22.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.776+0000 7f790e2e9700 1 -- 172.21.15.45:0/596763356 wait complete. 2024-05-10T03:40:22.780 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 28 2024-05-10T03:40:22.794 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:40:22.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.940+0000 7f0d05dff700 1 -- 172.21.15.45:0/82458740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d00101be0 msgr2=0x7f0d00101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:22.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.940+0000 7f0d05dff700 1 --2- 172.21.15.45:0/82458740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d00101be0 0x7f0d00101ff0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009990 tx=0x7f0cf4009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.940+0000 7f0d05dff700 1 -- 172.21.15.45:0/82458740 shutdown_connections 2024-05-10T03:40:22.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.940+0000 7f0d05dff700 1 --2- 172.21.15.45:0/82458740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d00102580 0x7f0d00108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.940+0000 7f0d05dff700 1 --2- 172.21.15.45:0/82458740 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d00100ac0 0x7f0d00100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.940+0000 7f0d05dff700 1 --2- 172.21.15.45:0/82458740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d00101be0 0x7f0d00101ff0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.940+0000 7f0d05dff700 1 -- 172.21.15.45:0/82458740 >> 172.21.15.45:0/82458740 conn(0x7f0d000fc0d0 msgr2=0x7f0d000fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:22.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.940+0000 7f0d05dff700 1 -- 172.21.15.45:0/82458740 shutdown_connections 2024-05-10T03:40:22.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.940+0000 7f0d05dff700 1 -- 172.21.15.45:0/82458740 wait complete. 2024-05-10T03:40:22.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.941+0000 7f0d05dff700 1 Processor -- start 2024-05-10T03:40:22.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.941+0000 7f0d05dff700 1 -- start start 2024-05-10T03:40:22.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.941+0000 7f0d05dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d00100ac0 0x7f0d00104880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:22.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.941+0000 7f0d05dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d00101be0 0x7f0d00102f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:22.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.941+0000 7f0d05dff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d00102580 0x7f0d00103460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:22.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.941+0000 7f0d05dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d00103b40 con 0x7f0d00101be0 2024-05-10T03:40:22.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.941+0000 7f0d05dff700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d00103cb0 con 0x7f0d00102580 2024-05-10T03:40:22.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.941+0000 7f0d05dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d001a2120 con 0x7f0d00100ac0 2024-05-10T03:40:22.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.942+0000 7f0cfeffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d00101be0 0x7f0d00102f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:22.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.942+0000 7f0cfeffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d00101be0 0x7f0d00102f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35316/0 (socket says 172.21.15.45:35316) 2024-05-10T03:40:22.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.942+0000 7f0cfeffd700 1 -- 172.21.15.45:0/487525956 learned_addr learned my addr 172.21.15.45:0/487525956 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:22.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.942+0000 7f0cff7fe700 1 --2- 172.21.15.45:0/487525956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d00100ac0 0x7f0d00104880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:22.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.942+0000 7f0cfffff700 1 --2- 172.21.15.45:0/487525956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d00102580 0x7f0d00103460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:22.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.942+0000 7f0cfeffd700 1 -- 172.21.15.45:0/487525956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d00100ac0 msgr2=0x7f0d00104880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:22.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.942+0000 7f0cfeffd700 1 --2- 172.21.15.45:0/487525956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d00100ac0 0x7f0d00104880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.942+0000 7f0cfeffd700 1 -- 172.21.15.45:0/487525956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d00102580 msgr2=0x7f0d00103460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:22.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.942+0000 7f0cfeffd700 1 --2- 172.21.15.45:0/487525956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d00102580 0x7f0d00103460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:22.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.942+0000 7f0cfeffd700 1 -- 172.21.15.45:0/487525956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf40095f0 con 0x7f0d00101be0 2024-05-10T03:40:22.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.942+0000 7f0cfeffd700 1 --2- 172.21.15.45:0/487525956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d00101be0 0x7f0d00102f20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0cf40098e0 tx=0x7f0cf400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:22.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.942+0000 7f0cfcff9700 1 -- 172.21.15.45:0/487525956 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf401d070 con 0x7f0d00101be0 2024-05-10T03:40:22.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.942+0000 7f0d05dff700 1 -- 172.21.15.45:0/487525956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d001a2320 con 0x7f0d00101be0 2024-05-10T03:40:22.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.942+0000 7f0cfcff9700 1 -- 172.21.15.45:0/487525956 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0cf4022470 con 0x7f0d00101be0 2024-05-10T03:40:22.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.942+0000 7f0cfcff9700 1 -- 172.21.15.45:0/487525956 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4017650 con 0x7f0d00101be0 2024-05-10T03:40:22.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.942+0000 7f0d05dff700 1 -- 172.21.15.45:0/487525956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d001a27a0 con 0x7f0d00101be0 2024-05-10T03:40:22.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.943+0000 7f0d05dff700 1 -- 172.21.15.45:0/487525956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d000694d0 con 0x7f0d00101be0 2024-05-10T03:40:22.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.945+0000 7f0cfcff9700 1 -- 172.21.15.45:0/487525956 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f0cf4022950 con 0x7f0d00101be0 2024-05-10T03:40:22.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.945+0000 7f0cfcff9700 1 --2- 172.21.15.45:0/487525956 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0ce80a11b0 0x7f0ce80a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:22.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.946+0000 7f0cfcff9700 1 -- 172.21.15.45:0/487525956 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f0cf40ce2a0 con 0x7f0d00101be0 2024-05-10T03:40:22.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.946+0000 7f0cff7fe700 1 --2- 172.21.15.45:0/487525956 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0ce80a11b0 0x7f0ce80a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:22.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.946+0000 7f0cff7fe700 1 --2- 172.21.15.45:0/487525956 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0ce80a11b0 0x7f0ce80a36c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0d00101ae0 tx=0x7f0cf0007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:22.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:22.949+0000 7f0cfcff9700 1 -- 172.21.15.45:0/487525956 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0cf40975f0 con 0x7f0d00101be0 2024-05-10T03:40:23.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.171+0000 7f0d05dff700 1 -- 172.21.15.45:0/487525956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d0010c600 con 0x7f0d00101be0 2024-05-10T03:40:23.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.173+0000 7f0cfcff9700 1 -- 172.21.15.45:0/487525956 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+24508 (secure 0 0 0) 0x7f0cf409ac10 con 0x7f0d00101be0 2024-05-10T03:40:23.177 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:40:23.177 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":88,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:39:27.064512+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:38:34.871801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:38:35.935386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T03:38:39.029903+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:40:23.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.176+0000 7f0d05dff700 1 -- 172.21.15.45:0/487525956 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0ce80a11b0 msgr2=0x7f0ce80a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:23.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.176+0000 7f0d05dff700 1 --2- 172.21.15.45:0/487525956 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0ce80a11b0 0x7f0ce80a36c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0d00101ae0 tx=0x7f0cf0007400 comp rx=0 tx=0).stop 2024-05-10T03:40:23.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.176+0000 7f0d05dff700 1 -- 172.21.15.45:0/487525956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d00101be0 msgr2=0x7f0d00102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:23.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.176+0000 7f0d05dff700 1 --2- 172.21.15.45:0/487525956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d00101be0 0x7f0d00102f20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0cf40098e0 tx=0x7f0cf400f690 comp rx=0 tx=0).stop 2024-05-10T03:40:23.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.176+0000 7f0d05dff700 1 -- 172.21.15.45:0/487525956 shutdown_connections 2024-05-10T03:40:23.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.176+0000 7f0d05dff700 1 --2- 172.21.15.45:0/487525956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d00100ac0 0x7f0d00104880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.176+0000 7f0d05dff700 1 --2- 172.21.15.45:0/487525956 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0ce80a11b0 0x7f0ce80a36c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.176+0000 7f0d05dff700 1 --2- 172.21.15.45:0/487525956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d00102580 0x7f0d00103460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.176+0000 7f0d05dff700 1 --2- 172.21.15.45:0/487525956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d00101be0 0x7f0d00102f20 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.176+0000 7f0d05dff700 1 -- 172.21.15.45:0/487525956 >> 172.21.15.45:0/487525956 conn(0x7f0d000fc0d0 msgr2=0x7f0d000fd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:23.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.176+0000 7f0d05dff700 1 -- 172.21.15.45:0/487525956 shutdown_connections 2024-05-10T03:40:23.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.176+0000 7f0d05dff700 1 -- 172.21.15.45:0/487525956 wait complete. 2024-05-10T03:40:23.195 DEBUG:tasks.fwd_scrub:Yielding 2024-05-10T03:40:23.195 INFO:teuthology.run_tasks:Running task background_exec... 2024-05-10T03:40:23.206 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi045.front.sepia.ceph.com 2024-05-10T03:40:23.206 DEBUG:teuthology.orchestra.run.smithi045:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-05-10T03:40:23.207 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-05-10T03:40:23.207 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-10T03:40:23.207 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-10T03:40:23.209 INFO:teuthology.run_tasks:Running task workunit... 2024-05-10T03:40:23.226 INFO:tasks.workunit:Pulling workunits from ref 50174015a7e79f951b988949abe236791f52d4da 2024-05-10T03:40:23.226 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-10T03:40:23.226 INFO:tasks.workunit:timeout=3h 2024-05-10T03:40:23.226 INFO:tasks.workunit:cleanup=True 2024-05-10T03:40:23.227 DEBUG:teuthology.orchestra.run.smithi045:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-10T03:40:23.255 INFO:teuthology.orchestra.run.smithi045.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-10T03:40:23.255 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-05-10T03:40:23.256 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 7ch/124d Inode: 1099511628283 Links: 2 2024-05-10T03:40:23.256 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T03:40:23.256 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:cephfs_t:s0 2024-05-10T03:40:23.256 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-05-10 03:38:59.815164927 +0000 2024-05-10T03:40:23.256 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-05-10 03:38:59.815164927 +0000 2024-05-10T03:40:23.256 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-05-10 03:40:12.974923987 +0000 2024-05-10T03:40:23.257 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2024-05-10 03:38:59.815164927 +0000 2024-05-10T03:40:23.257 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-10T03:40:23.257 DEBUG:teuthology.orchestra.run.smithi045:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-10T03:40:23.332 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:23 smithi045 ceph-mon[42520]: pgmap v286: 129 pgs: 129 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1023 B/s wr, 10 op/s 2024-05-10T03:40:23.332 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:23 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/4257755097' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:40:23.332 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:23 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/596763356' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:40:23.333 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 50174015a7e79f951b988949abe236791f52d4da 2024-05-10T03:40:23.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.362+0000 7fa09c7de700 1 -- 172.21.15.45:0/2070845738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa094102cf0 msgr2=0x7fa094103100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:23.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.362+0000 7fa09c7de700 1 --2- 172.21.15.45:0/2070845738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa094102cf0 0x7fa094103100 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa084009990 tx=0x7fa084009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.362+0000 7fa09c7de700 1 -- 172.21.15.45:0/2070845738 shutdown_connections 2024-05-10T03:40:23.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.362+0000 7fa09c7de700 1 --2- 172.21.15.45:0/2070845738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa094103690 0x7fa094109f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.362+0000 7fa09c7de700 1 --2- 172.21.15.45:0/2070845738 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa094101bd0 0x7fa094101fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.362+0000 7fa09c7de700 1 --2- 172.21.15.45:0/2070845738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa094102cf0 0x7fa094103100 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.362+0000 7fa09c7de700 1 -- 172.21.15.45:0/2070845738 >> 172.21.15.45:0/2070845738 conn(0x7fa0940fd1e0 msgr2=0x7fa0940ff690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:23.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.362+0000 7fa09c7de700 1 -- 172.21.15.45:0/2070845738 shutdown_connections 2024-05-10T03:40:23.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.362+0000 7fa09c7de700 1 -- 172.21.15.45:0/2070845738 wait complete. 2024-05-10T03:40:23.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.363+0000 7fa09c7de700 1 Processor -- start 2024-05-10T03:40:23.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.363+0000 7fa09c7de700 1 -- start start 2024-05-10T03:40:23.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.363+0000 7fa09c7de700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa094101bd0 0x7fa094074ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.363+0000 7fa09c7de700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa094102cf0 0x7fa094073560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.363+0000 7fa09c7de700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa094103690 0x7fa094073aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.363+0000 7fa09c7de700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa094074180 con 0x7fa094101bd0 2024-05-10T03:40:23.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.363+0000 7fa09c7de700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0940742f0 con 0x7fa094103690 2024-05-10T03:40:23.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.363+0000 7fa09c7de700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0941a2060 con 0x7fa094102cf0 2024-05-10T03:40:23.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.363+0000 7fa09a57a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa094101bd0 0x7fa094074ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.363+0000 7fa09a57a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa094101bd0 0x7fa094074ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35332/0 (socket says 172.21.15.45:35332) 2024-05-10T03:40:23.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.363+0000 7fa09a57a700 1 -- 172.21.15.45:0/4186554207 learned_addr learned my addr 172.21.15.45:0/4186554207 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:23.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.363+0000 7fa099d79700 1 --2- 172.21.15.45:0/4186554207 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa094102cf0 0x7fa094073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.363+0000 7fa09ad7b700 1 --2- 172.21.15.45:0/4186554207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa094103690 0x7fa094073aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.363+0000 7fa09a57a700 1 -- 172.21.15.45:0/4186554207 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa094102cf0 msgr2=0x7fa094073560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:23.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.363+0000 7fa09a57a700 1 --2- 172.21.15.45:0/4186554207 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa094102cf0 0x7fa094073560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.363+0000 7fa09a57a700 1 -- 172.21.15.45:0/4186554207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa094103690 msgr2=0x7fa094073aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:23.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.363+0000 7fa09a57a700 1 --2- 172.21.15.45:0/4186554207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa094103690 0x7fa094073aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.363+0000 7fa09a57a700 1 -- 172.21.15.45:0/4186554207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0840095f0 con 0x7fa094101bd0 2024-05-10T03:40:23.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.364+0000 7fa09a57a700 1 --2- 172.21.15.45:0/4186554207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa094101bd0 0x7fa094074ec0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa09000e940 tx=0x7fa09000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:23.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.364+0000 7fa08b7fe700 1 -- 172.21.15.45:0/4186554207 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09000cbd0 con 0x7fa094101bd0 2024-05-10T03:40:23.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.364+0000 7fa08b7fe700 1 -- 172.21.15.45:0/4186554207 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa090004500 con 0x7fa094101bd0 2024-05-10T03:40:23.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.364+0000 7fa08b7fe700 1 -- 172.21.15.45:0/4186554207 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa090003e30 con 0x7fa094101bd0 2024-05-10T03:40:23.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.364+0000 7fa09c7de700 1 -- 172.21.15.45:0/4186554207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0941a22c0 con 0x7fa094101bd0 2024-05-10T03:40:23.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.364+0000 7fa09c7de700 1 -- 172.21.15.45:0/4186554207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0941a27a0 con 0x7fa094101bd0 2024-05-10T03:40:23.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.367+0000 7fa08b7fe700 1 -- 172.21.15.45:0/4186554207 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fa090018430 con 0x7fa094101bd0 2024-05-10T03:40:23.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.368+0000 7fa08b7fe700 1 --2- 172.21.15.45:0/4186554207 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa0800a12e0 0x7fa0800a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.368+0000 7fa08b7fe700 1 -- 172.21.15.45:0/4186554207 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fa090014070 con 0x7fa094101bd0 2024-05-10T03:40:23.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.368+0000 7fa099d79700 1 --2- 172.21.15.45:0/4186554207 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa0800a12e0 0x7fa0800a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.368+0000 7fa0acb22b80 1 Processor -- start 2024-05-10T03:40:23.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.368+0000 7fa0acb22b80 1 -- start start 2024-05-10T03:40:23.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.368+0000 7fa099d79700 1 --2- 172.21.15.45:0/4186554207 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa0800a12e0 0x7fa0800a37f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa08400b2e0 tx=0x7fa08401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:23.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.369+0000 7fa0acb22b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ebdfaa5720 0x55ebdfaa5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.369+0000 7fa0acb22b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebdfaa65f0 0x55ebdfaa6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.369+0000 7fa0acb22b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa6f40 0x55ebdfaad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.369+0000 7fa0acb22b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebdf9cc1d0 con 0x55ebdfaa6f40 2024-05-10T03:40:23.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.369+0000 7fa0acb22b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebdf9c9b90 con 0x55ebdfaa5720 2024-05-10T03:40:23.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.369+0000 7fa0acb22b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebdf9c5480 con 0x55ebdfaa65f0 2024-05-10T03:40:23.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.369+0000 7fa09ad7b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa6f40 0x55ebdfaad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.369+0000 7fa09ad7b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa6f40 0x55ebdfaad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35338/0 (socket says 172.21.15.45:35338) 2024-05-10T03:40:23.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.369+0000 7fa09ad7b700 1 -- 172.21.15.45:0/4091251903 learned_addr learned my addr 172.21.15.45:0/4091251903 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:23.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.369+0000 7fa099d79700 1 --2- 172.21.15.45:0/4091251903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebdfaa65f0 0x55ebdfaa6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.369+0000 7fa09a57a700 1 --2- 172.21.15.45:0/4091251903 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ebdfaa5720 0x55ebdfaa5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.369+0000 7fa09ad7b700 1 -- 172.21.15.45:0/4091251903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebdfaa65f0 msgr2=0x55ebdfaa6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:23.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.369+0000 7fa09ad7b700 1 --2- 172.21.15.45:0/4091251903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebdfaa65f0 0x55ebdfaa6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.369+0000 7fa09ad7b700 1 -- 172.21.15.45:0/4091251903 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ebdfaa5720 msgr2=0x55ebdfaa5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:23.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.369+0000 7fa09ad7b700 1 --2- 172.21.15.45:0/4091251903 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ebdfaa5720 0x55ebdfaa5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.369+0000 7fa09ad7b700 1 -- 172.21.15.45:0/4091251903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ebdf846430 con 0x55ebdfaa6f40 2024-05-10T03:40:23.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.369+0000 7fa09ad7b700 1 --2- 172.21.15.45:0/4091251903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa6f40 0x55ebdfaad840 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa08c009370 tx=0x7fa08c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34acaa98953612e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:23.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.370+0000 7fa088ff9700 1 -- 172.21.15.45:0/4091251903 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c00e070 con 0x55ebdfaa6f40 2024-05-10T03:40:23.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.370+0000 7fa088ff9700 1 -- 172.21.15.45:0/4091251903 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa08c00f040 con 0x55ebdfaa6f40 2024-05-10T03:40:23.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.370+0000 7fa088ff9700 1 -- 172.21.15.45:0/4091251903 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c014920 con 0x55ebdfaa6f40 2024-05-10T03:40:23.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.371+0000 7fa0acb22b80 1 -- 172.21.15.45:0/4091251903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa6f40 msgr2=0x55ebdfaad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:23.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.371+0000 7fa0acb22b80 1 --2- 172.21.15.45:0/4091251903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa6f40 0x55ebdfaad840 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa08c009370 tx=0x7fa08c009920 comp rx=0 tx=0).stop 2024-05-10T03:40:23.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.371+0000 7fa0acb22b80 1 -- 172.21.15.45:0/4091251903 shutdown_connections 2024-05-10T03:40:23.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.371+0000 7fa0acb22b80 1 --2- 172.21.15.45:0/4091251903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa6f40 0x55ebdfaad840 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.371+0000 7fa0acb22b80 1 --2- 172.21.15.45:0/4091251903 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ebdfaa5720 0x55ebdfaa5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.371+0000 7fa0acb22b80 1 --2- 172.21.15.45:0/4091251903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebdfaa65f0 0x55ebdfaa6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.371+0000 7fa0acb22b80 1 -- 172.21.15.45:0/4091251903 >> 172.21.15.45:0/4091251903 conn(0x55ebdfa07ae0 msgr2=0x55ebdfaa0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:23.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.371+0000 7fa0acb22b80 1 -- 172.21.15.45:0/4091251903 shutdown_connections 2024-05-10T03:40:23.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.371+0000 7fa0acb22b80 1 -- 172.21.15.45:0/4091251903 wait complete. 2024-05-10T03:40:23.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.371+0000 7fa0acb22b80 1 -- start start 2024-05-10T03:40:23.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.371+0000 7fa0acb22b80 1 Processor -- start 2024-05-10T03:40:23.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.372+0000 7fa0acb22b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ebdfaa5720 0x55ebdfaaf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.372+0000 7fa0acb22b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebdfaa65f0 0x55ebdfaafc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.372+0000 7fa0acb22b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa6f40 0x55ebdfab6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.372+0000 7fa0acb22b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebdf9615e0 con 0x55ebdfaa6f40 2024-05-10T03:40:23.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.372+0000 7fa0acb22b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebdf961280 con 0x55ebdfaa5720 2024-05-10T03:40:23.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.372+0000 7fa0acb22b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebdf848720 con 0x55ebdfaa65f0 2024-05-10T03:40:23.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.372+0000 7fa0acb22b80 10 client.0 _ll_register_callbacks cb 0x55ebdf96abb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:23.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.372+0000 7fa09ad7b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa6f40 0x55ebdfab6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.372+0000 7fa099d79700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebdfaa65f0 0x55ebdfaafc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.372+0000 7fa09ad7b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa6f40 0x55ebdfab6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35354/0 (socket says 172.21.15.45:35354) 2024-05-10T03:40:23.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.372+0000 7fa09ad7b700 1 -- 172.21.15.45:0/76663633 learned_addr learned my addr 172.21.15.45:0/76663633 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:23.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.372+0000 7fa09a57a700 1 --2- 172.21.15.45:0/76663633 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ebdfaa5720 0x55ebdfaaf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.372+0000 7fa099d79700 1 -- 172.21.15.45:0/76663633 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ebdfaa5720 msgr2=0x55ebdfaaf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:23.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.372+0000 7fa099d79700 1 --2- 172.21.15.45:0/76663633 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ebdfaa5720 0x55ebdfaaf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.372+0000 7fa099d79700 1 -- 172.21.15.45:0/76663633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa6f40 msgr2=0x55ebdfab6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:23.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.372+0000 7fa099d79700 1 --2- 172.21.15.45:0/76663633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa6f40 0x55ebdfab6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.372+0000 7fa099d79700 1 -- 172.21.15.45:0/76663633 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08c009050 con 0x55ebdfaa65f0 2024-05-10T03:40:23.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.373+0000 7fa099d79700 1 --2- 172.21.15.45:0/76663633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebdfaa65f0 0x55ebdfaafc60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa0840098e0 tx=0x7fa084009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de6d1e552213f9dc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:23.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.373+0000 7fa07dffb700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-05-10T03:40:23.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.373+0000 7fa07dffb700 1 -- 172.21.15.45:0/76663633 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08402a050 con 0x55ebdfaa65f0 2024-05-10T03:40:23.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.373+0000 7fa0acb22b80 1 -- 172.21.15.45:0/76663633 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ebdf91e2f0 con 0x55ebdfaa65f0 2024-05-10T03:40:23.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.373+0000 7fa07dffb700 1 -- 172.21.15.45:0/76663633 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fa084023810 con 0x55ebdfaa65f0 2024-05-10T03:40:23.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.373+0000 7fa07dffb700 1 -- 172.21.15.45:0/76663633 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa08401d040 con 0x55ebdfaa65f0 2024-05-10T03:40:23.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.373+0000 7fa0acb22b80 10 client.25561 fetch_fsmap learned FSMap version 28 2024-05-10T03:40:23.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.373+0000 7fa0acb22b80 1 -- 172.21.15.45:0/76663633 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55ebdf7f2be0 con 0x55ebdfaa65f0 2024-05-10T03:40:23.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.374+0000 7fa07dffb700 1 -- 172.21.15.45:0/76663633 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55ebdf91e2f0 con 0x55ebdfaa65f0 2024-05-10T03:40:23.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.374+0000 7fa07dffb700 1 -- 172.21.15.45:0/76663633 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa08402faf0 con 0x55ebdfaa65f0 2024-05-10T03:40:23.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.374+0000 7fa0acb22b80 10 client.25561 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:40:23.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.374+0000 7fa0acb22b80 10 client.25561 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:40:23.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.374+0000 7fa0acb22b80 20 client.25561 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:23.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.374+0000 7fa0acb22b80 1 --2- 172.21.15.45:0/76663633 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55ebdfabb3e0 0x55ebdfabd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.374+0000 7fa0acb22b80 4 client.25561 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:40:23.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.374+0000 7fa0acb22b80 1 -- 172.21.15.45:0/76663633 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ebdfa74800 con 0x55ebdfabb3e0 2024-05-10T03:40:23.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.374+0000 7fa09a57a700 1 --2- 172.21.15.45:0/76663633 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55ebdfabb3e0 0x55ebdfabd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.375+0000 7fa07dffb700 10 client.25561 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:23.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.375+0000 7fa09a57a700 1 --2- 172.21.15.45:0/76663633 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55ebdfabb3e0 0x55ebdfabd830 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a14f597f3bbe8e5d server_cookie=2b82fce49b46b77b in_seq=0 out_seq=0 2024-05-10T03:40:23.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.376+0000 7fa07dffb700 1 -- 172.21.15.45:0/76663633 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ebdfa74800 con 0x55ebdfabb3e0 2024-05-10T03:40:23.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.376+0000 7fa07dffb700 10 client.25561 handle_command_reply: tid=0 2024-05-10T03:40:23.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.376+0000 7fa0acb22b80 1 client.25561 shutdown 2024-05-10T03:40:23.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.376+0000 7fa0acb22b80 1 -- 172.21.15.45:0/76663633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebdfaa65f0 msgr2=0x55ebdfaafc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:23.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.376+0000 7fa0acb22b80 1 --2- 172.21.15.45:0/76663633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebdfaa65f0 0x55ebdfaafc60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa0840098e0 tx=0x7fa084009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.376+0000 7fa0acb22b80 1 -- 172.21.15.45:0/76663633 shutdown_connections 2024-05-10T03:40:23.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.376+0000 7fa0acb22b80 1 --2- 172.21.15.45:0/76663633 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55ebdfabb3e0 0x55ebdfabd830 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.376+0000 7fa0acb22b80 1 --2- 172.21.15.45:0/76663633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa6f40 0x55ebdfab6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.376+0000 7fa0acb22b80 1 --2- 172.21.15.45:0/76663633 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ebdfaa5720 0x55ebdfaaf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.376+0000 7fa0acb22b80 1 --2- 172.21.15.45:0/76663633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebdfaa65f0 0x55ebdfaafc60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.376+0000 7fa07dffb700 0 client.25561 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:23.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.376+0000 7fa0acb22b80 1 -- 172.21.15.45:0/76663633 >> 172.21.15.45:0/76663633 conn(0x55ebdfa07ae0 msgr2=0x55ebdfaa0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:23.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.376+0000 7fa0acb22b80 1 -- 172.21.15.45:0/76663633 shutdown_connections 2024-05-10T03:40:23.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.376+0000 7fa0acb22b80 1 -- 172.21.15.45:0/76663633 wait complete. 2024-05-10T03:40:23.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.376+0000 7fa0acb22b80 20 client.25561 trim_cache size 0 max 16384 2024-05-10T03:40:23.386 INFO:tasks.workunit.client.0.smithi045.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-10T03:40:23.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.396+0000 7fa0acb22b80 1 Processor -- start 2024-05-10T03:40:23.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.396+0000 7fa0acb22b80 1 -- start start 2024-05-10T03:40:23.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.396+0000 7fa0acb22b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ebdfaa5720 0x55ebdfab4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.396+0000 7fa0acb22b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebdfaa65f0 0x55ebdfab50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.396+0000 7fa0acb22b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa6f40 0x55ebdfaaa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.396+0000 7fa0acb22b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebdfab7620 con 0x55ebdfaa6f40 2024-05-10T03:40:23.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.396+0000 7fa0acb22b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebdfab07c0 con 0x55ebdfaa5720 2024-05-10T03:40:23.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.396+0000 7fa0acb22b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebdfaa17f0 con 0x55ebdfaa65f0 2024-05-10T03:40:23.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.397+0000 7fa09ad7b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa6f40 0x55ebdfaaa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.397+0000 7fa09ad7b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa6f40 0x55ebdfaaa3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35362/0 (socket says 172.21.15.45:35362) 2024-05-10T03:40:23.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.397+0000 7fa09ad7b700 1 -- 172.21.15.45:0/720652935 learned_addr learned my addr 172.21.15.45:0/720652935 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:23.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.397+0000 7fa099d79700 1 --2- 172.21.15.45:0/720652935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebdfaa65f0 0x55ebdfab50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.397+0000 7fa09a57a700 1 --2- 172.21.15.45:0/720652935 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ebdfaa5720 0x55ebdfab4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.397+0000 7fa09ad7b700 1 -- 172.21.15.45:0/720652935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebdfaa65f0 msgr2=0x55ebdfab50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:23.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.397+0000 7fa09ad7b700 1 --2- 172.21.15.45:0/720652935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebdfaa65f0 0x55ebdfab50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.397+0000 7fa09ad7b700 1 -- 172.21.15.45:0/720652935 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ebdfaa5720 msgr2=0x55ebdfab4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:23.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.397+0000 7fa09ad7b700 1 --2- 172.21.15.45:0/720652935 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ebdfaa5720 0x55ebdfab4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.397+0000 7fa09ad7b700 1 -- 172.21.15.45:0/720652935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ebdf98b5e0 con 0x55ebdfaa6f40 2024-05-10T03:40:23.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.397+0000 7fa099d79700 1 --2- 172.21.15.45:0/720652935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebdfaa65f0 0x55ebdfab50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:40:23.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.397+0000 7fa09a57a700 1 --2- 172.21.15.45:0/720652935 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ebdfaa5720 0x55ebdfab4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:40:23.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.397+0000 7fa09ad7b700 1 --2- 172.21.15.45:0/720652935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa6f40 0x55ebdfaaa3d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0143e0 tx=0x7fa08c006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab4d4e6613a3a6c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:23.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.397+0000 7fa0897fa700 1 -- 172.21.15.45:0/720652935 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c00e040 con 0x55ebdfaa6f40 2024-05-10T03:40:23.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.398+0000 7fa0897fa700 1 -- 172.21.15.45:0/720652935 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa08c004d90 con 0x55ebdfaa6f40 2024-05-10T03:40:23.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.398+0000 7fa0897fa700 1 -- 172.21.15.45:0/720652935 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c0048a0 con 0x55ebdfaa6f40 2024-05-10T03:40:23.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:23 smithi106 ceph-mon[46996]: pgmap v286: 129 pgs: 129 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1023 B/s wr, 10 op/s 2024-05-10T03:40:23.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:23 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/4257755097' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:40:23.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:23 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/596763356' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:40:23.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.398+0000 7fa0acb22b80 1 -- 172.21.15.45:0/720652935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa6f40 msgr2=0x55ebdfaaa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:23.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.398+0000 7fa0acb22b80 1 --2- 172.21.15.45:0/720652935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa6f40 0x55ebdfaaa3d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0143e0 tx=0x7fa08c006040 comp rx=0 tx=0).stop 2024-05-10T03:40:23.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.398+0000 7fa0acb22b80 1 -- 172.21.15.45:0/720652935 shutdown_connections 2024-05-10T03:40:23.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.398+0000 7fa0acb22b80 1 --2- 172.21.15.45:0/720652935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa6f40 0x55ebdfaaa3d0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.398+0000 7fa0acb22b80 1 --2- 172.21.15.45:0/720652935 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ebdfaa5720 0x55ebdfab4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.398+0000 7fa0acb22b80 1 --2- 172.21.15.45:0/720652935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebdfaa65f0 0x55ebdfab50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.398+0000 7fa0acb22b80 1 -- 172.21.15.45:0/720652935 >> 172.21.15.45:0/720652935 conn(0x55ebdfa07ae0 msgr2=0x55ebdfaaf720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:23.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.399+0000 7fa0acb22b80 1 -- 172.21.15.45:0/720652935 shutdown_connections 2024-05-10T03:40:23.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.399+0000 7fa0acb22b80 1 -- 172.21.15.45:0/720652935 wait complete. 2024-05-10T03:40:23.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.399+0000 7fa0acb22b80 1 -- start start 2024-05-10T03:40:23.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.399+0000 7fa0acb22b80 1 Processor -- start 2024-05-10T03:40:23.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.400+0000 7fa0acb22b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa5720 0x55ebdfb09fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.400+0000 7fa0acb22b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebdfaa65f0 0x55ebdfb0a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.400+0000 7fa0acb22b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ebdfaa6f40 0x55ebdfb113f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.400+0000 7fa0acb22b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebdfb11930 con 0x55ebdfaa5720 2024-05-10T03:40:23.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.400+0000 7fa0acb22b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebdfb11a70 con 0x55ebdfaa6f40 2024-05-10T03:40:23.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.400+0000 7fa0acb22b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebdfb11c00 con 0x55ebdfaa65f0 2024-05-10T03:40:23.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.400+0000 7fa0acb22b80 10 client.0 _ll_register_callbacks cb 0x55ebdf96abb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:23.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.400+0000 7fa09a57a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa5720 0x55ebdfb09fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.400+0000 7fa09a57a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa5720 0x55ebdfb09fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35366/0 (socket says 172.21.15.45:35366) 2024-05-10T03:40:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.400+0000 7fa09a57a700 1 -- 172.21.15.45:0/249791281 learned_addr learned my addr 172.21.15.45:0/249791281 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.400+0000 7fa09ad7b700 1 --2- 172.21.15.45:0/249791281 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ebdfaa6f40 0x55ebdfb113f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.400+0000 7fa099d79700 1 --2- 172.21.15.45:0/249791281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebdfaa65f0 0x55ebdfb0a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.400+0000 7fa09a57a700 1 -- 172.21.15.45:0/249791281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebdfaa65f0 msgr2=0x55ebdfb0a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.400+0000 7fa09a57a700 1 --2- 172.21.15.45:0/249791281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebdfaa65f0 0x55ebdfb0a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.400+0000 7fa09a57a700 1 -- 172.21.15.45:0/249791281 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ebdfaa6f40 msgr2=0x55ebdfb113f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.400+0000 7fa09a57a700 1 --2- 172.21.15.45:0/249791281 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ebdfaa6f40 0x55ebdfb113f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.400+0000 7fa09a57a700 1 -- 172.21.15.45:0/249791281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0900cbe70 con 0x55ebdfaa5720 2024-05-10T03:40:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.400+0000 7fa099d79700 1 --2- 172.21.15.45:0/249791281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebdfaa65f0 0x55ebdfb0a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.400+0000 7fa09a57a700 1 --2- 172.21.15.45:0/249791281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa5720 0x55ebdfb09fa0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa090096690 tx=0x7fa090099dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7020429deb6bd6ee server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.400+0000 7fa07dffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.400+0000 7fa07dffb700 1 -- 172.21.15.45:0/249791281 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09009a190 con 0x55ebdfaa5720 2024-05-10T03:40:23.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.400+0000 7fa07dffb700 1 -- 172.21.15.45:0/249791281 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fa09009dfc0 con 0x55ebdfaa5720 2024-05-10T03:40:23.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.400+0000 7fa0acb22b80 1 -- 172.21.15.45:0/249791281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa08c00f040 con 0x55ebdfaa5720 2024-05-10T03:40:23.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.401+0000 7fa07dffb700 1 -- 172.21.15.45:0/249791281 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0900a2610 con 0x55ebdfaa5720 2024-05-10T03:40:23.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.401+0000 7fa0acb22b80 10 client.15675 fetch_fsmap learned FSMap version 28 2024-05-10T03:40:23.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.401+0000 7fa0acb22b80 1 -- 172.21.15.45:0/249791281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55ebdf7f2be0 con 0x55ebdfaa5720 2024-05-10T03:40:23.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.401+0000 7fa07dffb700 1 -- 172.21.15.45:0/249791281 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa08c00f040 con 0x55ebdfaa5720 2024-05-10T03:40:23.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.401+0000 7fa07dffb700 1 -- 172.21.15.45:0/249791281 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa0900a2180 con 0x55ebdfaa5720 2024-05-10T03:40:23.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.401+0000 7fa0acb22b80 10 client.15675 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:40:23.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.401+0000 7fa0acb22b80 10 client.15675 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:40:23.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.401+0000 7fa0acb22b80 20 client.15675 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:23.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.401+0000 7fa0acb22b80 1 --2- 172.21.15.45:0/249791281 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55ebdfb135e0 0x55ebdfb15a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.401+0000 7fa0acb22b80 4 client.15675 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-10T03:40:23.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.401+0000 7fa0acb22b80 1 -- 172.21.15.45:0/249791281 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55ebdf9bdf40 con 0x55ebdfb135e0 2024-05-10T03:40:23.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.401+0000 7fa099d79700 1 --2- 172.21.15.45:0/249791281 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55ebdfb135e0 0x55ebdfb15a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.402+0000 7fa099d79700 1 --2- 172.21.15.45:0/249791281 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55ebdfb135e0 0x55ebdfb15a00 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3deb8fa17097ebff server_cookie=dce1be365d9a5250 in_seq=0 out_seq=0 2024-05-10T03:40:23.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.402+0000 7fa07dffb700 10 client.15675 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:23.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.403+0000 7fa07dffb700 1 -- 172.21.15.45:0/249791281 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55ebdf9bdf40 con 0x55ebdfb135e0 2024-05-10T03:40:23.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.403+0000 7fa07dffb700 10 client.15675 handle_command_reply: tid=0 2024-05-10T03:40:23.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.403+0000 7fa0acb22b80 1 client.15675 shutdown 2024-05-10T03:40:23.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.403+0000 7fa0acb22b80 1 -- 172.21.15.45:0/249791281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa5720 msgr2=0x55ebdfb09fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:23.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.403+0000 7fa0acb22b80 1 --2- 172.21.15.45:0/249791281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa5720 0x55ebdfb09fa0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa090096690 tx=0x7fa090099dd0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.403+0000 7fa0acb22b80 1 -- 172.21.15.45:0/249791281 shutdown_connections 2024-05-10T03:40:23.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.403+0000 7fa0acb22b80 1 --2- 172.21.15.45:0/249791281 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55ebdfb135e0 0x55ebdfb15a00 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.403+0000 7fa0acb22b80 1 --2- 172.21.15.45:0/249791281 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ebdfaa6f40 0x55ebdfb113f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.403+0000 7fa0acb22b80 1 --2- 172.21.15.45:0/249791281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ebdfaa5720 0x55ebdfb09fa0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.403+0000 7fa0acb22b80 1 --2- 172.21.15.45:0/249791281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebdfaa65f0 0x55ebdfb0a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.403+0000 7fa07dffb700 0 client.15675 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:23.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.403+0000 7fa0acb22b80 1 -- 172.21.15.45:0/249791281 >> 172.21.15.45:0/249791281 conn(0x55ebdfa07ae0 msgr2=0x55ebdfaaf650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:23.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.404+0000 7fa0acb22b80 1 -- 172.21.15.45:0/249791281 shutdown_connections 2024-05-10T03:40:23.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.404+0000 7fa0acb22b80 1 -- 172.21.15.45:0/249791281 wait complete. 2024-05-10T03:40:23.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.404+0000 7fa0acb22b80 20 client.15675 trim_cache size 0 max 16384 2024-05-10T03:40:23.412 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:40:23.412 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-05-10T03:40:23.412 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "c44218c8-c617-4410-a241-cd56ed19d98b", 2024-05-10T03:40:23.412 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-05-10T03:40:23.412 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:40:23.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.404+0000 7fa09c7de700 1 -- 172.21.15.45:0/4186554207 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa0800a12e0 msgr2=0x7fa0800a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:23.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.404+0000 7fa09c7de700 1 --2- 172.21.15.45:0/4186554207 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa0800a12e0 0x7fa0800a37f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa08400b2e0 tx=0x7fa08401a040 comp rx=0 tx=0).stop 2024-05-10T03:40:23.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.404+0000 7fa09c7de700 1 -- 172.21.15.45:0/4186554207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa094101bd0 msgr2=0x7fa094074ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:23.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.404+0000 7fa09c7de700 1 --2- 172.21.15.45:0/4186554207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa094101bd0 0x7fa094074ec0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa09000e940 tx=0x7fa09000ed00 comp rx=0 tx=0).stop 2024-05-10T03:40:23.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.404+0000 7fa09c7de700 1 -- 172.21.15.45:0/4186554207 shutdown_connections 2024-05-10T03:40:23.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.404+0000 7fa09c7de700 1 --2- 172.21.15.45:0/4186554207 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa0800a12e0 0x7fa0800a37f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.404+0000 7fa09c7de700 1 --2- 172.21.15.45:0/4186554207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa094103690 0x7fa094073aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.404+0000 7fa09c7de700 1 --2- 172.21.15.45:0/4186554207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa094101bd0 0x7fa094074ec0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.404+0000 7fa09c7de700 1 --2- 172.21.15.45:0/4186554207 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa094102cf0 0x7fa094073560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.404+0000 7fa09c7de700 1 -- 172.21.15.45:0/4186554207 >> 172.21.15.45:0/4186554207 conn(0x7fa0940fd1e0 msgr2=0x7fa094105f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:23.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.404+0000 7fa09c7de700 1 -- 172.21.15.45:0/4186554207 shutdown_connections 2024-05-10T03:40:23.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.404+0000 7fa09c7de700 1 -- 172.21.15.45:0/4186554207 wait complete. 2024-05-10T03:40:23.422 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-10T03:40:23.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:23 smithi154 ceph-mon[46565]: pgmap v286: 129 pgs: 129 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1023 B/s wr, 10 op/s 2024-05-10T03:40:23.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:23 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/4257755097' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:40:23.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:23 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/596763356' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:40:23.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.613+0000 7f0d3c73a700 1 -- 172.21.15.45:0/1652880648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d341013a0 msgr2=0x7f0d341017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:23.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.613+0000 7f0d3c73a700 1 --2- 172.21.15.45:0/1652880648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d341013a0 0x7f0d341017b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400aaa0 tx=0x7f0d2400adb0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.613+0000 7f0d3c73a700 1 -- 172.21.15.45:0/1652880648 shutdown_connections 2024-05-10T03:40:23.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.613+0000 7f0d3c73a700 1 --2- 172.21.15.45:0/1652880648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d34101d40 0x7f0d341085f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.613+0000 7f0d3c73a700 1 --2- 172.21.15.45:0/1652880648 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d34100280 0x7f0d34100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.613+0000 7f0d3c73a700 1 --2- 172.21.15.45:0/1652880648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d341013a0 0x7f0d341017b0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.613+0000 7f0d3c73a700 1 -- 172.21.15.45:0/1652880648 >> 172.21.15.45:0/1652880648 conn(0x7f0d340fb8b0 msgr2=0x7f0d340fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:23.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.613+0000 7f0d3c73a700 1 -- 172.21.15.45:0/1652880648 shutdown_connections 2024-05-10T03:40:23.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.613+0000 7f0d3c73a700 1 -- 172.21.15.45:0/1652880648 wait complete. 2024-05-10T03:40:23.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.614+0000 7f0d3c73a700 1 Processor -- start 2024-05-10T03:40:23.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.614+0000 7f0d3c73a700 1 -- start start 2024-05-10T03:40:23.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.614+0000 7f0d3c73a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d34100280 0x7f0d34198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.614+0000 7f0d3c73a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d341013a0 0x7f0d34198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.614+0000 7f0d3c73a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d34101d40 0x7f0d3419f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.614+0000 7f0d3c73a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3419fad0 con 0x7f0d34100280 2024-05-10T03:40:23.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.614+0000 7f0d3c73a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3419fc40 con 0x7f0d341013a0 2024-05-10T03:40:23.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.614+0000 7f0d3c73a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3419fe00 con 0x7f0d34101d40 2024-05-10T03:40:23.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.615+0000 7f0d3a4d6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d34100280 0x7f0d34198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.615+0000 7f0d3a4d6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d34100280 0x7f0d34198040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35374/0 (socket says 172.21.15.45:35374) 2024-05-10T03:40:23.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.615+0000 7f0d3a4d6700 1 -- 172.21.15.45:0/580500825 learned_addr learned my addr 172.21.15.45:0/580500825 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:23.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.615+0000 7f0d39cd5700 1 --2- 172.21.15.45:0/580500825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d341013a0 0x7f0d34198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.615+0000 7f0d3acd7700 1 --2- 172.21.15.45:0/580500825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d34101d40 0x7f0d3419f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.615+0000 7f0d3a4d6700 1 -- 172.21.15.45:0/580500825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d34101d40 msgr2=0x7f0d3419f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:23.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.615+0000 7f0d3a4d6700 1 --2- 172.21.15.45:0/580500825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d34101d40 0x7f0d3419f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.615+0000 7f0d3a4d6700 1 -- 172.21.15.45:0/580500825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d341013a0 msgr2=0x7f0d34198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:23.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.615+0000 7f0d3a4d6700 1 --2- 172.21.15.45:0/580500825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d341013a0 0x7f0d34198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.615+0000 7f0d3a4d6700 1 -- 172.21.15.45:0/580500825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2400a700 con 0x7f0d34100280 2024-05-10T03:40:23.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.615+0000 7f0d3acd7700 1 --2- 172.21.15.45:0/580500825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d34101d40 0x7f0d3419f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:23.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.615+0000 7f0d3a4d6700 1 --2- 172.21.15.45:0/580500825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d34100280 0x7f0d34198040 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000d950 tx=0x7f0d3000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:23.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.615+0000 7f0d2b7fe700 1 -- 172.21.15.45:0/580500825 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d30004220 con 0x7f0d34100280 2024-05-10T03:40:23.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.615+0000 7f0d2b7fe700 1 -- 172.21.15.45:0/580500825 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0d30004380 con 0x7f0d34100280 2024-05-10T03:40:23.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.615+0000 7f0d3c73a700 1 -- 172.21.15.45:0/580500825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d341a00e0 con 0x7f0d34100280 2024-05-10T03:40:23.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.615+0000 7f0d2b7fe700 1 -- 172.21.15.45:0/580500825 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d30003cb0 con 0x7f0d34100280 2024-05-10T03:40:23.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.615+0000 7f0d3c73a700 1 -- 172.21.15.45:0/580500825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d341a05f0 con 0x7f0d34100280 2024-05-10T03:40:23.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.620+0000 7f0d4ca7eb80 1 Processor -- start 2024-05-10T03:40:23.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.620+0000 7f0d4ca7eb80 1 -- start start 2024-05-10T03:40:23.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.620+0000 7f0d4ca7eb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a58d3ac6a0 0x55a58d3acaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.620+0000 7f0d4ca7eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a58d3ad570 0x55a58d3ad980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.620+0000 7f0d4ca7eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3adec0 0x55a58d3b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.620+0000 7f0d4ca7eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a58d2d3150 con 0x55a58d3adec0 2024-05-10T03:40:23.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.620+0000 7f0d4ca7eb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a58d2d0b10 con 0x55a58d3ac6a0 2024-05-10T03:40:23.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.620+0000 7f0d4ca7eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a58d2cc400 con 0x55a58d3ad570 2024-05-10T03:40:23.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.620+0000 7f0d39cd5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3adec0 0x55a58d3b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.620+0000 7f0d39cd5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3adec0 0x55a58d3b47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35386/0 (socket says 172.21.15.45:35386) 2024-05-10T03:40:23.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.620+0000 7f0d39cd5700 1 -- 172.21.15.45:0/91042538 learned_addr learned my addr 172.21.15.45:0/91042538 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:23.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.620+0000 7f0d3acd7700 1 --2- 172.21.15.45:0/91042538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a58d3ac6a0 0x55a58d3acaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.621+0000 7f0d39cd5700 1 -- 172.21.15.45:0/91042538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a58d3ad570 msgr2=0x55a58d3ad980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T03:40:23.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.621+0000 7f0d39cd5700 1 --2- 172.21.15.45:0/91042538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a58d3ad570 0x55a58d3ad980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.621+0000 7f0d39cd5700 1 -- 172.21.15.45:0/91042538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a58d3ac6a0 msgr2=0x55a58d3acaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:23.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.621+0000 7f0d39cd5700 1 --2- 172.21.15.45:0/91042538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a58d3ac6a0 0x55a58d3acaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.621+0000 7f0d39cd5700 1 -- 172.21.15.45:0/91042538 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a58d14d3b0 con 0x55a58d3adec0 2024-05-10T03:40:23.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.621+0000 7f0d39cd5700 1 --2- 172.21.15.45:0/91042538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3adec0 0x55a58d3b47c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400aaa0 tx=0x7f0d24005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e97f8c8fc61c18 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:23.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.621+0000 7f0d2b7fe700 1 -- 172.21.15.45:0/580500825 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f0d30009730 con 0x7f0d34100280 2024-05-10T03:40:23.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.621+0000 7f0d28ff9700 1 -- 172.21.15.45:0/91042538 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2400cbf0 con 0x55a58d3adec0 2024-05-10T03:40:23.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.621+0000 7f0d28ff9700 1 -- 172.21.15.45:0/91042538 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0d24003e00 con 0x55a58d3adec0 2024-05-10T03:40:23.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.621+0000 7f0d28ff9700 1 -- 172.21.15.45:0/91042538 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24021680 con 0x55a58d3adec0 2024-05-10T03:40:23.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.622+0000 7f0d2b7fe700 1 --2- 172.21.15.45:0/580500825 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0d200a1260 0x7f0d200a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.622+0000 7f0d3acd7700 1 --2- 172.21.15.45:0/580500825 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0d200a1260 0x7f0d200a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.622+0000 7f0d2b7fe700 1 -- 172.21.15.45:0/580500825 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f0d300cc910 con 0x7f0d34100280 2024-05-10T03:40:23.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.622+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/91042538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3adec0 msgr2=0x55a58d3b47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:23.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.622+0000 7f0d4ca7eb80 1 --2- 172.21.15.45:0/91042538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3adec0 0x55a58d3b47c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400aaa0 tx=0x7f0d24005e80 comp rx=0 tx=0).stop 2024-05-10T03:40:23.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.622+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/91042538 shutdown_connections 2024-05-10T03:40:23.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.622+0000 7f0d4ca7eb80 1 --2- 172.21.15.45:0/91042538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3adec0 0x55a58d3b47c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.622+0000 7f0d4ca7eb80 1 --2- 172.21.15.45:0/91042538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a58d3ac6a0 0x55a58d3acaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.622+0000 7f0d4ca7eb80 1 --2- 172.21.15.45:0/91042538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a58d3ad570 0x55a58d3ad980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.622+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/91042538 >> 172.21.15.45:0/91042538 conn(0x55a58d30ea60 msgr2=0x55a58d3a6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:23.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.622+0000 7f0d3acd7700 1 --2- 172.21.15.45:0/580500825 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0d200a1260 0x7f0d200a3770 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55a58d3ac380 tx=0x7f0d2c009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:23.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.623+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/91042538 shutdown_connections 2024-05-10T03:40:23.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.623+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/91042538 wait complete. 2024-05-10T03:40:23.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.623+0000 7f0d4ca7eb80 1 -- start start 2024-05-10T03:40:23.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.623+0000 7f0d4ca7eb80 1 Processor -- start 2024-05-10T03:40:23.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.623+0000 7f0d4ca7eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a58d3ac6a0 0x55a58d3b6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.623+0000 7f0d4ca7eb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a58d3ad570 0x55a58d3b6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.623+0000 7f0d4ca7eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3adec0 0x55a58d3bdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.623+0000 7f0d4ca7eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a58d268560 con 0x55a58d3adec0 2024-05-10T03:40:23.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.623+0000 7f0d4ca7eb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a58d268200 con 0x55a58d3ad570 2024-05-10T03:40:23.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.623+0000 7f0d4ca7eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a58d14f6a0 con 0x55a58d3ac6a0 2024-05-10T03:40:23.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.623+0000 7f0d4ca7eb80 10 client.0 _ll_register_callbacks cb 0x55a58d271b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:23.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.624+0000 7f0d3acd7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3adec0 0x55a58d3bdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.624+0000 7f0d3acd7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3adec0 0x55a58d3bdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35400/0 (socket says 172.21.15.45:35400) 2024-05-10T03:40:23.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.624+0000 7f0d3acd7700 1 -- 172.21.15.45:0/559739508 learned_addr learned my addr 172.21.15.45:0/559739508 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:23.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.624+0000 7f0d39cd5700 1 --2- 172.21.15.45:0/559739508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a58d3ad570 0x55a58d3b6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.624+0000 7f0d3a4d6700 1 --2- 172.21.15.45:0/559739508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a58d3ac6a0 0x55a58d3b6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.624+0000 7f0d3acd7700 1 -- 172.21.15.45:0/559739508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a58d3ac6a0 msgr2=0x55a58d3b6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:23.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.624+0000 7f0d3acd7700 1 --2- 172.21.15.45:0/559739508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a58d3ac6a0 0x55a58d3b6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.624+0000 7f0d3acd7700 1 -- 172.21.15.45:0/559739508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a58d3ad570 msgr2=0x55a58d3b6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:23.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.624+0000 7f0d3acd7700 1 --2- 172.21.15.45:0/559739508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a58d3ad570 0x55a58d3b6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.624+0000 7f0d3acd7700 1 -- 172.21.15.45:0/559739508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2401a040 con 0x55a58d3adec0 2024-05-10T03:40:23.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.624+0000 7f0d39cd5700 1 --2- 172.21.15.45:0/559739508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a58d3ad570 0x55a58d3b6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:40:23.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.624+0000 7f0d3acd7700 1 --2- 172.21.15.45:0/559739508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3adec0 0x55a58d3bdb30 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009cb0 tx=0x7f0d2c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb5378165cab8b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:23.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.624+0000 7f0d1dffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:23.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.624+0000 7f0d1dffb700 1 -- 172.21.15.45:0/559739508 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c01d040 con 0x55a58d3adec0 2024-05-10T03:40:23.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.625+0000 7f0d1dffb700 1 -- 172.21.15.45:0/559739508 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f0d2c015a20 con 0x55a58d3adec0 2024-05-10T03:40:23.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.625+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/559739508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a58d225270 con 0x55a58d3adec0 2024-05-10T03:40:23.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.625+0000 7f0d1dffb700 1 -- 172.21.15.45:0/559739508 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d2c00e050 con 0x55a58d3adec0 2024-05-10T03:40:23.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.625+0000 7f0d4ca7eb80 10 client.15687 fetch_fsmap learned FSMap version 28 2024-05-10T03:40:23.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.625+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/559739508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55a58d0f9b60 con 0x55a58d3adec0 2024-05-10T03:40:23.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.625+0000 7f0d1dffb700 1 -- 172.21.15.45:0/559739508 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55a58d225270 con 0x55a58d3adec0 2024-05-10T03:40:23.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.625+0000 7f0d1dffb700 1 -- 172.21.15.45:0/559739508 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f0d2c0223d0 con 0x55a58d3adec0 2024-05-10T03:40:23.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.625+0000 7f0d4ca7eb80 10 client.15687 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:40:23.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.625+0000 7f0d4ca7eb80 10 client.15687 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:40:23.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.625+0000 7f0d4ca7eb80 20 client.15687 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:23.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.625+0000 7f0d4ca7eb80 1 --2- 172.21.15.45:0/559739508 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55a58d3c2360 0x55a58d3c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.625+0000 7f0d4ca7eb80 4 client.15687 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:40:23.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.625+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/559739508 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a58d37b780 con 0x55a58d3c2360 2024-05-10T03:40:23.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.626+0000 7f0d3a4d6700 1 --2- 172.21.15.45:0/559739508 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55a58d3c2360 0x55a58d3c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.626+0000 7f0d1dffb700 10 client.15687 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:23.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.626+0000 7f0d3a4d6700 1 --2- 172.21.15.45:0/559739508 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55a58d3c2360 0x55a58d3c47b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aff9cf3833424fe2 server_cookie=88e2f66835b4ca04 in_seq=0 out_seq=0 2024-05-10T03:40:23.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.627+0000 7f0d1dffb700 1 -- 172.21.15.45:0/559739508 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a58d37b780 con 0x55a58d3c2360 2024-05-10T03:40:23.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.627+0000 7f0d1dffb700 10 client.15687 handle_command_reply: tid=0 2024-05-10T03:40:23.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.627+0000 7f0d4ca7eb80 1 client.15687 shutdown 2024-05-10T03:40:23.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.627+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/559739508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3adec0 msgr2=0x55a58d3bdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:23.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.627+0000 7f0d4ca7eb80 1 --2- 172.21.15.45:0/559739508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3adec0 0x55a58d3bdb30 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009cb0 tx=0x7f0d2c00b040 comp rx=0 tx=0).stop 2024-05-10T03:40:23.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.627+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/559739508 shutdown_connections 2024-05-10T03:40:23.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.627+0000 7f0d4ca7eb80 1 --2- 172.21.15.45:0/559739508 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55a58d3c2360 0x55a58d3c47b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.627+0000 7f0d4ca7eb80 1 --2- 172.21.15.45:0/559739508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a58d3ac6a0 0x55a58d3b6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.627+0000 7f0d1dffb700 0 client.15687 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:23.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.627+0000 7f0d4ca7eb80 1 --2- 172.21.15.45:0/559739508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3adec0 0x55a58d3bdb30 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.627+0000 7f0d4ca7eb80 1 --2- 172.21.15.45:0/559739508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a58d3ad570 0x55a58d3b6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.627+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/559739508 >> 172.21.15.45:0/559739508 conn(0x55a58d30ea60 msgr2=0x55a58d3a6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:23.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.627+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/559739508 shutdown_connections 2024-05-10T03:40:23.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.627+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/559739508 wait complete. 2024-05-10T03:40:23.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.627+0000 7f0d4ca7eb80 20 client.15687 trim_cache size 0 max 16384 2024-05-10T03:40:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.645+0000 7f0d4ca7eb80 1 Processor -- start 2024-05-10T03:40:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.645+0000 7f0d4ca7eb80 1 -- start start 2024-05-10T03:40:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.646+0000 7f0d4ca7eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a58d30ea60 0x55a58d3b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.646+0000 7f0d4ca7eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3ac6a0 0x55a58d3bd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.646+0000 7f0d4ca7eb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a58d3ad570 0x55a58d3b6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.646+0000 7f0d4ca7eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a58d3acf50 con 0x55a58d3ac6a0 2024-05-10T03:40:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.646+0000 7f0d4ca7eb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a58d3ad3c0 con 0x55a58d3ad570 2024-05-10T03:40:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.646+0000 7f0d4ca7eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a58d3b4710 con 0x55a58d30ea60 2024-05-10T03:40:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.646+0000 7f0d39cd5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3ac6a0 0x55a58d3bd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.646+0000 7f0d39cd5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3ac6a0 0x55a58d3bd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35404/0 (socket says 172.21.15.45:35404) 2024-05-10T03:40:23.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.646+0000 7f0d39cd5700 1 -- 172.21.15.45:0/1522898496 learned_addr learned my addr 172.21.15.45:0/1522898496 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:23.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.646+0000 7f0d3a4d6700 1 --2- 172.21.15.45:0/1522898496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a58d30ea60 0x55a58d3b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.646+0000 7f0d3acd7700 1 --2- 172.21.15.45:0/1522898496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a58d3ad570 0x55a58d3b6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.646+0000 7f0d39cd5700 1 -- 172.21.15.45:0/1522898496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a58d30ea60 msgr2=0x55a58d3b5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:23.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.646+0000 7f0d39cd5700 1 --2- 172.21.15.45:0/1522898496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a58d30ea60 0x55a58d3b5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.646+0000 7f0d39cd5700 1 -- 172.21.15.45:0/1522898496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a58d3ad570 msgr2=0x55a58d3b6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:23.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.646+0000 7f0d39cd5700 1 --2- 172.21.15.45:0/1522898496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a58d3ad570 0x55a58d3b6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.646+0000 7f0d39cd5700 1 -- 172.21.15.45:0/1522898496 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a58d292560 con 0x55a58d3ac6a0 2024-05-10T03:40:23.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.646+0000 7f0d39cd5700 1 --2- 172.21.15.45:0/1522898496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3ac6a0 0x55a58d3bd760 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0d24000c00 tx=0x7f0d24004550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3becddc1881db28 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:23.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.647+0000 7f0d297fa700 1 -- 172.21.15.45:0/1522898496 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24030040 con 0x55a58d3ac6a0 2024-05-10T03:40:23.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.647+0000 7f0d297fa700 1 -- 172.21.15.45:0/1522898496 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0d2400cbf0 con 0x55a58d3ac6a0 2024-05-10T03:40:23.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.647+0000 7f0d297fa700 1 -- 172.21.15.45:0/1522898496 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24004820 con 0x55a58d3ac6a0 2024-05-10T03:40:23.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.647+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/1522898496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3ac6a0 msgr2=0x55a58d3bd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:23.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.647+0000 7f0d4ca7eb80 1 --2- 172.21.15.45:0/1522898496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3ac6a0 0x55a58d3bd760 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0d24000c00 tx=0x7f0d24004550 comp rx=0 tx=0).stop 2024-05-10T03:40:23.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.647+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/1522898496 shutdown_connections 2024-05-10T03:40:23.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.647+0000 7f0d4ca7eb80 1 --2- 172.21.15.45:0/1522898496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a58d30ea60 0x55a58d3b5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.647+0000 7f0d4ca7eb80 1 --2- 172.21.15.45:0/1522898496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a58d3ad570 0x55a58d3b6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.647+0000 7f0d4ca7eb80 1 --2- 172.21.15.45:0/1522898496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3ac6a0 0x55a58d3bd760 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.647+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/1522898496 >> 172.21.15.45:0/1522898496 conn(0x55a58d3a3450 msgr2=0x55a58d3b07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:23.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.647+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/1522898496 shutdown_connections 2024-05-10T03:40:23.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.647+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/1522898496 wait complete. 2024-05-10T03:40:23.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.648+0000 7f0d4ca7eb80 1 -- start start 2024-05-10T03:40:23.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.648+0000 7f0d4ca7eb80 1 Processor -- start 2024-05-10T03:40:23.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.648+0000 7f0d4ca7eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a58d30ea60 0x55a58d3bb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.648+0000 7f0d4ca7eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3ac6a0 0x55a58d3bba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.648+0000 7f0d4ca7eb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a58d3ad570 0x55a58d3bc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.648+0000 7f0d4ca7eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a58d3bcea0 con 0x55a58d3ac6a0 2024-05-10T03:40:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.648+0000 7f0d4ca7eb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a58d3bd010 con 0x55a58d3ad570 2024-05-10T03:40:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.648+0000 7f0d4ca7eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a58d3bd1d0 con 0x55a58d30ea60 2024-05-10T03:40:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.648+0000 7f0d4ca7eb80 10 client.0 _ll_register_callbacks cb 0x55a58d271b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.648+0000 7f0d39cd5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3ac6a0 0x55a58d3bba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.648+0000 7f0d39cd5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3ac6a0 0x55a58d3bba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35420/0 (socket says 172.21.15.45:35420) 2024-05-10T03:40:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.648+0000 7f0d39cd5700 1 -- 172.21.15.45:0/2495240729 learned_addr learned my addr 172.21.15.45:0/2495240729 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.648+0000 7f0d3a4d6700 1 --2- 172.21.15.45:0/2495240729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a58d30ea60 0x55a58d3bb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.648+0000 7f0d3acd7700 1 --2- 172.21.15.45:0/2495240729 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a58d3ad570 0x55a58d3bc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.649+0000 7f0d39cd5700 1 -- 172.21.15.45:0/2495240729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a58d30ea60 msgr2=0x55a58d3bb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.649+0000 7f0d39cd5700 1 --2- 172.21.15.45:0/2495240729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a58d30ea60 0x55a58d3bb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.649+0000 7f0d39cd5700 1 -- 172.21.15.45:0/2495240729 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a58d3ad570 msgr2=0x55a58d3bc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:23.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.649+0000 7f0d39cd5700 1 --2- 172.21.15.45:0/2495240729 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a58d3ad570 0x55a58d3bc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.649+0000 7f0d39cd5700 1 -- 172.21.15.45:0/2495240729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a58d14d3b0 con 0x55a58d3ac6a0 2024-05-10T03:40:23.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.649+0000 7f0d39cd5700 1 --2- 172.21.15.45:0/2495240729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3ac6a0 0x55a58d3bba30 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400a9f0 tx=0x7f0d24005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff2f7f4b11f8540 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:23.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.649+0000 7f0d1dffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:23.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.649+0000 7f0d1dffb700 1 -- 172.21.15.45:0/2495240729 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24030070 con 0x55a58d3ac6a0 2024-05-10T03:40:23.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.649+0000 7f0d1dffb700 1 -- 172.21.15.45:0/2495240729 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f0d24012070 con 0x55a58d3ac6a0 2024-05-10T03:40:23.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.649+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/2495240729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d24003e00 con 0x55a58d3ac6a0 2024-05-10T03:40:23.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.649+0000 7f0d1dffb700 1 -- 172.21.15.45:0/2495240729 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d24021480 con 0x55a58d3ac6a0 2024-05-10T03:40:23.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.649+0000 7f0d4ca7eb80 10 client.15693 fetch_fsmap learned FSMap version 28 2024-05-10T03:40:23.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.649+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/2495240729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55a58d151cd0 con 0x55a58d3ac6a0 2024-05-10T03:40:23.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.650+0000 7f0d1dffb700 1 -- 172.21.15.45:0/2495240729 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0d24003e00 con 0x55a58d3ac6a0 2024-05-10T03:40:23.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.650+0000 7f0d1dffb700 1 -- 172.21.15.45:0/2495240729 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f0d24045070 con 0x55a58d3ac6a0 2024-05-10T03:40:23.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.650+0000 7f0d4ca7eb80 10 client.15693 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:40:23.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.650+0000 7f0d4ca7eb80 10 client.15693 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:40:23.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.650+0000 7f0d4ca7eb80 20 client.15693 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:23.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.650+0000 7f0d4ca7eb80 1 --2- 172.21.15.45:0/2495240729 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55a58d3adec0 0x55a58d41ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:23.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.650+0000 7f0d4ca7eb80 4 client.15693 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T03:40:23.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.650+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/2495240729 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a58d2c4ec0 con 0x55a58d3adec0 2024-05-10T03:40:23.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.650+0000 7f0d3a4d6700 1 --2- 172.21.15.45:0/2495240729 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55a58d3adec0 0x55a58d41ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:23.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.650+0000 7f0d1dffb700 10 client.15693 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:23.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.650+0000 7f0d3a4d6700 1 --2- 172.21.15.45:0/2495240729 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55a58d3adec0 0x55a58d41ae80 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c79310acf20eb636 server_cookie=643a4143483dd56b in_seq=0 out_seq=0 2024-05-10T03:40:23.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.651+0000 7f0d1dffb700 1 -- 172.21.15.45:0/2495240729 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55a58d2c4ec0 con 0x55a58d3adec0 2024-05-10T03:40:23.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.651+0000 7f0d1dffb700 10 client.15693 handle_command_reply: tid=0 2024-05-10T03:40:23.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.651+0000 7f0d4ca7eb80 1 client.15693 shutdown 2024-05-10T03:40:23.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.651+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/2495240729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3ac6a0 msgr2=0x55a58d3bba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:23.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.651+0000 7f0d4ca7eb80 1 --2- 172.21.15.45:0/2495240729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3ac6a0 0x55a58d3bba30 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400a9f0 tx=0x7f0d24005e80 comp rx=0 tx=0).stop 2024-05-10T03:40:23.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.651+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/2495240729 shutdown_connections 2024-05-10T03:40:23.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.651+0000 7f0d4ca7eb80 1 --2- 172.21.15.45:0/2495240729 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55a58d3adec0 0x55a58d41ae80 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.651+0000 7f0d4ca7eb80 1 --2- 172.21.15.45:0/2495240729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a58d30ea60 0x55a58d3bb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.651+0000 7f0d4ca7eb80 1 --2- 172.21.15.45:0/2495240729 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a58d3ad570 0x55a58d3bc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.651+0000 7f0d1dffb700 0 client.15693 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:23.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.651+0000 7f0d4ca7eb80 1 --2- 172.21.15.45:0/2495240729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a58d3ac6a0 0x55a58d3bba30 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.651+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/2495240729 >> 172.21.15.45:0/2495240729 conn(0x55a58d3a3450 msgr2=0x55a58d3b07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:23.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.651+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/2495240729 shutdown_connections 2024-05-10T03:40:23.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.651+0000 7f0d4ca7eb80 1 -- 172.21.15.45:0/2495240729 wait complete. 2024-05-10T03:40:23.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.651+0000 7f0d4ca7eb80 20 client.15693 trim_cache size 0 max 16384 2024-05-10T03:40:23.660 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:40:23.661 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-10T03:40:23.661 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": { 2024-05-10T03:40:23.661 INFO:teuthology.orchestra.run.smithi045.stdout: "c44218c8-c617-4410-a241-cd56ed19d98b": { 2024-05-10T03:40:23.661 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/", 2024-05-10T03:40:23.661 INFO:teuthology.orchestra.run.smithi045.stdout: "tag": "c44218c8-c617-4410-a241-cd56ed19d98b", 2024-05-10T03:40:23.661 INFO:teuthology.orchestra.run.smithi045.stdout: "options": "recursive,force" 2024-05-10T03:40:23.661 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:40:23.661 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:40:23.661 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:40:23.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.651+0000 7f0d3c73a700 1 -- 172.21.15.45:0/580500825 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0d200a1260 msgr2=0x7f0d200a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:23.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.651+0000 7f0d3c73a700 1 --2- 172.21.15.45:0/580500825 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0d200a1260 0x7f0d200a3770 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55a58d3ac380 tx=0x7f0d2c009040 comp rx=0 tx=0).stop 2024-05-10T03:40:23.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.651+0000 7f0d3c73a700 1 -- 172.21.15.45:0/580500825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d34100280 msgr2=0x7f0d34198040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:23.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.652+0000 7f0d3c73a700 1 --2- 172.21.15.45:0/580500825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d34100280 0x7f0d34198040 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000d950 tx=0x7f0d3000dc60 comp rx=0 tx=0).stop 2024-05-10T03:40:23.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.652+0000 7f0d3c73a700 1 -- 172.21.15.45:0/580500825 shutdown_connections 2024-05-10T03:40:23.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.652+0000 7f0d3c73a700 1 --2- 172.21.15.45:0/580500825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d34101d40 0x7f0d3419f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.652+0000 7f0d3c73a700 1 --2- 172.21.15.45:0/580500825 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0d200a1260 0x7f0d200a3770 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.652+0000 7f0d3c73a700 1 --2- 172.21.15.45:0/580500825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d34100280 0x7f0d34198040 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.652+0000 7f0d3c73a700 1 --2- 172.21.15.45:0/580500825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d341013a0 0x7f0d34198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:23.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.652+0000 7f0d3c73a700 1 -- 172.21.15.45:0/580500825 >> 172.21.15.45:0/580500825 conn(0x7f0d340fb8b0 msgr2=0x7f0d341067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:23.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.652+0000 7f0d3c73a700 1 -- 172.21.15.45:0/580500825 shutdown_connections 2024-05-10T03:40:23.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:23.652+0000 7f0d3c73a700 1 -- 172.21.15.45:0/580500825 wait complete. 2024-05-10T03:40:23.669 INFO:tasks.cephfs.filesystem:scrub status for tag:c44218c8-c617-4410-a241-cd56ed19d98b - {'path': '/', 'tag': 'c44218c8-c617-4410-a241-cd56ed19d98b', 'options': 'recursive,force'} 2024-05-10T03:40:24.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:24 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/487525956' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:40:24.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:24 smithi106 ceph-mon[46996]: scrub queued for path: / 2024-05-10T03:40:24.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:24 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:40:24.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:24 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:40:24.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:24 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:40:24.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:24 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/487525956' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:40:24.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:24 smithi154 ceph-mon[46565]: scrub queued for path: / 2024-05-10T03:40:24.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:24 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:40:24.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:24 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:40:24.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:24 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:40:24.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:24 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/487525956' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:40:24.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:24 smithi045 ceph-mon[42520]: scrub queued for path: / 2024-05-10T03:40:24.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:24 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:40:24.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:24 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:40:24.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:24 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:40:25.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:25 smithi106 ceph-mon[46996]: pgmap v287: 129 pgs: 129 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1023 B/s wr, 9 op/s 2024-05-10T03:40:25.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:25 smithi154 ceph-mon[46565]: pgmap v287: 129 pgs: 129 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1023 B/s wr, 9 op/s 2024-05-10T03:40:25.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:25 smithi045 ceph-mon[42520]: pgmap v287: 129 pgs: 129 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1023 B/s wr, 9 op/s 2024-05-10T03:40:26.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [7, 11]}]: dispatch 2024-05-10T03:40:26.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-05-10T03:40:26.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]: dispatch 2024-05-10T03:40:26.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [5, 10]}]: dispatch 2024-05-10T03:40:26.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:26 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-05-10T03:40:26.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [7, 11]}]: dispatch 2024-05-10T03:40:26.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-05-10T03:40:26.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]: dispatch 2024-05-10T03:40:26.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [5, 10]}]: dispatch 2024-05-10T03:40:26.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:26 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-05-10T03:40:26.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [7, 11]}]: dispatch 2024-05-10T03:40:26.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-05-10T03:40:26.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]: dispatch 2024-05-10T03:40:26.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [5, 10]}]: dispatch 2024-05-10T03:40:26.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:26 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-05-10T03:40:27.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:27 smithi106 ceph-mon[46996]: pgmap v288: 129 pgs: 129 active+clean; 658 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-05-10T03:40:27.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:27 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [7, 11]}]': finished 2024-05-10T03:40:27.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:27 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-05-10T03:40:27.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:27 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-05-10T03:40:27.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:27 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [5, 10]}]': finished 2024-05-10T03:40:27.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:27 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-05-10T03:40:27.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:27 smithi106 ceph-mon[46996]: osdmap e89: 12 total, 12 up, 12 in 2024-05-10T03:40:27.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:27 smithi154 ceph-mon[46565]: pgmap v288: 129 pgs: 129 active+clean; 658 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-05-10T03:40:27.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:27 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [7, 11]}]': finished 2024-05-10T03:40:27.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:27 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-05-10T03:40:27.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:27 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-05-10T03:40:27.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:27 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [5, 10]}]': finished 2024-05-10T03:40:27.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:27 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-05-10T03:40:27.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:27 smithi154 ceph-mon[46565]: osdmap e89: 12 total, 12 up, 12 in 2024-05-10T03:40:27.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:27 smithi045 ceph-mon[42520]: pgmap v288: 129 pgs: 129 active+clean; 658 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-05-10T03:40:27.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [7, 11]}]': finished 2024-05-10T03:40:27.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-05-10T03:40:27.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-05-10T03:40:27.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [5, 10]}]': finished 2024-05-10T03:40:27.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:27 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-05-10T03:40:27.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:27 smithi045 ceph-mon[42520]: osdmap e89: 12 total, 12 up, 12 in 2024-05-10T03:40:28.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:28 smithi106 ceph-mon[46996]: osdmap e90: 12 total, 12 up, 12 in 2024-05-10T03:40:28.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:28 smithi154 ceph-mon[46565]: osdmap e90: 12 total, 12 up, 12 in 2024-05-10T03:40:28.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:28 smithi045 ceph-mon[42520]: osdmap e90: 12 total, 12 up, 12 in 2024-05-10T03:40:29.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:29 smithi106 ceph-mon[46996]: pgmap v291: 129 pgs: 2 peering, 127 active+clean; 658 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 895 B/s wr, 8 op/s 2024-05-10T03:40:29.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:29 smithi106 ceph-mon[46996]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-05-10T03:40:29.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:29 smithi154 ceph-mon[46565]: pgmap v291: 129 pgs: 2 peering, 127 active+clean; 658 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 895 B/s wr, 8 op/s 2024-05-10T03:40:29.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:29 smithi154 ceph-mon[46565]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-05-10T03:40:29.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:29 smithi045 ceph-mon[42520]: pgmap v291: 129 pgs: 2 peering, 127 active+clean; 658 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 895 B/s wr, 8 op/s 2024-05-10T03:40:29.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:29 smithi045 ceph-mon[42520]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-05-10T03:40:31.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:31 smithi106 ceph-mon[46996]: pgmap v292: 129 pgs: 2 peering, 127 active+clean; 658 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 11 op/s 2024-05-10T03:40:31.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:31 smithi154 ceph-mon[46565]: pgmap v292: 129 pgs: 2 peering, 127 active+clean; 658 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 11 op/s 2024-05-10T03:40:31.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:31 smithi045 ceph-mon[42520]: pgmap v292: 129 pgs: 2 peering, 127 active+clean; 658 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 11 op/s 2024-05-10T03:40:32.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:32 smithi154 ceph-mon[46565]: pgmap v293: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 12 op/s; 0 B/s, 0 objects/s recovering 2024-05-10T03:40:32.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:32 smithi154 ceph-mon[46565]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-05-10T03:40:32.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:32 smithi154 ceph-mon[46565]: Cluster is now healthy 2024-05-10T03:40:32.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:32 smithi045 ceph-mon[42520]: pgmap v293: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 12 op/s; 0 B/s, 0 objects/s recovering 2024-05-10T03:40:32.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:32 smithi045 ceph-mon[42520]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-05-10T03:40:32.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:32 smithi045 ceph-mon[42520]: Cluster is now healthy 2024-05-10T03:40:32.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:32 smithi106 ceph-mon[46996]: pgmap v293: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 12 op/s; 0 B/s, 0 objects/s recovering 2024-05-10T03:40:32.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:32 smithi106 ceph-mon[46996]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-05-10T03:40:32.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:32 smithi106 ceph-mon[46996]: Cluster is now healthy 2024-05-10T03:40:35.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:34 smithi154 ceph-mon[46565]: pgmap v294: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-05-10T03:40:35.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:34 smithi045 ceph-mon[42520]: pgmap v294: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-05-10T03:40:35.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:34 smithi106 ceph-mon[46996]: pgmap v294: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-05-10T03:40:36.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:35 smithi045 ceph-mon[42520]: scrub summary: idle 2024-05-10T03:40:36.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:35 smithi106 ceph-mon[46996]: scrub summary: idle 2024-05-10T03:40:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.400+0000 7f83852b2700 1 -- 172.21.15.45:0/3757167479 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8380107a30 msgr2=0x7f8380109e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.400+0000 7f83852b2700 1 --2- 172.21.15.45:0/3757167479 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8380107a30 0x7f8380109e50 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f837800b0a0 tx=0x7f837800b3b0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.400+0000 7f83852b2700 1 -- 172.21.15.45:0/3757167479 shutdown_connections 2024-05-10T03:40:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.400+0000 7f83852b2700 1 --2- 172.21.15.45:0/3757167479 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8380107a30 0x7f8380109e50 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.400+0000 7f83852b2700 1 --2- 172.21.15.45:0/3757167479 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8380102770 0x7f8380104b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.400+0000 7f83852b2700 1 --2- 172.21.15.45:0/3757167479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83801050d0 0x7f83801074f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.400+0000 7f83852b2700 1 -- 172.21.15.45:0/3757167479 >> 172.21.15.45:0/3757167479 conn(0x7f83800fc190 msgr2=0x7f83800fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.400+0000 7f83852b2700 1 -- 172.21.15.45:0/3757167479 shutdown_connections 2024-05-10T03:40:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.400+0000 7f83852b2700 1 -- 172.21.15.45:0/3757167479 wait complete. 2024-05-10T03:40:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.400+0000 7f83852b2700 1 Processor -- start 2024-05-10T03:40:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.401+0000 7f83852b2700 1 -- start start 2024-05-10T03:40:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.401+0000 7f83852b2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8380102770 0x7f8380101fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.401+0000 7f83852b2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83801050d0 0x7f8380100680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.401+0000 7f83852b2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8380107a30 0x7f8380100bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.401+0000 7f83852b2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8380101220 con 0x7f8380102770 2024-05-10T03:40:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.401+0000 7f83852b2700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8380101390 con 0x7f8380107a30 2024-05-10T03:40:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.401+0000 7f83852b2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8380101550 con 0x7f83801050d0 2024-05-10T03:40:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.401+0000 7f837effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8380102770 0x7f8380101fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.401+0000 7f837effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8380102770 0x7f8380101fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48700/0 (socket says 172.21.15.45:48700) 2024-05-10T03:40:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.401+0000 7f837effd700 1 -- 172.21.15.45:0/999982554 learned_addr learned my addr 172.21.15.45:0/999982554 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.401+0000 7f837e7fc700 1 --2- 172.21.15.45:0/999982554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83801050d0 0x7f8380100680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.401+0000 7f837f7fe700 1 --2- 172.21.15.45:0/999982554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8380107a30 0x7f8380100bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.401+0000 7f837effd700 1 -- 172.21.15.45:0/999982554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83801050d0 msgr2=0x7f8380100680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.401+0000 7f837effd700 1 --2- 172.21.15.45:0/999982554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83801050d0 0x7f8380100680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.401+0000 7f837effd700 1 -- 172.21.15.45:0/999982554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8380107a30 msgr2=0x7f8380100bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.401+0000 7f837effd700 1 --2- 172.21.15.45:0/999982554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8380107a30 0x7f8380100bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.401+0000 7f837effd700 1 -- 172.21.15.45:0/999982554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8378009d00 con 0x7f8380102770 2024-05-10T03:40:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.402+0000 7f837f7fe700 1 --2- 172.21.15.45:0/999982554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8380107a30 0x7f8380100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:40:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.402+0000 7f837effd700 1 --2- 172.21.15.45:0/999982554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8380102770 0x7f8380101fe0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f837000e970 tx=0x7f837000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.402+0000 7f8377fff700 1 -- 172.21.15.45:0/999982554 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8370009790 con 0x7f8380102770 2024-05-10T03:40:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.402+0000 7f8377fff700 1 -- 172.21.15.45:0/999982554 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8370004d10 con 0x7f8380102770 2024-05-10T03:40:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.402+0000 7f8377fff700 1 -- 172.21.15.45:0/999982554 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8370005720 con 0x7f8380102770 2024-05-10T03:40:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.402+0000 7f83852b2700 1 -- 172.21.15.45:0/999982554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83801a2480 con 0x7f8380102770 2024-05-10T03:40:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.402+0000 7f83852b2700 1 -- 172.21.15.45:0/999982554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83801a2940 con 0x7f8380102770 2024-05-10T03:40:36.409 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.404+0000 7f8377fff700 1 -- 172.21.15.45:0/999982554 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f8370004750 con 0x7f8380102770 2024-05-10T03:40:36.409 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.405+0000 7f8377fff700 1 --2- 172.21.15.45:0/999982554 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f836c0a11b0 0x7f836c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:36.409 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.405+0000 7f837e7fc700 1 --2- 172.21.15.45:0/999982554 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f836c0a11b0 0x7f836c0a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:36.409 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.405+0000 7f8377fff700 1 -- 172.21.15.45:0/999982554 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f8370014070 con 0x7f8380102770 2024-05-10T03:40:36.409 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.406+0000 7f837e7fc700 1 --2- 172.21.15.45:0/999982554 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f836c0a11b0 0x7f836c0a36c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8380101980 tx=0x7f8368009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:36.410 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.406+0000 7f83955f6b80 1 Processor -- start 2024-05-10T03:40:36.410 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.406+0000 7f83955f6b80 1 -- start start 2024-05-10T03:40:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.407+0000 7f83955f6b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f69b3b6180 0x55f69b3b65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.407+0000 7f83955f6b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b7050 0x55f69b3b7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.407+0000 7f83955f6b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f69b3b79a0 0x55f69b3be2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.407+0000 7f83955f6b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f69b2dd0f0 con 0x55f69b3b7050 2024-05-10T03:40:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.407+0000 7f83955f6b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f69b2daab0 con 0x55f69b3b79a0 2024-05-10T03:40:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.407+0000 7f83955f6b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f69b2d63a0 con 0x55f69b3b6180 2024-05-10T03:40:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.407+0000 7f837e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b7050 0x55f69b3b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.407+0000 7f837e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b7050 0x55f69b3b7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48706/0 (socket says 172.21.15.45:48706) 2024-05-10T03:40:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.407+0000 7f837e7fc700 1 -- 172.21.15.45:0/9153694 learned_addr learned my addr 172.21.15.45:0/9153694 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.407+0000 7f837effd700 1 --2- 172.21.15.45:0/9153694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f69b3b6180 0x55f69b3b65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.407+0000 7f837f7fe700 1 --2- 172.21.15.45:0/9153694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f69b3b79a0 0x55f69b3be2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.407+0000 7f837e7fc700 1 -- 172.21.15.45:0/9153694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f69b3b6180 msgr2=0x55f69b3b65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.407+0000 7f837e7fc700 1 --2- 172.21.15.45:0/9153694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f69b3b6180 0x55f69b3b65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.407+0000 7f837e7fc700 1 -- 172.21.15.45:0/9153694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f69b3b79a0 msgr2=0x55f69b3be2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.407+0000 7f837e7fc700 1 --2- 172.21.15.45:0/9153694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f69b3b79a0 0x55f69b3be2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.407+0000 7f837e7fc700 1 -- 172.21.15.45:0/9153694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f69b157350 con 0x55f69b3b7050 2024-05-10T03:40:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.407+0000 7f837e7fc700 1 --2- 172.21.15.45:0/9153694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b7050 0x55f69b3b7460 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8368011e10 tx=0x7f8368014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71085dc7f46a3000 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.408+0000 7f83757fa700 1 -- 172.21.15.45:0/9153694 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368012bc0 con 0x55f69b3b7050 2024-05-10T03:40:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.408+0000 7f83757fa700 1 -- 172.21.15.45:0/9153694 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8368016070 con 0x55f69b3b7050 2024-05-10T03:40:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.408+0000 7f83757fa700 1 -- 172.21.15.45:0/9153694 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836801d5f0 con 0x55f69b3b7050 2024-05-10T03:40:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.408+0000 7f83955f6b80 1 -- 172.21.15.45:0/9153694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b7050 msgr2=0x55f69b3b7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.408+0000 7f83955f6b80 1 --2- 172.21.15.45:0/9153694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b7050 0x55f69b3b7460 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8368011e10 tx=0x7f8368014000 comp rx=0 tx=0).stop 2024-05-10T03:40:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.409+0000 7f83955f6b80 1 -- 172.21.15.45:0/9153694 shutdown_connections 2024-05-10T03:40:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.409+0000 7f83955f6b80 1 --2- 172.21.15.45:0/9153694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f69b3b6180 0x55f69b3b65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.409+0000 7f83955f6b80 1 --2- 172.21.15.45:0/9153694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f69b3b79a0 0x55f69b3be2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.409+0000 7f83955f6b80 1 --2- 172.21.15.45:0/9153694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b7050 0x55f69b3b7460 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.409+0000 7f83955f6b80 1 -- 172.21.15.45:0/9153694 >> 172.21.15.45:0/9153694 conn(0x55f69b318a00 msgr2=0x55f69b3b0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.409+0000 7f83955f6b80 1 -- 172.21.15.45:0/9153694 shutdown_connections 2024-05-10T03:40:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.409+0000 7f83955f6b80 1 -- 172.21.15.45:0/9153694 wait complete. 2024-05-10T03:40:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.409+0000 7f83955f6b80 1 -- start start 2024-05-10T03:40:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.409+0000 7f83955f6b80 1 Processor -- start 2024-05-10T03:40:36.418 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.409+0000 7f83955f6b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b6180 0x55f69b3c0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:36.418 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.409+0000 7f83955f6b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f69b3b7050 0x55f69b3c06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:36.418 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.409+0000 7f83955f6b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f69b3b79a0 0x55f69b3c7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:36.418 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.409+0000 7f83955f6b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f69b272500 con 0x55f69b3b6180 2024-05-10T03:40:36.418 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.410+0000 7f83955f6b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f69b2721a0 con 0x55f69b3b79a0 2024-05-10T03:40:36.418 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.410+0000 7f83955f6b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f69b159640 con 0x55f69b3b7050 2024-05-10T03:40:36.418 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.410+0000 7f83955f6b80 10 client.0 _ll_register_callbacks cb 0x55f69b27bad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:36.418 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.410+0000 7f837effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b6180 0x55f69b3c0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.410+0000 7f837effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b6180 0x55f69b3c0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48718/0 (socket says 172.21.15.45:48718) 2024-05-10T03:40:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.410+0000 7f837e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f69b3b7050 0x55f69b3c06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.410+0000 7f837effd700 1 -- 172.21.15.45:0/174537936 learned_addr learned my addr 172.21.15.45:0/174537936 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.410+0000 7f837f7fe700 1 --2- 172.21.15.45:0/174537936 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f69b3b79a0 0x55f69b3c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.410+0000 7f837effd700 1 -- 172.21.15.45:0/174537936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f69b3b7050 msgr2=0x55f69b3c06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.410+0000 7f837effd700 1 --2- 172.21.15.45:0/174537936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f69b3b7050 0x55f69b3c06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.410+0000 7f837effd700 1 -- 172.21.15.45:0/174537936 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f69b3b79a0 msgr2=0x55f69b3c7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.410+0000 7f837effd700 1 --2- 172.21.15.45:0/174537936 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f69b3b79a0 0x55f69b3c7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.410+0000 7f837effd700 1 -- 172.21.15.45:0/174537936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8368011af0 con 0x55f69b3b6180 2024-05-10T03:40:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.410+0000 7f837effd700 1 --2- 172.21.15.45:0/174537936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b6180 0x55f69b3c0180 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8370096600 tx=0x7f837009a800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b671e1fb03a799b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.410+0000 7f83667fc700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.410+0000 7f83667fc700 1 -- 172.21.15.45:0/174537936 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83700a2580 con 0x55f69b3b6180 2024-05-10T03:40:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.410+0000 7f83667fc700 1 -- 172.21.15.45:0/174537936 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f83700caa10 con 0x55f69b3b6180 2024-05-10T03:40:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.410+0000 7f83955f6b80 1 -- 172.21.15.45:0/174537936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f69b22f210 con 0x55f69b3b6180 2024-05-10T03:40:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.411+0000 7f83667fc700 1 -- 172.21.15.45:0/174537936 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f837009a360 con 0x55f69b3b6180 2024-05-10T03:40:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.411+0000 7f83955f6b80 10 client.15705 fetch_fsmap learned FSMap version 28 2024-05-10T03:40:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.411+0000 7f83955f6b80 1 -- 172.21.15.45:0/174537936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55f69b103b00 con 0x55f69b3b6180 2024-05-10T03:40:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.411+0000 7f83667fc700 1 -- 172.21.15.45:0/174537936 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55f69b22f210 con 0x55f69b3b6180 2024-05-10T03:40:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.411+0000 7f83667fc700 1 -- 172.21.15.45:0/174537936 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f83700995f0 con 0x55f69b3b6180 2024-05-10T03:40:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.411+0000 7f83955f6b80 10 client.15705 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:40:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.411+0000 7f83955f6b80 10 client.15705 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:40:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.411+0000 7f83955f6b80 20 client.15705 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.411+0000 7f83955f6b80 1 --2- 172.21.15.45:0/174537936 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f69b3cbc80 0x55f69b3ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.411+0000 7f83955f6b80 4 client.15705 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:40:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.411+0000 7f83955f6b80 1 -- 172.21.15.45:0/174537936 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f69b385720 con 0x55f69b3cbc80 2024-05-10T03:40:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.411+0000 7f837e7fc700 1 --2- 172.21.15.45:0/174537936 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f69b3cbc80 0x55f69b3ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.412+0000 7f83667fc700 10 client.15705 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.412+0000 7f837e7fc700 1 --2- 172.21.15.45:0/174537936 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f69b3cbc80 0x55f69b3ce0d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fe6994ab91c203e server_cookie=1da6097f08db1bc6 in_seq=0 out_seq=0 2024-05-10T03:40:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.413+0000 7f83667fc700 1 -- 172.21.15.45:0/174537936 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f69b385720 con 0x55f69b3cbc80 2024-05-10T03:40:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.413+0000 7f83667fc700 10 client.15705 handle_command_reply: tid=0 2024-05-10T03:40:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.413+0000 7f83955f6b80 1 client.15705 shutdown 2024-05-10T03:40:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.413+0000 7f83955f6b80 1 -- 172.21.15.45:0/174537936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b6180 msgr2=0x55f69b3c0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.413+0000 7f83955f6b80 1 --2- 172.21.15.45:0/174537936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b6180 0x55f69b3c0180 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8370096600 tx=0x7f837009a800 comp rx=0 tx=0).stop 2024-05-10T03:40:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.413+0000 7f83955f6b80 1 -- 172.21.15.45:0/174537936 shutdown_connections 2024-05-10T03:40:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.413+0000 7f83955f6b80 1 --2- 172.21.15.45:0/174537936 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f69b3cbc80 0x55f69b3ce0d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.413+0000 7f83955f6b80 1 --2- 172.21.15.45:0/174537936 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f69b3b79a0 0x55f69b3c7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.413+0000 7f83955f6b80 1 --2- 172.21.15.45:0/174537936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b6180 0x55f69b3c0180 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.413+0000 7f83667fc700 0 client.15705 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.413+0000 7f83955f6b80 1 --2- 172.21.15.45:0/174537936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f69b3b7050 0x55f69b3c06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.413+0000 7f83955f6b80 1 -- 172.21.15.45:0/174537936 >> 172.21.15.45:0/174537936 conn(0x55f69b318a00 msgr2=0x55f69b3b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.413+0000 7f83955f6b80 1 -- 172.21.15.45:0/174537936 shutdown_connections 2024-05-10T03:40:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.413+0000 7f83955f6b80 1 -- 172.21.15.45:0/174537936 wait complete. 2024-05-10T03:40:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.413+0000 7f83955f6b80 20 client.15705 trim_cache size 0 max 16384 2024-05-10T03:40:36.432 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.429+0000 7f83955f6b80 1 Processor -- start 2024-05-10T03:40:36.432 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.429+0000 7f83955f6b80 1 -- start start 2024-05-10T03:40:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.429+0000 7f83955f6b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f69b3b6180 0x55f69b3bf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.429+0000 7f83955f6b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b7050 0x55f69b3c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.429+0000 7f83955f6b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f69b3b79a0 0x55f69b3b67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.429+0000 7f83955f6b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f69b3b2230 con 0x55f69b3b7050 2024-05-10T03:40:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.429+0000 7f83955f6b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f69b3be1b0 con 0x55f69b3b6180 2024-05-10T03:40:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.429+0000 7f83955f6b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f69b3bba80 con 0x55f69b3b79a0 2024-05-10T03:40:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.429+0000 7f837e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b7050 0x55f69b3c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.429+0000 7f837e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b7050 0x55f69b3c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48730/0 (socket says 172.21.15.45:48730) 2024-05-10T03:40:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.429+0000 7f837e7fc700 1 -- 172.21.15.45:0/3314999428 learned_addr learned my addr 172.21.15.45:0/3314999428 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.430+0000 7f837f7fe700 1 --2- 172.21.15.45:0/3314999428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f69b3b79a0 0x55f69b3b67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.430+0000 7f837effd700 1 --2- 172.21.15.45:0/3314999428 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f69b3b6180 0x55f69b3bf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.430+0000 7f837e7fc700 1 -- 172.21.15.45:0/3314999428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f69b3b79a0 msgr2=0x55f69b3b67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.430+0000 7f837e7fc700 1 --2- 172.21.15.45:0/3314999428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f69b3b79a0 0x55f69b3b67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.430+0000 7f837e7fc700 1 -- 172.21.15.45:0/3314999428 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f69b3b6180 msgr2=0x55f69b3bf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.430+0000 7f837e7fc700 1 --2- 172.21.15.45:0/3314999428 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f69b3b6180 0x55f69b3bf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.430+0000 7f837e7fc700 1 -- 172.21.15.45:0/3314999428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f69b29c500 con 0x55f69b3b7050 2024-05-10T03:40:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.430+0000 7f837e7fc700 1 --2- 172.21.15.45:0/3314999428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b7050 0x55f69b3c75e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8368012a10 tx=0x7f836801fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8e9ff87317cbd8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.430+0000 7f8375ffb700 1 -- 172.21.15.45:0/3314999428 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836802d070 con 0x55f69b3b7050 2024-05-10T03:40:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.430+0000 7f8375ffb700 1 -- 172.21.15.45:0/3314999428 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f836802e040 con 0x55f69b3b7050 2024-05-10T03:40:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.430+0000 7f8375ffb700 1 -- 172.21.15.45:0/3314999428 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836801f7c0 con 0x55f69b3b7050 2024-05-10T03:40:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.431+0000 7f83955f6b80 1 -- 172.21.15.45:0/3314999428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b7050 msgr2=0x55f69b3c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.431+0000 7f83955f6b80 1 --2- 172.21.15.45:0/3314999428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b7050 0x55f69b3c75e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8368012a10 tx=0x7f836801fba0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.431+0000 7f83955f6b80 1 -- 172.21.15.45:0/3314999428 shutdown_connections 2024-05-10T03:40:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.431+0000 7f83955f6b80 1 --2- 172.21.15.45:0/3314999428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f69b3b79a0 0x55f69b3b67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.431+0000 7f83955f6b80 1 --2- 172.21.15.45:0/3314999428 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f69b3b6180 0x55f69b3bf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.431+0000 7f83955f6b80 1 --2- 172.21.15.45:0/3314999428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b7050 0x55f69b3c75e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.431+0000 7f83955f6b80 1 -- 172.21.15.45:0/3314999428 >> 172.21.15.45:0/3314999428 conn(0x55f69b318a00 msgr2=0x55f69b3b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.431+0000 7f83955f6b80 1 -- 172.21.15.45:0/3314999428 shutdown_connections 2024-05-10T03:40:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.431+0000 7f83955f6b80 1 -- 172.21.15.45:0/3314999428 wait complete. 2024-05-10T03:40:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.431+0000 7f83955f6b80 1 -- start start 2024-05-10T03:40:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.432+0000 7f83955f6b80 1 Processor -- start 2024-05-10T03:40:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.432+0000 7f83955f6b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f69b3b6180 0x55f69b3c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.432+0000 7f83955f6b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b7050 0x55f69b3c5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.432+0000 7f83955f6b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f69b3b79a0 0x55f69b3c6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.432+0000 7f83955f6b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f69b3c68b0 con 0x55f69b3b7050 2024-05-10T03:40:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.432+0000 7f83955f6b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f69b3c6a20 con 0x55f69b3b79a0 2024-05-10T03:40:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.432+0000 7f83955f6b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f69b3c6be0 con 0x55f69b3b6180 2024-05-10T03:40:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.432+0000 7f83955f6b80 10 client.0 _ll_register_callbacks cb 0x55f69b27bad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.432+0000 7f837e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b7050 0x55f69b3c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.432+0000 7f837e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b7050 0x55f69b3c5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48732/0 (socket says 172.21.15.45:48732) 2024-05-10T03:40:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.432+0000 7f837e7fc700 1 -- 172.21.15.45:0/3443436106 learned_addr learned my addr 172.21.15.45:0/3443436106 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.432+0000 7f837effd700 1 --2- 172.21.15.45:0/3443436106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f69b3b6180 0x55f69b3c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.432+0000 7f837f7fe700 1 --2- 172.21.15.45:0/3443436106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f69b3b79a0 0x55f69b3c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.432+0000 7f837e7fc700 1 -- 172.21.15.45:0/3443436106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f69b3b6180 msgr2=0x55f69b3c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.432+0000 7f837e7fc700 1 --2- 172.21.15.45:0/3443436106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f69b3b6180 0x55f69b3c4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.432+0000 7f837e7fc700 1 -- 172.21.15.45:0/3443436106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f69b3b79a0 msgr2=0x55f69b3c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.432+0000 7f837e7fc700 1 --2- 172.21.15.45:0/3443436106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f69b3b79a0 0x55f69b3c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.432+0000 7f837e7fc700 1 -- 172.21.15.45:0/3443436106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f69b157350 con 0x55f69b3b7050 2024-05-10T03:40:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.433+0000 7f837e7fc700 1 --2- 172.21.15.45:0/3443436106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b7050 0x55f69b3c5440 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8368009940 tx=0x7f8368009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359366deea4093b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.433+0000 7f83667fc700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.433+0000 7f83667fc700 1 -- 172.21.15.45:0/3443436106 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836802d050 con 0x55f69b3b7050 2024-05-10T03:40:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.433+0000 7f83667fc700 1 -- 172.21.15.45:0/3443436106 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f8368018070 con 0x55f69b3b7050 2024-05-10T03:40:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.433+0000 7f83955f6b80 1 -- 172.21.15.45:0/3443436106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8368016070 con 0x55f69b3b7050 2024-05-10T03:40:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.433+0000 7f83667fc700 1 -- 172.21.15.45:0/3443436106 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8368012d40 con 0x55f69b3b7050 2024-05-10T03:40:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.433+0000 7f83955f6b80 10 client.15711 fetch_fsmap learned FSMap version 28 2024-05-10T03:40:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.433+0000 7f83955f6b80 1 -- 172.21.15.45:0/3443436106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55f69b15bc70 con 0x55f69b3b7050 2024-05-10T03:40:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.433+0000 7f83667fc700 1 -- 172.21.15.45:0/3443436106 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8368016070 con 0x55f69b3b7050 2024-05-10T03:40:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.433+0000 7f83667fc700 1 -- 172.21.15.45:0/3443436106 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f8368005370 con 0x55f69b3b7050 2024-05-10T03:40:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.433+0000 7f83955f6b80 10 client.15711 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:40:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.433+0000 7f83955f6b80 10 client.15711 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:40:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.433+0000 7f83955f6b80 20 client.15711 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.433+0000 7f83955f6b80 1 --2- 172.21.15.45:0/3443436106 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f69b422710 0x55f69b424b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.433+0000 7f83955f6b80 4 client.15711 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T03:40:36.442 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.433+0000 7f83955f6b80 1 -- 172.21.15.45:0/3443436106 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f69b2cee60 con 0x55f69b422710 2024-05-10T03:40:36.442 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.434+0000 7f837effd700 1 --2- 172.21.15.45:0/3443436106 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f69b422710 0x55f69b424b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:36.442 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.434+0000 7f837effd700 1 --2- 172.21.15.45:0/3443436106 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f69b422710 0x55f69b424b30 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dee210a11bdee84c server_cookie=7e4e305885590ce2 in_seq=0 out_seq=0 2024-05-10T03:40:36.442 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.434+0000 7f83667fc700 10 client.15711 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:36.451 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83667fc700 1 -- 172.21.15.45:0/3443436106 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f69b2cee60 con 0x55f69b422710 2024-05-10T03:40:36.451 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83667fc700 10 client.15711 handle_command_reply: tid=0 2024-05-10T03:40:36.451 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83955f6b80 1 client.15711 shutdown 2024-05-10T03:40:36.451 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83955f6b80 1 -- 172.21.15.45:0/3443436106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b7050 msgr2=0x55f69b3c5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:36.451 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83955f6b80 1 --2- 172.21.15.45:0/3443436106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b7050 0x55f69b3c5440 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8368009940 tx=0x7f8368009970 comp rx=0 tx=0).stop 2024-05-10T03:40:36.451 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83955f6b80 1 -- 172.21.15.45:0/3443436106 shutdown_connections 2024-05-10T03:40:36.451 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83955f6b80 1 --2- 172.21.15.45:0/3443436106 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f69b422710 0x55f69b424b30 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.452 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83955f6b80 1 --2- 172.21.15.45:0/3443436106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f69b3b6180 0x55f69b3c4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.452 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83955f6b80 1 --2- 172.21.15.45:0/3443436106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f69b3b79a0 0x55f69b3c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.452 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83667fc700 0 client.15711 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:36.452 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83955f6b80 1 --2- 172.21.15.45:0/3443436106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f69b3b7050 0x55f69b3c5440 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.452 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83955f6b80 1 -- 172.21.15.45:0/3443436106 >> 172.21.15.45:0/3443436106 conn(0x55f69b318a00 msgr2=0x55f69b3b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:36.452 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83955f6b80 1 -- 172.21.15.45:0/3443436106 shutdown_connections 2024-05-10T03:40:36.452 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83955f6b80 1 -- 172.21.15.45:0/3443436106 wait complete. 2024-05-10T03:40:36.452 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83955f6b80 20 client.15711 trim_cache size 0 max 16384 2024-05-10T03:40:36.452 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:{ 2024-05-10T03:40:36.453 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "message": "", 2024-05-10T03:40:36.453 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "return_code": 0 2024-05-10T03:40:36.453 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:} 2024-05-10T03:40:36.453 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83852b2700 1 -- 172.21.15.45:0/999982554 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f836c0a11b0 msgr2=0x7f836c0a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:36.453 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83852b2700 1 --2- 172.21.15.45:0/999982554 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f836c0a11b0 0x7f836c0a36c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8380101980 tx=0x7f8368009260 comp rx=0 tx=0).stop 2024-05-10T03:40:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83852b2700 1 -- 172.21.15.45:0/999982554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8380102770 msgr2=0x7f8380101fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83852b2700 1 --2- 172.21.15.45:0/999982554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8380102770 0x7f8380101fe0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f837000e970 tx=0x7f837000ed30 comp rx=0 tx=0).stop 2024-05-10T03:40:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83852b2700 1 -- 172.21.15.45:0/999982554 shutdown_connections 2024-05-10T03:40:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83852b2700 1 --2- 172.21.15.45:0/999982554 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f836c0a11b0 0x7f836c0a36c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83852b2700 1 --2- 172.21.15.45:0/999982554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8380107a30 0x7f8380100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83852b2700 1 --2- 172.21.15.45:0/999982554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8380102770 0x7f8380101fe0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83852b2700 1 --2- 172.21.15.45:0/999982554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83801050d0 0x7f8380100680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83852b2700 1 -- 172.21.15.45:0/999982554 >> 172.21.15.45:0/999982554 conn(0x7f83800fc190 msgr2=0x7f83801035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83852b2700 1 -- 172.21.15.45:0/999982554 shutdown_connections 2024-05-10T03:40:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:36.448+0000 7f83852b2700 1 -- 172.21.15.45:0/999982554 wait complete. 2024-05-10T03:40:36.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:35 smithi154 ceph-mon[46565]: scrub summary: idle 2024-05-10T03:40:37.283 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:36 smithi045 ceph-mon[42520]: pgmap v295: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 208 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-05-10T03:40:37.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:36 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:40:37.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:36 smithi106 ceph-mon[46996]: pgmap v295: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 208 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-05-10T03:40:37.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:36 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:40:37.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:36 smithi154 ceph-mon[46565]: pgmap v295: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 208 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-05-10T03:40:37.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:36 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:40:39.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:38 smithi154 ceph-mon[46565]: pgmap v296: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 378 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-05-10T03:40:39.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:38 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:40:39.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:38 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:40:39.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:38 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:40:39.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:38 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:40:39.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:38 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:40:39.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:38 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:40:39.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:38 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:40:39.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:38 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:40:39.225 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:38 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:40:39.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:38 smithi045 ceph-mon[42520]: pgmap v296: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 378 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-05-10T03:40:39.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:38 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:40:39.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:38 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:40:39.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:38 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:40:39.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:38 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:40:39.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:38 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:40:39.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:38 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:40:39.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:38 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:40:39.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:38 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:40:39.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:38 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:40:39.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:38 smithi106 ceph-mon[46996]: pgmap v296: 129 pgs: 129 active+clean; 658 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 378 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-05-10T03:40:39.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:38 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:40:39.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:38 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:40:39.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:38 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:40:39.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:38 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:40:39.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:38 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:40:39.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:38 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:40:39.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:38 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:40:39.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:38 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:40:39.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:38 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:40:41.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:40 smithi154 ceph-mon[46565]: pgmap v297: 129 pgs: 129 active+clean; 659 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 KiB/s wr, 15 op/s; 0 B/s, 0 objects/s recovering 2024-05-10T03:40:41.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:40 smithi045 ceph-mon[42520]: pgmap v297: 129 pgs: 129 active+clean; 659 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 KiB/s wr, 15 op/s; 0 B/s, 0 objects/s recovering 2024-05-10T03:40:41.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:40 smithi106 ceph-mon[46996]: pgmap v297: 129 pgs: 129 active+clean; 659 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.3 KiB/s wr, 15 op/s; 0 B/s, 0 objects/s recovering 2024-05-10T03:40:43.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:42 smithi045 ceph-mon[42520]: pgmap v298: 129 pgs: 129 active+clean; 659 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2024-05-10T03:40:43.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:42 smithi106 ceph-mon[46996]: pgmap v298: 129 pgs: 129 active+clean; 659 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2024-05-10T03:40:43.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:42 smithi154 ceph-mon[46565]: pgmap v298: 129 pgs: 129 active+clean; 659 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2024-05-10T03:40:45.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:44 smithi045 ceph-mon[42520]: pgmap v299: 129 pgs: 129 active+clean; 659 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-05-10T03:40:45.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:44 smithi106 ceph-mon[46996]: pgmap v299: 129 pgs: 129 active+clean; 659 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-05-10T03:40:45.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:44 smithi154 ceph-mon[46565]: pgmap v299: 129 pgs: 129 active+clean; 659 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-05-10T03:40:47.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:46 smithi045 ceph-mon[42520]: pgmap v300: 129 pgs: 129 active+clean; 659 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.4 KiB/s wr, 15 op/s 2024-05-10T03:40:47.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:46 smithi106 ceph-mon[46996]: pgmap v300: 129 pgs: 129 active+clean; 659 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.4 KiB/s wr, 15 op/s 2024-05-10T03:40:47.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:46 smithi154 ceph-mon[46565]: pgmap v300: 129 pgs: 129 active+clean; 659 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.4 KiB/s wr, 15 op/s 2024-05-10T03:40:49.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:48 smithi045 ceph-mon[42520]: pgmap v301: 129 pgs: 129 active+clean; 659 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-05-10T03:40:49.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:48 smithi106 ceph-mon[46996]: pgmap v301: 129 pgs: 129 active+clean; 659 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-05-10T03:40:49.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:48 smithi154 ceph-mon[46565]: pgmap v301: 129 pgs: 129 active+clean; 659 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-05-10T03:40:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.590+0000 7fd8dccbc700 1 -- 172.21.15.45:0/194442104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8d8101be0 msgr2=0x7fd8d8101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.590+0000 7fd8dccbc700 1 --2- 172.21.15.45:0/194442104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8d8101be0 0x7fd8d8101ff0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0009990 tx=0x7fd8c0009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.590+0000 7fd8dccbc700 1 -- 172.21.15.45:0/194442104 shutdown_connections 2024-05-10T03:40:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.590+0000 7fd8dccbc700 1 --2- 172.21.15.45:0/194442104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8d8100ac0 0x7fd8d8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.590+0000 7fd8dccbc700 1 --2- 172.21.15.45:0/194442104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8d8102580 0x7fd8d8108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.590+0000 7fd8dccbc700 1 --2- 172.21.15.45:0/194442104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8d8101be0 0x7fd8d8101ff0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.590+0000 7fd8dccbc700 1 -- 172.21.15.45:0/194442104 >> 172.21.15.45:0/194442104 conn(0x7fd8d80fc0f0 msgr2=0x7fd8d80fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:49.593 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.590+0000 7fd8dccbc700 1 -- 172.21.15.45:0/194442104 shutdown_connections 2024-05-10T03:40:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.590+0000 7fd8dccbc700 1 -- 172.21.15.45:0/194442104 wait complete. 2024-05-10T03:40:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.591+0000 7fd8dccbc700 1 Processor -- start 2024-05-10T03:40:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.591+0000 7fd8dccbc700 1 -- start start 2024-05-10T03:40:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.592+0000 7fd8dccbc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8d8100ac0 0x7fd8d81980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.592+0000 7fd8dccbc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8d8101be0 0x7fd8d8198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.592+0000 7fd8dccbc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8d8102580 0x7fd8d819f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.592+0000 7fd8dccbc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d819fb70 con 0x7fd8d8102580 2024-05-10T03:40:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.592+0000 7fd8dccbc700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d819fcb0 con 0x7fd8d8100ac0 2024-05-10T03:40:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.592+0000 7fd8dccbc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d819fe40 con 0x7fd8d8101be0 2024-05-10T03:40:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.592+0000 7fd8d659c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8d8100ac0 0x7fd8d81980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.592+0000 7fd8d5d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8d8101be0 0x7fd8d8198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.592+0000 7fd8d659c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8d8100ac0 0x7fd8d81980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.45:59016/0 (socket says 172.21.15.45:59016) 2024-05-10T03:40:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.592+0000 7fd8d659c700 1 -- 172.21.15.45:0/2330335309 learned_addr learned my addr 172.21.15.45:0/2330335309 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.592+0000 7fd8d6d9d700 1 --2- 172.21.15.45:0/2330335309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8d8102580 0x7fd8d819f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.593+0000 7fd8d659c700 1 -- 172.21.15.45:0/2330335309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8d8101be0 msgr2=0x7fd8d8198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.593+0000 7fd8d659c700 1 --2- 172.21.15.45:0/2330335309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8d8101be0 0x7fd8d8198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.593+0000 7fd8d659c700 1 -- 172.21.15.45:0/2330335309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8d8102580 msgr2=0x7fd8d819f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.593+0000 7fd8d659c700 1 --2- 172.21.15.45:0/2330335309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8d8102580 0x7fd8d819f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.593+0000 7fd8d659c700 1 -- 172.21.15.45:0/2330335309 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c00095f0 con 0x7fd8d8100ac0 2024-05-10T03:40:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.593+0000 7fd8d6d9d700 1 --2- 172.21.15.45:0/2330335309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8d8102580 0x7fd8d819f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:40:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.593+0000 7fd8d5d9b700 1 --2- 172.21.15.45:0/2330335309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8d8101be0 0x7fd8d8198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:40:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.593+0000 7fd8d659c700 1 --2- 172.21.15.45:0/2330335309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8d8100ac0 0x7fd8d81980d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd8c800d950 tx=0x7fd8c800dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.593+0000 7fd8cf7fe700 1 -- 172.21.15.45:0/2330335309 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c800f890 con 0x7fd8d8100ac0 2024-05-10T03:40:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.593+0000 7fd8dccbc700 1 -- 172.21.15.45:0/2330335309 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d81a0120 con 0x7fd8d8100ac0 2024-05-10T03:40:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.593+0000 7fd8cf7fe700 1 -- 172.21.15.45:0/2330335309 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd8c8010460 con 0x7fd8d8100ac0 2024-05-10T03:40:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.593+0000 7fd8cf7fe700 1 -- 172.21.15.45:0/2330335309 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c801a640 con 0x7fd8d8100ac0 2024-05-10T03:40:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.593+0000 7fd8dccbc700 1 -- 172.21.15.45:0/2330335309 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d81a0630 con 0x7fd8d8100ac0 2024-05-10T03:40:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.596+0000 7fd8cf7fe700 1 -- 172.21.15.45:0/2330335309 <== mon.2 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fd8c801a7a0 con 0x7fd8d8100ac0 2024-05-10T03:40:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.596+0000 7fd8cf7fe700 1 --2- 172.21.15.45:0/2330335309 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd8c40a11b0 0x7fd8c40a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.597+0000 7fd8cf7fe700 1 -- 172.21.15.45:0/2330335309 <== mon.2 v2:172.21.15.106:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd8c8016030 con 0x7fd8d8100ac0 2024-05-10T03:40:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.597+0000 7fd8d5d9b700 1 --2- 172.21.15.45:0/2330335309 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd8c40a11b0 0x7fd8c40a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.597+0000 7fd8d5d9b700 1 --2- 172.21.15.45:0/2330335309 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd8c40a11b0 0x7fd8c40a36c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000b5c0 tx=0x7fd8c001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.597+0000 7fd8ed000b80 1 Processor -- start 2024-05-10T03:40:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.598+0000 7fd8ed000b80 1 -- start start 2024-05-10T03:40:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.598+0000 7fd8ed000b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 0x55c804ace9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.598+0000 7fd8ed000b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c804acf460 0x55c804acf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.598+0000 7fd8ed000b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c804acfdb0 0x55c804ad66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.598+0000 7fd8ed000b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8049f10f0 con 0x55c804ace590 2024-05-10T03:40:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.598+0000 7fd8ed000b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8049eeab0 con 0x55c804acfdb0 2024-05-10T03:40:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.598+0000 7fd8ed000b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8049ea3a0 con 0x55c804acf460 2024-05-10T03:40:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.598+0000 7fd8d659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 0x55c804ace9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.598+0000 7fd8d659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 0x55c804ace9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60060/0 (socket says 172.21.15.45:60060) 2024-05-10T03:40:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.598+0000 7fd8d659c700 1 -- 172.21.15.45:0/769640967 learned_addr learned my addr 172.21.15.45:0/769640967 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.598+0000 7fd8d5d9b700 1 --2- 172.21.15.45:0/769640967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c804acf460 0x55c804acf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.598+0000 7fd8d6d9d700 1 --2- 172.21.15.45:0/769640967 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c804acfdb0 0x55c804ad66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.598+0000 7fd8d659c700 1 -- 172.21.15.45:0/769640967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c804acf460 msgr2=0x55c804acf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.598+0000 7fd8d659c700 1 --2- 172.21.15.45:0/769640967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c804acf460 0x55c804acf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.598+0000 7fd8d659c700 1 -- 172.21.15.45:0/769640967 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c804acfdb0 msgr2=0x55c804ad66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.598+0000 7fd8d659c700 1 --2- 172.21.15.45:0/769640967 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c804acfdb0 0x55c804ad66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.598+0000 7fd8d659c700 1 -- 172.21.15.45:0/769640967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c80486b350 con 0x55c804ace590 2024-05-10T03:40:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.599+0000 7fd8d659c700 1 --2- 172.21.15.45:0/769640967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 0x55c804ace9c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8096380 tx=0x7fd8c809a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5656d16a62436772 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:49.603 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.599+0000 7fd8ccff9700 1 -- 172.21.15.45:0/769640967 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c80a1d00 con 0x55c804ace590 2024-05-10T03:40:49.603 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.599+0000 7fd8ccff9700 1 -- 172.21.15.45:0/769640967 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd8c8097cb0 con 0x55c804ace590 2024-05-10T03:40:49.603 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.599+0000 7fd8ccff9700 1 -- 172.21.15.45:0/769640967 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8099dd0 con 0x55c804ace590 2024-05-10T03:40:49.608 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.600+0000 7fd8ed000b80 1 -- 172.21.15.45:0/769640967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 msgr2=0x55c804ace9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:49.608 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.600+0000 7fd8ed000b80 1 --2- 172.21.15.45:0/769640967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 0x55c804ace9c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8096380 tx=0x7fd8c809a160 comp rx=0 tx=0).stop 2024-05-10T03:40:49.608 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.600+0000 7fd8ed000b80 1 -- 172.21.15.45:0/769640967 shutdown_connections 2024-05-10T03:40:49.609 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.600+0000 7fd8ed000b80 1 --2- 172.21.15.45:0/769640967 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c804acfdb0 0x55c804ad66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.609 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.600+0000 7fd8ed000b80 1 --2- 172.21.15.45:0/769640967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 0x55c804ace9c0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.609 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.600+0000 7fd8ed000b80 1 --2- 172.21.15.45:0/769640967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c804acf460 0x55c804acf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.609 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.600+0000 7fd8ed000b80 1 -- 172.21.15.45:0/769640967 >> 172.21.15.45:0/769640967 conn(0x55c804a2ca00 msgr2=0x55c804ac4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:49.609 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.600+0000 7fd8ed000b80 1 -- 172.21.15.45:0/769640967 shutdown_connections 2024-05-10T03:40:49.609 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.600+0000 7fd8ed000b80 1 -- 172.21.15.45:0/769640967 wait complete. 2024-05-10T03:40:49.609 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.600+0000 7fd8ed000b80 1 -- start start 2024-05-10T03:40:49.609 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.600+0000 7fd8ed000b80 1 Processor -- start 2024-05-10T03:40:49.609 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.601+0000 7fd8ed000b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 0x55c804ad8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:49.609 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.601+0000 7fd8ed000b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c804acf460 0x55c804ad8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:49.610 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.601+0000 7fd8ed000b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c804acfdb0 0x55c804adfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:49.610 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.601+0000 7fd8ed000b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c804986500 con 0x55c804ace590 2024-05-10T03:40:49.610 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.601+0000 7fd8ed000b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8049861a0 con 0x55c804acf460 2024-05-10T03:40:49.610 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.601+0000 7fd8ed000b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c80486d640 con 0x55c804acfdb0 2024-05-10T03:40:49.610 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.601+0000 7fd8ed000b80 10 client.0 _ll_register_callbacks cb 0x55c80498fad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:49.610 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.601+0000 7fd8d659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 0x55c804ad8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:49.610 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.601+0000 7fd8d659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 0x55c804ad8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60070/0 (socket says 172.21.15.45:60070) 2024-05-10T03:40:49.610 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.601+0000 7fd8d659c700 1 -- 172.21.15.45:0/571353982 learned_addr learned my addr 172.21.15.45:0/571353982 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:49.610 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.601+0000 7fd8d6d9d700 1 --2- 172.21.15.45:0/571353982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c804acfdb0 0x55c804adfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:49.610 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.601+0000 7fd8d5d9b700 1 --2- 172.21.15.45:0/571353982 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c804acf460 0x55c804ad8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:49.610 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.601+0000 7fd8d659c700 1 -- 172.21.15.45:0/571353982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c804acfdb0 msgr2=0x55c804adfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:49.610 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.601+0000 7fd8d659c700 1 --2- 172.21.15.45:0/571353982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c804acfdb0 0x55c804adfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.610 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.601+0000 7fd8d659c700 1 -- 172.21.15.45:0/571353982 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c804acf460 msgr2=0x55c804ad8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:49.610 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.601+0000 7fd8d659c700 1 --2- 172.21.15.45:0/571353982 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c804acf460 0x55c804ad8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.611 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.601+0000 7fd8d659c700 1 -- 172.21.15.45:0/571353982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d81a0630 con 0x55c804ace590 2024-05-10T03:40:49.611 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.601+0000 7fd8d5d9b700 1 --2- 172.21.15.45:0/571353982 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c804acf460 0x55c804ad8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:40:49.611 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.601+0000 7fd8d659c700 1 --2- 172.21.15.45:0/571353982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 0x55c804ad8620 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80c9fc0 tx=0x7fd8c80a1d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2bece494ef7cf9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:49.611 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.601+0000 7fd8bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:49.611 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.602+0000 7fd8bdffb700 1 -- 172.21.15.45:0/571353982 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8099000 con 0x55c804ace590 2024-05-10T03:40:49.611 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.602+0000 7fd8bdffb700 1 -- 172.21.15.45:0/571353982 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd8c8099b70 con 0x55c804ace590 2024-05-10T03:40:49.611 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.602+0000 7fd8ed000b80 1 -- 172.21.15.45:0/571353982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c804943210 con 0x55c804ace590 2024-05-10T03:40:49.611 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.602+0000 7fd8bdffb700 1 -- 172.21.15.45:0/571353982 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8c80ca290 con 0x55c804ace590 2024-05-10T03:40:49.611 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.602+0000 7fd8ed000b80 10 client.15723 fetch_fsmap learned FSMap version 28 2024-05-10T03:40:49.611 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.602+0000 7fd8ed000b80 1 -- 172.21.15.45:0/571353982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55c804817b00 con 0x55c804ace590 2024-05-10T03:40:49.611 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.602+0000 7fd8bdffb700 1 -- 172.21.15.45:0/571353982 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd8c8064080 con 0x55c804ace590 2024-05-10T03:40:49.611 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.602+0000 7fd8bdffb700 1 -- 172.21.15.45:0/571353982 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd8c8098870 con 0x55c804ace590 2024-05-10T03:40:49.611 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.602+0000 7fd8ed000b80 10 client.15723 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:40:49.611 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.602+0000 7fd8ed000b80 10 client.15723 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:40:49.612 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.602+0000 7fd8ed000b80 20 client.15723 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:49.612 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.602+0000 7fd8ed000b80 1 --2- 172.21.15.45:0/571353982 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55c804ae3fb0 0x55c804ae6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:49.612 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.602+0000 7fd8ed000b80 4 client.15723 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:40:49.612 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.602+0000 7fd8ed000b80 1 -- 172.21.15.45:0/571353982 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c804a99720 con 0x55c804ae3fb0 2024-05-10T03:40:49.612 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.603+0000 7fd8d5d9b700 1 --2- 172.21.15.45:0/571353982 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55c804ae3fb0 0x55c804ae6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:49.612 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.603+0000 7fd8bdffb700 10 client.15723 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:49.612 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.603+0000 7fd8d5d9b700 1 --2- 172.21.15.45:0/571353982 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55c804ae3fb0 0x55c804ae6400 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2194a316c46c4dbf server_cookie=294103bf31b67fd3 in_seq=0 out_seq=0 2024-05-10T03:40:49.612 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.604+0000 7fd8bdffb700 1 -- 172.21.15.45:0/571353982 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c804a99720 con 0x55c804ae3fb0 2024-05-10T03:40:49.612 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.604+0000 7fd8bdffb700 10 client.15723 handle_command_reply: tid=0 2024-05-10T03:40:49.612 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.604+0000 7fd8ed000b80 1 client.15723 shutdown 2024-05-10T03:40:49.612 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.604+0000 7fd8ed000b80 1 -- 172.21.15.45:0/571353982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 msgr2=0x55c804ad8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:49.612 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.604+0000 7fd8ed000b80 1 --2- 172.21.15.45:0/571353982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 0x55c804ad8620 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80c9fc0 tx=0x7fd8c80a1d00 comp rx=0 tx=0).stop 2024-05-10T03:40:49.612 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.604+0000 7fd8ed000b80 1 -- 172.21.15.45:0/571353982 shutdown_connections 2024-05-10T03:40:49.612 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.604+0000 7fd8ed000b80 1 --2- 172.21.15.45:0/571353982 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55c804ae3fb0 0x55c804ae6400 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.612 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.604+0000 7fd8ed000b80 1 --2- 172.21.15.45:0/571353982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c804acfdb0 0x55c804adfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.613 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.604+0000 7fd8ed000b80 1 --2- 172.21.15.45:0/571353982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 0x55c804ad8620 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.613 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.604+0000 7fd8bdffb700 0 client.15723 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:49.613 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.604+0000 7fd8ed000b80 1 --2- 172.21.15.45:0/571353982 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c804acf460 0x55c804ad8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.613 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.604+0000 7fd8ed000b80 1 -- 172.21.15.45:0/571353982 >> 172.21.15.45:0/571353982 conn(0x55c804a2ca00 msgr2=0x55c804ac4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:49.613 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.604+0000 7fd8ed000b80 1 -- 172.21.15.45:0/571353982 shutdown_connections 2024-05-10T03:40:49.613 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.604+0000 7fd8ed000b80 1 -- 172.21.15.45:0/571353982 wait complete. 2024-05-10T03:40:49.613 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.605+0000 7fd8ed000b80 20 client.15723 trim_cache size 0 max 16384 2024-05-10T03:40:49.628 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.620+0000 7fd8ed000b80 1 Processor -- start 2024-05-10T03:40:49.628 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.620+0000 7fd8ed000b80 1 -- start start 2024-05-10T03:40:49.629 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.621+0000 7fd8ed000b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 0x55c804acf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:49.629 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.621+0000 7fd8ed000b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c804acf460 0x55c804ae63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:49.629 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.621+0000 7fd8ed000b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c804acfdb0 0x55c804adfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:49.629 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.621+0000 7fd8ed000b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c804ad6720 con 0x55c804ace590 2024-05-10T03:40:49.629 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.621+0000 7fd8ed000b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c804ad3f60 con 0x55c804acf460 2024-05-10T03:40:49.629 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.621+0000 7fd8ed000b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c804ae3d00 con 0x55c804acfdb0 2024-05-10T03:40:49.629 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.621+0000 7fd8d659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 0x55c804acf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:49.629 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.621+0000 7fd8d659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 0x55c804acf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60084/0 (socket says 172.21.15.45:60084) 2024-05-10T03:40:49.629 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.621+0000 7fd8d659c700 1 -- 172.21.15.45:0/3540359095 learned_addr learned my addr 172.21.15.45:0/3540359095 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:49.629 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.621+0000 7fd8d5d9b700 1 --2- 172.21.15.45:0/3540359095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c804acf460 0x55c804ae63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:49.629 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.621+0000 7fd8d6d9d700 1 --2- 172.21.15.45:0/3540359095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c804acfdb0 0x55c804adfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:49.629 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.621+0000 7fd8d659c700 1 -- 172.21.15.45:0/3540359095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c804acfdb0 msgr2=0x55c804adfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:49.629 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.621+0000 7fd8d659c700 1 --2- 172.21.15.45:0/3540359095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c804acfdb0 0x55c804adfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.621+0000 7fd8d659c700 1 -- 172.21.15.45:0/3540359095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c804acf460 msgr2=0x55c804ae63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.621+0000 7fd8d659c700 1 --2- 172.21.15.45:0/3540359095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c804acf460 0x55c804ae63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.621+0000 7fd8d659c700 1 -- 172.21.15.45:0/3540359095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8049b0500 con 0x55c804ace590 2024-05-10T03:40:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.621+0000 7fd8d6d9d700 1 --2- 172.21.15.45:0/3540359095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c804acfdb0 0x55c804adfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.621+0000 7fd8d659c700 1 --2- 172.21.15.45:0/3540359095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 0x55c804acf870 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8097c60 tx=0x7fd8c80a1e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae689b7ef1d1afcd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.621+0000 7fd8cd7fa700 1 -- 172.21.15.45:0/3540359095 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c80b2220 con 0x55c804ace590 2024-05-10T03:40:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.621+0000 7fd8cd7fa700 1 -- 172.21.15.45:0/3540359095 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55c804943210 con 0x55c804ace590 2024-05-10T03:40:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.622+0000 7fd8cd7fa700 1 -- 172.21.15.45:0/3540359095 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8066180 con 0x55c804ace590 2024-05-10T03:40:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.622+0000 7fd8ed000b80 1 -- 172.21.15.45:0/3540359095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 msgr2=0x55c804acf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.622+0000 7fd8ed000b80 1 --2- 172.21.15.45:0/3540359095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 0x55c804acf870 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8097c60 tx=0x7fd8c80a1e20 comp rx=0 tx=0).stop 2024-05-10T03:40:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.622+0000 7fd8ed000b80 1 -- 172.21.15.45:0/3540359095 shutdown_connections 2024-05-10T03:40:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.622+0000 7fd8ed000b80 1 --2- 172.21.15.45:0/3540359095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c804acfdb0 0x55c804adfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.622+0000 7fd8ed000b80 1 --2- 172.21.15.45:0/3540359095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 0x55c804acf870 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.622+0000 7fd8ed000b80 1 --2- 172.21.15.45:0/3540359095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c804acf460 0x55c804ae63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.622+0000 7fd8ed000b80 1 -- 172.21.15.45:0/3540359095 >> 172.21.15.45:0/3540359095 conn(0x55c804a2ca00 msgr2=0x55c804ad3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.622+0000 7fd8ed000b80 1 -- 172.21.15.45:0/3540359095 shutdown_connections 2024-05-10T03:40:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.622+0000 7fd8ed000b80 1 -- 172.21.15.45:0/3540359095 wait complete. 2024-05-10T03:40:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.623+0000 7fd8ed000b80 1 -- start start 2024-05-10T03:40:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.623+0000 7fd8ed000b80 1 Processor -- start 2024-05-10T03:40:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.623+0000 7fd8ed000b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 0x55c804adcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.623+0000 7fd8ed000b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c804acf460 0x55c804add110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.623+0000 7fd8ed000b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c804acfdb0 0x55c804ade040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.623+0000 7fd8ed000b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c804ade580 con 0x55c804ace590 2024-05-10T03:40:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.623+0000 7fd8ed000b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c804ade6f0 con 0x55c804acf460 2024-05-10T03:40:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.623+0000 7fd8ed000b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c804ade8b0 con 0x55c804acfdb0 2024-05-10T03:40:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.623+0000 7fd8ed000b80 10 client.0 _ll_register_callbacks cb 0x55c80498fad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.623+0000 7fd8d659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 0x55c804adcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.623+0000 7fd8d659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 0x55c804adcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60086/0 (socket says 172.21.15.45:60086) 2024-05-10T03:40:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.623+0000 7fd8d659c700 1 -- 172.21.15.45:0/2999552087 learned_addr learned my addr 172.21.15.45:0/2999552087 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.623+0000 7fd8d5d9b700 1 --2- 172.21.15.45:0/2999552087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c804acf460 0x55c804add110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.623+0000 7fd8d6d9d700 1 --2- 172.21.15.45:0/2999552087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c804acfdb0 0x55c804ade040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.624+0000 7fd8d659c700 1 -- 172.21.15.45:0/2999552087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c804acfdb0 msgr2=0x55c804ade040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.624+0000 7fd8d659c700 1 --2- 172.21.15.45:0/2999552087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c804acfdb0 0x55c804ade040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.624+0000 7fd8d659c700 1 -- 172.21.15.45:0/2999552087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c804acf460 msgr2=0x55c804add110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.624+0000 7fd8d659c700 1 --2- 172.21.15.45:0/2999552087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c804acf460 0x55c804add110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.624+0000 7fd8d659c700 1 -- 172.21.15.45:0/2999552087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c804817b00 con 0x55c804ace590 2024-05-10T03:40:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.624+0000 7fd8d6d9d700 1 --2- 172.21.15.45:0/2999552087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c804acfdb0 0x55c804ade040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.624+0000 7fd8d659c700 1 --2- 172.21.15.45:0/2999552087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 0x55c804adcbd0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80998a0 tx=0x7fd8c80a1d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3569455d4eed9f9d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.624+0000 7fd8bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.624+0000 7fd8bdffb700 1 -- 172.21.15.45:0/2999552087 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c80b2220 con 0x55c804ace590 2024-05-10T03:40:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.624+0000 7fd8bdffb700 1 -- 172.21.15.45:0/2999552087 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd8c80ca190 con 0x55c804ace590 2024-05-10T03:40:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.624+0000 7fd8ed000b80 1 -- 172.21.15.45:0/2999552087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd8c8097cb0 con 0x55c804ace590 2024-05-10T03:40:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.624+0000 7fd8bdffb700 1 -- 172.21.15.45:0/2999552087 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8c8066180 con 0x55c804ace590 2024-05-10T03:40:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.624+0000 7fd8ed000b80 10 client.15729 fetch_fsmap learned FSMap version 28 2024-05-10T03:40:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.624+0000 7fd8ed000b80 1 -- 172.21.15.45:0/2999552087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55c80486fc70 con 0x55c804ace590 2024-05-10T03:40:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.624+0000 7fd8bdffb700 1 -- 172.21.15.45:0/2999552087 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd8c8097cb0 con 0x55c804ace590 2024-05-10T03:40:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.625+0000 7fd8bdffb700 1 -- 172.21.15.45:0/2999552087 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd8c8098e00 con 0x55c804ace590 2024-05-10T03:40:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.625+0000 7fd8ed000b80 10 client.15729 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:40:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.625+0000 7fd8ed000b80 10 client.15729 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:40:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.625+0000 7fd8ed000b80 20 client.15729 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.625+0000 7fd8ed000b80 1 --2- 172.21.15.45:0/2999552087 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55c804adfb30 0x55c804b3c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.625+0000 7fd8ed000b80 4 client.15729 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T03:40:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.625+0000 7fd8ed000b80 1 -- 172.21.15.45:0/2999552087 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c8049e2e60 con 0x55c804adfb30 2024-05-10T03:40:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.625+0000 7fd8d5d9b700 1 --2- 172.21.15.45:0/2999552087 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55c804adfb30 0x55c804b3c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.625+0000 7fd8bdffb700 10 client.15729 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.625+0000 7fd8d5d9b700 1 --2- 172.21.15.45:0/2999552087 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55c804adfb30 0x55c804b3c430 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=def629c76a8c9f5c server_cookie=3a6cb7850556daac in_seq=0 out_seq=0 2024-05-10T03:40:49.635 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.629+0000 7fd8bdffb700 1 -- 172.21.15.45:0/2999552087 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c8049e2e60 con 0x55c804adfb30 2024-05-10T03:40:49.635 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.629+0000 7fd8bdffb700 10 client.15729 handle_command_reply: tid=0 2024-05-10T03:40:49.635 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.629+0000 7fd8ed000b80 1 client.15729 shutdown 2024-05-10T03:40:49.635 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.629+0000 7fd8ed000b80 1 -- 172.21.15.45:0/2999552087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 msgr2=0x55c804adcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:49.635 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.629+0000 7fd8ed000b80 1 --2- 172.21.15.45:0/2999552087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 0x55c804adcbd0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80998a0 tx=0x7fd8c80a1d00 comp rx=0 tx=0).stop 2024-05-10T03:40:49.635 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.629+0000 7fd8ed000b80 1 -- 172.21.15.45:0/2999552087 shutdown_connections 2024-05-10T03:40:49.635 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.629+0000 7fd8ed000b80 1 --2- 172.21.15.45:0/2999552087 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55c804adfb30 0x55c804b3c430 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.635 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.629+0000 7fd8ed000b80 1 --2- 172.21.15.45:0/2999552087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c804acfdb0 0x55c804ade040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.635 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.629+0000 7fd8ed000b80 1 --2- 172.21.15.45:0/2999552087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c804ace590 0x55c804adcbd0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.635 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.629+0000 7fd8ed000b80 1 --2- 172.21.15.45:0/2999552087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c804acf460 0x55c804add110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.635 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.629+0000 7fd8bdffb700 0 client.15729 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.629+0000 7fd8ed000b80 1 -- 172.21.15.45:0/2999552087 >> 172.21.15.45:0/2999552087 conn(0x55c804a2ca00 msgr2=0x55c804ad3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.629+0000 7fd8ed000b80 1 -- 172.21.15.45:0/2999552087 shutdown_connections 2024-05-10T03:40:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.629+0000 7fd8ed000b80 1 -- 172.21.15.45:0/2999552087 wait complete. 2024-05-10T03:40:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.629+0000 7fd8ed000b80 20 client.15729 trim_cache size 0 max 16384 2024-05-10T03:40:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:{ 2024-05-10T03:40:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "message": "", 2024-05-10T03:40:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "return_code": 0 2024-05-10T03:40:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:} 2024-05-10T03:40:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.630+0000 7fd8dccbc700 1 -- 172.21.15.45:0/2330335309 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd8c40a11b0 msgr2=0x7fd8c40a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.630+0000 7fd8dccbc700 1 --2- 172.21.15.45:0/2330335309 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd8c40a11b0 0x7fd8c40a36c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000b5c0 tx=0x7fd8c001a040 comp rx=0 tx=0).stop 2024-05-10T03:40:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.630+0000 7fd8dccbc700 1 -- 172.21.15.45:0/2330335309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8d8100ac0 msgr2=0x7fd8d81980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.630+0000 7fd8dccbc700 1 --2- 172.21.15.45:0/2330335309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8d8100ac0 0x7fd8d81980d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd8c800d950 tx=0x7fd8c800dc60 comp rx=0 tx=0).stop 2024-05-10T03:40:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.630+0000 7fd8dccbc700 1 -- 172.21.15.45:0/2330335309 shutdown_connections 2024-05-10T03:40:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.630+0000 7fd8dccbc700 1 --2- 172.21.15.45:0/2330335309 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd8c40a11b0 0x7fd8c40a36c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.630+0000 7fd8dccbc700 1 --2- 172.21.15.45:0/2330335309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8d8102580 0x7fd8d819f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.630+0000 7fd8dccbc700 1 --2- 172.21.15.45:0/2330335309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8d8100ac0 0x7fd8d81980d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.630+0000 7fd8dccbc700 1 --2- 172.21.15.45:0/2330335309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8d8101be0 0x7fd8d8198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:49.638 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.630+0000 7fd8dccbc700 1 -- 172.21.15.45:0/2330335309 >> 172.21.15.45:0/2330335309 conn(0x7fd8d80fc0f0 msgr2=0x7fd8d8068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:49.638 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.630+0000 7fd8dccbc700 1 -- 172.21.15.45:0/2330335309 shutdown_connections 2024-05-10T03:40:49.638 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:40:49.630+0000 7fd8dccbc700 1 -- 172.21.15.45:0/2330335309 wait complete. 2024-05-10T03:40:51.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:50 smithi045 ceph-mon[42520]: pgmap v302: 129 pgs: 129 active+clean; 660 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.4 KiB/s wr, 15 op/s 2024-05-10T03:40:51.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:50 smithi106 ceph-mon[46996]: pgmap v302: 129 pgs: 129 active+clean; 660 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.4 KiB/s wr, 15 op/s 2024-05-10T03:40:51.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:50 smithi154 ceph-mon[46565]: pgmap v302: 129 pgs: 129 active+clean; 660 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.4 KiB/s wr, 15 op/s 2024-05-10T03:40:53.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:52 smithi045 ceph-mon[42520]: pgmap v303: 129 pgs: 129 active+clean; 660 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-10T03:40:53.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:52 smithi106 ceph-mon[46996]: pgmap v303: 129 pgs: 129 active+clean; 660 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-10T03:40:53.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:52 smithi154 ceph-mon[46565]: pgmap v303: 129 pgs: 129 active+clean; 660 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-10T03:40:53.671 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-10T03:40:53.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.832+0000 7f3dc0ac4700 1 -- 172.21.15.45:0/1028830294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dbc107970 msgr2=0x7f3dbc109d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:53.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.832+0000 7f3dc0ac4700 1 --2- 172.21.15.45:0/1028830294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dbc107970 0x7f3dbc109d90 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3db400b0a0 tx=0x7f3db400b3b0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.832+0000 7f3dc0ac4700 1 -- 172.21.15.45:0/1028830294 shutdown_connections 2024-05-10T03:40:53.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.832+0000 7f3dc0ac4700 1 --2- 172.21.15.45:0/1028830294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dbc107970 0x7f3dbc109d90 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.832+0000 7f3dc0ac4700 1 --2- 172.21.15.45:0/1028830294 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3dbc1026b0 0x7f3dbc104ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.833+0000 7f3dc0ac4700 1 --2- 172.21.15.45:0/1028830294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dbc105010 0x7f3dbc107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.833+0000 7f3dc0ac4700 1 -- 172.21.15.45:0/1028830294 >> 172.21.15.45:0/1028830294 conn(0x7f3dbc0fc0d0 msgr2=0x7f3dbc0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:53.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.833+0000 7f3dc0ac4700 1 -- 172.21.15.45:0/1028830294 shutdown_connections 2024-05-10T03:40:53.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.833+0000 7f3dc0ac4700 1 -- 172.21.15.45:0/1028830294 wait complete. 2024-05-10T03:40:53.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.833+0000 7f3dc0ac4700 1 Processor -- start 2024-05-10T03:40:53.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.834+0000 7f3dc0ac4700 1 -- start start 2024-05-10T03:40:53.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.834+0000 7f3dc0ac4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dbc1026b0 0x7f3dbc1980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:53.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.834+0000 7f3dc0ac4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dbc105010 0x7f3dbc1985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:53.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.834+0000 7f3dc0ac4700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3dbc107970 0x7f3dbc19f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:53.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.834+0000 7f3dc0ac4700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc19fb80 con 0x7f3dbc105010 2024-05-10T03:40:53.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.834+0000 7f3dc0ac4700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc19fcf0 con 0x7f3dbc107970 2024-05-10T03:40:53.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.834+0000 7f3dc0ac4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc19feb0 con 0x7f3dbc1026b0 2024-05-10T03:40:53.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.834+0000 7f3db1d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dbc105010 0x7f3dbc1985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:53.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.834+0000 7f3db1d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dbc105010 0x7f3dbc1985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60106/0 (socket says 172.21.15.45:60106) 2024-05-10T03:40:53.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.834+0000 7f3db1d9b700 1 -- 172.21.15.45:0/581259662 learned_addr learned my addr 172.21.15.45:0/581259662 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:53.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.834+0000 7f3dba59c700 1 --2- 172.21.15.45:0/581259662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dbc1026b0 0x7f3dbc1980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:53.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.834+0000 7f3dbad9d700 1 --2- 172.21.15.45:0/581259662 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3dbc107970 0x7f3dbc19f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:53.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.835+0000 7f3db1d9b700 1 -- 172.21.15.45:0/581259662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dbc1026b0 msgr2=0x7f3dbc1980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:53.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.835+0000 7f3db1d9b700 1 --2- 172.21.15.45:0/581259662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dbc1026b0 0x7f3dbc1980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.835+0000 7f3db1d9b700 1 -- 172.21.15.45:0/581259662 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3dbc107970 msgr2=0x7f3dbc19f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:53.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.835+0000 7f3db1d9b700 1 --2- 172.21.15.45:0/581259662 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3dbc107970 0x7f3dbc19f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.835+0000 7f3db1d9b700 1 -- 172.21.15.45:0/581259662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db4009d00 con 0x7f3dbc105010 2024-05-10T03:40:53.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.835+0000 7f3db1d9b700 1 --2- 172.21.15.45:0/581259662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dbc105010 0x7f3dbc1985e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3da400e9a0 tx=0x7f3da400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:53.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.835+0000 7f3db3fff700 1 -- 172.21.15.45:0/581259662 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da4009790 con 0x7f3dbc105010 2024-05-10T03:40:53.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.835+0000 7f3dc0ac4700 1 -- 172.21.15.45:0/581259662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dbc1a0190 con 0x7f3dbc105010 2024-05-10T03:40:53.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.835+0000 7f3db3fff700 1 -- 172.21.15.45:0/581259662 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3da4010430 con 0x7f3dbc105010 2024-05-10T03:40:53.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.835+0000 7f3db3fff700 1 -- 172.21.15.45:0/581259662 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da4018680 con 0x7f3dbc105010 2024-05-10T03:40:53.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.835+0000 7f3dc0ac4700 1 -- 172.21.15.45:0/581259662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dbc1a06f0 con 0x7f3dbc105010 2024-05-10T03:40:53.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.838+0000 7f3db3fff700 1 -- 172.21.15.45:0/581259662 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f3da4010910 con 0x7f3dbc105010 2024-05-10T03:40:53.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.838+0000 7f3db3fff700 1 --2- 172.21.15.45:0/581259662 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3da80a1260 0x7f3da80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:53.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.839+0000 7f3db3fff700 1 -- 172.21.15.45:0/581259662 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3da4014070 con 0x7f3dbc105010 2024-05-10T03:40:53.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.839+0000 7f3dba59c700 1 --2- 172.21.15.45:0/581259662 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3da80a1260 0x7f3da80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:53.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.839+0000 7f3dba59c700 1 --2- 172.21.15.45:0/581259662 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3da80a1260 0x7f3da80a3770 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc068de0 tx=0x7f3dac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:53.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.839+0000 7f3dd0e08b80 1 Processor -- start 2024-05-10T03:40:53.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.840+0000 7f3dd0e08b80 1 -- start start 2024-05-10T03:40:53.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.840+0000 7f3dd0e08b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cf57b2ab0 0x562cf57b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:53.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.840+0000 7f3dd0e08b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562cf57b3980 0x562cf57b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:53.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.840+0000 7f3dd0e08b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b42d0 0x562cf57babd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:53.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.840+0000 7f3dd0e08b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf56d5150 con 0x562cf57b42d0 2024-05-10T03:40:53.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.840+0000 7f3dd0e08b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf56d2b10 con 0x562cf57b3980 2024-05-10T03:40:53.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.840+0000 7f3dd0e08b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf56ce400 con 0x562cf57b2ab0 2024-05-10T03:40:53.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.840+0000 7f3dbad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b42d0 0x562cf57babd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.840+0000 7f3dbad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b42d0 0x562cf57babd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60120/0 (socket says 172.21.15.45:60120) 2024-05-10T03:40:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.840+0000 7f3dbad9d700 1 -- 172.21.15.45:0/798151209 learned_addr learned my addr 172.21.15.45:0/798151209 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.840+0000 7f3db1d9b700 1 --2- 172.21.15.45:0/798151209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562cf57b3980 0x562cf57b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.840+0000 7f3dba59c700 1 --2- 172.21.15.45:0/798151209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cf57b2ab0 0x562cf57b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.840+0000 7f3dbad9d700 1 -- 172.21.15.45:0/798151209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cf57b2ab0 msgr2=0x562cf57b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.840+0000 7f3dbad9d700 1 --2- 172.21.15.45:0/798151209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cf57b2ab0 0x562cf57b2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.840+0000 7f3dbad9d700 1 -- 172.21.15.45:0/798151209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562cf57b3980 msgr2=0x562cf57b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.840+0000 7f3dbad9d700 1 --2- 172.21.15.45:0/798151209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562cf57b3980 0x562cf57b3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.840+0000 7f3dbad9d700 1 -- 172.21.15.45:0/798151209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562cf554f3b0 con 0x562cf57b42d0 2024-05-10T03:40:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.841+0000 7f3dbad9d700 1 --2- 172.21.15.45:0/798151209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b42d0 0x562cf57babd0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0694a0 tx=0x7f3db4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be41c126a4f4bc3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.841+0000 7f3db0d99700 1 -- 172.21.15.45:0/798151209 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db400e040 con 0x562cf57b42d0 2024-05-10T03:40:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.841+0000 7f3db0d99700 1 -- 172.21.15.45:0/798151209 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3db40075c0 con 0x562cf57b42d0 2024-05-10T03:40:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.841+0000 7f3db0d99700 1 -- 172.21.15.45:0/798151209 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db40052a0 con 0x562cf57b42d0 2024-05-10T03:40:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.842+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/798151209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b42d0 msgr2=0x562cf57babd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:53.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.842+0000 7f3dd0e08b80 1 --2- 172.21.15.45:0/798151209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b42d0 0x562cf57babd0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0694a0 tx=0x7f3db4009780 comp rx=0 tx=0).stop 2024-05-10T03:40:53.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.842+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/798151209 shutdown_connections 2024-05-10T03:40:53.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.842+0000 7f3dd0e08b80 1 --2- 172.21.15.45:0/798151209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cf57b2ab0 0x562cf57b2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.842+0000 7f3dd0e08b80 1 --2- 172.21.15.45:0/798151209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b42d0 0x562cf57babd0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.842+0000 7f3dd0e08b80 1 --2- 172.21.15.45:0/798151209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562cf57b3980 0x562cf57b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.842+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/798151209 >> 172.21.15.45:0/798151209 conn(0x562cf5710a60 msgr2=0x562cf57a8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:53.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.842+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/798151209 shutdown_connections 2024-05-10T03:40:53.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.842+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/798151209 wait complete. 2024-05-10T03:40:53.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.842+0000 7f3dd0e08b80 1 -- start start 2024-05-10T03:40:53.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.843+0000 7f3dd0e08b80 1 Processor -- start 2024-05-10T03:40:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.843+0000 7f3dd0e08b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562cf57b2ab0 0x562cf57bca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.843+0000 7f3dd0e08b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b3980 0x562cf57bcf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.843+0000 7f3dd0e08b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cf57b42d0 0x562cf57c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.843+0000 7f3dd0e08b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf566a560 con 0x562cf57b3980 2024-05-10T03:40:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.843+0000 7f3dd0e08b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf566a200 con 0x562cf57b2ab0 2024-05-10T03:40:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.843+0000 7f3dd0e08b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf55516a0 con 0x562cf57b42d0 2024-05-10T03:40:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.843+0000 7f3dd0e08b80 10 client.0 _ll_register_callbacks cb 0x562cf5673b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.843+0000 7f3db1d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b3980 0x562cf57bcf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.843+0000 7f3db1d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b3980 0x562cf57bcf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60122/0 (socket says 172.21.15.45:60122) 2024-05-10T03:40:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.843+0000 7f3db1d9b700 1 -- 172.21.15.45:0/4087022961 learned_addr learned my addr 172.21.15.45:0/4087022961 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.843+0000 7f3dbad9d700 1 --2- 172.21.15.45:0/4087022961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cf57b42d0 0x562cf57c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.843+0000 7f3dba59c700 1 --2- 172.21.15.45:0/4087022961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562cf57b2ab0 0x562cf57bca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.843+0000 7f3db1d9b700 1 -- 172.21.15.45:0/4087022961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cf57b42d0 msgr2=0x562cf57c3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.843+0000 7f3db1d9b700 1 --2- 172.21.15.45:0/4087022961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cf57b42d0 0x562cf57c3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.843+0000 7f3db1d9b700 1 -- 172.21.15.45:0/4087022961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562cf57b2ab0 msgr2=0x562cf57bca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.843+0000 7f3db1d9b700 1 --2- 172.21.15.45:0/4087022961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562cf57b2ab0 0x562cf57bca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.843+0000 7f3db1d9b700 1 -- 172.21.15.45:0/4087022961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dbc10a9b0 con 0x562cf57b3980 2024-05-10T03:40:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.844+0000 7f3db1d9b700 1 --2- 172.21.15.45:0/4087022961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b3980 0x562cf57bcf70 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3da4099ca0 tx=0x7f3da409a4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6a262e5e3e228 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.844+0000 7f3da1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.844+0000 7f3da1ffb700 1 -- 172.21.15.45:0/4087022961 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da40b1070 con 0x562cf57b3980 2024-05-10T03:40:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.844+0000 7f3da1ffb700 1 -- 172.21.15.45:0/4087022961 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3da409ddd0 con 0x562cf57b3980 2024-05-10T03:40:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.844+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/4087022961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562cf5627270 con 0x562cf57b3980 2024-05-10T03:40:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.844+0000 7f3da1ffb700 1 -- 172.21.15.45:0/4087022961 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3da405fea0 con 0x562cf57b3980 2024-05-10T03:40:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.844+0000 7f3dd0e08b80 10 client.15741 fetch_fsmap learned FSMap version 28 2024-05-10T03:40:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.844+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/4087022961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x562cf54fbb60 con 0x562cf57b3980 2024-05-10T03:40:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.844+0000 7f3da1ffb700 1 -- 172.21.15.45:0/4087022961 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3da4063080 con 0x562cf57b3980 2024-05-10T03:40:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.844+0000 7f3da1ffb700 1 -- 172.21.15.45:0/4087022961 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f3da40a20b0 con 0x562cf57b3980 2024-05-10T03:40:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.844+0000 7f3dd0e08b80 10 client.15741 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:40:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.844+0000 7f3dd0e08b80 10 client.15741 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:40:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.844+0000 7f3dd0e08b80 20 client.15741 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.844+0000 7f3dd0e08b80 1 --2- 172.21.15.45:0/4087022961 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x562cf57c8670 0x562cf57caac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.844+0000 7f3dd0e08b80 4 client.15741 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:40:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.844+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/4087022961 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562cf577d780 con 0x562cf57c8670 2024-05-10T03:40:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.845+0000 7f3dba59c700 1 --2- 172.21.15.45:0/4087022961 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x562cf57c8670 0x562cf57caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.845+0000 7f3da1ffb700 10 client.15741 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.845+0000 7f3dba59c700 1 --2- 172.21.15.45:0/4087022961 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x562cf57c8670 0x562cf57caac0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36dd5bbd21eef735 server_cookie=fa2c6ee50d9b0ff2 in_seq=0 out_seq=0 2024-05-10T03:40:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.846+0000 7f3da1ffb700 1 -- 172.21.15.45:0/4087022961 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562cf577d780 con 0x562cf57c8670 2024-05-10T03:40:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.846+0000 7f3da1ffb700 10 client.15741 handle_command_reply: tid=0 2024-05-10T03:40:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.846+0000 7f3dd0e08b80 1 client.15741 shutdown 2024-05-10T03:40:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.846+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/4087022961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b3980 msgr2=0x562cf57bcf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.846+0000 7f3dd0e08b80 1 --2- 172.21.15.45:0/4087022961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b3980 0x562cf57bcf70 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3da4099ca0 tx=0x7f3da409a4e0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.846+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/4087022961 shutdown_connections 2024-05-10T03:40:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.846+0000 7f3dd0e08b80 1 --2- 172.21.15.45:0/4087022961 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x562cf57c8670 0x562cf57caac0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.846+0000 7f3dd0e08b80 1 --2- 172.21.15.45:0/4087022961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cf57b42d0 0x562cf57c3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.846+0000 7f3dd0e08b80 1 --2- 172.21.15.45:0/4087022961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562cf57b2ab0 0x562cf57bca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.846+0000 7f3dd0e08b80 1 --2- 172.21.15.45:0/4087022961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b3980 0x562cf57bcf70 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.846+0000 7f3da1ffb700 0 client.15741 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:53.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.846+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/4087022961 >> 172.21.15.45:0/4087022961 conn(0x562cf5710a60 msgr2=0x562cf57a8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:53.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.846+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/4087022961 shutdown_connections 2024-05-10T03:40:53.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.846+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/4087022961 wait complete. 2024-05-10T03:40:53.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.846+0000 7f3dd0e08b80 20 client.15741 trim_cache size 0 max 16384 2024-05-10T03:40:53.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.864+0000 7f3dd0e08b80 1 Processor -- start 2024-05-10T03:40:53.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.864+0000 7f3dd0e08b80 1 -- start start 2024-05-10T03:40:53.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.865+0000 7f3dd0e08b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cf57b2ab0 0x562cf57c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:53.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.865+0000 7f3dd0e08b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b3980 0x562cf57c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:53.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.865+0000 7f3dd0e08b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562cf57b42d0 0x562cf57b6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:53.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.865+0000 7f3dd0e08b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf57bdad0 con 0x562cf57b3980 2024-05-10T03:40:53.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.865+0000 7f3dd0e08b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf57cfc60 con 0x562cf57b42d0 2024-05-10T03:40:53.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.865+0000 7f3dd0e08b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf57a37c0 con 0x562cf57b2ab0 2024-05-10T03:40:53.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.865+0000 7f3db1d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b3980 0x562cf57c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:53.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.865+0000 7f3db1d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b3980 0x562cf57c3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60126/0 (socket says 172.21.15.45:60126) 2024-05-10T03:40:53.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.865+0000 7f3db1d9b700 1 -- 172.21.15.45:0/2095227783 learned_addr learned my addr 172.21.15.45:0/2095227783 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:53.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.865+0000 7f3dba59c700 1 --2- 172.21.15.45:0/2095227783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cf57b2ab0 0x562cf57c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:53.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.865+0000 7f3db1d9b700 1 -- 172.21.15.45:0/2095227783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cf57b2ab0 msgr2=0x562cf57c44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:53.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.865+0000 7f3db1d9b700 1 --2- 172.21.15.45:0/2095227783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cf57b2ab0 0x562cf57c44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.865+0000 7f3db1d9b700 1 -- 172.21.15.45:0/2095227783 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562cf57b42d0 msgr2=0x562cf57b6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:53.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.865+0000 7f3db1d9b700 1 --2- 172.21.15.45:0/2095227783 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562cf57b42d0 0x562cf57b6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.865+0000 7f3db1d9b700 1 -- 172.21.15.45:0/2095227783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562cf5694560 con 0x562cf57b3980 2024-05-10T03:40:53.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.865+0000 7f3db1d9b700 1 --2- 172.21.15.45:0/2095227783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b3980 0x562cf57c3e90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f3da4000c00 tx=0x7f3da409a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adfccb1aa70404d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:53.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.865+0000 7f3db159a700 1 -- 172.21.15.45:0/2095227783 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da405fea0 con 0x562cf57b3980 2024-05-10T03:40:53.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.865+0000 7f3db159a700 1 -- 172.21.15.45:0/2095227783 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x562cf5627270 con 0x562cf57b3980 2024-05-10T03:40:53.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.865+0000 7f3db159a700 1 -- 172.21.15.45:0/2095227783 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da40b1070 con 0x562cf57b3980 2024-05-10T03:40:53.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.866+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/2095227783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b3980 msgr2=0x562cf57c3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:53.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.866+0000 7f3dd0e08b80 1 --2- 172.21.15.45:0/2095227783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b3980 0x562cf57c3e90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f3da4000c00 tx=0x7f3da409a060 comp rx=0 tx=0).stop 2024-05-10T03:40:53.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.866+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/2095227783 shutdown_connections 2024-05-10T03:40:53.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.866+0000 7f3dd0e08b80 1 --2- 172.21.15.45:0/2095227783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cf57b2ab0 0x562cf57c44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.866+0000 7f3dd0e08b80 1 --2- 172.21.15.45:0/2095227783 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562cf57b42d0 0x562cf57b6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.866+0000 7f3dd0e08b80 1 --2- 172.21.15.45:0/2095227783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b3980 0x562cf57c3e90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.866+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/2095227783 >> 172.21.15.45:0/2095227783 conn(0x562cf5710a60 msgr2=0x562cf57a5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:53.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.866+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/2095227783 shutdown_connections 2024-05-10T03:40:53.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.866+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/2095227783 wait complete. 2024-05-10T03:40:53.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.867+0000 7f3dd0e08b80 1 -- start start 2024-05-10T03:40:53.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.867+0000 7f3dd0e08b80 1 Processor -- start 2024-05-10T03:40:53.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.867+0000 7f3dd0e08b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b2ab0 0x562cf57c1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:53.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.867+0000 7f3dd0e08b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cf57b3980 0x562cf57c1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:53.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.867+0000 7f3dd0e08b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562cf57b42d0 0x562cf57c2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:53.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.867+0000 7f3dd0e08b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf57c2ed0 con 0x562cf57b2ab0 2024-05-10T03:40:53.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.867+0000 7f3dd0e08b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf57c3040 con 0x562cf57b42d0 2024-05-10T03:40:53.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.867+0000 7f3dd0e08b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf57c3200 con 0x562cf57b3980 2024-05-10T03:40:53.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.867+0000 7f3dd0e08b80 10 client.0 _ll_register_callbacks cb 0x562cf5673b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:53.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.867+0000 7f3dba59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b2ab0 0x562cf57c1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:53.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.867+0000 7f3dba59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b2ab0 0x562cf57c1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60136/0 (socket says 172.21.15.45:60136) 2024-05-10T03:40:53.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.867+0000 7f3dba59c700 1 -- 172.21.15.45:0/3247141809 learned_addr learned my addr 172.21.15.45:0/3247141809 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:53.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.867+0000 7f3db1d9b700 1 --2- 172.21.15.45:0/3247141809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cf57b3980 0x562cf57c1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:53.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.867+0000 7f3dbad9d700 1 --2- 172.21.15.45:0/3247141809 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562cf57b42d0 0x562cf57c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:53.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.867+0000 7f3dba59c700 1 -- 172.21.15.45:0/3247141809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cf57b3980 msgr2=0x562cf57c1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:53.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.867+0000 7f3dba59c700 1 --2- 172.21.15.45:0/3247141809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cf57b3980 0x562cf57c1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.867+0000 7f3dba59c700 1 -- 172.21.15.45:0/3247141809 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562cf57b42d0 msgr2=0x562cf57c2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:53.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.867+0000 7f3dba59c700 1 --2- 172.21.15.45:0/3247141809 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562cf57b42d0 0x562cf57c2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.867+0000 7f3dba59c700 1 -- 172.21.15.45:0/3247141809 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562cf54fbb60 con 0x562cf57b2ab0 2024-05-10T03:40:53.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.867+0000 7f3dbad9d700 1 --2- 172.21.15.45:0/3247141809 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562cf57b42d0 0x562cf57c2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:53.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.868+0000 7f3dba59c700 1 --2- 172.21.15.45:0/3247141809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b2ab0 0x562cf57c1520 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x562cf57cb360 tx=0x7f3dac0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420f9a74148d4be4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:53.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.868+0000 7f3da1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:53.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.868+0000 7f3da1ffb700 1 -- 172.21.15.45:0/3247141809 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac022030 con 0x562cf57b2ab0 2024-05-10T03:40:53.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.868+0000 7f3da1ffb700 1 -- 172.21.15.45:0/3247141809 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3dac003c70 con 0x562cf57b2ab0 2024-05-10T03:40:53.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.868+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/3247141809 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3db40075c0 con 0x562cf57b2ab0 2024-05-10T03:40:53.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.868+0000 7f3da1ffb700 1 -- 172.21.15.45:0/3247141809 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3dac003e30 con 0x562cf57b2ab0 2024-05-10T03:40:53.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.868+0000 7f3dd0e08b80 10 client.15747 fetch_fsmap learned FSMap version 28 2024-05-10T03:40:53.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.868+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/3247141809 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x562cf5553cd0 con 0x562cf57b2ab0 2024-05-10T03:40:53.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.868+0000 7f3da1ffb700 1 -- 172.21.15.45:0/3247141809 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3db40075c0 con 0x562cf57b2ab0 2024-05-10T03:40:53.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.868+0000 7f3da1ffb700 1 -- 172.21.15.45:0/3247141809 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f3dac030020 con 0x562cf57b2ab0 2024-05-10T03:40:53.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.868+0000 7f3dd0e08b80 10 client.15747 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:40:53.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.868+0000 7f3dd0e08b80 10 client.15747 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:40:53.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.868+0000 7f3dd0e08b80 20 client.15747 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:53.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.868+0000 7f3dd0e08b80 1 --2- 172.21.15.45:0/3247141809 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x562cf581f260 0x562cf5821680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:53.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.869+0000 7f3dd0e08b80 4 client.15747 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T03:40:53.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.869+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/3247141809 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562cf56c6ec0 con 0x562cf581f260 2024-05-10T03:40:53.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.869+0000 7f3db1d9b700 1 --2- 172.21.15.45:0/3247141809 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x562cf581f260 0x562cf5821680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:53.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.869+0000 7f3da1ffb700 10 client.15747 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:53.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.869+0000 7f3db1d9b700 1 --2- 172.21.15.45:0/3247141809 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x562cf581f260 0x562cf5821680 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1464677b4634eaa server_cookie=60d9634f3ca9cd6c in_seq=0 out_seq=0 2024-05-10T03:40:53.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.869+0000 7f3da1ffb700 1 -- 172.21.15.45:0/3247141809 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x562cf56c6ec0 con 0x562cf581f260 2024-05-10T03:40:53.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.869+0000 7f3da1ffb700 10 client.15747 handle_command_reply: tid=0 2024-05-10T03:40:53.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.869+0000 7f3dd0e08b80 1 client.15747 shutdown 2024-05-10T03:40:53.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.870+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/3247141809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b2ab0 msgr2=0x562cf57c1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:53.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.870+0000 7f3dd0e08b80 1 --2- 172.21.15.45:0/3247141809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b2ab0 0x562cf57c1520 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x562cf57cb360 tx=0x7f3dac0047c0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.870+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/3247141809 shutdown_connections 2024-05-10T03:40:53.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.870+0000 7f3dd0e08b80 1 --2- 172.21.15.45:0/3247141809 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x562cf581f260 0x562cf5821680 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.870+0000 7f3dd0e08b80 1 --2- 172.21.15.45:0/3247141809 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562cf57b42d0 0x562cf57c2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.870+0000 7f3da1ffb700 0 client.15747 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:53.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.870+0000 7f3dd0e08b80 1 --2- 172.21.15.45:0/3247141809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562cf57b2ab0 0x562cf57c1520 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.870+0000 7f3dd0e08b80 1 --2- 172.21.15.45:0/3247141809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cf57b3980 0x562cf57c1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.870+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/3247141809 >> 172.21.15.45:0/3247141809 conn(0x562cf5710a60 msgr2=0x562cf57a5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:53.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.870+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/3247141809 shutdown_connections 2024-05-10T03:40:53.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.870+0000 7f3dd0e08b80 1 -- 172.21.15.45:0/3247141809 wait complete. 2024-05-10T03:40:53.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.870+0000 7f3dd0e08b80 20 client.15747 trim_cache size 0 max 16384 2024-05-10T03:40:53.880 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:40:53.880 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-05-10T03:40:53.880 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-05-10T03:40:53.880 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:40:53.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.870+0000 7f3dc0ac4700 1 -- 172.21.15.45:0/581259662 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3da80a1260 msgr2=0x7f3da80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:53.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.870+0000 7f3dc0ac4700 1 --2- 172.21.15.45:0/581259662 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3da80a1260 0x7f3da80a3770 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc068de0 tx=0x7f3dac009260 comp rx=0 tx=0).stop 2024-05-10T03:40:53.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.870+0000 7f3dc0ac4700 1 -- 172.21.15.45:0/581259662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dbc105010 msgr2=0x7f3dbc1985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:53.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.870+0000 7f3dc0ac4700 1 --2- 172.21.15.45:0/581259662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dbc105010 0x7f3dbc1985e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3da400e9a0 tx=0x7f3da400ecb0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.870+0000 7f3dc0ac4700 1 -- 172.21.15.45:0/581259662 shutdown_connections 2024-05-10T03:40:53.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.870+0000 7f3dc0ac4700 1 --2- 172.21.15.45:0/581259662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dbc1026b0 0x7f3dbc1980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.870+0000 7f3dc0ac4700 1 --2- 172.21.15.45:0/581259662 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3da80a1260 0x7f3da80a3770 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.870+0000 7f3dc0ac4700 1 --2- 172.21.15.45:0/581259662 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3dbc107970 0x7f3dbc19f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.870+0000 7f3dc0ac4700 1 --2- 172.21.15.45:0/581259662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3dbc105010 0x7f3dbc1985e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:53.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.870+0000 7f3dc0ac4700 1 -- 172.21.15.45:0/581259662 >> 172.21.15.45:0/581259662 conn(0x7f3dbc0fc0d0 msgr2=0x7f3dbc1034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:53.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.871+0000 7f3dc0ac4700 1 -- 172.21.15.45:0/581259662 shutdown_connections 2024-05-10T03:40:53.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:53.871+0000 7f3dc0ac4700 1 -- 172.21.15.45:0/581259662 wait complete. 2024-05-10T03:40:53.887 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-10T03:40:53.887 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:40:54.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.036+0000 7f9d7c754700 1 -- 172.21.15.45:0/3081501140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d74100ac0 msgr2=0x7f9d74100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.036+0000 7f9d7c754700 1 --2- 172.21.15.45:0/3081501140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d74100ac0 0x7f9d74100ed0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9d70009990 tx=0x7f9d70009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.036+0000 7f9d7c754700 1 -- 172.21.15.45:0/3081501140 shutdown_connections 2024-05-10T03:40:54.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.036+0000 7f9d7c754700 1 --2- 172.21.15.45:0/3081501140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d74102580 0x7f9d74108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.036+0000 7f9d7c754700 1 --2- 172.21.15.45:0/3081501140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d74100ac0 0x7f9d74100ed0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.036+0000 7f9d7c754700 1 --2- 172.21.15.45:0/3081501140 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d74101be0 0x7f9d74101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.036+0000 7f9d7c754700 1 -- 172.21.15.45:0/3081501140 >> 172.21.15.45:0/3081501140 conn(0x7f9d740fc0d0 msgr2=0x7f9d740fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:54.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.036+0000 7f9d7c754700 1 -- 172.21.15.45:0/3081501140 shutdown_connections 2024-05-10T03:40:54.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.036+0000 7f9d7c754700 1 -- 172.21.15.45:0/3081501140 wait complete. 2024-05-10T03:40:54.041 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.037+0000 7f9d7c754700 1 Processor -- start 2024-05-10T03:40:54.041 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.037+0000 7f9d7c754700 1 -- start start 2024-05-10T03:40:54.041 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.037+0000 7f9d7c754700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d74100ac0 0x7f9d74068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.041 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.037+0000 7f9d7c754700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d74101be0 0x7f9d7419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.037+0000 7f9d7c754700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d74102580 0x7f9d7419f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.037+0000 7f9d7c754700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7419faa0 con 0x7f9d74101be0 2024-05-10T03:40:54.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.037+0000 7f9d7c754700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7419fc10 con 0x7f9d74102580 2024-05-10T03:40:54.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.037+0000 7f9d7c754700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7419fdd0 con 0x7f9d74100ac0 2024-05-10T03:40:54.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.037+0000 7f9d79cef700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d74101be0 0x7f9d7419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.038+0000 7f9d79cef700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d74101be0 0x7f9d7419cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60166/0 (socket says 172.21.15.45:60166) 2024-05-10T03:40:54.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.038+0000 7f9d79cef700 1 -- 172.21.15.45:0/2529755013 learned_addr learned my addr 172.21.15.45:0/2529755013 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:54.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.038+0000 7f9d7a4f0700 1 --2- 172.21.15.45:0/2529755013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d74100ac0 0x7f9d74068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.038+0000 7f9d7acf1700 1 --2- 172.21.15.45:0/2529755013 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d74102580 0x7f9d7419f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.038+0000 7f9d79cef700 1 -- 172.21.15.45:0/2529755013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d74100ac0 msgr2=0x7f9d74068e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.038+0000 7f9d79cef700 1 --2- 172.21.15.45:0/2529755013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d74100ac0 0x7f9d74068e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.038+0000 7f9d79cef700 1 -- 172.21.15.45:0/2529755013 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d74102580 msgr2=0x7f9d7419f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.038+0000 7f9d79cef700 1 --2- 172.21.15.45:0/2529755013 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d74102580 0x7f9d7419f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.038+0000 7f9d79cef700 1 -- 172.21.15.45:0/2529755013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d700095f0 con 0x7f9d74101be0 2024-05-10T03:40:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.038+0000 7f9d79cef700 1 --2- 172.21.15.45:0/2529755013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d74101be0 0x7f9d7419cd30 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9d6400d950 tx=0x7f9d6400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.038+0000 7f9d6b7fe700 1 -- 172.21.15.45:0/2529755013 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6400f890 con 0x7f9d74101be0 2024-05-10T03:40:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.038+0000 7f9d6b7fe700 1 -- 172.21.15.45:0/2529755013 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9d64010460 con 0x7f9d74101be0 2024-05-10T03:40:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.038+0000 7f9d6b7fe700 1 -- 172.21.15.45:0/2529755013 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6400e610 con 0x7f9d74101be0 2024-05-10T03:40:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.038+0000 7f9d7c754700 1 -- 172.21.15.45:0/2529755013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d741a00b0 con 0x7f9d74101be0 2024-05-10T03:40:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.038+0000 7f9d7c754700 1 -- 172.21.15.45:0/2529755013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d741a0570 con 0x7f9d74101be0 2024-05-10T03:40:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.039+0000 7f9d7c754700 1 -- 172.21.15.45:0/2529755013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d74107cd0 con 0x7f9d74101be0 2024-05-10T03:40:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.041+0000 7f9d6b7fe700 1 -- 172.21.15.45:0/2529755013 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f9d64010960 con 0x7f9d74101be0 2024-05-10T03:40:54.044 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.042+0000 7f9d6b7fe700 1 --2- 172.21.15.45:0/2529755013 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9d600a11b0 0x7f9d600a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.044 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.042+0000 7f9d7a4f0700 1 --2- 172.21.15.45:0/2529755013 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9d600a11b0 0x7f9d600a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.044 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.042+0000 7f9d6b7fe700 1 -- 172.21.15.45:0/2529755013 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f9d640ccc20 con 0x7f9d74101be0 2024-05-10T03:40:54.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.042+0000 7f9d7a4f0700 1 --2- 172.21.15.45:0/2529755013 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9d600a11b0 0x7f9d600a36c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9d70006010 tx=0x7f9d7001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:54.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.046+0000 7f9d6b7fe700 1 -- 172.21.15.45:0/2529755013 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9d64095eb0 con 0x7f9d74101be0 2024-05-10T03:40:54.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.314+0000 7f9d7c754700 1 -- 172.21.15.45:0/2529755013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d740694b0 con 0x7f9d74101be0 2024-05-10T03:40:54.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.315+0000 7f9d6b7fe700 1 -- 172.21.15.45:0/2529755013 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+10926 (secure 0 0 0) 0x7f9d64016090 con 0x7f9d74101be0 2024-05-10T03:40:54.317 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:40:54.318 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/378320264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":378320264},{"type":"v1","addr":"172.21.15.45:6835","nonce":378320264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3032381796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3032381796},{"type":"v1","addr":"172.21.15.45:6837","nonce":3032381796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T03:38:36.555290+0000","modified":"2024-05-10T03:40:14.047840+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24548,"mds_2":24547,"mds_3":24526,"mds_4":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14625":{"gid":14625,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6839/4007419304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":4007419304},{"type":"v1","addr":"172.21.15.45:6839","nonce":4007419304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14637":{"gid":14637,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6841/1355456195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1355456195},{"type":"v1","addr":"172.21.15.45:6841","nonce":1355456195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/4037121210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":4037121210},{"type":"v1","addr":"172.21.15.154:6835","nonce":4037121210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24521":{"gid":24521,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.106:6835/4162885659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4162885659},{"type":"v1","addr":"172.21.15.106:6835","nonce":4162885659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.154:6837/608167481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":608167481},{"type":"v1","addr":"172.21.15.154:6837","nonce":608167481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/1506563336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1506563336},{"type":"v1","addr":"172.21.15.154:6839","nonce":1506563336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.106:6837/3047487403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":3047487403},{"type":"v1","addr":"172.21.15.106:6837","nonce":3047487403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6839/3533867856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":3533867856},{"type":"v1","addr":"172.21.15.106:6839","nonce":3533867856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T03:40:54.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.318+0000 7f9d7c754700 1 -- 172.21.15.45:0/2529755013 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9d600a11b0 msgr2=0x7f9d600a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.318+0000 7f9d7c754700 1 --2- 172.21.15.45:0/2529755013 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9d600a11b0 0x7f9d600a36c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9d70006010 tx=0x7f9d7001a040 comp rx=0 tx=0).stop 2024-05-10T03:40:54.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.318+0000 7f9d7c754700 1 -- 172.21.15.45:0/2529755013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d74101be0 msgr2=0x7f9d7419cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.318+0000 7f9d7c754700 1 --2- 172.21.15.45:0/2529755013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d74101be0 0x7f9d7419cd30 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9d6400d950 tx=0x7f9d6400dc60 comp rx=0 tx=0).stop 2024-05-10T03:40:54.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.318+0000 7f9d7c754700 1 -- 172.21.15.45:0/2529755013 shutdown_connections 2024-05-10T03:40:54.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.318+0000 7f9d7c754700 1 --2- 172.21.15.45:0/2529755013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d74100ac0 0x7f9d74068e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.318+0000 7f9d7c754700 1 --2- 172.21.15.45:0/2529755013 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9d600a11b0 0x7f9d600a36c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.318+0000 7f9d7c754700 1 --2- 172.21.15.45:0/2529755013 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d74102580 0x7f9d7419f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.318+0000 7f9d7c754700 1 --2- 172.21.15.45:0/2529755013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d74101be0 0x7f9d7419cd30 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.318+0000 7f9d7c754700 1 -- 172.21.15.45:0/2529755013 >> 172.21.15.45:0/2529755013 conn(0x7f9d740fc0d0 msgr2=0x7f9d74104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:54.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.318+0000 7f9d7c754700 1 -- 172.21.15.45:0/2529755013 shutdown_connections 2024-05-10T03:40:54.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.318+0000 7f9d7c754700 1 -- 172.21.15.45:0/2529755013 wait complete. 2024-05-10T03:40:54.321 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 28 2024-05-10T03:40:54.335 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-05-10T03:40:54.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.484+0000 7f86c585f700 1 -- 172.21.15.45:0/3763612236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86c0102d00 msgr2=0x7f86c0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.484+0000 7f86c585f700 1 --2- 172.21.15.45:0/3763612236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86c0102d00 0x7f86c0103110 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f86b4009990 tx=0x7f86b4009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.484+0000 7f86c585f700 1 -- 172.21.15.45:0/3763612236 shutdown_connections 2024-05-10T03:40:54.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.484+0000 7f86c585f700 1 --2- 172.21.15.45:0/3763612236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86c0101be0 0x7f86c0101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.484+0000 7f86c585f700 1 --2- 172.21.15.45:0/3763612236 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86c01036a0 0x7f86c0109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.484+0000 7f86c585f700 1 --2- 172.21.15.45:0/3763612236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86c0102d00 0x7f86c0103110 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.484+0000 7f86c585f700 1 -- 172.21.15.45:0/3763612236 >> 172.21.15.45:0/3763612236 conn(0x7f86c00fd210 msgr2=0x7f86c00ff6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:54.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.484+0000 7f86c585f700 1 -- 172.21.15.45:0/3763612236 shutdown_connections 2024-05-10T03:40:54.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.484+0000 7f86c585f700 1 -- 172.21.15.45:0/3763612236 wait complete. 2024-05-10T03:40:54.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.485+0000 7f86c585f700 1 Processor -- start 2024-05-10T03:40:54.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.485+0000 7f86c585f700 1 -- start start 2024-05-10T03:40:54.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.485+0000 7f86c585f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86c0101be0 0x7f86c0198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.485+0000 7f86c585f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86c0102d00 0x7f86c01985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.485+0000 7f86c585f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86c01036a0 0x7f86c019f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.485+0000 7f86c585f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c019fb40 con 0x7f86c0101be0 2024-05-10T03:40:54.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.485+0000 7f86c585f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c019fcb0 con 0x7f86c01036a0 2024-05-10T03:40:54.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.485+0000 7f86c585f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c019fe70 con 0x7f86c0102d00 2024-05-10T03:40:54.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.485+0000 7f86beffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86c0101be0 0x7f86c0198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.485+0000 7f86be7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86c0102d00 0x7f86c01985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.485+0000 7f86beffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86c0101be0 0x7f86c0198060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60174/0 (socket says 172.21.15.45:60174) 2024-05-10T03:40:54.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.485+0000 7f86beffd700 1 -- 172.21.15.45:0/4006924467 learned_addr learned my addr 172.21.15.45:0/4006924467 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:54.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.485+0000 7f86bf7fe700 1 --2- 172.21.15.45:0/4006924467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86c01036a0 0x7f86c019f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.486+0000 7f86beffd700 1 -- 172.21.15.45:0/4006924467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86c0102d00 msgr2=0x7f86c01985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.486+0000 7f86beffd700 1 --2- 172.21.15.45:0/4006924467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86c0102d00 0x7f86c01985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.486+0000 7f86beffd700 1 -- 172.21.15.45:0/4006924467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86c01036a0 msgr2=0x7f86c019f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.486+0000 7f86beffd700 1 --2- 172.21.15.45:0/4006924467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86c01036a0 0x7f86c019f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.486+0000 7f86beffd700 1 -- 172.21.15.45:0/4006924467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b40095f0 con 0x7f86c0101be0 2024-05-10T03:40:54.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.486+0000 7f86beffd700 1 --2- 172.21.15.45:0/4006924467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86c0101be0 0x7f86c0198060 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f86b000e940 tx=0x7f86b000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:54.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.486+0000 7f86c485d700 1 -- 172.21.15.45:0/4006924467 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b0004220 con 0x7f86c0101be0 2024-05-10T03:40:54.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.486+0000 7f86c485d700 1 -- 172.21.15.45:0/4006924467 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f86b000ccc0 con 0x7f86c0101be0 2024-05-10T03:40:54.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.486+0000 7f86c585f700 1 -- 172.21.15.45:0/4006924467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c01a0150 con 0x7f86c0101be0 2024-05-10T03:40:54.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.486+0000 7f86c485d700 1 -- 172.21.15.45:0/4006924467 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b0003cb0 con 0x7f86c0101be0 2024-05-10T03:40:54.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.486+0000 7f86c585f700 1 -- 172.21.15.45:0/4006924467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c01a06b0 con 0x7f86c0101be0 2024-05-10T03:40:54.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.489+0000 7f86c485d700 1 -- 172.21.15.45:0/4006924467 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f86b0018430 con 0x7f86c0101be0 2024-05-10T03:40:54.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.489+0000 7f86c485d700 1 --2- 172.21.15.45:0/4006924467 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f86a80a12e0 0x7f86a80a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.490+0000 7f86be7fc700 1 --2- 172.21.15.45:0/4006924467 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f86a80a12e0 0x7f86a80a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.490+0000 7f86c485d700 1 -- 172.21.15.45:0/4006924467 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f86b0014070 con 0x7f86c0101be0 2024-05-10T03:40:54.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.490+0000 7f86be7fc700 1 --2- 172.21.15.45:0/4006924467 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f86a80a12e0 0x7f86a80a37f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f86b400b2e0 tx=0x7f86b401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:54.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.490+0000 7f86d5ba3b80 1 Processor -- start 2024-05-10T03:40:54.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.490+0000 7f86d5ba3b80 1 -- start start 2024-05-10T03:40:54.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.491+0000 7f86d5ba3b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555de709d6a0 0x555de709daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.491+0000 7f86d5ba3b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709e570 0x555de709e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.491+0000 7f86d5ba3b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555de709eec0 0x555de70a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.491+0000 7f86d5ba3b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555de6fc4150 con 0x555de709e570 2024-05-10T03:40:54.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.491+0000 7f86d5ba3b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555de6fc1b10 con 0x555de709eec0 2024-05-10T03:40:54.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.491+0000 7f86d5ba3b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x555de6fbd400 con 0x555de709d6a0 2024-05-10T03:40:54.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.491+0000 7f86be7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709e570 0x555de709e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.491+0000 7f86be7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709e570 0x555de709e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60178/0 (socket says 172.21.15.45:60178) 2024-05-10T03:40:54.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.491+0000 7f86be7fc700 1 -- 172.21.15.45:0/4208095472 learned_addr learned my addr 172.21.15.45:0/4208095472 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:54.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.491+0000 7f86beffd700 1 --2- 172.21.15.45:0/4208095472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555de709d6a0 0x555de709daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.491+0000 7f86bf7fe700 1 --2- 172.21.15.45:0/4208095472 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555de709eec0 0x555de70a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.491+0000 7f86be7fc700 1 -- 172.21.15.45:0/4208095472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555de709d6a0 msgr2=0x555de709daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:54.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.491+0000 7f86be7fc700 1 --2- 172.21.15.45:0/4208095472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555de709d6a0 0x555de709daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.491+0000 7f86be7fc700 1 -- 172.21.15.45:0/4208095472 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555de709eec0 msgr2=0x555de70a57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:54.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.491+0000 7f86be7fc700 1 --2- 172.21.15.45:0/4208095472 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555de709eec0 0x555de70a57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.491+0000 7f86be7fc700 1 -- 172.21.15.45:0/4208095472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555de6e3e3b0 con 0x555de709e570 2024-05-10T03:40:54.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.491+0000 7f86be7fc700 1 --2- 172.21.15.45:0/4208095472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709e570 0x555de709e980 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f86b4009990 tx=0x7f86b401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18453000eb90bdd6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:54.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.492+0000 7f86a5ffb700 1 -- 172.21.15.45:0/4208095472 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b402b070 con 0x555de709e570 2024-05-10T03:40:54.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.492+0000 7f86a5ffb700 1 -- 172.21.15.45:0/4208095472 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f86b401e040 con 0x555de709e570 2024-05-10T03:40:54.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.492+0000 7f86a5ffb700 1 -- 172.21.15.45:0/4208095472 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b4024870 con 0x555de709e570 2024-05-10T03:40:54.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.492+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/4208095472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709e570 msgr2=0x555de709e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.492+0000 7f86d5ba3b80 1 --2- 172.21.15.45:0/4208095472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709e570 0x555de709e980 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f86b4009990 tx=0x7f86b401f000 comp rx=0 tx=0).stop 2024-05-10T03:40:54.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.493+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/4208095472 shutdown_connections 2024-05-10T03:40:54.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.493+0000 7f86d5ba3b80 1 --2- 172.21.15.45:0/4208095472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555de709d6a0 0x555de709daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.493+0000 7f86d5ba3b80 1 --2- 172.21.15.45:0/4208095472 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555de709eec0 0x555de70a57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.493+0000 7f86d5ba3b80 1 --2- 172.21.15.45:0/4208095472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709e570 0x555de709e980 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.493+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/4208095472 >> 172.21.15.45:0/4208095472 conn(0x555de6fffa60 msgr2=0x555de7097fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:54.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.493+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/4208095472 shutdown_connections 2024-05-10T03:40:54.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.493+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/4208095472 wait complete. 2024-05-10T03:40:54.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.493+0000 7f86d5ba3b80 1 -- start start 2024-05-10T03:40:54.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.493+0000 7f86d5ba3b80 1 Processor -- start 2024-05-10T03:40:54.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.494+0000 7f86d5ba3b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555de709d6a0 0x555de70a7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.494+0000 7f86d5ba3b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709e570 0x555de70a7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.494+0000 7f86d5ba3b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555de709eec0 0x555de70aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.494+0000 7f86d5ba3b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555de6f59560 con 0x555de709e570 2024-05-10T03:40:54.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.494+0000 7f86d5ba3b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555de6f59200 con 0x555de709d6a0 2024-05-10T03:40:54.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.494+0000 7f86d5ba3b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x555de6e406a0 con 0x555de709eec0 2024-05-10T03:40:54.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.494+0000 7f86d5ba3b80 10 client.0 _ll_register_callbacks cb 0x555de6f62b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:54.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.494+0000 7f86be7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709e570 0x555de70a7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.494+0000 7f86be7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709e570 0x555de70a7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60192/0 (socket says 172.21.15.45:60192) 2024-05-10T03:40:54.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.494+0000 7f86be7fc700 1 -- 172.21.15.45:0/1366576746 learned_addr learned my addr 172.21.15.45:0/1366576746 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:54.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.494+0000 7f86bf7fe700 1 --2- 172.21.15.45:0/1366576746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555de709eec0 0x555de70aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.494+0000 7f86beffd700 1 --2- 172.21.15.45:0/1366576746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555de709d6a0 0x555de70a7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.494+0000 7f86be7fc700 1 -- 172.21.15.45:0/1366576746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555de709eec0 msgr2=0x555de70aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:54.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.494+0000 7f86be7fc700 1 --2- 172.21.15.45:0/1366576746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555de709eec0 0x555de70aeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.494+0000 7f86be7fc700 1 -- 172.21.15.45:0/1366576746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555de709d6a0 msgr2=0x555de70a7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:54.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.494+0000 7f86be7fc700 1 --2- 172.21.15.45:0/1366576746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555de709d6a0 0x555de70a7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.494+0000 7f86be7fc700 1 -- 172.21.15.45:0/1366576746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c010a9e0 con 0x555de709e570 2024-05-10T03:40:54.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.494+0000 7f86beffd700 1 --2- 172.21.15.45:0/1366576746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555de709d6a0 0x555de70a7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:54.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.494+0000 7f86be7fc700 1 --2- 172.21.15.45:0/1366576746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709e570 0x555de70a7b50 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f86b400fa60 tx=0x7f86b4009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f048375ee9396711 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:54.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.494+0000 7f869effd700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:54.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.495+0000 7f869effd700 1 -- 172.21.15.45:0/1366576746 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b402b030 con 0x555de709e570 2024-05-10T03:40:54.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.495+0000 7f869effd700 1 -- 172.21.15.45:0/1366576746 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f86b4024630 con 0x555de709e570 2024-05-10T03:40:54.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.495+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/1366576746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555de6f16270 con 0x555de709e570 2024-05-10T03:40:54.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.495+0000 7f869effd700 1 -- 172.21.15.45:0/1366576746 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86b40247f0 con 0x555de709e570 2024-05-10T03:40:54.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.495+0000 7f86d5ba3b80 10 client.15765 fetch_fsmap learned FSMap version 28 2024-05-10T03:40:54.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.495+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/1366576746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x555de6deab60 con 0x555de709e570 2024-05-10T03:40:54.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.495+0000 7f869effd700 1 -- 172.21.15.45:0/1366576746 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x555de6f16270 con 0x555de709e570 2024-05-10T03:40:54.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.495+0000 7f869effd700 1 -- 172.21.15.45:0/1366576746 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f86b402fb90 con 0x555de709e570 2024-05-10T03:40:54.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.495+0000 7f86d5ba3b80 10 client.15765 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:40:54.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.495+0000 7f86d5ba3b80 10 client.15765 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2024-05-10T03:40:54.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.495+0000 7f86d5ba3b80 20 client.15765 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:54.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.495+0000 7f86d5ba3b80 1 --2- 172.21.15.45:0/1366576746 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x555de70b2de0 0x555de70b5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.495+0000 7f86d5ba3b80 4 client.15765 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:40:54.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.495+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/1366576746 --> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555de706c780 con 0x555de70b2de0 2024-05-10T03:40:54.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.496+0000 7f86beffd700 1 --2- 172.21.15.45:0/1366576746 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x555de70b2de0 0x555de70b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.496+0000 7f869effd700 10 client.15765 ms_handle_connect on v2:172.21.15.106:6834/4162885659 2024-05-10T03:40:54.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.496+0000 7f86beffd700 1 --2- 172.21.15.45:0/1366576746 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x555de70b2de0 0x555de70b5230 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c1c824566e75da1e server_cookie=5ed541870a2eaf8b in_seq=0 out_seq=0 2024-05-10T03:40:54.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.497+0000 7f869effd700 1 -- 172.21.15.45:0/1366576746 <== mds.4 v2:172.21.15.106:6834/4162885659 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555de706c780 con 0x555de70b2de0 2024-05-10T03:40:54.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.497+0000 7f869effd700 10 client.15765 handle_command_reply: tid=0 2024-05-10T03:40:54.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.497+0000 7f86d5ba3b80 1 client.15765 shutdown 2024-05-10T03:40:54.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.497+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/1366576746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709e570 msgr2=0x555de70a7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.497+0000 7f86d5ba3b80 1 --2- 172.21.15.45:0/1366576746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709e570 0x555de70a7b50 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f86b400fa60 tx=0x7f86b4009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.497+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/1366576746 shutdown_connections 2024-05-10T03:40:54.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.497+0000 7f86d5ba3b80 1 --2- 172.21.15.45:0/1366576746 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x555de70b2de0 0x555de70b5230 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.497+0000 7f86d5ba3b80 1 --2- 172.21.15.45:0/1366576746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555de709eec0 0x555de70aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.497+0000 7f869effd700 0 client.15765 ms_handle_reset on v2:172.21.15.106:6834/4162885659 2024-05-10T03:40:54.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.497+0000 7f86d5ba3b80 1 --2- 172.21.15.45:0/1366576746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555de709d6a0 0x555de70a7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.497+0000 7f86d5ba3b80 1 --2- 172.21.15.45:0/1366576746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709e570 0x555de70a7b50 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.497+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/1366576746 >> 172.21.15.45:0/1366576746 conn(0x555de6fffa60 msgr2=0x555de7097fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:54.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.497+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/1366576746 shutdown_connections 2024-05-10T03:40:54.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.497+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/1366576746 wait complete. 2024-05-10T03:40:54.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.497+0000 7f86d5ba3b80 20 client.15765 trim_cache size 0 max 16384 2024-05-10T03:40:54.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.511+0000 7f86d5ba3b80 1 Processor -- start 2024-05-10T03:40:54.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.511+0000 7f86d5ba3b80 1 -- start start 2024-05-10T03:40:54.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.511+0000 7f86d5ba3b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555de709d6a0 0x555de709e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.512+0000 7f86d5ba3b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555de709e570 0x555de70aea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.512+0000 7f86d5ba3b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709eec0 0x555de70a17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.512+0000 7f86d5ba3b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555de70afbb0 con 0x555de709eec0 2024-05-10T03:40:54.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.512+0000 7f86d5ba3b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555de7099770 con 0x555de709d6a0 2024-05-10T03:40:54.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.512+0000 7f86d5ba3b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x555de70b2b80 con 0x555de709e570 2024-05-10T03:40:54.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.512+0000 7f86bf7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709eec0 0x555de70a17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.512+0000 7f86bf7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709eec0 0x555de70a17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60204/0 (socket says 172.21.15.45:60204) 2024-05-10T03:40:54.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.512+0000 7f86bf7fe700 1 -- 172.21.15.45:0/2429856823 learned_addr learned my addr 172.21.15.45:0/2429856823 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:54.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.512+0000 7f86beffd700 1 --2- 172.21.15.45:0/2429856823 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555de709d6a0 0x555de709e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.512+0000 7f86be7fc700 1 --2- 172.21.15.45:0/2429856823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555de709e570 0x555de70aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.512+0000 7f86bf7fe700 1 -- 172.21.15.45:0/2429856823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555de709e570 msgr2=0x555de70aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:54.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.512+0000 7f86bf7fe700 1 --2- 172.21.15.45:0/2429856823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555de709e570 0x555de70aea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.512+0000 7f86bf7fe700 1 -- 172.21.15.45:0/2429856823 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555de709d6a0 msgr2=0x555de709e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:54.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.512+0000 7f86bf7fe700 1 --2- 172.21.15.45:0/2429856823 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555de709d6a0 0x555de709e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.512+0000 7f86bf7fe700 1 -- 172.21.15.45:0/2429856823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555de6f83560 con 0x555de709eec0 2024-05-10T03:40:54.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.512+0000 7f86be7fc700 1 --2- 172.21.15.45:0/2429856823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555de709e570 0x555de70aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:54.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.512+0000 7f86bf7fe700 1 --2- 172.21.15.45:0/2429856823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709eec0 0x555de70a17a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f86b80128d0 tx=0x7f86b8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0629683ef87d046 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:54.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.512+0000 7f86a67fc700 1 -- 172.21.15.45:0/2429856823 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b800e040 con 0x555de709eec0 2024-05-10T03:40:54.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.512+0000 7f86a67fc700 1 -- 172.21.15.45:0/2429856823 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f86b800f040 con 0x555de709eec0 2024-05-10T03:40:54.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.513+0000 7f86a67fc700 1 -- 172.21.15.45:0/2429856823 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b8007760 con 0x555de709eec0 2024-05-10T03:40:54.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.513+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/2429856823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709eec0 msgr2=0x555de70a17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.513+0000 7f86d5ba3b80 1 --2- 172.21.15.45:0/2429856823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709eec0 0x555de70a17a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f86b80128d0 tx=0x7f86b8009920 comp rx=0 tx=0).stop 2024-05-10T03:40:54.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.513+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/2429856823 shutdown_connections 2024-05-10T03:40:54.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.513+0000 7f86d5ba3b80 1 --2- 172.21.15.45:0/2429856823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709eec0 0x555de70a17a0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.513+0000 7f86d5ba3b80 1 --2- 172.21.15.45:0/2429856823 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555de709d6a0 0x555de709e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.513+0000 7f86d5ba3b80 1 --2- 172.21.15.45:0/2429856823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555de709e570 0x555de70aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.513+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/2429856823 >> 172.21.15.45:0/2429856823 conn(0x555de6fffa60 msgr2=0x555de7094180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:54.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.513+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/2429856823 shutdown_connections 2024-05-10T03:40:54.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.513+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/2429856823 wait complete. 2024-05-10T03:40:54.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.514+0000 7f86d5ba3b80 1 -- start start 2024-05-10T03:40:54.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.514+0000 7f86d5ba3b80 1 Processor -- start 2024-05-10T03:40:54.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.514+0000 7f86d5ba3b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555de709d6a0 0x555de70abb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.514+0000 7f86d5ba3b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709e570 0x555de70ac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.514+0000 7f86d5ba3b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555de709eec0 0x555de70acfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.514+0000 7f86d5ba3b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555de70ad520 con 0x555de709e570 2024-05-10T03:40:54.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.514+0000 7f86d5ba3b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555de70ad690 con 0x555de709eec0 2024-05-10T03:40:54.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.514+0000 7f86d5ba3b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x555de70ad850 con 0x555de709d6a0 2024-05-10T03:40:54.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.515+0000 7f86d5ba3b80 10 client.0 _ll_register_callbacks cb 0x555de6f62b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:54.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.515+0000 7f86be7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709e570 0x555de70ac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.515+0000 7f86be7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709e570 0x555de70ac0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60220/0 (socket says 172.21.15.45:60220) 2024-05-10T03:40:54.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.515+0000 7f86be7fc700 1 -- 172.21.15.45:0/2307818232 learned_addr learned my addr 172.21.15.45:0/2307818232 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:54.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.515+0000 7f86beffd700 1 --2- 172.21.15.45:0/2307818232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555de709d6a0 0x555de70abb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.515+0000 7f86bf7fe700 1 --2- 172.21.15.45:0/2307818232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555de709eec0 0x555de70acfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.515+0000 7f86be7fc700 1 -- 172.21.15.45:0/2307818232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555de709d6a0 msgr2=0x555de70abb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:54.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.515+0000 7f86be7fc700 1 --2- 172.21.15.45:0/2307818232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555de709d6a0 0x555de70abb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.515+0000 7f86be7fc700 1 -- 172.21.15.45:0/2307818232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555de709eec0 msgr2=0x555de70acfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:54.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.515+0000 7f86be7fc700 1 --2- 172.21.15.45:0/2307818232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555de709eec0 0x555de70acfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.515+0000 7f86be7fc700 1 -- 172.21.15.45:0/2307818232 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b8012580 con 0x555de709e570 2024-05-10T03:40:54.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.515+0000 7f86beffd700 1 --2- 172.21.15.45:0/2307818232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555de709d6a0 0x555de70abb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:40:54.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.515+0000 7f86be7fc700 1 --2- 172.21.15.45:0/2307818232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709e570 0x555de70ac0b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f86b400fa30 tx=0x7f86b4016c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f68e85afb39f83eb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:54.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.515+0000 7f869effd700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:54.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.515+0000 7f869effd700 1 -- 172.21.15.45:0/2307818232 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b402b040 con 0x555de709e570 2024-05-10T03:40:54.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.515+0000 7f869effd700 1 -- 172.21.15.45:0/2307818232 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f86b40375f0 con 0x555de709e570 2024-05-10T03:40:54.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.515+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/2307818232 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f86b401e040 con 0x555de709e570 2024-05-10T03:40:54.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.516+0000 7f869effd700 1 -- 172.21.15.45:0/2307818232 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86b4016ea0 con 0x555de709e570 2024-05-10T03:40:54.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.516+0000 7f86d5ba3b80 10 client.15771 fetch_fsmap learned FSMap version 28 2024-05-10T03:40:54.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.516+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/2307818232 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x555de6e42cd0 con 0x555de709e570 2024-05-10T03:40:54.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.516+0000 7f869effd700 1 -- 172.21.15.45:0/2307818232 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f86b401e040 con 0x555de709e570 2024-05-10T03:40:54.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.516+0000 7f869effd700 1 -- 172.21.15.45:0/2307818232 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f86b404e070 con 0x555de709e570 2024-05-10T03:40:54.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.516+0000 7f86d5ba3b80 10 client.15771 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:40:54.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.516+0000 7f86d5ba3b80 10 client.15771 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2024-05-10T03:40:54.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.516+0000 7f86d5ba3b80 20 client.15771 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:54.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.516+0000 7f86d5ba3b80 1 --2- 172.21.15.45:0/2307818232 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x555de7109250 0x555de710b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.516+0000 7f86d5ba3b80 4 client.15771 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-10T03:40:54.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.516+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/2307818232 --> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555de6fb5ec0 con 0x555de7109250 2024-05-10T03:40:54.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.516+0000 7f86beffd700 1 --2- 172.21.15.45:0/2307818232 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x555de7109250 0x555de710b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.517+0000 7f869effd700 10 client.15771 ms_handle_connect on v2:172.21.15.106:6834/4162885659 2024-05-10T03:40:54.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.517+0000 7f86beffd700 1 --2- 172.21.15.45:0/2307818232 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x555de7109250 0x555de710b670 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=71d5e9815e5480f2 server_cookie=1bbf75a77e8d1708 in_seq=0 out_seq=0 2024-05-10T03:40:54.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.517+0000 7f869effd700 1 -- 172.21.15.45:0/2307818232 <== mds.4 v2:172.21.15.106:6834/4162885659 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555de6fb5ec0 con 0x555de7109250 2024-05-10T03:40:54.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.517+0000 7f869effd700 10 client.15771 handle_command_reply: tid=0 2024-05-10T03:40:54.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.517+0000 7f86d5ba3b80 1 client.15771 shutdown 2024-05-10T03:40:54.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.517+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/2307818232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709e570 msgr2=0x555de70ac0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.517+0000 7f86d5ba3b80 1 --2- 172.21.15.45:0/2307818232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709e570 0x555de70ac0b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f86b400fa30 tx=0x7f86b4016c00 comp rx=0 tx=0).stop 2024-05-10T03:40:54.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.517+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/2307818232 shutdown_connections 2024-05-10T03:40:54.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.517+0000 7f86d5ba3b80 1 --2- 172.21.15.45:0/2307818232 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x555de7109250 0x555de710b670 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.517+0000 7f86d5ba3b80 1 --2- 172.21.15.45:0/2307818232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555de709d6a0 0x555de70abb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.517+0000 7f86d5ba3b80 1 --2- 172.21.15.45:0/2307818232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555de709eec0 0x555de70acfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.517+0000 7f86d5ba3b80 1 --2- 172.21.15.45:0/2307818232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555de709e570 0x555de70ac0b0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.517+0000 7f869effd700 0 client.15771 ms_handle_reset on v2:172.21.15.106:6834/4162885659 2024-05-10T03:40:54.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.517+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/2307818232 >> 172.21.15.45:0/2307818232 conn(0x555de6fffa60 msgr2=0x555de7094180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:54.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.517+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/2307818232 shutdown_connections 2024-05-10T03:40:54.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.517+0000 7f86d5ba3b80 1 -- 172.21.15.45:0/2307818232 wait complete. 2024-05-10T03:40:54.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.518+0000 7f86d5ba3b80 20 client.15771 trim_cache size 0 max 16384 2024-05-10T03:40:54.527 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-05-10T03:40:54.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.518+0000 7f86c585f700 1 -- 172.21.15.45:0/4006924467 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f86a80a12e0 msgr2=0x7f86a80a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.518+0000 7f86c585f700 1 --2- 172.21.15.45:0/4006924467 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f86a80a12e0 0x7f86a80a37f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f86b400b2e0 tx=0x7f86b401a040 comp rx=0 tx=0).stop 2024-05-10T03:40:54.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.518+0000 7f86c585f700 1 -- 172.21.15.45:0/4006924467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86c0101be0 msgr2=0x7f86c0198060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.518+0000 7f86c585f700 1 --2- 172.21.15.45:0/4006924467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86c0101be0 0x7f86c0198060 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f86b000e940 tx=0x7f86b000ec50 comp rx=0 tx=0).stop 2024-05-10T03:40:54.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.518+0000 7f86c585f700 1 -- 172.21.15.45:0/4006924467 shutdown_connections 2024-05-10T03:40:54.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.518+0000 7f86c585f700 1 --2- 172.21.15.45:0/4006924467 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f86a80a12e0 0x7f86a80a37f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.518+0000 7f86c585f700 1 --2- 172.21.15.45:0/4006924467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86c01036a0 0x7f86c019f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.518+0000 7f86c585f700 1 --2- 172.21.15.45:0/4006924467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86c0101be0 0x7f86c0198060 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.518+0000 7f86c585f700 1 --2- 172.21.15.45:0/4006924467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86c0102d00 0x7f86c01985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.518+0000 7f86c585f700 1 -- 172.21.15.45:0/4006924467 >> 172.21.15.45:0/4006924467 conn(0x7f86c00fd210 msgr2=0x7f86c0105f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:54.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.518+0000 7f86c585f700 1 -- 172.21.15.45:0/4006924467 shutdown_connections 2024-05-10T03:40:54.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.518+0000 7f86c585f700 1 -- 172.21.15.45:0/4006924467 wait complete. 2024-05-10T03:40:54.535 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-05-10T03:40:54.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.683+0000 7f341570a700 1 -- 172.21.15.45:0/2128788747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3410105030 msgr2=0x7f3410107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.683+0000 7f341570a700 1 --2- 172.21.15.45:0/2128788747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3410105030 0x7f3410107450 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3404009990 tx=0x7f3404009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.683+0000 7f341570a700 1 -- 172.21.15.45:0/2128788747 shutdown_connections 2024-05-10T03:40:54.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.683+0000 7f341570a700 1 --2- 172.21.15.45:0/2128788747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3410107990 0x7f3410109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.683+0000 7f341570a700 1 --2- 172.21.15.45:0/2128788747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34101026d0 0x7f3410104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.683+0000 7f341570a700 1 --2- 172.21.15.45:0/2128788747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3410105030 0x7f3410107450 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.683+0000 7f341570a700 1 -- 172.21.15.45:0/2128788747 >> 172.21.15.45:0/2128788747 conn(0x7f34100fc110 msgr2=0x7f34100fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:54.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.683+0000 7f341570a700 1 -- 172.21.15.45:0/2128788747 shutdown_connections 2024-05-10T03:40:54.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.683+0000 7f341570a700 1 -- 172.21.15.45:0/2128788747 wait complete. 2024-05-10T03:40:54.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.684+0000 7f341570a700 1 Processor -- start 2024-05-10T03:40:54.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.684+0000 7f341570a700 1 -- start start 2024-05-10T03:40:54.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.685+0000 7f341570a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34101026d0 0x7f3410198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.685+0000 7f341570a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3410105030 0x7f3410198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.685+0000 7f341570a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3410107990 0x7f341019f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.685+0000 7f341570a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341019fb00 con 0x7f3410105030 2024-05-10T03:40:54.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.685+0000 7f341570a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341019fc70 con 0x7f34101026d0 2024-05-10T03:40:54.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.685+0000 7f341570a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341019fe30 con 0x7f3410107990 2024-05-10T03:40:54.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.685+0000 7f340e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3410105030 0x7f3410198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.685+0000 7f340e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3410105030 0x7f3410198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60236/0 (socket says 172.21.15.45:60236) 2024-05-10T03:40:54.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.685+0000 7f340effd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34101026d0 0x7f3410198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.685+0000 7f340e7fc700 1 -- 172.21.15.45:0/3759035981 learned_addr learned my addr 172.21.15.45:0/3759035981 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:54.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.685+0000 7f340f7fe700 1 --2- 172.21.15.45:0/3759035981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3410107990 0x7f341019f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.685+0000 7f340e7fc700 1 -- 172.21.15.45:0/3759035981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3410107990 msgr2=0x7f341019f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.685+0000 7f340e7fc700 1 --2- 172.21.15.45:0/3759035981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3410107990 0x7f341019f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.685+0000 7f340e7fc700 1 -- 172.21.15.45:0/3759035981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34101026d0 msgr2=0x7f3410198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.685+0000 7f340e7fc700 1 --2- 172.21.15.45:0/3759035981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34101026d0 0x7f3410198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.685+0000 7f340e7fc700 1 -- 172.21.15.45:0/3759035981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34040095f0 con 0x7f3410105030 2024-05-10T03:40:54.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.685+0000 7f340effd700 1 --2- 172.21.15.45:0/3759035981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34101026d0 0x7f3410198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:40:54.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.685+0000 7f340e7fc700 1 --2- 172.21.15.45:0/3759035981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3410105030 0x7f3410198560 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f34040095c0 tx=0x7f340400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:54.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.686+0000 7f33f7fff700 1 -- 172.21.15.45:0/3759035981 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340401d070 con 0x7f3410105030 2024-05-10T03:40:54.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.686+0000 7f341570a700 1 -- 172.21.15.45:0/3759035981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34101a00b0 con 0x7f3410105030 2024-05-10T03:40:54.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.686+0000 7f33f7fff700 1 -- 172.21.15.45:0/3759035981 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3404003680 con 0x7f3410105030 2024-05-10T03:40:54.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.686+0000 7f33f7fff700 1 -- 172.21.15.45:0/3759035981 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3404004ae0 con 0x7f3410105030 2024-05-10T03:40:54.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.686+0000 7f341570a700 1 -- 172.21.15.45:0/3759035981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34101a0530 con 0x7f3410105030 2024-05-10T03:40:54.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.688+0000 7f33f7fff700 1 -- 172.21.15.45:0/3759035981 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f3404004c40 con 0x7f3410105030 2024-05-10T03:40:54.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.689+0000 7f33f7fff700 1 --2- 172.21.15.45:0/3759035981 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f33f80a1260 0x7f33f80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.689+0000 7f33f7fff700 1 -- 172.21.15.45:0/3759035981 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f34040cdc20 con 0x7f3410105030 2024-05-10T03:40:54.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.689+0000 7f340effd700 1 --2- 172.21.15.45:0/3759035981 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f33f80a1260 0x7f33f80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.690+0000 7f3425a4eb80 1 Processor -- start 2024-05-10T03:40:54.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.690+0000 7f3425a4eb80 1 -- start start 2024-05-10T03:40:54.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.690+0000 7f340effd700 1 --2- 172.21.15.45:0/3759035981 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f33f80a1260 0x7f33f80a3770 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3400005950 tx=0x7f340000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:54.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.690+0000 7f3425a4eb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5570c9b7dab0 0x5570c9b7df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.690+0000 7f3425a4eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570c9b7e980 0x5570c9b7ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.690+0000 7f3425a4eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7f2d0 0x5570c9b85bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.690+0000 7f3425a4eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c9aa0150 con 0x5570c9b7f2d0 2024-05-10T03:40:54.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.690+0000 7f3425a4eb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c9a9db10 con 0x5570c9b7dab0 2024-05-10T03:40:54.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.690+0000 7f3425a4eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c9a99400 con 0x5570c9b7e980 2024-05-10T03:40:54.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.690+0000 7f340f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7f2d0 0x5570c9b85bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.690+0000 7f340f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7f2d0 0x5570c9b85bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60250/0 (socket says 172.21.15.45:60250) 2024-05-10T03:40:54.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.690+0000 7f340f7fe700 1 -- 172.21.15.45:0/3750080683 learned_addr learned my addr 172.21.15.45:0/3750080683 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:54.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.690+0000 7f340e7fc700 1 --2- 172.21.15.45:0/3750080683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570c9b7e980 0x5570c9b7ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.690+0000 7f340effd700 1 --2- 172.21.15.45:0/3750080683 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5570c9b7dab0 0x5570c9b7df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.691+0000 7f340f7fe700 1 -- 172.21.15.45:0/3750080683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570c9b7e980 msgr2=0x5570c9b7ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:54.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.691+0000 7f340f7fe700 1 --2- 172.21.15.45:0/3750080683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570c9b7e980 0x5570c9b7ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.691+0000 7f340f7fe700 1 -- 172.21.15.45:0/3750080683 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5570c9b7dab0 msgr2=0x5570c9b7df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:54.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.691+0000 7f340f7fe700 1 --2- 172.21.15.45:0/3750080683 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5570c9b7dab0 0x5570c9b7df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.691+0000 7f340f7fe700 1 -- 172.21.15.45:0/3750080683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5570c991a3b0 con 0x5570c9b7f2d0 2024-05-10T03:40:54.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.691+0000 7f340f7fe700 1 --2- 172.21.15.45:0/3750080683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7f2d0 0x5570c9b85bd0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f3408003f20 tx=0x7f3408009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3faca581c09a2231 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:54.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.691+0000 7f33f57fa700 1 -- 172.21.15.45:0/3750080683 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408019070 con 0x5570c9b7f2d0 2024-05-10T03:40:54.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.691+0000 7f33f57fa700 1 -- 172.21.15.45:0/3750080683 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f340800f040 con 0x5570c9b7f2d0 2024-05-10T03:40:54.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.691+0000 7f33f57fa700 1 -- 172.21.15.45:0/3750080683 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408007a90 con 0x5570c9b7f2d0 2024-05-10T03:40:54.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.692+0000 7f3425a4eb80 1 -- 172.21.15.45:0/3750080683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7f2d0 msgr2=0x5570c9b85bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.692+0000 7f3425a4eb80 1 --2- 172.21.15.45:0/3750080683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7f2d0 0x5570c9b85bd0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f3408003f20 tx=0x7f3408009ba0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.692+0000 7f3425a4eb80 1 -- 172.21.15.45:0/3750080683 shutdown_connections 2024-05-10T03:40:54.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.692+0000 7f3425a4eb80 1 --2- 172.21.15.45:0/3750080683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7f2d0 0x5570c9b85bd0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.692+0000 7f3425a4eb80 1 --2- 172.21.15.45:0/3750080683 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5570c9b7dab0 0x5570c9b7df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.692+0000 7f3425a4eb80 1 --2- 172.21.15.45:0/3750080683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570c9b7e980 0x5570c9b7ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.692+0000 7f3425a4eb80 1 -- 172.21.15.45:0/3750080683 >> 172.21.15.45:0/3750080683 conn(0x5570c9adba60 msgr2=0x5570c9b73fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:54.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.692+0000 7f3425a4eb80 1 -- 172.21.15.45:0/3750080683 shutdown_connections 2024-05-10T03:40:54.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.692+0000 7f3425a4eb80 1 -- 172.21.15.45:0/3750080683 wait complete. 2024-05-10T03:40:54.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.692+0000 7f3425a4eb80 1 -- start start 2024-05-10T03:40:54.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.693+0000 7f3425a4eb80 1 Processor -- start 2024-05-10T03:40:54.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.693+0000 7f3425a4eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570c9b7dab0 0x5570c9b87ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.693+0000 7f3425a4eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7e980 0x5570c9b87ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.693+0000 7f3425a4eb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5570c9b7f2d0 0x5570c9b8ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.693+0000 7f3425a4eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c9a35560 con 0x5570c9b7e980 2024-05-10T03:40:54.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.693+0000 7f3425a4eb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c9a35200 con 0x5570c9b7f2d0 2024-05-10T03:40:54.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.693+0000 7f3425a4eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c991c6a0 con 0x5570c9b7dab0 2024-05-10T03:40:54.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.693+0000 7f3425a4eb80 10 client.0 _ll_register_callbacks cb 0x5570c9a3eb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:54.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.693+0000 7f340e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7e980 0x5570c9b87ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.693+0000 7f340effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570c9b7dab0 0x5570c9b87ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.693+0000 7f340e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7e980 0x5570c9b87ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60254/0 (socket says 172.21.15.45:60254) 2024-05-10T03:40:54.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.693+0000 7f340effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570c9b7dab0 0x5570c9b87ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:53606/0 (socket says 172.21.15.45:53606) 2024-05-10T03:40:54.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.693+0000 7f340e7fc700 1 -- 172.21.15.45:0/910375709 learned_addr learned my addr 172.21.15.45:0/910375709 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:54.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.693+0000 7f340f7fe700 1 --2- 172.21.15.45:0/910375709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5570c9b7f2d0 0x5570c9b8ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.693+0000 7f340e7fc700 1 -- 172.21.15.45:0/910375709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570c9b7dab0 msgr2=0x5570c9b87ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:54.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.693+0000 7f340e7fc700 1 --2- 172.21.15.45:0/910375709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570c9b7dab0 0x5570c9b87ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.693+0000 7f340e7fc700 1 -- 172.21.15.45:0/910375709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5570c9b7f2d0 msgr2=0x5570c9b8ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:54.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.693+0000 7f340e7fc700 1 --2- 172.21.15.45:0/910375709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5570c9b7f2d0 0x5570c9b8ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.693+0000 7f340e7fc700 1 -- 172.21.15.45:0/910375709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3408003b50 con 0x5570c9b7e980 2024-05-10T03:40:54.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.693+0000 7f340f7fe700 1 --2- 172.21.15.45:0/910375709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5570c9b7f2d0 0x5570c9b8ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:54.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.693+0000 7f340effd700 1 --2- 172.21.15.45:0/910375709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570c9b7dab0 0x5570c9b87ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:40:54.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.694+0000 7f340e7fc700 1 --2- 172.21.15.45:0/910375709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7e980 0x5570c9b87ff0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f34040058b0 tx=0x7f34040055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36e941673c1173f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:54.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.694+0000 7f33f2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:54.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.694+0000 7f33f2ff5700 1 -- 172.21.15.45:0/910375709 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340409b000 con 0x5570c9b7e980 2024-05-10T03:40:54.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.694+0000 7f33f2ff5700 1 -- 172.21.15.45:0/910375709 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f340409e9d0 con 0x5570c9b7e980 2024-05-10T03:40:54.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.694+0000 7f3425a4eb80 1 -- 172.21.15.45:0/910375709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5570c99f2270 con 0x5570c9b7e980 2024-05-10T03:40:54.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.694+0000 7f33f2ff5700 1 -- 172.21.15.45:0/910375709 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34040a2f90 con 0x5570c9b7e980 2024-05-10T03:40:54.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.694+0000 7f3425a4eb80 10 client.15783 fetch_fsmap learned FSMap version 28 2024-05-10T03:40:54.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.694+0000 7f3425a4eb80 1 -- 172.21.15.45:0/910375709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5570c98c6b60 con 0x5570c9b7e980 2024-05-10T03:40:54.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.694+0000 7f33f2ff5700 1 -- 172.21.15.45:0/910375709 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x5570c99f2270 con 0x5570c9b7e980 2024-05-10T03:40:54.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.694+0000 7f33f2ff5700 1 -- 172.21.15.45:0/910375709 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f34040b3200 con 0x5570c9b7e980 2024-05-10T03:40:54.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.694+0000 7f3425a4eb80 10 client.15783 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:40:54.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.694+0000 7f3425a4eb80 10 client.15783 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-05-10T03:40:54.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.694+0000 7f3425a4eb80 20 client.15783 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:54.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.695+0000 7f3425a4eb80 1 --2- 172.21.15.45:0/910375709 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x5570c9b93380 0x5570c9b957d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.695+0000 7f3425a4eb80 4 client.15783 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:40:54.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.695+0000 7f3425a4eb80 1 -- 172.21.15.45:0/910375709 --> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5570c9b48780 con 0x5570c9b93380 2024-05-10T03:40:54.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.695+0000 7f340effd700 1 --2- 172.21.15.45:0/910375709 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x5570c9b93380 0x5570c9b957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.695+0000 7f340effd700 1 --2- 172.21.15.45:0/910375709 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x5570c9b93380 0x5570c9b957d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8ec923cb337797af server_cookie=1f494dbb8df80e17 in_seq=0 out_seq=0 2024-05-10T03:40:54.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.695+0000 7f33f2ff5700 10 client.15783 ms_handle_connect on v2:172.21.15.154:6836/608167481 2024-05-10T03:40:54.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.696+0000 7f33f2ff5700 1 -- 172.21.15.45:0/910375709 <== mds.3 v2:172.21.15.154:6836/608167481 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5570c9b48780 con 0x5570c9b93380 2024-05-10T03:40:54.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.696+0000 7f33f2ff5700 10 client.15783 handle_command_reply: tid=0 2024-05-10T03:40:54.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.696+0000 7f3425a4eb80 1 client.15783 shutdown 2024-05-10T03:40:54.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.696+0000 7f3425a4eb80 1 -- 172.21.15.45:0/910375709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7e980 msgr2=0x5570c9b87ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.696+0000 7f3425a4eb80 1 --2- 172.21.15.45:0/910375709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7e980 0x5570c9b87ff0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f34040058b0 tx=0x7f34040055a0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.696+0000 7f3425a4eb80 1 -- 172.21.15.45:0/910375709 shutdown_connections 2024-05-10T03:40:54.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.696+0000 7f3425a4eb80 1 --2- 172.21.15.45:0/910375709 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x5570c9b93380 0x5570c9b957d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.696+0000 7f3425a4eb80 1 --2- 172.21.15.45:0/910375709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570c9b7dab0 0x5570c9b87ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.696+0000 7f3425a4eb80 1 --2- 172.21.15.45:0/910375709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5570c9b7f2d0 0x5570c9b8ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.696+0000 7f33f2ff5700 0 client.15783 ms_handle_reset on v2:172.21.15.154:6836/608167481 2024-05-10T03:40:54.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.696+0000 7f3425a4eb80 1 --2- 172.21.15.45:0/910375709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7e980 0x5570c9b87ff0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.696+0000 7f3425a4eb80 1 -- 172.21.15.45:0/910375709 >> 172.21.15.45:0/910375709 conn(0x5570c9adba60 msgr2=0x5570c9b73fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:54.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.696+0000 7f3425a4eb80 1 -- 172.21.15.45:0/910375709 shutdown_connections 2024-05-10T03:40:54.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.696+0000 7f3425a4eb80 1 -- 172.21.15.45:0/910375709 wait complete. 2024-05-10T03:40:54.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.696+0000 7f3425a4eb80 20 client.15783 trim_cache size 0 max 16384 2024-05-10T03:40:54.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.710+0000 7f3425a4eb80 1 Processor -- start 2024-05-10T03:40:54.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.710+0000 7f3425a4eb80 1 -- start start 2024-05-10T03:40:54.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.710+0000 7f3425a4eb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5570c9b7dab0 0x5570c9b7ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.711+0000 7f3425a4eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7e980 0x5570c9b8ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.711+0000 7f3425a4eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570c9b7f2d0 0x5570c9b87020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.711+0000 7f3425a4eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c9b75770 con 0x5570c9b7e980 2024-05-10T03:40:54.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.711+0000 7f3425a4eb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c9b6e7c0 con 0x5570c9b7dab0 2024-05-10T03:40:54.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.711+0000 7f3425a4eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c9b886b0 con 0x5570c9b7f2d0 2024-05-10T03:40:54.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.711+0000 7f340e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7e980 0x5570c9b8ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.711+0000 7f340e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7e980 0x5570c9b8ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60258/0 (socket says 172.21.15.45:60258) 2024-05-10T03:40:54.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.711+0000 7f340e7fc700 1 -- 172.21.15.45:0/1300984833 learned_addr learned my addr 172.21.15.45:0/1300984833 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:54.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.711+0000 7f340effd700 1 --2- 172.21.15.45:0/1300984833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5570c9b7dab0 0x5570c9b7ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.711+0000 7f340f7fe700 1 --2- 172.21.15.45:0/1300984833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570c9b7f2d0 0x5570c9b87020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.711+0000 7f340e7fc700 1 -- 172.21.15.45:0/1300984833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570c9b7f2d0 msgr2=0x5570c9b87020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:54.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.711+0000 7f340e7fc700 1 --2- 172.21.15.45:0/1300984833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570c9b7f2d0 0x5570c9b87020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.711+0000 7f340e7fc700 1 -- 172.21.15.45:0/1300984833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5570c9b7dab0 msgr2=0x5570c9b7ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:54.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.711+0000 7f340e7fc700 1 --2- 172.21.15.45:0/1300984833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5570c9b7dab0 0x5570c9b7ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.711+0000 7f340e7fc700 1 -- 172.21.15.45:0/1300984833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5570c9a5f560 con 0x5570c9b7e980 2024-05-10T03:40:54.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.711+0000 7f340f7fe700 1 --2- 172.21.15.45:0/1300984833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570c9b7f2d0 0x5570c9b87020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:54.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.711+0000 7f340e7fc700 1 --2- 172.21.15.45:0/1300984833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7e980 0x5570c9b8ef10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f34040970a0 tx=0x7f3404009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6b11f29525fde1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:54.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.711+0000 7f33f5ffb700 1 -- 172.21.15.45:0/1300984833 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3404096ee0 con 0x5570c9b7e980 2024-05-10T03:40:54.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.711+0000 7f33f5ffb700 1 -- 172.21.15.45:0/1300984833 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f340409e9d0 con 0x5570c9b7e980 2024-05-10T03:40:54.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.711+0000 7f33f5ffb700 1 -- 172.21.15.45:0/1300984833 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340409a2f0 con 0x5570c9b7e980 2024-05-10T03:40:54.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.712+0000 7f3425a4eb80 1 -- 172.21.15.45:0/1300984833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7e980 msgr2=0x5570c9b8ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.712+0000 7f3425a4eb80 1 --2- 172.21.15.45:0/1300984833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7e980 0x5570c9b8ef10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f34040970a0 tx=0x7f3404009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.712+0000 7f3425a4eb80 1 -- 172.21.15.45:0/1300984833 shutdown_connections 2024-05-10T03:40:54.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.712+0000 7f3425a4eb80 1 --2- 172.21.15.45:0/1300984833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570c9b7f2d0 0x5570c9b87020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.712+0000 7f3425a4eb80 1 --2- 172.21.15.45:0/1300984833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5570c9b7dab0 0x5570c9b7ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.712+0000 7f3425a4eb80 1 --2- 172.21.15.45:0/1300984833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7e980 0x5570c9b8ef10 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.712+0000 7f3425a4eb80 1 -- 172.21.15.45:0/1300984833 >> 172.21.15.45:0/1300984833 conn(0x5570c9adba60 msgr2=0x5570c9b70180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:54.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.712+0000 7f3425a4eb80 1 -- 172.21.15.45:0/1300984833 shutdown_connections 2024-05-10T03:40:54.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.712+0000 7f3425a4eb80 1 -- 172.21.15.45:0/1300984833 wait complete. 2024-05-10T03:40:54.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.713+0000 7f3425a4eb80 1 -- start start 2024-05-10T03:40:54.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.713+0000 7f3425a4eb80 1 Processor -- start 2024-05-10T03:40:54.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.713+0000 7f3425a4eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7dab0 0x5570c9b8bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.713+0000 7f3425a4eb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5570c9b7e980 0x5570c9b8c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.713+0000 7f3425a4eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570c9b7f2d0 0x5570c9be7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.713+0000 7f3425a4eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c9b8f060 con 0x5570c9b7dab0 2024-05-10T03:40:54.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.713+0000 7f3425a4eb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c9b8f1d0 con 0x5570c9b7e980 2024-05-10T03:40:54.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.713+0000 7f3425a4eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570c9be7d60 con 0x5570c9b7f2d0 2024-05-10T03:40:54.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.713+0000 7f3425a4eb80 10 client.0 _ll_register_callbacks cb 0x5570c9a3eb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:54.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.713+0000 7f340effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7dab0 0x5570c9b8bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.713+0000 7f340effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7dab0 0x5570c9b8bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60262/0 (socket says 172.21.15.45:60262) 2024-05-10T03:40:54.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.713+0000 7f340effd700 1 -- 172.21.15.45:0/2334201575 learned_addr learned my addr 172.21.15.45:0/2334201575 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:54.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.713+0000 7f340e7fc700 1 --2- 172.21.15.45:0/2334201575 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5570c9b7e980 0x5570c9b8c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.713+0000 7f340f7fe700 1 --2- 172.21.15.45:0/2334201575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570c9b7f2d0 0x5570c9be7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.713+0000 7f340effd700 1 -- 172.21.15.45:0/2334201575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570c9b7f2d0 msgr2=0x5570c9be7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:54.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.713+0000 7f340effd700 1 --2- 172.21.15.45:0/2334201575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570c9b7f2d0 0x5570c9be7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.713+0000 7f340effd700 1 -- 172.21.15.45:0/2334201575 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5570c9b7e980 msgr2=0x5570c9b8c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:54.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.713+0000 7f340effd700 1 --2- 172.21.15.45:0/2334201575 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5570c9b7e980 0x5570c9b8c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.713+0000 7f340effd700 1 -- 172.21.15.45:0/2334201575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5570c98c6b60 con 0x5570c9b7dab0 2024-05-10T03:40:54.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.713+0000 7f340f7fe700 1 --2- 172.21.15.45:0/2334201575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570c9b7f2d0 0x5570c9be7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:54.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.714+0000 7f340effd700 1 --2- 172.21.15.45:0/2334201575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7dab0 0x5570c9b8bc30 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x5570c9b96070 tx=0x7f34000047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939332cefb91d1f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:54.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.714+0000 7f33f2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:54.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.714+0000 7f33f2ff5700 1 -- 172.21.15.45:0/2334201575 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400024040 con 0x5570c9b7dab0 2024-05-10T03:40:54.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.714+0000 7f33f2ff5700 1 -- 172.21.15.45:0/2334201575 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3400017070 con 0x5570c9b7dab0 2024-05-10T03:40:54.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.714+0000 7f3425a4eb80 1 -- 172.21.15.45:0/2334201575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f340800f040 con 0x5570c9b7dab0 2024-05-10T03:40:54.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.714+0000 7f33f2ff5700 1 -- 172.21.15.45:0/2334201575 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34000297a0 con 0x5570c9b7dab0 2024-05-10T03:40:54.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.714+0000 7f3425a4eb80 10 client.15789 fetch_fsmap learned FSMap version 28 2024-05-10T03:40:54.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.714+0000 7f3425a4eb80 1 -- 172.21.15.45:0/2334201575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5570c991ecd0 con 0x5570c9b7dab0 2024-05-10T03:40:54.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.714+0000 7f33f2ff5700 1 -- 172.21.15.45:0/2334201575 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f340800f040 con 0x5570c9b7dab0 2024-05-10T03:40:54.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.714+0000 7f33f2ff5700 1 -- 172.21.15.45:0/2334201575 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f3400005490 con 0x5570c9b7dab0 2024-05-10T03:40:54.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.715+0000 7f3425a4eb80 10 client.15789 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:40:54.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.715+0000 7f3425a4eb80 10 client.15789 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-05-10T03:40:54.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.715+0000 7f3425a4eb80 20 client.15789 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:54.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.715+0000 7f3425a4eb80 1 --2- 172.21.15.45:0/2334201575 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x5570c9be9620 0x5570c9beba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.715+0000 7f3425a4eb80 4 client.15789 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-10T03:40:54.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.715+0000 7f3425a4eb80 1 -- 172.21.15.45:0/2334201575 --> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5570c9a91ec0 con 0x5570c9be9620 2024-05-10T03:40:54.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.715+0000 7f340e7fc700 1 --2- 172.21.15.45:0/2334201575 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x5570c9be9620 0x5570c9beba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.715+0000 7f340e7fc700 1 --2- 172.21.15.45:0/2334201575 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x5570c9be9620 0x5570c9beba40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2d768edbcf609187 server_cookie=5ec0ea1f9b93750b in_seq=0 out_seq=0 2024-05-10T03:40:54.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.715+0000 7f33f2ff5700 10 client.15789 ms_handle_connect on v2:172.21.15.154:6836/608167481 2024-05-10T03:40:54.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.715+0000 7f33f2ff5700 1 -- 172.21.15.45:0/2334201575 <== mds.3 v2:172.21.15.154:6836/608167481 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5570c9a91ec0 con 0x5570c9be9620 2024-05-10T03:40:54.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.715+0000 7f33f2ff5700 10 client.15789 handle_command_reply: tid=0 2024-05-10T03:40:54.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.716+0000 7f3425a4eb80 1 client.15789 shutdown 2024-05-10T03:40:54.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.716+0000 7f3425a4eb80 1 -- 172.21.15.45:0/2334201575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7dab0 msgr2=0x5570c9b8bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.716+0000 7f3425a4eb80 1 --2- 172.21.15.45:0/2334201575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7dab0 0x5570c9b8bc30 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x5570c9b96070 tx=0x7f34000047c0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.716+0000 7f3425a4eb80 1 -- 172.21.15.45:0/2334201575 shutdown_connections 2024-05-10T03:40:54.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.716+0000 7f3425a4eb80 1 --2- 172.21.15.45:0/2334201575 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x5570c9be9620 0x5570c9beba40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.716+0000 7f3425a4eb80 1 --2- 172.21.15.45:0/2334201575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5570c9b7f2d0 0x5570c9be7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.716+0000 7f3425a4eb80 1 --2- 172.21.15.45:0/2334201575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5570c9b7dab0 0x5570c9b8bc30 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.716+0000 7f3425a4eb80 1 --2- 172.21.15.45:0/2334201575 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5570c9b7e980 0x5570c9b8c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.716+0000 7f33f2ff5700 0 client.15789 ms_handle_reset on v2:172.21.15.154:6836/608167481 2024-05-10T03:40:54.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.716+0000 7f3425a4eb80 1 -- 172.21.15.45:0/2334201575 >> 172.21.15.45:0/2334201575 conn(0x5570c9adba60 msgr2=0x5570c9b70180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:54.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.716+0000 7f3425a4eb80 1 -- 172.21.15.45:0/2334201575 shutdown_connections 2024-05-10T03:40:54.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.716+0000 7f3425a4eb80 1 -- 172.21.15.45:0/2334201575 wait complete. 2024-05-10T03:40:54.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.716+0000 7f3425a4eb80 20 client.15789 trim_cache size 0 max 16384 2024-05-10T03:40:54.725 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-05-10T03:40:54.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.716+0000 7f341570a700 1 -- 172.21.15.45:0/3759035981 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f33f80a1260 msgr2=0x7f33f80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.716+0000 7f341570a700 1 --2- 172.21.15.45:0/3759035981 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f33f80a1260 0x7f33f80a3770 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3400005950 tx=0x7f340000b410 comp rx=0 tx=0).stop 2024-05-10T03:40:54.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.716+0000 7f341570a700 1 -- 172.21.15.45:0/3759035981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3410105030 msgr2=0x7f3410198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.716+0000 7f341570a700 1 --2- 172.21.15.45:0/3759035981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3410105030 0x7f3410198560 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f34040095c0 tx=0x7f340400f690 comp rx=0 tx=0).stop 2024-05-10T03:40:54.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.717+0000 7f341570a700 1 -- 172.21.15.45:0/3759035981 shutdown_connections 2024-05-10T03:40:54.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.717+0000 7f341570a700 1 --2- 172.21.15.45:0/3759035981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3410107990 0x7f341019f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.717+0000 7f341570a700 1 --2- 172.21.15.45:0/3759035981 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f33f80a1260 0x7f33f80a3770 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.717+0000 7f341570a700 1 --2- 172.21.15.45:0/3759035981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34101026d0 0x7f3410198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.717+0000 7f341570a700 1 --2- 172.21.15.45:0/3759035981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3410105030 0x7f3410198560 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.717+0000 7f341570a700 1 -- 172.21.15.45:0/3759035981 >> 172.21.15.45:0/3759035981 conn(0x7f34100fc110 msgr2=0x7f3410103160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:54.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.717+0000 7f341570a700 1 -- 172.21.15.45:0/3759035981 shutdown_connections 2024-05-10T03:40:54.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.717+0000 7f341570a700 1 -- 172.21.15.45:0/3759035981 wait complete. 2024-05-10T03:40:54.733 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-10T03:40:54.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.882+0000 7fab28312700 1 -- 172.21.15.45:0/1522307610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab20100ac0 msgr2=0x7fab20100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.882+0000 7fab28312700 1 --2- 172.21.15.45:0/1522307610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab20100ac0 0x7fab20100ed0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fab1c009990 tx=0x7fab1c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.882+0000 7fab28312700 1 -- 172.21.15.45:0/1522307610 shutdown_connections 2024-05-10T03:40:54.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.882+0000 7fab28312700 1 --2- 172.21.15.45:0/1522307610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab20102580 0x7fab20108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.882+0000 7fab28312700 1 --2- 172.21.15.45:0/1522307610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab20100ac0 0x7fab20100ed0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.882+0000 7fab28312700 1 --2- 172.21.15.45:0/1522307610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab20101be0 0x7fab20101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.882+0000 7fab28312700 1 -- 172.21.15.45:0/1522307610 >> 172.21.15.45:0/1522307610 conn(0x7fab200fc0d0 msgr2=0x7fab200fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:54.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.882+0000 7fab28312700 1 -- 172.21.15.45:0/1522307610 shutdown_connections 2024-05-10T03:40:54.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.882+0000 7fab28312700 1 -- 172.21.15.45:0/1522307610 wait complete. 2024-05-10T03:40:54.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.883+0000 7fab28312700 1 Processor -- start 2024-05-10T03:40:54.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.883+0000 7fab28312700 1 -- start start 2024-05-10T03:40:54.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.883+0000 7fab28312700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab20100ac0 0x7fab20198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.883+0000 7fab28312700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab20101be0 0x7fab20198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.883+0000 7fab28312700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab20102580 0x7fab2019f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.883+0000 7fab28312700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2019fad0 con 0x7fab20101be0 2024-05-10T03:40:54.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.883+0000 7fab28312700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2019fc40 con 0x7fab20102580 2024-05-10T03:40:54.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.883+0000 7fab28312700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2019fe00 con 0x7fab20100ac0 2024-05-10T03:40:54.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.883+0000 7fab258ad700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab20101be0 0x7fab20198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.883+0000 7fab258ad700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab20101be0 0x7fab20198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60274/0 (socket says 172.21.15.45:60274) 2024-05-10T03:40:54.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.883+0000 7fab258ad700 1 -- 172.21.15.45:0/668150461 learned_addr learned my addr 172.21.15.45:0/668150461 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:54.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.883+0000 7fab260ae700 1 --2- 172.21.15.45:0/668150461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab20100ac0 0x7fab20198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.883+0000 7fab268af700 1 --2- 172.21.15.45:0/668150461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab20102580 0x7fab2019f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.883+0000 7fab258ad700 1 -- 172.21.15.45:0/668150461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab20100ac0 msgr2=0x7fab20198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.883+0000 7fab258ad700 1 --2- 172.21.15.45:0/668150461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab20100ac0 0x7fab20198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.883+0000 7fab258ad700 1 -- 172.21.15.45:0/668150461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab20102580 msgr2=0x7fab2019f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.883+0000 7fab258ad700 1 --2- 172.21.15.45:0/668150461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab20102580 0x7fab2019f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.883+0000 7fab258ad700 1 -- 172.21.15.45:0/668150461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c0095f0 con 0x7fab20101be0 2024-05-10T03:40:54.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.883+0000 7fab260ae700 1 --2- 172.21.15.45:0/668150461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab20100ac0 0x7fab20198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:54.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.883+0000 7fab268af700 1 --2- 172.21.15.45:0/668150461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab20102580 0x7fab2019f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:40:54.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.884+0000 7fab258ad700 1 --2- 172.21.15.45:0/668150461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab20101be0 0x7fab20198580 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fab1400d980 tx=0x7fab1400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:54.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.884+0000 7fab137fe700 1 -- 172.21.15.45:0/668150461 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1400bb60 con 0x7fab20101be0 2024-05-10T03:40:54.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.884+0000 7fab137fe700 1 -- 172.21.15.45:0/668150461 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fab14007640 con 0x7fab20101be0 2024-05-10T03:40:54.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.884+0000 7fab28312700 1 -- 172.21.15.45:0/668150461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab201a00e0 con 0x7fab20101be0 2024-05-10T03:40:54.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.884+0000 7fab137fe700 1 -- 172.21.15.45:0/668150461 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab14005020 con 0x7fab20101be0 2024-05-10T03:40:54.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.884+0000 7fab28312700 1 -- 172.21.15.45:0/668150461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab201a0640 con 0x7fab20101be0 2024-05-10T03:40:54.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.887+0000 7fab137fe700 1 -- 172.21.15.45:0/668150461 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fab14005180 con 0x7fab20101be0 2024-05-10T03:40:54.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.887+0000 7fab137fe700 1 --2- 172.21.15.45:0/668150461 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fab0c0a12e0 0x7fab0c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.887+0000 7fab137fe700 1 -- 172.21.15.45:0/668150461 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fab140ccc80 con 0x7fab20101be0 2024-05-10T03:40:54.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.887+0000 7fab260ae700 1 --2- 172.21.15.45:0/668150461 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fab0c0a12e0 0x7fab0c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.888+0000 7fab38656b80 1 Processor -- start 2024-05-10T03:40:54.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.888+0000 7fab38656b80 1 -- start start 2024-05-10T03:40:54.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.888+0000 7fab260ae700 1 --2- 172.21.15.45:0/668150461 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fab0c0a12e0 0x7fab0c0a37f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fab1c006010 tx=0x7fab1c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:54.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.888+0000 7fab38656b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563fce2156a0 0x563fce215af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.888+0000 7fab38656b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce216570 0x563fce216980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.888+0000 7fab38656b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563fce216ec0 0x563fce21d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.888+0000 7fab38656b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fce13c150 con 0x563fce216570 2024-05-10T03:40:54.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.888+0000 7fab38656b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fce139b10 con 0x563fce2156a0 2024-05-10T03:40:54.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.888+0000 7fab38656b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fce135400 con 0x563fce216ec0 2024-05-10T03:40:54.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.888+0000 7fab258ad700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce216570 0x563fce216980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.888+0000 7fab258ad700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce216570 0x563fce216980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60290/0 (socket says 172.21.15.45:60290) 2024-05-10T03:40:54.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.889+0000 7fab258ad700 1 -- 172.21.15.45:0/608748421 learned_addr learned my addr 172.21.15.45:0/608748421 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:54.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.889+0000 7fab260ae700 1 --2- 172.21.15.45:0/608748421 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563fce2156a0 0x563fce215af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.889+0000 7fab268af700 1 --2- 172.21.15.45:0/608748421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563fce216ec0 0x563fce21d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.889+0000 7fab258ad700 1 -- 172.21.15.45:0/608748421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563fce216ec0 msgr2=0x563fce21d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.889+0000 7fab258ad700 1 --2- 172.21.15.45:0/608748421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563fce216ec0 0x563fce21d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.889+0000 7fab258ad700 1 -- 172.21.15.45:0/608748421 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563fce2156a0 msgr2=0x563fce215af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.889+0000 7fab258ad700 1 --2- 172.21.15.45:0/608748421 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563fce2156a0 0x563fce215af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.889+0000 7fab258ad700 1 -- 172.21.15.45:0/608748421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fcdfb63b0 con 0x563fce216570 2024-05-10T03:40:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.889+0000 7fab260ae700 1 --2- 172.21.15.45:0/608748421 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563fce2156a0 0x563fce215af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.889+0000 7fab258ad700 1 --2- 172.21.15.45:0/608748421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce216570 0x563fce216980 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fab140998d0 tx=0x7fab14099630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=968f61536442429e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.889+0000 7fab10d7f700 1 -- 172.21.15.45:0/608748421 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab14099bd0 con 0x563fce216570 2024-05-10T03:40:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.889+0000 7fab10d7f700 1 -- 172.21.15.45:0/608748421 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fab1409da00 con 0x563fce216570 2024-05-10T03:40:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.889+0000 7fab10d7f700 1 -- 172.21.15.45:0/608748421 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1409ae00 con 0x563fce216570 2024-05-10T03:40:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.890+0000 7fab38656b80 1 -- 172.21.15.45:0/608748421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce216570 msgr2=0x563fce216980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.890+0000 7fab38656b80 1 --2- 172.21.15.45:0/608748421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce216570 0x563fce216980 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fab140998d0 tx=0x7fab14099630 comp rx=0 tx=0).stop 2024-05-10T03:40:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.890+0000 7fab38656b80 1 -- 172.21.15.45:0/608748421 shutdown_connections 2024-05-10T03:40:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.890+0000 7fab38656b80 1 --2- 172.21.15.45:0/608748421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563fce216ec0 0x563fce21d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.890+0000 7fab38656b80 1 --2- 172.21.15.45:0/608748421 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563fce2156a0 0x563fce215af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.890+0000 7fab38656b80 1 --2- 172.21.15.45:0/608748421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce216570 0x563fce216980 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.890+0000 7fab38656b80 1 -- 172.21.15.45:0/608748421 >> 172.21.15.45:0/608748421 conn(0x563fce177a60 msgr2=0x563fce20ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.890+0000 7fab38656b80 1 -- 172.21.15.45:0/608748421 shutdown_connections 2024-05-10T03:40:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.890+0000 7fab38656b80 1 -- 172.21.15.45:0/608748421 wait complete. 2024-05-10T03:40:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.891+0000 7fab38656b80 1 -- start start 2024-05-10T03:40:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.891+0000 7fab38656b80 1 Processor -- start 2024-05-10T03:40:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.891+0000 7fab38656b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563fce2156a0 0x563fce21f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.891+0000 7fab38656b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce216570 0x563fce21fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.891+0000 7fab38656b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563fce216ec0 0x563fce2269d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.891+0000 7fab38656b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fce0d1560 con 0x563fce216570 2024-05-10T03:40:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.891+0000 7fab38656b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fce0d1200 con 0x563fce2156a0 2024-05-10T03:40:54.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.891+0000 7fab38656b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fcdfb86a0 con 0x563fce216ec0 2024-05-10T03:40:54.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.891+0000 7fab38656b80 10 client.0 _ll_register_callbacks cb 0x563fce0dab30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:54.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.891+0000 7fab258ad700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce216570 0x563fce21fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.891+0000 7fab258ad700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce216570 0x563fce21fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60302/0 (socket says 172.21.15.45:60302) 2024-05-10T03:40:54.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.891+0000 7fab258ad700 1 -- 172.21.15.45:0/2591901578 learned_addr learned my addr 172.21.15.45:0/2591901578 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:54.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.891+0000 7fab268af700 1 --2- 172.21.15.45:0/2591901578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563fce216ec0 0x563fce2269d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.891+0000 7fab260ae700 1 --2- 172.21.15.45:0/2591901578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563fce2156a0 0x563fce21f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.892+0000 7fab258ad700 1 -- 172.21.15.45:0/2591901578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563fce216ec0 msgr2=0x563fce2269d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:54.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.892+0000 7fab258ad700 1 --2- 172.21.15.45:0/2591901578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563fce216ec0 0x563fce2269d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.892+0000 7fab258ad700 1 -- 172.21.15.45:0/2591901578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563fce2156a0 msgr2=0x563fce21f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:54.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.892+0000 7fab258ad700 1 --2- 172.21.15.45:0/2591901578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563fce2156a0 0x563fce21f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.892+0000 7fab258ad700 1 -- 172.21.15.45:0/2591901578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab201a0640 con 0x563fce216570 2024-05-10T03:40:54.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.892+0000 7fab258ad700 1 --2- 172.21.15.45:0/2591901578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce216570 0x563fce21fa70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fab14096640 tx=0x7fab14099ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e98f51f9db0de4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:54.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.892+0000 7fab09ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:54.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.892+0000 7fab09ffb700 1 -- 172.21.15.45:0/2591901578 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab140a2050 con 0x563fce216570 2024-05-10T03:40:54.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.892+0000 7fab09ffb700 1 -- 172.21.15.45:0/2591901578 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fab14099bd0 con 0x563fce216570 2024-05-10T03:40:54.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.892+0000 7fab38656b80 1 -- 172.21.15.45:0/2591901578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563fce08e270 con 0x563fce216570 2024-05-10T03:40:54.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.892+0000 7fab09ffb700 1 -- 172.21.15.45:0/2591901578 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab140992d0 con 0x563fce216570 2024-05-10T03:40:54.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.892+0000 7fab38656b80 10 client.15801 fetch_fsmap learned FSMap version 28 2024-05-10T03:40:54.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.892+0000 7fab38656b80 1 -- 172.21.15.45:0/2591901578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x563fcdf62b60 con 0x563fce216570 2024-05-10T03:40:54.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.892+0000 7fab09ffb700 1 -- 172.21.15.45:0/2591901578 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x563fce08e270 con 0x563fce216570 2024-05-10T03:40:54.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.893+0000 7fab09ffb700 1 -- 172.21.15.45:0/2591901578 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fab14005550 con 0x563fce216570 2024-05-10T03:40:54.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.893+0000 7fab38656b80 10 client.15801 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:40:54.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.893+0000 7fab38656b80 10 client.15801 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-10T03:40:54.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.893+0000 7fab38656b80 20 client.15801 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:54.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.893+0000 7fab38656b80 1 --2- 172.21.15.45:0/2591901578 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x563fce22ae60 0x563fce22d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.893+0000 7fab38656b80 4 client.15801 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:40:54.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.893+0000 7fab38656b80 1 -- 172.21.15.45:0/2591901578 --> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563fce1e4780 con 0x563fce22ae60 2024-05-10T03:40:54.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.893+0000 7fab260ae700 1 --2- 172.21.15.45:0/2591901578 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x563fce22ae60 0x563fce22d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.893+0000 7fab09ffb700 10 client.15801 ms_handle_connect on v2:172.21.15.154:6838/1506563336 2024-05-10T03:40:54.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.893+0000 7fab260ae700 1 --2- 172.21.15.45:0/2591901578 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x563fce22ae60 0x563fce22d2b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d1fce7351d6e5c34 server_cookie=d139d11590b7d7d1 in_seq=0 out_seq=0 2024-05-10T03:40:54.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.894+0000 7fab09ffb700 1 -- 172.21.15.45:0/2591901578 <== mds.2 v2:172.21.15.154:6838/1506563336 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563fce1e4780 con 0x563fce22ae60 2024-05-10T03:40:54.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.894+0000 7fab09ffb700 10 client.15801 handle_command_reply: tid=0 2024-05-10T03:40:54.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.894+0000 7fab38656b80 1 client.15801 shutdown 2024-05-10T03:40:54.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.894+0000 7fab38656b80 1 -- 172.21.15.45:0/2591901578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce216570 msgr2=0x563fce21fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.894+0000 7fab38656b80 1 --2- 172.21.15.45:0/2591901578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce216570 0x563fce21fa70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fab14096640 tx=0x7fab14099ad0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.894+0000 7fab38656b80 1 -- 172.21.15.45:0/2591901578 shutdown_connections 2024-05-10T03:40:54.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.894+0000 7fab38656b80 1 --2- 172.21.15.45:0/2591901578 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x563fce22ae60 0x563fce22d2b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.894+0000 7fab38656b80 1 --2- 172.21.15.45:0/2591901578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563fce216ec0 0x563fce2269d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.894+0000 7fab38656b80 1 --2- 172.21.15.45:0/2591901578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563fce2156a0 0x563fce21f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.894+0000 7fab38656b80 1 --2- 172.21.15.45:0/2591901578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce216570 0x563fce21fa70 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.894+0000 7fab38656b80 1 -- 172.21.15.45:0/2591901578 >> 172.21.15.45:0/2591901578 conn(0x563fce177a60 msgr2=0x563fce20ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:54.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.894+0000 7fab09ffb700 0 client.15801 ms_handle_reset on v2:172.21.15.154:6838/1506563336 2024-05-10T03:40:54.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.894+0000 7fab38656b80 1 -- 172.21.15.45:0/2591901578 shutdown_connections 2024-05-10T03:40:54.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.895+0000 7fab38656b80 1 -- 172.21.15.45:0/2591901578 wait complete. 2024-05-10T03:40:54.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.895+0000 7fab38656b80 20 client.15801 trim_cache size 0 max 16384 2024-05-10T03:40:54.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.909+0000 7fab38656b80 1 Processor -- start 2024-05-10T03:40:54.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.909+0000 7fab38656b80 1 -- start start 2024-05-10T03:40:54.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.909+0000 7fab38656b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563fce2156a0 0x563fce21eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.909+0000 7fab38656b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563fce216570 0x563fce226990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.909+0000 7fab38656b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce216ec0 0x563fce21f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.909+0000 7fab38656b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fce20a7c0 con 0x563fce216ec0 2024-05-10T03:40:54.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.909+0000 7fab38656b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fce2172d0 con 0x563fce2156a0 2024-05-10T03:40:54.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.909+0000 7fab38656b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fce211770 con 0x563fce216570 2024-05-10T03:40:54.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.909+0000 7fab268af700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce216ec0 0x563fce21f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.909+0000 7fab268af700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce216ec0 0x563fce21f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60306/0 (socket says 172.21.15.45:60306) 2024-05-10T03:40:54.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.909+0000 7fab268af700 1 -- 172.21.15.45:0/1879566129 learned_addr learned my addr 172.21.15.45:0/1879566129 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:54.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.909+0000 7fab258ad700 1 --2- 172.21.15.45:0/1879566129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563fce216570 0x563fce226990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.909+0000 7fab260ae700 1 --2- 172.21.15.45:0/1879566129 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563fce2156a0 0x563fce21eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.910+0000 7fab268af700 1 -- 172.21.15.45:0/1879566129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563fce216570 msgr2=0x563fce226990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:54.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.910+0000 7fab268af700 1 --2- 172.21.15.45:0/1879566129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563fce216570 0x563fce226990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.910+0000 7fab268af700 1 -- 172.21.15.45:0/1879566129 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563fce2156a0 msgr2=0x563fce21eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:54.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.910+0000 7fab268af700 1 --2- 172.21.15.45:0/1879566129 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563fce2156a0 0x563fce21eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.910+0000 7fab268af700 1 -- 172.21.15.45:0/1879566129 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fce0fb560 con 0x563fce216ec0 2024-05-10T03:40:54.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.910+0000 7fab260ae700 1 --2- 172.21.15.45:0/1879566129 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563fce2156a0 0x563fce21eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:54.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.910+0000 7fab268af700 1 --2- 172.21.15.45:0/1879566129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce216ec0 0x563fce21f510 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fab18009b30 tx=0x7fab18009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f1de25ea9b7245 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:54.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.910+0000 7fab11580700 1 -- 172.21.15.45:0/1879566129 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab18007ba0 con 0x563fce216ec0 2024-05-10T03:40:54.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.910+0000 7fab11580700 1 -- 172.21.15.45:0/1879566129 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fab18007d00 con 0x563fce216ec0 2024-05-10T03:40:54.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.910+0000 7fab11580700 1 -- 172.21.15.45:0/1879566129 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab18016750 con 0x563fce216ec0 2024-05-10T03:40:54.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.911+0000 7fab38656b80 1 -- 172.21.15.45:0/1879566129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce216ec0 msgr2=0x563fce21f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.911+0000 7fab38656b80 1 --2- 172.21.15.45:0/1879566129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce216ec0 0x563fce21f510 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fab18009b30 tx=0x7fab18009040 comp rx=0 tx=0).stop 2024-05-10T03:40:54.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.911+0000 7fab38656b80 1 -- 172.21.15.45:0/1879566129 shutdown_connections 2024-05-10T03:40:54.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.911+0000 7fab38656b80 1 --2- 172.21.15.45:0/1879566129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce216ec0 0x563fce21f510 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.911+0000 7fab38656b80 1 --2- 172.21.15.45:0/1879566129 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563fce2156a0 0x563fce21eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.911+0000 7fab38656b80 1 --2- 172.21.15.45:0/1879566129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563fce216570 0x563fce226990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.911+0000 7fab38656b80 1 -- 172.21.15.45:0/1879566129 >> 172.21.15.45:0/1879566129 conn(0x563fce177a60 msgr2=0x563fce210b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:54.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.911+0000 7fab38656b80 1 -- 172.21.15.45:0/1879566129 shutdown_connections 2024-05-10T03:40:54.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.911+0000 7fab38656b80 1 -- 172.21.15.45:0/1879566129 wait complete. 2024-05-10T03:40:54.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.911+0000 7fab38656b80 1 -- start start 2024-05-10T03:40:54.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.911+0000 7fab38656b80 1 Processor -- start 2024-05-10T03:40:54.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.912+0000 7fab38656b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce2156a0 0x563fce226a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.912+0000 7fab38656b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563fce216570 0x563fce2235b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.912+0000 7fab38656b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563fce216ec0 0x563fce223c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.912+0000 7fab38656b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fce27f300 con 0x563fce2156a0 2024-05-10T03:40:54.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.912+0000 7fab38656b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fce27f440 con 0x563fce216570 2024-05-10T03:40:54.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.912+0000 7fab38656b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fce27f5d0 con 0x563fce216ec0 2024-05-10T03:40:54.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.912+0000 7fab38656b80 10 client.0 _ll_register_callbacks cb 0x563fce0dab30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:54.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.912+0000 7fab260ae700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce2156a0 0x563fce226a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.912+0000 7fab260ae700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce2156a0 0x563fce226a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60318/0 (socket says 172.21.15.45:60318) 2024-05-10T03:40:54.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.912+0000 7fab260ae700 1 -- 172.21.15.45:0/2005455884 learned_addr learned my addr 172.21.15.45:0/2005455884 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:54.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.912+0000 7fab268af700 1 --2- 172.21.15.45:0/2005455884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563fce216ec0 0x563fce223c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.912+0000 7fab258ad700 1 --2- 172.21.15.45:0/2005455884 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563fce216570 0x563fce2235b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.912+0000 7fab260ae700 1 -- 172.21.15.45:0/2005455884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563fce216ec0 msgr2=0x563fce223c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:54.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.912+0000 7fab260ae700 1 --2- 172.21.15.45:0/2005455884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563fce216ec0 0x563fce223c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.912+0000 7fab260ae700 1 -- 172.21.15.45:0/2005455884 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563fce216570 msgr2=0x563fce2235b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.912+0000 7fab260ae700 1 --2- 172.21.15.45:0/2005455884 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563fce216570 0x563fce2235b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.912+0000 7fab260ae700 1 -- 172.21.15.45:0/2005455884 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab18011040 con 0x563fce2156a0 2024-05-10T03:40:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.912+0000 7fab260ae700 1 --2- 172.21.15.45:0/2005455884 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce2156a0 0x563fce226a30 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fab1c009990 tx=0x7fab1c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd29aa9d0061155 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.912+0000 7fab09ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.912+0000 7fab09ffb700 1 -- 172.21.15.45:0/2005455884 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c01d040 con 0x563fce2156a0 2024-05-10T03:40:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.913+0000 7fab09ffb700 1 -- 172.21.15.45:0/2005455884 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fab1c0327b0 con 0x563fce2156a0 2024-05-10T03:40:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.913+0000 7fab38656b80 1 -- 172.21.15.45:0/2005455884 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fab1409da00 con 0x563fce2156a0 2024-05-10T03:40:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.913+0000 7fab09ffb700 1 -- 172.21.15.45:0/2005455884 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab1c0050b0 con 0x563fce2156a0 2024-05-10T03:40:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.913+0000 7fab38656b80 10 client.15807 fetch_fsmap learned FSMap version 28 2024-05-10T03:40:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.913+0000 7fab38656b80 1 -- 172.21.15.45:0/2005455884 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x563fcdfbacd0 con 0x563fce2156a0 2024-05-10T03:40:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.913+0000 7fab09ffb700 1 -- 172.21.15.45:0/2005455884 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fab1409da00 con 0x563fce2156a0 2024-05-10T03:40:54.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.913+0000 7fab09ffb700 1 -- 172.21.15.45:0/2005455884 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fab1c03b8f0 con 0x563fce2156a0 2024-05-10T03:40:54.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.913+0000 7fab38656b80 10 client.15807 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:40:54.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.913+0000 7fab38656b80 10 client.15807 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-10T03:40:54.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.913+0000 7fab38656b80 20 client.15807 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:54.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.913+0000 7fab38656b80 1 --2- 172.21.15.45:0/2005455884 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x563fce280fb0 0x563fce2833d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:54.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.913+0000 7fab38656b80 4 client.15807 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-10T03:40:54.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.913+0000 7fab38656b80 1 -- 172.21.15.45:0/2005455884 --> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563fce12dec0 con 0x563fce280fb0 2024-05-10T03:40:54.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.914+0000 7fab258ad700 1 --2- 172.21.15.45:0/2005455884 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x563fce280fb0 0x563fce2833d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:54.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.914+0000 7fab258ad700 1 --2- 172.21.15.45:0/2005455884 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x563fce280fb0 0x563fce2833d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3ac3c5f02ae20899 server_cookie=ba89257719d3c793 in_seq=0 out_seq=0 2024-05-10T03:40:54.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.914+0000 7fab09ffb700 10 client.15807 ms_handle_connect on v2:172.21.15.154:6838/1506563336 2024-05-10T03:40:54.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.914+0000 7fab09ffb700 1 -- 172.21.15.45:0/2005455884 <== mds.2 v2:172.21.15.154:6838/1506563336 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563fce12dec0 con 0x563fce280fb0 2024-05-10T03:40:54.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.914+0000 7fab09ffb700 10 client.15807 handle_command_reply: tid=0 2024-05-10T03:40:54.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.914+0000 7fab38656b80 1 client.15807 shutdown 2024-05-10T03:40:54.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.914+0000 7fab38656b80 1 -- 172.21.15.45:0/2005455884 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce2156a0 msgr2=0x563fce226a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.914+0000 7fab38656b80 1 --2- 172.21.15.45:0/2005455884 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce2156a0 0x563fce226a30 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fab1c009990 tx=0x7fab1c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.914+0000 7fab38656b80 1 -- 172.21.15.45:0/2005455884 shutdown_connections 2024-05-10T03:40:54.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.914+0000 7fab38656b80 1 --2- 172.21.15.45:0/2005455884 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x563fce280fb0 0x563fce2833d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.914+0000 7fab38656b80 1 --2- 172.21.15.45:0/2005455884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563fce216ec0 0x563fce223c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.914+0000 7fab38656b80 1 --2- 172.21.15.45:0/2005455884 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563fce2156a0 0x563fce226a30 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.914+0000 7fab09ffb700 0 client.15807 ms_handle_reset on v2:172.21.15.154:6838/1506563336 2024-05-10T03:40:54.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.914+0000 7fab38656b80 1 --2- 172.21.15.45:0/2005455884 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563fce216570 0x563fce2235b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.914+0000 7fab38656b80 1 -- 172.21.15.45:0/2005455884 >> 172.21.15.45:0/2005455884 conn(0x563fce177a60 msgr2=0x563fce21a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:54.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.914+0000 7fab38656b80 1 -- 172.21.15.45:0/2005455884 shutdown_connections 2024-05-10T03:40:54.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.915+0000 7fab38656b80 1 -- 172.21.15.45:0/2005455884 wait complete. 2024-05-10T03:40:54.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.915+0000 7fab38656b80 20 client.15807 trim_cache size 0 max 16384 2024-05-10T03:40:54.924 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-05-10T03:40:54.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.915+0000 7fab28312700 1 -- 172.21.15.45:0/668150461 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fab0c0a12e0 msgr2=0x7fab0c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.915+0000 7fab28312700 1 --2- 172.21.15.45:0/668150461 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fab0c0a12e0 0x7fab0c0a37f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fab1c006010 tx=0x7fab1c01a040 comp rx=0 tx=0).stop 2024-05-10T03:40:54.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.915+0000 7fab28312700 1 -- 172.21.15.45:0/668150461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab20101be0 msgr2=0x7fab20198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:54.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.915+0000 7fab28312700 1 --2- 172.21.15.45:0/668150461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab20101be0 0x7fab20198580 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fab1400d980 tx=0x7fab1400dd40 comp rx=0 tx=0).stop 2024-05-10T03:40:54.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.915+0000 7fab28312700 1 -- 172.21.15.45:0/668150461 shutdown_connections 2024-05-10T03:40:54.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.915+0000 7fab28312700 1 --2- 172.21.15.45:0/668150461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab20100ac0 0x7fab20198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.915+0000 7fab28312700 1 --2- 172.21.15.45:0/668150461 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fab0c0a12e0 0x7fab0c0a37f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.915+0000 7fab28312700 1 --2- 172.21.15.45:0/668150461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab20102580 0x7fab2019f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.915+0000 7fab28312700 1 --2- 172.21.15.45:0/668150461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab20101be0 0x7fab20198580 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:54.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.915+0000 7fab28312700 1 -- 172.21.15.45:0/668150461 >> 172.21.15.45:0/668150461 conn(0x7fab200fc0d0 msgr2=0x7fab20104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:54.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.915+0000 7fab28312700 1 -- 172.21.15.45:0/668150461 shutdown_connections 2024-05-10T03:40:54.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:54.915+0000 7fab28312700 1 -- 172.21.15.45:0/668150461 wait complete. 2024-05-10T03:40:54.932 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-10T03:40:55.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.082+0000 7fe7b942d700 1 -- 172.21.15.45:0/2014661730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7b4108210 msgr2=0x7fe7b4108620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:55.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.082+0000 7fe7b942d700 1 --2- 172.21.15.45:0/2014661730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7b4108210 0x7fe7b4108620 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4009990 tx=0x7fe7a4009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.082+0000 7fe7b942d700 1 -- 172.21.15.45:0/2014661730 shutdown_connections 2024-05-10T03:40:55.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.082+0000 7fe7b942d700 1 --2- 172.21.15.45:0/2014661730 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7b4109cd0 0x7fe7b4110580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.082+0000 7fe7b942d700 1 --2- 172.21.15.45:0/2014661730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7b4108210 0x7fe7b4108620 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.082+0000 7fe7b942d700 1 --2- 172.21.15.45:0/2014661730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7b4109330 0x7fe7b4109740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.082+0000 7fe7b942d700 1 -- 172.21.15.45:0/2014661730 >> 172.21.15.45:0/2014661730 conn(0x7fe7b4077280 msgr2=0x7fe7b4106030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:55.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.082+0000 7fe7b942d700 1 -- 172.21.15.45:0/2014661730 shutdown_connections 2024-05-10T03:40:55.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.083+0000 7fe7b942d700 1 -- 172.21.15.45:0/2014661730 wait complete. 2024-05-10T03:40:55.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.083+0000 7fe7b942d700 1 Processor -- start 2024-05-10T03:40:55.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.083+0000 7fe7b942d700 1 -- start start 2024-05-10T03:40:55.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.084+0000 7fe7b942d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7b4108210 0x7fe7b419e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.084+0000 7fe7b942d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7b4109330 0x7fe7b419eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.084+0000 7fe7b942d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7b4109cd0 0x7fe7b41a5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.084+0000 7fe7b942d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b41a6110 con 0x7fe7b4109cd0 2024-05-10T03:40:55.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.084+0000 7fe7b942d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b41a6280 con 0x7fe7b4109330 2024-05-10T03:40:55.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.084+0000 7fe7b942d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b41a6440 con 0x7fe7b4108210 2024-05-10T03:40:55.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.084+0000 7fe7b37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7b4109cd0 0x7fe7b41a5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.084+0000 7fe7b37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7b4109cd0 0x7fe7b41a5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60342/0 (socket says 172.21.15.45:60342) 2024-05-10T03:40:55.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.084+0000 7fe7b37fe700 1 -- 172.21.15.45:0/473762832 learned_addr learned my addr 172.21.15.45:0/473762832 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:55.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.084+0000 7fe7b2ffd700 1 --2- 172.21.15.45:0/473762832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7b4108210 0x7fe7b419e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.084+0000 7fe7b27fc700 1 --2- 172.21.15.45:0/473762832 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7b4109330 0x7fe7b419eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.084+0000 7fe7b37fe700 1 -- 172.21.15.45:0/473762832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7b4108210 msgr2=0x7fe7b419e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:55.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.084+0000 7fe7b37fe700 1 --2- 172.21.15.45:0/473762832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7b4108210 0x7fe7b419e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.084+0000 7fe7b37fe700 1 -- 172.21.15.45:0/473762832 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7b4109330 msgr2=0x7fe7b419eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:55.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.084+0000 7fe7b37fe700 1 --2- 172.21.15.45:0/473762832 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7b4109330 0x7fe7b419eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.084+0000 7fe7b37fe700 1 -- 172.21.15.45:0/473762832 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a40095f0 con 0x7fe7b4109cd0 2024-05-10T03:40:55.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.084+0000 7fe7b27fc700 1 --2- 172.21.15.45:0/473762832 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7b4109330 0x7fe7b419eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:55.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.084+0000 7fe7b37fe700 1 --2- 172.21.15.45:0/473762832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7b4109cd0 0x7fe7b41a5b00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac00ef30 tx=0x7fe7ac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:55.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.085+0000 7fe79bfff700 1 -- 172.21.15.45:0/473762832 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac018070 con 0x7fe7b4109cd0 2024-05-10T03:40:55.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.085+0000 7fe79bfff700 1 -- 172.21.15.45:0/473762832 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe7ac00f040 con 0x7fe7b4109cd0 2024-05-10T03:40:55.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.085+0000 7fe7b942d700 1 -- 172.21.15.45:0/473762832 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b41a66c0 con 0x7fe7b4109cd0 2024-05-10T03:40:55.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.085+0000 7fe79bfff700 1 -- 172.21.15.45:0/473762832 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac00ce00 con 0x7fe7b4109cd0 2024-05-10T03:40:55.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.085+0000 7fe7b942d700 1 -- 172.21.15.45:0/473762832 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b41a6bd0 con 0x7fe7b4109cd0 2024-05-10T03:40:55.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.087+0000 7fe79bfff700 1 -- 172.21.15.45:0/473762832 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fe7ac004000 con 0x7fe7b4109cd0 2024-05-10T03:40:55.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.088+0000 7fe79bfff700 1 --2- 172.21.15.45:0/473762832 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe79c0a12e0 0x7fe79c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.088+0000 7fe79bfff700 1 -- 172.21.15.45:0/473762832 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fe7ac0cc970 con 0x7fe7b4109cd0 2024-05-10T03:40:55.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.088+0000 7fe7b2ffd700 1 --2- 172.21.15.45:0/473762832 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe79c0a12e0 0x7fe79c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.089+0000 7fe7c9771b80 1 Processor -- start 2024-05-10T03:40:55.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.089+0000 7fe7c9771b80 1 -- start start 2024-05-10T03:40:55.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.089+0000 7fe7b2ffd700 1 --2- 172.21.15.45:0/473762832 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe79c0a12e0 0x7fe79c0a37f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4006010 tx=0x7fe7a401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:55.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.089+0000 7fe7c9771b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4558656a0 0x55b455865af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.089+0000 7fe7c9771b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b455866570 0x55b455866980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.089+0000 7fe7c9771b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b455866ec0 0x55b45586d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.089+0000 7fe7c9771b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b45578c150 con 0x55b4558656a0 2024-05-10T03:40:55.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.089+0000 7fe7c9771b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b455789b10 con 0x55b455866ec0 2024-05-10T03:40:55.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.089+0000 7fe7c9771b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b455785400 con 0x55b455866570 2024-05-10T03:40:55.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.089+0000 7fe7b2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4558656a0 0x55b455865af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.089+0000 7fe7b2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4558656a0 0x55b455865af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60354/0 (socket says 172.21.15.45:60354) 2024-05-10T03:40:55.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.089+0000 7fe7b2ffd700 1 -- 172.21.15.45:0/970058256 learned_addr learned my addr 172.21.15.45:0/970058256 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:55.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.089+0000 7fe7b27fc700 1 --2- 172.21.15.45:0/970058256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b455866570 0x55b455866980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.090+0000 7fe7b37fe700 1 --2- 172.21.15.45:0/970058256 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b455866ec0 0x55b45586d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.090+0000 7fe7b2ffd700 1 -- 172.21.15.45:0/970058256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b455866570 msgr2=0x55b455866980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:55.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.090+0000 7fe7b2ffd700 1 --2- 172.21.15.45:0/970058256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b455866570 0x55b455866980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.090+0000 7fe7b2ffd700 1 -- 172.21.15.45:0/970058256 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b455866ec0 msgr2=0x55b45586d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:55.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.090+0000 7fe7b2ffd700 1 --2- 172.21.15.45:0/970058256 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b455866ec0 0x55b45586d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.090+0000 7fe7b2ffd700 1 -- 172.21.15.45:0/970058256 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4556063b0 con 0x55b4558656a0 2024-05-10T03:40:55.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.090+0000 7fe7b37fe700 1 --2- 172.21.15.45:0/970058256 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b455866ec0 0x55b45586d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:55.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.090+0000 7fe7b2ffd700 1 --2- 172.21.15.45:0/970058256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4558656a0 0x55b455865af0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400b2e0 tx=0x7fe7a401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9ae91fc044e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:55.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.090+0000 7fe7997fa700 1 -- 172.21.15.45:0/970058256 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a402b070 con 0x55b4558656a0 2024-05-10T03:40:55.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.090+0000 7fe7997fa700 1 -- 172.21.15.45:0/970058256 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe7a401e040 con 0x55b4558656a0 2024-05-10T03:40:55.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.090+0000 7fe7997fa700 1 -- 172.21.15.45:0/970058256 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4024850 con 0x55b4558656a0 2024-05-10T03:40:55.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.091+0000 7fe7c9771b80 1 -- 172.21.15.45:0/970058256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4558656a0 msgr2=0x55b455865af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:55.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.091+0000 7fe7c9771b80 1 --2- 172.21.15.45:0/970058256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4558656a0 0x55b455865af0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400b2e0 tx=0x7fe7a401f000 comp rx=0 tx=0).stop 2024-05-10T03:40:55.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.091+0000 7fe7c9771b80 1 -- 172.21.15.45:0/970058256 shutdown_connections 2024-05-10T03:40:55.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.091+0000 7fe7c9771b80 1 --2- 172.21.15.45:0/970058256 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b455866ec0 0x55b45586d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.091+0000 7fe7c9771b80 1 --2- 172.21.15.45:0/970058256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4558656a0 0x55b455865af0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.091+0000 7fe7c9771b80 1 --2- 172.21.15.45:0/970058256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b455866570 0x55b455866980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.091+0000 7fe7c9771b80 1 -- 172.21.15.45:0/970058256 >> 172.21.15.45:0/970058256 conn(0x55b4557c7a60 msgr2=0x55b45585ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:55.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.091+0000 7fe7c9771b80 1 -- 172.21.15.45:0/970058256 shutdown_connections 2024-05-10T03:40:55.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.091+0000 7fe7c9771b80 1 -- 172.21.15.45:0/970058256 wait complete. 2024-05-10T03:40:55.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.092+0000 7fe7c9771b80 1 -- start start 2024-05-10T03:40:55.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.092+0000 7fe7c9771b80 1 Processor -- start 2024-05-10T03:40:55.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.092+0000 7fe7c9771b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4558656a0 0x55b45586f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.092+0000 7fe7c9771b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b455866570 0x55b45586fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.092+0000 7fe7c9771b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b455866ec0 0x55b455876a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.092+0000 7fe7c9771b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b455721560 con 0x55b4558656a0 2024-05-10T03:40:55.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.092+0000 7fe7c9771b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b455721200 con 0x55b455866ec0 2024-05-10T03:40:55.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.092+0000 7fe7c9771b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4556086a0 con 0x55b455866570 2024-05-10T03:40:55.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.092+0000 7fe7c9771b80 10 client.0 _ll_register_callbacks cb 0x55b45572ab30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:55.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.092+0000 7fe7b2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4558656a0 0x55b45586f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.092+0000 7fe7b2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4558656a0 0x55b45586f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60366/0 (socket says 172.21.15.45:60366) 2024-05-10T03:40:55.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.092+0000 7fe7b2ffd700 1 -- 172.21.15.45:0/1586458265 learned_addr learned my addr 172.21.15.45:0/1586458265 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:55.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.092+0000 7fe7b27fc700 1 --2- 172.21.15.45:0/1586458265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b455866570 0x55b45586fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.092+0000 7fe7b37fe700 1 --2- 172.21.15.45:0/1586458265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b455866ec0 0x55b455876a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.092+0000 7fe7b2ffd700 1 -- 172.21.15.45:0/1586458265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b455866570 msgr2=0x55b45586fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:55.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.092+0000 7fe7b2ffd700 1 --2- 172.21.15.45:0/1586458265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b455866570 0x55b45586fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.092+0000 7fe7b2ffd700 1 -- 172.21.15.45:0/1586458265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b455866ec0 msgr2=0x55b455876a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:55.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.092+0000 7fe7b2ffd700 1 --2- 172.21.15.45:0/1586458265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b455866ec0 0x55b455876a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.092+0000 7fe7b2ffd700 1 -- 172.21.15.45:0/1586458265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b4111010 con 0x55b4558656a0 2024-05-10T03:40:55.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.093+0000 7fe7b2ffd700 1 --2- 172.21.15.45:0/1586458265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4558656a0 0x55b45586f5f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4031040 tx=0x7fe7a4024e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5924f30ead105160 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:55.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.093+0000 7fe796ff5700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:55.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.093+0000 7fe796ff5700 1 -- 172.21.15.45:0/1586458265 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a402b040 con 0x55b4558656a0 2024-05-10T03:40:55.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.093+0000 7fe7c9771b80 1 -- 172.21.15.45:0/1586458265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b4556de270 con 0x55b4558656a0 2024-05-10T03:40:55.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.093+0000 7fe796ff5700 1 -- 172.21.15.45:0/1586458265 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fe7a400f870 con 0x55b4558656a0 2024-05-10T03:40:55.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.093+0000 7fe796ff5700 1 -- 172.21.15.45:0/1586458265 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7a400fa30 con 0x55b4558656a0 2024-05-10T03:40:55.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.093+0000 7fe7c9771b80 10 client.15819 fetch_fsmap learned FSMap version 28 2024-05-10T03:40:55.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.093+0000 7fe7c9771b80 1 -- 172.21.15.45:0/1586458265 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55b4555b2b60 con 0x55b4558656a0 2024-05-10T03:40:55.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.093+0000 7fe796ff5700 1 -- 172.21.15.45:0/1586458265 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55b4556de270 con 0x55b4558656a0 2024-05-10T03:40:55.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.093+0000 7fe796ff5700 1 -- 172.21.15.45:0/1586458265 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fe7a403f070 con 0x55b4558656a0 2024-05-10T03:40:55.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.094+0000 7fe7c9771b80 10 client.15819 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:40:55.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.094+0000 7fe7c9771b80 10 client.15819 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-10T03:40:55.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.094+0000 7fe7c9771b80 20 client.15819 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:55.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.094+0000 7fe7c9771b80 1 --2- 172.21.15.45:0/1586458265 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55b45587ad70 0x55b45587d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.094+0000 7fe7c9771b80 4 client.15819 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:40:55.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.094+0000 7fe7c9771b80 1 -- 172.21.15.45:0/1586458265 --> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b455834780 con 0x55b45587ad70 2024-05-10T03:40:55.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.094+0000 7fe7b27fc700 1 --2- 172.21.15.45:0/1586458265 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55b45587ad70 0x55b45587d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.094+0000 7fe796ff5700 10 client.15819 ms_handle_connect on v2:172.21.15.106:6836/3047487403 2024-05-10T03:40:55.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.094+0000 7fe7b27fc700 1 --2- 172.21.15.45:0/1586458265 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55b45587ad70 0x55b45587d190 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=34855c206cb1fc11 server_cookie=e60b249632f51376 in_seq=0 out_seq=0 2024-05-10T03:40:55.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.095+0000 7fe796ff5700 1 -- 172.21.15.45:0/1586458265 <== mds.1 v2:172.21.15.106:6836/3047487403 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b455834780 con 0x55b45587ad70 2024-05-10T03:40:55.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.095+0000 7fe796ff5700 10 client.15819 handle_command_reply: tid=0 2024-05-10T03:40:55.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.095+0000 7fe7c9771b80 1 client.15819 shutdown 2024-05-10T03:40:55.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.095+0000 7fe7c9771b80 1 -- 172.21.15.45:0/1586458265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4558656a0 msgr2=0x55b45586f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:55.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.095+0000 7fe7c9771b80 1 --2- 172.21.15.45:0/1586458265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4558656a0 0x55b45586f5f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4031040 tx=0x7fe7a4024e00 comp rx=0 tx=0).stop 2024-05-10T03:40:55.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.095+0000 7fe7c9771b80 1 -- 172.21.15.45:0/1586458265 shutdown_connections 2024-05-10T03:40:55.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.095+0000 7fe7c9771b80 1 --2- 172.21.15.45:0/1586458265 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55b45587ad70 0x55b45587d190 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.095+0000 7fe7c9771b80 1 --2- 172.21.15.45:0/1586458265 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b455866ec0 0x55b455876a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.095+0000 7fe7c9771b80 1 --2- 172.21.15.45:0/1586458265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4558656a0 0x55b45586f5f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.095+0000 7fe796ff5700 0 client.15819 ms_handle_reset on v2:172.21.15.106:6836/3047487403 2024-05-10T03:40:55.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.095+0000 7fe7c9771b80 1 --2- 172.21.15.45:0/1586458265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b455866570 0x55b45586fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.095+0000 7fe7c9771b80 1 -- 172.21.15.45:0/1586458265 >> 172.21.15.45:0/1586458265 conn(0x55b4557c7a60 msgr2=0x55b45585ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:55.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.095+0000 7fe7c9771b80 1 -- 172.21.15.45:0/1586458265 shutdown_connections 2024-05-10T03:40:55.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.095+0000 7fe7c9771b80 1 -- 172.21.15.45:0/1586458265 wait complete. 2024-05-10T03:40:55.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.095+0000 7fe7c9771b80 20 client.15819 trim_cache size 0 max 16384 2024-05-10T03:40:55.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.110+0000 7fe7c9771b80 1 Processor -- start 2024-05-10T03:40:55.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.110+0000 7fe7c9771b80 1 -- start start 2024-05-10T03:40:55.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.110+0000 7fe7c9771b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4558656a0 0x55b455866980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.110+0000 7fe7c9771b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b455866570 0x55b45587d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.110+0000 7fe7c9771b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b455866ec0 0x55b4558697a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.110+0000 7fe7c9771b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4558822f0 con 0x55b455866ec0 2024-05-10T03:40:55.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.110+0000 7fe7c9771b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b45586ace0 con 0x55b4558656a0 2024-05-10T03:40:55.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.110+0000 7fe7c9771b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b45586d610 con 0x55b455866570 2024-05-10T03:40:55.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.110+0000 7fe7b37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b455866ec0 0x55b4558697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.110+0000 7fe7b37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b455866ec0 0x55b4558697a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60378/0 (socket says 172.21.15.45:60378) 2024-05-10T03:40:55.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.110+0000 7fe7b37fe700 1 -- 172.21.15.45:0/2448600741 learned_addr learned my addr 172.21.15.45:0/2448600741 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:55.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.110+0000 7fe7b2ffd700 1 --2- 172.21.15.45:0/2448600741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4558656a0 0x55b455866980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.110+0000 7fe7b27fc700 1 --2- 172.21.15.45:0/2448600741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b455866570 0x55b45587d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.110+0000 7fe7b37fe700 1 -- 172.21.15.45:0/2448600741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b455866570 msgr2=0x55b45587d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:55.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.110+0000 7fe7b37fe700 1 --2- 172.21.15.45:0/2448600741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b455866570 0x55b45587d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.110+0000 7fe7b37fe700 1 -- 172.21.15.45:0/2448600741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4558656a0 msgr2=0x55b455866980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:55.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.110+0000 7fe7b37fe700 1 --2- 172.21.15.45:0/2448600741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4558656a0 0x55b455866980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.110+0000 7fe7b37fe700 1 -- 172.21.15.45:0/2448600741 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b45574b560 con 0x55b455866ec0 2024-05-10T03:40:55.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.111+0000 7fe7b37fe700 1 --2- 172.21.15.45:0/2448600741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b455866ec0 0x55b4558697a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009f40 tx=0x7fe7ac099320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9a3a0b9c4a4f01 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:55.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.111+0000 7fe799ffb700 1 -- 172.21.15.45:0/2448600741 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac0b2210 con 0x55b455866ec0 2024-05-10T03:40:55.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.111+0000 7fe799ffb700 1 -- 172.21.15.45:0/2448600741 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe7ac084040 con 0x55b455866ec0 2024-05-10T03:40:55.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.111+0000 7fe799ffb700 1 -- 172.21.15.45:0/2448600741 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac0b90c0 con 0x55b455866ec0 2024-05-10T03:40:55.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.112+0000 7fe7c9771b80 1 -- 172.21.15.45:0/2448600741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b455866ec0 msgr2=0x55b4558697a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:55.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.112+0000 7fe7c9771b80 1 --2- 172.21.15.45:0/2448600741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b455866ec0 0x55b4558697a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009f40 tx=0x7fe7ac099320 comp rx=0 tx=0).stop 2024-05-10T03:40:55.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.112+0000 7fe7c9771b80 1 -- 172.21.15.45:0/2448600741 shutdown_connections 2024-05-10T03:40:55.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.112+0000 7fe7c9771b80 1 --2- 172.21.15.45:0/2448600741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b455866ec0 0x55b4558697a0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.112+0000 7fe7c9771b80 1 --2- 172.21.15.45:0/2448600741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4558656a0 0x55b455866980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.112+0000 7fe7c9771b80 1 --2- 172.21.15.45:0/2448600741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b455866570 0x55b45587d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.112+0000 7fe7c9771b80 1 -- 172.21.15.45:0/2448600741 >> 172.21.15.45:0/2448600741 conn(0x55b4557c7a60 msgr2=0x55b45585ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:55.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.112+0000 7fe7c9771b80 1 -- 172.21.15.45:0/2448600741 shutdown_connections 2024-05-10T03:40:55.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.112+0000 7fe7c9771b80 1 -- 172.21.15.45:0/2448600741 wait complete. 2024-05-10T03:40:55.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.112+0000 7fe7c9771b80 1 -- start start 2024-05-10T03:40:55.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.112+0000 7fe7c9771b80 1 Processor -- start 2024-05-10T03:40:55.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.112+0000 7fe7c9771b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4558656a0 0x55b4558745f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.112+0000 7fe7c9771b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b455866570 0x55b455874b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.112+0000 7fe7c9771b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b455866ec0 0x55b4558759c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.112+0000 7fe7c9771b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b455875f00 con 0x55b4558656a0 2024-05-10T03:40:55.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.113+0000 7fe7c9771b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b455876070 con 0x55b455866570 2024-05-10T03:40:55.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.113+0000 7fe7c9771b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b455876230 con 0x55b455866ec0 2024-05-10T03:40:55.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.113+0000 7fe7c9771b80 10 client.0 _ll_register_callbacks cb 0x55b45572ab30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:55.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.113+0000 7fe7b2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4558656a0 0x55b4558745f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.113+0000 7fe7b2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4558656a0 0x55b4558745f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60380/0 (socket says 172.21.15.45:60380) 2024-05-10T03:40:55.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.113+0000 7fe7b2ffd700 1 -- 172.21.15.45:0/1523980593 learned_addr learned my addr 172.21.15.45:0/1523980593 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:55.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.113+0000 7fe7b27fc700 1 --2- 172.21.15.45:0/1523980593 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b455866570 0x55b455874b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.113+0000 7fe7b37fe700 1 --2- 172.21.15.45:0/1523980593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b455866ec0 0x55b4558759c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.113+0000 7fe7b2ffd700 1 -- 172.21.15.45:0/1523980593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b455866ec0 msgr2=0x55b4558759c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:55.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.113+0000 7fe7b2ffd700 1 --2- 172.21.15.45:0/1523980593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b455866ec0 0x55b4558759c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.113+0000 7fe7b2ffd700 1 -- 172.21.15.45:0/1523980593 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b455866570 msgr2=0x55b455874b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:55.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.113+0000 7fe7b2ffd700 1 --2- 172.21.15.45:0/1523980593 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b455866570 0x55b455874b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.113+0000 7fe7b2ffd700 1 -- 172.21.15.45:0/1523980593 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b41a6bd0 con 0x55b4558656a0 2024-05-10T03:40:55.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.113+0000 7fe7b2ffd700 1 --2- 172.21.15.45:0/1523980593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4558656a0 0x55b4558745f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400bbb0 tx=0x7fe7a402f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88fcecce064c359b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:55.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.113+0000 7fe796ff5700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:55.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.113+0000 7fe796ff5700 1 -- 172.21.15.45:0/1523980593 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a402b040 con 0x55b4558656a0 2024-05-10T03:40:55.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.113+0000 7fe796ff5700 1 -- 172.21.15.45:0/1523980593 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fe7a400fe40 con 0x55b4558656a0 2024-05-10T03:40:55.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.113+0000 7fe7c9771b80 1 -- 172.21.15.45:0/1523980593 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe7a401e040 con 0x55b4558656a0 2024-05-10T03:40:55.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.114+0000 7fe796ff5700 1 -- 172.21.15.45:0/1523980593 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7a402f790 con 0x55b4558656a0 2024-05-10T03:40:55.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.114+0000 7fe7c9771b80 10 client.15825 fetch_fsmap learned FSMap version 28 2024-05-10T03:40:55.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.114+0000 7fe7c9771b80 1 -- 172.21.15.45:0/1523980593 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55b45560acd0 con 0x55b4558656a0 2024-05-10T03:40:55.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.114+0000 7fe796ff5700 1 -- 172.21.15.45:0/1523980593 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe7a401e040 con 0x55b4558656a0 2024-05-10T03:40:55.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.114+0000 7fe796ff5700 1 -- 172.21.15.45:0/1523980593 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fe7a403f070 con 0x55b4558656a0 2024-05-10T03:40:55.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.114+0000 7fe7c9771b80 10 client.15825 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:40:55.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.114+0000 7fe7c9771b80 10 client.15825 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-10T03:40:55.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.114+0000 7fe7c9771b80 20 client.15825 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:55.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.114+0000 7fe7c9771b80 1 --2- 172.21.15.45:0/1523980593 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55b45587ad70 0x55b4558d3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.114+0000 7fe7c9771b80 4 client.15825 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-10T03:40:55.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.114+0000 7fe7c9771b80 1 -- 172.21.15.45:0/1523980593 --> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b45577dec0 con 0x55b45587ad70 2024-05-10T03:40:55.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.114+0000 7fe7b27fc700 1 --2- 172.21.15.45:0/1523980593 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55b45587ad70 0x55b4558d3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.115+0000 7fe796ff5700 10 client.15825 ms_handle_connect on v2:172.21.15.106:6836/3047487403 2024-05-10T03:40:55.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.115+0000 7fe7b27fc700 1 --2- 172.21.15.45:0/1523980593 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55b45587ad70 0x55b4558d3530 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b6ed7d5367cabd77 server_cookie=250577d77fe89411 in_seq=0 out_seq=0 2024-05-10T03:40:55.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.115+0000 7fe796ff5700 1 -- 172.21.15.45:0/1523980593 <== mds.1 v2:172.21.15.106:6836/3047487403 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b45577dec0 con 0x55b45587ad70 2024-05-10T03:40:55.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.115+0000 7fe796ff5700 10 client.15825 handle_command_reply: tid=0 2024-05-10T03:40:55.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.115+0000 7fe7c9771b80 1 client.15825 shutdown 2024-05-10T03:40:55.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.115+0000 7fe7c9771b80 1 -- 172.21.15.45:0/1523980593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4558656a0 msgr2=0x55b4558745f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:55.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.115+0000 7fe7c9771b80 1 --2- 172.21.15.45:0/1523980593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4558656a0 0x55b4558745f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400bbb0 tx=0x7fe7a402f400 comp rx=0 tx=0).stop 2024-05-10T03:40:55.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.115+0000 7fe7c9771b80 1 -- 172.21.15.45:0/1523980593 shutdown_connections 2024-05-10T03:40:55.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.115+0000 7fe7c9771b80 1 --2- 172.21.15.45:0/1523980593 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55b45587ad70 0x55b4558d3530 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.115+0000 7fe7c9771b80 1 --2- 172.21.15.45:0/1523980593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b455866ec0 0x55b4558759c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.115+0000 7fe7c9771b80 1 --2- 172.21.15.45:0/1523980593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4558656a0 0x55b4558745f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.115+0000 7fe796ff5700 0 client.15825 ms_handle_reset on v2:172.21.15.106:6836/3047487403 2024-05-10T03:40:55.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.115+0000 7fe7c9771b80 1 --2- 172.21.15.45:0/1523980593 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b455866570 0x55b455874b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.115+0000 7fe7c9771b80 1 -- 172.21.15.45:0/1523980593 >> 172.21.15.45:0/1523980593 conn(0x55b4557c7a60 msgr2=0x55b45585ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:55.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.115+0000 7fe7c9771b80 1 -- 172.21.15.45:0/1523980593 shutdown_connections 2024-05-10T03:40:55.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.115+0000 7fe7c9771b80 1 -- 172.21.15.45:0/1523980593 wait complete. 2024-05-10T03:40:55.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.115+0000 7fe7c9771b80 20 client.15825 trim_cache size 0 max 16384 2024-05-10T03:40:55.125 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-05-10T03:40:55.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.116+0000 7fe7b942d700 1 -- 172.21.15.45:0/473762832 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe79c0a12e0 msgr2=0x7fe79c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:55.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.116+0000 7fe7b942d700 1 --2- 172.21.15.45:0/473762832 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe79c0a12e0 0x7fe79c0a37f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4006010 tx=0x7fe7a401a040 comp rx=0 tx=0).stop 2024-05-10T03:40:55.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.116+0000 7fe7b942d700 1 -- 172.21.15.45:0/473762832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7b4109cd0 msgr2=0x7fe7b41a5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:55.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.116+0000 7fe7b942d700 1 --2- 172.21.15.45:0/473762832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7b4109cd0 0x7fe7b41a5b00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac00ef30 tx=0x7fe7ac00c3a0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.116+0000 7fe7b942d700 1 -- 172.21.15.45:0/473762832 shutdown_connections 2024-05-10T03:40:55.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.116+0000 7fe7b942d700 1 --2- 172.21.15.45:0/473762832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7b4108210 0x7fe7b419e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.116+0000 7fe7b942d700 1 --2- 172.21.15.45:0/473762832 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe79c0a12e0 0x7fe79c0a37f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.116+0000 7fe7b942d700 1 --2- 172.21.15.45:0/473762832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7b4109cd0 0x7fe7b41a5b00 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.116+0000 7fe7b942d700 1 --2- 172.21.15.45:0/473762832 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7b4109330 0x7fe7b419eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.116+0000 7fe7b942d700 1 -- 172.21.15.45:0/473762832 >> 172.21.15.45:0/473762832 conn(0x7fe7b4077280 msgr2=0x7fe7b410c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:55.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.116+0000 7fe7b942d700 1 -- 172.21.15.45:0/473762832 shutdown_connections 2024-05-10T03:40:55.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.116+0000 7fe7b942d700 1 -- 172.21.15.45:0/473762832 wait complete. 2024-05-10T03:40:55.133 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-10T03:40:55.283 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:54 smithi045 ceph-mon[42520]: pgmap v304: 129 pgs: 129 active+clean; 660 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:40:55.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:54 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2529755013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:40:55.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.282+0000 7fd519b19700 1 -- 172.21.15.45:0/2400555751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd514101c10 msgr2=0x7fd514102020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:55.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.282+0000 7fd519b19700 1 --2- 172.21.15.45:0/2400555751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd514101c10 0x7fd514102020 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd508009990 tx=0x7fd508009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.282+0000 7fd519b19700 1 -- 172.21.15.45:0/2400555751 shutdown_connections 2024-05-10T03:40:55.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.282+0000 7fd519b19700 1 --2- 172.21.15.45:0/2400555751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd514100af0 0x7fd514100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.282+0000 7fd519b19700 1 --2- 172.21.15.45:0/2400555751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5141025b0 0x7fd514108e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.282+0000 7fd519b19700 1 --2- 172.21.15.45:0/2400555751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd514101c10 0x7fd514102020 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.282+0000 7fd519b19700 1 -- 172.21.15.45:0/2400555751 >> 172.21.15.45:0/2400555751 conn(0x7fd5140fc100 msgr2=0x7fd5140fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:55.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.282+0000 7fd519b19700 1 -- 172.21.15.45:0/2400555751 shutdown_connections 2024-05-10T03:40:55.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.282+0000 7fd519b19700 1 -- 172.21.15.45:0/2400555751 wait complete. 2024-05-10T03:40:55.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.283+0000 7fd519b19700 1 Processor -- start 2024-05-10T03:40:55.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.283+0000 7fd519b19700 1 -- start start 2024-05-10T03:40:55.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.283+0000 7fd519b19700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd514100af0 0x7fd51419a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.283+0000 7fd519b19700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd514101c10 0x7fd51419a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.283+0000 7fd519b19700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5141025b0 0x7fd5141a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.283+0000 7fd519b19700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5141a1d30 con 0x7fd514101c10 2024-05-10T03:40:55.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.283+0000 7fd519b19700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5141a1ea0 con 0x7fd5141025b0 2024-05-10T03:40:55.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.283+0000 7fd519b19700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5141a2060 con 0x7fd514100af0 2024-05-10T03:40:55.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.283+0000 7fd512ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd514101c10 0x7fd51419a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.283+0000 7fd512ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd514101c10 0x7fd51419a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60388/0 (socket says 172.21.15.45:60388) 2024-05-10T03:40:55.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.283+0000 7fd512ffd700 1 -- 172.21.15.45:0/3603392106 learned_addr learned my addr 172.21.15.45:0/3603392106 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:55.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.283+0000 7fd5137fe700 1 --2- 172.21.15.45:0/3603392106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd514100af0 0x7fd51419a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.283+0000 7fd513fff700 1 --2- 172.21.15.45:0/3603392106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5141025b0 0x7fd5141a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.283+0000 7fd512ffd700 1 -- 172.21.15.45:0/3603392106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd514100af0 msgr2=0x7fd51419a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:55.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.283+0000 7fd512ffd700 1 --2- 172.21.15.45:0/3603392106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd514100af0 0x7fd51419a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.284+0000 7fd512ffd700 1 -- 172.21.15.45:0/3603392106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5141025b0 msgr2=0x7fd5141a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:55.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.284+0000 7fd512ffd700 1 --2- 172.21.15.45:0/3603392106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5141025b0 0x7fd5141a1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.284+0000 7fd512ffd700 1 -- 172.21.15.45:0/3603392106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5080095f0 con 0x7fd514101c10 2024-05-10T03:40:55.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.284+0000 7fd513fff700 1 --2- 172.21.15.45:0/3603392106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5141025b0 0x7fd5141a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:40:55.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.284+0000 7fd512ffd700 1 --2- 172.21.15.45:0/3603392106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd514101c10 0x7fd51419a790 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd508000c00 tx=0x7fd50800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:55.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.284+0000 7fd510ff9700 1 -- 172.21.15.45:0/3603392106 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50801d070 con 0x7fd514101c10 2024-05-10T03:40:55.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.284+0000 7fd510ff9700 1 -- 172.21.15.45:0/3603392106 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd5080218f0 con 0x7fd514101c10 2024-05-10T03:40:55.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.284+0000 7fd510ff9700 1 -- 172.21.15.45:0/3603392106 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd508017650 con 0x7fd514101c10 2024-05-10T03:40:55.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.284+0000 7fd519b19700 1 -- 172.21.15.45:0/3603392106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5141a22e0 con 0x7fd514101c10 2024-05-10T03:40:55.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.284+0000 7fd519b19700 1 -- 172.21.15.45:0/3603392106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5141a26b0 con 0x7fd514101c10 2024-05-10T03:40:55.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.286+0000 7fd510ff9700 1 -- 172.21.15.45:0/3603392106 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fd508021410 con 0x7fd514101c10 2024-05-10T03:40:55.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.287+0000 7fd510ff9700 1 --2- 172.21.15.45:0/3603392106 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd4fc0a1260 0x7fd4fc0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.288+0000 7fd5137fe700 1 --2- 172.21.15.45:0/3603392106 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd4fc0a1260 0x7fd4fc0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.288+0000 7fd510ff9700 1 -- 172.21.15.45:0/3603392106 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd5080ce280 con 0x7fd514101c10 2024-05-10T03:40:55.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.288+0000 7fd5137fe700 1 --2- 172.21.15.45:0/3603392106 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd4fc0a1260 0x7fd4fc0a3770 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd514101b10 tx=0x7fd504009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:55.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.288+0000 7fd529e5db80 1 Processor -- start 2024-05-10T03:40:55.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.288+0000 7fd529e5db80 1 -- start start 2024-05-10T03:40:55.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.289+0000 7fd529e5db80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c210266a0 0x559c21026af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.289+0000 7fd529e5db80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c21027570 0x559c21027980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.289+0000 7fd529e5db80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c21027ec0 0x559c2102e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.289+0000 7fd529e5db80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c20f4d150 con 0x559c210266a0 2024-05-10T03:40:55.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.289+0000 7fd529e5db80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c20f4ab10 con 0x559c21027570 2024-05-10T03:40:55.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.289+0000 7fd529e5db80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c20f46400 con 0x559c21027ec0 2024-05-10T03:40:55.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.289+0000 7fd5137fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c210266a0 0x559c21026af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.289+0000 7fd5137fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c210266a0 0x559c21026af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60392/0 (socket says 172.21.15.45:60392) 2024-05-10T03:40:55.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.289+0000 7fd5137fe700 1 -- 172.21.15.45:0/3937809524 learned_addr learned my addr 172.21.15.45:0/3937809524 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:55.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.289+0000 7fd512ffd700 1 --2- 172.21.15.45:0/3937809524 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c21027570 0x559c21027980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.289+0000 7fd513fff700 1 --2- 172.21.15.45:0/3937809524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c21027ec0 0x559c2102e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.289+0000 7fd5137fe700 1 -- 172.21.15.45:0/3937809524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c21027ec0 msgr2=0x559c2102e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:55.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.289+0000 7fd5137fe700 1 --2- 172.21.15.45:0/3937809524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c21027ec0 0x559c2102e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.289+0000 7fd5137fe700 1 -- 172.21.15.45:0/3937809524 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c21027570 msgr2=0x559c21027980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:55.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.289+0000 7fd5137fe700 1 --2- 172.21.15.45:0/3937809524 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c21027570 0x559c21027980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.289+0000 7fd5137fe700 1 -- 172.21.15.45:0/3937809524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c20dc73b0 con 0x559c210266a0 2024-05-10T03:40:55.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.289+0000 7fd5137fe700 1 --2- 172.21.15.45:0/3937809524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c210266a0 0x559c21026af0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd504011df0 tx=0x7fd504014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9d7373779b3ebb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:55.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.290+0000 7fd4f9ffb700 1 -- 172.21.15.45:0/3937809524 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50401f420 con 0x559c210266a0 2024-05-10T03:40:55.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.290+0000 7fd4f9ffb700 1 -- 172.21.15.45:0/3937809524 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd504016070 con 0x559c210266a0 2024-05-10T03:40:55.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.290+0000 7fd4f9ffb700 1 -- 172.21.15.45:0/3937809524 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50401d940 con 0x559c210266a0 2024-05-10T03:40:55.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.290+0000 7fd529e5db80 1 -- 172.21.15.45:0/3937809524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c210266a0 msgr2=0x559c21026af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:55.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.290+0000 7fd529e5db80 1 --2- 172.21.15.45:0/3937809524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c210266a0 0x559c21026af0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd504011df0 tx=0x7fd504014000 comp rx=0 tx=0).stop 2024-05-10T03:40:55.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.291+0000 7fd529e5db80 1 -- 172.21.15.45:0/3937809524 shutdown_connections 2024-05-10T03:40:55.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.291+0000 7fd529e5db80 1 --2- 172.21.15.45:0/3937809524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c21027ec0 0x559c2102e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.291+0000 7fd529e5db80 1 --2- 172.21.15.45:0/3937809524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c210266a0 0x559c21026af0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.291+0000 7fd529e5db80 1 --2- 172.21.15.45:0/3937809524 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c21027570 0x559c21027980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.291+0000 7fd529e5db80 1 -- 172.21.15.45:0/3937809524 >> 172.21.15.45:0/3937809524 conn(0x559c20f88a60 msgr2=0x559c21020fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:55.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.291+0000 7fd529e5db80 1 -- 172.21.15.45:0/3937809524 shutdown_connections 2024-05-10T03:40:55.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.291+0000 7fd529e5db80 1 -- 172.21.15.45:0/3937809524 wait complete. 2024-05-10T03:40:55.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.291+0000 7fd529e5db80 1 -- start start 2024-05-10T03:40:55.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.291+0000 7fd529e5db80 1 Processor -- start 2024-05-10T03:40:55.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.292+0000 7fd529e5db80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c210266a0 0x559c210306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.292+0000 7fd529e5db80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c21027570 0x559c21030be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.292+0000 7fd529e5db80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c21027ec0 0x559c21037b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.292+0000 7fd529e5db80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c20ee2560 con 0x559c21027ec0 2024-05-10T03:40:55.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.292+0000 7fd529e5db80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c20ee2200 con 0x559c21027570 2024-05-10T03:40:55.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.292+0000 7fd529e5db80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c20dc96a0 con 0x559c210266a0 2024-05-10T03:40:55.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.292+0000 7fd529e5db80 10 client.0 _ll_register_callbacks cb 0x559c20eebb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:55.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.292+0000 7fd513fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c21027ec0 0x559c21037b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.292+0000 7fd513fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c21027ec0 0x559c21037b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60408/0 (socket says 172.21.15.45:60408) 2024-05-10T03:40:55.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.292+0000 7fd513fff700 1 -- 172.21.15.45:0/2318955602 learned_addr learned my addr 172.21.15.45:0/2318955602 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:55.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.292+0000 7fd512ffd700 1 --2- 172.21.15.45:0/2318955602 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c21027570 0x559c21030be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.292+0000 7fd5137fe700 1 --2- 172.21.15.45:0/2318955602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c210266a0 0x559c210306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.292+0000 7fd513fff700 1 -- 172.21.15.45:0/2318955602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c210266a0 msgr2=0x559c210306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:55.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.292+0000 7fd513fff700 1 --2- 172.21.15.45:0/2318955602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c210266a0 0x559c210306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.292+0000 7fd513fff700 1 -- 172.21.15.45:0/2318955602 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c21027570 msgr2=0x559c21030be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:55.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.292+0000 7fd513fff700 1 --2- 172.21.15.45:0/2318955602 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c21027570 0x559c21030be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.292+0000 7fd513fff700 1 -- 172.21.15.45:0/2318955602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd504011aa0 con 0x559c21027ec0 2024-05-10T03:40:55.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.292+0000 7fd513fff700 1 --2- 172.21.15.45:0/2318955602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c21027ec0 0x559c21037b40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd50c0078f0 tx=0x7fd50c007c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ebf65ca946b1158 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:55.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.292+0000 7fd4f2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:55.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.293+0000 7fd4f2ffd700 1 -- 172.21.15.45:0/2318955602 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c01a070 con 0x559c21027ec0 2024-05-10T03:40:55.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.293+0000 7fd4f2ffd700 1 -- 172.21.15.45:0/2318955602 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd50c004bb0 con 0x559c21027ec0 2024-05-10T03:40:55.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.293+0000 7fd529e5db80 1 -- 172.21.15.45:0/2318955602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559c20e9f270 con 0x559c21027ec0 2024-05-10T03:40:55.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.293+0000 7fd4f2ffd700 1 -- 172.21.15.45:0/2318955602 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd50c004d70 con 0x559c21027ec0 2024-05-10T03:40:55.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.293+0000 7fd529e5db80 10 client.15837 fetch_fsmap learned FSMap version 28 2024-05-10T03:40:55.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.293+0000 7fd529e5db80 1 -- 172.21.15.45:0/2318955602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x559c20d73b60 con 0x559c21027ec0 2024-05-10T03:40:55.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.293+0000 7fd4f2ffd700 1 -- 172.21.15.45:0/2318955602 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x559c20e9f270 con 0x559c21027ec0 2024-05-10T03:40:55.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.293+0000 7fd4f2ffd700 1 -- 172.21.15.45:0/2318955602 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd50c01d020 con 0x559c21027ec0 2024-05-10T03:40:55.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.293+0000 7fd529e5db80 10 client.15837 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:40:55.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.293+0000 7fd529e5db80 10 client.15837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:40:55.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.293+0000 7fd529e5db80 20 client.15837 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:55.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.293+0000 7fd529e5db80 1 --2- 172.21.15.45:0/2318955602 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x559c2103c3a0 0x559c2103e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.293+0000 7fd529e5db80 4 client.15837 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:40:55.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.293+0000 7fd529e5db80 1 -- 172.21.15.45:0/2318955602 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559c20ff5780 con 0x559c2103c3a0 2024-05-10T03:40:55.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.294+0000 7fd5137fe700 1 --2- 172.21.15.45:0/2318955602 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x559c2103c3a0 0x559c2103e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.294+0000 7fd5137fe700 1 --2- 172.21.15.45:0/2318955602 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x559c2103c3a0 0x559c2103e7f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b954ccc777501376 server_cookie=7f707623e2f85d5f in_seq=0 out_seq=0 2024-05-10T03:40:55.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.294+0000 7fd4f2ffd700 10 client.15837 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:55.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.295+0000 7fd4f2ffd700 1 -- 172.21.15.45:0/2318955602 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559c20ff5780 con 0x559c2103c3a0 2024-05-10T03:40:55.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.295+0000 7fd4f2ffd700 10 client.15837 handle_command_reply: tid=0 2024-05-10T03:40:55.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.295+0000 7fd529e5db80 1 client.15837 shutdown 2024-05-10T03:40:55.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.295+0000 7fd529e5db80 1 -- 172.21.15.45:0/2318955602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c21027ec0 msgr2=0x559c21037b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:55.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.295+0000 7fd529e5db80 1 --2- 172.21.15.45:0/2318955602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c21027ec0 0x559c21037b40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd50c0078f0 tx=0x7fd50c007c00 comp rx=0 tx=0).stop 2024-05-10T03:40:55.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.295+0000 7fd529e5db80 1 -- 172.21.15.45:0/2318955602 shutdown_connections 2024-05-10T03:40:55.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.295+0000 7fd529e5db80 1 --2- 172.21.15.45:0/2318955602 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x559c2103c3a0 0x559c2103e7f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.295+0000 7fd529e5db80 1 --2- 172.21.15.45:0/2318955602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c210266a0 0x559c210306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.295+0000 7fd529e5db80 1 --2- 172.21.15.45:0/2318955602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c21027ec0 0x559c21037b40 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.295+0000 7fd4f2ffd700 0 client.15837 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:55.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.295+0000 7fd529e5db80 1 --2- 172.21.15.45:0/2318955602 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c21027570 0x559c21030be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.295+0000 7fd529e5db80 1 -- 172.21.15.45:0/2318955602 >> 172.21.15.45:0/2318955602 conn(0x559c20f88a60 msgr2=0x559c21020fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:55.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.295+0000 7fd529e5db80 1 -- 172.21.15.45:0/2318955602 shutdown_connections 2024-05-10T03:40:55.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.295+0000 7fd529e5db80 1 -- 172.21.15.45:0/2318955602 wait complete. 2024-05-10T03:40:55.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.295+0000 7fd529e5db80 20 client.15837 trim_cache size 0 max 16384 2024-05-10T03:40:55.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.309+0000 7fd529e5db80 1 Processor -- start 2024-05-10T03:40:55.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.309+0000 7fd529e5db80 1 -- start start 2024-05-10T03:40:55.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.310+0000 7fd529e5db80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c210266a0 0x559c21038120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.310+0000 7fd529e5db80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c21027570 0x559c210379f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.310+0000 7fd529e5db80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c21027ec0 0x559c2102fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.310+0000 7fd529e5db80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c21031740 con 0x559c210266a0 2024-05-10T03:40:55.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.310+0000 7fd529e5db80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c21022770 con 0x559c21027570 2024-05-10T03:40:55.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.310+0000 7fd529e5db80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c2103e7c0 con 0x559c21027ec0 2024-05-10T03:40:55.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.310+0000 7fd5137fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c210266a0 0x559c21038120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.310+0000 7fd5137fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c210266a0 0x559c21038120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60410/0 (socket says 172.21.15.45:60410) 2024-05-10T03:40:55.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.310+0000 7fd5137fe700 1 -- 172.21.15.45:0/1156143517 learned_addr learned my addr 172.21.15.45:0/1156143517 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:55.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.310+0000 7fd513fff700 1 --2- 172.21.15.45:0/1156143517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c21027ec0 0x559c2102fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.310+0000 7fd512ffd700 1 --2- 172.21.15.45:0/1156143517 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c21027570 0x559c210379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.310+0000 7fd5137fe700 1 -- 172.21.15.45:0/1156143517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c21027ec0 msgr2=0x559c2102fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:55.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.310+0000 7fd5137fe700 1 --2- 172.21.15.45:0/1156143517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c21027ec0 0x559c2102fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.310+0000 7fd5137fe700 1 -- 172.21.15.45:0/1156143517 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c21027570 msgr2=0x559c210379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:55.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.310+0000 7fd5137fe700 1 --2- 172.21.15.45:0/1156143517 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c21027570 0x559c210379f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.310+0000 7fd5137fe700 1 -- 172.21.15.45:0/1156143517 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c20f0c560 con 0x559c210266a0 2024-05-10T03:40:55.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.310+0000 7fd513fff700 1 --2- 172.21.15.45:0/1156143517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c21027ec0 0x559c2102fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:55.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.310+0000 7fd512ffd700 1 --2- 172.21.15.45:0/1156143517 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c21027570 0x559c210379f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:40:55.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.310+0000 7fd5137fe700 1 --2- 172.21.15.45:0/1156143517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c210266a0 0x559c21038120 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd504005950 tx=0x7fd5040058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7fec3830db356ca server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:55.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.311+0000 7fd4fa7fc700 1 -- 172.21.15.45:0/1156143517 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50403a070 con 0x559c210266a0 2024-05-10T03:40:55.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.311+0000 7fd4fa7fc700 1 -- 172.21.15.45:0/1156143517 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd50402f040 con 0x559c210266a0 2024-05-10T03:40:55.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.311+0000 7fd4fa7fc700 1 -- 172.21.15.45:0/1156143517 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5040056e0 con 0x559c210266a0 2024-05-10T03:40:55.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.311+0000 7fd529e5db80 1 -- 172.21.15.45:0/1156143517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c210266a0 msgr2=0x559c21038120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:55.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.311+0000 7fd529e5db80 1 --2- 172.21.15.45:0/1156143517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c210266a0 0x559c21038120 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd504005950 tx=0x7fd5040058e0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.311+0000 7fd529e5db80 1 -- 172.21.15.45:0/1156143517 shutdown_connections 2024-05-10T03:40:55.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.311+0000 7fd529e5db80 1 --2- 172.21.15.45:0/1156143517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c21027ec0 0x559c2102fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.311+0000 7fd529e5db80 1 --2- 172.21.15.45:0/1156143517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c210266a0 0x559c21038120 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.311+0000 7fd529e5db80 1 --2- 172.21.15.45:0/1156143517 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c21027570 0x559c210379f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.311+0000 7fd529e5db80 1 -- 172.21.15.45:0/1156143517 >> 172.21.15.45:0/1156143517 conn(0x559c20f88a60 msgr2=0x559c21021c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:55.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.312+0000 7fd529e5db80 1 -- 172.21.15.45:0/1156143517 shutdown_connections 2024-05-10T03:40:55.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.312+0000 7fd529e5db80 1 -- 172.21.15.45:0/1156143517 wait complete. 2024-05-10T03:40:55.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.312+0000 7fd529e5db80 1 -- start start 2024-05-10T03:40:55.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.312+0000 7fd529e5db80 1 Processor -- start 2024-05-10T03:40:55.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.312+0000 7fd529e5db80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c210266a0 0x559c21034d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.312+0000 7fd529e5db80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c21027570 0x559c210352a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.312+0000 7fd529e5db80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c21027ec0 0x559c210361d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.312+0000 7fd529e5db80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c21036710 con 0x559c21027ec0 2024-05-10T03:40:55.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.313+0000 7fd529e5db80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c21036880 con 0x559c21027570 2024-05-10T03:40:55.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.313+0000 7fd529e5db80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c21036a40 con 0x559c210266a0 2024-05-10T03:40:55.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.313+0000 7fd529e5db80 10 client.0 _ll_register_callbacks cb 0x559c20eebb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:55.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.313+0000 7fd513fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c21027ec0 0x559c210361d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.313+0000 7fd513fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c21027ec0 0x559c210361d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60422/0 (socket says 172.21.15.45:60422) 2024-05-10T03:40:55.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.313+0000 7fd513fff700 1 -- 172.21.15.45:0/2336482320 learned_addr learned my addr 172.21.15.45:0/2336482320 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:55.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.313+0000 7fd5137fe700 1 --2- 172.21.15.45:0/2336482320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c210266a0 0x559c21034d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.313+0000 7fd512ffd700 1 --2- 172.21.15.45:0/2336482320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c21027570 0x559c210352a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.313+0000 7fd513fff700 1 -- 172.21.15.45:0/2336482320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c210266a0 msgr2=0x559c21034d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:55.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.313+0000 7fd513fff700 1 --2- 172.21.15.45:0/2336482320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c210266a0 0x559c21034d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.313+0000 7fd513fff700 1 -- 172.21.15.45:0/2336482320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c21027570 msgr2=0x559c210352a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:55.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.313+0000 7fd513fff700 1 --2- 172.21.15.45:0/2336482320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c21027570 0x559c210352a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.313+0000 7fd513fff700 1 -- 172.21.15.45:0/2336482320 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559c20dc73b0 con 0x559c21027ec0 2024-05-10T03:40:55.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.313+0000 7fd513fff700 1 --2- 172.21.15.45:0/2336482320 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c21027ec0 0x559c210361d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009690 tx=0x7fd50c015690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be900c19cbd79e2d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:55.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.313+0000 7fd4f2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:55.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.313+0000 7fd4f2ffd700 1 -- 172.21.15.45:0/2336482320 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c01a040 con 0x559c21027ec0 2024-05-10T03:40:55.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.313+0000 7fd4f2ffd700 1 -- 172.21.15.45:0/2336482320 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd50c016690 con 0x559c21027ec0 2024-05-10T03:40:55.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.314+0000 7fd529e5db80 1 -- 172.21.15.45:0/2336482320 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd504016070 con 0x559c21027ec0 2024-05-10T03:40:55.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.314+0000 7fd4f2ffd700 1 -- 172.21.15.45:0/2336482320 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd50c00d040 con 0x559c21027ec0 2024-05-10T03:40:55.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.314+0000 7fd529e5db80 10 client.15843 fetch_fsmap learned FSMap version 28 2024-05-10T03:40:55.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.314+0000 7fd529e5db80 1 -- 172.21.15.45:0/2336482320 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x559c20dcbcd0 con 0x559c21027ec0 2024-05-10T03:40:55.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.314+0000 7fd4f2ffd700 1 -- 172.21.15.45:0/2336482320 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd504016070 con 0x559c21027ec0 2024-05-10T03:40:55.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.314+0000 7fd4f2ffd700 1 -- 172.21.15.45:0/2336482320 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd50c01d030 con 0x559c21027ec0 2024-05-10T03:40:55.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.314+0000 7fd529e5db80 10 client.15843 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:40:55.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.314+0000 7fd529e5db80 10 client.15843 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:40:55.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.314+0000 7fd529e5db80 20 client.15843 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:55.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.314+0000 7fd529e5db80 1 --2- 172.21.15.45:0/2336482320 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x559c21092bf0 0x559c21095010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:55.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.314+0000 7fd529e5db80 4 client.15843 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-10T03:40:55.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.314+0000 7fd529e5db80 1 -- 172.21.15.45:0/2336482320 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559c20f3eec0 con 0x559c21092bf0 2024-05-10T03:40:55.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.314+0000 7fd5137fe700 1 --2- 172.21.15.45:0/2336482320 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x559c21092bf0 0x559c21095010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:55.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.315+0000 7fd4f2ffd700 10 client.15843 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:55.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.315+0000 7fd5137fe700 1 --2- 172.21.15.45:0/2336482320 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x559c21092bf0 0x559c21095010 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=425126763224cabb server_cookie=db86bc196736dd8a in_seq=0 out_seq=0 2024-05-10T03:40:55.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.315+0000 7fd4f2ffd700 1 -- 172.21.15.45:0/2336482320 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559c20f3eec0 con 0x559c21092bf0 2024-05-10T03:40:55.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.315+0000 7fd4f2ffd700 10 client.15843 handle_command_reply: tid=0 2024-05-10T03:40:55.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.315+0000 7fd529e5db80 1 client.15843 shutdown 2024-05-10T03:40:55.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.315+0000 7fd529e5db80 1 -- 172.21.15.45:0/2336482320 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c21027ec0 msgr2=0x559c210361d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:55.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.315+0000 7fd529e5db80 1 --2- 172.21.15.45:0/2336482320 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c21027ec0 0x559c210361d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009690 tx=0x7fd50c015690 comp rx=0 tx=0).stop 2024-05-10T03:40:55.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.315+0000 7fd529e5db80 1 -- 172.21.15.45:0/2336482320 shutdown_connections 2024-05-10T03:40:55.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.315+0000 7fd529e5db80 1 --2- 172.21.15.45:0/2336482320 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x559c21092bf0 0x559c21095010 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.315+0000 7fd529e5db80 1 --2- 172.21.15.45:0/2336482320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559c210266a0 0x559c21034d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.315+0000 7fd529e5db80 1 --2- 172.21.15.45:0/2336482320 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c21027ec0 0x559c210361d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.315+0000 7fd529e5db80 1 --2- 172.21.15.45:0/2336482320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c21027570 0x559c210352a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.315+0000 7fd4f2ffd700 0 client.15843 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:55.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.315+0000 7fd529e5db80 1 -- 172.21.15.45:0/2336482320 >> 172.21.15.45:0/2336482320 conn(0x559c20f88a60 msgr2=0x559c2102b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:55.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.316+0000 7fd529e5db80 1 -- 172.21.15.45:0/2336482320 shutdown_connections 2024-05-10T03:40:55.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.316+0000 7fd529e5db80 1 -- 172.21.15.45:0/2336482320 wait complete. 2024-05-10T03:40:55.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.316+0000 7fd529e5db80 20 client.15843 trim_cache size 0 max 16384 2024-05-10T03:40:55.324 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-05-10T03:40:55.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.316+0000 7fd519b19700 1 -- 172.21.15.45:0/3603392106 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd4fc0a1260 msgr2=0x7fd4fc0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:55.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.316+0000 7fd519b19700 1 --2- 172.21.15.45:0/3603392106 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd4fc0a1260 0x7fd4fc0a3770 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd514101b10 tx=0x7fd504009260 comp rx=0 tx=0).stop 2024-05-10T03:40:55.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.316+0000 7fd519b19700 1 -- 172.21.15.45:0/3603392106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd514101c10 msgr2=0x7fd51419a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:55.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.316+0000 7fd519b19700 1 --2- 172.21.15.45:0/3603392106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd514101c10 0x7fd51419a790 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd508000c00 tx=0x7fd50800f740 comp rx=0 tx=0).stop 2024-05-10T03:40:55.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.316+0000 7fd519b19700 1 -- 172.21.15.45:0/3603392106 shutdown_connections 2024-05-10T03:40:55.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.316+0000 7fd519b19700 1 --2- 172.21.15.45:0/3603392106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd514100af0 0x7fd51419a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.316+0000 7fd519b19700 1 --2- 172.21.15.45:0/3603392106 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd4fc0a1260 0x7fd4fc0a3770 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.316+0000 7fd519b19700 1 --2- 172.21.15.45:0/3603392106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5141025b0 0x7fd5141a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.316+0000 7fd519b19700 1 --2- 172.21.15.45:0/3603392106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd514101c10 0x7fd51419a790 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:55.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.316+0000 7fd519b19700 1 -- 172.21.15.45:0/3603392106 >> 172.21.15.45:0/3603392106 conn(0x7fd5140fc100 msgr2=0x7fd5140697c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:55.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.316+0000 7fd519b19700 1 -- 172.21.15.45:0/3603392106 shutdown_connections 2024-05-10T03:40:55.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:55.316+0000 7fd519b19700 1 -- 172.21.15.45:0/3603392106 wait complete. 2024-05-10T03:40:55.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:54 smithi106 ceph-mon[46996]: pgmap v304: 129 pgs: 129 active+clean; 660 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:40:55.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:54 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2529755013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:40:55.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:54 smithi154 ceph-mon[46565]: pgmap v304: 129 pgs: 129 active+clean; 660 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:40:55.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:54 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2529755013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:40:56.333 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-10T03:40:56.334 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-10T03:40:56.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.494+0000 7efd7c2d3700 1 -- 172.21.15.45:0/429804366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd74101be0 msgr2=0x7efd74101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:56.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.494+0000 7efd7c2d3700 1 --2- 172.21.15.45:0/429804366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd74101be0 0x7efd74101ff0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7efd64009990 tx=0x7efd64009ca0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.494+0000 7efd7c2d3700 1 -- 172.21.15.45:0/429804366 shutdown_connections 2024-05-10T03:40:56.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.494+0000 7efd7c2d3700 1 --2- 172.21.15.45:0/429804366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd74100ac0 0x7efd74100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.494+0000 7efd7c2d3700 1 --2- 172.21.15.45:0/429804366 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd74102580 0x7efd74108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.494+0000 7efd7c2d3700 1 --2- 172.21.15.45:0/429804366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd74101be0 0x7efd74101ff0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.494+0000 7efd7c2d3700 1 -- 172.21.15.45:0/429804366 >> 172.21.15.45:0/429804366 conn(0x7efd740fc0d0 msgr2=0x7efd740fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:56.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.494+0000 7efd7c2d3700 1 -- 172.21.15.45:0/429804366 shutdown_connections 2024-05-10T03:40:56.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.494+0000 7efd7c2d3700 1 -- 172.21.15.45:0/429804366 wait complete. 2024-05-10T03:40:56.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.495+0000 7efd7c2d3700 1 Processor -- start 2024-05-10T03:40:56.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.495+0000 7efd7c2d3700 1 -- start start 2024-05-10T03:40:56.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.495+0000 7efd7c2d3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd74100ac0 0x7efd74104880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.495+0000 7efd7c2d3700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd74101be0 0x7efd74102f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.495+0000 7efd7c2d3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd74102580 0x7efd74103460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.495+0000 7efd7c2d3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd74103b40 con 0x7efd74100ac0 2024-05-10T03:40:56.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.495+0000 7efd7c2d3700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd74103cb0 con 0x7efd74101be0 2024-05-10T03:40:56.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.495+0000 7efd7c2d3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd741a20b0 con 0x7efd74102580 2024-05-10T03:40:56.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.496+0000 7efd7a06f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd74100ac0 0x7efd74104880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.496+0000 7efd7a06f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd74100ac0 0x7efd74104880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60448/0 (socket says 172.21.15.45:60448) 2024-05-10T03:40:56.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.496+0000 7efd7a06f700 1 -- 172.21.15.45:0/4235134565 learned_addr learned my addr 172.21.15.45:0/4235134565 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:56.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.496+0000 7efd7a870700 1 --2- 172.21.15.45:0/4235134565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd74102580 0x7efd74103460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.496+0000 7efd7986e700 1 --2- 172.21.15.45:0/4235134565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd74101be0 0x7efd74102f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.496+0000 7efd7a06f700 1 -- 172.21.15.45:0/4235134565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd74102580 msgr2=0x7efd74103460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:56.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.496+0000 7efd7a06f700 1 --2- 172.21.15.45:0/4235134565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd74102580 0x7efd74103460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.496+0000 7efd7a06f700 1 -- 172.21.15.45:0/4235134565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd74101be0 msgr2=0x7efd74102f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:56.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.496+0000 7efd7a06f700 1 --2- 172.21.15.45:0/4235134565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd74101be0 0x7efd74102f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.496+0000 7efd7a06f700 1 -- 172.21.15.45:0/4235134565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd640095f0 con 0x7efd74100ac0 2024-05-10T03:40:56.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.496+0000 7efd7a06f700 1 --2- 172.21.15.45:0/4235134565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd74100ac0 0x7efd74104880 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7efd7000d950 tx=0x7efd7000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:56.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.496+0000 7efd6b7fe700 1 -- 172.21.15.45:0/4235134565 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd70004220 con 0x7efd74100ac0 2024-05-10T03:40:56.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.496+0000 7efd6b7fe700 1 -- 172.21.15.45:0/4235134565 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efd70004380 con 0x7efd74100ac0 2024-05-10T03:40:56.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.496+0000 7efd7c2d3700 1 -- 172.21.15.45:0/4235134565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd741a2310 con 0x7efd74100ac0 2024-05-10T03:40:56.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.496+0000 7efd6b7fe700 1 -- 172.21.15.45:0/4235134565 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd70003cb0 con 0x7efd74100ac0 2024-05-10T03:40:56.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.496+0000 7efd7c2d3700 1 -- 172.21.15.45:0/4235134565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd741a27f0 con 0x7efd74100ac0 2024-05-10T03:40:56.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.499+0000 7efd6b7fe700 1 -- 172.21.15.45:0/4235134565 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7efd70009730 con 0x7efd74100ac0 2024-05-10T03:40:56.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.499+0000 7efd6b7fe700 1 --2- 172.21.15.45:0/4235134565 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efd600a1260 0x7efd600a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.500+0000 7efd6b7fe700 1 -- 172.21.15.45:0/4235134565 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7efd700cc9a0 con 0x7efd74100ac0 2024-05-10T03:40:56.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.500+0000 7efd7986e700 1 --2- 172.21.15.45:0/4235134565 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efd600a1260 0x7efd600a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.500+0000 7efd7986e700 1 --2- 172.21.15.45:0/4235134565 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efd600a1260 0x7efd600a3770 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7efd64006010 tx=0x7efd6401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:56.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.500+0000 7efd8c617b80 1 Processor -- start 2024-05-10T03:40:56.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.501+0000 7efd8c617b80 1 -- start start 2024-05-10T03:40:56.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.501+0000 7efd8c617b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac18720 0x560a7ac18b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.501+0000 7efd8c617b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560a7ac195f0 0x560a7ac19a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.501+0000 7efd8c617b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560a7ac19f40 0x560a7ac20840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.501+0000 7efd8c617b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a7ab3f1d0 con 0x560a7ac18720 2024-05-10T03:40:56.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.501+0000 7efd8c617b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a7ab3cb90 con 0x560a7ac19f40 2024-05-10T03:40:56.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.501+0000 7efd8c617b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a7ab38480 con 0x560a7ac195f0 2024-05-10T03:40:56.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.501+0000 7efd7a06f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac18720 0x560a7ac18b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.501+0000 7efd7a06f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac18720 0x560a7ac18b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60452/0 (socket says 172.21.15.45:60452) 2024-05-10T03:40:56.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.501+0000 7efd7a06f700 1 -- 172.21.15.45:0/3174006395 learned_addr learned my addr 172.21.15.45:0/3174006395 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:56.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.501+0000 7efd7986e700 1 --2- 172.21.15.45:0/3174006395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560a7ac195f0 0x560a7ac19a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.501+0000 7efd7a870700 1 --2- 172.21.15.45:0/3174006395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560a7ac19f40 0x560a7ac20840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.501+0000 7efd7a06f700 1 -- 172.21.15.45:0/3174006395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560a7ac195f0 msgr2=0x560a7ac19a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:56.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.501+0000 7efd7a06f700 1 --2- 172.21.15.45:0/3174006395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560a7ac195f0 0x560a7ac19a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.501+0000 7efd7a06f700 1 -- 172.21.15.45:0/3174006395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560a7ac19f40 msgr2=0x560a7ac20840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:56.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.501+0000 7efd7a06f700 1 --2- 172.21.15.45:0/3174006395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560a7ac19f40 0x560a7ac20840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.501+0000 7efd7a06f700 1 -- 172.21.15.45:0/3174006395 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a7a9b9430 con 0x560a7ac18720 2024-05-10T03:40:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.502+0000 7efd7a06f700 1 --2- 172.21.15.45:0/3174006395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac18720 0x560a7ac18b70 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7efd700a1840 tx=0x7efd7000df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55597b49762f50d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.502+0000 7efd68d7f700 1 -- 172.21.15.45:0/3174006395 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7009d720 con 0x560a7ac18720 2024-05-10T03:40:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.502+0000 7efd68d7f700 1 -- 172.21.15.45:0/3174006395 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efd70084040 con 0x560a7ac18720 2024-05-10T03:40:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.502+0000 7efd68d7f700 1 -- 172.21.15.45:0/3174006395 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd70099b50 con 0x560a7ac18720 2024-05-10T03:40:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.503+0000 7efd8c617b80 1 -- 172.21.15.45:0/3174006395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac18720 msgr2=0x560a7ac18b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.503+0000 7efd8c617b80 1 --2- 172.21.15.45:0/3174006395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac18720 0x560a7ac18b70 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7efd700a1840 tx=0x7efd7000df90 comp rx=0 tx=0).stop 2024-05-10T03:40:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.503+0000 7efd8c617b80 1 -- 172.21.15.45:0/3174006395 shutdown_connections 2024-05-10T03:40:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.503+0000 7efd8c617b80 1 --2- 172.21.15.45:0/3174006395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560a7ac19f40 0x560a7ac20840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.503+0000 7efd8c617b80 1 --2- 172.21.15.45:0/3174006395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac18720 0x560a7ac18b70 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.503+0000 7efd8c617b80 1 --2- 172.21.15.45:0/3174006395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560a7ac195f0 0x560a7ac19a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.503+0000 7efd8c617b80 1 -- 172.21.15.45:0/3174006395 >> 172.21.15.45:0/3174006395 conn(0x560a7ab7aae0 msgr2=0x560a7ac13060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.503+0000 7efd8c617b80 1 -- 172.21.15.45:0/3174006395 shutdown_connections 2024-05-10T03:40:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.503+0000 7efd8c617b80 1 -- 172.21.15.45:0/3174006395 wait complete. 2024-05-10T03:40:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.503+0000 7efd8c617b80 1 -- start start 2024-05-10T03:40:56.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.503+0000 7efd8c617b80 1 Processor -- start 2024-05-10T03:40:56.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.504+0000 7efd8c617b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560a7ac18720 0x560a7ac22780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.504+0000 7efd8c617b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac195f0 0x560a7ac22cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.504+0000 7efd8c617b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560a7ac19f40 0x560a7ac29bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.504+0000 7efd8c617b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a7aad45e0 con 0x560a7ac195f0 2024-05-10T03:40:56.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.504+0000 7efd8c617b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a7aad4280 con 0x560a7ac19f40 2024-05-10T03:40:56.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.504+0000 7efd8c617b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a7a9bb720 con 0x560a7ac18720 2024-05-10T03:40:56.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.504+0000 7efd8c617b80 10 client.0 _ll_register_callbacks cb 0x560a7aaddbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:56.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.504+0000 7efd7986e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac195f0 0x560a7ac22cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.504+0000 7efd7986e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac195f0 0x560a7ac22cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60460/0 (socket says 172.21.15.45:60460) 2024-05-10T03:40:56.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.504+0000 7efd7986e700 1 -- 172.21.15.45:0/3122083990 learned_addr learned my addr 172.21.15.45:0/3122083990 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:56.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.504+0000 7efd7a06f700 1 --2- 172.21.15.45:0/3122083990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560a7ac18720 0x560a7ac22780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.504+0000 7efd7a870700 1 --2- 172.21.15.45:0/3122083990 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560a7ac19f40 0x560a7ac29bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.504+0000 7efd7986e700 1 -- 172.21.15.45:0/3122083990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560a7ac18720 msgr2=0x560a7ac22780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:56.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.504+0000 7efd7986e700 1 --2- 172.21.15.45:0/3122083990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560a7ac18720 0x560a7ac22780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.504+0000 7efd7986e700 1 -- 172.21.15.45:0/3122083990 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560a7ac19f40 msgr2=0x560a7ac29bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:56.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.504+0000 7efd7986e700 1 --2- 172.21.15.45:0/3122083990 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560a7ac19f40 0x560a7ac29bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.504+0000 7efd7986e700 1 -- 172.21.15.45:0/3122083990 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd741a27f0 con 0x560a7ac195f0 2024-05-10T03:40:56.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.504+0000 7efd7a870700 1 --2- 172.21.15.45:0/3122083990 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560a7ac19f40 0x560a7ac29bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:40:56.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.504+0000 7efd7986e700 1 --2- 172.21.15.45:0/3122083990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac195f0 0x560a7ac22cc0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7efd6400f7b0 tx=0x7efd64009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6647f01860d32cd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:56.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.504+0000 7efd5dffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:56.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.505+0000 7efd5dffb700 1 -- 172.21.15.45:0/3122083990 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6401d040 con 0x560a7ac195f0 2024-05-10T03:40:56.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.505+0000 7efd5dffb700 1 -- 172.21.15.45:0/3122083990 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7efd64004a30 con 0x560a7ac195f0 2024-05-10T03:40:56.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.505+0000 7efd8c617b80 1 -- 172.21.15.45:0/3122083990 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560a7aa912f0 con 0x560a7ac195f0 2024-05-10T03:40:56.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.505+0000 7efd5dffb700 1 -- 172.21.15.45:0/3122083990 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd64004bf0 con 0x560a7ac195f0 2024-05-10T03:40:56.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.505+0000 7efd8c617b80 10 client.15855 fetch_fsmap learned FSMap version 28 2024-05-10T03:40:56.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.505+0000 7efd8c617b80 1 -- 172.21.15.45:0/3122083990 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x560a7a965be0 con 0x560a7ac195f0 2024-05-10T03:40:56.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.505+0000 7efd5dffb700 1 -- 172.21.15.45:0/3122083990 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efd64038080 con 0x560a7ac195f0 2024-05-10T03:40:56.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.505+0000 7efd5dffb700 1 -- 172.21.15.45:0/3122083990 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7efd64023870 con 0x560a7ac195f0 2024-05-10T03:40:56.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.505+0000 7efd8c617b80 10 client.15855 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:40:56.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.505+0000 7efd8c617b80 10 client.15855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:40:56.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.505+0000 7efd8c617b80 20 client.15855 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:56.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.505+0000 7efd8c617b80 1 --2- 172.21.15.45:0/3122083990 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x560a7ac2e400 0x560a7ac30850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.505+0000 7efd8c617b80 4 client.15855 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:40:56.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.505+0000 7efd8c617b80 1 -- 172.21.15.45:0/3122083990 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560a7abe7800 con 0x560a7ac2e400 2024-05-10T03:40:56.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.506+0000 7efd7a06f700 1 --2- 172.21.15.45:0/3122083990 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x560a7ac2e400 0x560a7ac30850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.506+0000 7efd5dffb700 10 client.15855 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:56.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.506+0000 7efd7a06f700 1 --2- 172.21.15.45:0/3122083990 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x560a7ac2e400 0x560a7ac30850 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66a5ee7d150298ab server_cookie=9bb0ad36e9b7a224 in_seq=0 out_seq=0 2024-05-10T03:40:56.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.507+0000 7efd5dffb700 1 -- 172.21.15.45:0/3122083990 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560a7abe7800 con 0x560a7ac2e400 2024-05-10T03:40:56.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.507+0000 7efd5dffb700 10 client.15855 handle_command_reply: tid=0 2024-05-10T03:40:56.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.507+0000 7efd8c617b80 1 client.15855 shutdown 2024-05-10T03:40:56.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.507+0000 7efd8c617b80 1 -- 172.21.15.45:0/3122083990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac195f0 msgr2=0x560a7ac22cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:56.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.507+0000 7efd8c617b80 1 --2- 172.21.15.45:0/3122083990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac195f0 0x560a7ac22cc0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7efd6400f7b0 tx=0x7efd64009310 comp rx=0 tx=0).stop 2024-05-10T03:40:56.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.507+0000 7efd8c617b80 1 -- 172.21.15.45:0/3122083990 shutdown_connections 2024-05-10T03:40:56.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.507+0000 7efd8c617b80 1 --2- 172.21.15.45:0/3122083990 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x560a7ac2e400 0x560a7ac30850 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.507+0000 7efd8c617b80 1 --2- 172.21.15.45:0/3122083990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560a7ac18720 0x560a7ac22780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.507+0000 7efd8c617b80 1 --2- 172.21.15.45:0/3122083990 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560a7ac19f40 0x560a7ac29bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.507+0000 7efd8c617b80 1 --2- 172.21.15.45:0/3122083990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac195f0 0x560a7ac22cc0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.507+0000 7efd5dffb700 0 client.15855 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:56.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.507+0000 7efd8c617b80 1 -- 172.21.15.45:0/3122083990 >> 172.21.15.45:0/3122083990 conn(0x560a7ab7aae0 msgr2=0x560a7ac13030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:56.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.507+0000 7efd8c617b80 1 -- 172.21.15.45:0/3122083990 shutdown_connections 2024-05-10T03:40:56.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.507+0000 7efd8c617b80 1 -- 172.21.15.45:0/3122083990 wait complete. 2024-05-10T03:40:56.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.507+0000 7efd8c617b80 20 client.15855 trim_cache size 0 max 16384 2024-05-10T03:40:56.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.526+0000 7efd8c617b80 1 Processor -- start 2024-05-10T03:40:56.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.526+0000 7efd8c617b80 1 -- start start 2024-05-10T03:40:56.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.526+0000 7efd8c617b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560a7ac18720 0x560a7ac1d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.526+0000 7efd8c617b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560a7ac195f0 0x560a7ac29b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.526+0000 7efd8c617b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac19f40 0x560a7ac1d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.526+0000 7efd8c617b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a7ac194b0 con 0x560a7ac19f40 2024-05-10T03:40:56.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.526+0000 7efd8c617b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a7ac0d840 con 0x560a7ac195f0 2024-05-10T03:40:56.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.526+0000 7efd8c617b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a7ac20760 con 0x560a7ac18720 2024-05-10T03:40:56.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.526+0000 7efd7a870700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac19f40 0x560a7ac1d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.526+0000 7efd7a870700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac19f40 0x560a7ac1d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60476/0 (socket says 172.21.15.45:60476) 2024-05-10T03:40:56.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.526+0000 7efd7a870700 1 -- 172.21.15.45:0/250484705 learned_addr learned my addr 172.21.15.45:0/250484705 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:56.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.527+0000 7efd7986e700 1 --2- 172.21.15.45:0/250484705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560a7ac195f0 0x560a7ac29b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.527+0000 7efd7a06f700 1 --2- 172.21.15.45:0/250484705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560a7ac18720 0x560a7ac1d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.527+0000 7efd7a870700 1 -- 172.21.15.45:0/250484705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560a7ac18720 msgr2=0x560a7ac1d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:56.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.527+0000 7efd7a870700 1 --2- 172.21.15.45:0/250484705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560a7ac18720 0x560a7ac1d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.527+0000 7efd7a870700 1 -- 172.21.15.45:0/250484705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560a7ac195f0 msgr2=0x560a7ac29b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:56.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.527+0000 7efd7a870700 1 --2- 172.21.15.45:0/250484705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560a7ac195f0 0x560a7ac29b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.527+0000 7efd7a870700 1 -- 172.21.15.45:0/250484705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a7aafe5e0 con 0x560a7ac19f40 2024-05-10T03:40:56.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.527+0000 7efd7a870700 1 --2- 172.21.15.45:0/250484705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac19f40 0x560a7ac1d9d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7efd6c007530 tx=0x7efd6c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa3648cbfaf42ac1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:56.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.527+0000 7efd69580700 1 -- 172.21.15.45:0/250484705 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c00e040 con 0x560a7ac19f40 2024-05-10T03:40:56.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.527+0000 7efd69580700 1 -- 172.21.15.45:0/250484705 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efd6c00f040 con 0x560a7ac19f40 2024-05-10T03:40:56.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.527+0000 7efd69580700 1 -- 172.21.15.45:0/250484705 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c01eae0 con 0x560a7ac19f40 2024-05-10T03:40:56.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.528+0000 7efd8c617b80 1 -- 172.21.15.45:0/250484705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac19f40 msgr2=0x560a7ac1d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:56.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.528+0000 7efd8c617b80 1 --2- 172.21.15.45:0/250484705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac19f40 0x560a7ac1d9d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7efd6c007530 tx=0x7efd6c00b040 comp rx=0 tx=0).stop 2024-05-10T03:40:56.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.528+0000 7efd8c617b80 1 -- 172.21.15.45:0/250484705 shutdown_connections 2024-05-10T03:40:56.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.528+0000 7efd8c617b80 1 --2- 172.21.15.45:0/250484705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560a7ac18720 0x560a7ac1d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.528+0000 7efd8c617b80 1 --2- 172.21.15.45:0/250484705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac19f40 0x560a7ac1d9d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.528+0000 7efd8c617b80 1 --2- 172.21.15.45:0/250484705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560a7ac195f0 0x560a7ac29b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.528+0000 7efd8c617b80 1 -- 172.21.15.45:0/250484705 >> 172.21.15.45:0/250484705 conn(0x560a7ab7aae0 msgr2=0x560a7ac22780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:56.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.528+0000 7efd8c617b80 1 -- 172.21.15.45:0/250484705 shutdown_connections 2024-05-10T03:40:56.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.528+0000 7efd8c617b80 1 -- 172.21.15.45:0/250484705 wait complete. 2024-05-10T03:40:56.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.528+0000 7efd8c617b80 1 -- start start 2024-05-10T03:40:56.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.529+0000 7efd8c617b80 1 Processor -- start 2024-05-10T03:40:56.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.529+0000 7efd8c617b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560a7ac18720 0x560a7ac28310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.529+0000 7efd8c617b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560a7ac195f0 0x560a7ac28850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.529+0000 7efd8c617b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac19f40 0x560a7ac28d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.529+0000 7efd8c617b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a7ac29ee0 con 0x560a7ac19f40 2024-05-10T03:40:56.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.529+0000 7efd8c617b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a7ac848b0 con 0x560a7ac195f0 2024-05-10T03:40:56.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.529+0000 7efd8c617b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a7ac849f0 con 0x560a7ac18720 2024-05-10T03:40:56.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.529+0000 7efd8c617b80 10 client.0 _ll_register_callbacks cb 0x560a7aaddbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:56.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.529+0000 7efd7a870700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac19f40 0x560a7ac28d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.529+0000 7efd7a870700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac19f40 0x560a7ac28d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60486/0 (socket says 172.21.15.45:60486) 2024-05-10T03:40:56.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.529+0000 7efd7a870700 1 -- 172.21.15.45:0/1011137377 learned_addr learned my addr 172.21.15.45:0/1011137377 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:56.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.529+0000 7efd7986e700 1 --2- 172.21.15.45:0/1011137377 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560a7ac195f0 0x560a7ac28850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.529+0000 7efd7a06f700 1 --2- 172.21.15.45:0/1011137377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560a7ac18720 0x560a7ac28310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.530+0000 7efd7a870700 1 -- 172.21.15.45:0/1011137377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560a7ac18720 msgr2=0x560a7ac28310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:56.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.530+0000 7efd7a870700 1 --2- 172.21.15.45:0/1011137377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560a7ac18720 0x560a7ac28310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.530+0000 7efd7a870700 1 -- 172.21.15.45:0/1011137377 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560a7ac195f0 msgr2=0x560a7ac28850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:56.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.530+0000 7efd7a870700 1 --2- 172.21.15.45:0/1011137377 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560a7ac195f0 0x560a7ac28850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.530+0000 7efd7a870700 1 -- 172.21.15.45:0/1011137377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6c009260 con 0x560a7ac19f40 2024-05-10T03:40:56.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.530+0000 7efd7986e700 1 --2- 172.21.15.45:0/1011137377 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560a7ac195f0 0x560a7ac28850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:40:56.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.530+0000 7efd7a870700 1 --2- 172.21.15.45:0/1011137377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac19f40 0x560a7ac28d90 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7efd6c007500 tx=0x7efd6c01ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=400899b26923cbbb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:56.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.530+0000 7efd5dffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:56.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.530+0000 7efd5dffb700 1 -- 172.21.15.45:0/1011137377 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c00e040 con 0x560a7ac19f40 2024-05-10T03:40:56.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.530+0000 7efd5dffb700 1 -- 172.21.15.45:0/1011137377 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7efd6c003c00 con 0x560a7ac19f40 2024-05-10T03:40:56.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.530+0000 7efd8c617b80 1 -- 172.21.15.45:0/1011137377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efd70084040 con 0x560a7ac19f40 2024-05-10T03:40:56.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.530+0000 7efd5dffb700 1 -- 172.21.15.45:0/1011137377 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd6c003dc0 con 0x560a7ac19f40 2024-05-10T03:40:56.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.530+0000 7efd8c617b80 10 client.15861 fetch_fsmap learned FSMap version 28 2024-05-10T03:40:56.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.530+0000 7efd8c617b80 1 -- 172.21.15.45:0/1011137377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x560a7a9bdd50 con 0x560a7ac19f40 2024-05-10T03:40:56.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.530+0000 7efd5dffb700 1 -- 172.21.15.45:0/1011137377 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efd70084040 con 0x560a7ac19f40 2024-05-10T03:40:56.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.531+0000 7efd5dffb700 1 -- 172.21.15.45:0/1011137377 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7efd6c0045c0 con 0x560a7ac19f40 2024-05-10T03:40:56.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.531+0000 7efd8c617b80 10 client.15861 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:40:56.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.531+0000 7efd8c617b80 10 client.15861 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:40:56.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.531+0000 7efd8c617b80 20 client.15861 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:56.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.531+0000 7efd8c617b80 1 --2- 172.21.15.45:0/1011137377 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x560a7ac86330 0x560a7ac88750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.531+0000 7efd8c617b80 4 client.15861 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-10T03:40:56.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.531+0000 7efd8c617b80 1 -- 172.21.15.45:0/1011137377 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x560a7ab30f40 con 0x560a7ac86330 2024-05-10T03:40:56.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.531+0000 7efd7a06f700 1 --2- 172.21.15.45:0/1011137377 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x560a7ac86330 0x560a7ac88750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.531+0000 7efd7a06f700 1 --2- 172.21.15.45:0/1011137377 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x560a7ac86330 0x560a7ac88750 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85f3f3e08e52b557 server_cookie=a79b8f530d51a01b in_seq=0 out_seq=0 2024-05-10T03:40:56.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.531+0000 7efd5dffb700 10 client.15861 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:56.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.533+0000 7efd5dffb700 1 -- 172.21.15.45:0/1011137377 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x560a7ab30f40 con 0x560a7ac86330 2024-05-10T03:40:56.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.533+0000 7efd5dffb700 10 client.15861 handle_command_reply: tid=0 2024-05-10T03:40:56.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.533+0000 7efd8c617b80 1 client.15861 shutdown 2024-05-10T03:40:56.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.533+0000 7efd8c617b80 1 -- 172.21.15.45:0/1011137377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac19f40 msgr2=0x560a7ac28d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:56.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.533+0000 7efd8c617b80 1 --2- 172.21.15.45:0/1011137377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac19f40 0x560a7ac28d90 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7efd6c007500 tx=0x7efd6c01ef20 comp rx=0 tx=0).stop 2024-05-10T03:40:56.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.533+0000 7efd8c617b80 1 -- 172.21.15.45:0/1011137377 shutdown_connections 2024-05-10T03:40:56.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.533+0000 7efd8c617b80 1 --2- 172.21.15.45:0/1011137377 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x560a7ac86330 0x560a7ac88750 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.533+0000 7efd8c617b80 1 --2- 172.21.15.45:0/1011137377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560a7ac18720 0x560a7ac28310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.533+0000 7efd8c617b80 1 --2- 172.21.15.45:0/1011137377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560a7ac19f40 0x560a7ac28d90 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.533+0000 7efd5dffb700 0 client.15861 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:56.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.533+0000 7efd8c617b80 1 --2- 172.21.15.45:0/1011137377 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560a7ac195f0 0x560a7ac28850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.533+0000 7efd8c617b80 1 -- 172.21.15.45:0/1011137377 >> 172.21.15.45:0/1011137377 conn(0x560a7ab7aae0 msgr2=0x560a7ac20a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:56.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.533+0000 7efd8c617b80 1 -- 172.21.15.45:0/1011137377 shutdown_connections 2024-05-10T03:40:56.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.533+0000 7efd8c617b80 1 -- 172.21.15.45:0/1011137377 wait complete. 2024-05-10T03:40:56.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.533+0000 7efd8c617b80 20 client.15861 trim_cache size 0 max 16384 2024-05-10T03:40:56.542 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:40:56.542 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-05-10T03:40:56.542 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "0e4073b2-b6b3-4c48-9400-9f5d476825b2", 2024-05-10T03:40:56.542 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-05-10T03:40:56.542 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:40:56.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.534+0000 7efd7c2d3700 1 -- 172.21.15.45:0/4235134565 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efd600a1260 msgr2=0x7efd600a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:56.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.534+0000 7efd7c2d3700 1 --2- 172.21.15.45:0/4235134565 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efd600a1260 0x7efd600a3770 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7efd64006010 tx=0x7efd6401a040 comp rx=0 tx=0).stop 2024-05-10T03:40:56.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.534+0000 7efd7c2d3700 1 -- 172.21.15.45:0/4235134565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd74100ac0 msgr2=0x7efd74104880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:56.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.534+0000 7efd7c2d3700 1 --2- 172.21.15.45:0/4235134565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd74100ac0 0x7efd74104880 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7efd7000d950 tx=0x7efd7000dc60 comp rx=0 tx=0).stop 2024-05-10T03:40:56.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.534+0000 7efd7c2d3700 1 -- 172.21.15.45:0/4235134565 shutdown_connections 2024-05-10T03:40:56.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.534+0000 7efd7c2d3700 1 --2- 172.21.15.45:0/4235134565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd74102580 0x7efd74103460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.534+0000 7efd7c2d3700 1 --2- 172.21.15.45:0/4235134565 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efd600a1260 0x7efd600a3770 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.534+0000 7efd7c2d3700 1 --2- 172.21.15.45:0/4235134565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd74100ac0 0x7efd74104880 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.534+0000 7efd7c2d3700 1 --2- 172.21.15.45:0/4235134565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd74101be0 0x7efd74102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.534+0000 7efd7c2d3700 1 -- 172.21.15.45:0/4235134565 >> 172.21.15.45:0/4235134565 conn(0x7efd740fc0d0 msgr2=0x7efd740fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:56.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.534+0000 7efd7c2d3700 1 -- 172.21.15.45:0/4235134565 shutdown_connections 2024-05-10T03:40:56.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.534+0000 7efd7c2d3700 1 -- 172.21.15.45:0/4235134565 wait complete. 2024-05-10T03:40:56.550 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-10T03:40:56.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.702+0000 7f47f04fa700 1 -- 172.21.15.45:0/2463681742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e81025b0 msgr2=0x7f47e8108e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:56.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.702+0000 7f47f04fa700 1 --2- 172.21.15.45:0/2463681742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e81025b0 0x7f47e8108e60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f47e000b0a0 tx=0x7f47e000b3b0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.702+0000 7f47f04fa700 1 -- 172.21.15.45:0/2463681742 shutdown_connections 2024-05-10T03:40:56.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.702+0000 7f47f04fa700 1 --2- 172.21.15.45:0/2463681742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e81025b0 0x7f47e8108e60 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.702+0000 7f47f04fa700 1 --2- 172.21.15.45:0/2463681742 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47e8100af0 0x7f47e8100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.702+0000 7f47f04fa700 1 --2- 172.21.15.45:0/2463681742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47e8101c10 0x7f47e8102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.702+0000 7f47f04fa700 1 -- 172.21.15.45:0/2463681742 >> 172.21.15.45:0/2463681742 conn(0x7f47e80fc0e0 msgr2=0x7f47e80fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:56.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.702+0000 7f47f04fa700 1 -- 172.21.15.45:0/2463681742 shutdown_connections 2024-05-10T03:40:56.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.702+0000 7f47f04fa700 1 -- 172.21.15.45:0/2463681742 wait complete. 2024-05-10T03:40:56.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.703+0000 7f47f04fa700 1 Processor -- start 2024-05-10T03:40:56.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.703+0000 7f47f04fa700 1 -- start start 2024-05-10T03:40:56.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.703+0000 7f47f04fa700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47e8100af0 0x7f47e8073f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.703+0000 7f47f04fa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e8101c10 0x7f47e819ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.703+0000 7f47f04fa700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47e81025b0 0x7f47e819f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.703+0000 7f47f04fa700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e819fba0 con 0x7f47e8101c10 2024-05-10T03:40:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.703+0000 7f47f04fa700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e819fd10 con 0x7f47e81025b0 2024-05-10T03:40:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.703+0000 7f47f04fa700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e819fed0 con 0x7f47e8100af0 2024-05-10T03:40:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.703+0000 7f47eda95700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e8101c10 0x7f47e819ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.703+0000 7f47eda95700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e8101c10 0x7f47e819ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60494/0 (socket says 172.21.15.45:60494) 2024-05-10T03:40:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.703+0000 7f47eda95700 1 -- 172.21.15.45:0/4067070982 learned_addr learned my addr 172.21.15.45:0/4067070982 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.703+0000 7f47ee296700 1 --2- 172.21.15.45:0/4067070982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47e8100af0 0x7f47e8073f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.703+0000 7f47eea97700 1 --2- 172.21.15.45:0/4067070982 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47e81025b0 0x7f47e819f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.703+0000 7f47eda95700 1 -- 172.21.15.45:0/4067070982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47e8100af0 msgr2=0x7f47e8073f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.703+0000 7f47eda95700 1 --2- 172.21.15.45:0/4067070982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47e8100af0 0x7f47e8073f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.703+0000 7f47eda95700 1 -- 172.21.15.45:0/4067070982 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47e81025b0 msgr2=0x7f47e819f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.703+0000 7f47eda95700 1 --2- 172.21.15.45:0/4067070982 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47e81025b0 0x7f47e819f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.703+0000 7f47eda95700 1 -- 172.21.15.45:0/4067070982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e0009d00 con 0x7f47e8101c10 2024-05-10T03:40:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.704+0000 7f47eda95700 1 --2- 172.21.15.45:0/4067070982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e8101c10 0x7f47e819ce30 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f47dc00e9a0 tx=0x7f47dc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:56.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.704+0000 7f47db7fe700 1 -- 172.21.15.45:0/4067070982 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc009790 con 0x7f47e8101c10 2024-05-10T03:40:56.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.704+0000 7f47db7fe700 1 -- 172.21.15.45:0/4067070982 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f47dc010430 con 0x7f47e8101c10 2024-05-10T03:40:56.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.704+0000 7f47f04fa700 1 -- 172.21.15.45:0/4067070982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e81a01b0 con 0x7f47e8101c10 2024-05-10T03:40:56.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.704+0000 7f47db7fe700 1 -- 172.21.15.45:0/4067070982 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc018680 con 0x7f47e8101c10 2024-05-10T03:40:56.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.704+0000 7f47f04fa700 1 -- 172.21.15.45:0/4067070982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e81a06c0 con 0x7f47e8101c10 2024-05-10T03:40:56.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.707+0000 7f47db7fe700 1 -- 172.21.15.45:0/4067070982 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f47dc010910 con 0x7f47e8101c10 2024-05-10T03:40:56.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.708+0000 7f47db7fe700 1 --2- 172.21.15.45:0/4067070982 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f47d40a1260 0x7f47d40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.708+0000 7f47db7fe700 1 -- 172.21.15.45:0/4067070982 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f47dc014070 con 0x7f47e8101c10 2024-05-10T03:40:56.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.708+0000 7f47ee296700 1 --2- 172.21.15.45:0/4067070982 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f47d40a1260 0x7f47d40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.708+0000 7f47ee296700 1 --2- 172.21.15.45:0/4067070982 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f47d40a1260 0x7f47d40a3770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f47e8101b10 tx=0x7f47e4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:56.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.709+0000 7f480083eb80 1 Processor -- start 2024-05-10T03:40:56.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.709+0000 7f480083eb80 1 -- start start 2024-05-10T03:40:56.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.709+0000 7f480083eb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4baa2c6a0 0x55b4baa2caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.709+0000 7f480083eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2d570 0x55b4baa2d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.709+0000 7f480083eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4baa2dec0 0x55b4baa347c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.709+0000 7f480083eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4ba953150 con 0x55b4baa2d570 2024-05-10T03:40:56.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.709+0000 7f480083eb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4ba950b10 con 0x55b4baa2c6a0 2024-05-10T03:40:56.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.709+0000 7f480083eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4ba94c400 con 0x55b4baa2dec0 2024-05-10T03:40:56.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.710+0000 7f47eda95700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2d570 0x55b4baa2d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.710+0000 7f47ee296700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4baa2c6a0 0x55b4baa2caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.710+0000 7f47eda95700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2d570 0x55b4baa2d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60496/0 (socket says 172.21.15.45:60496) 2024-05-10T03:40:56.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.710+0000 7f47eda95700 1 -- 172.21.15.45:0/3330243987 learned_addr learned my addr 172.21.15.45:0/3330243987 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:56.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.710+0000 7f47eea97700 1 --2- 172.21.15.45:0/3330243987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4baa2dec0 0x55b4baa347c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.710+0000 7f47eda95700 1 -- 172.21.15.45:0/3330243987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4baa2dec0 msgr2=0x55b4baa347c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:56.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.710+0000 7f47eda95700 1 --2- 172.21.15.45:0/3330243987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4baa2dec0 0x55b4baa347c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.710+0000 7f47eda95700 1 -- 172.21.15.45:0/3330243987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4baa2c6a0 msgr2=0x55b4baa2caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:56.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.710+0000 7f47eda95700 1 --2- 172.21.15.45:0/3330243987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4baa2c6a0 0x55b4baa2caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.710+0000 7f47eda95700 1 -- 172.21.15.45:0/3330243987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4ba7cd3b0 con 0x55b4baa2d570 2024-05-10T03:40:56.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.710+0000 7f47eda95700 1 --2- 172.21.15.45:0/3330243987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2d570 0x55b4baa2d980 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f47dc099f30 tx=0x7f47dc010670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74162ca6e7441c98 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:56.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.710+0000 7f47d8ff9700 1 -- 172.21.15.45:0/3330243987 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc09ddd0 con 0x55b4baa2d570 2024-05-10T03:40:56.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.710+0000 7f47d8ff9700 1 -- 172.21.15.45:0/3330243987 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f47dc0a2420 con 0x55b4baa2d570 2024-05-10T03:40:56.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.710+0000 7f47d8ff9700 1 -- 172.21.15.45:0/3330243987 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc0a21b0 con 0x55b4baa2d570 2024-05-10T03:40:56.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.711+0000 7f480083eb80 1 -- 172.21.15.45:0/3330243987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2d570 msgr2=0x55b4baa2d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:56.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.711+0000 7f480083eb80 1 --2- 172.21.15.45:0/3330243987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2d570 0x55b4baa2d980 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f47dc099f30 tx=0x7f47dc010670 comp rx=0 tx=0).stop 2024-05-10T03:40:56.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.711+0000 7f480083eb80 1 -- 172.21.15.45:0/3330243987 shutdown_connections 2024-05-10T03:40:56.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.711+0000 7f480083eb80 1 --2- 172.21.15.45:0/3330243987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4baa2dec0 0x55b4baa347c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.711+0000 7f480083eb80 1 --2- 172.21.15.45:0/3330243987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4baa2c6a0 0x55b4baa2caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.711+0000 7f480083eb80 1 --2- 172.21.15.45:0/3330243987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2d570 0x55b4baa2d980 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.711+0000 7f480083eb80 1 -- 172.21.15.45:0/3330243987 >> 172.21.15.45:0/3330243987 conn(0x55b4ba98ea60 msgr2=0x55b4baa26fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:56.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.711+0000 7f480083eb80 1 -- 172.21.15.45:0/3330243987 shutdown_connections 2024-05-10T03:40:56.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.711+0000 7f480083eb80 1 -- 172.21.15.45:0/3330243987 wait complete. 2024-05-10T03:40:56.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.712+0000 7f480083eb80 1 -- start start 2024-05-10T03:40:56.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.712+0000 7f480083eb80 1 Processor -- start 2024-05-10T03:40:56.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.712+0000 7f480083eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4baa2c6a0 0x55b4baa36710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.712+0000 7f480083eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2d570 0x55b4baa36c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.712+0000 7f480083eb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4baa2dec0 0x55b4baa3dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.712+0000 7f480083eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4ba8e8560 con 0x55b4baa2d570 2024-05-10T03:40:56.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.712+0000 7f480083eb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4ba8e8200 con 0x55b4baa2dec0 2024-05-10T03:40:56.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.712+0000 7f480083eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4ba7cf6a0 con 0x55b4baa2c6a0 2024-05-10T03:40:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.712+0000 7f480083eb80 10 client.0 _ll_register_callbacks cb 0x55b4ba8f1b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.712+0000 7f47eda95700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2d570 0x55b4baa36c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.712+0000 7f47eda95700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2d570 0x55b4baa36c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60502/0 (socket says 172.21.15.45:60502) 2024-05-10T03:40:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.712+0000 7f47eda95700 1 -- 172.21.15.45:0/3116271962 learned_addr learned my addr 172.21.15.45:0/3116271962 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.713+0000 7f47ee296700 1 --2- 172.21.15.45:0/3116271962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4baa2c6a0 0x55b4baa36710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.713+0000 7f47eea97700 1 --2- 172.21.15.45:0/3116271962 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4baa2dec0 0x55b4baa3dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.713+0000 7f47eda95700 1 -- 172.21.15.45:0/3116271962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4baa2c6a0 msgr2=0x55b4baa36710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.713+0000 7f47eda95700 1 --2- 172.21.15.45:0/3116271962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4baa2c6a0 0x55b4baa36710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.713+0000 7f47eda95700 1 -- 172.21.15.45:0/3116271962 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4baa2dec0 msgr2=0x55b4baa3dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.713+0000 7f47eda95700 1 --2- 172.21.15.45:0/3116271962 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4baa2dec0 0x55b4baa3dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.713+0000 7f47eda95700 1 -- 172.21.15.45:0/3116271962 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e81a06c0 con 0x55b4baa2d570 2024-05-10T03:40:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.713+0000 7f47eda95700 1 --2- 172.21.15.45:0/3116271962 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2d570 0x55b4baa36c50 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f47dc099ee0 tx=0x7f47dc0caae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82bf4ca22f855e7c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.713+0000 7f47d1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.713+0000 7f47d1ffb700 1 -- 172.21.15.45:0/3116271962 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc099490 con 0x55b4baa2d570 2024-05-10T03:40:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.713+0000 7f47d1ffb700 1 -- 172.21.15.45:0/3116271962 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f47dc09ddd0 con 0x55b4baa2d570 2024-05-10T03:40:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.713+0000 7f480083eb80 1 -- 172.21.15.45:0/3116271962 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b4ba8a5270 con 0x55b4baa2d570 2024-05-10T03:40:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.713+0000 7f47d1ffb700 1 -- 172.21.15.45:0/3116271962 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47dc098340 con 0x55b4baa2d570 2024-05-10T03:40:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.714+0000 7f480083eb80 10 client.15873 fetch_fsmap learned FSMap version 28 2024-05-10T03:40:56.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.714+0000 7f480083eb80 1 -- 172.21.15.45:0/3116271962 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55b4ba779b60 con 0x55b4baa2d570 2024-05-10T03:40:56.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.714+0000 7f47d1ffb700 1 -- 172.21.15.45:0/3116271962 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55b4ba8a5270 con 0x55b4baa2d570 2024-05-10T03:40:56.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.714+0000 7f47d1ffb700 1 -- 172.21.15.45:0/3116271962 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f47dc099170 con 0x55b4baa2d570 2024-05-10T03:40:56.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.714+0000 7f480083eb80 10 client.15873 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:40:56.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.714+0000 7f480083eb80 10 client.15873 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:40:56.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.714+0000 7f480083eb80 20 client.15873 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:56.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.714+0000 7f480083eb80 1 --2- 172.21.15.45:0/3116271962 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55b4baa41fa0 0x55b4baa443f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.714+0000 7f480083eb80 4 client.15873 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:40:56.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.714+0000 7f480083eb80 1 -- 172.21.15.45:0/3116271962 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b4ba9fb780 con 0x55b4baa41fa0 2024-05-10T03:40:56.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.714+0000 7f47ee296700 1 --2- 172.21.15.45:0/3116271962 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55b4baa41fa0 0x55b4baa443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.715+0000 7f47d1ffb700 10 client.15873 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:56.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.715+0000 7f47ee296700 1 --2- 172.21.15.45:0/3116271962 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55b4baa41fa0 0x55b4baa443f0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26efdb2ffe7f971d server_cookie=ad0122f8173bc256 in_seq=0 out_seq=0 2024-05-10T03:40:56.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.715+0000 7f47d1ffb700 1 -- 172.21.15.45:0/3116271962 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b4ba9fb780 con 0x55b4baa41fa0 2024-05-10T03:40:56.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.715+0000 7f47d1ffb700 10 client.15873 handle_command_reply: tid=0 2024-05-10T03:40:56.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.715+0000 7f480083eb80 1 client.15873 shutdown 2024-05-10T03:40:56.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.716+0000 7f480083eb80 1 -- 172.21.15.45:0/3116271962 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2d570 msgr2=0x55b4baa36c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:56.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.716+0000 7f480083eb80 1 --2- 172.21.15.45:0/3116271962 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2d570 0x55b4baa36c50 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f47dc099ee0 tx=0x7f47dc0caae0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.716+0000 7f480083eb80 1 -- 172.21.15.45:0/3116271962 shutdown_connections 2024-05-10T03:40:56.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.716+0000 7f480083eb80 1 --2- 172.21.15.45:0/3116271962 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55b4baa41fa0 0x55b4baa443f0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.716+0000 7f480083eb80 1 --2- 172.21.15.45:0/3116271962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4baa2c6a0 0x55b4baa36710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.716+0000 7f47d1ffb700 0 client.15873 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:56.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.716+0000 7f480083eb80 1 --2- 172.21.15.45:0/3116271962 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4baa2dec0 0x55b4baa3dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.716+0000 7f480083eb80 1 --2- 172.21.15.45:0/3116271962 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2d570 0x55b4baa36c50 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.716+0000 7f480083eb80 1 -- 172.21.15.45:0/3116271962 >> 172.21.15.45:0/3116271962 conn(0x55b4ba98ea60 msgr2=0x55b4baa26fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:56.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.716+0000 7f480083eb80 1 -- 172.21.15.45:0/3116271962 shutdown_connections 2024-05-10T03:40:56.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.716+0000 7f480083eb80 1 -- 172.21.15.45:0/3116271962 wait complete. 2024-05-10T03:40:56.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.716+0000 7f480083eb80 20 client.15873 trim_cache size 0 max 16384 2024-05-10T03:40:56.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.734+0000 7f480083eb80 1 Processor -- start 2024-05-10T03:40:56.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.734+0000 7f480083eb80 1 -- start start 2024-05-10T03:40:56.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.734+0000 7f480083eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4baa2c6a0 0x55b4baa3bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.734+0000 7f480083eb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4baa2d570 0x55b4baa3c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.734+0000 7f480083eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2dec0 0x55b4baa36710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.734+0000 7f480083eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4baa3e610 con 0x55b4baa2dec0 2024-05-10T03:40:56.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.734+0000 7f480083eb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4baa28770 con 0x55b4baa2d570 2024-05-10T03:40:56.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.734+0000 7f480083eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4baa217c0 con 0x55b4baa2c6a0 2024-05-10T03:40:56.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.734+0000 7f47eea97700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2dec0 0x55b4baa36710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.734+0000 7f47eea97700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2dec0 0x55b4baa36710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60518/0 (socket says 172.21.15.45:60518) 2024-05-10T03:40:56.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.734+0000 7f47eea97700 1 -- 172.21.15.45:0/2970287068 learned_addr learned my addr 172.21.15.45:0/2970287068 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:56.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.734+0000 7f47ee296700 1 --2- 172.21.15.45:0/2970287068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4baa2c6a0 0x55b4baa3bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.734+0000 7f47eea97700 1 -- 172.21.15.45:0/2970287068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4baa2c6a0 msgr2=0x55b4baa3bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:56.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.734+0000 7f47eda95700 1 --2- 172.21.15.45:0/2970287068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4baa2d570 0x55b4baa3c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.734+0000 7f47eea97700 1 --2- 172.21.15.45:0/2970287068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4baa2c6a0 0x55b4baa3bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.734+0000 7f47eea97700 1 -- 172.21.15.45:0/2970287068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4baa2d570 msgr2=0x55b4baa3c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:56.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.734+0000 7f47eea97700 1 --2- 172.21.15.45:0/2970287068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4baa2d570 0x55b4baa3c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.734+0000 7f47eea97700 1 -- 172.21.15.45:0/2970287068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4ba912560 con 0x55b4baa2dec0 2024-05-10T03:40:56.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.735+0000 7f47eea97700 1 --2- 172.21.15.45:0/2970287068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2dec0 0x55b4baa36710 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009900 tx=0x7f47e000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edde7c759c06712 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:56.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.735+0000 7f47d97fa700 1 -- 172.21.15.45:0/2970287068 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e000e040 con 0x55b4baa2dec0 2024-05-10T03:40:56.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.735+0000 7f47d97fa700 1 -- 172.21.15.45:0/2970287068 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f47e00077c0 con 0x55b4baa2dec0 2024-05-10T03:40:56.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.735+0000 7f47d97fa700 1 -- 172.21.15.45:0/2970287068 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e0005370 con 0x55b4baa2dec0 2024-05-10T03:40:56.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.735+0000 7f480083eb80 1 -- 172.21.15.45:0/2970287068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2dec0 msgr2=0x55b4baa36710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:56.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.735+0000 7f480083eb80 1 --2- 172.21.15.45:0/2970287068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2dec0 0x55b4baa36710 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009900 tx=0x7f47e000b700 comp rx=0 tx=0).stop 2024-05-10T03:40:56.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.736+0000 7f480083eb80 1 -- 172.21.15.45:0/2970287068 shutdown_connections 2024-05-10T03:40:56.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.736+0000 7f480083eb80 1 --2- 172.21.15.45:0/2970287068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4baa2c6a0 0x55b4baa3bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.736+0000 7f480083eb80 1 --2- 172.21.15.45:0/2970287068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2dec0 0x55b4baa36710 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.736+0000 7f480083eb80 1 --2- 172.21.15.45:0/2970287068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4baa2d570 0x55b4baa3c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.736+0000 7f480083eb80 1 -- 172.21.15.45:0/2970287068 >> 172.21.15.45:0/2970287068 conn(0x55b4ba98ea60 msgr2=0x55b4baa307a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:56.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.736+0000 7f480083eb80 1 -- 172.21.15.45:0/2970287068 shutdown_connections 2024-05-10T03:40:56.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.736+0000 7f480083eb80 1 -- 172.21.15.45:0/2970287068 wait complete. 2024-05-10T03:40:56.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.736+0000 7f480083eb80 1 -- start start 2024-05-10T03:40:56.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.736+0000 7f480083eb80 1 Processor -- start 2024-05-10T03:40:56.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.736+0000 7f480083eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4baa2c6a0 0x55b4baa92610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.736+0000 7f480083eb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4baa2d570 0x55b4baa94b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.736+0000 7f480083eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2dec0 0x55b4baa97110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.736+0000 7f480083eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4baa977b0 con 0x55b4baa2dec0 2024-05-10T03:40:56.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.736+0000 7f480083eb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4baa97920 con 0x55b4baa2d570 2024-05-10T03:40:56.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.736+0000 7f480083eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4baa97ae0 con 0x55b4baa2c6a0 2024-05-10T03:40:56.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.736+0000 7f480083eb80 10 client.0 _ll_register_callbacks cb 0x55b4ba8f1b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:40:56.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.737+0000 7f47eea97700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2dec0 0x55b4baa97110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.737+0000 7f47eda95700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4baa2d570 0x55b4baa94b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.737+0000 7f47ee296700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4baa2c6a0 0x55b4baa92610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.737+0000 7f47eda95700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4baa2d570 0x55b4baa94b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.45:59506/0 (socket says 172.21.15.45:59506) 2024-05-10T03:40:56.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.737+0000 7f47eea97700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2dec0 0x55b4baa97110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60534/0 (socket says 172.21.15.45:60534) 2024-05-10T03:40:56.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.737+0000 7f47eea97700 1 -- 172.21.15.45:0/1586224450 learned_addr learned my addr 172.21.15.45:0/1586224450 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:40:56.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.737+0000 7f47eea97700 1 -- 172.21.15.45:0/1586224450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4baa2c6a0 msgr2=0x55b4baa92610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:56.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.737+0000 7f47eea97700 1 --2- 172.21.15.45:0/1586224450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4baa2c6a0 0x55b4baa92610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.737+0000 7f47eea97700 1 -- 172.21.15.45:0/1586224450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4baa2d570 msgr2=0x55b4baa94b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:40:56.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.737+0000 7f47eea97700 1 --2- 172.21.15.45:0/1586224450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4baa2d570 0x55b4baa94b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.737+0000 7f47eea97700 1 -- 172.21.15.45:0/1586224450 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e81098f0 con 0x55b4baa2dec0 2024-05-10T03:40:56.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.737+0000 7f47eda95700 1 --2- 172.21.15.45:0/1586224450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4baa2d570 0x55b4baa94b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:40:56.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.737+0000 7f47eea97700 1 --2- 172.21.15.45:0/1586224450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2dec0 0x55b4baa97110 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f47e0007b40 tx=0x7f47e000bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6aebabc98142ebf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:40:56.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.737+0000 7f47d1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:40:56.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.737+0000 7f47d1ffb700 1 -- 172.21.15.45:0/1586224450 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e000e040 con 0x55b4baa2dec0 2024-05-10T03:40:56.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.737+0000 7f47d1ffb700 1 -- 172.21.15.45:0/1586224450 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f47e00052c0 con 0x55b4baa2dec0 2024-05-10T03:40:56.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.737+0000 7f480083eb80 1 -- 172.21.15.45:0/1586224450 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f47dc0a2420 con 0x55b4baa2dec0 2024-05-10T03:40:56.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.738+0000 7f47d1ffb700 1 -- 172.21.15.45:0/1586224450 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47e0005480 con 0x55b4baa2dec0 2024-05-10T03:40:56.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.738+0000 7f480083eb80 10 client.15879 fetch_fsmap learned FSMap version 28 2024-05-10T03:40:56.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.738+0000 7f480083eb80 1 -- 172.21.15.45:0/1586224450 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55b4ba7d1cd0 con 0x55b4baa2dec0 2024-05-10T03:40:56.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.738+0000 7f47d1ffb700 1 -- 172.21.15.45:0/1586224450 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f47dc0a2420 con 0x55b4baa2dec0 2024-05-10T03:40:56.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.738+0000 7f47d1ffb700 1 -- 172.21.15.45:0/1586224450 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f47e000b0d0 con 0x55b4baa2dec0 2024-05-10T03:40:56.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.738+0000 7f480083eb80 10 client.15879 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:40:56.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.738+0000 7f480083eb80 10 client.15879 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:40:56.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.738+0000 7f480083eb80 20 client.15879 populate_metadata read hostname 'smithi045' 2024-05-10T03:40:56.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.738+0000 7f480083eb80 1 --2- 172.21.15.45:0/1586224450 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55b4baa99100 0x55b4baa9b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:40:56.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.738+0000 7f480083eb80 4 client.15879 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T03:40:56.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.738+0000 7f480083eb80 1 -- 172.21.15.45:0/1586224450 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b4ba944ec0 con 0x55b4baa99100 2024-05-10T03:40:56.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.738+0000 7f47ee296700 1 --2- 172.21.15.45:0/1586224450 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55b4baa99100 0x55b4baa9b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:40:56.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.739+0000 7f47ee296700 1 --2- 172.21.15.45:0/1586224450 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55b4baa99100 0x55b4baa9b520 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33b78604dca204cb server_cookie=68fdb5022cf80c84 in_seq=0 out_seq=0 2024-05-10T03:40:56.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.739+0000 7f47d1ffb700 10 client.15879 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:56.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.739+0000 7f47d1ffb700 1 -- 172.21.15.45:0/1586224450 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55b4ba944ec0 con 0x55b4baa99100 2024-05-10T03:40:56.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.739+0000 7f47d1ffb700 10 client.15879 handle_command_reply: tid=0 2024-05-10T03:40:56.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.739+0000 7f480083eb80 1 client.15879 shutdown 2024-05-10T03:40:56.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.739+0000 7f480083eb80 1 -- 172.21.15.45:0/1586224450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2dec0 msgr2=0x55b4baa97110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:56.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.739+0000 7f480083eb80 1 --2- 172.21.15.45:0/1586224450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2dec0 0x55b4baa97110 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f47e0007b40 tx=0x7f47e000bce0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.739+0000 7f480083eb80 1 -- 172.21.15.45:0/1586224450 shutdown_connections 2024-05-10T03:40:56.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.739+0000 7f480083eb80 1 --2- 172.21.15.45:0/1586224450 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55b4baa99100 0x55b4baa9b520 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.739+0000 7f480083eb80 1 --2- 172.21.15.45:0/1586224450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b4baa2c6a0 0x55b4baa92610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.739+0000 7f480083eb80 1 --2- 172.21.15.45:0/1586224450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4baa2dec0 0x55b4baa97110 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.739+0000 7f480083eb80 1 --2- 172.21.15.45:0/1586224450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b4baa2d570 0x55b4baa94b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.739+0000 7f480083eb80 1 -- 172.21.15.45:0/1586224450 >> 172.21.15.45:0/1586224450 conn(0x55b4ba98ea60 msgr2=0x55b4baa312f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:56.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.739+0000 7f47d1ffb700 0 client.15879 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:40:56.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.739+0000 7f480083eb80 1 -- 172.21.15.45:0/1586224450 shutdown_connections 2024-05-10T03:40:56.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.739+0000 7f480083eb80 1 -- 172.21.15.45:0/1586224450 wait complete. 2024-05-10T03:40:56.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.739+0000 7f480083eb80 20 client.15879 trim_cache size 0 max 16384 2024-05-10T03:40:56.752 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:40:56.752 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-10T03:40:56.752 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": { 2024-05-10T03:40:56.752 INFO:teuthology.orchestra.run.smithi045.stdout: "0e4073b2-b6b3-4c48-9400-9f5d476825b2": { 2024-05-10T03:40:56.752 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/", 2024-05-10T03:40:56.752 INFO:teuthology.orchestra.run.smithi045.stdout: "tag": "0e4073b2-b6b3-4c48-9400-9f5d476825b2", 2024-05-10T03:40:56.752 INFO:teuthology.orchestra.run.smithi045.stdout: "options": "recursive,force" 2024-05-10T03:40:56.752 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:40:56.753 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:40:56.753 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:40:56.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.740+0000 7f47f04fa700 1 -- 172.21.15.45:0/4067070982 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f47d40a1260 msgr2=0x7f47d40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:56.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.740+0000 7f47f04fa700 1 --2- 172.21.15.45:0/4067070982 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f47d40a1260 0x7f47d40a3770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f47e8101b10 tx=0x7f47e4009260 comp rx=0 tx=0).stop 2024-05-10T03:40:56.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.740+0000 7f47f04fa700 1 -- 172.21.15.45:0/4067070982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e8101c10 msgr2=0x7f47e819ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:40:56.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.740+0000 7f47f04fa700 1 --2- 172.21.15.45:0/4067070982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e8101c10 0x7f47e819ce30 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f47dc00e9a0 tx=0x7f47dc00ecb0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.740+0000 7f47f04fa700 1 -- 172.21.15.45:0/4067070982 shutdown_connections 2024-05-10T03:40:56.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.740+0000 7f47f04fa700 1 --2- 172.21.15.45:0/4067070982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47e8100af0 0x7f47e8073f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.740+0000 7f47f04fa700 1 --2- 172.21.15.45:0/4067070982 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f47d40a1260 0x7f47d40a3770 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.740+0000 7f47f04fa700 1 --2- 172.21.15.45:0/4067070982 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47e81025b0 0x7f47e819f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.740+0000 7f47f04fa700 1 --2- 172.21.15.45:0/4067070982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e8101c10 0x7f47e819ce30 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:40:56.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.740+0000 7f47f04fa700 1 -- 172.21.15.45:0/4067070982 >> 172.21.15.45:0/4067070982 conn(0x7f47e80fc0e0 msgr2=0x7f47e8104e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:40:56.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.740+0000 7f47f04fa700 1 -- 172.21.15.45:0/4067070982 shutdown_connections 2024-05-10T03:40:56.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:40:56.740+0000 7f47f04fa700 1 -- 172.21.15.45:0/4067070982 wait complete. 2024-05-10T03:40:56.756 INFO:tasks.cephfs.filesystem:scrub status for tag:0e4073b2-b6b3-4c48-9400-9f5d476825b2 - {'path': '/', 'tag': '0e4073b2-b6b3-4c48-9400-9f5d476825b2', 'options': 'recursive,force'} 2024-05-10T03:40:57.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:56 smithi045 ceph-mon[42520]: pgmap v305: 129 pgs: 129 active+clean; 660 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:40:57.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:56 smithi045 ceph-mon[42520]: scrub queued for path: / 2024-05-10T03:40:57.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:56 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:40:57.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:56 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:40:57.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:56 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:40:57.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:56 smithi106 ceph-mon[46996]: pgmap v305: 129 pgs: 129 active+clean; 660 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:40:57.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:56 smithi106 ceph-mon[46996]: scrub queued for path: / 2024-05-10T03:40:57.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:56 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:40:57.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:56 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:40:57.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:56 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:40:57.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:56 smithi154 ceph-mon[46565]: pgmap v305: 129 pgs: 129 active+clean; 660 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:40:57.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:56 smithi154 ceph-mon[46565]: scrub queued for path: / 2024-05-10T03:40:57.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:56 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:40:57.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:56 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:40:57.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:56 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:40:59.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:40:59 smithi045 ceph-mon[42520]: pgmap v306: 129 pgs: 129 active+clean; 660 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:40:59.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:40:59 smithi106 ceph-mon[46996]: pgmap v306: 129 pgs: 129 active+clean; 660 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:40:59.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:40:59 smithi154 ceph-mon[46565]: pgmap v306: 129 pgs: 129 active+clean; 660 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:41:01.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:01 smithi045 ceph-mon[42520]: pgmap v307: 129 pgs: 129 active+clean; 669 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-05-10T03:41:01.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:01 smithi045 ceph-mon[42520]: scrub summary: idle 2024-05-10T03:41:01.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:01 smithi106 ceph-mon[46996]: pgmap v307: 129 pgs: 129 active+clean; 669 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-05-10T03:41:01.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:01 smithi106 ceph-mon[46996]: scrub summary: idle 2024-05-10T03:41:01.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:01 smithi154 ceph-mon[46565]: pgmap v307: 129 pgs: 129 active+clean; 669 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-05-10T03:41:01.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:01 smithi154 ceph-mon[46565]: scrub summary: idle 2024-05-10T03:41:02.775 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.771+0000 7f48500f2700 1 -- 172.21.15.45:0/1705228222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4848100ac0 msgr2=0x7f4848100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.771+0000 7f48500f2700 1 --2- 172.21.15.45:0/1705228222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4848100ac0 0x7f4848100ed0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4844009990 tx=0x7f4844009ca0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.771+0000 7f48500f2700 1 -- 172.21.15.45:0/1705228222 shutdown_connections 2024-05-10T03:41:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.771+0000 7f48500f2700 1 --2- 172.21.15.45:0/1705228222 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4848102580 0x7f4848108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.771+0000 7f48500f2700 1 --2- 172.21.15.45:0/1705228222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4848100ac0 0x7f4848100ed0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.771+0000 7f48500f2700 1 --2- 172.21.15.45:0/1705228222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4848101be0 0x7f4848101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.771+0000 7f48500f2700 1 -- 172.21.15.45:0/1705228222 >> 172.21.15.45:0/1705228222 conn(0x7f48480fc0f0 msgr2=0x7f48480fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.771+0000 7f48500f2700 1 -- 172.21.15.45:0/1705228222 shutdown_connections 2024-05-10T03:41:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.771+0000 7f48500f2700 1 -- 172.21.15.45:0/1705228222 wait complete. 2024-05-10T03:41:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.771+0000 7f48500f2700 1 Processor -- start 2024-05-10T03:41:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.772+0000 7f48500f2700 1 -- start start 2024-05-10T03:41:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.772+0000 7f48500f2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4848100ac0 0x7f48480690e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.772+0000 7f48500f2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4848101be0 0x7f484819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:02.776 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.772+0000 7f48500f2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4848102580 0x7f484819f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:02.777 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.772+0000 7f48500f2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484819fb20 con 0x7f4848101be0 2024-05-10T03:41:02.777 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.772+0000 7f48500f2700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484819fc90 con 0x7f4848102580 2024-05-10T03:41:02.777 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.772+0000 7f48500f2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484819fe50 con 0x7f4848100ac0 2024-05-10T03:41:02.777 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.772+0000 7f484d68d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4848101be0 0x7f484819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:02.777 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.772+0000 7f484d68d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4848101be0 0x7f484819ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39070/0 (socket says 172.21.15.45:39070) 2024-05-10T03:41:02.777 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.772+0000 7f484d68d700 1 -- 172.21.15.45:0/1496032 learned_addr learned my addr 172.21.15.45:0/1496032 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:02.777 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.772+0000 7f484de8e700 1 --2- 172.21.15.45:0/1496032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4848100ac0 0x7f48480690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:02.777 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.772+0000 7f484e68f700 1 --2- 172.21.15.45:0/1496032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4848102580 0x7f484819f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:02.777 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.772+0000 7f484d68d700 1 -- 172.21.15.45:0/1496032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4848100ac0 msgr2=0x7f48480690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:02.777 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.772+0000 7f484d68d700 1 --2- 172.21.15.45:0/1496032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4848100ac0 0x7f48480690e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.777 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.772+0000 7f484d68d700 1 -- 172.21.15.45:0/1496032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4848102580 msgr2=0x7f484819f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:02.777 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.772+0000 7f484d68d700 1 --2- 172.21.15.45:0/1496032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4848102580 0x7f484819f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.777 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.772+0000 7f484d68d700 1 -- 172.21.15.45:0/1496032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48440095f0 con 0x7f4848101be0 2024-05-10T03:41:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.772+0000 7f484e68f700 1 --2- 172.21.15.45:0/1496032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4848102580 0x7f484819f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.773+0000 7f484d68d700 1 --2- 172.21.15.45:0/1496032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4848101be0 0x7f484819ce70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f483c00e9a0 tx=0x7f483c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.773+0000 7f483affd700 1 -- 172.21.15.45:0/1496032 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c009790 con 0x7f4848101be0 2024-05-10T03:41:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.773+0000 7f483affd700 1 -- 172.21.15.45:0/1496032 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f483c00cbd0 con 0x7f4848101be0 2024-05-10T03:41:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.773+0000 7f48500f2700 1 -- 172.21.15.45:0/1496032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48481a0130 con 0x7f4848101be0 2024-05-10T03:41:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.773+0000 7f483affd700 1 -- 172.21.15.45:0/1496032 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c018680 con 0x7f4848101be0 2024-05-10T03:41:02.778 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.773+0000 7f48500f2700 1 -- 172.21.15.45:0/1496032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48481a0640 con 0x7f4848101be0 2024-05-10T03:41:02.779 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.775+0000 7f483affd700 1 -- 172.21.15.45:0/1496032 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f483c0188a0 con 0x7f4848101be0 2024-05-10T03:41:02.779 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.776+0000 7f483affd700 1 --2- 172.21.15.45:0/1496032 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f48340a11b0 0x7f48340a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:02.779 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.776+0000 7f484de8e700 1 --2- 172.21.15.45:0/1496032 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f48340a11b0 0x7f48340a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:02.779 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.776+0000 7f483affd700 1 -- 172.21.15.45:0/1496032 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f483c014070 con 0x7f4848101be0 2024-05-10T03:41:02.779 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.777+0000 7f4860436b80 1 Processor -- start 2024-05-10T03:41:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.777+0000 7f4860436b80 1 -- start start 2024-05-10T03:41:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.777+0000 7f484de8e700 1 --2- 172.21.15.45:0/1496032 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f48340a11b0 0x7f48340a36c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4844006010 tx=0x7f484401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.777+0000 7f4860436b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1990650 0x55a7d1990a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.777+0000 7f4860436b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a7d1991430 0x55a7d1991840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.777+0000 7f4860436b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d1991d80 0x55a7d1998680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.777+0000 7f4860436b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7d18b30f0 con 0x55a7d1990650 2024-05-10T03:41:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.777+0000 7f4860436b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7d18b0ab0 con 0x55a7d1991430 2024-05-10T03:41:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.777+0000 7f4860436b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7d18ac3a0 con 0x55a7d1991d80 2024-05-10T03:41:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.777+0000 7f484de8e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1990650 0x55a7d1990a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.777+0000 7f484de8e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1990650 0x55a7d1990a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39084/0 (socket says 172.21.15.45:39084) 2024-05-10T03:41:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.777+0000 7f484de8e700 1 -- 172.21.15.45:0/2315065744 learned_addr learned my addr 172.21.15.45:0/2315065744 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.778+0000 7f484e68f700 1 --2- 172.21.15.45:0/2315065744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d1991d80 0x55a7d1998680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.778+0000 7f484d68d700 1 --2- 172.21.15.45:0/2315065744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a7d1991430 0x55a7d1991840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.778+0000 7f484de8e700 1 -- 172.21.15.45:0/2315065744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d1991d80 msgr2=0x55a7d1998680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.778+0000 7f484de8e700 1 --2- 172.21.15.45:0/2315065744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d1991d80 0x55a7d1998680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.778+0000 7f484de8e700 1 -- 172.21.15.45:0/2315065744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a7d1991430 msgr2=0x55a7d1991840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.778+0000 7f484de8e700 1 --2- 172.21.15.45:0/2315065744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a7d1991430 0x55a7d1991840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.778+0000 7f484de8e700 1 -- 172.21.15.45:0/2315065744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7d172d350 con 0x55a7d1990650 2024-05-10T03:41:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.778+0000 7f484de8e700 1 --2- 172.21.15.45:0/2315065744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1990650 0x55a7d1990a60 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f484400b2e0 tx=0x7f484401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de848a292506a13c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.778+0000 7f4833fff700 1 -- 172.21.15.45:0/2315065744 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484402b070 con 0x55a7d1990650 2024-05-10T03:41:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.778+0000 7f4833fff700 1 -- 172.21.15.45:0/2315065744 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f484401e040 con 0x55a7d1990650 2024-05-10T03:41:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.778+0000 7f4833fff700 1 -- 172.21.15.45:0/2315065744 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4844024890 con 0x55a7d1990650 2024-05-10T03:41:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.779+0000 7f4860436b80 1 -- 172.21.15.45:0/2315065744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1990650 msgr2=0x55a7d1990a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.779+0000 7f4860436b80 1 --2- 172.21.15.45:0/2315065744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1990650 0x55a7d1990a60 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f484400b2e0 tx=0x7f484401f000 comp rx=0 tx=0).stop 2024-05-10T03:41:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.779+0000 7f4860436b80 1 -- 172.21.15.45:0/2315065744 shutdown_connections 2024-05-10T03:41:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.779+0000 7f4860436b80 1 --2- 172.21.15.45:0/2315065744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d1991d80 0x55a7d1998680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.779+0000 7f4860436b80 1 --2- 172.21.15.45:0/2315065744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1990650 0x55a7d1990a60 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.779+0000 7f4860436b80 1 --2- 172.21.15.45:0/2315065744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a7d1991430 0x55a7d1991840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.779+0000 7f4860436b80 1 -- 172.21.15.45:0/2315065744 >> 172.21.15.45:0/2315065744 conn(0x55a7d18eea00 msgr2=0x55a7d1986a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.779+0000 7f4860436b80 1 -- 172.21.15.45:0/2315065744 shutdown_connections 2024-05-10T03:41:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.779+0000 7f4860436b80 1 -- 172.21.15.45:0/2315065744 wait complete. 2024-05-10T03:41:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.780+0000 7f4860436b80 1 -- start start 2024-05-10T03:41:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.780+0000 7f4860436b80 1 Processor -- start 2024-05-10T03:41:02.788 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.780+0000 7f4860436b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d1990650 0x55a7d199a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:02.788 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.780+0000 7f4860436b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1991430 0x55a7d199aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:02.788 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.780+0000 7f4860436b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a7d1991d80 0x55a7d19a19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:02.788 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.780+0000 7f4860436b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7d1848500 con 0x55a7d1991430 2024-05-10T03:41:02.788 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.780+0000 7f4860436b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7d18481a0 con 0x55a7d1991d80 2024-05-10T03:41:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.780+0000 7f4860436b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7d172f640 con 0x55a7d1990650 2024-05-10T03:41:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.781+0000 7f4860436b80 10 client.0 _ll_register_callbacks cb 0x55a7d1851ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.781+0000 7f484d68d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1991430 0x55a7d199aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.781+0000 7f484d68d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1991430 0x55a7d199aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39092/0 (socket says 172.21.15.45:39092) 2024-05-10T03:41:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.781+0000 7f484d68d700 1 -- 172.21.15.45:0/2428778977 learned_addr learned my addr 172.21.15.45:0/2428778977 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.781+0000 7f484e68f700 1 --2- 172.21.15.45:0/2428778977 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a7d1991d80 0x55a7d19a19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.781+0000 7f484de8e700 1 --2- 172.21.15.45:0/2428778977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d1990650 0x55a7d199a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.781+0000 7f484d68d700 1 -- 172.21.15.45:0/2428778977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d1990650 msgr2=0x55a7d199a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.781+0000 7f484d68d700 1 --2- 172.21.15.45:0/2428778977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d1990650 0x55a7d199a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.781+0000 7f484d68d700 1 -- 172.21.15.45:0/2428778977 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a7d1991d80 msgr2=0x55a7d19a19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.781+0000 7f484d68d700 1 --2- 172.21.15.45:0/2428778977 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a7d1991d80 0x55a7d19a19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.781+0000 7f484d68d700 1 -- 172.21.15.45:0/2428778977 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48481098c0 con 0x55a7d1991430 2024-05-10T03:41:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.781+0000 7f484e68f700 1 --2- 172.21.15.45:0/2428778977 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a7d1991d80 0x55a7d19a19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:41:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.781+0000 7f484d68d700 1 --2- 172.21.15.45:0/2428778977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1991430 0x55a7d199aa50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f483c099d70 tx=0x7f483c09a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e1011ef49ee3c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.781+0000 7f48317fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:41:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.781+0000 7f48317fa700 1 -- 172.21.15.45:0/2428778977 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c0a24f0 con 0x55a7d1991430 2024-05-10T03:41:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.781+0000 7f48317fa700 1 -- 172.21.15.45:0/2428778977 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f483c0a2060 con 0x55a7d1991430 2024-05-10T03:41:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.781+0000 7f4860436b80 1 -- 172.21.15.45:0/2428778977 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a7d1805210 con 0x55a7d1991430 2024-05-10T03:41:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.781+0000 7f48317fa700 1 -- 172.21.15.45:0/2428778977 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f483c0a2220 con 0x55a7d1991430 2024-05-10T03:41:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.782+0000 7f4860436b80 10 client.15891 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.782+0000 7f4860436b80 1 -- 172.21.15.45:0/2428778977 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55a7d16d9b00 con 0x55a7d1991430 2024-05-10T03:41:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.782+0000 7f48317fa700 1 -- 172.21.15.45:0/2428778977 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55a7d1805210 con 0x55a7d1991430 2024-05-10T03:41:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.782+0000 7f48317fa700 1 -- 172.21.15.45:0/2428778977 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f483c098fd0 con 0x55a7d1991430 2024-05-10T03:41:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.782+0000 7f4860436b80 10 client.15891 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.782+0000 7f4860436b80 10 client.15891 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:41:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.782+0000 7f4860436b80 20 client.15891 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:02.791 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.782+0000 7f4860436b80 1 --2- 172.21.15.45:0/2428778977 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55a7d19a61e0 0x55a7d19a8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:02.791 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.782+0000 7f4860436b80 4 client.15891 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:41:02.791 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.782+0000 7f4860436b80 1 -- 172.21.15.45:0/2428778977 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a7d195b720 con 0x55a7d19a61e0 2024-05-10T03:41:02.791 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.782+0000 7f484de8e700 1 --2- 172.21.15.45:0/2428778977 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55a7d19a61e0 0x55a7d19a8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:02.791 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.783+0000 7f48317fa700 10 client.15891 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:02.791 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.783+0000 7f484de8e700 1 --2- 172.21.15.45:0/2428778977 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55a7d19a61e0 0x55a7d19a8630 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39077618cd97ac06 server_cookie=7d083394d6c5f091 in_seq=0 out_seq=0 2024-05-10T03:41:02.791 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.784+0000 7f48317fa700 1 -- 172.21.15.45:0/2428778977 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a7d195b720 con 0x55a7d19a61e0 2024-05-10T03:41:02.791 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.784+0000 7f48317fa700 10 client.15891 handle_command_reply: tid=0 2024-05-10T03:41:02.791 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.784+0000 7f4860436b80 1 client.15891 shutdown 2024-05-10T03:41:02.791 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.784+0000 7f4860436b80 1 -- 172.21.15.45:0/2428778977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1991430 msgr2=0x55a7d199aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:02.791 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.784+0000 7f4860436b80 1 --2- 172.21.15.45:0/2428778977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1991430 0x55a7d199aa50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f483c099d70 tx=0x7f483c09a5b0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.791 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.784+0000 7f4860436b80 1 -- 172.21.15.45:0/2428778977 shutdown_connections 2024-05-10T03:41:02.791 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.784+0000 7f4860436b80 1 --2- 172.21.15.45:0/2428778977 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55a7d19a61e0 0x55a7d19a8630 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.792 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.784+0000 7f4860436b80 1 --2- 172.21.15.45:0/2428778977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d1990650 0x55a7d199a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.792 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.784+0000 7f4860436b80 1 --2- 172.21.15.45:0/2428778977 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a7d1991d80 0x55a7d19a19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.792 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.784+0000 7f4860436b80 1 --2- 172.21.15.45:0/2428778977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1991430 0x55a7d199aa50 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.792 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.784+0000 7f4860436b80 1 -- 172.21.15.45:0/2428778977 >> 172.21.15.45:0/2428778977 conn(0x55a7d18eea00 msgr2=0x55a7d1986a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:02.792 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.784+0000 7f48317fa700 0 client.15891 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:02.792 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.784+0000 7f4860436b80 1 -- 172.21.15.45:0/2428778977 shutdown_connections 2024-05-10T03:41:02.792 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.784+0000 7f4860436b80 1 -- 172.21.15.45:0/2428778977 wait complete. 2024-05-10T03:41:02.792 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.784+0000 7f4860436b80 20 client.15891 trim_cache size 0 max 16384 2024-05-10T03:41:02.805 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.800+0000 7f4860436b80 1 Processor -- start 2024-05-10T03:41:02.805 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.800+0000 7f4860436b80 1 -- start start 2024-05-10T03:41:02.805 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.801+0000 7f4860436b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a7d1990650 0x55a7d19a1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:02.805 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.801+0000 7f4860436b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d1991430 0x55a7d19a1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:02.805 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.801+0000 7f4860436b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1991d80 0x55a7d199a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.801+0000 7f4860436b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7d19a3730 con 0x55a7d1991d80 2024-05-10T03:41:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.801+0000 7f4860436b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7d197e9e0 con 0x55a7d1990650 2024-05-10T03:41:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.801+0000 7f4860436b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7d19985a0 con 0x55a7d1991430 2024-05-10T03:41:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.801+0000 7f484e68f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1991d80 0x55a7d199a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.801+0000 7f484e68f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1991d80 0x55a7d199a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39102/0 (socket says 172.21.15.45:39102) 2024-05-10T03:41:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.801+0000 7f484e68f700 1 -- 172.21.15.45:0/1708344749 learned_addr learned my addr 172.21.15.45:0/1708344749 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.801+0000 7f484de8e700 1 --2- 172.21.15.45:0/1708344749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a7d1990650 0x55a7d19a1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.801+0000 7f484d68d700 1 --2- 172.21.15.45:0/1708344749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d1991430 0x55a7d19a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.801+0000 7f484e68f700 1 -- 172.21.15.45:0/1708344749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d1991430 msgr2=0x55a7d19a1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.801+0000 7f484e68f700 1 --2- 172.21.15.45:0/1708344749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d1991430 0x55a7d19a1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.801+0000 7f484e68f700 1 -- 172.21.15.45:0/1708344749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a7d1990650 msgr2=0x55a7d19a1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.801+0000 7f484e68f700 1 --2- 172.21.15.45:0/1708344749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a7d1990650 0x55a7d19a1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.801+0000 7f484e68f700 1 -- 172.21.15.45:0/1708344749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7d1872500 con 0x55a7d1991d80 2024-05-10T03:41:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.801+0000 7f484d68d700 1 --2- 172.21.15.45:0/1708344749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d1991430 0x55a7d19a1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.801+0000 7f484de8e700 1 --2- 172.21.15.45:0/1708344749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a7d1990650 0x55a7d19a1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:41:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.801+0000 7f484e68f700 1 --2- 172.21.15.45:0/1708344749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1991d80 0x55a7d199a510 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4840007a10 tx=0x7f484000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79309b0ce7a3040 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.801+0000 7f4838ff9700 1 -- 172.21.15.45:0/1708344749 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484000e040 con 0x55a7d1991d80 2024-05-10T03:41:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.802+0000 7f4838ff9700 1 -- 172.21.15.45:0/1708344749 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f484000f040 con 0x55a7d1991d80 2024-05-10T03:41:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.802+0000 7f4838ff9700 1 -- 172.21.15.45:0/1708344749 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4840004020 con 0x55a7d1991d80 2024-05-10T03:41:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.802+0000 7f4860436b80 1 -- 172.21.15.45:0/1708344749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1991d80 msgr2=0x55a7d199a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.802+0000 7f4860436b80 1 --2- 172.21.15.45:0/1708344749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1991d80 0x55a7d199a510 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4840007a10 tx=0x7f484000b040 comp rx=0 tx=0).stop 2024-05-10T03:41:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.802+0000 7f4860436b80 1 -- 172.21.15.45:0/1708344749 shutdown_connections 2024-05-10T03:41:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.802+0000 7f4860436b80 1 --2- 172.21.15.45:0/1708344749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1991d80 0x55a7d199a510 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.802+0000 7f4860436b80 1 --2- 172.21.15.45:0/1708344749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a7d1990650 0x55a7d19a1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.802+0000 7f4860436b80 1 --2- 172.21.15.45:0/1708344749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d1991430 0x55a7d19a1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.802+0000 7f4860436b80 1 -- 172.21.15.45:0/1708344749 >> 172.21.15.45:0/1708344749 conn(0x55a7d18eea00 msgr2=0x55a7d1999a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.802+0000 7f4860436b80 1 -- 172.21.15.45:0/1708344749 shutdown_connections 2024-05-10T03:41:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.802+0000 7f4860436b80 1 -- 172.21.15.45:0/1708344749 wait complete. 2024-05-10T03:41:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.803+0000 7f4860436b80 1 -- start start 2024-05-10T03:41:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.803+0000 7f4860436b80 1 Processor -- start 2024-05-10T03:41:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.804+0000 7f4860436b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d1990650 0x55a7d199ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.804+0000 7f4860436b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a7d1991430 0x55a7d199f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.804+0000 7f4860436b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1991d80 0x55a7d19a01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.804+0000 7f4860436b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7d19a0700 con 0x55a7d1991d80 2024-05-10T03:41:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.804+0000 7f4860436b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7d19a0870 con 0x55a7d1991430 2024-05-10T03:41:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.804+0000 7f4860436b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7d19a0a30 con 0x55a7d1990650 2024-05-10T03:41:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.804+0000 7f4860436b80 10 client.0 _ll_register_callbacks cb 0x55a7d1851ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.804+0000 7f484e68f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1991d80 0x55a7d19a01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.804+0000 7f484e68f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1991d80 0x55a7d19a01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39110/0 (socket says 172.21.15.45:39110) 2024-05-10T03:41:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.804+0000 7f484e68f700 1 -- 172.21.15.45:0/427565955 learned_addr learned my addr 172.21.15.45:0/427565955 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.804+0000 7f484de8e700 1 --2- 172.21.15.45:0/427565955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d1990650 0x55a7d199ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.804+0000 7f484d68d700 1 --2- 172.21.15.45:0/427565955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a7d1991430 0x55a7d199f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.804+0000 7f484e68f700 1 -- 172.21.15.45:0/427565955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d1990650 msgr2=0x55a7d199ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.804+0000 7f484e68f700 1 --2- 172.21.15.45:0/427565955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d1990650 0x55a7d199ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.804+0000 7f484e68f700 1 -- 172.21.15.45:0/427565955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a7d1991430 msgr2=0x55a7d199f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.804+0000 7f484e68f700 1 --2- 172.21.15.45:0/427565955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a7d1991430 0x55a7d199f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.804+0000 7f484e68f700 1 -- 172.21.15.45:0/427565955 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a7d172d350 con 0x55a7d1991d80 2024-05-10T03:41:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.804+0000 7f484d68d700 1 --2- 172.21.15.45:0/427565955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a7d1991430 0x55a7d199f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.804+0000 7f484e68f700 1 --2- 172.21.15.45:0/427565955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1991d80 0x55a7d19a01c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4840017a10 tx=0x7f484000afa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a16bbbcecd73f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.804+0000 7f48317fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:41:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.805+0000 7f48317fa700 1 -- 172.21.15.45:0/427565955 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484000e050 con 0x55a7d1991d80 2024-05-10T03:41:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.805+0000 7f48317fa700 1 -- 172.21.15.45:0/427565955 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f484001e3f0 con 0x55a7d1991d80 2024-05-10T03:41:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.805+0000 7f4860436b80 1 -- 172.21.15.45:0/427565955 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f484401e040 con 0x55a7d1991d80 2024-05-10T03:41:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.805+0000 7f48317fa700 1 -- 172.21.15.45:0/427565955 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f484001e5f0 con 0x55a7d1991d80 2024-05-10T03:41:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.805+0000 7f4860436b80 10 client.15897 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.805+0000 7f4860436b80 1 -- 172.21.15.45:0/427565955 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f4840007690 con 0x55a7d1991d80 2024-05-10T03:41:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.805+0000 7f48317fa700 1 -- 172.21.15.45:0/427565955 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f484401e040 con 0x55a7d1991d80 2024-05-10T03:41:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.805+0000 7f48317fa700 1 -- 172.21.15.45:0/427565955 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f484001d070 con 0x55a7d1991d80 2024-05-10T03:41:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.805+0000 7f4860436b80 10 client.15897 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.805+0000 7f4860436b80 10 client.15897 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:41:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.805+0000 7f4860436b80 20 client.15897 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.805+0000 7f4860436b80 1 --2- 172.21.15.45:0/427565955 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55a7d19fcae0 0x55a7d19fef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.805+0000 7f4860436b80 4 client.15897 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T03:41:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.805+0000 7f4860436b80 1 -- 172.21.15.45:0/427565955 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a7d18a4e60 con 0x55a7d19fcae0 2024-05-10T03:41:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.806+0000 7f484de8e700 1 --2- 172.21.15.45:0/427565955 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55a7d19fcae0 0x55a7d19fef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.806+0000 7f484de8e700 1 --2- 172.21.15.45:0/427565955 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55a7d19fcae0 0x55a7d19fef00 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=890e0b5c4de1b4b8 server_cookie=fba7eb34abe9f098 in_seq=0 out_seq=0 2024-05-10T03:41:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.806+0000 7f48317fa700 10 client.15897 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.813+0000 7f48317fa700 1 -- 172.21.15.45:0/427565955 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a7d18a4e60 con 0x55a7d19fcae0 2024-05-10T03:41:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.813+0000 7f48317fa700 10 client.15897 handle_command_reply: tid=0 2024-05-10T03:41:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.813+0000 7f4860436b80 1 client.15897 shutdown 2024-05-10T03:41:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.813+0000 7f4860436b80 1 -- 172.21.15.45:0/427565955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1991d80 msgr2=0x55a7d19a01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.813+0000 7f4860436b80 1 --2- 172.21.15.45:0/427565955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1991d80 0x55a7d19a01c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4840017a10 tx=0x7f484000afa0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.814+0000 7f4860436b80 1 -- 172.21.15.45:0/427565955 shutdown_connections 2024-05-10T03:41:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.814+0000 7f4860436b80 1 --2- 172.21.15.45:0/427565955 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55a7d19fcae0 0x55a7d19fef00 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.814+0000 7f4860436b80 1 --2- 172.21.15.45:0/427565955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7d1990650 0x55a7d199ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.814+0000 7f4860436b80 1 --2- 172.21.15.45:0/427565955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7d1991d80 0x55a7d19a01c0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.814+0000 7f4860436b80 1 --2- 172.21.15.45:0/427565955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a7d1991430 0x55a7d199f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.814+0000 7f48317fa700 0 client.15897 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.814+0000 7f4860436b80 1 -- 172.21.15.45:0/427565955 >> 172.21.15.45:0/427565955 conn(0x55a7d18eea00 msgr2=0x55a7d1999a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.814+0000 7f4860436b80 1 -- 172.21.15.45:0/427565955 shutdown_connections 2024-05-10T03:41:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.814+0000 7f4860436b80 1 -- 172.21.15.45:0/427565955 wait complete. 2024-05-10T03:41:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.814+0000 7f4860436b80 20 client.15897 trim_cache size 0 max 16384 2024-05-10T03:41:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:{ 2024-05-10T03:41:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "message": "", 2024-05-10T03:41:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "return_code": 0 2024-05-10T03:41:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:} 2024-05-10T03:41:02.819 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.814+0000 7f48500f2700 1 -- 172.21.15.45:0/1496032 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f48340a11b0 msgr2=0x7f48340a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:02.819 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.814+0000 7f48500f2700 1 --2- 172.21.15.45:0/1496032 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f48340a11b0 0x7f48340a36c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4844006010 tx=0x7f484401a040 comp rx=0 tx=0).stop 2024-05-10T03:41:02.819 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.814+0000 7f48500f2700 1 -- 172.21.15.45:0/1496032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4848101be0 msgr2=0x7f484819ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:02.819 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.814+0000 7f48500f2700 1 --2- 172.21.15.45:0/1496032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4848101be0 0x7f484819ce70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f483c00e9a0 tx=0x7f483c00ecb0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.819 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.814+0000 7f48500f2700 1 -- 172.21.15.45:0/1496032 shutdown_connections 2024-05-10T03:41:02.819 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.814+0000 7f48500f2700 1 --2- 172.21.15.45:0/1496032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4848100ac0 0x7f48480690e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.819 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.814+0000 7f48500f2700 1 --2- 172.21.15.45:0/1496032 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f48340a11b0 0x7f48340a36c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.819 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.814+0000 7f48500f2700 1 --2- 172.21.15.45:0/1496032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4848102580 0x7f484819f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.819 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.814+0000 7f48500f2700 1 --2- 172.21.15.45:0/1496032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4848101be0 0x7f484819ce70 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:02.819 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.814+0000 7f48500f2700 1 -- 172.21.15.45:0/1496032 >> 172.21.15.45:0/1496032 conn(0x7f48480fc0f0 msgr2=0x7f4848104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:02.819 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.815+0000 7f48500f2700 1 -- 172.21.15.45:0/1496032 shutdown_connections 2024-05-10T03:41:02.819 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:02.815+0000 7f48500f2700 1 -- 172.21.15.45:0/1496032 wait complete. 2024-05-10T03:41:03.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:03 smithi045 ceph-mon[42520]: pgmap v308: 129 pgs: 129 active+clean; 669 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-10T03:41:03.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:03 smithi106 ceph-mon[46996]: pgmap v308: 129 pgs: 129 active+clean; 669 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-10T03:41:03.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:03 smithi154 ceph-mon[46565]: pgmap v308: 129 pgs: 129 active+clean; 669 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-10T03:41:05.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:05 smithi045 ceph-mon[42520]: pgmap v309: 129 pgs: 129 active+clean; 669 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-05-10T03:41:05.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:05 smithi106 ceph-mon[46996]: pgmap v309: 129 pgs: 129 active+clean; 669 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-05-10T03:41:05.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:05 smithi154 ceph-mon[46565]: pgmap v309: 129 pgs: 129 active+clean; 669 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-05-10T03:41:07.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:07 smithi045 ceph-mon[42520]: pgmap v310: 129 pgs: 129 active+clean; 670 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-05-10T03:41:07.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:07 smithi106 ceph-mon[46996]: pgmap v310: 129 pgs: 129 active+clean; 670 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-05-10T03:41:07.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:07 smithi154 ceph-mon[46565]: pgmap v310: 129 pgs: 129 active+clean; 670 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-05-10T03:41:09.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:09 smithi045 ceph-mon[42520]: pgmap v311: 129 pgs: 129 active+clean; 670 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-10T03:41:09.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:09 smithi106 ceph-mon[46996]: pgmap v311: 129 pgs: 129 active+clean; 670 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-10T03:41:09.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:09 smithi154 ceph-mon[46565]: pgmap v311: 129 pgs: 129 active+clean; 670 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-10T03:41:11.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:11 smithi045 ceph-mon[42520]: pgmap v312: 129 pgs: 129 active+clean; 670 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-05-10T03:41:11.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:11 smithi106 ceph-mon[46996]: pgmap v312: 129 pgs: 129 active+clean; 670 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-05-10T03:41:11.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:11 smithi154 ceph-mon[46565]: pgmap v312: 129 pgs: 129 active+clean; 670 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-05-10T03:41:13.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:13 smithi045 ceph-mon[42520]: pgmap v313: 129 pgs: 129 active+clean; 670 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 11 op/s 2024-05-10T03:41:13.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:13 smithi106 ceph-mon[46996]: pgmap v313: 129 pgs: 129 active+clean; 670 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 11 op/s 2024-05-10T03:41:13.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:13 smithi154 ceph-mon[46565]: pgmap v313: 129 pgs: 129 active+clean; 670 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 11 op/s 2024-05-10T03:41:15.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:15 smithi045 ceph-mon[42520]: pgmap v314: 129 pgs: 129 active+clean; 670 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 10 op/s 2024-05-10T03:41:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:15 smithi106 ceph-mon[46996]: pgmap v314: 129 pgs: 129 active+clean; 670 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 10 op/s 2024-05-10T03:41:15.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:15 smithi154 ceph-mon[46565]: pgmap v314: 129 pgs: 129 active+clean; 670 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 10 op/s 2024-05-10T03:41:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.955+0000 7ff466370700 1 -- 172.21.15.45:0/2650207384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff460101be0 msgr2=0x7ff460101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.955+0000 7ff466370700 1 --2- 172.21.15.45:0/2650207384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff460101be0 0x7ff460101ff0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff454009990 tx=0x7ff454009ca0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.955+0000 7ff466370700 1 -- 172.21.15.45:0/2650207384 shutdown_connections 2024-05-10T03:41:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.955+0000 7ff466370700 1 --2- 172.21.15.45:0/2650207384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff460100ac0 0x7ff460100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.955+0000 7ff466370700 1 --2- 172.21.15.45:0/2650207384 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff460102580 0x7ff460108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.955+0000 7ff466370700 1 --2- 172.21.15.45:0/2650207384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff460101be0 0x7ff460101ff0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.955+0000 7ff466370700 1 -- 172.21.15.45:0/2650207384 >> 172.21.15.45:0/2650207384 conn(0x7ff4600fc0f0 msgr2=0x7ff4600fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.955+0000 7ff466370700 1 -- 172.21.15.45:0/2650207384 shutdown_connections 2024-05-10T03:41:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.955+0000 7ff466370700 1 -- 172.21.15.45:0/2650207384 wait complete. 2024-05-10T03:41:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.956+0000 7ff466370700 1 Processor -- start 2024-05-10T03:41:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.956+0000 7ff466370700 1 -- start start 2024-05-10T03:41:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.956+0000 7ff466370700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff460100ac0 0x7ff4600690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.956+0000 7ff466370700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff460101be0 0x7ff46019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.956+0000 7ff466370700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff460102580 0x7ff46019f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.956+0000 7ff466370700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46019fa50 con 0x7ff460100ac0 2024-05-10T03:41:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.956+0000 7ff466370700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46019fbc0 con 0x7ff460102580 2024-05-10T03:41:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.956+0000 7ff466370700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46019fd80 con 0x7ff460101be0 2024-05-10T03:41:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.956+0000 7ff45ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff460100ac0 0x7ff4600690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.956+0000 7ff45ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff460100ac0 0x7ff4600690c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35004/0 (socket says 172.21.15.45:35004) 2024-05-10T03:41:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.956+0000 7ff45ffff700 1 -- 172.21.15.45:0/3682768952 learned_addr learned my addr 172.21.15.45:0/3682768952 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.956+0000 7ff45f7fe700 1 --2- 172.21.15.45:0/3682768952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff460101be0 0x7ff46019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.956+0000 7ff46490d700 1 --2- 172.21.15.45:0/3682768952 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff460102580 0x7ff46019f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.957+0000 7ff45ffff700 1 -- 172.21.15.45:0/3682768952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff460101be0 msgr2=0x7ff46019ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.957+0000 7ff45ffff700 1 --2- 172.21.15.45:0/3682768952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff460101be0 0x7ff46019ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.957+0000 7ff45ffff700 1 -- 172.21.15.45:0/3682768952 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff460102580 msgr2=0x7ff46019f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.957+0000 7ff45ffff700 1 --2- 172.21.15.45:0/3682768952 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff460102580 0x7ff46019f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.957+0000 7ff45ffff700 1 -- 172.21.15.45:0/3682768952 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4540095f0 con 0x7ff460100ac0 2024-05-10T03:41:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.957+0000 7ff45ffff700 1 --2- 172.21.15.45:0/3682768952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff460100ac0 0x7ff4600690c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff45000c970 tx=0x7ff45000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.957+0000 7ff45d7fa700 1 -- 172.21.15.45:0/3682768952 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450007b00 con 0x7ff460100ac0 2024-05-10T03:41:15.964 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.957+0000 7ff466370700 1 -- 172.21.15.45:0/3682768952 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4601a0060 con 0x7ff460100ac0 2024-05-10T03:41:15.964 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.957+0000 7ff45d7fa700 1 -- 172.21.15.45:0/3682768952 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff450007c60 con 0x7ff460100ac0 2024-05-10T03:41:15.964 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.957+0000 7ff45d7fa700 1 -- 172.21.15.45:0/3682768952 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450018660 con 0x7ff460100ac0 2024-05-10T03:41:15.964 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.957+0000 7ff466370700 1 -- 172.21.15.45:0/3682768952 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4601a05c0 con 0x7ff460100ac0 2024-05-10T03:41:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.960+0000 7ff45d7fa700 1 -- 172.21.15.45:0/3682768952 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ff45000f450 con 0x7ff460100ac0 2024-05-10T03:41:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.960+0000 7ff45d7fa700 1 --2- 172.21.15.45:0/3682768952 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4480a11b0 0x7ff4480a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.960+0000 7ff45d7fa700 1 -- 172.21.15.45:0/3682768952 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff4500ccda0 con 0x7ff460100ac0 2024-05-10T03:41:15.967 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.960+0000 7ff45f7fe700 1 --2- 172.21.15.45:0/3682768952 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4480a11b0 0x7ff4480a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.961+0000 7ff45f7fe700 1 --2- 172.21.15.45:0/3682768952 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4480a11b0 0x7ff4480a36c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff4540098e0 tx=0x7ff45401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.961+0000 7ff4766b4b80 1 Processor -- start 2024-05-10T03:41:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.961+0000 7ff4766b4b80 1 -- start start 2024-05-10T03:41:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.961+0000 7ff4766b4b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f6aabbb590 0x55f6aabbb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.962+0000 7ff4766b4b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f6aabbc460 0x55f6aabbc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.962+0000 7ff4766b4b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbcdb0 0x55f6aabc36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.962+0000 7ff4766b4b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6aaade0f0 con 0x55f6aabbcdb0 2024-05-10T03:41:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.962+0000 7ff4766b4b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6aaadbab0 con 0x55f6aabbc460 2024-05-10T03:41:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.962+0000 7ff4766b4b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6aaad73a0 con 0x55f6aabbb590 2024-05-10T03:41:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.962+0000 7ff46490d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbcdb0 0x55f6aabc36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.962+0000 7ff46490d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbcdb0 0x55f6aabc36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35010/0 (socket says 172.21.15.45:35010) 2024-05-10T03:41:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.962+0000 7ff46490d700 1 -- 172.21.15.45:0/3851927877 learned_addr learned my addr 172.21.15.45:0/3851927877 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.962+0000 7ff45ffff700 1 --2- 172.21.15.45:0/3851927877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f6aabbb590 0x55f6aabbb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:15.968 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.962+0000 7ff45f7fe700 1 --2- 172.21.15.45:0/3851927877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f6aabbc460 0x55f6aabbc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.962+0000 7ff46490d700 1 -- 172.21.15.45:0/3851927877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f6aabbb590 msgr2=0x55f6aabbb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.962+0000 7ff46490d700 1 --2- 172.21.15.45:0/3851927877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f6aabbb590 0x55f6aabbb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.962+0000 7ff46490d700 1 -- 172.21.15.45:0/3851927877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f6aabbc460 msgr2=0x55f6aabbc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.962+0000 7ff46490d700 1 --2- 172.21.15.45:0/3851927877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f6aabbc460 0x55f6aabbc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.962+0000 7ff46490d700 1 -- 172.21.15.45:0/3851927877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6aa958350 con 0x55f6aabbcdb0 2024-05-10T03:41:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.962+0000 7ff46490d700 1 --2- 172.21.15.45:0/3851927877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbcdb0 0x55f6aabc36b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff458009d70 tx=0x7ff4580077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55906711a07f6cd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.962+0000 7ff4467fc700 1 -- 172.21.15.45:0/3851927877 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff458014610 con 0x55f6aabbcdb0 2024-05-10T03:41:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.963+0000 7ff4467fc700 1 -- 172.21.15.45:0/3851927877 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff45800f050 con 0x55f6aabbcdb0 2024-05-10T03:41:15.969 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.963+0000 7ff4467fc700 1 -- 172.21.15.45:0/3851927877 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff458013970 con 0x55f6aabbcdb0 2024-05-10T03:41:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.963+0000 7ff4766b4b80 1 -- 172.21.15.45:0/3851927877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbcdb0 msgr2=0x55f6aabc36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.963+0000 7ff4766b4b80 1 --2- 172.21.15.45:0/3851927877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbcdb0 0x55f6aabc36b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff458009d70 tx=0x7ff4580077e0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.963+0000 7ff4766b4b80 1 -- 172.21.15.45:0/3851927877 shutdown_connections 2024-05-10T03:41:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.963+0000 7ff4766b4b80 1 --2- 172.21.15.45:0/3851927877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f6aabbb590 0x55f6aabbb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.963+0000 7ff4766b4b80 1 --2- 172.21.15.45:0/3851927877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbcdb0 0x55f6aabc36b0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.963+0000 7ff4766b4b80 1 --2- 172.21.15.45:0/3851927877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f6aabbc460 0x55f6aabbc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.963+0000 7ff4766b4b80 1 -- 172.21.15.45:0/3851927877 >> 172.21.15.45:0/3851927877 conn(0x55f6aab19a00 msgr2=0x55f6aabb1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.964+0000 7ff4766b4b80 1 -- 172.21.15.45:0/3851927877 shutdown_connections 2024-05-10T03:41:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.964+0000 7ff4766b4b80 1 -- 172.21.15.45:0/3851927877 wait complete. 2024-05-10T03:41:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.964+0000 7ff4766b4b80 1 -- start start 2024-05-10T03:41:15.970 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.964+0000 7ff4766b4b80 1 Processor -- start 2024-05-10T03:41:15.975 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.965+0000 7ff4766b4b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbb590 0x55f6aabc5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:15.976 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.965+0000 7ff4766b4b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f6aabbc460 0x55f6aabc5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:15.976 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.965+0000 7ff4766b4b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f6aabbcdb0 0x55f6aabcca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:15.976 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.965+0000 7ff4766b4b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6aaa73500 con 0x55f6aabbb590 2024-05-10T03:41:15.976 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.965+0000 7ff4766b4b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6aaa731a0 con 0x55f6aabbc460 2024-05-10T03:41:15.976 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.965+0000 7ff4766b4b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6aa95a640 con 0x55f6aabbcdb0 2024-05-10T03:41:15.976 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.965+0000 7ff4766b4b80 10 client.0 _ll_register_callbacks cb 0x55f6aaa7cad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:15.976 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.965+0000 7ff45ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbb590 0x55f6aabc5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:15.976 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.965+0000 7ff45ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbb590 0x55f6aabc5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35016/0 (socket says 172.21.15.45:35016) 2024-05-10T03:41:15.976 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.965+0000 7ff45ffff700 1 -- 172.21.15.45:0/2804182766 learned_addr learned my addr 172.21.15.45:0/2804182766 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:15.976 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.965+0000 7ff46490d700 1 --2- 172.21.15.45:0/2804182766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f6aabbcdb0 0x55f6aabcca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:15.976 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.965+0000 7ff45f7fe700 1 --2- 172.21.15.45:0/2804182766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f6aabbc460 0x55f6aabc5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:15.976 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.965+0000 7ff45ffff700 1 -- 172.21.15.45:0/2804182766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f6aabbcdb0 msgr2=0x55f6aabcca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:15.977 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.965+0000 7ff45ffff700 1 --2- 172.21.15.45:0/2804182766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f6aabbcdb0 0x55f6aabcca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.977 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.965+0000 7ff45ffff700 1 -- 172.21.15.45:0/2804182766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f6aabbc460 msgr2=0x55f6aabc5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:15.977 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.965+0000 7ff45ffff700 1 --2- 172.21.15.45:0/2804182766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f6aabbc460 0x55f6aabc5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.977 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.965+0000 7ff45ffff700 1 -- 172.21.15.45:0/2804182766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4580099a0 con 0x55f6aabbb590 2024-05-10T03:41:15.977 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.965+0000 7ff45ffff700 1 --2- 172.21.15.45:0/2804182766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbb590 0x55f6aabc5590 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff450099c80 tx=0x7ff4500996c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7076341aff1469b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:15.977 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.965+0000 7ff43f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:41:15.977 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.965+0000 7ff43f7fe700 1 -- 172.21.15.45:0/2804182766 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45000f900 con 0x55f6aabbb590 2024-05-10T03:41:15.977 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.965+0000 7ff43f7fe700 1 -- 172.21.15.45:0/2804182766 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff450099cf0 con 0x55f6aabbb590 2024-05-10T03:41:15.977 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.965+0000 7ff4766b4b80 1 -- 172.21.15.45:0/2804182766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f6aaa30210 con 0x55f6aabbb590 2024-05-10T03:41:15.977 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.966+0000 7ff43f7fe700 1 -- 172.21.15.45:0/2804182766 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff45009db20 con 0x55f6aabbb590 2024-05-10T03:41:15.977 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.966+0000 7ff4766b4b80 10 client.15909 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:15.977 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.966+0000 7ff4766b4b80 1 -- 172.21.15.45:0/2804182766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55f6aa904b00 con 0x55f6aabbb590 2024-05-10T03:41:15.977 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.966+0000 7ff43f7fe700 1 -- 172.21.15.45:0/2804182766 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff45007c020 con 0x55f6aabbb590 2024-05-10T03:41:15.977 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.966+0000 7ff43f7fe700 1 -- 172.21.15.45:0/2804182766 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ff4500a1ce0 con 0x55f6aabbb590 2024-05-10T03:41:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.966+0000 7ff4766b4b80 10 client.15909 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.966+0000 7ff4766b4b80 10 client.15909 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:41:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.966+0000 7ff4766b4b80 20 client.15909 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.966+0000 7ff4766b4b80 1 --2- 172.21.15.45:0/2804182766 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f6aabd1190 0x55f6aabd35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.966+0000 7ff4766b4b80 4 client.15909 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:41:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.966+0000 7ff4766b4b80 1 -- 172.21.15.45:0/2804182766 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f6aab86720 con 0x55f6aabd1190 2024-05-10T03:41:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.966+0000 7ff45f7fe700 1 --2- 172.21.15.45:0/2804182766 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f6aabd1190 0x55f6aabd35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.967+0000 7ff43f7fe700 10 client.15909 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.967+0000 7ff45f7fe700 1 --2- 172.21.15.45:0/2804182766 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f6aabd1190 0x55f6aabd35e0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13ab974e7e07c16 server_cookie=b85a40e4f94ebb7c in_seq=0 out_seq=0 2024-05-10T03:41:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.968+0000 7ff43f7fe700 1 -- 172.21.15.45:0/2804182766 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f6aab86720 con 0x55f6aabd1190 2024-05-10T03:41:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.968+0000 7ff43f7fe700 10 client.15909 handle_command_reply: tid=0 2024-05-10T03:41:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.968+0000 7ff4766b4b80 1 client.15909 shutdown 2024-05-10T03:41:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.968+0000 7ff4766b4b80 1 -- 172.21.15.45:0/2804182766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbb590 msgr2=0x55f6aabc5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:15.978 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.968+0000 7ff4766b4b80 1 --2- 172.21.15.45:0/2804182766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbb590 0x55f6aabc5590 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff450099c80 tx=0x7ff4500996c0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.979 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.968+0000 7ff4766b4b80 1 -- 172.21.15.45:0/2804182766 shutdown_connections 2024-05-10T03:41:15.979 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.968+0000 7ff4766b4b80 1 --2- 172.21.15.45:0/2804182766 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f6aabd1190 0x55f6aabd35e0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.979 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.968+0000 7ff4766b4b80 1 --2- 172.21.15.45:0/2804182766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f6aabbcdb0 0x55f6aabcca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.979 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.968+0000 7ff4766b4b80 1 --2- 172.21.15.45:0/2804182766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbb590 0x55f6aabc5590 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.979 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.968+0000 7ff4766b4b80 1 --2- 172.21.15.45:0/2804182766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f6aabbc460 0x55f6aabc5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.979 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.968+0000 7ff43f7fe700 0 client.15909 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:15.979 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.968+0000 7ff4766b4b80 1 -- 172.21.15.45:0/2804182766 >> 172.21.15.45:0/2804182766 conn(0x55f6aab19a00 msgr2=0x55f6aabb1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:15.979 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.968+0000 7ff4766b4b80 1 -- 172.21.15.45:0/2804182766 shutdown_connections 2024-05-10T03:41:15.979 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.968+0000 7ff4766b4b80 1 -- 172.21.15.45:0/2804182766 wait complete. 2024-05-10T03:41:15.979 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.968+0000 7ff4766b4b80 20 client.15909 trim_cache size 0 max 16384 2024-05-10T03:41:15.990 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.984+0000 7ff4766b4b80 1 Processor -- start 2024-05-10T03:41:15.990 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.984+0000 7ff4766b4b80 1 -- start start 2024-05-10T03:41:15.990 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.984+0000 7ff4766b4b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbb590 0x55f6aabcd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:15.990 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.984+0000 7ff4766b4b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f6aabbc460 0x55f6aabcc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:15.990 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.984+0000 7ff4766b4b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f6aabbcdb0 0x55f6aabc4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:15.990 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.984+0000 7ff4766b4b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6aabb3270 con 0x55f6aabbb590 2024-05-10T03:41:15.990 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.984+0000 7ff4766b4b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6aabc35f0 con 0x55f6aabbcdb0 2024-05-10T03:41:15.990 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.984+0000 7ff4766b4b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6aabc0e90 con 0x55f6aabbc460 2024-05-10T03:41:15.990 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.984+0000 7ff45ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbb590 0x55f6aabcd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:15.990 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.984+0000 7ff45ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbb590 0x55f6aabcd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35032/0 (socket says 172.21.15.45:35032) 2024-05-10T03:41:15.990 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.984+0000 7ff45ffff700 1 -- 172.21.15.45:0/2331159919 learned_addr learned my addr 172.21.15.45:0/2331159919 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.984+0000 7ff45f7fe700 1 --2- 172.21.15.45:0/2331159919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f6aabbc460 0x55f6aabcc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.984+0000 7ff46490d700 1 --2- 172.21.15.45:0/2331159919 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f6aabbcdb0 0x55f6aabc4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.985+0000 7ff45ffff700 1 -- 172.21.15.45:0/2331159919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f6aabbc460 msgr2=0x55f6aabcc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.985+0000 7ff45ffff700 1 --2- 172.21.15.45:0/2331159919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f6aabbc460 0x55f6aabcc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.985+0000 7ff45ffff700 1 -- 172.21.15.45:0/2331159919 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f6aabbcdb0 msgr2=0x55f6aabc4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.985+0000 7ff45ffff700 1 --2- 172.21.15.45:0/2331159919 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f6aabbcdb0 0x55f6aabc4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.985+0000 7ff45ffff700 1 -- 172.21.15.45:0/2331159919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6aaa9d500 con 0x55f6aabbb590 2024-05-10T03:41:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.985+0000 7ff46490d700 1 --2- 172.21.15.45:0/2331159919 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f6aabbcdb0 0x55f6aabc4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:41:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.985+0000 7ff45ffff700 1 --2- 172.21.15.45:0/2331159919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbb590 0x55f6aabcd040 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff4500a1c40 tx=0x7ff450099ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d77a819ff9c1c5c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.985+0000 7ff446ffd700 1 -- 172.21.15.45:0/2331159919 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450099cf0 con 0x55f6aabbb590 2024-05-10T03:41:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.985+0000 7ff446ffd700 1 -- 172.21.15.45:0/2331159919 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff45007c070 con 0x55f6aabbb590 2024-05-10T03:41:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.985+0000 7ff446ffd700 1 -- 172.21.15.45:0/2331159919 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45000f700 con 0x55f6aabbb590 2024-05-10T03:41:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.986+0000 7ff4766b4b80 1 -- 172.21.15.45:0/2331159919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbb590 msgr2=0x55f6aabcd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.986+0000 7ff4766b4b80 1 --2- 172.21.15.45:0/2331159919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbb590 0x55f6aabcd040 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff4500a1c40 tx=0x7ff450099ac0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.986+0000 7ff4766b4b80 1 -- 172.21.15.45:0/2331159919 shutdown_connections 2024-05-10T03:41:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.986+0000 7ff4766b4b80 1 --2- 172.21.15.45:0/2331159919 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f6aabbcdb0 0x55f6aabc4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.986+0000 7ff4766b4b80 1 --2- 172.21.15.45:0/2331159919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbb590 0x55f6aabcd040 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.986+0000 7ff4766b4b80 1 --2- 172.21.15.45:0/2331159919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f6aabbc460 0x55f6aabcc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.986+0000 7ff4766b4b80 1 -- 172.21.15.45:0/2331159919 >> 172.21.15.45:0/2331159919 conn(0x55f6aab19a00 msgr2=0x55f6aabb1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.986+0000 7ff4766b4b80 1 -- 172.21.15.45:0/2331159919 shutdown_connections 2024-05-10T03:41:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.986+0000 7ff4766b4b80 1 -- 172.21.15.45:0/2331159919 wait complete. 2024-05-10T03:41:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.986+0000 7ff4766b4b80 1 -- start start 2024-05-10T03:41:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.987+0000 7ff4766b4b80 1 Processor -- start 2024-05-10T03:41:15.995 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.987+0000 7ff4766b4b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbb590 0x55f6aabc9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:15.995 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.987+0000 7ff4766b4b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f6aabbc460 0x55f6aabca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:15.995 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.987+0000 7ff4766b4b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f6aabbcdb0 0x55f6aabcb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:15.995 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.987+0000 7ff4766b4b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6aabcb920 con 0x55f6aabbb590 2024-05-10T03:41:15.995 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.987+0000 7ff4766b4b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6aabcba90 con 0x55f6aabbcdb0 2024-05-10T03:41:15.995 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.987+0000 7ff4766b4b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6aabcbc50 con 0x55f6aabbc460 2024-05-10T03:41:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.987+0000 7ff4766b4b80 10 client.0 _ll_register_callbacks cb 0x55f6aaa7cad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.987+0000 7ff45ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbb590 0x55f6aabc9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.987+0000 7ff45ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbb590 0x55f6aabc9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35042/0 (socket says 172.21.15.45:35042) 2024-05-10T03:41:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.987+0000 7ff45ffff700 1 -- 172.21.15.45:0/751753985 learned_addr learned my addr 172.21.15.45:0/751753985 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.987+0000 7ff45f7fe700 1 --2- 172.21.15.45:0/751753985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f6aabbc460 0x55f6aabca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.987+0000 7ff46490d700 1 --2- 172.21.15.45:0/751753985 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f6aabbcdb0 0x55f6aabcb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.987+0000 7ff45ffff700 1 -- 172.21.15.45:0/751753985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f6aabbc460 msgr2=0x55f6aabca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.987+0000 7ff45ffff700 1 --2- 172.21.15.45:0/751753985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f6aabbc460 0x55f6aabca4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.987+0000 7ff45ffff700 1 -- 172.21.15.45:0/751753985 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f6aabbcdb0 msgr2=0x55f6aabcb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.987+0000 7ff45ffff700 1 --2- 172.21.15.45:0/751753985 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f6aabbcdb0 0x55f6aabcb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.987+0000 7ff45ffff700 1 -- 172.21.15.45:0/751753985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f6aa904b00 con 0x55f6aabbb590 2024-05-10T03:41:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.987+0000 7ff45f7fe700 1 --2- 172.21.15.45:0/751753985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f6aabbc460 0x55f6aabca4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:41:15.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.988+0000 7ff45ffff700 1 --2- 172.21.15.45:0/751753985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbb590 0x55f6aabc9f70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff450098040 tx=0x7ff4500996c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f28214caaa57fe0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.988+0000 7ff43f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:41:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.988+0000 7ff43f7fe700 1 -- 172.21.15.45:0/751753985 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4500832f0 con 0x55f6aabbb590 2024-05-10T03:41:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.988+0000 7ff43f7fe700 1 -- 172.21.15.45:0/751753985 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff45007d080 con 0x55f6aabbb590 2024-05-10T03:41:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.988+0000 7ff4766b4b80 1 -- 172.21.15.45:0/751753985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff45800f050 con 0x55f6aabbb590 2024-05-10T03:41:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.988+0000 7ff43f7fe700 1 -- 172.21.15.45:0/751753985 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff45009db20 con 0x55f6aabbb590 2024-05-10T03:41:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.988+0000 7ff4766b4b80 10 client.15915 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.988+0000 7ff4766b4b80 1 -- 172.21.15.45:0/751753985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55f6aa95cc70 con 0x55f6aabbb590 2024-05-10T03:41:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.988+0000 7ff43f7fe700 1 -- 172.21.15.45:0/751753985 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff45800f050 con 0x55f6aabbb590 2024-05-10T03:41:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.988+0000 7ff43f7fe700 1 -- 172.21.15.45:0/751753985 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ff450099270 con 0x55f6aabbb590 2024-05-10T03:41:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.988+0000 7ff4766b4b80 10 client.15915 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.988+0000 7ff4766b4b80 10 client.15915 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:41:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.988+0000 7ff4766b4b80 20 client.15915 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.988+0000 7ff4766b4b80 1 --2- 172.21.15.45:0/751753985 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f6aac27720 0x55f6aac29b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:15.997 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.988+0000 7ff4766b4b80 4 client.15915 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T03:41:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.988+0000 7ff4766b4b80 1 -- 172.21.15.45:0/751753985 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f6aaacfe60 con 0x55f6aac27720 2024-05-10T03:41:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.989+0000 7ff45f7fe700 1 --2- 172.21.15.45:0/751753985 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f6aac27720 0x55f6aac29b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.989+0000 7ff43f7fe700 10 client.15915 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:15.998 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.989+0000 7ff45f7fe700 1 --2- 172.21.15.45:0/751753985 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f6aac27720 0x55f6aac29b40 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcd16ecd8040a2e5 server_cookie=f9f8cc24126540f3 in_seq=0 out_seq=0 2024-05-10T03:41:15.999 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.993+0000 7ff43f7fe700 1 -- 172.21.15.45:0/751753985 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f6aaacfe60 con 0x55f6aac27720 2024-05-10T03:41:15.999 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.993+0000 7ff43f7fe700 10 client.15915 handle_command_reply: tid=0 2024-05-10T03:41:15.999 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.993+0000 7ff4766b4b80 1 client.15915 shutdown 2024-05-10T03:41:15.999 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.993+0000 7ff4766b4b80 1 -- 172.21.15.45:0/751753985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbb590 msgr2=0x55f6aabc9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:15.999 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.993+0000 7ff4766b4b80 1 --2- 172.21.15.45:0/751753985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbb590 0x55f6aabc9f70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff450098040 tx=0x7ff4500996c0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.999 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.993+0000 7ff4766b4b80 1 -- 172.21.15.45:0/751753985 shutdown_connections 2024-05-10T03:41:15.999 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.993+0000 7ff4766b4b80 1 --2- 172.21.15.45:0/751753985 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f6aac27720 0x55f6aac29b40 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:15.999 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.993+0000 7ff4766b4b80 1 --2- 172.21.15.45:0/751753985 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f6aabbcdb0 0x55f6aabcb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.993+0000 7ff4766b4b80 1 --2- 172.21.15.45:0/751753985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6aabbb590 0x55f6aabc9f70 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.993+0000 7ff4766b4b80 1 --2- 172.21.15.45:0/751753985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f6aabbc460 0x55f6aabca4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.993+0000 7ff43f7fe700 0 client.15915 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.993+0000 7ff4766b4b80 1 -- 172.21.15.45:0/751753985 >> 172.21.15.45:0/751753985 conn(0x55f6aab19a00 msgr2=0x55f6aabb1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.993+0000 7ff4766b4b80 1 -- 172.21.15.45:0/751753985 shutdown_connections 2024-05-10T03:41:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.993+0000 7ff4766b4b80 1 -- 172.21.15.45:0/751753985 wait complete. 2024-05-10T03:41:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.993+0000 7ff4766b4b80 20 client.15915 trim_cache size 0 max 16384 2024-05-10T03:41:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:{ 2024-05-10T03:41:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "message": "", 2024-05-10T03:41:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "return_code": 0 2024-05-10T03:41:16.001 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:} 2024-05-10T03:41:16.001 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.994+0000 7ff466370700 1 -- 172.21.15.45:0/3682768952 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4480a11b0 msgr2=0x7ff4480a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:16.001 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.994+0000 7ff466370700 1 --2- 172.21.15.45:0/3682768952 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4480a11b0 0x7ff4480a36c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff4540098e0 tx=0x7ff45401a040 comp rx=0 tx=0).stop 2024-05-10T03:41:16.001 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.994+0000 7ff466370700 1 -- 172.21.15.45:0/3682768952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff460100ac0 msgr2=0x7ff4600690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:16.002 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.994+0000 7ff466370700 1 --2- 172.21.15.45:0/3682768952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff460100ac0 0x7ff4600690c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff45000c970 tx=0x7ff45000cc80 comp rx=0 tx=0).stop 2024-05-10T03:41:16.002 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.994+0000 7ff466370700 1 -- 172.21.15.45:0/3682768952 shutdown_connections 2024-05-10T03:41:16.002 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.994+0000 7ff466370700 1 --2- 172.21.15.45:0/3682768952 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff4480a11b0 0x7ff4480a36c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:16.002 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.994+0000 7ff466370700 1 --2- 172.21.15.45:0/3682768952 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff460102580 0x7ff46019f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:16.002 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.994+0000 7ff466370700 1 --2- 172.21.15.45:0/3682768952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff460100ac0 0x7ff4600690c0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:16.002 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.994+0000 7ff466370700 1 --2- 172.21.15.45:0/3682768952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff460101be0 0x7ff46019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:16.002 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.994+0000 7ff466370700 1 -- 172.21.15.45:0/3682768952 >> 172.21.15.45:0/3682768952 conn(0x7ff4600fc0f0 msgr2=0x7ff460104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:16.002 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.994+0000 7ff466370700 1 -- 172.21.15.45:0/3682768952 shutdown_connections 2024-05-10T03:41:16.002 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:15.994+0000 7ff466370700 1 -- 172.21.15.45:0/3682768952 wait complete. 2024-05-10T03:41:17.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:17 smithi045 ceph-mon[42520]: pgmap v315: 129 pgs: 129 active+clean; 670 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 597 B/s wr, 12 op/s 2024-05-10T03:41:17.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:17 smithi106 ceph-mon[46996]: pgmap v315: 129 pgs: 129 active+clean; 670 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 597 B/s wr, 12 op/s 2024-05-10T03:41:17.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:17 smithi154 ceph-mon[46565]: pgmap v315: 129 pgs: 129 active+clean; 670 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 597 B/s wr, 12 op/s 2024-05-10T03:41:19.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:19 smithi045 ceph-mon[42520]: pgmap v316: 129 pgs: 129 active+clean; 670 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-10T03:41:19.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:19 smithi106 ceph-mon[46996]: pgmap v316: 129 pgs: 129 active+clean; 670 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-10T03:41:19.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:19 smithi154 ceph-mon[46565]: pgmap v316: 129 pgs: 129 active+clean; 670 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-10T03:41:21.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:21 smithi106 ceph-mon[46996]: pgmap v317: 129 pgs: 129 active+clean; 671 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:41:21.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:21 smithi154 ceph-mon[46565]: pgmap v317: 129 pgs: 129 active+clean; 671 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:41:21.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:21 smithi045 ceph-mon[42520]: pgmap v317: 129 pgs: 129 active+clean; 671 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:41:23.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:23 smithi106 ceph-mon[46996]: pgmap v318: 129 pgs: 129 active+clean; 671 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:41:23.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:23 smithi154 ceph-mon[46565]: pgmap v318: 129 pgs: 129 active+clean; 671 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:41:23.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:23 smithi045 ceph-mon[42520]: pgmap v318: 129 pgs: 129 active+clean; 671 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:41:25.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:25 smithi106 ceph-mon[46996]: pgmap v319: 129 pgs: 129 active+clean; 671 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:41:25.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:25 smithi154 ceph-mon[46565]: pgmap v319: 129 pgs: 129 active+clean; 671 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:41:25.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:25 smithi045 ceph-mon[42520]: pgmap v319: 129 pgs: 129 active+clean; 671 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:41:26.758 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-10T03:41:26.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.919+0000 7f7654c73700 1 -- 172.21.15.45:0/3168674032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7650104d10 msgr2=0x7f76501071f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:26.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.919+0000 7f7654c73700 1 --2- 172.21.15.45:0/3168674032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7650104d10 0x7f76501071f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7638009990 tx=0x7f7638009ca0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.919+0000 7f7654c73700 1 -- 172.21.15.45:0/3168674032 shutdown_connections 2024-05-10T03:41:26.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.919+0000 7f7654c73700 1 --2- 172.21.15.45:0/3168674032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7650069090 0x7f7650104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.919+0000 7f7654c73700 1 --2- 172.21.15.45:0/3168674032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7650107880 0x7f7650109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.919+0000 7f7654c73700 1 --2- 172.21.15.45:0/3168674032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7650104d10 0x7f76501071f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.919+0000 7f7654c73700 1 -- 172.21.15.45:0/3168674032 >> 172.21.15.45:0/3168674032 conn(0x7f76500fc0d0 msgr2=0x7f76500fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:26.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.919+0000 7f7654c73700 1 -- 172.21.15.45:0/3168674032 shutdown_connections 2024-05-10T03:41:26.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.919+0000 7f7654c73700 1 -- 172.21.15.45:0/3168674032 wait complete. 2024-05-10T03:41:26.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.920+0000 7f7654c73700 1 Processor -- start 2024-05-10T03:41:26.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.920+0000 7f7654c73700 1 -- start start 2024-05-10T03:41:26.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.920+0000 7f7654c73700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7650069090 0x7f7650197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:26.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.920+0000 7f7654c73700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7650104d10 0x7f76501984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:26.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.920+0000 7f7654c73700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7650107880 0x7f765019f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:26.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.920+0000 7f7654c73700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765019fa90 con 0x7f7650104d10 2024-05-10T03:41:26.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.920+0000 7f7654c73700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765019fc00 con 0x7f7650069090 2024-05-10T03:41:26.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.920+0000 7f7654c73700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765019fdc0 con 0x7f7650107880 2024-05-10T03:41:26.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.920+0000 7f764dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7650104d10 0x7f76501984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:26.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.920+0000 7f764dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7650104d10 0x7f76501984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48846/0 (socket says 172.21.15.45:48846) 2024-05-10T03:41:26.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.920+0000 7f764dd9b700 1 -- 172.21.15.45:0/3368835945 learned_addr learned my addr 172.21.15.45:0/3368835945 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:26.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.920+0000 7f764ed9d700 1 --2- 172.21.15.45:0/3368835945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7650107880 0x7f765019f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:26.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.920+0000 7f764e59c700 1 --2- 172.21.15.45:0/3368835945 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7650069090 0x7f7650197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:26.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.921+0000 7f764dd9b700 1 -- 172.21.15.45:0/3368835945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7650107880 msgr2=0x7f765019f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:26.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.921+0000 7f764dd9b700 1 --2- 172.21.15.45:0/3368835945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7650107880 0x7f765019f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.921+0000 7f764dd9b700 1 -- 172.21.15.45:0/3368835945 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7650069090 msgr2=0x7f7650197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:26.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.921+0000 7f764dd9b700 1 --2- 172.21.15.45:0/3368835945 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7650069090 0x7f7650197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.921+0000 7f764dd9b700 1 -- 172.21.15.45:0/3368835945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76380095f0 con 0x7f7650104d10 2024-05-10T03:41:26.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.921+0000 7f764ed9d700 1 --2- 172.21.15.45:0/3368835945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7650107880 0x7f765019f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:41:26.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.921+0000 7f764dd9b700 1 --2- 172.21.15.45:0/3368835945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7650104d10 0x7f76501984f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f76380098e0 tx=0x7f763800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:26.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.921+0000 7f76477fe700 1 -- 172.21.15.45:0/3368835945 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763801d070 con 0x7f7650104d10 2024-05-10T03:41:26.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.921+0000 7f7654c73700 1 -- 172.21.15.45:0/3368835945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76501a0040 con 0x7f7650104d10 2024-05-10T03:41:26.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.921+0000 7f76477fe700 1 -- 172.21.15.45:0/3368835945 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f763800be40 con 0x7f7650104d10 2024-05-10T03:41:26.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.921+0000 7f76477fe700 1 -- 172.21.15.45:0/3368835945 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76380173f0 con 0x7f7650104d10 2024-05-10T03:41:26.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.921+0000 7f7654c73700 1 -- 172.21.15.45:0/3368835945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76501a0460 con 0x7f7650104d10 2024-05-10T03:41:26.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.924+0000 7f76477fe700 1 -- 172.21.15.45:0/3368835945 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f7638021410 con 0x7f7650104d10 2024-05-10T03:41:26.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.924+0000 7f76477fe700 1 --2- 172.21.15.45:0/3368835945 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f763c0a1260 0x7f763c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:26.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.924+0000 7f76477fe700 1 -- 172.21.15.45:0/3368835945 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f76380cdf30 con 0x7f7650104d10 2024-05-10T03:41:26.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.924+0000 7f764e59c700 1 --2- 172.21.15.45:0/3368835945 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f763c0a1260 0x7f763c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:26.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.925+0000 7f764e59c700 1 --2- 172.21.15.45:0/3368835945 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f763c0a1260 0x7f763c0a3770 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f76500694a0 tx=0x7f7640009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:26.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.925+0000 7f7664fb7b80 1 Processor -- start 2024-05-10T03:41:26.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.925+0000 7f7664fb7b80 1 -- start start 2024-05-10T03:41:26.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.926+0000 7f7664fb7b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db79979ab0 0x55db79979f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:26.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.926+0000 7f7664fb7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997a980 0x55db7997ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:26.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.926+0000 7f7664fb7b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db7997b2d0 0x55db79981bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:26.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.926+0000 7f7664fb7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db7989c150 con 0x55db7997a980 2024-05-10T03:41:26.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.926+0000 7f7664fb7b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db79899b10 con 0x55db79979ab0 2024-05-10T03:41:26.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.926+0000 7f7664fb7b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db79895400 con 0x55db7997b2d0 2024-05-10T03:41:26.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.926+0000 7f764dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997a980 0x55db7997ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:26.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.926+0000 7f764dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997a980 0x55db7997ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48852/0 (socket says 172.21.15.45:48852) 2024-05-10T03:41:26.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.926+0000 7f764dd9b700 1 -- 172.21.15.45:0/101706357 learned_addr learned my addr 172.21.15.45:0/101706357 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:26.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.926+0000 7f764ed9d700 1 --2- 172.21.15.45:0/101706357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db7997b2d0 0x55db79981bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:26.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.926+0000 7f764e59c700 1 --2- 172.21.15.45:0/101706357 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db79979ab0 0x55db79979f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:26.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.926+0000 7f764dd9b700 1 -- 172.21.15.45:0/101706357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db7997b2d0 msgr2=0x55db79981bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:26.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.926+0000 7f764dd9b700 1 --2- 172.21.15.45:0/101706357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db7997b2d0 0x55db79981bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.926+0000 7f764dd9b700 1 -- 172.21.15.45:0/101706357 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db79979ab0 msgr2=0x55db79979f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:26.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.926+0000 7f764dd9b700 1 --2- 172.21.15.45:0/101706357 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db79979ab0 0x55db79979f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.926+0000 7f764dd9b700 1 -- 172.21.15.45:0/101706357 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db797163b0 con 0x55db7997a980 2024-05-10T03:41:26.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.926+0000 7f764dd9b700 1 --2- 172.21.15.45:0/101706357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997a980 0x55db7997ad90 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f763809aea0 tx=0x7f763809a870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b539a2f6611005d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:26.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.927+0000 7f7644ff9700 1 -- 172.21.15.45:0/101706357 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763809af10 con 0x55db7997a980 2024-05-10T03:41:26.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.927+0000 7f7644ff9700 1 -- 172.21.15.45:0/101706357 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f763809ed40 con 0x55db7997a980 2024-05-10T03:41:26.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.927+0000 7f7644ff9700 1 -- 172.21.15.45:0/101706357 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763809a640 con 0x55db7997a980 2024-05-10T03:41:26.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.928+0000 7f7664fb7b80 1 -- 172.21.15.45:0/101706357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997a980 msgr2=0x55db7997ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:26.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.928+0000 7f7664fb7b80 1 --2- 172.21.15.45:0/101706357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997a980 0x55db7997ad90 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f763809aea0 tx=0x7f763809a870 comp rx=0 tx=0).stop 2024-05-10T03:41:26.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.928+0000 7f7664fb7b80 1 -- 172.21.15.45:0/101706357 shutdown_connections 2024-05-10T03:41:26.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.928+0000 7f7664fb7b80 1 --2- 172.21.15.45:0/101706357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db7997b2d0 0x55db79981bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.928+0000 7f7664fb7b80 1 --2- 172.21.15.45:0/101706357 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db79979ab0 0x55db79979f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.928+0000 7f7664fb7b80 1 --2- 172.21.15.45:0/101706357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997a980 0x55db7997ad90 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.928+0000 7f7664fb7b80 1 -- 172.21.15.45:0/101706357 >> 172.21.15.45:0/101706357 conn(0x55db798d7a60 msgr2=0x55db7996ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.928+0000 7f7664fb7b80 1 -- 172.21.15.45:0/101706357 shutdown_connections 2024-05-10T03:41:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.928+0000 7f7664fb7b80 1 -- 172.21.15.45:0/101706357 wait complete. 2024-05-10T03:41:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.928+0000 7f7664fb7b80 1 -- start start 2024-05-10T03:41:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.928+0000 7f7664fb7b80 1 Processor -- start 2024-05-10T03:41:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.929+0000 7f7664fb7b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db79979ab0 0x55db79983780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.929+0000 7f7664fb7b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db7997a980 0x55db79983cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.929+0000 7f7664fb7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997b2d0 0x55db7998ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.929+0000 7f7664fb7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db79831560 con 0x55db7997b2d0 2024-05-10T03:41:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.929+0000 7f7664fb7b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db79831200 con 0x55db7997a980 2024-05-10T03:41:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.929+0000 7f7664fb7b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db797186a0 con 0x55db79979ab0 2024-05-10T03:41:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.929+0000 7f7664fb7b80 10 client.0 _ll_register_callbacks cb 0x55db7983ab30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.929+0000 7f764ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997b2d0 0x55db7998ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.929+0000 7f764ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997b2d0 0x55db7998ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48858/0 (socket says 172.21.15.45:48858) 2024-05-10T03:41:26.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.929+0000 7f764ed9d700 1 -- 172.21.15.45:0/2301659159 learned_addr learned my addr 172.21.15.45:0/2301659159 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:26.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.929+0000 7f764e59c700 1 --2- 172.21.15.45:0/2301659159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db79979ab0 0x55db79983780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:26.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.929+0000 7f764dd9b700 1 --2- 172.21.15.45:0/2301659159 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db7997a980 0x55db79983cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:26.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.929+0000 7f764ed9d700 1 -- 172.21.15.45:0/2301659159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db79979ab0 msgr2=0x55db79983780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:26.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.929+0000 7f764ed9d700 1 --2- 172.21.15.45:0/2301659159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db79979ab0 0x55db79983780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.929+0000 7f764ed9d700 1 -- 172.21.15.45:0/2301659159 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db7997a980 msgr2=0x55db79983cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:26.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.929+0000 7f764ed9d700 1 --2- 172.21.15.45:0/2301659159 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db7997a980 0x55db79983cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.929+0000 7f764ed9d700 1 -- 172.21.15.45:0/2301659159 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76501a0460 con 0x55db7997b2d0 2024-05-10T03:41:26.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.929+0000 7f764e59c700 1 --2- 172.21.15.45:0/2301659159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db79979ab0 0x55db79983780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:41:26.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.929+0000 7f764dd9b700 1 --2- 172.21.15.45:0/2301659159 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db7997a980 0x55db79983cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:41:26.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.929+0000 7f764ed9d700 1 --2- 172.21.15.45:0/2301659159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997b2d0 0x55db7998ac20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f7648004720 tx=0x7f764800e4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2acc3fa8e3da0f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:26.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.929+0000 7f7635ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:41:26.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.930+0000 7f7635ffb700 1 -- 172.21.15.45:0/2301659159 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7648004bb0 con 0x55db7997b2d0 2024-05-10T03:41:26.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.930+0000 7f7664fb7b80 1 -- 172.21.15.45:0/2301659159 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55db797ee270 con 0x55db7997b2d0 2024-05-10T03:41:26.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.930+0000 7f7635ffb700 1 -- 172.21.15.45:0/2301659159 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7648004d10 con 0x55db7997b2d0 2024-05-10T03:41:26.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.930+0000 7f7635ffb700 1 -- 172.21.15.45:0/2301659159 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f764800ea90 con 0x55db7997b2d0 2024-05-10T03:41:26.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.930+0000 7f7664fb7b80 10 client.15927 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:26.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.930+0000 7f7664fb7b80 1 -- 172.21.15.45:0/2301659159 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55db796c2b60 con 0x55db7997b2d0 2024-05-10T03:41:26.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.930+0000 7f7635ffb700 1 -- 172.21.15.45:0/2301659159 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55db797ee270 con 0x55db7997b2d0 2024-05-10T03:41:26.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.930+0000 7f7635ffb700 1 -- 172.21.15.45:0/2301659159 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f764801c030 con 0x55db7997b2d0 2024-05-10T03:41:26.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.930+0000 7f7664fb7b80 10 client.15927 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:26.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.930+0000 7f7664fb7b80 10 client.15927 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:41:26.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.930+0000 7f7664fb7b80 20 client.15927 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:26.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.930+0000 7f7664fb7b80 1 --2- 172.21.15.45:0/2301659159 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55db7998f4e0 0x55db79991930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:26.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.930+0000 7f7664fb7b80 4 client.15927 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:41:26.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.930+0000 7f7664fb7b80 1 -- 172.21.15.45:0/2301659159 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55db79944780 con 0x55db7998f4e0 2024-05-10T03:41:26.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.931+0000 7f764e59c700 1 --2- 172.21.15.45:0/2301659159 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55db7998f4e0 0x55db79991930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:26.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.931+0000 7f764e59c700 1 --2- 172.21.15.45:0/2301659159 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55db7998f4e0 0x55db79991930 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6dc23ce41f4ffebc server_cookie=4b9cbd8d904f878f in_seq=0 out_seq=0 2024-05-10T03:41:26.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.931+0000 7f7635ffb700 10 client.15927 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:26.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.932+0000 7f7635ffb700 1 -- 172.21.15.45:0/2301659159 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55db79944780 con 0x55db7998f4e0 2024-05-10T03:41:26.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.932+0000 7f7635ffb700 10 client.15927 handle_command_reply: tid=0 2024-05-10T03:41:26.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.932+0000 7f7664fb7b80 1 client.15927 shutdown 2024-05-10T03:41:26.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.932+0000 7f7664fb7b80 1 -- 172.21.15.45:0/2301659159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997b2d0 msgr2=0x55db7998ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:26.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.932+0000 7f7664fb7b80 1 --2- 172.21.15.45:0/2301659159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997b2d0 0x55db7998ac20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f7648004720 tx=0x7f764800e4f0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.932+0000 7f7664fb7b80 1 -- 172.21.15.45:0/2301659159 shutdown_connections 2024-05-10T03:41:26.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.932+0000 7f7664fb7b80 1 --2- 172.21.15.45:0/2301659159 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55db7998f4e0 0x55db79991930 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.932+0000 7f7664fb7b80 1 --2- 172.21.15.45:0/2301659159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db79979ab0 0x55db79983780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.932+0000 7f7664fb7b80 1 --2- 172.21.15.45:0/2301659159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997b2d0 0x55db7998ac20 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.932+0000 7f7635ffb700 0 client.15927 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:26.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.932+0000 7f7664fb7b80 1 --2- 172.21.15.45:0/2301659159 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db7997a980 0x55db79983cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.932+0000 7f7664fb7b80 1 -- 172.21.15.45:0/2301659159 >> 172.21.15.45:0/2301659159 conn(0x55db798d7a60 msgr2=0x55db7996ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:26.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.932+0000 7f7664fb7b80 1 -- 172.21.15.45:0/2301659159 shutdown_connections 2024-05-10T03:41:26.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.932+0000 7f7664fb7b80 1 -- 172.21.15.45:0/2301659159 wait complete. 2024-05-10T03:41:26.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.932+0000 7f7664fb7b80 20 client.15927 trim_cache size 0 max 16384 2024-05-10T03:41:26.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.950+0000 7f7664fb7b80 1 Processor -- start 2024-05-10T03:41:26.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.950+0000 7f7664fb7b80 1 -- start start 2024-05-10T03:41:26.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.951+0000 7f7664fb7b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db79979ab0 0x55db79970d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:26.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.951+0000 7f7664fb7b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db7997a980 0x55db7997e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:26.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.951+0000 7f7664fb7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997b2d0 0x55db7998a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:26.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.951+0000 7f7664fb7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db7996cd30 con 0x55db7997b2d0 2024-05-10T03:41:26.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.951+0000 7f7664fb7b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db7998c930 con 0x55db79979ab0 2024-05-10T03:41:26.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.951+0000 7f7664fb7b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db7997a7a0 con 0x55db7997a980 2024-05-10T03:41:26.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.951+0000 7f764ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997b2d0 0x55db7998a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:26.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.951+0000 7f764ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997b2d0 0x55db7998a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48870/0 (socket says 172.21.15.45:48870) 2024-05-10T03:41:26.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.951+0000 7f764ed9d700 1 -- 172.21.15.45:0/231253211 learned_addr learned my addr 172.21.15.45:0/231253211 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:26.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.951+0000 7f764dd9b700 1 --2- 172.21.15.45:0/231253211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db7997a980 0x55db7997e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:26.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.951+0000 7f764e59c700 1 --2- 172.21.15.45:0/231253211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db79979ab0 0x55db79970d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:26.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.951+0000 7f764ed9d700 1 -- 172.21.15.45:0/231253211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db7997a980 msgr2=0x55db7997e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:26.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.951+0000 7f764ed9d700 1 --2- 172.21.15.45:0/231253211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db7997a980 0x55db7997e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.951+0000 7f764ed9d700 1 -- 172.21.15.45:0/231253211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db79979ab0 msgr2=0x55db79970d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:26.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.951+0000 7f764ed9d700 1 --2- 172.21.15.45:0/231253211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db79979ab0 0x55db79970d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.951+0000 7f764ed9d700 1 -- 172.21.15.45:0/231253211 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db7985b560 con 0x55db7997b2d0 2024-05-10T03:41:26.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.951+0000 7f764ed9d700 1 --2- 172.21.15.45:0/231253211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997b2d0 0x55db7998a850 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f764800e8e0 tx=0x7f7648006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303e9c2dfc05e77 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:26.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.952+0000 7f76457fa700 1 -- 172.21.15.45:0/231253211 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764801e4f0 con 0x55db7997b2d0 2024-05-10T03:41:26.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.952+0000 7f76457fa700 1 -- 172.21.15.45:0/231253211 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f764800f040 con 0x55db7997b2d0 2024-05-10T03:41:26.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.952+0000 7f76457fa700 1 -- 172.21.15.45:0/231253211 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7648007500 con 0x55db7997b2d0 2024-05-10T03:41:26.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.952+0000 7f7664fb7b80 1 -- 172.21.15.45:0/231253211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997b2d0 msgr2=0x55db7998a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:26.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.952+0000 7f7664fb7b80 1 --2- 172.21.15.45:0/231253211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997b2d0 0x55db7998a850 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f764800e8e0 tx=0x7f7648006000 comp rx=0 tx=0).stop 2024-05-10T03:41:26.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.952+0000 7f7664fb7b80 1 -- 172.21.15.45:0/231253211 shutdown_connections 2024-05-10T03:41:26.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.952+0000 7f7664fb7b80 1 --2- 172.21.15.45:0/231253211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997b2d0 0x55db7998a850 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.952+0000 7f7664fb7b80 1 --2- 172.21.15.45:0/231253211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db79979ab0 0x55db79970d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.952+0000 7f7664fb7b80 1 --2- 172.21.15.45:0/231253211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db7997a980 0x55db7997e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.952+0000 7f7664fb7b80 1 -- 172.21.15.45:0/231253211 >> 172.21.15.45:0/231253211 conn(0x55db798d7a60 msgr2=0x55db7997dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:26.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.952+0000 7f7664fb7b80 1 -- 172.21.15.45:0/231253211 shutdown_connections 2024-05-10T03:41:26.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.952+0000 7f7664fb7b80 1 -- 172.21.15.45:0/231253211 wait complete. 2024-05-10T03:41:26.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.953+0000 7f7664fb7b80 1 -- start start 2024-05-10T03:41:26.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.953+0000 7f7664fb7b80 1 Processor -- start 2024-05-10T03:41:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.953+0000 7f7664fb7b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db79979ab0 0x55db799884a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.953+0000 7f7664fb7b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db7997a980 0x55db799889e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.953+0000 7f7664fb7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997b2d0 0x55db799898c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.953+0000 7f7664fb7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db79989e00 con 0x55db7997b2d0 2024-05-10T03:41:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.953+0000 7f7664fb7b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db79989f70 con 0x55db79979ab0 2024-05-10T03:41:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.953+0000 7f7664fb7b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db7998a130 con 0x55db7997a980 2024-05-10T03:41:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.953+0000 7f7664fb7b80 10 client.0 _ll_register_callbacks cb 0x55db7983ab30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.953+0000 7f764ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997b2d0 0x55db799898c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.953+0000 7f764ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997b2d0 0x55db799898c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48882/0 (socket says 172.21.15.45:48882) 2024-05-10T03:41:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.953+0000 7f764ed9d700 1 -- 172.21.15.45:0/538343411 learned_addr learned my addr 172.21.15.45:0/538343411 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.953+0000 7f764dd9b700 1 --2- 172.21.15.45:0/538343411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db7997a980 0x55db799889e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.953+0000 7f764e59c700 1 --2- 172.21.15.45:0/538343411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db79979ab0 0x55db799884a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.954+0000 7f764ed9d700 1 -- 172.21.15.45:0/538343411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db7997a980 msgr2=0x55db799889e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.954+0000 7f764ed9d700 1 --2- 172.21.15.45:0/538343411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db7997a980 0x55db799889e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.954+0000 7f764ed9d700 1 -- 172.21.15.45:0/538343411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db79979ab0 msgr2=0x55db799884a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.954+0000 7f764ed9d700 1 --2- 172.21.15.45:0/538343411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db79979ab0 0x55db799884a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.954+0000 7f764ed9d700 1 -- 172.21.15.45:0/538343411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55db796c2b60 con 0x55db7997b2d0 2024-05-10T03:41:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.954+0000 7f764ed9d700 1 --2- 172.21.15.45:0/538343411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997b2d0 0x55db799898c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f764801e420 tx=0x7f764800e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf59b2cb366ea2cb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.954+0000 7f7635ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:41:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.954+0000 7f7635ffb700 1 -- 172.21.15.45:0/538343411 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764801e700 con 0x55db7997b2d0 2024-05-10T03:41:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.954+0000 7f7635ffb700 1 -- 172.21.15.45:0/538343411 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f764800ea90 con 0x55db7997b2d0 2024-05-10T03:41:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.954+0000 7f7664fb7b80 1 -- 172.21.15.45:0/538343411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f763809ed40 con 0x55db7997b2d0 2024-05-10T03:41:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.954+0000 7f7635ffb700 1 -- 172.21.15.45:0/538343411 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f764800ec50 con 0x55db7997b2d0 2024-05-10T03:41:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.954+0000 7f7664fb7b80 10 client.15933 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:26.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.954+0000 7f7664fb7b80 1 -- 172.21.15.45:0/538343411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55db7971acd0 con 0x55db7997b2d0 2024-05-10T03:41:26.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.954+0000 7f7635ffb700 1 -- 172.21.15.45:0/538343411 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f763809ed40 con 0x55db7997b2d0 2024-05-10T03:41:26.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.955+0000 7f7635ffb700 1 -- 172.21.15.45:0/538343411 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7648031070 con 0x55db7997b2d0 2024-05-10T03:41:26.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.955+0000 7f7664fb7b80 10 client.15933 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:26.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.955+0000 7f7664fb7b80 10 client.15933 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:41:26.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.955+0000 7f7664fb7b80 20 client.15933 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:26.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.955+0000 7f7664fb7b80 1 --2- 172.21.15.45:0/538343411 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55db799e5c80 0x55db799e80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:26.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.955+0000 7f7664fb7b80 4 client.15933 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T03:41:26.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.955+0000 7f7664fb7b80 1 -- 172.21.15.45:0/538343411 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55db7988dec0 con 0x55db799e5c80 2024-05-10T03:41:26.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.955+0000 7f764e59c700 1 --2- 172.21.15.45:0/538343411 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55db799e5c80 0x55db799e80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:26.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.955+0000 7f764e59c700 1 --2- 172.21.15.45:0/538343411 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55db799e5c80 0x55db799e80a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a72ac80536e089d server_cookie=f1efa6fa11bbfc91 in_seq=0 out_seq=0 2024-05-10T03:41:26.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.955+0000 7f7635ffb700 10 client.15933 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:26.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.956+0000 7f7635ffb700 1 -- 172.21.15.45:0/538343411 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55db7988dec0 con 0x55db799e5c80 2024-05-10T03:41:26.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.956+0000 7f7635ffb700 10 client.15933 handle_command_reply: tid=0 2024-05-10T03:41:26.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.956+0000 7f7664fb7b80 1 client.15933 shutdown 2024-05-10T03:41:26.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.956+0000 7f7664fb7b80 1 -- 172.21.15.45:0/538343411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997b2d0 msgr2=0x55db799898c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:26.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.956+0000 7f7664fb7b80 1 --2- 172.21.15.45:0/538343411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997b2d0 0x55db799898c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f764801e420 tx=0x7f764800e910 comp rx=0 tx=0).stop 2024-05-10T03:41:26.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.956+0000 7f7664fb7b80 1 -- 172.21.15.45:0/538343411 shutdown_connections 2024-05-10T03:41:26.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.956+0000 7f7664fb7b80 1 --2- 172.21.15.45:0/538343411 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55db799e5c80 0x55db799e80a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.956+0000 7f7664fb7b80 1 --2- 172.21.15.45:0/538343411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55db7997b2d0 0x55db799898c0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.956+0000 7f7664fb7b80 1 --2- 172.21.15.45:0/538343411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db79979ab0 0x55db799884a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.956+0000 7f7664fb7b80 1 --2- 172.21.15.45:0/538343411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55db7997a980 0x55db799889e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.956+0000 7f7635ffb700 0 client.15933 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:26.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.956+0000 7f7664fb7b80 1 -- 172.21.15.45:0/538343411 >> 172.21.15.45:0/538343411 conn(0x55db798d7a60 msgr2=0x55db7997dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:26.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.956+0000 7f7664fb7b80 1 -- 172.21.15.45:0/538343411 shutdown_connections 2024-05-10T03:41:26.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.956+0000 7f7664fb7b80 1 -- 172.21.15.45:0/538343411 wait complete. 2024-05-10T03:41:26.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.956+0000 7f7664fb7b80 20 client.15933 trim_cache size 0 max 16384 2024-05-10T03:41:26.966 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:41:26.966 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-05-10T03:41:26.966 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-05-10T03:41:26.966 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:41:26.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.957+0000 7f7654c73700 1 -- 172.21.15.45:0/3368835945 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f763c0a1260 msgr2=0x7f763c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:26.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.957+0000 7f7654c73700 1 --2- 172.21.15.45:0/3368835945 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f763c0a1260 0x7f763c0a3770 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f76500694a0 tx=0x7f7640009260 comp rx=0 tx=0).stop 2024-05-10T03:41:26.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.957+0000 7f7654c73700 1 -- 172.21.15.45:0/3368835945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7650104d10 msgr2=0x7f76501984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:26.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.957+0000 7f7654c73700 1 --2- 172.21.15.45:0/3368835945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7650104d10 0x7f76501984f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f76380098e0 tx=0x7f763800f690 comp rx=0 tx=0).stop 2024-05-10T03:41:26.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.957+0000 7f7654c73700 1 -- 172.21.15.45:0/3368835945 shutdown_connections 2024-05-10T03:41:26.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.957+0000 7f7654c73700 1 --2- 172.21.15.45:0/3368835945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7650107880 0x7f765019f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.957+0000 7f7654c73700 1 --2- 172.21.15.45:0/3368835945 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f763c0a1260 0x7f763c0a3770 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.957+0000 7f7654c73700 1 --2- 172.21.15.45:0/3368835945 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7650069090 0x7f7650197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.957+0000 7f7654c73700 1 --2- 172.21.15.45:0/3368835945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7650104d10 0x7f76501984f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:26.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.957+0000 7f7654c73700 1 -- 172.21.15.45:0/3368835945 >> 172.21.15.45:0/3368835945 conn(0x7f76500fc0d0 msgr2=0x7f7650103200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:26.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.957+0000 7f7654c73700 1 -- 172.21.15.45:0/3368835945 shutdown_connections 2024-05-10T03:41:26.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:26.957+0000 7f7654c73700 1 -- 172.21.15.45:0/3368835945 wait complete. 2024-05-10T03:41:26.974 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-10T03:41:26.974 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:41:27.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.127+0000 7f8f94458700 1 -- 172.21.15.45:0/1420818611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f8c1010d0 msgr2=0x7f8f8c1014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.127+0000 7f8f94458700 1 --2- 172.21.15.45:0/1420818611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f8c1010d0 0x7f8f8c1014e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c009990 tx=0x7f8f7c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.127+0000 7f8f94458700 1 -- 172.21.15.45:0/1420818611 shutdown_connections 2024-05-10T03:41:27.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.127+0000 7f8f94458700 1 --2- 172.21.15.45:0/1420818611 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f8c1025d0 0x7f8f8c109090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.127+0000 7f8f94458700 1 --2- 172.21.15.45:0/1420818611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f8c1010d0 0x7f8f8c1014e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.127+0000 7f8f94458700 1 --2- 172.21.15.45:0/1420818611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8c101ab0 0x7f8f8c101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.127+0000 7f8f94458700 1 -- 172.21.15.45:0/1420818611 >> 172.21.15.45:0/1420818611 conn(0x7f8f8c0fb8f0 msgr2=0x7f8f8c0fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:27.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.127+0000 7f8f94458700 1 -- 172.21.15.45:0/1420818611 shutdown_connections 2024-05-10T03:41:27.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.127+0000 7f8f94458700 1 -- 172.21.15.45:0/1420818611 wait complete. 2024-05-10T03:41:27.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.128+0000 7f8f94458700 1 Processor -- start 2024-05-10T03:41:27.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.128+0000 7f8f94458700 1 -- start start 2024-05-10T03:41:27.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.128+0000 7f8f94458700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f8c1010d0 0x7f8f8c100790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.128+0000 7f8f94458700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8c101ab0 0x7f8f8c19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.128+0000 7f8f94458700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f8c1025d0 0x7f8f8c19f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.128+0000 7f8f94458700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c19fb80 con 0x7f8f8c1010d0 2024-05-10T03:41:27.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.128+0000 7f8f94458700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c19fcf0 con 0x7f8f8c1025d0 2024-05-10T03:41:27.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.128+0000 7f8f94458700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c19feb0 con 0x7f8f8c101ab0 2024-05-10T03:41:27.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.128+0000 7f8f921f4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f8c1010d0 0x7f8f8c100790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.128+0000 7f8f921f4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f8c1010d0 0x7f8f8c100790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48908/0 (socket says 172.21.15.45:48908) 2024-05-10T03:41:27.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.128+0000 7f8f921f4700 1 -- 172.21.15.45:0/3538975314 learned_addr learned my addr 172.21.15.45:0/3538975314 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:27.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.128+0000 7f8f919f3700 1 --2- 172.21.15.45:0/3538975314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8c101ab0 0x7f8f8c19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.128+0000 7f8f929f5700 1 --2- 172.21.15.45:0/3538975314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f8c1025d0 0x7f8f8c19f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.129+0000 7f8f921f4700 1 -- 172.21.15.45:0/3538975314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8c101ab0 msgr2=0x7f8f8c19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.129+0000 7f8f921f4700 1 --2- 172.21.15.45:0/3538975314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8c101ab0 0x7f8f8c19ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.129+0000 7f8f921f4700 1 -- 172.21.15.45:0/3538975314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f8c1025d0 msgr2=0x7f8f8c19f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.129+0000 7f8f921f4700 1 --2- 172.21.15.45:0/3538975314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f8c1025d0 0x7f8f8c19f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.129+0000 7f8f921f4700 1 -- 172.21.15.45:0/3538975314 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7c0095f0 con 0x7f8f8c1010d0 2024-05-10T03:41:27.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.129+0000 7f8f919f3700 1 --2- 172.21.15.45:0/3538975314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8c101ab0 0x7f8f8c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:27.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.129+0000 7f8f929f5700 1 --2- 172.21.15.45:0/3538975314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f8c1025d0 0x7f8f8c19f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:27.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.129+0000 7f8f921f4700 1 --2- 172.21.15.45:0/3538975314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f8c1010d0 0x7f8f8c100790 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0098e0 tx=0x7f8f7c005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:27.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.129+0000 7f8f837fe700 1 -- 172.21.15.45:0/3538975314 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c01d070 con 0x7f8f8c1010d0 2024-05-10T03:41:27.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.129+0000 7f8f837fe700 1 -- 172.21.15.45:0/3538975314 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8f7c00be40 con 0x7f8f8c1010d0 2024-05-10T03:41:27.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.129+0000 7f8f94458700 1 -- 172.21.15.45:0/3538975314 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f8c1a0130 con 0x7f8f8c1010d0 2024-05-10T03:41:27.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.129+0000 7f8f837fe700 1 -- 172.21.15.45:0/3538975314 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c017650 con 0x7f8f8c1010d0 2024-05-10T03:41:27.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.129+0000 7f8f94458700 1 -- 172.21.15.45:0/3538975314 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f8c1a0550 con 0x7f8f8c1010d0 2024-05-10T03:41:27.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.130+0000 7f8f94458700 1 -- 172.21.15.45:0/3538975314 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f8c107f30 con 0x7f8f8c1010d0 2024-05-10T03:41:27.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.132+0000 7f8f837fe700 1 -- 172.21.15.45:0/3538975314 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8f7c021410 con 0x7f8f8c1010d0 2024-05-10T03:41:27.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.133+0000 7f8f837fe700 1 --2- 172.21.15.45:0/3538975314 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8f780a1120 0x7f8f780a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.133+0000 7f8f919f3700 1 --2- 172.21.15.45:0/3538975314 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8f780a1120 0x7f8f780a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.133+0000 7f8f837fe700 1 -- 172.21.15.45:0/3538975314 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f8f7c0ce8b0 con 0x7f8f8c1010d0 2024-05-10T03:41:27.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.134+0000 7f8f919f3700 1 --2- 172.21.15.45:0/3538975314 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8f780a1120 0x7f8f780a3630 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c100130 tx=0x7f8f88009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:27.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.137+0000 7f8f837fe700 1 -- 172.21.15.45:0/3538975314 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8f7c097cd0 con 0x7f8f8c1010d0 2024-05-10T03:41:27.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:27 smithi106 ceph-mon[46996]: pgmap v320: 129 pgs: 129 active+clean; 671 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:41:27.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.403+0000 7f8f94458700 1 -- 172.21.15.45:0/3538975314 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f8c0678b0 con 0x7f8f8c1010d0 2024-05-10T03:41:27.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.404+0000 7f8f837fe700 1 -- 172.21.15.45:0/3538975314 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+10926 (secure 0 0 0) 0x7f8f7c09b2f0 con 0x7f8f8c1010d0 2024-05-10T03:41:27.408 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:41:27.408 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/378320264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":378320264},{"type":"v1","addr":"172.21.15.45:6835","nonce":378320264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3032381796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3032381796},{"type":"v1","addr":"172.21.15.45:6837","nonce":3032381796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T03:38:36.555290+0000","modified":"2024-05-10T03:40:14.047840+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24548,"mds_2":24547,"mds_3":24526,"mds_4":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14625":{"gid":14625,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6839/4007419304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":4007419304},{"type":"v1","addr":"172.21.15.45:6839","nonce":4007419304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14637":{"gid":14637,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6841/1355456195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1355456195},{"type":"v1","addr":"172.21.15.45:6841","nonce":1355456195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/4037121210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":4037121210},{"type":"v1","addr":"172.21.15.154:6835","nonce":4037121210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24521":{"gid":24521,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.106:6835/4162885659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4162885659},{"type":"v1","addr":"172.21.15.106:6835","nonce":4162885659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.154:6837/608167481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":608167481},{"type":"v1","addr":"172.21.15.154:6837","nonce":608167481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/1506563336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1506563336},{"type":"v1","addr":"172.21.15.154:6839","nonce":1506563336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.106:6837/3047487403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":3047487403},{"type":"v1","addr":"172.21.15.106:6837","nonce":3047487403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6839/3533867856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":3533867856},{"type":"v1","addr":"172.21.15.106:6839","nonce":3533867856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T03:41:27.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.407+0000 7f8f94458700 1 -- 172.21.15.45:0/3538975314 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8f780a1120 msgr2=0x7f8f780a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.407+0000 7f8f94458700 1 --2- 172.21.15.45:0/3538975314 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8f780a1120 0x7f8f780a3630 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c100130 tx=0x7f8f88009260 comp rx=0 tx=0).stop 2024-05-10T03:41:27.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.407+0000 7f8f94458700 1 -- 172.21.15.45:0/3538975314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f8c1010d0 msgr2=0x7f8f8c100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.407+0000 7f8f94458700 1 --2- 172.21.15.45:0/3538975314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f8c1010d0 0x7f8f8c100790 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0098e0 tx=0x7f8f7c005b00 comp rx=0 tx=0).stop 2024-05-10T03:41:27.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.407+0000 7f8f94458700 1 -- 172.21.15.45:0/3538975314 shutdown_connections 2024-05-10T03:41:27.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.407+0000 7f8f94458700 1 --2- 172.21.15.45:0/3538975314 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8f780a1120 0x7f8f780a3630 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.407+0000 7f8f94458700 1 --2- 172.21.15.45:0/3538975314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f8c1025d0 0x7f8f8c19f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.407+0000 7f8f94458700 1 --2- 172.21.15.45:0/3538975314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f8c1010d0 0x7f8f8c100790 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.407+0000 7f8f94458700 1 --2- 172.21.15.45:0/3538975314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8c101ab0 0x7f8f8c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.407+0000 7f8f94458700 1 -- 172.21.15.45:0/3538975314 >> 172.21.15.45:0/3538975314 conn(0x7f8f8c0fb8f0 msgr2=0x7f8f8c105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:27.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.407+0000 7f8f94458700 1 -- 172.21.15.45:0/3538975314 shutdown_connections 2024-05-10T03:41:27.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.407+0000 7f8f94458700 1 -- 172.21.15.45:0/3538975314 wait complete. 2024-05-10T03:41:27.411 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 28 2024-05-10T03:41:27.423 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:27 smithi045 ceph-mon[42520]: pgmap v320: 129 pgs: 129 active+clean; 671 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:41:27.425 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-05-10T03:41:27.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:27 smithi154 ceph-mon[46565]: pgmap v320: 129 pgs: 129 active+clean; 671 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:41:27.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.573+0000 7f198fee0700 1 -- 172.21.15.45:0/1749726542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1988101a70 msgr2=0x7f1988101f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.573+0000 7f198fee0700 1 --2- 172.21.15.45:0/1749726542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1988101a70 0x7f1988101f40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1978009990 tx=0x7f1978009ca0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.574+0000 7f198fee0700 1 -- 172.21.15.45:0/1749726542 shutdown_connections 2024-05-10T03:41:27.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.574+0000 7f198fee0700 1 --2- 172.21.15.45:0/1749726542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1988101090 0x7f19881014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.574+0000 7f198fee0700 1 --2- 172.21.15.45:0/1749726542 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19881025d0 0x7f1988109050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.574+0000 7f198fee0700 1 --2- 172.21.15.45:0/1749726542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1988101a70 0x7f1988101f40 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.574+0000 7f198fee0700 1 -- 172.21.15.45:0/1749726542 >> 172.21.15.45:0/1749726542 conn(0x7f19880fb8f0 msgr2=0x7f19880fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:27.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.574+0000 7f198fee0700 1 -- 172.21.15.45:0/1749726542 shutdown_connections 2024-05-10T03:41:27.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.574+0000 7f198fee0700 1 -- 172.21.15.45:0/1749726542 wait complete. 2024-05-10T03:41:27.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.574+0000 7f198fee0700 1 Processor -- start 2024-05-10T03:41:27.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.574+0000 7f198fee0700 1 -- start start 2024-05-10T03:41:27.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.575+0000 7f198fee0700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1988101090 0x7f1988104aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.575+0000 7f198fee0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1988101a70 0x7f1988103140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.575+0000 7f198fee0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19881025d0 0x7f1988103680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.575+0000 7f198fee0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1988103ce0 con 0x7f1988101a70 2024-05-10T03:41:27.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.575+0000 7f198fee0700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1988103e50 con 0x7f1988101090 2024-05-10T03:41:27.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.575+0000 7f198fee0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1988104010 con 0x7f19881025d0 2024-05-10T03:41:27.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.575+0000 7f198d47b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1988101a70 0x7f1988103140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.575+0000 7f198d47b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1988101a70 0x7f1988103140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37134/0 (socket says 172.21.15.45:37134) 2024-05-10T03:41:27.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.575+0000 7f198d47b700 1 -- 172.21.15.45:0/3743245963 learned_addr learned my addr 172.21.15.45:0/3743245963 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:27.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.575+0000 7f198dc7c700 1 --2- 172.21.15.45:0/3743245963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1988101090 0x7f1988104aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.575+0000 7f198e47d700 1 --2- 172.21.15.45:0/3743245963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19881025d0 0x7f1988103680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.575+0000 7f198d47b700 1 -- 172.21.15.45:0/3743245963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19881025d0 msgr2=0x7f1988103680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.575+0000 7f198d47b700 1 --2- 172.21.15.45:0/3743245963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19881025d0 0x7f1988103680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.575+0000 7f198d47b700 1 -- 172.21.15.45:0/3743245963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1988101090 msgr2=0x7f1988104aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.575+0000 7f198d47b700 1 --2- 172.21.15.45:0/3743245963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1988101090 0x7f1988104aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.575+0000 7f198d47b700 1 -- 172.21.15.45:0/3743245963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19780095f0 con 0x7f1988101a70 2024-05-10T03:41:27.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.575+0000 7f198e47d700 1 --2- 172.21.15.45:0/3743245963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19881025d0 0x7f1988103680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:41:27.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.575+0000 7f198dc7c700 1 --2- 172.21.15.45:0/3743245963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1988101090 0x7f1988104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:27.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.575+0000 7f198d47b700 1 --2- 172.21.15.45:0/3743245963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1988101a70 0x7f1988103140 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f19780098e0 tx=0x7f197800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:27.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.576+0000 7f197effd700 1 -- 172.21.15.45:0/3743245963 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197801d070 con 0x7f1988101a70 2024-05-10T03:41:27.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.576+0000 7f197effd700 1 -- 172.21.15.45:0/3743245963 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f19780218f0 con 0x7f1988101a70 2024-05-10T03:41:27.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.576+0000 7f198fee0700 1 -- 172.21.15.45:0/3743245963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19881a2230 con 0x7f1988101a70 2024-05-10T03:41:27.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.576+0000 7f197effd700 1 -- 172.21.15.45:0/3743245963 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19780176c0 con 0x7f1988101a70 2024-05-10T03:41:27.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.576+0000 7f198fee0700 1 -- 172.21.15.45:0/3743245963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19881a2650 con 0x7f1988101a70 2024-05-10T03:41:27.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.578+0000 7f197effd700 1 -- 172.21.15.45:0/3743245963 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1978021410 con 0x7f1988101a70 2024-05-10T03:41:27.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.579+0000 7f197effd700 1 --2- 172.21.15.45:0/3743245963 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f19740a11c0 0x7f19740a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.579+0000 7f197effd700 1 -- 172.21.15.45:0/3743245963 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f19780ce020 con 0x7f1988101a70 2024-05-10T03:41:27.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.579+0000 7f198dc7c700 1 --2- 172.21.15.45:0/3743245963 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f19740a11c0 0x7f19740a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.580+0000 7f198dc7c700 1 --2- 172.21.15.45:0/3743245963 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f19740a11c0 0x7f19740a36d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1988068330 tx=0x7f1984009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:27.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.580+0000 7f19a0224b80 1 Processor -- start 2024-05-10T03:41:27.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.580+0000 7f19a0224b80 1 -- start start 2024-05-10T03:41:27.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.580+0000 7f19a0224b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606df0ff6a0 0x5606df0ffaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.580+0000 7f19a0224b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df100570 0x5606df100980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.580+0000 7f19a0224b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606df100ec0 0x5606df1077c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.580+0000 7f19a0224b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606df026150 con 0x5606df100570 2024-05-10T03:41:27.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.580+0000 7f19a0224b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606df023b10 con 0x5606df100ec0 2024-05-10T03:41:27.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.580+0000 7f19a0224b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606df01f400 con 0x5606df0ff6a0 2024-05-10T03:41:27.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.580+0000 7f198d47b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df100570 0x5606df100980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.581+0000 7f198d47b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df100570 0x5606df100980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37140/0 (socket says 172.21.15.45:37140) 2024-05-10T03:41:27.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.581+0000 7f198d47b700 1 -- 172.21.15.45:0/1664560688 learned_addr learned my addr 172.21.15.45:0/1664560688 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:27.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.581+0000 7f198dc7c700 1 --2- 172.21.15.45:0/1664560688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606df0ff6a0 0x5606df0ffaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.581+0000 7f198e47d700 1 --2- 172.21.15.45:0/1664560688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606df100ec0 0x5606df1077c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.581+0000 7f198dc7c700 1 -- 172.21.15.45:0/1664560688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606df100ec0 msgr2=0x5606df1077c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:27.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.581+0000 7f198dc7c700 1 --2- 172.21.15.45:0/1664560688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606df100ec0 0x5606df1077c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.581+0000 7f198dc7c700 1 -- 172.21.15.45:0/1664560688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df100570 msgr2=0x5606df100980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:27.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.581+0000 7f198dc7c700 1 --2- 172.21.15.45:0/1664560688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df100570 0x5606df100980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.581+0000 7f198dc7c700 1 -- 172.21.15.45:0/1664560688 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606deea03b0 con 0x5606df0ff6a0 2024-05-10T03:41:27.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.581+0000 7f198d47b700 1 --2- 172.21.15.45:0/1664560688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df100570 0x5606df100980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:41:27.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.581+0000 7f198dc7c700 1 --2- 172.21.15.45:0/1664560688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606df0ff6a0 0x5606df0ffaf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1984011f50 tx=0x7f1984014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=628ca508f51cbb49 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:27.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.581+0000 7f1973fff700 1 -- 172.21.15.45:0/1664560688 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1984009a40 con 0x5606df0ff6a0 2024-05-10T03:41:27.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.581+0000 7f1973fff700 1 -- 172.21.15.45:0/1664560688 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1984009e70 con 0x5606df0ff6a0 2024-05-10T03:41:27.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.581+0000 7f1973fff700 1 -- 172.21.15.45:0/1664560688 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1984012c30 con 0x5606df0ff6a0 2024-05-10T03:41:27.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.582+0000 7f19a0224b80 1 -- 172.21.15.45:0/1664560688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606df0ff6a0 msgr2=0x5606df0ffaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.582+0000 7f19a0224b80 1 --2- 172.21.15.45:0/1664560688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606df0ff6a0 0x5606df0ffaf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1984011f50 tx=0x7f1984014000 comp rx=0 tx=0).stop 2024-05-10T03:41:27.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.582+0000 7f19a0224b80 1 -- 172.21.15.45:0/1664560688 shutdown_connections 2024-05-10T03:41:27.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.582+0000 7f19a0224b80 1 --2- 172.21.15.45:0/1664560688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606df0ff6a0 0x5606df0ffaf0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.582+0000 7f19a0224b80 1 --2- 172.21.15.45:0/1664560688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606df100ec0 0x5606df1077c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.582+0000 7f19a0224b80 1 --2- 172.21.15.45:0/1664560688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df100570 0x5606df100980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.582+0000 7f19a0224b80 1 -- 172.21.15.45:0/1664560688 >> 172.21.15.45:0/1664560688 conn(0x5606df061a60 msgr2=0x5606df0f9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:27.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.582+0000 7f19a0224b80 1 -- 172.21.15.45:0/1664560688 shutdown_connections 2024-05-10T03:41:27.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.582+0000 7f19a0224b80 1 -- 172.21.15.45:0/1664560688 wait complete. 2024-05-10T03:41:27.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.583+0000 7f19a0224b80 1 -- start start 2024-05-10T03:41:27.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.583+0000 7f19a0224b80 1 Processor -- start 2024-05-10T03:41:27.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.583+0000 7f19a0224b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606df0ff6a0 0x5606df1096e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.583+0000 7f19a0224b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606df100570 0x5606df109c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.583+0000 7f19a0224b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df100ec0 0x5606df110b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.583+0000 7f19a0224b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606defbb560 con 0x5606df100ec0 2024-05-10T03:41:27.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.583+0000 7f19a0224b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606defbb200 con 0x5606df100570 2024-05-10T03:41:27.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.583+0000 7f19a0224b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606deea26a0 con 0x5606df0ff6a0 2024-05-10T03:41:27.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.584+0000 7f19a0224b80 10 client.0 _ll_register_callbacks cb 0x5606defc4b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:27.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.584+0000 7f198dc7c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606df0ff6a0 0x5606df1096e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.584+0000 7f198dc7c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606df0ff6a0 0x5606df1096e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:54410/0 (socket says 172.21.15.45:54410) 2024-05-10T03:41:27.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.584+0000 7f198e47d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df100ec0 0x5606df110b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.584+0000 7f198dc7c700 1 -- 172.21.15.45:0/1460694600 learned_addr learned my addr 172.21.15.45:0/1460694600 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:27.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.584+0000 7f198d47b700 1 --2- 172.21.15.45:0/1460694600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606df100570 0x5606df109c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.584+0000 7f198e47d700 1 -- 172.21.15.45:0/1460694600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606df0ff6a0 msgr2=0x5606df1096e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:27.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.584+0000 7f198e47d700 1 --2- 172.21.15.45:0/1460694600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606df0ff6a0 0x5606df1096e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.584+0000 7f198e47d700 1 -- 172.21.15.45:0/1460694600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606df100570 msgr2=0x5606df109c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:27.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.584+0000 7f198e47d700 1 --2- 172.21.15.45:0/1460694600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606df100570 0x5606df109c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.584+0000 7f198e47d700 1 -- 172.21.15.45:0/1460694600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19881a2650 con 0x5606df100ec0 2024-05-10T03:41:27.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.584+0000 7f198d47b700 1 --2- 172.21.15.45:0/1460694600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606df100570 0x5606df109c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:27.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.584+0000 7f198dc7c700 1 --2- 172.21.15.45:0/1460694600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606df0ff6a0 0x5606df1096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:41:27.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.584+0000 7f198e47d700 1 --2- 172.21.15.45:0/1460694600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df100ec0 0x5606df110b80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1980010d50 tx=0x7f198000e4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e8a098e76f103b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:27.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.584+0000 7f19717fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:41:27.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.584+0000 7f19717fa700 1 -- 172.21.15.45:0/1460694600 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198000ecb0 con 0x5606df100ec0 2024-05-10T03:41:27.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.584+0000 7f19717fa700 1 -- 172.21.15.45:0/1460694600 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f198000ee10 con 0x5606df100ec0 2024-05-10T03:41:27.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.584+0000 7f19a0224b80 1 -- 172.21.15.45:0/1460694600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5606def78270 con 0x5606df100ec0 2024-05-10T03:41:27.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.585+0000 7f19717fa700 1 -- 172.21.15.45:0/1460694600 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1980014440 con 0x5606df100ec0 2024-05-10T03:41:27.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.585+0000 7f19a0224b80 10 client.15951 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:27.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.585+0000 7f19a0224b80 1 -- 172.21.15.45:0/1460694600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f1984011c30 con 0x5606df100ec0 2024-05-10T03:41:27.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.585+0000 7f19717fa700 1 -- 172.21.15.45:0/1460694600 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x5606def78270 con 0x5606df100ec0 2024-05-10T03:41:27.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.585+0000 7f19717fa700 1 -- 172.21.15.45:0/1460694600 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1980012040 con 0x5606df100ec0 2024-05-10T03:41:27.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.585+0000 7f19a0224b80 10 client.15951 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:27.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.585+0000 7f19a0224b80 10 client.15951 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2024-05-10T03:41:27.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.585+0000 7f19a0224b80 20 client.15951 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:27.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.585+0000 7f19a0224b80 1 --2- 172.21.15.45:0/1460694600 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x5606df115390 0x5606df1177e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.585+0000 7f19a0224b80 4 client.15951 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:41:27.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.585+0000 7f19a0224b80 1 -- 172.21.15.45:0/1460694600 --> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5606df0ce780 con 0x5606df115390 2024-05-10T03:41:27.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.585+0000 7f198dc7c700 1 --2- 172.21.15.45:0/1460694600 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x5606df115390 0x5606df1177e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.586+0000 7f19717fa700 10 client.15951 ms_handle_connect on v2:172.21.15.106:6834/4162885659 2024-05-10T03:41:27.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.586+0000 7f198dc7c700 1 --2- 172.21.15.45:0/1460694600 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x5606df115390 0x5606df1177e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6a4259b8ab190e12 server_cookie=986704d3c5424927 in_seq=0 out_seq=0 2024-05-10T03:41:27.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.587+0000 7f19717fa700 1 -- 172.21.15.45:0/1460694600 <== mds.4 v2:172.21.15.106:6834/4162885659 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5606df0ce780 con 0x5606df115390 2024-05-10T03:41:27.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.587+0000 7f19717fa700 10 client.15951 handle_command_reply: tid=0 2024-05-10T03:41:27.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.587+0000 7f19a0224b80 1 client.15951 shutdown 2024-05-10T03:41:27.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.587+0000 7f19a0224b80 1 -- 172.21.15.45:0/1460694600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df100ec0 msgr2=0x5606df110b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.587+0000 7f19a0224b80 1 --2- 172.21.15.45:0/1460694600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df100ec0 0x5606df110b80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1980010d50 tx=0x7f198000e4a0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.587+0000 7f19a0224b80 1 -- 172.21.15.45:0/1460694600 shutdown_connections 2024-05-10T03:41:27.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.587+0000 7f19a0224b80 1 --2- 172.21.15.45:0/1460694600 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x5606df115390 0x5606df1177e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.587+0000 7f19a0224b80 1 --2- 172.21.15.45:0/1460694600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606df0ff6a0 0x5606df1096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.587+0000 7f19a0224b80 1 --2- 172.21.15.45:0/1460694600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df100ec0 0x5606df110b80 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.587+0000 7f19717fa700 0 client.15951 ms_handle_reset on v2:172.21.15.106:6834/4162885659 2024-05-10T03:41:27.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.587+0000 7f19a0224b80 1 --2- 172.21.15.45:0/1460694600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606df100570 0x5606df109c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.587+0000 7f19a0224b80 1 -- 172.21.15.45:0/1460694600 >> 172.21.15.45:0/1460694600 conn(0x5606df061a60 msgr2=0x5606df0f9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:27.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.587+0000 7f19a0224b80 1 -- 172.21.15.45:0/1460694600 shutdown_connections 2024-05-10T03:41:27.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.587+0000 7f19a0224b80 1 -- 172.21.15.45:0/1460694600 wait complete. 2024-05-10T03:41:27.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.587+0000 7f19a0224b80 20 client.15951 trim_cache size 0 max 16384 2024-05-10T03:41:27.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.601+0000 7f19a0224b80 1 Processor -- start 2024-05-10T03:41:27.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.601+0000 7f19a0224b80 1 -- start start 2024-05-10T03:41:27.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.601+0000 7f19a0224b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df0ff6a0 0x5606df100980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.601+0000 7f19a0224b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606df100570 0x5606df110a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.601+0000 7f19a0224b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606df100ec0 0x5606df0f6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.601+0000 7f19a0224b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606df0f47c0 con 0x5606df0ff6a0 2024-05-10T03:41:27.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.601+0000 7f19a0224b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606df111160 con 0x5606df100ec0 2024-05-10T03:41:27.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.601+0000 7f19a0224b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606df111320 con 0x5606df100570 2024-05-10T03:41:27.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.602+0000 7f198dc7c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df0ff6a0 0x5606df100980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.602+0000 7f198dc7c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df0ff6a0 0x5606df100980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37166/0 (socket says 172.21.15.45:37166) 2024-05-10T03:41:27.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.602+0000 7f198dc7c700 1 -- 172.21.15.45:0/2803522641 learned_addr learned my addr 172.21.15.45:0/2803522641 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:27.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.602+0000 7f198e47d700 1 --2- 172.21.15.45:0/2803522641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606df100ec0 0x5606df0f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.602+0000 7f198d47b700 1 --2- 172.21.15.45:0/2803522641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606df100570 0x5606df110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.602+0000 7f198dc7c700 1 -- 172.21.15.45:0/2803522641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606df100570 msgr2=0x5606df110a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:27.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.602+0000 7f198dc7c700 1 --2- 172.21.15.45:0/2803522641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606df100570 0x5606df110a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.602+0000 7f198dc7c700 1 -- 172.21.15.45:0/2803522641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606df100ec0 msgr2=0x5606df0f6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:27.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.602+0000 7f198dc7c700 1 --2- 172.21.15.45:0/2803522641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606df100ec0 0x5606df0f6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.602+0000 7f198dc7c700 1 -- 172.21.15.45:0/2803522641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606dee4cb60 con 0x5606df0ff6a0 2024-05-10T03:41:27.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.602+0000 7f198d47b700 1 --2- 172.21.15.45:0/2803522641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606df100570 0x5606df110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:27.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.602+0000 7f198dc7c700 1 --2- 172.21.15.45:0/2803522641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df0ff6a0 0x5606df100980 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f19840096d0 tx=0x7f1984009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16651cf03734595 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:27.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.602+0000 7f197cff9700 1 -- 172.21.15.45:0/2803522641 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1984032070 con 0x5606df0ff6a0 2024-05-10T03:41:27.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.602+0000 7f197cff9700 1 -- 172.21.15.45:0/2803522641 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f19840125a0 con 0x5606df0ff6a0 2024-05-10T03:41:27.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.602+0000 7f197cff9700 1 -- 172.21.15.45:0/2803522641 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1984032430 con 0x5606df0ff6a0 2024-05-10T03:41:27.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.603+0000 7f19a0224b80 1 -- 172.21.15.45:0/2803522641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df0ff6a0 msgr2=0x5606df100980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.603+0000 7f19a0224b80 1 --2- 172.21.15.45:0/2803522641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df0ff6a0 0x5606df100980 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f19840096d0 tx=0x7f1984009620 comp rx=0 tx=0).stop 2024-05-10T03:41:27.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.603+0000 7f19a0224b80 1 -- 172.21.15.45:0/2803522641 shutdown_connections 2024-05-10T03:41:27.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.603+0000 7f19a0224b80 1 --2- 172.21.15.45:0/2803522641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606df100ec0 0x5606df0f6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.603+0000 7f19a0224b80 1 --2- 172.21.15.45:0/2803522641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df0ff6a0 0x5606df100980 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.603+0000 7f19a0224b80 1 --2- 172.21.15.45:0/2803522641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606df100570 0x5606df110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.603+0000 7f19a0224b80 1 -- 172.21.15.45:0/2803522641 >> 172.21.15.45:0/2803522641 conn(0x5606df061a60 msgr2=0x5606df0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:27.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.603+0000 7f19a0224b80 1 -- 172.21.15.45:0/2803522641 shutdown_connections 2024-05-10T03:41:27.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.603+0000 7f19a0224b80 1 -- 172.21.15.45:0/2803522641 wait complete. 2024-05-10T03:41:27.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.604+0000 7f19a0224b80 1 -- start start 2024-05-10T03:41:27.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.604+0000 7f19a0224b80 1 Processor -- start 2024-05-10T03:41:27.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.604+0000 7f19a0224b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606df0ff6a0 0x5606df10d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.604+0000 7f19a0224b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df100570 0x5606df10de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.604+0000 7f19a0224b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606df100ec0 0x5606df169850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.605+0000 7f19a0224b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606df110d40 con 0x5606df100570 2024-05-10T03:41:27.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.605+0000 7f19a0224b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606df110eb0 con 0x5606df100ec0 2024-05-10T03:41:27.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.605+0000 7f19a0224b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606df169d90 con 0x5606df0ff6a0 2024-05-10T03:41:27.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.605+0000 7f19a0224b80 10 client.0 _ll_register_callbacks cb 0x5606defc4b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:27.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.605+0000 7f198d47b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df100570 0x5606df10de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.605+0000 7f198d47b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df100570 0x5606df10de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37172/0 (socket says 172.21.15.45:37172) 2024-05-10T03:41:27.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.605+0000 7f198d47b700 1 -- 172.21.15.45:0/1933258280 learned_addr learned my addr 172.21.15.45:0/1933258280 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:27.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.605+0000 7f198dc7c700 1 --2- 172.21.15.45:0/1933258280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606df0ff6a0 0x5606df10d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.605+0000 7f198e47d700 1 --2- 172.21.15.45:0/1933258280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606df100ec0 0x5606df169850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.605+0000 7f198d47b700 1 -- 172.21.15.45:0/1933258280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606df0ff6a0 msgr2=0x5606df10d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:27.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.605+0000 7f198d47b700 1 --2- 172.21.15.45:0/1933258280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606df0ff6a0 0x5606df10d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.605+0000 7f198d47b700 1 -- 172.21.15.45:0/1933258280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606df100ec0 msgr2=0x5606df169850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:27.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.605+0000 7f198d47b700 1 --2- 172.21.15.45:0/1933258280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606df100ec0 0x5606df169850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.605+0000 7f198d47b700 1 -- 172.21.15.45:0/1933258280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5606deea03b0 con 0x5606df100570 2024-05-10T03:41:27.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.605+0000 7f198e47d700 1 --2- 172.21.15.45:0/1933258280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606df100ec0 0x5606df169850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:27.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.605+0000 7f198d47b700 1 --2- 172.21.15.45:0/1933258280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df100570 0x5606df10de50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1978097780 tx=0x7f1978009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e822088f043b6695 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:27.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.605+0000 7f19717fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:41:27.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.605+0000 7f19717fa700 1 -- 172.21.15.45:0/1933258280 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197809f0b0 con 0x5606df100570 2024-05-10T03:41:27.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.605+0000 7f19717fa700 1 -- 172.21.15.45:0/1933258280 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f19780a3670 con 0x5606df100570 2024-05-10T03:41:27.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.605+0000 7f19a0224b80 1 -- 172.21.15.45:0/1933258280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1984009e70 con 0x5606df100570 2024-05-10T03:41:27.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.606+0000 7f19717fa700 1 -- 172.21.15.45:0/1933258280 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1978099620 con 0x5606df100570 2024-05-10T03:41:27.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.606+0000 7f19a0224b80 10 client.15957 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:27.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.606+0000 7f19a0224b80 1 -- 172.21.15.45:0/1933258280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5606defe5560 con 0x5606df100570 2024-05-10T03:41:27.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.606+0000 7f19717fa700 1 -- 172.21.15.45:0/1933258280 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1984009e70 con 0x5606df100570 2024-05-10T03:41:27.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.606+0000 7f19717fa700 1 -- 172.21.15.45:0/1933258280 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f19780a1220 con 0x5606df100570 2024-05-10T03:41:27.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.606+0000 7f19a0224b80 10 client.15957 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:27.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.606+0000 7f19a0224b80 10 client.15957 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2024-05-10T03:41:27.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.606+0000 7f19a0224b80 20 client.15957 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:27.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.606+0000 7f19a0224b80 1 --2- 172.21.15.45:0/1933258280 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x5606df16b380 0x5606df16d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.606+0000 7f19a0224b80 4 client.15957 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-10T03:41:27.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.606+0000 7f19a0224b80 1 -- 172.21.15.45:0/1933258280 --> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5606df017ec0 con 0x5606df16b380 2024-05-10T03:41:27.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.606+0000 7f198dc7c700 1 --2- 172.21.15.45:0/1933258280 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x5606df16b380 0x5606df16d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.607+0000 7f19717fa700 10 client.15957 ms_handle_connect on v2:172.21.15.106:6834/4162885659 2024-05-10T03:41:27.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.607+0000 7f198dc7c700 1 --2- 172.21.15.45:0/1933258280 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x5606df16b380 0x5606df16d7a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9be6a16395433e5e server_cookie=dfc8595cb5a7e1eb in_seq=0 out_seq=0 2024-05-10T03:41:27.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.607+0000 7f19717fa700 1 -- 172.21.15.45:0/1933258280 <== mds.4 v2:172.21.15.106:6834/4162885659 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5606df017ec0 con 0x5606df16b380 2024-05-10T03:41:27.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.607+0000 7f19717fa700 10 client.15957 handle_command_reply: tid=0 2024-05-10T03:41:27.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.607+0000 7f19a0224b80 1 client.15957 shutdown 2024-05-10T03:41:27.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.607+0000 7f19a0224b80 1 -- 172.21.15.45:0/1933258280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df100570 msgr2=0x5606df10de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.607+0000 7f19a0224b80 1 --2- 172.21.15.45:0/1933258280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df100570 0x5606df10de50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1978097780 tx=0x7f1978009ca0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.607+0000 7f19a0224b80 1 -- 172.21.15.45:0/1933258280 shutdown_connections 2024-05-10T03:41:27.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.607+0000 7f19a0224b80 1 --2- 172.21.15.45:0/1933258280 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x5606df16b380 0x5606df16d7a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.607+0000 7f19a0224b80 1 --2- 172.21.15.45:0/1933258280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606df0ff6a0 0x5606df10d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.607+0000 7f19a0224b80 1 --2- 172.21.15.45:0/1933258280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606df100ec0 0x5606df169850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.607+0000 7f19a0224b80 1 --2- 172.21.15.45:0/1933258280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5606df100570 0x5606df10de50 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.607+0000 7f19717fa700 0 client.15957 ms_handle_reset on v2:172.21.15.106:6834/4162885659 2024-05-10T03:41:27.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.607+0000 7f19a0224b80 1 -- 172.21.15.45:0/1933258280 >> 172.21.15.45:0/1933258280 conn(0x5606df061a60 msgr2=0x5606df0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:27.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.607+0000 7f19a0224b80 1 -- 172.21.15.45:0/1933258280 shutdown_connections 2024-05-10T03:41:27.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.607+0000 7f19a0224b80 1 -- 172.21.15.45:0/1933258280 wait complete. 2024-05-10T03:41:27.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.607+0000 7f19a0224b80 20 client.15957 trim_cache size 0 max 16384 2024-05-10T03:41:27.619 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-05-10T03:41:27.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.608+0000 7f198fee0700 1 -- 172.21.15.45:0/3743245963 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f19740a11c0 msgr2=0x7f19740a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.608+0000 7f198fee0700 1 --2- 172.21.15.45:0/3743245963 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f19740a11c0 0x7f19740a36d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1988068330 tx=0x7f1984009260 comp rx=0 tx=0).stop 2024-05-10T03:41:27.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.608+0000 7f198fee0700 1 -- 172.21.15.45:0/3743245963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1988101a70 msgr2=0x7f1988103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.608+0000 7f198fee0700 1 --2- 172.21.15.45:0/3743245963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1988101a70 0x7f1988103140 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f19780098e0 tx=0x7f197800f740 comp rx=0 tx=0).stop 2024-05-10T03:41:27.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.608+0000 7f198fee0700 1 -- 172.21.15.45:0/3743245963 shutdown_connections 2024-05-10T03:41:27.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.608+0000 7f198fee0700 1 --2- 172.21.15.45:0/3743245963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19881025d0 0x7f1988103680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.608+0000 7f198fee0700 1 --2- 172.21.15.45:0/3743245963 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f19740a11c0 0x7f19740a36d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.608+0000 7f198fee0700 1 --2- 172.21.15.45:0/3743245963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1988101090 0x7f1988104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.608+0000 7f198fee0700 1 --2- 172.21.15.45:0/3743245963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1988101a70 0x7f1988103140 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.608+0000 7f198fee0700 1 -- 172.21.15.45:0/3743245963 >> 172.21.15.45:0/3743245963 conn(0x7f19880fb8f0 msgr2=0x7f19880fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:27.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.608+0000 7f198fee0700 1 -- 172.21.15.45:0/3743245963 shutdown_connections 2024-05-10T03:41:27.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.608+0000 7f198fee0700 1 -- 172.21.15.45:0/3743245963 wait complete. 2024-05-10T03:41:27.626 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-05-10T03:41:27.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.774+0000 7fb860f34700 1 -- 172.21.15.45:0/1698503529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb85c101be0 msgr2=0x7fb85c101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.774+0000 7fb860f34700 1 --2- 172.21.15.45:0/1698503529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb85c101be0 0x7fb85c101ff0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb844009990 tx=0x7fb844009ca0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.774+0000 7fb860f34700 1 -- 172.21.15.45:0/1698503529 shutdown_connections 2024-05-10T03:41:27.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.774+0000 7fb860f34700 1 --2- 172.21.15.45:0/1698503529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb85c102580 0x7fb85c108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.774+0000 7fb860f34700 1 --2- 172.21.15.45:0/1698503529 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb85c100ac0 0x7fb85c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.774+0000 7fb860f34700 1 --2- 172.21.15.45:0/1698503529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb85c101be0 0x7fb85c101ff0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.774+0000 7fb860f34700 1 -- 172.21.15.45:0/1698503529 >> 172.21.15.45:0/1698503529 conn(0x7fb85c0fc0d0 msgr2=0x7fb85c0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:27.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.774+0000 7fb860f34700 1 -- 172.21.15.45:0/1698503529 shutdown_connections 2024-05-10T03:41:27.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.774+0000 7fb860f34700 1 -- 172.21.15.45:0/1698503529 wait complete. 2024-05-10T03:41:27.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.775+0000 7fb860f34700 1 Processor -- start 2024-05-10T03:41:27.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.775+0000 7fb860f34700 1 -- start start 2024-05-10T03:41:27.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.775+0000 7fb860f34700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb85c100ac0 0x7fb85c197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.775+0000 7fb860f34700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb85c101be0 0x7fb85c198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.775+0000 7fb860f34700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb85c102580 0x7fb85c19f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.775+0000 7fb860f34700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c19faa0 con 0x7fb85c100ac0 2024-05-10T03:41:27.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.775+0000 7fb860f34700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c19fc10 con 0x7fb85c101be0 2024-05-10T03:41:27.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.775+0000 7fb860f34700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c19fdd0 con 0x7fb85c102580 2024-05-10T03:41:27.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.775+0000 7fb85a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb85c100ac0 0x7fb85c197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.776+0000 7fb85a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb85c100ac0 0x7fb85c197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37200/0 (socket says 172.21.15.45:37200) 2024-05-10T03:41:27.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.776+0000 7fb85a59c700 1 -- 172.21.15.45:0/745999350 learned_addr learned my addr 172.21.15.45:0/745999350 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:27.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.776+0000 7fb851d9b700 1 --2- 172.21.15.45:0/745999350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb85c101be0 0x7fb85c198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.776+0000 7fb85ad9d700 1 --2- 172.21.15.45:0/745999350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb85c102580 0x7fb85c19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.776+0000 7fb85a59c700 1 -- 172.21.15.45:0/745999350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb85c102580 msgr2=0x7fb85c19f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.776+0000 7fb85a59c700 1 --2- 172.21.15.45:0/745999350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb85c102580 0x7fb85c19f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.776+0000 7fb85a59c700 1 -- 172.21.15.45:0/745999350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb85c101be0 msgr2=0x7fb85c198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.776+0000 7fb85a59c700 1 --2- 172.21.15.45:0/745999350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb85c101be0 0x7fb85c198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.776+0000 7fb85a59c700 1 -- 172.21.15.45:0/745999350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8440095f0 con 0x7fb85c100ac0 2024-05-10T03:41:27.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.776+0000 7fb85ad9d700 1 --2- 172.21.15.45:0/745999350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb85c102580 0x7fb85c19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:27.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.776+0000 7fb85a59c700 1 --2- 172.21.15.45:0/745999350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb85c100ac0 0x7fb85c197fc0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00e940 tx=0x7fb84c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:27.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.776+0000 7fb853fff700 1 -- 172.21.15.45:0/745999350 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c00cbd0 con 0x7fb85c100ac0 2024-05-10T03:41:27.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.776+0000 7fb853fff700 1 -- 172.21.15.45:0/745999350 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb84c00ee90 con 0x7fb85c100ac0 2024-05-10T03:41:27.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.776+0000 7fb853fff700 1 -- 172.21.15.45:0/745999350 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c003e30 con 0x7fb85c100ac0 2024-05-10T03:41:27.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.776+0000 7fb860f34700 1 -- 172.21.15.45:0/745999350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85c1a00b0 con 0x7fb85c100ac0 2024-05-10T03:41:27.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.776+0000 7fb860f34700 1 -- 172.21.15.45:0/745999350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85c1a0570 con 0x7fb85c100ac0 2024-05-10T03:41:27.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.779+0000 7fb853fff700 1 -- 172.21.15.45:0/745999350 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb84c018430 con 0x7fb85c100ac0 2024-05-10T03:41:27.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.780+0000 7fb853fff700 1 --2- 172.21.15.45:0/745999350 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb8480a11c0 0x7fb8480a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.780+0000 7fb853fff700 1 -- 172.21.15.45:0/745999350 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb84c014070 con 0x7fb85c100ac0 2024-05-10T03:41:27.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.780+0000 7fb851d9b700 1 --2- 172.21.15.45:0/745999350 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb8480a11c0 0x7fb8480a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.781+0000 7fb851d9b700 1 --2- 172.21.15.45:0/745999350 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb8480a11c0 0x7fb8480a36d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb84400b2e0 tx=0x7fb84401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:27.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.781+0000 7fb871278b80 1 Processor -- start 2024-05-10T03:41:27.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.781+0000 7fb871278b80 1 -- start start 2024-05-10T03:41:27.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.781+0000 7fb871278b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a3406a0 0x56342a340af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.781+0000 7fb871278b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56342a341570 0x56342a341980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.781+0000 7fb871278b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56342a341ec0 0x56342a3487c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.781+0000 7fb871278b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56342a267150 con 0x56342a3406a0 2024-05-10T03:41:27.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.781+0000 7fb871278b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x56342a264b10 con 0x56342a341570 2024-05-10T03:41:27.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.781+0000 7fb871278b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x56342a260400 con 0x56342a341ec0 2024-05-10T03:41:27.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.781+0000 7fb85a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a3406a0 0x56342a340af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.781+0000 7fb85a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a3406a0 0x56342a340af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37206/0 (socket says 172.21.15.45:37206) 2024-05-10T03:41:27.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.781+0000 7fb85a59c700 1 -- 172.21.15.45:0/534660422 learned_addr learned my addr 172.21.15.45:0/534660422 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:27.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.781+0000 7fb851d9b700 1 --2- 172.21.15.45:0/534660422 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56342a341570 0x56342a341980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.782+0000 7fb85ad9d700 1 --2- 172.21.15.45:0/534660422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56342a341ec0 0x56342a3487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.782+0000 7fb85a59c700 1 -- 172.21.15.45:0/534660422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56342a341ec0 msgr2=0x56342a3487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:27.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.782+0000 7fb85a59c700 1 --2- 172.21.15.45:0/534660422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56342a341ec0 0x56342a3487c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.782+0000 7fb85a59c700 1 -- 172.21.15.45:0/534660422 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56342a341570 msgr2=0x56342a341980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:27.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.782+0000 7fb85a59c700 1 --2- 172.21.15.45:0/534660422 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56342a341570 0x56342a341980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.782+0000 7fb85a59c700 1 -- 172.21.15.45:0/534660422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56342a0e13b0 con 0x56342a3406a0 2024-05-10T03:41:27.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.782+0000 7fb85ad9d700 1 --2- 172.21.15.45:0/534660422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56342a341ec0 0x56342a3487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:27.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.782+0000 7fb85a59c700 1 --2- 172.21.15.45:0/534660422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a3406a0 0x56342a340af0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb84c0965c0 tx=0x7fb84c095e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cdef01f6d51e6df server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:27.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.782+0000 7fb850d99700 1 -- 172.21.15.45:0/534660422 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c0b1070 con 0x56342a3406a0 2024-05-10T03:41:27.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.782+0000 7fb850d99700 1 -- 172.21.15.45:0/534660422 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb84c09a7c0 con 0x56342a3406a0 2024-05-10T03:41:27.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.782+0000 7fb850d99700 1 -- 172.21.15.45:0/534660422 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c09d070 con 0x56342a3406a0 2024-05-10T03:41:27.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.783+0000 7fb871278b80 1 -- 172.21.15.45:0/534660422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a3406a0 msgr2=0x56342a340af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.783+0000 7fb871278b80 1 --2- 172.21.15.45:0/534660422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a3406a0 0x56342a340af0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb84c0965c0 tx=0x7fb84c095e00 comp rx=0 tx=0).stop 2024-05-10T03:41:27.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.783+0000 7fb871278b80 1 -- 172.21.15.45:0/534660422 shutdown_connections 2024-05-10T03:41:27.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.783+0000 7fb871278b80 1 --2- 172.21.15.45:0/534660422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56342a341ec0 0x56342a3487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.783+0000 7fb871278b80 1 --2- 172.21.15.45:0/534660422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a3406a0 0x56342a340af0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.783+0000 7fb871278b80 1 --2- 172.21.15.45:0/534660422 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56342a341570 0x56342a341980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.783+0000 7fb871278b80 1 -- 172.21.15.45:0/534660422 >> 172.21.15.45:0/534660422 conn(0x56342a2a2a60 msgr2=0x56342a33afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:27.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.783+0000 7fb871278b80 1 -- 172.21.15.45:0/534660422 shutdown_connections 2024-05-10T03:41:27.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.783+0000 7fb871278b80 1 -- 172.21.15.45:0/534660422 wait complete. 2024-05-10T03:41:27.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.784+0000 7fb871278b80 1 -- start start 2024-05-10T03:41:27.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.784+0000 7fb871278b80 1 Processor -- start 2024-05-10T03:41:27.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.784+0000 7fb871278b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56342a3406a0 0x56342a34a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.784+0000 7fb871278b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56342a341570 0x56342a34acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.784+0000 7fb871278b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a341ec0 0x56342a351c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.784+0000 7fb871278b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56342a1fc560 con 0x56342a341ec0 2024-05-10T03:41:27.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.784+0000 7fb871278b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x56342a1fc200 con 0x56342a341570 2024-05-10T03:41:27.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.784+0000 7fb871278b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x56342a0e36a0 con 0x56342a3406a0 2024-05-10T03:41:27.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.784+0000 7fb871278b80 10 client.0 _ll_register_callbacks cb 0x56342a205b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:27.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.784+0000 7fb85ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a341ec0 0x56342a351c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.784+0000 7fb85ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a341ec0 0x56342a351c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37218/0 (socket says 172.21.15.45:37218) 2024-05-10T03:41:27.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.784+0000 7fb85ad9d700 1 -- 172.21.15.45:0/2353991270 learned_addr learned my addr 172.21.15.45:0/2353991270 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:27.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.784+0000 7fb851d9b700 1 --2- 172.21.15.45:0/2353991270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56342a341570 0x56342a34acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.784+0000 7fb85a59c700 1 --2- 172.21.15.45:0/2353991270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56342a3406a0 0x56342a34a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.785+0000 7fb85ad9d700 1 -- 172.21.15.45:0/2353991270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56342a3406a0 msgr2=0x56342a34a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:27.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.785+0000 7fb85ad9d700 1 --2- 172.21.15.45:0/2353991270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56342a3406a0 0x56342a34a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.785+0000 7fb85ad9d700 1 -- 172.21.15.45:0/2353991270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56342a341570 msgr2=0x56342a34acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:27.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.785+0000 7fb85ad9d700 1 --2- 172.21.15.45:0/2353991270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56342a341570 0x56342a34acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.785+0000 7fb85ad9d700 1 -- 172.21.15.45:0/2353991270 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85c1a0570 con 0x56342a341ec0 2024-05-10T03:41:27.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.785+0000 7fb851d9b700 1 --2- 172.21.15.45:0/2353991270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56342a341570 0x56342a34acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:41:27.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.785+0000 7fb85ad9d700 1 --2- 172.21.15.45:0/2353991270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a341ec0 0x56342a351c30 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb854007c20 tx=0x7fb854007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c646d0398f9b41 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:27.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.785+0000 7fb841ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:41:27.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.785+0000 7fb841ffb700 1 -- 172.21.15.45:0/2353991270 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85400e070 con 0x56342a341ec0 2024-05-10T03:41:27.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.785+0000 7fb841ffb700 1 -- 172.21.15.45:0/2353991270 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb854012cb0 con 0x56342a341ec0 2024-05-10T03:41:27.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.785+0000 7fb871278b80 1 -- 172.21.15.45:0/2353991270 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56342a1b9270 con 0x56342a341ec0 2024-05-10T03:41:27.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.785+0000 7fb841ffb700 1 -- 172.21.15.45:0/2353991270 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb854012e70 con 0x56342a341ec0 2024-05-10T03:41:27.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.785+0000 7fb871278b80 10 client.15969 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:27.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.785+0000 7fb871278b80 1 -- 172.21.15.45:0/2353991270 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x56342a08db60 con 0x56342a341ec0 2024-05-10T03:41:27.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.785+0000 7fb841ffb700 1 -- 172.21.15.45:0/2353991270 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x56342a1b9270 con 0x56342a341ec0 2024-05-10T03:41:27.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.786+0000 7fb841ffb700 1 -- 172.21.15.45:0/2353991270 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb854014040 con 0x56342a341ec0 2024-05-10T03:41:27.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.786+0000 7fb871278b80 10 client.15969 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:27.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.786+0000 7fb871278b80 10 client.15969 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-05-10T03:41:27.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.786+0000 7fb871278b80 20 client.15969 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:27.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.786+0000 7fb871278b80 1 --2- 172.21.15.45:0/2353991270 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x56342a3563e0 0x56342a358830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.786+0000 7fb871278b80 4 client.15969 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:41:27.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.786+0000 7fb871278b80 1 -- 172.21.15.45:0/2353991270 --> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56342a30f780 con 0x56342a3563e0 2024-05-10T03:41:27.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.786+0000 7fb85a59c700 1 --2- 172.21.15.45:0/2353991270 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x56342a3563e0 0x56342a358830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.787+0000 7fb85a59c700 1 --2- 172.21.15.45:0/2353991270 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x56342a3563e0 0x56342a358830 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fefface80b66cc69 server_cookie=54bbf62bad4f0a3c in_seq=0 out_seq=0 2024-05-10T03:41:27.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.787+0000 7fb841ffb700 10 client.15969 ms_handle_connect on v2:172.21.15.154:6836/608167481 2024-05-10T03:41:27.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.787+0000 7fb841ffb700 1 -- 172.21.15.45:0/2353991270 <== mds.3 v2:172.21.15.154:6836/608167481 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56342a30f780 con 0x56342a3563e0 2024-05-10T03:41:27.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.787+0000 7fb841ffb700 10 client.15969 handle_command_reply: tid=0 2024-05-10T03:41:27.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.787+0000 7fb871278b80 1 client.15969 shutdown 2024-05-10T03:41:27.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.788+0000 7fb871278b80 1 -- 172.21.15.45:0/2353991270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a341ec0 msgr2=0x56342a351c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.788+0000 7fb871278b80 1 --2- 172.21.15.45:0/2353991270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a341ec0 0x56342a351c30 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb854007c20 tx=0x7fb854007f30 comp rx=0 tx=0).stop 2024-05-10T03:41:27.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.788+0000 7fb871278b80 1 -- 172.21.15.45:0/2353991270 shutdown_connections 2024-05-10T03:41:27.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.788+0000 7fb871278b80 1 --2- 172.21.15.45:0/2353991270 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x56342a3563e0 0x56342a358830 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.788+0000 7fb871278b80 1 --2- 172.21.15.45:0/2353991270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56342a3406a0 0x56342a34a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.788+0000 7fb841ffb700 0 client.15969 ms_handle_reset on v2:172.21.15.154:6836/608167481 2024-05-10T03:41:27.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.788+0000 7fb871278b80 1 --2- 172.21.15.45:0/2353991270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a341ec0 0x56342a351c30 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.788+0000 7fb871278b80 1 --2- 172.21.15.45:0/2353991270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56342a341570 0x56342a34acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.788+0000 7fb871278b80 1 -- 172.21.15.45:0/2353991270 >> 172.21.15.45:0/2353991270 conn(0x56342a2a2a60 msgr2=0x56342a33afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:27.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.788+0000 7fb871278b80 1 -- 172.21.15.45:0/2353991270 shutdown_connections 2024-05-10T03:41:27.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.788+0000 7fb871278b80 1 -- 172.21.15.45:0/2353991270 wait complete. 2024-05-10T03:41:27.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.788+0000 7fb871278b80 20 client.15969 trim_cache size 0 max 16384 2024-05-10T03:41:27.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.802+0000 7fb871278b80 1 Processor -- start 2024-05-10T03:41:27.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.802+0000 7fb871278b80 1 -- start start 2024-05-10T03:41:27.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.802+0000 7fb871278b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56342a3406a0 0x56342a341980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.802+0000 7fb871278b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56342a341570 0x56342a351bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.802+0000 7fb871278b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a341ec0 0x56342a352210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.802+0000 7fb871278b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56342a3413c0 con 0x56342a341ec0 2024-05-10T03:41:27.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.802+0000 7fb871278b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x56342a3560e0 con 0x56342a341570 2024-05-10T03:41:27.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.802+0000 7fb871278b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x56342a33be00 con 0x56342a3406a0 2024-05-10T03:41:27.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.802+0000 7fb85ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a341ec0 0x56342a352210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.802+0000 7fb85ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a341ec0 0x56342a352210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37230/0 (socket says 172.21.15.45:37230) 2024-05-10T03:41:27.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.802+0000 7fb85ad9d700 1 -- 172.21.15.45:0/3604692237 learned_addr learned my addr 172.21.15.45:0/3604692237 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:27.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.802+0000 7fb85a59c700 1 --2- 172.21.15.45:0/3604692237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56342a3406a0 0x56342a341980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.802+0000 7fb851d9b700 1 --2- 172.21.15.45:0/3604692237 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56342a341570 0x56342a351bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.802+0000 7fb85ad9d700 1 -- 172.21.15.45:0/3604692237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56342a3406a0 msgr2=0x56342a341980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:27.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.802+0000 7fb85ad9d700 1 --2- 172.21.15.45:0/3604692237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56342a3406a0 0x56342a341980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.802+0000 7fb85ad9d700 1 -- 172.21.15.45:0/3604692237 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56342a341570 msgr2=0x56342a351bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:27.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.802+0000 7fb85ad9d700 1 --2- 172.21.15.45:0/3604692237 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56342a341570 0x56342a351bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.802+0000 7fb85ad9d700 1 -- 172.21.15.45:0/3604692237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56342a226560 con 0x56342a341ec0 2024-05-10T03:41:27.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.802+0000 7fb851d9b700 1 --2- 172.21.15.45:0/3604692237 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56342a341570 0x56342a351bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:41:27.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.803+0000 7fb85ad9d700 1 --2- 172.21.15.45:0/3604692237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a341ec0 0x56342a352210 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb8540157e0 tx=0x7fb85400af80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779be6e8da3bbd49 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:27.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.803+0000 7fb85159a700 1 -- 172.21.15.45:0/3604692237 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85400e040 con 0x56342a341ec0 2024-05-10T03:41:27.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.803+0000 7fb85159a700 1 -- 172.21.15.45:0/3604692237 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb85400f040 con 0x56342a341ec0 2024-05-10T03:41:27.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.803+0000 7fb85159a700 1 -- 172.21.15.45:0/3604692237 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854012e30 con 0x56342a341ec0 2024-05-10T03:41:27.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.804+0000 7fb871278b80 1 -- 172.21.15.45:0/3604692237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a341ec0 msgr2=0x56342a352210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.804+0000 7fb871278b80 1 --2- 172.21.15.45:0/3604692237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a341ec0 0x56342a352210 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb8540157e0 tx=0x7fb85400af80 comp rx=0 tx=0).stop 2024-05-10T03:41:27.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.804+0000 7fb871278b80 1 -- 172.21.15.45:0/3604692237 shutdown_connections 2024-05-10T03:41:27.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.804+0000 7fb871278b80 1 --2- 172.21.15.45:0/3604692237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56342a3406a0 0x56342a341980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.804+0000 7fb871278b80 1 --2- 172.21.15.45:0/3604692237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a341ec0 0x56342a352210 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.804+0000 7fb871278b80 1 --2- 172.21.15.45:0/3604692237 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56342a341570 0x56342a351bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.804+0000 7fb871278b80 1 -- 172.21.15.45:0/3604692237 >> 172.21.15.45:0/3604692237 conn(0x56342a2a2a60 msgr2=0x56342a35d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:27.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.804+0000 7fb871278b80 1 -- 172.21.15.45:0/3604692237 shutdown_connections 2024-05-10T03:41:27.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.804+0000 7fb871278b80 1 -- 172.21.15.45:0/3604692237 wait complete. 2024-05-10T03:41:27.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.804+0000 7fb871278b80 1 -- start start 2024-05-10T03:41:27.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.804+0000 7fb871278b80 1 Processor -- start 2024-05-10T03:41:27.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.805+0000 7fb871278b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56342a3406a0 0x56342a34ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.805+0000 7fb871278b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a341570 0x56342a34f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.805+0000 7fb871278b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56342a341ec0 0x56342a350190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.805+0000 7fb871278b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56342a3506d0 con 0x56342a341570 2024-05-10T03:41:27.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.805+0000 7fb871278b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x56342a350840 con 0x56342a341ec0 2024-05-10T03:41:27.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.805+0000 7fb871278b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x56342a350a00 con 0x56342a3406a0 2024-05-10T03:41:27.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.805+0000 7fb871278b80 10 client.0 _ll_register_callbacks cb 0x56342a205b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:27.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.805+0000 7fb851d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a341570 0x56342a34f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.805+0000 7fb851d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a341570 0x56342a34f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37242/0 (socket says 172.21.15.45:37242) 2024-05-10T03:41:27.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.805+0000 7fb851d9b700 1 -- 172.21.15.45:0/1757157543 learned_addr learned my addr 172.21.15.45:0/1757157543 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:27.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.805+0000 7fb85a59c700 1 --2- 172.21.15.45:0/1757157543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56342a3406a0 0x56342a34ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.805+0000 7fb85ad9d700 1 --2- 172.21.15.45:0/1757157543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56342a341ec0 0x56342a350190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.805+0000 7fb851d9b700 1 -- 172.21.15.45:0/1757157543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56342a3406a0 msgr2=0x56342a34ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.805+0000 7fb851d9b700 1 --2- 172.21.15.45:0/1757157543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56342a3406a0 0x56342a34ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.805+0000 7fb851d9b700 1 -- 172.21.15.45:0/1757157543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56342a341ec0 msgr2=0x56342a350190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.805+0000 7fb851d9b700 1 --2- 172.21.15.45:0/1757157543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56342a341ec0 0x56342a350190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.805+0000 7fb851d9b700 1 -- 172.21.15.45:0/1757157543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56342a08db60 con 0x56342a341570 2024-05-10T03:41:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.805+0000 7fb85ad9d700 1 --2- 172.21.15.45:0/1757157543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56342a341ec0 0x56342a350190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.805+0000 7fb85a59c700 1 --2- 172.21.15.45:0/1757157543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56342a3406a0 0x56342a34ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:41:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.805+0000 7fb851d9b700 1 --2- 172.21.15.45:0/1757157543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a341570 0x56342a34f260 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb8440098e0 tx=0x7fb844009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b5bd67a6760485 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.805+0000 7fb841ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:41:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.806+0000 7fb841ffb700 1 -- 172.21.15.45:0/1757157543 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844037070 con 0x56342a341570 2024-05-10T03:41:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.806+0000 7fb841ffb700 1 -- 172.21.15.45:0/1757157543 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb844004830 con 0x56342a341570 2024-05-10T03:41:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.806+0000 7fb871278b80 1 -- 172.21.15.45:0/1757157543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb84c09a7c0 con 0x56342a341570 2024-05-10T03:41:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.806+0000 7fb841ffb700 1 -- 172.21.15.45:0/1757157543 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb84402d040 con 0x56342a341570 2024-05-10T03:41:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.806+0000 7fb871278b80 10 client.15975 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.806+0000 7fb871278b80 1 -- 172.21.15.45:0/1757157543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x56342a0e5cd0 con 0x56342a341570 2024-05-10T03:41:27.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.806+0000 7fb841ffb700 1 -- 172.21.15.45:0/1757157543 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb84c09a7c0 con 0x56342a341570 2024-05-10T03:41:27.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.806+0000 7fb841ffb700 1 -- 172.21.15.45:0/1757157543 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb84403a020 con 0x56342a341570 2024-05-10T03:41:27.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.806+0000 7fb871278b80 10 client.15975 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:27.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.806+0000 7fb871278b80 10 client.15975 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-05-10T03:41:27.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.806+0000 7fb871278b80 20 client.15975 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:27.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.806+0000 7fb871278b80 1 --2- 172.21.15.45:0/1757157543 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x56342a3acb10 0x56342a3aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.806+0000 7fb871278b80 4 client.15975 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-10T03:41:27.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.806+0000 7fb871278b80 1 -- 172.21.15.45:0/1757157543 --> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56342a258ec0 con 0x56342a3acb10 2024-05-10T03:41:27.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.807+0000 7fb85a59c700 1 --2- 172.21.15.45:0/1757157543 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x56342a3acb10 0x56342a3aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.807+0000 7fb841ffb700 10 client.15975 ms_handle_connect on v2:172.21.15.154:6836/608167481 2024-05-10T03:41:27.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.807+0000 7fb85a59c700 1 --2- 172.21.15.45:0/1757157543 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x56342a3acb10 0x56342a3aef30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=be6b5b94fae88895 server_cookie=57a324c450fa8ecb in_seq=0 out_seq=0 2024-05-10T03:41:27.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.807+0000 7fb841ffb700 1 -- 172.21.15.45:0/1757157543 <== mds.3 v2:172.21.15.154:6836/608167481 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56342a258ec0 con 0x56342a3acb10 2024-05-10T03:41:27.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.807+0000 7fb841ffb700 10 client.15975 handle_command_reply: tid=0 2024-05-10T03:41:27.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.807+0000 7fb871278b80 1 client.15975 shutdown 2024-05-10T03:41:27.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.807+0000 7fb871278b80 1 -- 172.21.15.45:0/1757157543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a341570 msgr2=0x56342a34f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.807+0000 7fb871278b80 1 --2- 172.21.15.45:0/1757157543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a341570 0x56342a34f260 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb8440098e0 tx=0x7fb844009310 comp rx=0 tx=0).stop 2024-05-10T03:41:27.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.807+0000 7fb871278b80 1 -- 172.21.15.45:0/1757157543 shutdown_connections 2024-05-10T03:41:27.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.807+0000 7fb871278b80 1 --2- 172.21.15.45:0/1757157543 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x56342a3acb10 0x56342a3aef30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.807+0000 7fb871278b80 1 --2- 172.21.15.45:0/1757157543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56342a3406a0 0x56342a34ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.807+0000 7fb871278b80 1 --2- 172.21.15.45:0/1757157543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56342a341ec0 0x56342a350190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.807+0000 7fb841ffb700 0 client.15975 ms_handle_reset on v2:172.21.15.154:6836/608167481 2024-05-10T03:41:27.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.807+0000 7fb871278b80 1 --2- 172.21.15.45:0/1757157543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56342a341570 0x56342a34f260 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.807+0000 7fb871278b80 1 -- 172.21.15.45:0/1757157543 >> 172.21.15.45:0/1757157543 conn(0x56342a2a2a60 msgr2=0x56342a35d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:27.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.807+0000 7fb871278b80 1 -- 172.21.15.45:0/1757157543 shutdown_connections 2024-05-10T03:41:27.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.808+0000 7fb871278b80 1 -- 172.21.15.45:0/1757157543 wait complete. 2024-05-10T03:41:27.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.808+0000 7fb871278b80 20 client.15975 trim_cache size 0 max 16384 2024-05-10T03:41:27.817 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-05-10T03:41:27.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.808+0000 7fb860f34700 1 -- 172.21.15.45:0/745999350 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb8480a11c0 msgr2=0x7fb8480a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.808+0000 7fb860f34700 1 --2- 172.21.15.45:0/745999350 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb8480a11c0 0x7fb8480a36d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb84400b2e0 tx=0x7fb84401a040 comp rx=0 tx=0).stop 2024-05-10T03:41:27.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.808+0000 7fb860f34700 1 -- 172.21.15.45:0/745999350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb85c100ac0 msgr2=0x7fb85c197fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.808+0000 7fb860f34700 1 --2- 172.21.15.45:0/745999350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb85c100ac0 0x7fb85c197fc0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00e940 tx=0x7fb84c00ec50 comp rx=0 tx=0).stop 2024-05-10T03:41:27.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.808+0000 7fb860f34700 1 -- 172.21.15.45:0/745999350 shutdown_connections 2024-05-10T03:41:27.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.808+0000 7fb860f34700 1 --2- 172.21.15.45:0/745999350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb85c102580 0x7fb85c19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.808+0000 7fb860f34700 1 --2- 172.21.15.45:0/745999350 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb8480a11c0 0x7fb8480a36d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.808+0000 7fb860f34700 1 --2- 172.21.15.45:0/745999350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb85c100ac0 0x7fb85c197fc0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.808+0000 7fb860f34700 1 --2- 172.21.15.45:0/745999350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb85c101be0 0x7fb85c198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.808+0000 7fb860f34700 1 -- 172.21.15.45:0/745999350 >> 172.21.15.45:0/745999350 conn(0x7fb85c0fc0d0 msgr2=0x7fb85c0fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:27.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.808+0000 7fb860f34700 1 -- 172.21.15.45:0/745999350 shutdown_connections 2024-05-10T03:41:27.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.808+0000 7fb860f34700 1 -- 172.21.15.45:0/745999350 wait complete. 2024-05-10T03:41:27.826 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-10T03:41:27.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.974+0000 7f72c6d83700 1 -- 172.21.15.45:0/295525928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72c0100ac0 msgr2=0x7f72c0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.974+0000 7f72c6d83700 1 --2- 172.21.15.45:0/295525928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72c0100ac0 0x7f72c0100ed0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f72bc009920 tx=0x7f72bc009c30 comp rx=0 tx=0).stop 2024-05-10T03:41:27.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.974+0000 7f72c6d83700 1 -- 172.21.15.45:0/295525928 shutdown_connections 2024-05-10T03:41:27.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.974+0000 7f72c6d83700 1 --2- 172.21.15.45:0/295525928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72c0100ac0 0x7f72c0100ed0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.974+0000 7f72c6d83700 1 --2- 172.21.15.45:0/295525928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c0102580 0x7f72c0108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.974+0000 7f72c6d83700 1 --2- 172.21.15.45:0/295525928 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72c0101be0 0x7f72c0101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.974+0000 7f72c6d83700 1 -- 172.21.15.45:0/295525928 >> 172.21.15.45:0/295525928 conn(0x7f72c00fc0d0 msgr2=0x7f72c00fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:27.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.974+0000 7f72c6d83700 1 -- 172.21.15.45:0/295525928 shutdown_connections 2024-05-10T03:41:27.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.974+0000 7f72c6d83700 1 -- 172.21.15.45:0/295525928 wait complete. 2024-05-10T03:41:27.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.974+0000 7f72c6d83700 1 Processor -- start 2024-05-10T03:41:27.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.974+0000 7f72c6d83700 1 -- start start 2024-05-10T03:41:27.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.975+0000 7f72c6d83700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72c0100ac0 0x7f72c0198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.975+0000 7f72c6d83700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c0101be0 0x7f72c01985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.975+0000 7f72c6d83700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72c0102580 0x7f72c019f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.975+0000 7f72c6d83700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c019fb50 con 0x7f72c0101be0 2024-05-10T03:41:27.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.975+0000 7f72c6d83700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c019fcc0 con 0x7f72c0102580 2024-05-10T03:41:27.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.975+0000 7f72c6d83700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c019fe80 con 0x7f72c0100ac0 2024-05-10T03:41:27.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.975+0000 7f72b7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c0101be0 0x7f72c01985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.975+0000 7f72b7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c0101be0 0x7f72c01985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37260/0 (socket says 172.21.15.45:37260) 2024-05-10T03:41:27.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.975+0000 7f72b7fff700 1 -- 172.21.15.45:0/473642563 learned_addr learned my addr 172.21.15.45:0/473642563 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:27.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.975+0000 7f72c5320700 1 --2- 172.21.15.45:0/473642563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72c0102580 0x7f72c019f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.975+0000 7f72c4b1f700 1 --2- 172.21.15.45:0/473642563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72c0100ac0 0x7f72c0198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.975+0000 7f72b7fff700 1 -- 172.21.15.45:0/473642563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72c0100ac0 msgr2=0x7f72c0198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.975+0000 7f72b7fff700 1 --2- 172.21.15.45:0/473642563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72c0100ac0 0x7f72c0198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.975+0000 7f72b7fff700 1 -- 172.21.15.45:0/473642563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72c0102580 msgr2=0x7f72c019f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.975+0000 7f72b7fff700 1 --2- 172.21.15.45:0/473642563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72c0102580 0x7f72c019f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.975+0000 7f72b7fff700 1 -- 172.21.15.45:0/473642563 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72bc009520 con 0x7f72c0101be0 2024-05-10T03:41:27.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.975+0000 7f72b7fff700 1 --2- 172.21.15.45:0/473642563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c0101be0 0x7f72c01985b0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f72b000e9c0 tx=0x7f72b000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:27.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.976+0000 7f72b5ffb700 1 -- 172.21.15.45:0/473642563 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b000cbd0 con 0x7f72c0101be0 2024-05-10T03:41:27.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.976+0000 7f72c6d83700 1 -- 172.21.15.45:0/473642563 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c01a0160 con 0x7f72c0101be0 2024-05-10T03:41:27.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.976+0000 7f72b5ffb700 1 -- 172.21.15.45:0/473642563 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f72b000eeb0 con 0x7f72c0101be0 2024-05-10T03:41:27.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.976+0000 7f72b5ffb700 1 -- 172.21.15.45:0/473642563 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0005680 con 0x7f72c0101be0 2024-05-10T03:41:27.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.976+0000 7f72c6d83700 1 -- 172.21.15.45:0/473642563 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c01a06c0 con 0x7f72c0101be0 2024-05-10T03:41:27.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.978+0000 7f72b5ffb700 1 -- 172.21.15.45:0/473642563 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f72b0004750 con 0x7f72c0101be0 2024-05-10T03:41:27.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.979+0000 7f72b5ffb700 1 --2- 172.21.15.45:0/473642563 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f72a80a11c0 0x7f72a80a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.979+0000 7f72b5ffb700 1 -- 172.21.15.45:0/473642563 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f72b0014070 con 0x7f72c0101be0 2024-05-10T03:41:27.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.979+0000 7f72c4b1f700 1 --2- 172.21.15.45:0/473642563 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f72a80a11c0 0x7f72a80a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.979+0000 7f72c4b1f700 1 --2- 172.21.15.45:0/473642563 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f72a80a11c0 0x7f72a80a36d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f72bc009810 tx=0x7f72bc019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:27.985 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.980+0000 7f72d70c7b80 1 Processor -- start 2024-05-10T03:41:27.985 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.980+0000 7f72d70c7b80 1 -- start start 2024-05-10T03:41:27.985 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.980+0000 7f72d70c7b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcdbdc8ab0 0x55dcdbdc8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.985 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.980+0000 7f72d70c7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc9980 0x55dcdbdc9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.985 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.980+0000 7f72d70c7b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dcdbdca2d0 0x55dcdbdd0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.985 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.980+0000 7f72d70c7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcdbceb150 con 0x55dcdbdc9980 2024-05-10T03:41:27.985 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.980+0000 7f72d70c7b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcdbce8b10 con 0x55dcdbdca2d0 2024-05-10T03:41:27.985 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.980+0000 7f72d70c7b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcdbce4400 con 0x55dcdbdc8ab0 2024-05-10T03:41:27.985 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.980+0000 7f72b7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc9980 0x55dcdbdc9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.985 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.980+0000 7f72b7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc9980 0x55dcdbdc9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37272/0 (socket says 172.21.15.45:37272) 2024-05-10T03:41:27.985 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.980+0000 7f72b7fff700 1 -- 172.21.15.45:0/1152392084 learned_addr learned my addr 172.21.15.45:0/1152392084 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:27.985 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.980+0000 7f72c4b1f700 1 --2- 172.21.15.45:0/1152392084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcdbdc8ab0 0x55dcdbdc8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.985 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.980+0000 7f72c5320700 1 --2- 172.21.15.45:0/1152392084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dcdbdca2d0 0x55dcdbdd0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.981+0000 7f72b7fff700 1 -- 172.21.15.45:0/1152392084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcdbdc8ab0 msgr2=0x55dcdbdc8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:27.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.981+0000 7f72b7fff700 1 --2- 172.21.15.45:0/1152392084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcdbdc8ab0 0x55dcdbdc8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.981+0000 7f72b7fff700 1 -- 172.21.15.45:0/1152392084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dcdbdca2d0 msgr2=0x55dcdbdd0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:27.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.981+0000 7f72b7fff700 1 --2- 172.21.15.45:0/1152392084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dcdbdca2d0 0x55dcdbdd0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.981+0000 7f72b7fff700 1 -- 172.21.15.45:0/1152392084 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcdbb653b0 con 0x55dcdbdc9980 2024-05-10T03:41:27.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.981+0000 7f72b7fff700 1 --2- 172.21.15.45:0/1152392084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc9980 0x55dcdbdc9d90 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f72b00a1fa0 tx=0x7f72b0009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cbc875167c1557 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:27.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.981+0000 7f72a6ffd700 1 -- 172.21.15.45:0/1152392084 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b009de80 con 0x55dcdbdc9980 2024-05-10T03:41:27.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.981+0000 7f72a6ffd700 1 -- 172.21.15.45:0/1152392084 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f72b00a24d0 con 0x55dcdbdc9980 2024-05-10T03:41:27.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.981+0000 7f72a6ffd700 1 -- 172.21.15.45:0/1152392084 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0099540 con 0x55dcdbdc9980 2024-05-10T03:41:27.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.982+0000 7f72d70c7b80 1 -- 172.21.15.45:0/1152392084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc9980 msgr2=0x55dcdbdc9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.982+0000 7f72d70c7b80 1 --2- 172.21.15.45:0/1152392084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc9980 0x55dcdbdc9d90 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f72b00a1fa0 tx=0x7f72b0009550 comp rx=0 tx=0).stop 2024-05-10T03:41:27.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.982+0000 7f72d70c7b80 1 -- 172.21.15.45:0/1152392084 shutdown_connections 2024-05-10T03:41:27.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.982+0000 7f72d70c7b80 1 --2- 172.21.15.45:0/1152392084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcdbdc8ab0 0x55dcdbdc8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.982+0000 7f72d70c7b80 1 --2- 172.21.15.45:0/1152392084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dcdbdca2d0 0x55dcdbdd0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.982+0000 7f72d70c7b80 1 --2- 172.21.15.45:0/1152392084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc9980 0x55dcdbdc9d90 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.982+0000 7f72d70c7b80 1 -- 172.21.15.45:0/1152392084 >> 172.21.15.45:0/1152392084 conn(0x55dcdbd26a60 msgr2=0x55dcdbdbefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:27.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.982+0000 7f72d70c7b80 1 -- 172.21.15.45:0/1152392084 shutdown_connections 2024-05-10T03:41:27.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.982+0000 7f72d70c7b80 1 -- 172.21.15.45:0/1152392084 wait complete. 2024-05-10T03:41:27.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.982+0000 7f72d70c7b80 1 -- start start 2024-05-10T03:41:27.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.983+0000 7f72d70c7b80 1 Processor -- start 2024-05-10T03:41:27.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.983+0000 7f72d70c7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc8ab0 0x55dcdbdd2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.983+0000 7f72d70c7b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dcdbdc9980 0x55dcdbdd2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.983+0000 7f72d70c7b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcdbdca2d0 0x55dcdbdd9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.983+0000 7f72d70c7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcdbc80560 con 0x55dcdbdc8ab0 2024-05-10T03:41:27.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.983+0000 7f72d70c7b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcdbc80200 con 0x55dcdbdc9980 2024-05-10T03:41:27.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.983+0000 7f72d70c7b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcdbb676a0 con 0x55dcdbdca2d0 2024-05-10T03:41:27.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.983+0000 7f72d70c7b80 10 client.0 _ll_register_callbacks cb 0x55dcdbc89b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:27.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.983+0000 7f72c4b1f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc8ab0 0x55dcdbdd2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.983+0000 7f72c4b1f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc8ab0 0x55dcdbdd2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37286/0 (socket says 172.21.15.45:37286) 2024-05-10T03:41:27.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.983+0000 7f72c4b1f700 1 -- 172.21.15.45:0/2989713559 learned_addr learned my addr 172.21.15.45:0/2989713559 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:27.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.983+0000 7f72c5320700 1 --2- 172.21.15.45:0/2989713559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcdbdca2d0 0x55dcdbdd9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.983+0000 7f72b7fff700 1 --2- 172.21.15.45:0/2989713559 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dcdbdc9980 0x55dcdbdd2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.984+0000 7f72c4b1f700 1 -- 172.21.15.45:0/2989713559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcdbdca2d0 msgr2=0x55dcdbdd9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:27.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.984+0000 7f72c4b1f700 1 --2- 172.21.15.45:0/2989713559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcdbdca2d0 0x55dcdbdd9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.984+0000 7f72c4b1f700 1 -- 172.21.15.45:0/2989713559 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dcdbdc9980 msgr2=0x55dcdbdd2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:27.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.984+0000 7f72c4b1f700 1 --2- 172.21.15.45:0/2989713559 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dcdbdc9980 0x55dcdbdd2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.984+0000 7f72c4b1f700 1 -- 172.21.15.45:0/2989713559 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c01a06c0 con 0x55dcdbdc8ab0 2024-05-10T03:41:27.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.984+0000 7f72c5320700 1 --2- 172.21.15.45:0/2989713559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcdbdca2d0 0x55dcdbdd9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:27.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.984+0000 7f72c4b1f700 1 --2- 172.21.15.45:0/2989713559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc8ab0 0x55dcdbdd2a70 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f72bc016000 tx=0x7f72bc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e22ee1076176c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:27.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.984+0000 7f729ffff700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:41:27.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.984+0000 7f729ffff700 1 -- 172.21.15.45:0/2989713559 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc01c040 con 0x55dcdbdc8ab0 2024-05-10T03:41:27.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.984+0000 7f729ffff700 1 -- 172.21.15.45:0/2989713559 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f72bc00ba30 con 0x55dcdbdc8ab0 2024-05-10T03:41:27.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.984+0000 7f72d70c7b80 1 -- 172.21.15.45:0/2989713559 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dcdbc3d270 con 0x55dcdbdc8ab0 2024-05-10T03:41:27.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.984+0000 7f729ffff700 1 -- 172.21.15.45:0/2989713559 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72bc00bbf0 con 0x55dcdbdc8ab0 2024-05-10T03:41:27.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.984+0000 7f72d70c7b80 10 client.15987 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:27.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.984+0000 7f72d70c7b80 1 -- 172.21.15.45:0/2989713559 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55dcdbb11b60 con 0x55dcdbdc8ab0 2024-05-10T03:41:27.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.985+0000 7f729ffff700 1 -- 172.21.15.45:0/2989713559 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55dcdbc3d270 con 0x55dcdbdc8ab0 2024-05-10T03:41:27.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.985+0000 7f729ffff700 1 -- 172.21.15.45:0/2989713559 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f72bc02e9d0 con 0x55dcdbdc8ab0 2024-05-10T03:41:27.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.985+0000 7f72d70c7b80 10 client.15987 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:27.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.985+0000 7f72d70c7b80 10 client.15987 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-10T03:41:27.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.985+0000 7f72d70c7b80 20 client.15987 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:27.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.985+0000 7f72d70c7b80 1 --2- 172.21.15.45:0/2989713559 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x55dcdbdde740 0x55dcdbde0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:27.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.985+0000 7f72d70c7b80 4 client.15987 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:41:27.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.985+0000 7f72d70c7b80 1 -- 172.21.15.45:0/2989713559 --> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dcdbd93780 con 0x55dcdbdde740 2024-05-10T03:41:27.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.985+0000 7f72b7fff700 1 --2- 172.21.15.45:0/2989713559 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x55dcdbdde740 0x55dcdbde0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:27.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.986+0000 7f729ffff700 10 client.15987 ms_handle_connect on v2:172.21.15.154:6838/1506563336 2024-05-10T03:41:27.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.986+0000 7f72b7fff700 1 --2- 172.21.15.45:0/2989713559 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x55dcdbdde740 0x55dcdbde0b90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=adc2a2a8d3823f47 server_cookie=6baac7c20397bac3 in_seq=0 out_seq=0 2024-05-10T03:41:27.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.986+0000 7f729ffff700 1 -- 172.21.15.45:0/2989713559 <== mds.2 v2:172.21.15.154:6838/1506563336 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55dcdbd93780 con 0x55dcdbdde740 2024-05-10T03:41:27.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.986+0000 7f729ffff700 10 client.15987 handle_command_reply: tid=0 2024-05-10T03:41:27.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.986+0000 7f72d70c7b80 1 client.15987 shutdown 2024-05-10T03:41:27.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.986+0000 7f72d70c7b80 1 -- 172.21.15.45:0/2989713559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc8ab0 msgr2=0x55dcdbdd2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:27.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.986+0000 7f72d70c7b80 1 --2- 172.21.15.45:0/2989713559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc8ab0 0x55dcdbdd2a70 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f72bc016000 tx=0x7f72bc009260 comp rx=0 tx=0).stop 2024-05-10T03:41:27.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.986+0000 7f72d70c7b80 1 -- 172.21.15.45:0/2989713559 shutdown_connections 2024-05-10T03:41:27.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.987+0000 7f72d70c7b80 1 --2- 172.21.15.45:0/2989713559 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x55dcdbdde740 0x55dcdbde0b90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.987+0000 7f72d70c7b80 1 --2- 172.21.15.45:0/2989713559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcdbdca2d0 0x55dcdbdd9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.987+0000 7f72d70c7b80 1 --2- 172.21.15.45:0/2989713559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc8ab0 0x55dcdbdd2a70 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.987+0000 7f72d70c7b80 1 --2- 172.21.15.45:0/2989713559 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dcdbdc9980 0x55dcdbdd2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:27.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.987+0000 7f72d70c7b80 1 -- 172.21.15.45:0/2989713559 >> 172.21.15.45:0/2989713559 conn(0x55dcdbd26a60 msgr2=0x55dcdbdbefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:27.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.987+0000 7f729ffff700 0 client.15987 ms_handle_reset on v2:172.21.15.154:6838/1506563336 2024-05-10T03:41:27.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.987+0000 7f72d70c7b80 1 -- 172.21.15.45:0/2989713559 shutdown_connections 2024-05-10T03:41:27.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.987+0000 7f72d70c7b80 1 -- 172.21.15.45:0/2989713559 wait complete. 2024-05-10T03:41:27.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:27.987+0000 7f72d70c7b80 20 client.15987 trim_cache size 0 max 16384 2024-05-10T03:41:28.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.001+0000 7f72d70c7b80 1 Processor -- start 2024-05-10T03:41:28.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.001+0000 7f72d70c7b80 1 -- start start 2024-05-10T03:41:28.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.001+0000 7f72d70c7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc8ab0 0x55dcdbde0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.001+0000 7f72d70c7b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcdbdc9980 0x55dcdbdd9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.001+0000 7f72d70c7b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dcdbdca2d0 0x55dcdbde0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.001+0000 7f72d70c7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcdbdcd230 con 0x55dcdbdc8ab0 2024-05-10T03:41:28.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.001+0000 7f72d70c7b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcdbde5d50 con 0x55dcdbdca2d0 2024-05-10T03:41:28.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.001+0000 7f72d70c7b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcdbdbfad0 con 0x55dcdbdc9980 2024-05-10T03:41:28.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.001+0000 7f72c4b1f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc8ab0 0x55dcdbde0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.001+0000 7f72c4b1f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc8ab0 0x55dcdbde0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37298/0 (socket says 172.21.15.45:37298) 2024-05-10T03:41:28.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.001+0000 7f72c4b1f700 1 -- 172.21.15.45:0/1567270562 learned_addr learned my addr 172.21.15.45:0/1567270562 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:28.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.001+0000 7f72b7fff700 1 --2- 172.21.15.45:0/1567270562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcdbdc9980 0x55dcdbdd9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.001+0000 7f72c4b1f700 1 -- 172.21.15.45:0/1567270562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcdbdc9980 msgr2=0x55dcdbdd9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:28.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.001+0000 7f72c4b1f700 1 --2- 172.21.15.45:0/1567270562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcdbdc9980 0x55dcdbdd9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.001+0000 7f72c4b1f700 1 -- 172.21.15.45:0/1567270562 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dcdbdca2d0 msgr2=0x55dcdbde0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:28.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.001+0000 7f72c5320700 1 --2- 172.21.15.45:0/1567270562 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dcdbdca2d0 0x55dcdbde0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.002+0000 7f72c4b1f700 1 --2- 172.21.15.45:0/1567270562 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dcdbdca2d0 0x55dcdbde0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.002+0000 7f72c4b1f700 1 -- 172.21.15.45:0/1567270562 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcdbcaa560 con 0x55dcdbdc8ab0 2024-05-10T03:41:28.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.002+0000 7f72c5320700 1 --2- 172.21.15.45:0/1567270562 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dcdbdca2d0 0x55dcdbde0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:41:28.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.002+0000 7f72c4b1f700 1 --2- 172.21.15.45:0/1567270562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc8ab0 0x55dcdbde0750 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f72bc02ed30 tx=0x7f72bc022470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b5367af545074d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:28.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.002+0000 7f72a77fe700 1 -- 172.21.15.45:0/1567270562 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc01c040 con 0x55dcdbdc8ab0 2024-05-10T03:41:28.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.002+0000 7f72a77fe700 1 -- 172.21.15.45:0/1567270562 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f72bc028040 con 0x55dcdbdc8ab0 2024-05-10T03:41:28.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.002+0000 7f72a77fe700 1 -- 172.21.15.45:0/1567270562 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc004b90 con 0x55dcdbdc8ab0 2024-05-10T03:41:28.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.003+0000 7f72d70c7b80 1 -- 172.21.15.45:0/1567270562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc8ab0 msgr2=0x55dcdbde0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:28.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.003+0000 7f72d70c7b80 1 --2- 172.21.15.45:0/1567270562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc8ab0 0x55dcdbde0750 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f72bc02ed30 tx=0x7f72bc022470 comp rx=0 tx=0).stop 2024-05-10T03:41:28.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.003+0000 7f72d70c7b80 1 -- 172.21.15.45:0/1567270562 shutdown_connections 2024-05-10T03:41:28.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.003+0000 7f72d70c7b80 1 --2- 172.21.15.45:0/1567270562 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dcdbdca2d0 0x55dcdbde0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.003+0000 7f72d70c7b80 1 --2- 172.21.15.45:0/1567270562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc8ab0 0x55dcdbde0750 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.003+0000 7f72d70c7b80 1 --2- 172.21.15.45:0/1567270562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcdbdc9980 0x55dcdbdd9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.003+0000 7f72d70c7b80 1 -- 172.21.15.45:0/1567270562 >> 172.21.15.45:0/1567270562 conn(0x55dcdbd26a60 msgr2=0x55dcdbdbeed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:28.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.003+0000 7f72d70c7b80 1 -- 172.21.15.45:0/1567270562 shutdown_connections 2024-05-10T03:41:28.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.003+0000 7f72d70c7b80 1 -- 172.21.15.45:0/1567270562 wait complete. 2024-05-10T03:41:28.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.003+0000 7f72d70c7b80 1 -- start start 2024-05-10T03:41:28.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.003+0000 7f72d70c7b80 1 Processor -- start 2024-05-10T03:41:28.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.004+0000 7f72d70c7b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcdbdc8ab0 0x55dcdbdd74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.004+0000 7f72d70c7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc9980 0x55dcdbdd79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.004+0000 7f72d70c7b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dcdbdca2d0 0x55dcdbdd8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.004+0000 7f72d70c7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcdbdd8e50 con 0x55dcdbdc9980 2024-05-10T03:41:28.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.004+0000 7f72d70c7b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcdbdd8fc0 con 0x55dcdbdca2d0 2024-05-10T03:41:28.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.004+0000 7f72d70c7b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcdbdd9180 con 0x55dcdbdc8ab0 2024-05-10T03:41:28.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.004+0000 7f72d70c7b80 10 client.0 _ll_register_callbacks cb 0x55dcdbc89b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:28.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.004+0000 7f72b7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc9980 0x55dcdbdd79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.004+0000 7f72b7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc9980 0x55dcdbdd79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37310/0 (socket says 172.21.15.45:37310) 2024-05-10T03:41:28.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.004+0000 7f72b7fff700 1 -- 172.21.15.45:0/3650689641 learned_addr learned my addr 172.21.15.45:0/3650689641 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:28.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.004+0000 7f72c4b1f700 1 --2- 172.21.15.45:0/3650689641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcdbdc8ab0 0x55dcdbdd74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.004+0000 7f72c5320700 1 --2- 172.21.15.45:0/3650689641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dcdbdca2d0 0x55dcdbdd8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.004+0000 7f72b7fff700 1 -- 172.21.15.45:0/3650689641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcdbdc8ab0 msgr2=0x55dcdbdd74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:28.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.004+0000 7f72b7fff700 1 --2- 172.21.15.45:0/3650689641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcdbdc8ab0 0x55dcdbdd74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.004+0000 7f72b7fff700 1 -- 172.21.15.45:0/3650689641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dcdbdca2d0 msgr2=0x55dcdbdd8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:28.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.004+0000 7f72b7fff700 1 --2- 172.21.15.45:0/3650689641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dcdbdca2d0 0x55dcdbdd8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.004+0000 7f72b7fff700 1 -- 172.21.15.45:0/3650689641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dcdbb11b60 con 0x55dcdbdc9980 2024-05-10T03:41:28.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.004+0000 7f72c5320700 1 --2- 172.21.15.45:0/3650689641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dcdbdca2d0 0x55dcdbdd8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:28.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.004+0000 7f72b7fff700 1 --2- 172.21.15.45:0/3650689641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc9980 0x55dcdbdd79e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f72b0096ac0 tx=0x7f72b00a2640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b04ad9a9449acb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:28.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.004+0000 7f729ffff700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:41:28.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.005+0000 7f729ffff700 1 -- 172.21.15.45:0/3650689641 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b000cd30 con 0x55dcdbdc9980 2024-05-10T03:41:28.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.005+0000 7f729ffff700 1 -- 172.21.15.45:0/3650689641 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f72b00b8250 con 0x55dcdbdc9980 2024-05-10T03:41:28.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.005+0000 7f72d70c7b80 1 -- 172.21.15.45:0/3650689641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f72b00a24d0 con 0x55dcdbdc9980 2024-05-10T03:41:28.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.005+0000 7f729ffff700 1 -- 172.21.15.45:0/3650689641 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72b00b8410 con 0x55dcdbdc9980 2024-05-10T03:41:28.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.005+0000 7f72d70c7b80 10 client.15993 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:28.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.005+0000 7f72d70c7b80 1 -- 172.21.15.45:0/3650689641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55dcdbb69cd0 con 0x55dcdbdc9980 2024-05-10T03:41:28.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.005+0000 7f729ffff700 1 -- 172.21.15.45:0/3650689641 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f72b00a24d0 con 0x55dcdbdc9980 2024-05-10T03:41:28.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.005+0000 7f729ffff700 1 -- 172.21.15.45:0/3650689641 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f72b00a2040 con 0x55dcdbdc9980 2024-05-10T03:41:28.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.005+0000 7f72d70c7b80 10 client.15993 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:28.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.005+0000 7f72d70c7b80 10 client.15993 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-10T03:41:28.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.005+0000 7f72d70c7b80 20 client.15993 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:28.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.005+0000 7f72d70c7b80 1 --2- 172.21.15.45:0/3650689641 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x55dcdbe34f10 0x55dcdbe37330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.005+0000 7f72d70c7b80 4 client.15993 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-10T03:41:28.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.005+0000 7f72d70c7b80 1 -- 172.21.15.45:0/3650689641 --> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55dcdbcdcec0 con 0x55dcdbe34f10 2024-05-10T03:41:28.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.005+0000 7f72c4b1f700 1 --2- 172.21.15.45:0/3650689641 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x55dcdbe34f10 0x55dcdbe37330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.006+0000 7f72c4b1f700 1 --2- 172.21.15.45:0/3650689641 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x55dcdbe34f10 0x55dcdbe37330 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=10a83432635540d6 server_cookie=90cd70ed7c2e8d3a in_seq=0 out_seq=0 2024-05-10T03:41:28.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.006+0000 7f729ffff700 10 client.15993 ms_handle_connect on v2:172.21.15.154:6838/1506563336 2024-05-10T03:41:28.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.006+0000 7f729ffff700 1 -- 172.21.15.45:0/3650689641 <== mds.2 v2:172.21.15.154:6838/1506563336 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55dcdbcdcec0 con 0x55dcdbe34f10 2024-05-10T03:41:28.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.006+0000 7f729ffff700 10 client.15993 handle_command_reply: tid=0 2024-05-10T03:41:28.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.006+0000 7f72d70c7b80 1 client.15993 shutdown 2024-05-10T03:41:28.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.006+0000 7f72d70c7b80 1 -- 172.21.15.45:0/3650689641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc9980 msgr2=0x55dcdbdd79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:28.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.006+0000 7f72d70c7b80 1 --2- 172.21.15.45:0/3650689641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc9980 0x55dcdbdd79e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f72b0096ac0 tx=0x7f72b00a2640 comp rx=0 tx=0).stop 2024-05-10T03:41:28.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.006+0000 7f72d70c7b80 1 -- 172.21.15.45:0/3650689641 shutdown_connections 2024-05-10T03:41:28.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.006+0000 7f72d70c7b80 1 --2- 172.21.15.45:0/3650689641 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x55dcdbe34f10 0x55dcdbe37330 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.006+0000 7f72d70c7b80 1 --2- 172.21.15.45:0/3650689641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcdbdc8ab0 0x55dcdbdd74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.006+0000 7f729ffff700 0 client.15993 ms_handle_reset on v2:172.21.15.154:6838/1506563336 2024-05-10T03:41:28.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.006+0000 7f72d70c7b80 1 --2- 172.21.15.45:0/3650689641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dcdbdca2d0 0x55dcdbdd8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.006+0000 7f72d70c7b80 1 --2- 172.21.15.45:0/3650689641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdbdc9980 0x55dcdbdd79e0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.006+0000 7f72d70c7b80 1 -- 172.21.15.45:0/3650689641 >> 172.21.15.45:0/3650689641 conn(0x55dcdbd26a60 msgr2=0x55dcdbdbeed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:28.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.006+0000 7f72d70c7b80 1 -- 172.21.15.45:0/3650689641 shutdown_connections 2024-05-10T03:41:28.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.006+0000 7f72d70c7b80 1 -- 172.21.15.45:0/3650689641 wait complete. 2024-05-10T03:41:28.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.007+0000 7f72d70c7b80 20 client.15993 trim_cache size 0 max 16384 2024-05-10T03:41:28.017 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-05-10T03:41:28.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.007+0000 7f72c6d83700 1 -- 172.21.15.45:0/473642563 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f72a80a11c0 msgr2=0x7f72a80a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:28.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.007+0000 7f72c6d83700 1 --2- 172.21.15.45:0/473642563 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f72a80a11c0 0x7f72a80a36d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f72bc009810 tx=0x7f72bc019040 comp rx=0 tx=0).stop 2024-05-10T03:41:28.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.007+0000 7f72c6d83700 1 -- 172.21.15.45:0/473642563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c0101be0 msgr2=0x7f72c01985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:28.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.007+0000 7f72c6d83700 1 --2- 172.21.15.45:0/473642563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c0101be0 0x7f72c01985b0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f72b000e9c0 tx=0x7f72b000ecd0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.007+0000 7f72c6d83700 1 -- 172.21.15.45:0/473642563 shutdown_connections 2024-05-10T03:41:28.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.007+0000 7f72c6d83700 1 --2- 172.21.15.45:0/473642563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72c0100ac0 0x7f72c0198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.007+0000 7f72c6d83700 1 --2- 172.21.15.45:0/473642563 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f72a80a11c0 0x7f72a80a36d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.007+0000 7f72c6d83700 1 --2- 172.21.15.45:0/473642563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72c0102580 0x7f72c019f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.007+0000 7f72c6d83700 1 --2- 172.21.15.45:0/473642563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c0101be0 0x7f72c01985b0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.007+0000 7f72c6d83700 1 -- 172.21.15.45:0/473642563 >> 172.21.15.45:0/473642563 conn(0x7f72c00fc0d0 msgr2=0x7f72c00fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:28.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.007+0000 7f72c6d83700 1 -- 172.21.15.45:0/473642563 shutdown_connections 2024-05-10T03:41:28.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.007+0000 7f72c6d83700 1 -- 172.21.15.45:0/473642563 wait complete. 2024-05-10T03:41:28.025 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-10T03:41:28.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.173+0000 7fd25f118700 1 -- 172.21.15.45:0/706236099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd258101be0 msgr2=0x7fd258101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:28.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.173+0000 7fd25f118700 1 --2- 172.21.15.45:0/706236099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd258101be0 0x7fd258101ff0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd244009990 tx=0x7fd244009ca0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.174+0000 7fd25f118700 1 -- 172.21.15.45:0/706236099 shutdown_connections 2024-05-10T03:41:28.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.174+0000 7fd25f118700 1 --2- 172.21.15.45:0/706236099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd258100ac0 0x7fd258100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.174+0000 7fd25f118700 1 --2- 172.21.15.45:0/706236099 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd258102580 0x7fd258108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.174+0000 7fd25f118700 1 --2- 172.21.15.45:0/706236099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd258101be0 0x7fd258101ff0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.174+0000 7fd25f118700 1 -- 172.21.15.45:0/706236099 >> 172.21.15.45:0/706236099 conn(0x7fd2580fc0d0 msgr2=0x7fd2580fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:28.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.174+0000 7fd25f118700 1 -- 172.21.15.45:0/706236099 shutdown_connections 2024-05-10T03:41:28.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.174+0000 7fd25f118700 1 -- 172.21.15.45:0/706236099 wait complete. 2024-05-10T03:41:28.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.175+0000 7fd25f118700 1 Processor -- start 2024-05-10T03:41:28.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.175+0000 7fd25f118700 1 -- start start 2024-05-10T03:41:28.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.175+0000 7fd25f118700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd258100ac0 0x7fd258196ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.175+0000 7fd25f118700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd258101be0 0x7fd258197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.175+0000 7fd25f118700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd258102580 0x7fd25819e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.175+0000 7fd25f118700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25819e9c0 con 0x7fd258102580 2024-05-10T03:41:28.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.175+0000 7fd25f118700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25819eb30 con 0x7fd258101be0 2024-05-10T03:41:28.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.175+0000 7fd25f118700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25819ecf0 con 0x7fd258100ac0 2024-05-10T03:41:28.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.175+0000 7fd25d6b5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd258102580 0x7fd25819e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.175+0000 7fd25d6b5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd258102580 0x7fd25819e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37340/0 (socket says 172.21.15.45:37340) 2024-05-10T03:41:28.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.175+0000 7fd25d6b5700 1 -- 172.21.15.45:0/2856605271 learned_addr learned my addr 172.21.15.45:0/2856605271 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:28.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.175+0000 7fd257fff700 1 --2- 172.21.15.45:0/2856605271 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd258101be0 0x7fd258197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.175+0000 7fd25ceb4700 1 --2- 172.21.15.45:0/2856605271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd258100ac0 0x7fd258196ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.175+0000 7fd25d6b5700 1 -- 172.21.15.45:0/2856605271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd258100ac0 msgr2=0x7fd258196ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:28.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.175+0000 7fd25d6b5700 1 --2- 172.21.15.45:0/2856605271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd258100ac0 0x7fd258196ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.175+0000 7fd25d6b5700 1 -- 172.21.15.45:0/2856605271 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd258101be0 msgr2=0x7fd258197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:28.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.176+0000 7fd25d6b5700 1 --2- 172.21.15.45:0/2856605271 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd258101be0 0x7fd258197420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.176+0000 7fd25d6b5700 1 -- 172.21.15.45:0/2856605271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2440095f0 con 0x7fd258102580 2024-05-10T03:41:28.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.176+0000 7fd25ceb4700 1 --2- 172.21.15.45:0/2856605271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd258100ac0 0x7fd258196ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:28.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.176+0000 7fd25d6b5700 1 --2- 172.21.15.45:0/2856605271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd258102580 0x7fd25819e3b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd250007ee0 tx=0x7fd25000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:28.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.176+0000 7fd255ffb700 1 -- 172.21.15.45:0/2856605271 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25000ddd0 con 0x7fd258102580 2024-05-10T03:41:28.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.176+0000 7fd255ffb700 1 -- 172.21.15.45:0/2856605271 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd25000f040 con 0x7fd258102580 2024-05-10T03:41:28.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.176+0000 7fd25f118700 1 -- 172.21.15.45:0/2856605271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd25819efd0 con 0x7fd258102580 2024-05-10T03:41:28.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.176+0000 7fd255ffb700 1 -- 172.21.15.45:0/2856605271 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd250015400 con 0x7fd258102580 2024-05-10T03:41:28.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.176+0000 7fd25f118700 1 -- 172.21.15.45:0/2856605271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd25819f3f0 con 0x7fd258102580 2024-05-10T03:41:28.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.179+0000 7fd255ffb700 1 -- 172.21.15.45:0/2856605271 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd250003a00 con 0x7fd258102580 2024-05-10T03:41:28.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.179+0000 7fd255ffb700 1 --2- 172.21.15.45:0/2856605271 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd2480a11c0 0x7fd2480a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.179+0000 7fd255ffb700 1 -- 172.21.15.45:0/2856605271 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd2500cc4e0 con 0x7fd258102580 2024-05-10T03:41:28.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.179+0000 7fd25ceb4700 1 --2- 172.21.15.45:0/2856605271 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd2480a11c0 0x7fd2480a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.180+0000 7fd25ceb4700 1 --2- 172.21.15.45:0/2856605271 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd2480a11c0 0x7fd2480a36d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd258101ae0 tx=0x7fd24c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:28.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.180+0000 7fd26f45cb80 1 Processor -- start 2024-05-10T03:41:28.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.180+0000 7fd26f45cb80 1 -- start start 2024-05-10T03:41:28.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.181+0000 7fd26f45cb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc367198b0 0x55cc36719d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.181+0000 7fd26f45cb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc3671a780 0x55cc3671ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.181+0000 7fd26f45cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cc3671b0d0 0x55cc367219d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.181+0000 7fd26f45cb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc3663e150 con 0x55cc367198b0 2024-05-10T03:41:28.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.181+0000 7fd26f45cb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc3663bb10 con 0x55cc3671a780 2024-05-10T03:41:28.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.181+0000 7fd26f45cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc36637400 con 0x55cc3671b0d0 2024-05-10T03:41:28.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.181+0000 7fd25ceb4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc367198b0 0x55cc36719d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.181+0000 7fd25ceb4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc367198b0 0x55cc36719d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37354/0 (socket says 172.21.15.45:37354) 2024-05-10T03:41:28.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.181+0000 7fd25ceb4700 1 -- 172.21.15.45:0/4154922000 learned_addr learned my addr 172.21.15.45:0/4154922000 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:28.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.181+0000 7fd257fff700 1 --2- 172.21.15.45:0/4154922000 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc3671a780 0x55cc3671ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.181+0000 7fd25d6b5700 1 --2- 172.21.15.45:0/4154922000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cc3671b0d0 0x55cc367219d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.181+0000 7fd25ceb4700 1 -- 172.21.15.45:0/4154922000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cc3671b0d0 msgr2=0x55cc367219d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:28.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.181+0000 7fd25ceb4700 1 --2- 172.21.15.45:0/4154922000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cc3671b0d0 0x55cc367219d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.181+0000 7fd25ceb4700 1 -- 172.21.15.45:0/4154922000 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc3671a780 msgr2=0x55cc3671ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:28.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.181+0000 7fd25ceb4700 1 --2- 172.21.15.45:0/4154922000 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc3671a780 0x55cc3671ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.181+0000 7fd25ceb4700 1 -- 172.21.15.45:0/4154922000 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc364b83b0 con 0x55cc367198b0 2024-05-10T03:41:28.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.181+0000 7fd257fff700 1 --2- 172.21.15.45:0/4154922000 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc3671a780 0x55cc3671ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:41:28.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.181+0000 7fd25ceb4700 1 --2- 172.21.15.45:0/4154922000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc367198b0 0x55cc36719d00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd24c011ea0 tx=0x7fd24c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a352170e3792c42 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:28.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.182+0000 7fd242ffd700 1 -- 172.21.15.45:0/4154922000 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c012dc0 con 0x55cc367198b0 2024-05-10T03:41:28.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.182+0000 7fd242ffd700 1 -- 172.21.15.45:0/4154922000 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd24c016070 con 0x55cc367198b0 2024-05-10T03:41:28.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.182+0000 7fd242ffd700 1 -- 172.21.15.45:0/4154922000 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c01d610 con 0x55cc367198b0 2024-05-10T03:41:28.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.183+0000 7fd26f45cb80 1 -- 172.21.15.45:0/4154922000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc367198b0 msgr2=0x55cc36719d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:28.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.183+0000 7fd26f45cb80 1 --2- 172.21.15.45:0/4154922000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc367198b0 0x55cc36719d00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd24c011ea0 tx=0x7fd24c014000 comp rx=0 tx=0).stop 2024-05-10T03:41:28.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.183+0000 7fd26f45cb80 1 -- 172.21.15.45:0/4154922000 shutdown_connections 2024-05-10T03:41:28.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.183+0000 7fd26f45cb80 1 --2- 172.21.15.45:0/4154922000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cc3671b0d0 0x55cc367219d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.183+0000 7fd26f45cb80 1 --2- 172.21.15.45:0/4154922000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc367198b0 0x55cc36719d00 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.183+0000 7fd26f45cb80 1 --2- 172.21.15.45:0/4154922000 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc3671a780 0x55cc3671ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.183+0000 7fd26f45cb80 1 -- 172.21.15.45:0/4154922000 >> 172.21.15.45:0/4154922000 conn(0x55cc36679a60 msgr2=0x55cc36711fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:28.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.183+0000 7fd26f45cb80 1 -- 172.21.15.45:0/4154922000 shutdown_connections 2024-05-10T03:41:28.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.183+0000 7fd26f45cb80 1 -- 172.21.15.45:0/4154922000 wait complete. 2024-05-10T03:41:28.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.183+0000 7fd26f45cb80 1 -- start start 2024-05-10T03:41:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.183+0000 7fd26f45cb80 1 Processor -- start 2024-05-10T03:41:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.184+0000 7fd26f45cb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc367198b0 0x55cc367238d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.184+0000 7fd26f45cb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc3671a780 0x55cc36723e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.184+0000 7fd26f45cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cc3671b0d0 0x55cc3672ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.184+0000 7fd26f45cb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc365d3560 con 0x55cc3671a780 2024-05-10T03:41:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.184+0000 7fd26f45cb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc365d3200 con 0x55cc367198b0 2024-05-10T03:41:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.184+0000 7fd26f45cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc364ba6a0 con 0x55cc3671b0d0 2024-05-10T03:41:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.184+0000 7fd26f45cb80 10 client.0 _ll_register_callbacks cb 0x55cc365dcb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.184+0000 7fd257fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc3671a780 0x55cc36723e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.184+0000 7fd257fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc3671a780 0x55cc36723e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37360/0 (socket says 172.21.15.45:37360) 2024-05-10T03:41:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.184+0000 7fd257fff700 1 -- 172.21.15.45:0/892379730 learned_addr learned my addr 172.21.15.45:0/892379730 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.184+0000 7fd25d6b5700 1 --2- 172.21.15.45:0/892379730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cc3671b0d0 0x55cc3672ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.184+0000 7fd25ceb4700 1 --2- 172.21.15.45:0/892379730 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc367198b0 0x55cc367238d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.184+0000 7fd257fff700 1 -- 172.21.15.45:0/892379730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cc3671b0d0 msgr2=0x55cc3672ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.184+0000 7fd257fff700 1 --2- 172.21.15.45:0/892379730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cc3671b0d0 0x55cc3672ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.185+0000 7fd257fff700 1 -- 172.21.15.45:0/892379730 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc367198b0 msgr2=0x55cc367238d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.185+0000 7fd257fff700 1 --2- 172.21.15.45:0/892379730 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc367198b0 0x55cc367238d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.185+0000 7fd257fff700 1 -- 172.21.15.45:0/892379730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2581098c0 con 0x55cc3671a780 2024-05-10T03:41:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.185+0000 7fd25d6b5700 1 --2- 172.21.15.45:0/892379730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cc3671b0d0 0x55cc3672ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.185+0000 7fd257fff700 1 --2- 172.21.15.45:0/892379730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc3671a780 0x55cc36723e10 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd244015000 tx=0x7fd244005320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e95028d77638333 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.185+0000 7fd237fff700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:41:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.185+0000 7fd237fff700 1 -- 172.21.15.45:0/892379730 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd244004910 con 0x55cc3671a780 2024-05-10T03:41:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.185+0000 7fd237fff700 1 -- 172.21.15.45:0/892379730 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd244004a70 con 0x55cc3671a780 2024-05-10T03:41:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.185+0000 7fd26f45cb80 1 -- 172.21.15.45:0/892379730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cc36590270 con 0x55cc3671a780 2024-05-10T03:41:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.185+0000 7fd237fff700 1 -- 172.21.15.45:0/892379730 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd24400bea0 con 0x55cc3671a780 2024-05-10T03:41:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.185+0000 7fd26f45cb80 10 client.16005 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.185+0000 7fd26f45cb80 1 -- 172.21.15.45:0/892379730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7fd24c011c30 con 0x55cc3671a780 2024-05-10T03:41:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.185+0000 7fd237fff700 1 -- 172.21.15.45:0/892379730 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55cc36590270 con 0x55cc3671a780 2024-05-10T03:41:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.186+0000 7fd237fff700 1 -- 172.21.15.45:0/892379730 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd24400f460 con 0x55cc3671a780 2024-05-10T03:41:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.186+0000 7fd26f45cb80 10 client.16005 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.186+0000 7fd26f45cb80 10 client.16005 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-10T03:41:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.186+0000 7fd26f45cb80 20 client.16005 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.186+0000 7fd26f45cb80 1 --2- 172.21.15.45:0/892379730 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55cc3672f5f0 0x55cc36731a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.186+0000 7fd26f45cb80 4 client.16005 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:41:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.186+0000 7fd26f45cb80 1 -- 172.21.15.45:0/892379730 --> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cc366e6780 con 0x55cc3672f5f0 2024-05-10T03:41:28.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.186+0000 7fd25ceb4700 1 --2- 172.21.15.45:0/892379730 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55cc3672f5f0 0x55cc36731a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.186+0000 7fd237fff700 10 client.16005 ms_handle_connect on v2:172.21.15.106:6836/3047487403 2024-05-10T03:41:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.186+0000 7fd25ceb4700 1 --2- 172.21.15.45:0/892379730 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55cc3672f5f0 0x55cc36731a40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=81e45ba866ebc757 server_cookie=587baac4dc238d4e in_seq=0 out_seq=0 2024-05-10T03:41:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.187+0000 7fd237fff700 1 -- 172.21.15.45:0/892379730 <== mds.1 v2:172.21.15.106:6836/3047487403 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cc366e6780 con 0x55cc3672f5f0 2024-05-10T03:41:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.187+0000 7fd237fff700 10 client.16005 handle_command_reply: tid=0 2024-05-10T03:41:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.187+0000 7fd26f45cb80 1 client.16005 shutdown 2024-05-10T03:41:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.187+0000 7fd26f45cb80 1 -- 172.21.15.45:0/892379730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc3671a780 msgr2=0x55cc36723e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.187+0000 7fd26f45cb80 1 --2- 172.21.15.45:0/892379730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc3671a780 0x55cc36723e10 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd244015000 tx=0x7fd244005320 comp rx=0 tx=0).stop 2024-05-10T03:41:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.187+0000 7fd26f45cb80 1 -- 172.21.15.45:0/892379730 shutdown_connections 2024-05-10T03:41:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.187+0000 7fd26f45cb80 1 --2- 172.21.15.45:0/892379730 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55cc3672f5f0 0x55cc36731a40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.187+0000 7fd26f45cb80 1 --2- 172.21.15.45:0/892379730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cc3671b0d0 0x55cc3672ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.187+0000 7fd26f45cb80 1 --2- 172.21.15.45:0/892379730 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc367198b0 0x55cc367238d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.187+0000 7fd237fff700 0 client.16005 ms_handle_reset on v2:172.21.15.106:6836/3047487403 2024-05-10T03:41:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.187+0000 7fd26f45cb80 1 --2- 172.21.15.45:0/892379730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc3671a780 0x55cc36723e10 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.187+0000 7fd26f45cb80 1 -- 172.21.15.45:0/892379730 >> 172.21.15.45:0/892379730 conn(0x55cc36679a60 msgr2=0x55cc36711fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.187+0000 7fd26f45cb80 1 -- 172.21.15.45:0/892379730 shutdown_connections 2024-05-10T03:41:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.187+0000 7fd26f45cb80 1 -- 172.21.15.45:0/892379730 wait complete. 2024-05-10T03:41:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.188+0000 7fd26f45cb80 20 client.16005 trim_cache size 0 max 16384 2024-05-10T03:41:28.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.201+0000 7fd26f45cb80 1 Processor -- start 2024-05-10T03:41:28.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.201+0000 7fd26f45cb80 1 -- start start 2024-05-10T03:41:28.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.202+0000 7fd26f45cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cc367198b0 0x55cc3672b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.202+0000 7fd26f45cb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc3671a780 0x55cc367238d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.202+0000 7fd26f45cb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc3671b0d0 0x55cc36723e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.202+0000 7fd26f45cb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc36724970 con 0x55cc3671a780 2024-05-10T03:41:28.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.202+0000 7fd26f45cb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc3670c7e0 con 0x55cc3671b0d0 2024-05-10T03:41:28.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.202+0000 7fd26f45cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc3671a160 con 0x55cc367198b0 2024-05-10T03:41:28.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.202+0000 7fd257fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc3671a780 0x55cc367238d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.202+0000 7fd257fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc3671a780 0x55cc367238d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37366/0 (socket says 172.21.15.45:37366) 2024-05-10T03:41:28.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.202+0000 7fd257fff700 1 -- 172.21.15.45:0/1875472270 learned_addr learned my addr 172.21.15.45:0/1875472270 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:28.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.202+0000 7fd25ceb4700 1 --2- 172.21.15.45:0/1875472270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cc367198b0 0x55cc3672b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.202+0000 7fd25d6b5700 1 --2- 172.21.15.45:0/1875472270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc3671b0d0 0x55cc36723e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.202+0000 7fd257fff700 1 -- 172.21.15.45:0/1875472270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cc367198b0 msgr2=0x55cc3672b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:28.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.202+0000 7fd257fff700 1 --2- 172.21.15.45:0/1875472270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cc367198b0 0x55cc3672b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.202+0000 7fd257fff700 1 -- 172.21.15.45:0/1875472270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc3671b0d0 msgr2=0x55cc36723e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:28.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.202+0000 7fd257fff700 1 --2- 172.21.15.45:0/1875472270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc3671b0d0 0x55cc36723e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.202+0000 7fd257fff700 1 -- 172.21.15.45:0/1875472270 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc36464b60 con 0x55cc3671a780 2024-05-10T03:41:28.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.202+0000 7fd257fff700 1 --2- 172.21.15.45:0/1875472270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc3671a780 0x55cc367238d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd24400f7c0 tx=0x7fd244009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76fe449882d0738 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:28.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.202+0000 7fd2437fe700 1 -- 172.21.15.45:0/1875472270 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24400fab0 con 0x55cc3671a780 2024-05-10T03:41:28.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.203+0000 7fd2437fe700 1 -- 172.21.15.45:0/1875472270 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd24401e040 con 0x55cc3671a780 2024-05-10T03:41:28.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.203+0000 7fd2437fe700 1 -- 172.21.15.45:0/1875472270 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd244024480 con 0x55cc3671a780 2024-05-10T03:41:28.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.203+0000 7fd26f45cb80 1 -- 172.21.15.45:0/1875472270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc3671a780 msgr2=0x55cc367238d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:28.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.203+0000 7fd26f45cb80 1 --2- 172.21.15.45:0/1875472270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc3671a780 0x55cc367238d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd24400f7c0 tx=0x7fd244009ca0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.203+0000 7fd26f45cb80 1 -- 172.21.15.45:0/1875472270 shutdown_connections 2024-05-10T03:41:28.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.203+0000 7fd26f45cb80 1 --2- 172.21.15.45:0/1875472270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cc367198b0 0x55cc3672b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.203+0000 7fd26f45cb80 1 --2- 172.21.15.45:0/1875472270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc3671b0d0 0x55cc36723e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.203+0000 7fd26f45cb80 1 --2- 172.21.15.45:0/1875472270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc3671a780 0x55cc367238d0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.203+0000 7fd26f45cb80 1 -- 172.21.15.45:0/1875472270 >> 172.21.15.45:0/1875472270 conn(0x55cc36679a60 msgr2=0x55cc3671d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:28.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.203+0000 7fd26f45cb80 1 -- 172.21.15.45:0/1875472270 shutdown_connections 2024-05-10T03:41:28.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.203+0000 7fd26f45cb80 1 -- 172.21.15.45:0/1875472270 wait complete. 2024-05-10T03:41:28.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.204+0000 7fd26f45cb80 1 -- start start 2024-05-10T03:41:28.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.204+0000 7fd26f45cb80 1 Processor -- start 2024-05-10T03:41:28.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.204+0000 7fd26f45cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cc367198b0 0x55cc36718380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.204+0000 7fd26f45cb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc3671a780 0x55cc367188c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.204+0000 7fd26f45cb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc3671b0d0 0x55cc36785d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.204+0000 7fd26f45cb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc36786240 con 0x55cc3671b0d0 2024-05-10T03:41:28.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.204+0000 7fd26f45cb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc36786380 con 0x55cc3671a780 2024-05-10T03:41:28.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.204+0000 7fd26f45cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc36786510 con 0x55cc367198b0 2024-05-10T03:41:28.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.204+0000 7fd26f45cb80 10 client.0 _ll_register_callbacks cb 0x55cc365dcb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:28.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.204+0000 7fd25d6b5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc3671b0d0 0x55cc36785d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.204+0000 7fd25d6b5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc3671b0d0 0x55cc36785d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37368/0 (socket says 172.21.15.45:37368) 2024-05-10T03:41:28.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.205+0000 7fd25d6b5700 1 -- 172.21.15.45:0/564199451 learned_addr learned my addr 172.21.15.45:0/564199451 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:28.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.205+0000 7fd257fff700 1 --2- 172.21.15.45:0/564199451 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc3671a780 0x55cc367188c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.205+0000 7fd25ceb4700 1 --2- 172.21.15.45:0/564199451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cc367198b0 0x55cc36718380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.205+0000 7fd257fff700 1 -- 172.21.15.45:0/564199451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cc367198b0 msgr2=0x55cc36718380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:28.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.205+0000 7fd257fff700 1 --2- 172.21.15.45:0/564199451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cc367198b0 0x55cc36718380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.205+0000 7fd257fff700 1 -- 172.21.15.45:0/564199451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc3671b0d0 msgr2=0x55cc36785d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:28.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.205+0000 7fd257fff700 1 --2- 172.21.15.45:0/564199451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc3671b0d0 0x55cc36785d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.205+0000 7fd257fff700 1 -- 172.21.15.45:0/564199451 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24c011c30 con 0x55cc3671a780 2024-05-10T03:41:28.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.205+0000 7fd25d6b5700 1 --2- 172.21.15.45:0/564199451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc3671b0d0 0x55cc36785d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:41:28.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.205+0000 7fd257fff700 1 --2- 172.21.15.45:0/564199451 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc3671a780 0x55cc367188c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55cc3672bde0 tx=0x7fd24400b610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6d839ba000da682 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:28.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.205+0000 7fd237fff700 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-05-10T03:41:28.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.205+0000 7fd237fff700 1 -- 172.21.15.45:0/564199451 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd244004710 con 0x55cc3671a780 2024-05-10T03:41:28.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.205+0000 7fd26f45cb80 1 -- 172.21.15.45:0/564199451 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd24c016070 con 0x55cc3671a780 2024-05-10T03:41:28.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.205+0000 7fd237fff700 1 -- 172.21.15.45:0/564199451 <== mon.2 v2:172.21.15.106:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd244000e40 con 0x55cc3671a780 2024-05-10T03:41:28.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.206+0000 7fd237fff700 1 -- 172.21.15.45:0/564199451 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd244004870 con 0x55cc3671a780 2024-05-10T03:41:28.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.206+0000 7fd26f45cb80 10 client.25850 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:28.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.206+0000 7fd26f45cb80 1 -- 172.21.15.45:0/564199451 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55cc365fd560 con 0x55cc3671a780 2024-05-10T03:41:28.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.206+0000 7fd237fff700 1 -- 172.21.15.45:0/564199451 <== mon.2 v2:172.21.15.106:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd24c016070 con 0x55cc3671a780 2024-05-10T03:41:28.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.206+0000 7fd237fff700 1 -- 172.21.15.45:0/564199451 <== mon.2 v2:172.21.15.106:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd244040430 con 0x55cc3671a780 2024-05-10T03:41:28.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.206+0000 7fd26f45cb80 10 client.25850 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:28.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.206+0000 7fd26f45cb80 10 client.25850 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-10T03:41:28.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.206+0000 7fd26f45cb80 20 client.25850 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:28.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.206+0000 7fd26f45cb80 1 --2- 172.21.15.45:0/564199451 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55cc36787b20 0x55cc36789f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.206+0000 7fd26f45cb80 4 client.25850 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-10T03:41:28.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.206+0000 7fd26f45cb80 1 -- 172.21.15.45:0/564199451 --> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55cc3662fec0 con 0x55cc36787b20 2024-05-10T03:41:28.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.206+0000 7fd25ceb4700 1 --2- 172.21.15.45:0/564199451 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55cc36787b20 0x55cc36789f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.207+0000 7fd237fff700 10 client.25850 ms_handle_connect on v2:172.21.15.106:6836/3047487403 2024-05-10T03:41:28.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.207+0000 7fd25ceb4700 1 --2- 172.21.15.45:0/564199451 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55cc36787b20 0x55cc36789f40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a49f2f710b4d3fb7 server_cookie=4eae2f0c606e566b in_seq=0 out_seq=0 2024-05-10T03:41:28.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.207+0000 7fd237fff700 1 -- 172.21.15.45:0/564199451 <== mds.1 v2:172.21.15.106:6836/3047487403 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55cc3662fec0 con 0x55cc36787b20 2024-05-10T03:41:28.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.207+0000 7fd237fff700 10 client.25850 handle_command_reply: tid=0 2024-05-10T03:41:28.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.207+0000 7fd26f45cb80 1 client.25850 shutdown 2024-05-10T03:41:28.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.207+0000 7fd26f45cb80 1 -- 172.21.15.45:0/564199451 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc3671a780 msgr2=0x55cc367188c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:28.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.207+0000 7fd26f45cb80 1 --2- 172.21.15.45:0/564199451 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc3671a780 0x55cc367188c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55cc3672bde0 tx=0x7fd24400b610 comp rx=0 tx=0).stop 2024-05-10T03:41:28.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.207+0000 7fd26f45cb80 1 -- 172.21.15.45:0/564199451 shutdown_connections 2024-05-10T03:41:28.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.207+0000 7fd26f45cb80 1 --2- 172.21.15.45:0/564199451 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55cc36787b20 0x55cc36789f40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.207+0000 7fd26f45cb80 1 --2- 172.21.15.45:0/564199451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cc367198b0 0x55cc36718380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.207+0000 7fd26f45cb80 1 --2- 172.21.15.45:0/564199451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc3671b0d0 0x55cc36785d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.207+0000 7fd237fff700 0 client.25850 ms_handle_reset on v2:172.21.15.106:6836/3047487403 2024-05-10T03:41:28.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.207+0000 7fd26f45cb80 1 --2- 172.21.15.45:0/564199451 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc3671a780 0x55cc367188c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.207+0000 7fd26f45cb80 1 -- 172.21.15.45:0/564199451 >> 172.21.15.45:0/564199451 conn(0x55cc36679a60 msgr2=0x55cc3672b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:28.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.207+0000 7fd26f45cb80 1 -- 172.21.15.45:0/564199451 shutdown_connections 2024-05-10T03:41:28.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.207+0000 7fd26f45cb80 1 -- 172.21.15.45:0/564199451 wait complete. 2024-05-10T03:41:28.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.208+0000 7fd26f45cb80 20 client.25850 trim_cache size 0 max 16384 2024-05-10T03:41:28.217 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-05-10T03:41:28.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.208+0000 7fd25f118700 1 -- 172.21.15.45:0/2856605271 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd2480a11c0 msgr2=0x7fd2480a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:28.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.208+0000 7fd25f118700 1 --2- 172.21.15.45:0/2856605271 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd2480a11c0 0x7fd2480a36d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd258101ae0 tx=0x7fd24c009260 comp rx=0 tx=0).stop 2024-05-10T03:41:28.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.208+0000 7fd25f118700 1 -- 172.21.15.45:0/2856605271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd258102580 msgr2=0x7fd25819e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:28.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.208+0000 7fd25f118700 1 --2- 172.21.15.45:0/2856605271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd258102580 0x7fd25819e3b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd250007ee0 tx=0x7fd25000d3b0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.208+0000 7fd25f118700 1 -- 172.21.15.45:0/2856605271 shutdown_connections 2024-05-10T03:41:28.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.208+0000 7fd25f118700 1 --2- 172.21.15.45:0/2856605271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd258100ac0 0x7fd258196ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.208+0000 7fd25f118700 1 --2- 172.21.15.45:0/2856605271 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd2480a11c0 0x7fd2480a36d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.208+0000 7fd25f118700 1 --2- 172.21.15.45:0/2856605271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd258102580 0x7fd25819e3b0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.208+0000 7fd25f118700 1 --2- 172.21.15.45:0/2856605271 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd258101be0 0x7fd258197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.208+0000 7fd25f118700 1 -- 172.21.15.45:0/2856605271 >> 172.21.15.45:0/2856605271 conn(0x7fd2580fc0d0 msgr2=0x7fd258104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:28.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.208+0000 7fd25f118700 1 -- 172.21.15.45:0/2856605271 shutdown_connections 2024-05-10T03:41:28.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.208+0000 7fd25f118700 1 -- 172.21.15.45:0/2856605271 wait complete. 2024-05-10T03:41:28.224 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:28 smithi045 ceph-mon[42520]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-05-10T03:41:28.224 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:28 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3538975314' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:41:28.226 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-10T03:41:28.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.374+0000 7f0d4e264700 1 -- 172.21.15.45:0/3183803754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d48100ac0 msgr2=0x7f0d48100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:28.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.374+0000 7f0d4e264700 1 --2- 172.21.15.45:0/3183803754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d48100ac0 0x7f0d48100ed0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0d38009990 tx=0x7f0d38009ca0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.374+0000 7f0d4e264700 1 -- 172.21.15.45:0/3183803754 shutdown_connections 2024-05-10T03:41:28.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.374+0000 7f0d4e264700 1 --2- 172.21.15.45:0/3183803754 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d48102580 0x7f0d48108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.374+0000 7f0d4e264700 1 --2- 172.21.15.45:0/3183803754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d48100ac0 0x7f0d48100ed0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.374+0000 7f0d4e264700 1 --2- 172.21.15.45:0/3183803754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d48101be0 0x7f0d48101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.374+0000 7f0d4e264700 1 -- 172.21.15.45:0/3183803754 >> 172.21.15.45:0/3183803754 conn(0x7f0d480fc0d0 msgr2=0x7f0d480fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:28.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.374+0000 7f0d4e264700 1 -- 172.21.15.45:0/3183803754 shutdown_connections 2024-05-10T03:41:28.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.374+0000 7f0d4e264700 1 -- 172.21.15.45:0/3183803754 wait complete. 2024-05-10T03:41:28.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.375+0000 7f0d4e264700 1 Processor -- start 2024-05-10T03:41:28.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.375+0000 7f0d4e264700 1 -- start start 2024-05-10T03:41:28.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.375+0000 7f0d4e264700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d48100ac0 0x7f0d4819a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.375+0000 7f0d4e264700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d48101be0 0x7f0d4819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.375+0000 7f0d4e264700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d48102580 0x7f0d481a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.375+0000 7f0d4e264700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d481a1ce0 con 0x7f0d48100ac0 2024-05-10T03:41:28.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.375+0000 7f0d4e264700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d481a1e50 con 0x7f0d48101be0 2024-05-10T03:41:28.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.375+0000 7f0d4e264700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d481a2010 con 0x7f0d48102580 2024-05-10T03:41:28.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.375+0000 7f0d47fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d48100ac0 0x7f0d4819a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.375+0000 7f0d47fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d48100ac0 0x7f0d4819a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37394/0 (socket says 172.21.15.45:37394) 2024-05-10T03:41:28.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.375+0000 7f0d47fff700 1 -- 172.21.15.45:0/2796203534 learned_addr learned my addr 172.21.15.45:0/2796203534 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:28.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.375+0000 7f0d477fe700 1 --2- 172.21.15.45:0/2796203534 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d48101be0 0x7f0d4819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.376+0000 7f0d4c801700 1 --2- 172.21.15.45:0/2796203534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d48102580 0x7f0d481a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.376+0000 7f0d47fff700 1 -- 172.21.15.45:0/2796203534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d48102580 msgr2=0x7f0d481a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:28.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.376+0000 7f0d47fff700 1 --2- 172.21.15.45:0/2796203534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d48102580 0x7f0d481a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.376+0000 7f0d47fff700 1 -- 172.21.15.45:0/2796203534 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d48101be0 msgr2=0x7f0d4819a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:28.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.376+0000 7f0d47fff700 1 --2- 172.21.15.45:0/2796203534 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d48101be0 0x7f0d4819a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.376+0000 7f0d47fff700 1 -- 172.21.15.45:0/2796203534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d380095f0 con 0x7f0d48100ac0 2024-05-10T03:41:28.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.376+0000 7f0d47fff700 1 --2- 172.21.15.45:0/2796203534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d48100ac0 0x7f0d4819a200 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0d38000c00 tx=0x7f0d38005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:28.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.376+0000 7f0d457fa700 1 -- 172.21.15.45:0/2796203534 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3801d070 con 0x7f0d48100ac0 2024-05-10T03:41:28.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.376+0000 7f0d457fa700 1 -- 172.21.15.45:0/2796203534 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0d380218f0 con 0x7f0d48100ac0 2024-05-10T03:41:28.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.376+0000 7f0d4e264700 1 -- 172.21.15.45:0/2796203534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d481a2290 con 0x7f0d48100ac0 2024-05-10T03:41:28.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.376+0000 7f0d457fa700 1 -- 172.21.15.45:0/2796203534 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3800fea0 con 0x7f0d48100ac0 2024-05-10T03:41:28.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.376+0000 7f0d4e264700 1 -- 172.21.15.45:0/2796203534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d481a2710 con 0x7f0d48100ac0 2024-05-10T03:41:28.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.379+0000 7f0d457fa700 1 -- 172.21.15.45:0/2796203534 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0d38017690 con 0x7f0d48100ac0 2024-05-10T03:41:28.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.380+0000 7f0d457fa700 1 --2- 172.21.15.45:0/2796203534 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0d300a1240 0x7f0d300a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.380+0000 7f0d477fe700 1 --2- 172.21.15.45:0/2796203534 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0d300a1240 0x7f0d300a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.380+0000 7f0d457fa700 1 -- 172.21.15.45:0/2796203534 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0d380ce000 con 0x7f0d48100ac0 2024-05-10T03:41:28.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.380+0000 7f0d477fe700 1 --2- 172.21.15.45:0/2796203534 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0d300a1240 0x7f0d300a3750 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0d4819b2a0 tx=0x7f0d3c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:28.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.381+0000 7f0d5e5a8b80 1 Processor -- start 2024-05-10T03:41:28.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.381+0000 7f0d5e5a8b80 1 -- start start 2024-05-10T03:41:28.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.381+0000 7f0d5e5a8b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bc3286a0 0x5572bc328af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.381+0000 7f0d5e5a8b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572bc329570 0x5572bc329980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.381+0000 7f0d5e5a8b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329ec0 0x5572bc3307c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.381+0000 7f0d5e5a8b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572bc24f150 con 0x5572bc329ec0 2024-05-10T03:41:28.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.381+0000 7f0d5e5a8b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572bc24cb10 con 0x5572bc329570 2024-05-10T03:41:28.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.381+0000 7f0d5e5a8b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572bc248400 con 0x5572bc3286a0 2024-05-10T03:41:28.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.381+0000 7f0d4c801700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329ec0 0x5572bc3307c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.381+0000 7f0d4c801700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329ec0 0x5572bc3307c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37410/0 (socket says 172.21.15.45:37410) 2024-05-10T03:41:28.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.381+0000 7f0d4c801700 1 -- 172.21.15.45:0/3212099035 learned_addr learned my addr 172.21.15.45:0/3212099035 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:28.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.381+0000 7f0d477fe700 1 --2- 172.21.15.45:0/3212099035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572bc329570 0x5572bc329980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.381+0000 7f0d47fff700 1 --2- 172.21.15.45:0/3212099035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bc3286a0 0x5572bc328af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.382+0000 7f0d4c801700 1 -- 172.21.15.45:0/3212099035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bc3286a0 msgr2=0x5572bc328af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:28.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.382+0000 7f0d4c801700 1 --2- 172.21.15.45:0/3212099035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bc3286a0 0x5572bc328af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.382+0000 7f0d4c801700 1 -- 172.21.15.45:0/3212099035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572bc329570 msgr2=0x5572bc329980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:28.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.382+0000 7f0d4c801700 1 --2- 172.21.15.45:0/3212099035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572bc329570 0x5572bc329980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.382+0000 7f0d4c801700 1 -- 172.21.15.45:0/3212099035 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572bc0c93b0 con 0x5572bc329ec0 2024-05-10T03:41:28.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.382+0000 7f0d477fe700 1 --2- 172.21.15.45:0/3212099035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572bc329570 0x5572bc329980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:28.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.382+0000 7f0d4c801700 1 --2- 172.21.15.45:0/3212099035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329ec0 0x5572bc3307c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009d40 tx=0x7f0d400077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b22aae0757a6c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:28.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.382+0000 7f0d2e7fc700 1 -- 172.21.15.45:0/3212099035 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40014610 con 0x5572bc329ec0 2024-05-10T03:41:28.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.382+0000 7f0d2e7fc700 1 -- 172.21.15.45:0/3212099035 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0d4000f050 con 0x5572bc329ec0 2024-05-10T03:41:28.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.382+0000 7f0d2e7fc700 1 -- 172.21.15.45:0/3212099035 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40013960 con 0x5572bc329ec0 2024-05-10T03:41:28.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.383+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/3212099035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329ec0 msgr2=0x5572bc3307c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:28.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.383+0000 7f0d5e5a8b80 1 --2- 172.21.15.45:0/3212099035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329ec0 0x5572bc3307c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009d40 tx=0x7f0d400077e0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.383+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/3212099035 shutdown_connections 2024-05-10T03:41:28.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.383+0000 7f0d5e5a8b80 1 --2- 172.21.15.45:0/3212099035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bc3286a0 0x5572bc328af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.383+0000 7f0d5e5a8b80 1 --2- 172.21.15.45:0/3212099035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329ec0 0x5572bc3307c0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.383+0000 7f0d5e5a8b80 1 --2- 172.21.15.45:0/3212099035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572bc329570 0x5572bc329980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.383+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/3212099035 >> 172.21.15.45:0/3212099035 conn(0x5572bc28aa60 msgr2=0x5572bc322fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:28.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.383+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/3212099035 shutdown_connections 2024-05-10T03:41:28.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.383+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/3212099035 wait complete. 2024-05-10T03:41:28.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.383+0000 7f0d5e5a8b80 1 -- start start 2024-05-10T03:41:28.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.384+0000 7f0d5e5a8b80 1 Processor -- start 2024-05-10T03:41:28.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.384+0000 7f0d5e5a8b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572bc3286a0 0x5572bc332670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.384+0000 7f0d5e5a8b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329570 0x5572bc332bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.384+0000 7f0d5e5a8b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bc329ec0 0x5572bc339b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.384+0000 7f0d5e5a8b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572bc1e4560 con 0x5572bc329570 2024-05-10T03:41:28.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.384+0000 7f0d5e5a8b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572bc1e4200 con 0x5572bc3286a0 2024-05-10T03:41:28.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.384+0000 7f0d5e5a8b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572bc0cb6a0 con 0x5572bc329ec0 2024-05-10T03:41:28.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.384+0000 7f0d5e5a8b80 10 client.0 _ll_register_callbacks cb 0x5572bc1edb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:28.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.384+0000 7f0d477fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329570 0x5572bc332bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.384+0000 7f0d477fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329570 0x5572bc332bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37416/0 (socket says 172.21.15.45:37416) 2024-05-10T03:41:28.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.384+0000 7f0d477fe700 1 -- 172.21.15.45:0/4287911410 learned_addr learned my addr 172.21.15.45:0/4287911410 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:28.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.384+0000 7f0d47fff700 1 --2- 172.21.15.45:0/4287911410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572bc3286a0 0x5572bc332670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.384+0000 7f0d4c801700 1 --2- 172.21.15.45:0/4287911410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bc329ec0 0x5572bc339b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.385+0000 7f0d477fe700 1 -- 172.21.15.45:0/4287911410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bc329ec0 msgr2=0x5572bc339b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:28.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.385+0000 7f0d477fe700 1 --2- 172.21.15.45:0/4287911410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bc329ec0 0x5572bc339b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.385+0000 7f0d477fe700 1 -- 172.21.15.45:0/4287911410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572bc3286a0 msgr2=0x5572bc332670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:28.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.385+0000 7f0d477fe700 1 --2- 172.21.15.45:0/4287911410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572bc3286a0 0x5572bc332670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.385+0000 7f0d477fe700 1 -- 172.21.15.45:0/4287911410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d400099a0 con 0x5572bc329570 2024-05-10T03:41:28.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.385+0000 7f0d47fff700 1 --2- 172.21.15.45:0/4287911410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572bc3286a0 0x5572bc332670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:41:28.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.385+0000 7f0d477fe700 1 --2- 172.21.15.45:0/4287911410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329570 0x5572bc332bb0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0129e0 tx=0x7f0d3c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bebc8a5f9d51f097 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:28.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.385+0000 7f0d277fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:41:28.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.385+0000 7f0d277fe700 1 -- 172.21.15.45:0/4287911410 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c01e940 con 0x5572bc329570 2024-05-10T03:41:28.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.385+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/4287911410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5572bc1a1270 con 0x5572bc329570 2024-05-10T03:41:28.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.385+0000 7f0d277fe700 1 -- 172.21.15.45:0/4287911410 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0d3c025070 con 0x5572bc329570 2024-05-10T03:41:28.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.385+0000 7f0d277fe700 1 -- 172.21.15.45:0/4287911410 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d3c01eaa0 con 0x5572bc329570 2024-05-10T03:41:28.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.385+0000 7f0d5e5a8b80 10 client.16023 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:28.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.385+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/4287911410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5572bc075b60 con 0x5572bc329570 2024-05-10T03:41:28.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.386+0000 7f0d277fe700 1 -- 172.21.15.45:0/4287911410 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x5572bc1a1270 con 0x5572bc329570 2024-05-10T03:41:28.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.386+0000 7f0d277fe700 1 -- 172.21.15.45:0/4287911410 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f0d3c01b390 con 0x5572bc329570 2024-05-10T03:41:28.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.386+0000 7f0d5e5a8b80 10 client.16023 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:28.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.386+0000 7f0d5e5a8b80 10 client.16023 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:41:28.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.386+0000 7f0d5e5a8b80 20 client.16023 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:28.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.386+0000 7f0d5e5a8b80 1 --2- 172.21.15.45:0/4287911410 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5572bc33e370 0x5572bc3407c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.386+0000 7f0d5e5a8b80 4 client.16023 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:41:28.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.386+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/4287911410 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5572bc2f7780 con 0x5572bc33e370 2024-05-10T03:41:28.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.386+0000 7f0d47fff700 1 --2- 172.21.15.45:0/4287911410 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5572bc33e370 0x5572bc3407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.387+0000 7f0d47fff700 1 --2- 172.21.15.45:0/4287911410 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5572bc33e370 0x5572bc3407c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6638aadf0bd3328f server_cookie=41e03b8dc94be992 in_seq=0 out_seq=0 2024-05-10T03:41:28.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.387+0000 7f0d277fe700 10 client.16023 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:28.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.388+0000 7f0d277fe700 1 -- 172.21.15.45:0/4287911410 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5572bc2f7780 con 0x5572bc33e370 2024-05-10T03:41:28.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.388+0000 7f0d277fe700 10 client.16023 handle_command_reply: tid=0 2024-05-10T03:41:28.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.388+0000 7f0d5e5a8b80 1 client.16023 shutdown 2024-05-10T03:41:28.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.388+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/4287911410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329570 msgr2=0x5572bc332bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:28.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.388+0000 7f0d5e5a8b80 1 --2- 172.21.15.45:0/4287911410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329570 0x5572bc332bb0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0129e0 tx=0x7f0d3c0047c0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.388+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/4287911410 shutdown_connections 2024-05-10T03:41:28.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.388+0000 7f0d5e5a8b80 1 --2- 172.21.15.45:0/4287911410 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5572bc33e370 0x5572bc3407c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.388+0000 7f0d5e5a8b80 1 --2- 172.21.15.45:0/4287911410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bc329ec0 0x5572bc339b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.388+0000 7f0d5e5a8b80 1 --2- 172.21.15.45:0/4287911410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572bc3286a0 0x5572bc332670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.388+0000 7f0d277fe700 0 client.16023 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:28.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.388+0000 7f0d5e5a8b80 1 --2- 172.21.15.45:0/4287911410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329570 0x5572bc332bb0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.388+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/4287911410 >> 172.21.15.45:0/4287911410 conn(0x5572bc28aa60 msgr2=0x5572bc322fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:28.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.388+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/4287911410 shutdown_connections 2024-05-10T03:41:28.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.388+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/4287911410 wait complete. 2024-05-10T03:41:28.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.388+0000 7f0d5e5a8b80 20 client.16023 trim_cache size 0 max 16384 2024-05-10T03:41:28.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:28 smithi106 ceph-mon[46996]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-05-10T03:41:28.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:28 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3538975314' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:41:28.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.402+0000 7f0d5e5a8b80 1 Processor -- start 2024-05-10T03:41:28.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.402+0000 7f0d5e5a8b80 1 -- start start 2024-05-10T03:41:28.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.402+0000 7f0d5e5a8b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bc3286a0 0x5572bc32c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.402+0000 7f0d5e5a8b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572bc329570 0x5572bc328d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.402+0000 7f0d5e5a8b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329ec0 0x5572bc32d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.402+0000 7f0d5e5a8b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572bc33b820 con 0x5572bc329ec0 2024-05-10T03:41:28.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.402+0000 7f0d5e5a8b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572bc31d7c0 con 0x5572bc329570 2024-05-10T03:41:28.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.402+0000 7f0d5e5a8b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572bc33e070 con 0x5572bc3286a0 2024-05-10T03:41:28.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.402+0000 7f0d4c801700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329ec0 0x5572bc32d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.403+0000 7f0d4c801700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329ec0 0x5572bc32d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37430/0 (socket says 172.21.15.45:37430) 2024-05-10T03:41:28.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.403+0000 7f0d4c801700 1 -- 172.21.15.45:0/970590981 learned_addr learned my addr 172.21.15.45:0/970590981 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:28.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.403+0000 7f0d477fe700 1 --2- 172.21.15.45:0/970590981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572bc329570 0x5572bc328d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.403+0000 7f0d47fff700 1 --2- 172.21.15.45:0/970590981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bc3286a0 0x5572bc32c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.403+0000 7f0d4c801700 1 -- 172.21.15.45:0/970590981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bc3286a0 msgr2=0x5572bc32c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.403+0000 7f0d4c801700 1 --2- 172.21.15.45:0/970590981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bc3286a0 0x5572bc32c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.403+0000 7f0d4c801700 1 -- 172.21.15.45:0/970590981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572bc329570 msgr2=0x5572bc328d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.403+0000 7f0d4c801700 1 --2- 172.21.15.45:0/970590981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572bc329570 0x5572bc328d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.403+0000 7f0d4c801700 1 -- 172.21.15.45:0/970590981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572bc20e560 con 0x5572bc329ec0 2024-05-10T03:41:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.403+0000 7f0d47fff700 1 --2- 172.21.15.45:0/970590981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bc3286a0 0x5572bc32c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.403+0000 7f0d477fe700 1 --2- 172.21.15.45:0/970590981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572bc329570 0x5572bc328d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.403+0000 7f0d4c801700 1 --2- 172.21.15.45:0/970590981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329ec0 0x5572bc32d2b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009d40 tx=0x7f0d40004a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66cfc24608b0ce6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.403+0000 7f0d2effd700 1 -- 172.21.15.45:0/970590981 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40005040 con 0x5572bc329ec0 2024-05-10T03:41:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.403+0000 7f0d2effd700 1 -- 172.21.15.45:0/970590981 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0d40009e90 con 0x5572bc329ec0 2024-05-10T03:41:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.403+0000 7f0d2effd700 1 -- 172.21.15.45:0/970590981 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d400149b0 con 0x5572bc329ec0 2024-05-10T03:41:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.404+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/970590981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329ec0 msgr2=0x5572bc32d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.404+0000 7f0d5e5a8b80 1 --2- 172.21.15.45:0/970590981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329ec0 0x5572bc32d2b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009d40 tx=0x7f0d40004a90 comp rx=0 tx=0).stop 2024-05-10T03:41:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.404+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/970590981 shutdown_connections 2024-05-10T03:41:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.404+0000 7f0d5e5a8b80 1 --2- 172.21.15.45:0/970590981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bc3286a0 0x5572bc32c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.404+0000 7f0d5e5a8b80 1 --2- 172.21.15.45:0/970590981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329ec0 0x5572bc32d2b0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.404+0000 7f0d5e5a8b80 1 --2- 172.21.15.45:0/970590981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572bc329570 0x5572bc328d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.404+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/970590981 >> 172.21.15.45:0/970590981 conn(0x5572bc28aa60 msgr2=0x5572bc322fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.404+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/970590981 shutdown_connections 2024-05-10T03:41:28.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.404+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/970590981 wait complete. 2024-05-10T03:41:28.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.404+0000 7f0d5e5a8b80 1 -- start start 2024-05-10T03:41:28.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.405+0000 7f0d5e5a8b80 1 Processor -- start 2024-05-10T03:41:28.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.405+0000 7f0d5e5a8b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bc3286a0 0x5572bc337950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.405+0000 7f0d5e5a8b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572bc329570 0x5572bc337e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.405+0000 7f0d5e5a8b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329ec0 0x5572bc338dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.405+0000 7f0d5e5a8b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572bc339300 con 0x5572bc329ec0 2024-05-10T03:41:28.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.405+0000 7f0d5e5a8b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572bc339470 con 0x5572bc329570 2024-05-10T03:41:28.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.405+0000 7f0d5e5a8b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572bc339630 con 0x5572bc3286a0 2024-05-10T03:41:28.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.405+0000 7f0d5e5a8b80 10 client.0 _ll_register_callbacks cb 0x5572bc1edb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:28.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.405+0000 7f0d4c801700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329ec0 0x5572bc338dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.405+0000 7f0d4c801700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329ec0 0x5572bc338dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37438/0 (socket says 172.21.15.45:37438) 2024-05-10T03:41:28.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.405+0000 7f0d4c801700 1 -- 172.21.15.45:0/1350468970 learned_addr learned my addr 172.21.15.45:0/1350468970 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:28.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.405+0000 7f0d47fff700 1 --2- 172.21.15.45:0/1350468970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bc3286a0 0x5572bc337950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.405+0000 7f0d477fe700 1 --2- 172.21.15.45:0/1350468970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572bc329570 0x5572bc337e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.406+0000 7f0d4c801700 1 -- 172.21.15.45:0/1350468970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bc3286a0 msgr2=0x5572bc337950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:28.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.406+0000 7f0d4c801700 1 --2- 172.21.15.45:0/1350468970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bc3286a0 0x5572bc337950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.406+0000 7f0d4c801700 1 -- 172.21.15.45:0/1350468970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572bc329570 msgr2=0x5572bc337e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:28.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.406+0000 7f0d4c801700 1 --2- 172.21.15.45:0/1350468970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572bc329570 0x5572bc337e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.406+0000 7f0d4c801700 1 -- 172.21.15.45:0/1350468970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5572bc0c93b0 con 0x5572bc329ec0 2024-05-10T03:41:28.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.406+0000 7f0d4c801700 1 --2- 172.21.15.45:0/1350468970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329ec0 0x5572bc338dc0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0d40025000 tx=0x7f0d40015d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94d85833bbeb45f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:28.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.406+0000 7f0d277fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:41:28.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.406+0000 7f0d277fe700 1 -- 172.21.15.45:0/1350468970 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4001e810 con 0x5572bc329ec0 2024-05-10T03:41:28.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.406+0000 7f0d277fe700 1 -- 172.21.15.45:0/1350468970 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0d4001e970 con 0x5572bc329ec0 2024-05-10T03:41:28.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.406+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/1350468970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d4000f050 con 0x5572bc329ec0 2024-05-10T03:41:28.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.406+0000 7f0d277fe700 1 -- 172.21.15.45:0/1350468970 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d4001eb30 con 0x5572bc329ec0 2024-05-10T03:41:28.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.406+0000 7f0d5e5a8b80 10 client.16029 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:28.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.406+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/1350468970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5572bc0cdcd0 con 0x5572bc329ec0 2024-05-10T03:41:28.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.406+0000 7f0d277fe700 1 -- 172.21.15.45:0/1350468970 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0d4000f050 con 0x5572bc329ec0 2024-05-10T03:41:28.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.406+0000 7f0d277fe700 1 -- 172.21.15.45:0/1350468970 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f0d40039080 con 0x5572bc329ec0 2024-05-10T03:41:28.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.407+0000 7f0d5e5a8b80 10 client.16029 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:28.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.407+0000 7f0d5e5a8b80 10 client.16029 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:41:28.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.407+0000 7f0d5e5a8b80 20 client.16029 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:28.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.407+0000 7f0d5e5a8b80 1 --2- 172.21.15.45:0/1350468970 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5572bc394b90 0x5572bc396fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:28.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.407+0000 7f0d5e5a8b80 4 client.16029 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-10T03:41:28.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.407+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/1350468970 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5572bc240ec0 con 0x5572bc394b90 2024-05-10T03:41:28.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.407+0000 7f0d47fff700 1 --2- 172.21.15.45:0/1350468970 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5572bc394b90 0x5572bc396fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:28.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.407+0000 7f0d277fe700 10 client.16029 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:28.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.407+0000 7f0d47fff700 1 --2- 172.21.15.45:0/1350468970 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5572bc394b90 0x5572bc396fb0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c57f5671401f9ae server_cookie=94721ad4ccb92462 in_seq=0 out_seq=0 2024-05-10T03:41:28.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.407+0000 7f0d277fe700 1 -- 172.21.15.45:0/1350468970 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5572bc240ec0 con 0x5572bc394b90 2024-05-10T03:41:28.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.407+0000 7f0d277fe700 10 client.16029 handle_command_reply: tid=0 2024-05-10T03:41:28.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.407+0000 7f0d5e5a8b80 1 client.16029 shutdown 2024-05-10T03:41:28.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.408+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/1350468970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329ec0 msgr2=0x5572bc338dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:28.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.408+0000 7f0d5e5a8b80 1 --2- 172.21.15.45:0/1350468970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329ec0 0x5572bc338dc0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0d40025000 tx=0x7f0d40015d30 comp rx=0 tx=0).stop 2024-05-10T03:41:28.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.408+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/1350468970 shutdown_connections 2024-05-10T03:41:28.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.408+0000 7f0d5e5a8b80 1 --2- 172.21.15.45:0/1350468970 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5572bc394b90 0x5572bc396fb0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.408+0000 7f0d5e5a8b80 1 --2- 172.21.15.45:0/1350468970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572bc3286a0 0x5572bc337950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.408+0000 7f0d5e5a8b80 1 --2- 172.21.15.45:0/1350468970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5572bc329ec0 0x5572bc338dc0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.408+0000 7f0d277fe700 0 client.16029 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:28.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.408+0000 7f0d5e5a8b80 1 --2- 172.21.15.45:0/1350468970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572bc329570 0x5572bc337e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.408+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/1350468970 >> 172.21.15.45:0/1350468970 conn(0x5572bc28aa60 msgr2=0x5572bc330c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:28.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.408+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/1350468970 shutdown_connections 2024-05-10T03:41:28.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.408+0000 7f0d5e5a8b80 1 -- 172.21.15.45:0/1350468970 wait complete. 2024-05-10T03:41:28.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.408+0000 7f0d5e5a8b80 20 client.16029 trim_cache size 0 max 16384 2024-05-10T03:41:28.418 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-05-10T03:41:28.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.408+0000 7f0d4e264700 1 -- 172.21.15.45:0/2796203534 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0d300a1240 msgr2=0x7f0d300a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:28.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.408+0000 7f0d4e264700 1 --2- 172.21.15.45:0/2796203534 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0d300a1240 0x7f0d300a3750 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0d4819b2a0 tx=0x7f0d3c009260 comp rx=0 tx=0).stop 2024-05-10T03:41:28.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.408+0000 7f0d4e264700 1 -- 172.21.15.45:0/2796203534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d48100ac0 msgr2=0x7f0d4819a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:28.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.408+0000 7f0d4e264700 1 --2- 172.21.15.45:0/2796203534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d48100ac0 0x7f0d4819a200 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0d38000c00 tx=0x7f0d38005b00 comp rx=0 tx=0).stop 2024-05-10T03:41:28.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.409+0000 7f0d4e264700 1 -- 172.21.15.45:0/2796203534 shutdown_connections 2024-05-10T03:41:28.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.409+0000 7f0d4e264700 1 --2- 172.21.15.45:0/2796203534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d48102580 0x7f0d481a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.409+0000 7f0d4e264700 1 --2- 172.21.15.45:0/2796203534 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0d300a1240 0x7f0d300a3750 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.409+0000 7f0d4e264700 1 --2- 172.21.15.45:0/2796203534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d48100ac0 0x7f0d4819a200 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.409+0000 7f0d4e264700 1 --2- 172.21.15.45:0/2796203534 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d48101be0 0x7f0d4819a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.409+0000 7f0d4e264700 1 -- 172.21.15.45:0/2796203534 >> 172.21.15.45:0/2796203534 conn(0x7f0d480fc0d0 msgr2=0x7f0d480fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.409+0000 7f0d4e264700 1 -- 172.21.15.45:0/2796203534 shutdown_connections 2024-05-10T03:41:28.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:28.409+0000 7f0d4e264700 1 -- 172.21.15.45:0/2796203534 wait complete. 2024-05-10T03:41:28.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:28 smithi154 ceph-mon[46565]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-05-10T03:41:28.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:28 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3538975314' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:41:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.135+0000 7f6d8726e700 1 -- 172.21.15.45:0/1865715337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d80100ac0 msgr2=0x7f6d80100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.135+0000 7f6d8726e700 1 --2- 172.21.15.45:0/1865715337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d80100ac0 0x7f6d80100ed0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c009990 tx=0x7f6d7c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.135+0000 7f6d8726e700 1 -- 172.21.15.45:0/1865715337 shutdown_connections 2024-05-10T03:41:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.135+0000 7f6d8726e700 1 --2- 172.21.15.45:0/1865715337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d80102580 0x7f6d80108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.135+0000 7f6d8726e700 1 --2- 172.21.15.45:0/1865715337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d80100ac0 0x7f6d80100ed0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.135+0000 7f6d8726e700 1 --2- 172.21.15.45:0/1865715337 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d80101be0 0x7f6d80101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.135+0000 7f6d8726e700 1 -- 172.21.15.45:0/1865715337 >> 172.21.15.45:0/1865715337 conn(0x7f6d800fc0f0 msgr2=0x7f6d800fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.135+0000 7f6d8726e700 1 -- 172.21.15.45:0/1865715337 shutdown_connections 2024-05-10T03:41:29.139 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.135+0000 7f6d8726e700 1 -- 172.21.15.45:0/1865715337 wait complete. 2024-05-10T03:41:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.136+0000 7f6d8726e700 1 Processor -- start 2024-05-10T03:41:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.136+0000 7f6d8726e700 1 -- start start 2024-05-10T03:41:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.136+0000 7f6d8726e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d80100ac0 0x7f6d80196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.142 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.136+0000 7f6d8726e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d80101be0 0x7f6d801974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.136+0000 7f6d8726e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d80102580 0x7f6d8019e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.136+0000 7f6d8726e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8019ea20 con 0x7f6d80100ac0 2024-05-10T03:41:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.136+0000 7f6d8726e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8019eb60 con 0x7f6d80102580 2024-05-10T03:41:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.136+0000 7f6d8726e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8019ecf0 con 0x7f6d80101be0 2024-05-10T03:41:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.136+0000 7f6d8500a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d80100ac0 0x7f6d80196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.136+0000 7f6d8500a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d80100ac0 0x7f6d80196f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37454/0 (socket says 172.21.15.45:37454) 2024-05-10T03:41:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.136+0000 7f6d8500a700 1 -- 172.21.15.45:0/2204266238 learned_addr learned my addr 172.21.15.45:0/2204266238 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.137+0000 7f6d8580b700 1 --2- 172.21.15.45:0/2204266238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d80102580 0x7f6d8019e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.137+0000 7f6d84809700 1 --2- 172.21.15.45:0/2204266238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d80101be0 0x7f6d801974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.137+0000 7f6d8500a700 1 -- 172.21.15.45:0/2204266238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d80101be0 msgr2=0x7f6d801974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.137+0000 7f6d8500a700 1 --2- 172.21.15.45:0/2204266238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d80101be0 0x7f6d801974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.137+0000 7f6d8500a700 1 -- 172.21.15.45:0/2204266238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d80102580 msgr2=0x7f6d8019e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.137+0000 7f6d8500a700 1 --2- 172.21.15.45:0/2204266238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d80102580 0x7f6d8019e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.143 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.137+0000 7f6d8500a700 1 -- 172.21.15.45:0/2204266238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7c0095f0 con 0x7f6d80100ac0 2024-05-10T03:41:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.137+0000 7f6d8580b700 1 --2- 172.21.15.45:0/2204266238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d80102580 0x7f6d8019e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:41:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.137+0000 7f6d8500a700 1 --2- 172.21.15.45:0/2204266238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d80100ac0 0x7f6d80196f80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c000c00 tx=0x7f6d7c005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.137+0000 7f6d767fc700 1 -- 172.21.15.45:0/2204266238 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c01f070 con 0x7f6d80100ac0 2024-05-10T03:41:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.137+0000 7f6d767fc700 1 -- 172.21.15.45:0/2204266238 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6d7c01ae00 con 0x7f6d80100ac0 2024-05-10T03:41:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.137+0000 7f6d8726e700 1 -- 172.21.15.45:0/2204266238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d80068650 con 0x7f6d80100ac0 2024-05-10T03:41:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.137+0000 7f6d767fc700 1 -- 172.21.15.45:0/2204266238 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c0247d0 con 0x7f6d80100ac0 2024-05-10T03:41:29.144 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.137+0000 7f6d8726e700 1 -- 172.21.15.45:0/2204266238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d80068b50 con 0x7f6d80100ac0 2024-05-10T03:41:29.152 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.140+0000 7f6d767fc700 1 -- 172.21.15.45:0/2204266238 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6d7c02e440 con 0x7f6d80100ac0 2024-05-10T03:41:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.141+0000 7f6d767fc700 1 --2- 172.21.15.45:0/2204266238 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6d6c0a11a0 0x7f6d6c0a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.141+0000 7f6d84809700 1 --2- 172.21.15.45:0/2204266238 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6d6c0a11a0 0x7f6d6c0a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.141+0000 7f6d767fc700 1 -- 172.21.15.45:0/2204266238 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f6d7c0d05e0 con 0x7f6d80100ac0 2024-05-10T03:41:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.141+0000 7f6d84809700 1 --2- 172.21.15.45:0/2204266238 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6d6c0a11a0 0x7f6d6c0a36b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6d70005950 tx=0x7f6d700058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.142+0000 7f6d975b2b80 1 Processor -- start 2024-05-10T03:41:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.142+0000 7f6d975b2b80 1 -- start start 2024-05-10T03:41:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.142+0000 7f6d975b2b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f5650 0x564c443f5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.142+0000 7f6d975b2b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c443f6430 0x564c443f6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.142+0000 7f6d975b2b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564c443f6d80 0x564c443fd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.142+0000 7f6d975b2b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c443180f0 con 0x564c443f5650 2024-05-10T03:41:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.142+0000 7f6d975b2b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c44315ab0 con 0x564c443f6d80 2024-05-10T03:41:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.142+0000 7f6d975b2b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c443113a0 con 0x564c443f6430 2024-05-10T03:41:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.142+0000 7f6d8500a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f5650 0x564c443f5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.142+0000 7f6d8500a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f5650 0x564c443f5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37456/0 (socket says 172.21.15.45:37456) 2024-05-10T03:41:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.142+0000 7f6d8500a700 1 -- 172.21.15.45:0/3525539493 learned_addr learned my addr 172.21.15.45:0/3525539493 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.142+0000 7f6d84809700 1 --2- 172.21.15.45:0/3525539493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c443f6430 0x564c443f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.142+0000 7f6d8580b700 1 --2- 172.21.15.45:0/3525539493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564c443f6d80 0x564c443fd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.143+0000 7f6d8500a700 1 -- 172.21.15.45:0/3525539493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c443f6430 msgr2=0x564c443f6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.143+0000 7f6d8500a700 1 --2- 172.21.15.45:0/3525539493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c443f6430 0x564c443f6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.143+0000 7f6d8500a700 1 -- 172.21.15.45:0/3525539493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564c443f6d80 msgr2=0x564c443fd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.143+0000 7f6d8500a700 1 --2- 172.21.15.45:0/3525539493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564c443f6d80 0x564c443fd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.143+0000 7f6d8500a700 1 -- 172.21.15.45:0/3525539493 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c44192350 con 0x564c443f5650 2024-05-10T03:41:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.143+0000 7f6d8580b700 1 --2- 172.21.15.45:0/3525539493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564c443f6d80 0x564c443fd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.143+0000 7f6d8500a700 1 --2- 172.21.15.45:0/3525539493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f5650 0x564c443f5a60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c09d6b0 tx=0x7f6d7c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c4a4cbe12fd42d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.143+0000 7f6d6b7fe700 1 -- 172.21.15.45:0/3525539493 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c09d260 con 0x564c443f5650 2024-05-10T03:41:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.143+0000 7f6d6b7fe700 1 -- 172.21.15.45:0/3525539493 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6d7c09d080 con 0x564c443f5650 2024-05-10T03:41:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.143+0000 7f6d6b7fe700 1 -- 172.21.15.45:0/3525539493 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c0bd170 con 0x564c443f5650 2024-05-10T03:41:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.144+0000 7f6d975b2b80 1 -- 172.21.15.45:0/3525539493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f5650 msgr2=0x564c443f5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.144+0000 7f6d975b2b80 1 --2- 172.21.15.45:0/3525539493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f5650 0x564c443f5a60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c09d6b0 tx=0x7f6d7c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.144+0000 7f6d975b2b80 1 -- 172.21.15.45:0/3525539493 shutdown_connections 2024-05-10T03:41:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.144+0000 7f6d975b2b80 1 --2- 172.21.15.45:0/3525539493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564c443f6d80 0x564c443fd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.144+0000 7f6d975b2b80 1 --2- 172.21.15.45:0/3525539493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f5650 0x564c443f5a60 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.144+0000 7f6d975b2b80 1 --2- 172.21.15.45:0/3525539493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c443f6430 0x564c443f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.144+0000 7f6d975b2b80 1 -- 172.21.15.45:0/3525539493 >> 172.21.15.45:0/3525539493 conn(0x564c44353a00 msgr2=0x564c443eba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.144+0000 7f6d975b2b80 1 -- 172.21.15.45:0/3525539493 shutdown_connections 2024-05-10T03:41:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.144+0000 7f6d975b2b80 1 -- 172.21.15.45:0/3525539493 wait complete. 2024-05-10T03:41:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.144+0000 7f6d975b2b80 1 -- start start 2024-05-10T03:41:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.144+0000 7f6d975b2b80 1 Processor -- start 2024-05-10T03:41:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.145+0000 7f6d975b2b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564c443f5650 0x564c443ff2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.145+0000 7f6d975b2b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f6430 0x564c443ff7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.145+0000 7f6d975b2b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c443f6d80 0x564c44406740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.145+0000 7f6d975b2b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c442ad500 con 0x564c443f6430 2024-05-10T03:41:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.145+0000 7f6d975b2b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c442ad1a0 con 0x564c443f5650 2024-05-10T03:41:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.145+0000 7f6d975b2b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c44194640 con 0x564c443f6d80 2024-05-10T03:41:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.145+0000 7f6d975b2b80 10 client.0 _ll_register_callbacks cb 0x564c442b6ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.145+0000 7f6d84809700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f6430 0x564c443ff7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.145+0000 7f6d84809700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f6430 0x564c443ff7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37458/0 (socket says 172.21.15.45:37458) 2024-05-10T03:41:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.145+0000 7f6d84809700 1 -- 172.21.15.45:0/2545840284 learned_addr learned my addr 172.21.15.45:0/2545840284 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.145+0000 7f6d8580b700 1 --2- 172.21.15.45:0/2545840284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c443f6d80 0x564c44406740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.145+0000 7f6d8500a700 1 --2- 172.21.15.45:0/2545840284 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564c443f5650 0x564c443ff2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.145+0000 7f6d84809700 1 -- 172.21.15.45:0/2545840284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c443f6d80 msgr2=0x564c44406740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.145+0000 7f6d84809700 1 --2- 172.21.15.45:0/2545840284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c443f6d80 0x564c44406740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.145+0000 7f6d84809700 1 -- 172.21.15.45:0/2545840284 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564c443f5650 msgr2=0x564c443ff2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.145+0000 7f6d84809700 1 --2- 172.21.15.45:0/2545840284 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564c443f5650 0x564c443ff2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.145+0000 7f6d84809700 1 -- 172.21.15.45:0/2545840284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d80068b50 con 0x564c443f6430 2024-05-10T03:41:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.145+0000 7f6d8580b700 1 --2- 172.21.15.45:0/2545840284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c443f6d80 0x564c44406740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.145+0000 7f6d8500a700 1 --2- 172.21.15.45:0/2545840284 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564c443f5650 0x564c443ff2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.146+0000 7f6d84809700 1 --2- 172.21.15.45:0/2545840284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f6430 0x564c443ff7e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6d70011520 tx=0x7f6d70004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00b54634f786318 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.146+0000 7f6d68ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:41:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.146+0000 7f6d68ff9700 1 -- 172.21.15.45:0/2545840284 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7001f840 con 0x564c443f6430 2024-05-10T03:41:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.146+0000 7f6d68ff9700 1 -- 172.21.15.45:0/2545840284 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f6d7001f9a0 con 0x564c443f6430 2024-05-10T03:41:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.146+0000 7f6d975b2b80 1 -- 172.21.15.45:0/2545840284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564c4426a210 con 0x564c443f6430 2024-05-10T03:41:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.146+0000 7f6d68ff9700 1 -- 172.21.15.45:0/2545840284 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d7001fba0 con 0x564c443f6430 2024-05-10T03:41:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.146+0000 7f6d975b2b80 10 client.16041 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.146+0000 7f6d975b2b80 1 -- 172.21.15.45:0/2545840284 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x564c4413eb00 con 0x564c443f6430 2024-05-10T03:41:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.146+0000 7f6d68ff9700 1 -- 172.21.15.45:0/2545840284 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x564c4426a210 con 0x564c443f6430 2024-05-10T03:41:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.146+0000 7f6d68ff9700 1 -- 172.21.15.45:0/2545840284 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6d7001ec80 con 0x564c443f6430 2024-05-10T03:41:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.147+0000 7f6d975b2b80 10 client.16041 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.147+0000 7f6d975b2b80 10 client.16041 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:41:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.147+0000 7f6d975b2b80 20 client.16041 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.147+0000 7f6d975b2b80 1 --2- 172.21.15.45:0/2545840284 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x564c4440af80 0x564c4440d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.147+0000 7f6d975b2b80 4 client.16041 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:41:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.147+0000 7f6d975b2b80 1 -- 172.21.15.45:0/2545840284 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564c443c0720 con 0x564c4440af80 2024-05-10T03:41:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.147+0000 7f6d8500a700 1 --2- 172.21.15.45:0/2545840284 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x564c4440af80 0x564c4440d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.147+0000 7f6d8500a700 1 --2- 172.21.15.45:0/2545840284 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x564c4440af80 0x564c4440d3d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=522e7ea18c3e9a14 server_cookie=8fb04f3a41843558 in_seq=0 out_seq=0 2024-05-10T03:41:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.147+0000 7f6d68ff9700 10 client.16041 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.148+0000 7f6d68ff9700 1 -- 172.21.15.45:0/2545840284 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564c443c0720 con 0x564c4440af80 2024-05-10T03:41:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.148+0000 7f6d68ff9700 10 client.16041 handle_command_reply: tid=0 2024-05-10T03:41:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.148+0000 7f6d975b2b80 1 client.16041 shutdown 2024-05-10T03:41:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.148+0000 7f6d975b2b80 1 -- 172.21.15.45:0/2545840284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f6430 msgr2=0x564c443ff7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.148+0000 7f6d975b2b80 1 --2- 172.21.15.45:0/2545840284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f6430 0x564c443ff7e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6d70011520 tx=0x7f6d70004750 comp rx=0 tx=0).stop 2024-05-10T03:41:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.148+0000 7f6d975b2b80 1 -- 172.21.15.45:0/2545840284 shutdown_connections 2024-05-10T03:41:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.148+0000 7f6d975b2b80 1 --2- 172.21.15.45:0/2545840284 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x564c4440af80 0x564c4440d3d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.149+0000 7f6d975b2b80 1 --2- 172.21.15.45:0/2545840284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c443f6d80 0x564c44406740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.149+0000 7f6d975b2b80 1 --2- 172.21.15.45:0/2545840284 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564c443f5650 0x564c443ff2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.149+0000 7f6d975b2b80 1 --2- 172.21.15.45:0/2545840284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f6430 0x564c443ff7e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.149+0000 7f6d68ff9700 0 client.16041 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.149+0000 7f6d975b2b80 1 -- 172.21.15.45:0/2545840284 >> 172.21.15.45:0/2545840284 conn(0x564c44353a00 msgr2=0x564c443eba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.149+0000 7f6d975b2b80 1 -- 172.21.15.45:0/2545840284 shutdown_connections 2024-05-10T03:41:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.149+0000 7f6d975b2b80 1 -- 172.21.15.45:0/2545840284 wait complete. 2024-05-10T03:41:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.149+0000 7f6d975b2b80 20 client.16041 trim_cache size 0 max 16384 2024-05-10T03:41:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.165+0000 7f6d975b2b80 1 Processor -- start 2024-05-10T03:41:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.165+0000 7f6d975b2b80 1 -- start start 2024-05-10T03:41:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.165+0000 7f6d975b2b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564c443f5650 0x564c443ff2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.165+0000 7f6d975b2b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f6430 0x564c44406700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.165+0000 7f6d975b2b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c443f6d80 0x564c443ff7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.165+0000 7f6d975b2b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c4426a210 con 0x564c443f6430 2024-05-10T03:41:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.165+0000 7f6d975b2b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c443e8920 con 0x564c443f5650 2024-05-10T03:41:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.165+0000 7f6d975b2b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c44408450 con 0x564c443f6d80 2024-05-10T03:41:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.166+0000 7f6d84809700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f6430 0x564c44406700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.166+0000 7f6d84809700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f6430 0x564c44406700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37468/0 (socket says 172.21.15.45:37468) 2024-05-10T03:41:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.166+0000 7f6d8500a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564c443f5650 0x564c443ff2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.166+0000 7f6d84809700 1 -- 172.21.15.45:0/956776423 learned_addr learned my addr 172.21.15.45:0/956776423 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.166+0000 7f6d8580b700 1 --2- 172.21.15.45:0/956776423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c443f6d80 0x564c443ff7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.166+0000 7f6d84809700 1 -- 172.21.15.45:0/956776423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c443f6d80 msgr2=0x564c443ff7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.166+0000 7f6d84809700 1 --2- 172.21.15.45:0/956776423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c443f6d80 0x564c443ff7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.166+0000 7f6d84809700 1 -- 172.21.15.45:0/956776423 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564c443f5650 msgr2=0x564c443ff2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.166+0000 7f6d84809700 1 --2- 172.21.15.45:0/956776423 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564c443f5650 0x564c443ff2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.166+0000 7f6d84809700 1 -- 172.21.15.45:0/956776423 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c442d7500 con 0x564c443f6430 2024-05-10T03:41:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.166+0000 7f6d84809700 1 --2- 172.21.15.45:0/956776423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f6430 0x564c44406700 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6d7000f970 tx=0x7f6d7000f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7337447b16067afb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.166+0000 7f6d6bfff700 1 -- 172.21.15.45:0/956776423 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7001dab0 con 0x564c443f6430 2024-05-10T03:41:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.166+0000 7f6d6bfff700 1 -- 172.21.15.45:0/956776423 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6d70011c70 con 0x564c443f6430 2024-05-10T03:41:29.171 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.166+0000 7f6d6bfff700 1 -- 172.21.15.45:0/956776423 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7001fea0 con 0x564c443f6430 2024-05-10T03:41:29.174 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.167+0000 7f6d975b2b80 1 -- 172.21.15.45:0/956776423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f6430 msgr2=0x564c44406700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.174 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.167+0000 7f6d975b2b80 1 --2- 172.21.15.45:0/956776423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f6430 0x564c44406700 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6d7000f970 tx=0x7f6d7000f770 comp rx=0 tx=0).stop 2024-05-10T03:41:29.175 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.167+0000 7f6d975b2b80 1 -- 172.21.15.45:0/956776423 shutdown_connections 2024-05-10T03:41:29.175 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.167+0000 7f6d975b2b80 1 --2- 172.21.15.45:0/956776423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c443f6d80 0x564c443ff7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.175 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.167+0000 7f6d975b2b80 1 --2- 172.21.15.45:0/956776423 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564c443f5650 0x564c443ff2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.175 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.167+0000 7f6d975b2b80 1 --2- 172.21.15.45:0/956776423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f6430 0x564c44406700 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.175 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.167+0000 7f6d975b2b80 1 -- 172.21.15.45:0/956776423 >> 172.21.15.45:0/956776423 conn(0x564c44353a00 msgr2=0x564c443f9660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:29.175 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.167+0000 7f6d975b2b80 1 -- 172.21.15.45:0/956776423 shutdown_connections 2024-05-10T03:41:29.175 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.167+0000 7f6d975b2b80 1 -- 172.21.15.45:0/956776423 wait complete. 2024-05-10T03:41:29.175 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.168+0000 7f6d975b2b80 1 -- start start 2024-05-10T03:41:29.175 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.168+0000 7f6d975b2b80 1 Processor -- start 2024-05-10T03:41:29.175 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.168+0000 7f6d975b2b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c443f5650 0x564c444041b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.175 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.168+0000 7f6d975b2b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564c443f6430 0x564c444046f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.175 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.169+0000 7f6d975b2b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f6d80 0x564c44405620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.175 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.169+0000 7f6d975b2b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c44405b60 con 0x564c443f6d80 2024-05-10T03:41:29.176 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.169+0000 7f6d975b2b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c44405cd0 con 0x564c443f6430 2024-05-10T03:41:29.176 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.169+0000 7f6d975b2b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c44405e90 con 0x564c443f5650 2024-05-10T03:41:29.176 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.169+0000 7f6d975b2b80 10 client.0 _ll_register_callbacks cb 0x564c442b6ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:29.176 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.169+0000 7f6d8580b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f6d80 0x564c44405620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.176 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.169+0000 7f6d8580b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f6d80 0x564c44405620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37470/0 (socket says 172.21.15.45:37470) 2024-05-10T03:41:29.176 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.169+0000 7f6d8580b700 1 -- 172.21.15.45:0/1222086786 learned_addr learned my addr 172.21.15.45:0/1222086786 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:29.176 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.169+0000 7f6d84809700 1 --2- 172.21.15.45:0/1222086786 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564c443f6430 0x564c444046f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.176 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.169+0000 7f6d8500a700 1 --2- 172.21.15.45:0/1222086786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c443f5650 0x564c444041b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.176 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.169+0000 7f6d8580b700 1 -- 172.21.15.45:0/1222086786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c443f5650 msgr2=0x564c444041b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:29.176 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.169+0000 7f6d8580b700 1 --2- 172.21.15.45:0/1222086786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c443f5650 0x564c444041b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.176 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.169+0000 7f6d8580b700 1 -- 172.21.15.45:0/1222086786 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564c443f6430 msgr2=0x564c444046f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:29.176 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.169+0000 7f6d8580b700 1 --2- 172.21.15.45:0/1222086786 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564c443f6430 0x564c444046f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.177 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.169+0000 7f6d8580b700 1 -- 172.21.15.45:0/1222086786 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564c4413eb00 con 0x564c443f6d80 2024-05-10T03:41:29.177 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.169+0000 7f6d8580b700 1 --2- 172.21.15.45:0/1222086786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f6d80 0x564c44405620 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6d78007f00 tx=0x7f6d78007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814089da6334b723 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:29.177 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.169+0000 7f6d68ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:41:29.177 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.169+0000 7f6d68ff9700 1 -- 172.21.15.45:0/1222086786 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78015b50 con 0x564c443f6d80 2024-05-10T03:41:29.177 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.170+0000 7f6d68ff9700 1 -- 172.21.15.45:0/1222086786 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f6d78015cb0 con 0x564c443f6d80 2024-05-10T03:41:29.177 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.170+0000 7f6d975b2b80 1 -- 172.21.15.45:0/1222086786 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6d7c09d080 con 0x564c443f6d80 2024-05-10T03:41:29.177 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.170+0000 7f6d68ff9700 1 -- 172.21.15.45:0/1222086786 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d780093e0 con 0x564c443f6d80 2024-05-10T03:41:29.177 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.170+0000 7f6d975b2b80 10 client.16047 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:29.177 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.170+0000 7f6d975b2b80 1 -- 172.21.15.45:0/1222086786 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x564c44196c70 con 0x564c443f6d80 2024-05-10T03:41:29.177 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.170+0000 7f6d68ff9700 1 -- 172.21.15.45:0/1222086786 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6d7c09d080 con 0x564c443f6d80 2024-05-10T03:41:29.177 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.170+0000 7f6d68ff9700 1 -- 172.21.15.45:0/1222086786 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6d780175b0 con 0x564c443f6d80 2024-05-10T03:41:29.178 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.170+0000 7f6d975b2b80 10 client.16047 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:29.178 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.170+0000 7f6d975b2b80 10 client.16047 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:41:29.178 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.170+0000 7f6d975b2b80 20 client.16047 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:29.178 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.170+0000 7f6d975b2b80 1 --2- 172.21.15.45:0/1222086786 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x564c444620b0 0x564c444644d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.178 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.170+0000 7f6d975b2b80 4 client.16047 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T03:41:29.178 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.170+0000 7f6d975b2b80 1 -- 172.21.15.45:0/1222086786 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564c44309e60 con 0x564c444620b0 2024-05-10T03:41:29.178 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.170+0000 7f6d8500a700 1 --2- 172.21.15.45:0/1222086786 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x564c444620b0 0x564c444644d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.178 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.171+0000 7f6d8500a700 1 --2- 172.21.15.45:0/1222086786 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x564c444620b0 0x564c444644d0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a57108f82a463694 server_cookie=d3953f10886d15ca in_seq=0 out_seq=0 2024-05-10T03:41:29.178 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.171+0000 7f6d68ff9700 10 client.16047 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:29.181 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.177+0000 7f6d68ff9700 1 -- 172.21.15.45:0/1222086786 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564c44309e60 con 0x564c444620b0 2024-05-10T03:41:29.181 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.177+0000 7f6d68ff9700 10 client.16047 handle_command_reply: tid=0 2024-05-10T03:41:29.181 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.177+0000 7f6d975b2b80 1 client.16047 shutdown 2024-05-10T03:41:29.181 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.177+0000 7f6d975b2b80 1 -- 172.21.15.45:0/1222086786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f6d80 msgr2=0x564c44405620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.181 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.177+0000 7f6d975b2b80 1 --2- 172.21.15.45:0/1222086786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f6d80 0x564c44405620 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6d78007f00 tx=0x7f6d78007f30 comp rx=0 tx=0).stop 2024-05-10T03:41:29.182 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.177+0000 7f6d975b2b80 1 -- 172.21.15.45:0/1222086786 shutdown_connections 2024-05-10T03:41:29.182 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.177+0000 7f6d975b2b80 1 --2- 172.21.15.45:0/1222086786 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x564c444620b0 0x564c444644d0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.182 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.177+0000 7f6d975b2b80 1 --2- 172.21.15.45:0/1222086786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564c443f5650 0x564c444041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.182 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.177+0000 7f6d975b2b80 1 --2- 172.21.15.45:0/1222086786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564c443f6d80 0x564c44405620 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.182 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.177+0000 7f6d975b2b80 1 --2- 172.21.15.45:0/1222086786 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564c443f6430 0x564c444046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.182 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.177+0000 7f6d68ff9700 0 client.16047 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:29.182 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.177+0000 7f6d975b2b80 1 -- 172.21.15.45:0/1222086786 >> 172.21.15.45:0/1222086786 conn(0x564c44353a00 msgr2=0x564c443fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:29.182 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.178+0000 7f6d975b2b80 1 -- 172.21.15.45:0/1222086786 shutdown_connections 2024-05-10T03:41:29.182 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.178+0000 7f6d975b2b80 1 -- 172.21.15.45:0/1222086786 wait complete. 2024-05-10T03:41:29.182 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.178+0000 7f6d975b2b80 20 client.16047 trim_cache size 0 max 16384 2024-05-10T03:41:29.183 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:{ 2024-05-10T03:41:29.183 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "message": "", 2024-05-10T03:41:29.183 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "return_code": 0 2024-05-10T03:41:29.183 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:} 2024-05-10T03:41:29.184 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.178+0000 7f6d8726e700 1 -- 172.21.15.45:0/2204266238 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6d6c0a11a0 msgr2=0x7f6d6c0a36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.184 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.178+0000 7f6d8726e700 1 --2- 172.21.15.45:0/2204266238 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6d6c0a11a0 0x7f6d6c0a36b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6d70005950 tx=0x7f6d700058e0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.184 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.178+0000 7f6d8726e700 1 -- 172.21.15.45:0/2204266238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d80100ac0 msgr2=0x7f6d80196f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.184 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.178+0000 7f6d8726e700 1 --2- 172.21.15.45:0/2204266238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d80100ac0 0x7f6d80196f80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c000c00 tx=0x7f6d7c005b00 comp rx=0 tx=0).stop 2024-05-10T03:41:29.184 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.178+0000 7f6d8726e700 1 -- 172.21.15.45:0/2204266238 shutdown_connections 2024-05-10T03:41:29.184 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.178+0000 7f6d8726e700 1 --2- 172.21.15.45:0/2204266238 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6d6c0a11a0 0x7f6d6c0a36b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.184 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.178+0000 7f6d8726e700 1 --2- 172.21.15.45:0/2204266238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d80102580 0x7f6d8019e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.184 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.178+0000 7f6d8726e700 1 --2- 172.21.15.45:0/2204266238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d80100ac0 0x7f6d80196f80 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.184 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.178+0000 7f6d8726e700 1 --2- 172.21.15.45:0/2204266238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d80101be0 0x7f6d801974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.184 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.178+0000 7f6d8726e700 1 -- 172.21.15.45:0/2204266238 >> 172.21.15.45:0/2204266238 conn(0x7f6d800fc0f0 msgr2=0x7f6d80104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:29.185 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.179+0000 7f6d8726e700 1 -- 172.21.15.45:0/2204266238 shutdown_connections 2024-05-10T03:41:29.185 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:29.179+0000 7f6d8726e700 1 -- 172.21.15.45:0/2204266238 wait complete. 2024-05-10T03:41:29.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:29 smithi106 ceph-mon[46996]: pgmap v321: 129 pgs: 129 active+clean; 671 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:41:29.426 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-10T03:41:29.427 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-10T03:41:29.458 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:29 smithi045 ceph-mon[42520]: pgmap v321: 129 pgs: 129 active+clean; 671 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:41:29.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:29 smithi154 ceph-mon[46565]: pgmap v321: 129 pgs: 129 active+clean; 671 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:41:29.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.586+0000 7f7a97652700 1 -- 172.21.15.45:0/3492515932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a901031a0 msgr2=0x7f7a901035b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.586+0000 7f7a97652700 1 --2- 172.21.15.45:0/3492515932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a901031a0 0x7f7a901035b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c009990 tx=0x7f7a8c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.586+0000 7f7a97652700 1 -- 172.21.15.45:0/3492515932 shutdown_connections 2024-05-10T03:41:29.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.586+0000 7f7a97652700 1 --2- 172.21.15.45:0/3492515932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a90100530 0x7f7a9010a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.586+0000 7f7a97652700 1 --2- 172.21.15.45:0/3492515932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a901031a0 0x7f7a901035b0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.586+0000 7f7a97652700 1 --2- 172.21.15.45:0/3492515932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a900ffbe0 0x7f7a900ffff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.586+0000 7f7a97652700 1 -- 172.21.15.45:0/3492515932 >> 172.21.15.45:0/3492515932 conn(0x7f7a900fb8b0 msgr2=0x7f7a900fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:29.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.586+0000 7f7a97652700 1 -- 172.21.15.45:0/3492515932 shutdown_connections 2024-05-10T03:41:29.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.586+0000 7f7a97652700 1 -- 172.21.15.45:0/3492515932 wait complete. 2024-05-10T03:41:29.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.587+0000 7f7a97652700 1 Processor -- start 2024-05-10T03:41:29.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.587+0000 7f7a97652700 1 -- start start 2024-05-10T03:41:29.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.587+0000 7f7a97652700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a900ffbe0 0x7f7a90197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.587+0000 7f7a97652700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a90100530 0x7f7a901984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.587+0000 7f7a97652700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a901031a0 0x7f7a9019f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.587+0000 7f7a97652700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9019fa70 con 0x7f7a901031a0 2024-05-10T03:41:29.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.587+0000 7f7a97652700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9019fbe0 con 0x7f7a900ffbe0 2024-05-10T03:41:29.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.587+0000 7f7a97652700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9019fda0 con 0x7f7a90100530 2024-05-10T03:41:29.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.588+0000 7f7a953ee700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a900ffbe0 0x7f7a90197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.588+0000 7f7a95bef700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a901031a0 0x7f7a9019f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.588+0000 7f7a953ee700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a900ffbe0 0x7f7a90197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.45:41430/0 (socket says 172.21.15.45:41430) 2024-05-10T03:41:29.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.588+0000 7f7a95bef700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a901031a0 0x7f7a9019f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37488/0 (socket says 172.21.15.45:37488) 2024-05-10T03:41:29.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.588+0000 7f7a953ee700 1 -- 172.21.15.45:0/1676990399 learned_addr learned my addr 172.21.15.45:0/1676990399 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:29.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.588+0000 7f7a94bed700 1 --2- 172.21.15.45:0/1676990399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a90100530 0x7f7a901984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.588+0000 7f7a953ee700 1 -- 172.21.15.45:0/1676990399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a90100530 msgr2=0x7f7a901984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.588+0000 7f7a953ee700 1 --2- 172.21.15.45:0/1676990399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a90100530 0x7f7a901984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.588+0000 7f7a953ee700 1 -- 172.21.15.45:0/1676990399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a901031a0 msgr2=0x7f7a9019f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.588+0000 7f7a953ee700 1 --2- 172.21.15.45:0/1676990399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a901031a0 0x7f7a9019f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.588+0000 7f7a953ee700 1 -- 172.21.15.45:0/1676990399 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c0095f0 con 0x7f7a900ffbe0 2024-05-10T03:41:29.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.588+0000 7f7a95bef700 1 --2- 172.21.15.45:0/1676990399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a901031a0 0x7f7a9019f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:41:29.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.588+0000 7f7a953ee700 1 --2- 172.21.15.45:0/1676990399 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a900ffbe0 0x7f7a90197f90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c0098e0 tx=0x7f7a8c005b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:29.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.588+0000 7f7a867fc700 1 -- 172.21.15.45:0/1676990399 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c01d070 con 0x7f7a900ffbe0 2024-05-10T03:41:29.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.588+0000 7f7a97652700 1 -- 172.21.15.45:0/1676990399 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a901a0020 con 0x7f7a900ffbe0 2024-05-10T03:41:29.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.588+0000 7f7a867fc700 1 -- 172.21.15.45:0/1676990399 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7a8c00be40 con 0x7f7a900ffbe0 2024-05-10T03:41:29.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.588+0000 7f7a867fc700 1 -- 172.21.15.45:0/1676990399 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c0173f0 con 0x7f7a900ffbe0 2024-05-10T03:41:29.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.589+0000 7f7a97652700 1 -- 172.21.15.45:0/1676990399 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a901a0440 con 0x7f7a900ffbe0 2024-05-10T03:41:29.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.591+0000 7f7a867fc700 1 -- 172.21.15.45:0/1676990399 <== mon.2 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7a8c021410 con 0x7f7a900ffbe0 2024-05-10T03:41:29.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.592+0000 7f7a867fc700 1 --2- 172.21.15.45:0/1676990399 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7a7c0a11c0 0x7f7a7c0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.592+0000 7f7a867fc700 1 -- 172.21.15.45:0/1676990399 <== mon.2 v2:172.21.15.106:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7a8c0cdcc0 con 0x7f7a900ffbe0 2024-05-10T03:41:29.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.592+0000 7f7a94bed700 1 --2- 172.21.15.45:0/1676990399 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7a7c0a11c0 0x7f7a7c0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.592+0000 7f7a94bed700 1 --2- 172.21.15.45:0/1676990399 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7a7c0a11c0 0x7f7a7c0a36d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7a90199030 tx=0x7f7a80009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.592+0000 7f7aa7996b80 1 Processor -- start 2024-05-10T03:41:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.593+0000 7f7aa7996b80 1 -- start start 2024-05-10T03:41:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.593+0000 7f7aa7996b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a3a60fb30 0x564a3a60ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.593+0000 7f7aa7996b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a3a610a00 0x564a3a610e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.593+0000 7f7aa7996b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a611350 0x564a3a617c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.593+0000 7f7aa7996b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a3a5321d0 con 0x564a3a611350 2024-05-10T03:41:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.593+0000 7f7aa7996b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a3a52fb90 con 0x564a3a60fb30 2024-05-10T03:41:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.593+0000 7f7aa7996b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a3a52b480 con 0x564a3a610a00 2024-05-10T03:41:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.593+0000 7f7a95bef700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a611350 0x564a3a617c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.593+0000 7f7a95bef700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a611350 0x564a3a617c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37492/0 (socket says 172.21.15.45:37492) 2024-05-10T03:41:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.593+0000 7f7a95bef700 1 -- 172.21.15.45:0/2256622932 learned_addr learned my addr 172.21.15.45:0/2256622932 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.593+0000 7f7a94bed700 1 --2- 172.21.15.45:0/2256622932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a3a610a00 0x564a3a610e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.593+0000 7f7a953ee700 1 --2- 172.21.15.45:0/2256622932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a3a60fb30 0x564a3a60ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.593+0000 7f7a95bef700 1 -- 172.21.15.45:0/2256622932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a3a610a00 msgr2=0x564a3a610e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:29.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.593+0000 7f7a95bef700 1 --2- 172.21.15.45:0/2256622932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a3a610a00 0x564a3a610e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.593+0000 7f7a95bef700 1 -- 172.21.15.45:0/2256622932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a3a60fb30 msgr2=0x564a3a60ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:29.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.593+0000 7f7a95bef700 1 --2- 172.21.15.45:0/2256622932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a3a60fb30 0x564a3a60ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.593+0000 7f7a95bef700 1 -- 172.21.15.45:0/2256622932 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a3a3ac430 con 0x564a3a611350 2024-05-10T03:41:29.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.594+0000 7f7a95bef700 1 --2- 172.21.15.45:0/2256622932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a611350 0x564a3a617c50 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7a88003eb0 tx=0x7f7a88009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbb81cec1a2df26 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:29.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.594+0000 7f7a7b7fe700 1 -- 172.21.15.45:0/2256622932 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a880092d0 con 0x564a3a611350 2024-05-10T03:41:29.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.594+0000 7f7a7b7fe700 1 -- 172.21.15.45:0/2256622932 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7a8800f040 con 0x564a3a611350 2024-05-10T03:41:29.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.594+0000 7f7a7b7fe700 1 -- 172.21.15.45:0/2256622932 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8800e890 con 0x564a3a611350 2024-05-10T03:41:29.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.595+0000 7f7aa7996b80 1 -- 172.21.15.45:0/2256622932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a611350 msgr2=0x564a3a617c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.595+0000 7f7aa7996b80 1 --2- 172.21.15.45:0/2256622932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a611350 0x564a3a617c50 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7a88003eb0 tx=0x7f7a88009920 comp rx=0 tx=0).stop 2024-05-10T03:41:29.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.595+0000 7f7aa7996b80 1 -- 172.21.15.45:0/2256622932 shutdown_connections 2024-05-10T03:41:29.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.595+0000 7f7aa7996b80 1 --2- 172.21.15.45:0/2256622932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a611350 0x564a3a617c50 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.595+0000 7f7aa7996b80 1 --2- 172.21.15.45:0/2256622932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a3a60fb30 0x564a3a60ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.595+0000 7f7aa7996b80 1 --2- 172.21.15.45:0/2256622932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a3a610a00 0x564a3a610e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.595+0000 7f7aa7996b80 1 -- 172.21.15.45:0/2256622932 >> 172.21.15.45:0/2256622932 conn(0x564a3a56dae0 msgr2=0x564a3a606060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:29.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.595+0000 7f7aa7996b80 1 -- 172.21.15.45:0/2256622932 shutdown_connections 2024-05-10T03:41:29.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.595+0000 7f7aa7996b80 1 -- 172.21.15.45:0/2256622932 wait complete. 2024-05-10T03:41:29.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.595+0000 7f7aa7996b80 1 -- start start 2024-05-10T03:41:29.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.595+0000 7f7aa7996b80 1 Processor -- start 2024-05-10T03:41:29.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.596+0000 7f7aa7996b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a60fb30 0x564a3a619b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.596+0000 7f7aa7996b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a3a610a00 0x564a3a61a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.596+0000 7f7aa7996b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a3a611350 0x564a3a620fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.596+0000 7f7aa7996b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a3a4c75e0 con 0x564a3a60fb30 2024-05-10T03:41:29.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.596+0000 7f7aa7996b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a3a4c7280 con 0x564a3a611350 2024-05-10T03:41:29.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.596+0000 7f7aa7996b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a3a3ae720 con 0x564a3a610a00 2024-05-10T03:41:29.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.596+0000 7f7aa7996b80 10 client.0 _ll_register_callbacks cb 0x564a3a4d0bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:29.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.596+0000 7f7a953ee700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a60fb30 0x564a3a619b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.596+0000 7f7a953ee700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a60fb30 0x564a3a619b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37494/0 (socket says 172.21.15.45:37494) 2024-05-10T03:41:29.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.596+0000 7f7a953ee700 1 -- 172.21.15.45:0/2828930258 learned_addr learned my addr 172.21.15.45:0/2828930258 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:29.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.596+0000 7f7a94bed700 1 --2- 172.21.15.45:0/2828930258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a3a610a00 0x564a3a61a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.596+0000 7f7a95bef700 1 --2- 172.21.15.45:0/2828930258 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a3a611350 0x564a3a620fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.596+0000 7f7a953ee700 1 -- 172.21.15.45:0/2828930258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a3a610a00 msgr2=0x564a3a61a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:29.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.596+0000 7f7a953ee700 1 --2- 172.21.15.45:0/2828930258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a3a610a00 0x564a3a61a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.596+0000 7f7a953ee700 1 -- 172.21.15.45:0/2828930258 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a3a611350 msgr2=0x564a3a620fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:29.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.596+0000 7f7a953ee700 1 --2- 172.21.15.45:0/2828930258 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a3a611350 0x564a3a620fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.596+0000 7f7a953ee700 1 -- 172.21.15.45:0/2828930258 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a88003b90 con 0x564a3a60fb30 2024-05-10T03:41:29.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.596+0000 7f7a94bed700 1 --2- 172.21.15.45:0/2828930258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a3a610a00 0x564a3a61a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:29.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.596+0000 7f7a953ee700 1 --2- 172.21.15.45:0/2828930258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a60fb30 0x564a3a619b00 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c0cb470 tx=0x7f7a8c09a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af81911008cb84b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:29.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.596+0000 7f7a78ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:41:29.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.597+0000 7f7a78ff9700 1 -- 172.21.15.45:0/2828930258 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c09ec30 con 0x564a3a60fb30 2024-05-10T03:41:29.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.597+0000 7f7a78ff9700 1 -- 172.21.15.45:0/2828930258 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7a8c0a31f0 con 0x564a3a60fb30 2024-05-10T03:41:29.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.597+0000 7f7aa7996b80 1 -- 172.21.15.45:0/2828930258 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a3a4842f0 con 0x564a3a60fb30 2024-05-10T03:41:29.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.597+0000 7f7a78ff9700 1 -- 172.21.15.45:0/2828930258 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a8c09a2f0 con 0x564a3a60fb30 2024-05-10T03:41:29.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.597+0000 7f7aa7996b80 10 client.16059 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:29.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.597+0000 7f7aa7996b80 1 -- 172.21.15.45:0/2828930258 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x564a3a358be0 con 0x564a3a60fb30 2024-05-10T03:41:29.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.597+0000 7f7a78ff9700 1 -- 172.21.15.45:0/2828930258 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7a8c0b7020 con 0x564a3a60fb30 2024-05-10T03:41:29.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.597+0000 7f7a78ff9700 1 -- 172.21.15.45:0/2828930258 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7a8c09fb50 con 0x564a3a60fb30 2024-05-10T03:41:29.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.597+0000 7f7aa7996b80 10 client.16059 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:29.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.597+0000 7f7aa7996b80 10 client.16059 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:41:29.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.597+0000 7f7aa7996b80 20 client.16059 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:29.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.597+0000 7f7aa7996b80 1 --2- 172.21.15.45:0/2828930258 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x564a3a625340 0x564a3a627760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.597+0000 7f7aa7996b80 4 client.16059 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:41:29.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.597+0000 7f7aa7996b80 1 -- 172.21.15.45:0/2828930258 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a3a5da800 con 0x564a3a625340 2024-05-10T03:41:29.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.598+0000 7f7a94bed700 1 --2- 172.21.15.45:0/2828930258 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x564a3a625340 0x564a3a627760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.598+0000 7f7a78ff9700 10 client.16059 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:29.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.598+0000 7f7a94bed700 1 --2- 172.21.15.45:0/2828930258 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x564a3a625340 0x564a3a627760 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4114ace864aa4cc server_cookie=e822f79afed3a40e in_seq=0 out_seq=0 2024-05-10T03:41:29.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.599+0000 7f7a78ff9700 1 -- 172.21.15.45:0/2828930258 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564a3a5da800 con 0x564a3a625340 2024-05-10T03:41:29.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.599+0000 7f7a78ff9700 10 client.16059 handle_command_reply: tid=0 2024-05-10T03:41:29.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.599+0000 7f7aa7996b80 1 client.16059 shutdown 2024-05-10T03:41:29.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.599+0000 7f7aa7996b80 1 -- 172.21.15.45:0/2828930258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a60fb30 msgr2=0x564a3a619b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.599+0000 7f7aa7996b80 1 --2- 172.21.15.45:0/2828930258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a60fb30 0x564a3a619b00 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c0cb470 tx=0x7f7a8c09a890 comp rx=0 tx=0).stop 2024-05-10T03:41:29.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.599+0000 7f7aa7996b80 1 -- 172.21.15.45:0/2828930258 shutdown_connections 2024-05-10T03:41:29.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.599+0000 7f7aa7996b80 1 --2- 172.21.15.45:0/2828930258 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x564a3a625340 0x564a3a627760 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.599+0000 7f7aa7996b80 1 --2- 172.21.15.45:0/2828930258 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a3a611350 0x564a3a620fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.599+0000 7f7a78ff9700 0 client.16059 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:29.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.599+0000 7f7aa7996b80 1 --2- 172.21.15.45:0/2828930258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a60fb30 0x564a3a619b00 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.599+0000 7f7aa7996b80 1 --2- 172.21.15.45:0/2828930258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a3a610a00 0x564a3a61a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.599+0000 7f7aa7996b80 1 -- 172.21.15.45:0/2828930258 >> 172.21.15.45:0/2828930258 conn(0x564a3a56dae0 msgr2=0x564a3a606030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:29.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.599+0000 7f7aa7996b80 1 -- 172.21.15.45:0/2828930258 shutdown_connections 2024-05-10T03:41:29.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.599+0000 7f7aa7996b80 1 -- 172.21.15.45:0/2828930258 wait complete. 2024-05-10T03:41:29.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.599+0000 7f7aa7996b80 20 client.16059 trim_cache size 0 max 16384 2024-05-10T03:41:29.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.618+0000 7f7aa7996b80 1 Processor -- start 2024-05-10T03:41:29.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.618+0000 7f7aa7996b80 1 -- start start 2024-05-10T03:41:29.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.618+0000 7f7aa7996b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a3a60fb30 0x564a3a618190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.618+0000 7f7aa7996b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a3a610a00 0x564a3a620f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.618+0000 7f7aa7996b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a611350 0x564a3a6186d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.618+0000 7f7aa7996b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a3a602db0 con 0x564a3a611350 2024-05-10T03:41:29.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.618+0000 7f7aa7996b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a3a6077f0 con 0x564a3a60fb30 2024-05-10T03:41:29.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.618+0000 7f7aa7996b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a3a600840 con 0x564a3a610a00 2024-05-10T03:41:29.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.618+0000 7f7a95bef700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a611350 0x564a3a6186d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.618+0000 7f7a95bef700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a611350 0x564a3a6186d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37508/0 (socket says 172.21.15.45:37508) 2024-05-10T03:41:29.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.618+0000 7f7a95bef700 1 -- 172.21.15.45:0/126020263 learned_addr learned my addr 172.21.15.45:0/126020263 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:29.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.619+0000 7f7a953ee700 1 --2- 172.21.15.45:0/126020263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a3a60fb30 0x564a3a618190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.619+0000 7f7a94bed700 1 --2- 172.21.15.45:0/126020263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a3a610a00 0x564a3a620f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.619+0000 7f7a95bef700 1 -- 172.21.15.45:0/126020263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a3a610a00 msgr2=0x564a3a620f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:29.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.619+0000 7f7a95bef700 1 --2- 172.21.15.45:0/126020263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a3a610a00 0x564a3a620f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.619+0000 7f7a95bef700 1 -- 172.21.15.45:0/126020263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a3a60fb30 msgr2=0x564a3a618190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:29.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.619+0000 7f7a95bef700 1 --2- 172.21.15.45:0/126020263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a3a60fb30 0x564a3a618190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.619+0000 7f7a95bef700 1 -- 172.21.15.45:0/126020263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a3a606300 con 0x564a3a611350 2024-05-10T03:41:29.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.619+0000 7f7a94bed700 1 --2- 172.21.15.45:0/126020263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a3a610a00 0x564a3a620f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:29.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.619+0000 7f7a95bef700 1 --2- 172.21.15.45:0/126020263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a611350 0x564a3a6186d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7a88003e80 tx=0x7f7a88006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69467e82811f0d74 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:29.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.619+0000 7f7a7bfff700 1 -- 172.21.15.45:0/126020263 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a880092d0 con 0x564a3a611350 2024-05-10T03:41:29.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.619+0000 7f7a7bfff700 1 -- 172.21.15.45:0/126020263 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7a880079e0 con 0x564a3a611350 2024-05-10T03:41:29.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.619+0000 7f7a7bfff700 1 -- 172.21.15.45:0/126020263 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8800ec70 con 0x564a3a611350 2024-05-10T03:41:29.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.620+0000 7f7aa7996b80 1 -- 172.21.15.45:0/126020263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a611350 msgr2=0x564a3a6186d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.620+0000 7f7aa7996b80 1 --2- 172.21.15.45:0/126020263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a611350 0x564a3a6186d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7a88003e80 tx=0x7f7a88006000 comp rx=0 tx=0).stop 2024-05-10T03:41:29.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.620+0000 7f7aa7996b80 1 -- 172.21.15.45:0/126020263 shutdown_connections 2024-05-10T03:41:29.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.620+0000 7f7aa7996b80 1 --2- 172.21.15.45:0/126020263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a611350 0x564a3a6186d0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.620+0000 7f7aa7996b80 1 --2- 172.21.15.45:0/126020263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a3a60fb30 0x564a3a618190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.620+0000 7f7aa7996b80 1 --2- 172.21.15.45:0/126020263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a3a610a00 0x564a3a620f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.620+0000 7f7aa7996b80 1 -- 172.21.15.45:0/126020263 >> 172.21.15.45:0/126020263 conn(0x564a3a56dae0 msgr2=0x564a3a613c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:29.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.620+0000 7f7aa7996b80 1 -- 172.21.15.45:0/126020263 shutdown_connections 2024-05-10T03:41:29.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.620+0000 7f7aa7996b80 1 -- 172.21.15.45:0/126020263 wait complete. 2024-05-10T03:41:29.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.620+0000 7f7aa7996b80 1 -- start start 2024-05-10T03:41:29.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.621+0000 7f7aa7996b80 1 Processor -- start 2024-05-10T03:41:29.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.621+0000 7f7aa7996b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a3a60fb30 0x564a3a620ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.621+0000 7f7aa7996b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a610a00 0x564a3a61f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.621+0000 7f7aa7996b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a3a611350 0x564a3a61f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.621+0000 7f7aa7996b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a3a61fd90 con 0x564a3a610a00 2024-05-10T03:41:29.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.621+0000 7f7aa7996b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a3a61ff00 con 0x564a3a60fb30 2024-05-10T03:41:29.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.621+0000 7f7aa7996b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a3a620070 con 0x564a3a611350 2024-05-10T03:41:29.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.621+0000 7f7aa7996b80 10 client.0 _ll_register_callbacks cb 0x564a3a4d0bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:29.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.621+0000 7f7a94bed700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a610a00 0x564a3a61f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.621+0000 7f7a94bed700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a610a00 0x564a3a61f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37514/0 (socket says 172.21.15.45:37514) 2024-05-10T03:41:29.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.621+0000 7f7a94bed700 1 -- 172.21.15.45:0/3970146049 learned_addr learned my addr 172.21.15.45:0/3970146049 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:29.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.621+0000 7f7a95bef700 1 --2- 172.21.15.45:0/3970146049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a3a611350 0x564a3a61f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.621+0000 7f7a953ee700 1 --2- 172.21.15.45:0/3970146049 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a3a60fb30 0x564a3a620ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.621+0000 7f7a94bed700 1 -- 172.21.15.45:0/3970146049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a3a611350 msgr2=0x564a3a61f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:29.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.621+0000 7f7a94bed700 1 --2- 172.21.15.45:0/3970146049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a3a611350 0x564a3a61f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.621+0000 7f7a94bed700 1 -- 172.21.15.45:0/3970146049 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a3a60fb30 msgr2=0x564a3a620ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:29.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.621+0000 7f7a94bed700 1 --2- 172.21.15.45:0/3970146049 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a3a60fb30 0x564a3a620ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.622+0000 7f7a94bed700 1 -- 172.21.15.45:0/3970146049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a3a3ac430 con 0x564a3a610a00 2024-05-10T03:41:29.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.622+0000 7f7a94bed700 1 --2- 172.21.15.45:0/3970146049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a610a00 0x564a3a61f310 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7a800097c0 tx=0x7f7a800047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751dd886a06f2ac1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:29.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.622+0000 7f7a78ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:41:29.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.622+0000 7f7a78ff9700 1 -- 172.21.15.45:0/3970146049 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a80004e90 con 0x564a3a610a00 2024-05-10T03:41:29.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.622+0000 7f7aa7996b80 1 -- 172.21.15.45:0/3970146049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7a8800f040 con 0x564a3a610a00 2024-05-10T03:41:29.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.622+0000 7f7a78ff9700 1 -- 172.21.15.45:0/3970146049 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7a80029420 con 0x564a3a610a00 2024-05-10T03:41:29.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.622+0000 7f7a78ff9700 1 -- 172.21.15.45:0/3970146049 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a800295e0 con 0x564a3a610a00 2024-05-10T03:41:29.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.622+0000 7f7aa7996b80 10 client.16065 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:29.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.622+0000 7f7aa7996b80 1 -- 172.21.15.45:0/3970146049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x564a3a4f15e0 con 0x564a3a610a00 2024-05-10T03:41:29.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.622+0000 7f7a78ff9700 1 -- 172.21.15.45:0/3970146049 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7a8800f040 con 0x564a3a610a00 2024-05-10T03:41:29.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.623+0000 7f7a78ff9700 1 -- 172.21.15.45:0/3970146049 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7a800038e0 con 0x564a3a610a00 2024-05-10T03:41:29.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.623+0000 7f7aa7996b80 10 client.16065 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:29.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.623+0000 7f7aa7996b80 10 client.16065 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:41:29.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.623+0000 7f7aa7996b80 20 client.16065 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:29.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.623+0000 7f7aa7996b80 1 --2- 172.21.15.45:0/3970146049 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x564a3a67cf50 0x564a3a67f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.623+0000 7f7aa7996b80 4 client.16065 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-10T03:41:29.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.623+0000 7f7aa7996b80 1 -- 172.21.15.45:0/3970146049 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x564a3a523f40 con 0x564a3a67cf50 2024-05-10T03:41:29.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.623+0000 7f7a953ee700 1 --2- 172.21.15.45:0/3970146049 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x564a3a67cf50 0x564a3a67f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.623+0000 7f7a953ee700 1 --2- 172.21.15.45:0/3970146049 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x564a3a67cf50 0x564a3a67f370 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49f6cb26ab4cbf18 server_cookie=a72692378dfb6330 in_seq=0 out_seq=0 2024-05-10T03:41:29.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.623+0000 7f7a78ff9700 10 client.16065 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:29.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.624+0000 7f7a78ff9700 1 -- 172.21.15.45:0/3970146049 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x564a3a523f40 con 0x564a3a67cf50 2024-05-10T03:41:29.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.624+0000 7f7a78ff9700 10 client.16065 handle_command_reply: tid=0 2024-05-10T03:41:29.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.625+0000 7f7aa7996b80 1 client.16065 shutdown 2024-05-10T03:41:29.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.625+0000 7f7aa7996b80 1 -- 172.21.15.45:0/3970146049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a610a00 msgr2=0x564a3a61f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.625+0000 7f7aa7996b80 1 --2- 172.21.15.45:0/3970146049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a610a00 0x564a3a61f310 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7a800097c0 tx=0x7f7a800047c0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.625+0000 7f7aa7996b80 1 -- 172.21.15.45:0/3970146049 shutdown_connections 2024-05-10T03:41:29.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.625+0000 7f7aa7996b80 1 --2- 172.21.15.45:0/3970146049 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x564a3a67cf50 0x564a3a67f370 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.625+0000 7f7aa7996b80 1 --2- 172.21.15.45:0/3970146049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a3a611350 0x564a3a61f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.625+0000 7f7aa7996b80 1 --2- 172.21.15.45:0/3970146049 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a3a60fb30 0x564a3a620ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.625+0000 7f7aa7996b80 1 --2- 172.21.15.45:0/3970146049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a3a610a00 0x564a3a61f310 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.625+0000 7f7aa7996b80 1 -- 172.21.15.45:0/3970146049 >> 172.21.15.45:0/3970146049 conn(0x564a3a56dae0 msgr2=0x564a3a614740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:29.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.625+0000 7f7a78ff9700 0 client.16065 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:29.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.625+0000 7f7aa7996b80 1 -- 172.21.15.45:0/3970146049 shutdown_connections 2024-05-10T03:41:29.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.625+0000 7f7aa7996b80 1 -- 172.21.15.45:0/3970146049 wait complete. 2024-05-10T03:41:29.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.625+0000 7f7aa7996b80 20 client.16065 trim_cache size 0 max 16384 2024-05-10T03:41:29.635 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:41:29.635 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-05-10T03:41:29.635 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "dad79132-d9c8-4642-9c3f-bb7e32b5dfd9", 2024-05-10T03:41:29.635 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-05-10T03:41:29.635 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:41:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.626+0000 7f7a97652700 1 -- 172.21.15.45:0/1676990399 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7a7c0a11c0 msgr2=0x7f7a7c0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.626+0000 7f7a97652700 1 --2- 172.21.15.45:0/1676990399 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7a7c0a11c0 0x7f7a7c0a36d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7a90199030 tx=0x7f7a80009260 comp rx=0 tx=0).stop 2024-05-10T03:41:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.626+0000 7f7a97652700 1 -- 172.21.15.45:0/1676990399 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a900ffbe0 msgr2=0x7f7a90197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.626+0000 7f7a97652700 1 --2- 172.21.15.45:0/1676990399 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a900ffbe0 0x7f7a90197f90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c0098e0 tx=0x7f7a8c005b00 comp rx=0 tx=0).stop 2024-05-10T03:41:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.626+0000 7f7a97652700 1 -- 172.21.15.45:0/1676990399 shutdown_connections 2024-05-10T03:41:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.626+0000 7f7a97652700 1 --2- 172.21.15.45:0/1676990399 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f7a7c0a11c0 0x7f7a7c0a36d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.626+0000 7f7a97652700 1 --2- 172.21.15.45:0/1676990399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a901031a0 0x7f7a9019f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.626+0000 7f7a97652700 1 --2- 172.21.15.45:0/1676990399 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a900ffbe0 0x7f7a90197f90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.626+0000 7f7a97652700 1 --2- 172.21.15.45:0/1676990399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a90100530 0x7f7a901984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.626+0000 7f7a97652700 1 -- 172.21.15.45:0/1676990399 >> 172.21.15.45:0/1676990399 conn(0x7f7a900fb8b0 msgr2=0x7f7a90106130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:29.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.626+0000 7f7a97652700 1 -- 172.21.15.45:0/1676990399 shutdown_connections 2024-05-10T03:41:29.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.626+0000 7f7a97652700 1 -- 172.21.15.45:0/1676990399 wait complete. 2024-05-10T03:41:29.643 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-10T03:41:29.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.835+0000 7fa2730c6700 1 -- 172.21.15.45:0/1066595716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa26c102580 msgr2=0x7fa26c108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.835+0000 7fa2730c6700 1 --2- 172.21.15.45:0/1066595716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa26c102580 0x7fa26c108e30 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa26400b0a0 tx=0x7fa26400b3b0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.835+0000 7fa2730c6700 1 -- 172.21.15.45:0/1066595716 shutdown_connections 2024-05-10T03:41:29.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.835+0000 7fa2730c6700 1 --2- 172.21.15.45:0/1066595716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa26c100ac0 0x7fa26c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.835+0000 7fa2730c6700 1 --2- 172.21.15.45:0/1066595716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa26c102580 0x7fa26c108e30 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.835+0000 7fa2730c6700 1 --2- 172.21.15.45:0/1066595716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa26c101be0 0x7fa26c101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.835+0000 7fa2730c6700 1 -- 172.21.15.45:0/1066595716 >> 172.21.15.45:0/1066595716 conn(0x7fa26c0fc0d0 msgr2=0x7fa26c0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:29.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.835+0000 7fa2730c6700 1 -- 172.21.15.45:0/1066595716 shutdown_connections 2024-05-10T03:41:29.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.835+0000 7fa2730c6700 1 -- 172.21.15.45:0/1066595716 wait complete. 2024-05-10T03:41:29.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.835+0000 7fa2730c6700 1 Processor -- start 2024-05-10T03:41:29.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.835+0000 7fa2730c6700 1 -- start start 2024-05-10T03:41:29.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.836+0000 7fa2730c6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa26c100ac0 0x7fa26c10b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.836+0000 7fa2730c6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa26c101be0 0x7fa26c109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.836+0000 7fa2730c6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa26c102580 0x7fa26c10a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.836+0000 7fa2730c6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c10a8b0 con 0x7fa26c100ac0 2024-05-10T03:41:29.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.836+0000 7fa2730c6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c10aa20 con 0x7fa26c101be0 2024-05-10T03:41:29.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.836+0000 7fa2730c6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c1a2180 con 0x7fa26c102580 2024-05-10T03:41:29.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.836+0000 7fa270e62700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa26c100ac0 0x7fa26c10b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.836+0000 7fa270e62700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa26c100ac0 0x7fa26c10b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37524/0 (socket says 172.21.15.45:37524) 2024-05-10T03:41:29.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.836+0000 7fa270e62700 1 -- 172.21.15.45:0/3998604987 learned_addr learned my addr 172.21.15.45:0/3998604987 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:29.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.836+0000 7fa26bfff700 1 --2- 172.21.15.45:0/3998604987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa26c101be0 0x7fa26c109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.836+0000 7fa271663700 1 --2- 172.21.15.45:0/3998604987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa26c102580 0x7fa26c10a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.836+0000 7fa270e62700 1 -- 172.21.15.45:0/3998604987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa26c102580 msgr2=0x7fa26c10a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.836+0000 7fa270e62700 1 --2- 172.21.15.45:0/3998604987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa26c102580 0x7fa26c10a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.836+0000 7fa270e62700 1 -- 172.21.15.45:0/3998604987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa26c101be0 msgr2=0x7fa26c109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.836+0000 7fa270e62700 1 --2- 172.21.15.45:0/3998604987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa26c101be0 0x7fa26c109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.836+0000 7fa270e62700 1 -- 172.21.15.45:0/3998604987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa264009d00 con 0x7fa26c100ac0 2024-05-10T03:41:29.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.836+0000 7fa270e62700 1 --2- 172.21.15.45:0/3998604987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa26c100ac0 0x7fa26c10b5f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa26000d950 tx=0x7fa26000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:29.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.837+0000 7fa269ffb700 1 -- 172.21.15.45:0/3998604987 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa260004a30 con 0x7fa26c100ac0 2024-05-10T03:41:29.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.837+0000 7fa269ffb700 1 -- 172.21.15.45:0/3998604987 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa260007620 con 0x7fa26c100ac0 2024-05-10T03:41:29.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.837+0000 7fa2730c6700 1 -- 172.21.15.45:0/3998604987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa26c1a23e0 con 0x7fa26c100ac0 2024-05-10T03:41:29.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.837+0000 7fa269ffb700 1 -- 172.21.15.45:0/3998604987 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26000fb50 con 0x7fa26c100ac0 2024-05-10T03:41:29.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.837+0000 7fa2730c6700 1 -- 172.21.15.45:0/3998604987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa26c1a28c0 con 0x7fa26c100ac0 2024-05-10T03:41:29.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.839+0000 7fa269ffb700 1 -- 172.21.15.45:0/3998604987 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa26000fcf0 con 0x7fa26c100ac0 2024-05-10T03:41:29.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.840+0000 7fa269ffb700 1 --2- 172.21.15.45:0/3998604987 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa25c0a11c0 0x7fa25c0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.840+0000 7fa269ffb700 1 -- 172.21.15.45:0/3998604987 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa2600cc6d0 con 0x7fa26c100ac0 2024-05-10T03:41:29.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.840+0000 7fa26bfff700 1 --2- 172.21.15.45:0/3998604987 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa25c0a11c0 0x7fa25c0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.841+0000 7fa26bfff700 1 --2- 172.21.15.45:0/3998604987 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa25c0a11c0 0x7fa25c0a36d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa26c10af90 tx=0x7fa25800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:29.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.841+0000 7fa28340ab80 1 Processor -- start 2024-05-10T03:41:29.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.841+0000 7fa28340ab80 1 -- start start 2024-05-10T03:41:29.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.841+0000 7fa28340ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bdc6a0 0x558fc0bdcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.841+0000 7fa28340ab80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fc0bdd570 0x558fc0bdd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.841+0000 7fa28340ab80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fc0bddec0 0x558fc0be47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.841+0000 7fa28340ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc0b03150 con 0x558fc0bdc6a0 2024-05-10T03:41:29.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.841+0000 7fa28340ab80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc0b00b10 con 0x558fc0bddec0 2024-05-10T03:41:29.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.841+0000 7fa28340ab80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc0afc400 con 0x558fc0bdd570 2024-05-10T03:41:29.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.841+0000 7fa270e62700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bdc6a0 0x558fc0bdcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.841+0000 7fa270e62700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bdc6a0 0x558fc0bdcaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37528/0 (socket says 172.21.15.45:37528) 2024-05-10T03:41:29.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.841+0000 7fa270e62700 1 -- 172.21.15.45:0/1051140852 learned_addr learned my addr 172.21.15.45:0/1051140852 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:29.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.842+0000 7fa271663700 1 --2- 172.21.15.45:0/1051140852 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fc0bddec0 0x558fc0be47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.842+0000 7fa26bfff700 1 --2- 172.21.15.45:0/1051140852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fc0bdd570 0x558fc0bdd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.842+0000 7fa270e62700 1 -- 172.21.15.45:0/1051140852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fc0bdd570 msgr2=0x558fc0bdd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:29.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.842+0000 7fa270e62700 1 --2- 172.21.15.45:0/1051140852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fc0bdd570 0x558fc0bdd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.842+0000 7fa270e62700 1 -- 172.21.15.45:0/1051140852 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fc0bddec0 msgr2=0x558fc0be47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:29.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.842+0000 7fa270e62700 1 --2- 172.21.15.45:0/1051140852 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fc0bddec0 0x558fc0be47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.842+0000 7fa270e62700 1 -- 172.21.15.45:0/1051140852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fc097d3b0 con 0x558fc0bdc6a0 2024-05-10T03:41:29.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.842+0000 7fa26bfff700 1 --2- 172.21.15.45:0/1051140852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fc0bdd570 0x558fc0bdd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:29.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.842+0000 7fa270e62700 1 --2- 172.21.15.45:0/1051140852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bdc6a0 0x558fc0bdcaf0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa260099710 tx=0x7fa260099160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1679cd925367bc8e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:29.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.842+0000 7fa256ffd700 1 -- 172.21.15.45:0/1051140852 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26009d5b0 con 0x558fc0bdc6a0 2024-05-10T03:41:29.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.842+0000 7fa256ffd700 1 -- 172.21.15.45:0/1051140852 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa2600a1c00 con 0x558fc0bdc6a0 2024-05-10T03:41:29.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.842+0000 7fa256ffd700 1 -- 172.21.15.45:0/1051140852 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa260098c70 con 0x558fc0bdc6a0 2024-05-10T03:41:29.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.843+0000 7fa28340ab80 1 -- 172.21.15.45:0/1051140852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bdc6a0 msgr2=0x558fc0bdcaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.843+0000 7fa28340ab80 1 --2- 172.21.15.45:0/1051140852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bdc6a0 0x558fc0bdcaf0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa260099710 tx=0x7fa260099160 comp rx=0 tx=0).stop 2024-05-10T03:41:29.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.843+0000 7fa28340ab80 1 -- 172.21.15.45:0/1051140852 shutdown_connections 2024-05-10T03:41:29.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.843+0000 7fa28340ab80 1 --2- 172.21.15.45:0/1051140852 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fc0bddec0 0x558fc0be47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.843+0000 7fa28340ab80 1 --2- 172.21.15.45:0/1051140852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bdc6a0 0x558fc0bdcaf0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.843+0000 7fa28340ab80 1 --2- 172.21.15.45:0/1051140852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fc0bdd570 0x558fc0bdd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.843+0000 7fa28340ab80 1 -- 172.21.15.45:0/1051140852 >> 172.21.15.45:0/1051140852 conn(0x558fc0b3ea60 msgr2=0x558fc0bd6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:29.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.843+0000 7fa28340ab80 1 -- 172.21.15.45:0/1051140852 shutdown_connections 2024-05-10T03:41:29.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.843+0000 7fa28340ab80 1 -- 172.21.15.45:0/1051140852 wait complete. 2024-05-10T03:41:29.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.844+0000 7fa28340ab80 1 -- start start 2024-05-10T03:41:29.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.844+0000 7fa28340ab80 1 Processor -- start 2024-05-10T03:41:29.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.844+0000 7fa28340ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bdc6a0 0x558fc0be6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.844+0000 7fa28340ab80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fc0bdd570 0x558fc0be6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.844+0000 7fa28340ab80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fc0bddec0 0x558fc0bedbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.844+0000 7fa28340ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc0a98560 con 0x558fc0bdc6a0 2024-05-10T03:41:29.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.844+0000 7fa28340ab80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc0a98200 con 0x558fc0bdd570 2024-05-10T03:41:29.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.844+0000 7fa28340ab80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc097f6a0 con 0x558fc0bddec0 2024-05-10T03:41:29.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.844+0000 7fa28340ab80 10 client.0 _ll_register_callbacks cb 0x558fc0aa1b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:29.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.844+0000 7fa270e62700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bdc6a0 0x558fc0be6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.844+0000 7fa270e62700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bdc6a0 0x558fc0be6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37534/0 (socket says 172.21.15.45:37534) 2024-05-10T03:41:29.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.844+0000 7fa270e62700 1 -- 172.21.15.45:0/683644107 learned_addr learned my addr 172.21.15.45:0/683644107 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:29.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.845+0000 7fa26bfff700 1 --2- 172.21.15.45:0/683644107 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fc0bdd570 0x558fc0be6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.845+0000 7fa271663700 1 --2- 172.21.15.45:0/683644107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fc0bddec0 0x558fc0bedbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.845+0000 7fa270e62700 1 -- 172.21.15.45:0/683644107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fc0bddec0 msgr2=0x558fc0bedbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.845+0000 7fa270e62700 1 --2- 172.21.15.45:0/683644107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fc0bddec0 0x558fc0bedbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.845+0000 7fa270e62700 1 -- 172.21.15.45:0/683644107 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fc0bdd570 msgr2=0x558fc0be6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.845+0000 7fa270e62700 1 --2- 172.21.15.45:0/683644107 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fc0bdd570 0x558fc0be6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.845+0000 7fa270e62700 1 -- 172.21.15.45:0/683644107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa26c1a28c0 con 0x558fc0bdc6a0 2024-05-10T03:41:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.845+0000 7fa270e62700 1 --2- 172.21.15.45:0/683644107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bdc6a0 0x558fc0be6730 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa2600961f0 tx=0x7fa260004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f295a1e9311ed351 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.845+0000 7fa24bfff700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:41:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.845+0000 7fa24bfff700 1 -- 172.21.15.45:0/683644107 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa260004b90 con 0x558fc0bdc6a0 2024-05-10T03:41:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.845+0000 7fa24bfff700 1 -- 172.21.15.45:0/683644107 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa26009d5b0 con 0x558fc0bdc6a0 2024-05-10T03:41:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.845+0000 7fa28340ab80 1 -- 172.21.15.45:0/683644107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558fc0a55270 con 0x558fc0bdc6a0 2024-05-10T03:41:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.845+0000 7fa24bfff700 1 -- 172.21.15.45:0/683644107 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2600650d0 con 0x558fc0bdc6a0 2024-05-10T03:41:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.845+0000 7fa28340ab80 10 client.16077 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.845+0000 7fa28340ab80 1 -- 172.21.15.45:0/683644107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x558fc0929b60 con 0x558fc0bdc6a0 2024-05-10T03:41:29.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.846+0000 7fa24bfff700 1 -- 172.21.15.45:0/683644107 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x558fc0a55270 con 0x558fc0bdc6a0 2024-05-10T03:41:29.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.846+0000 7fa24bfff700 1 -- 172.21.15.45:0/683644107 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa260098c70 con 0x558fc0bdc6a0 2024-05-10T03:41:29.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.846+0000 7fa28340ab80 10 client.16077 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:29.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.846+0000 7fa28340ab80 10 client.16077 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:41:29.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.846+0000 7fa28340ab80 20 client.16077 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:29.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.846+0000 7fa28340ab80 1 --2- 172.21.15.45:0/683644107 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x558fc0bf1df0 0x558fc0bf4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.846+0000 7fa28340ab80 4 client.16077 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:41:29.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.846+0000 7fa28340ab80 1 -- 172.21.15.45:0/683644107 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558fc0bab780 con 0x558fc0bf1df0 2024-05-10T03:41:29.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.846+0000 7fa26bfff700 1 --2- 172.21.15.45:0/683644107 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x558fc0bf1df0 0x558fc0bf4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.846+0000 7fa24bfff700 10 client.16077 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:29.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.846+0000 7fa26bfff700 1 --2- 172.21.15.45:0/683644107 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x558fc0bf1df0 0x558fc0bf4210 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5489f81f0a0584f server_cookie=b0c736f40ab7810d in_seq=0 out_seq=0 2024-05-10T03:41:29.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.847+0000 7fa24bfff700 1 -- 172.21.15.45:0/683644107 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558fc0bab780 con 0x558fc0bf1df0 2024-05-10T03:41:29.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.847+0000 7fa24bfff700 10 client.16077 handle_command_reply: tid=0 2024-05-10T03:41:29.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.847+0000 7fa28340ab80 1 client.16077 shutdown 2024-05-10T03:41:29.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.847+0000 7fa28340ab80 1 -- 172.21.15.45:0/683644107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bdc6a0 msgr2=0x558fc0be6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.847+0000 7fa28340ab80 1 --2- 172.21.15.45:0/683644107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bdc6a0 0x558fc0be6730 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa2600961f0 tx=0x7fa260004750 comp rx=0 tx=0).stop 2024-05-10T03:41:29.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.847+0000 7fa28340ab80 1 -- 172.21.15.45:0/683644107 shutdown_connections 2024-05-10T03:41:29.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.847+0000 7fa28340ab80 1 --2- 172.21.15.45:0/683644107 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x558fc0bf1df0 0x558fc0bf4210 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.847+0000 7fa28340ab80 1 --2- 172.21.15.45:0/683644107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fc0bddec0 0x558fc0bedbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.847+0000 7fa28340ab80 1 --2- 172.21.15.45:0/683644107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bdc6a0 0x558fc0be6730 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.847+0000 7fa28340ab80 1 --2- 172.21.15.45:0/683644107 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fc0bdd570 0x558fc0be6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.847+0000 7fa24bfff700 0 client.16077 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:29.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.847+0000 7fa28340ab80 1 -- 172.21.15.45:0/683644107 >> 172.21.15.45:0/683644107 conn(0x558fc0b3ea60 msgr2=0x558fc0bd6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:29.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.848+0000 7fa28340ab80 1 -- 172.21.15.45:0/683644107 shutdown_connections 2024-05-10T03:41:29.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.848+0000 7fa28340ab80 1 -- 172.21.15.45:0/683644107 wait complete. 2024-05-10T03:41:29.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.848+0000 7fa28340ab80 20 client.16077 trim_cache size 0 max 16384 2024-05-10T03:41:29.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.866+0000 7fa28340ab80 1 Processor -- start 2024-05-10T03:41:29.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.866+0000 7fa28340ab80 1 -- start start 2024-05-10T03:41:29.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.866+0000 7fa28340ab80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fc0bdc6a0 0x558fc0be4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.866+0000 7fa28340ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bdd570 0x558fc0bedb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.866+0000 7fa28340ab80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fc0bddec0 0x558fc0be5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.866+0000 7fa28340ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc0bf1ca0 con 0x558fc0bdd570 2024-05-10T03:41:29.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.866+0000 7fa28340ab80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc0bab7b0 con 0x558fc0bddec0 2024-05-10T03:41:29.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.866+0000 7fa28340ab80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc0bd3d30 con 0x558fc0bdc6a0 2024-05-10T03:41:29.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.866+0000 7fa26bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bdd570 0x558fc0bedb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.866+0000 7fa26bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bdd570 0x558fc0bedb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37544/0 (socket says 172.21.15.45:37544) 2024-05-10T03:41:29.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.866+0000 7fa26bfff700 1 -- 172.21.15.45:0/435593099 learned_addr learned my addr 172.21.15.45:0/435593099 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:29.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.866+0000 7fa271663700 1 --2- 172.21.15.45:0/435593099 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fc0bddec0 0x558fc0be5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.867+0000 7fa270e62700 1 --2- 172.21.15.45:0/435593099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fc0bdc6a0 0x558fc0be4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.867+0000 7fa26bfff700 1 -- 172.21.15.45:0/435593099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fc0bdc6a0 msgr2=0x558fc0be4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:29.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.867+0000 7fa26bfff700 1 --2- 172.21.15.45:0/435593099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fc0bdc6a0 0x558fc0be4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.867+0000 7fa26bfff700 1 -- 172.21.15.45:0/435593099 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fc0bddec0 msgr2=0x558fc0be5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:29.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.867+0000 7fa26bfff700 1 --2- 172.21.15.45:0/435593099 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fc0bddec0 0x558fc0be5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.867+0000 7fa26bfff700 1 -- 172.21.15.45:0/435593099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fc0ac2560 con 0x558fc0bdd570 2024-05-10T03:41:29.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.867+0000 7fa270e62700 1 --2- 172.21.15.45:0/435593099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fc0bdc6a0 0x558fc0be4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:29.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.867+0000 7fa26bfff700 1 --2- 172.21.15.45:0/435593099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bdd570 0x558fc0bedb90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x558fc0be77a0 tx=0x7fa258013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e9797c86a91db2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:29.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.867+0000 7fa2577fe700 1 -- 172.21.15.45:0/435593099 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258025070 con 0x558fc0bdd570 2024-05-10T03:41:29.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.867+0000 7fa2577fe700 1 -- 172.21.15.45:0/435593099 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa258015070 con 0x558fc0bdd570 2024-05-10T03:41:29.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.867+0000 7fa2577fe700 1 -- 172.21.15.45:0/435593099 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258011440 con 0x558fc0bdd570 2024-05-10T03:41:29.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.868+0000 7fa28340ab80 1 -- 172.21.15.45:0/435593099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bdd570 msgr2=0x558fc0bedb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.868+0000 7fa28340ab80 1 --2- 172.21.15.45:0/435593099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bdd570 0x558fc0bedb90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x558fc0be77a0 tx=0x7fa258013000 comp rx=0 tx=0).stop 2024-05-10T03:41:29.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.868+0000 7fa28340ab80 1 -- 172.21.15.45:0/435593099 shutdown_connections 2024-05-10T03:41:29.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.868+0000 7fa28340ab80 1 --2- 172.21.15.45:0/435593099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fc0bdc6a0 0x558fc0be4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.868+0000 7fa28340ab80 1 --2- 172.21.15.45:0/435593099 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fc0bddec0 0x558fc0be5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.868+0000 7fa28340ab80 1 --2- 172.21.15.45:0/435593099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bdd570 0x558fc0bedb90 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.868+0000 7fa28340ab80 1 -- 172.21.15.45:0/435593099 >> 172.21.15.45:0/435593099 conn(0x558fc0b3ea60 msgr2=0x558fc0be1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:29.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.868+0000 7fa28340ab80 1 -- 172.21.15.45:0/435593099 shutdown_connections 2024-05-10T03:41:29.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.868+0000 7fa28340ab80 1 -- 172.21.15.45:0/435593099 wait complete. 2024-05-10T03:41:29.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.868+0000 7fa28340ab80 1 -- start start 2024-05-10T03:41:29.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.869+0000 7fa28340ab80 1 Processor -- start 2024-05-10T03:41:29.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.869+0000 7fa28340ab80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fc0bdc6a0 0x558fc0beb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.869+0000 7fa28340ab80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fc0bdd570 0x558fc0beb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.869+0000 7fa28340ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bddec0 0x558fc0bec8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.869+0000 7fa28340ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc0bece20 con 0x558fc0bddec0 2024-05-10T03:41:29.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.869+0000 7fa28340ab80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc0becf90 con 0x558fc0bdc6a0 2024-05-10T03:41:29.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.869+0000 7fa28340ab80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc0bed150 con 0x558fc0bdd570 2024-05-10T03:41:29.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.869+0000 7fa28340ab80 10 client.0 _ll_register_callbacks cb 0x558fc0aa1b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:29.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.869+0000 7fa271663700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bddec0 0x558fc0bec8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.869+0000 7fa271663700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bddec0 0x558fc0bec8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37556/0 (socket says 172.21.15.45:37556) 2024-05-10T03:41:29.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.869+0000 7fa271663700 1 -- 172.21.15.45:0/199627541 learned_addr learned my addr 172.21.15.45:0/199627541 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:29.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.869+0000 7fa270e62700 1 --2- 172.21.15.45:0/199627541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fc0bdc6a0 0x558fc0beb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.870+0000 7fa26bfff700 1 --2- 172.21.15.45:0/199627541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fc0bdd570 0x558fc0beb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.870+0000 7fa271663700 1 -- 172.21.15.45:0/199627541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fc0bdd570 msgr2=0x558fc0beb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:29.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.870+0000 7fa271663700 1 --2- 172.21.15.45:0/199627541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fc0bdd570 0x558fc0beb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.870+0000 7fa271663700 1 -- 172.21.15.45:0/199627541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fc0bdc6a0 msgr2=0x558fc0beb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:29.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.870+0000 7fa271663700 1 --2- 172.21.15.45:0/199627541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fc0bdc6a0 0x558fc0beb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.870+0000 7fa271663700 1 -- 172.21.15.45:0/199627541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa258020440 con 0x558fc0bddec0 2024-05-10T03:41:29.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.870+0000 7fa271663700 1 --2- 172.21.15.45:0/199627541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bddec0 0x558fc0bec8e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa26400d010 tx=0x7fa264009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e03bb8a760d6c28 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:29.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.870+0000 7fa24bfff700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:41:29.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.870+0000 7fa24bfff700 1 -- 172.21.15.45:0/199627541 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26400e040 con 0x558fc0bddec0 2024-05-10T03:41:29.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.870+0000 7fa24bfff700 1 -- 172.21.15.45:0/199627541 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa264005040 con 0x558fc0bddec0 2024-05-10T03:41:29.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.870+0000 7fa28340ab80 1 -- 172.21.15.45:0/199627541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa2600a1c00 con 0x558fc0bddec0 2024-05-10T03:41:29.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.870+0000 7fa24bfff700 1 -- 172.21.15.45:0/199627541 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa264005240 con 0x558fc0bddec0 2024-05-10T03:41:29.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.870+0000 7fa28340ab80 10 client.16083 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:29.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.870+0000 7fa28340ab80 1 -- 172.21.15.45:0/199627541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x558fc0981cd0 con 0x558fc0bddec0 2024-05-10T03:41:29.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.870+0000 7fa24bfff700 1 -- 172.21.15.45:0/199627541 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa2600a1c00 con 0x558fc0bddec0 2024-05-10T03:41:29.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.871+0000 7fa24bfff700 1 -- 172.21.15.45:0/199627541 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa26400b0d0 con 0x558fc0bddec0 2024-05-10T03:41:29.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.871+0000 7fa28340ab80 10 client.16083 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:29.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.871+0000 7fa28340ab80 10 client.16083 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:41:29.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.871+0000 7fa28340ab80 20 client.16083 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:29.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.871+0000 7fa28340ab80 1 --2- 172.21.15.45:0/199627541 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x558fc0c48bd0 0x558fc0c4aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:29.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.871+0000 7fa28340ab80 4 client.16083 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T03:41:29.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.871+0000 7fa28340ab80 1 -- 172.21.15.45:0/199627541 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558fc0af4ec0 con 0x558fc0c48bd0 2024-05-10T03:41:29.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.871+0000 7fa270e62700 1 --2- 172.21.15.45:0/199627541 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x558fc0c48bd0 0x558fc0c4aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:29.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.871+0000 7fa24bfff700 10 client.16083 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:29.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.871+0000 7fa270e62700 1 --2- 172.21.15.45:0/199627541 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x558fc0c48bd0 0x558fc0c4aff0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7805465d6489f2f server_cookie=42a74cf8e0c0b44c in_seq=0 out_seq=0 2024-05-10T03:41:29.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.872+0000 7fa24bfff700 1 -- 172.21.15.45:0/199627541 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x558fc0af4ec0 con 0x558fc0c48bd0 2024-05-10T03:41:29.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.872+0000 7fa24bfff700 10 client.16083 handle_command_reply: tid=0 2024-05-10T03:41:29.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.872+0000 7fa28340ab80 1 client.16083 shutdown 2024-05-10T03:41:29.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.872+0000 7fa28340ab80 1 -- 172.21.15.45:0/199627541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bddec0 msgr2=0x558fc0bec8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.872+0000 7fa28340ab80 1 --2- 172.21.15.45:0/199627541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bddec0 0x558fc0bec8e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa26400d010 tx=0x7fa264009510 comp rx=0 tx=0).stop 2024-05-10T03:41:29.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.872+0000 7fa28340ab80 1 -- 172.21.15.45:0/199627541 shutdown_connections 2024-05-10T03:41:29.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.872+0000 7fa28340ab80 1 --2- 172.21.15.45:0/199627541 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x558fc0c48bd0 0x558fc0c4aff0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.872+0000 7fa28340ab80 1 --2- 172.21.15.45:0/199627541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558fc0bddec0 0x558fc0bec8e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.872+0000 7fa28340ab80 1 --2- 172.21.15.45:0/199627541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558fc0bdc6a0 0x558fc0beb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.872+0000 7fa24bfff700 0 client.16083 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:29.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.872+0000 7fa28340ab80 1 --2- 172.21.15.45:0/199627541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558fc0bdd570 0x558fc0beb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.872+0000 7fa28340ab80 1 -- 172.21.15.45:0/199627541 >> 172.21.15.45:0/199627541 conn(0x558fc0b3ea60 msgr2=0x558fc0be4980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:29.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.872+0000 7fa28340ab80 1 -- 172.21.15.45:0/199627541 shutdown_connections 2024-05-10T03:41:29.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.872+0000 7fa28340ab80 1 -- 172.21.15.45:0/199627541 wait complete. 2024-05-10T03:41:29.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.872+0000 7fa28340ab80 20 client.16083 trim_cache size 0 max 16384 2024-05-10T03:41:29.882 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:41:29.882 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-10T03:41:29.882 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": { 2024-05-10T03:41:29.882 INFO:teuthology.orchestra.run.smithi045.stdout: "dad79132-d9c8-4642-9c3f-bb7e32b5dfd9": { 2024-05-10T03:41:29.882 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/", 2024-05-10T03:41:29.882 INFO:teuthology.orchestra.run.smithi045.stdout: "tag": "dad79132-d9c8-4642-9c3f-bb7e32b5dfd9", 2024-05-10T03:41:29.882 INFO:teuthology.orchestra.run.smithi045.stdout: "options": "recursive,force" 2024-05-10T03:41:29.882 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:41:29.882 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:41:29.882 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:41:29.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.873+0000 7fa2730c6700 1 -- 172.21.15.45:0/3998604987 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa25c0a11c0 msgr2=0x7fa25c0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.873+0000 7fa2730c6700 1 --2- 172.21.15.45:0/3998604987 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa25c0a11c0 0x7fa25c0a36d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa26c10af90 tx=0x7fa25800b410 comp rx=0 tx=0).stop 2024-05-10T03:41:29.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.873+0000 7fa2730c6700 1 -- 172.21.15.45:0/3998604987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa26c100ac0 msgr2=0x7fa26c10b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:29.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.873+0000 7fa2730c6700 1 --2- 172.21.15.45:0/3998604987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa26c100ac0 0x7fa26c10b5f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa26000d950 tx=0x7fa26000dc60 comp rx=0 tx=0).stop 2024-05-10T03:41:29.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.873+0000 7fa2730c6700 1 -- 172.21.15.45:0/3998604987 shutdown_connections 2024-05-10T03:41:29.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.873+0000 7fa2730c6700 1 --2- 172.21.15.45:0/3998604987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa26c102580 0x7fa26c10a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.873+0000 7fa2730c6700 1 --2- 172.21.15.45:0/3998604987 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa25c0a11c0 0x7fa25c0a36d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.873+0000 7fa2730c6700 1 --2- 172.21.15.45:0/3998604987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa26c100ac0 0x7fa26c10b5f0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.873+0000 7fa2730c6700 1 --2- 172.21.15.45:0/3998604987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa26c101be0 0x7fa26c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:29.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.873+0000 7fa2730c6700 1 -- 172.21.15.45:0/3998604987 >> 172.21.15.45:0/3998604987 conn(0x7fa26c0fc0d0 msgr2=0x7fa26c104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:29.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.873+0000 7fa2730c6700 1 -- 172.21.15.45:0/3998604987 shutdown_connections 2024-05-10T03:41:29.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:41:29.873+0000 7fa2730c6700 1 -- 172.21.15.45:0/3998604987 wait complete. 2024-05-10T03:41:29.890 INFO:tasks.cephfs.filesystem:scrub status for tag:dad79132-d9c8-4642-9c3f-bb7e32b5dfd9 - {'path': '/', 'tag': 'dad79132-d9c8-4642-9c3f-bb7e32b5dfd9', 'options': 'recursive,force'} 2024-05-10T03:41:30.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:30 smithi106 ceph-mon[46996]: scrub queued for path: / 2024-05-10T03:41:30.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:30 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:41:30.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:30 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:41:30.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:30 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:41:30.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:30 smithi154 ceph-mon[46565]: scrub queued for path: / 2024-05-10T03:41:30.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:30 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:41:30.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:30 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:41:30.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:30 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:41:30.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:30 smithi045 ceph-mon[42520]: scrub queued for path: / 2024-05-10T03:41:30.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:30 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:41:30.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:30 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:41:30.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:30 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:41:31.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:31 smithi106 ceph-mon[46996]: pgmap v322: 129 pgs: 129 active+clean; 672 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 853 B/s wr, 12 op/s 2024-05-10T03:41:31.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:31 smithi106 ceph-mon[46996]: scrub summary: idle 2024-05-10T03:41:31.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:31 smithi154 ceph-mon[46565]: pgmap v322: 129 pgs: 129 active+clean; 672 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 853 B/s wr, 12 op/s 2024-05-10T03:41:31.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:31 smithi154 ceph-mon[46565]: scrub summary: idle 2024-05-10T03:41:31.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:31 smithi045 ceph-mon[42520]: pgmap v322: 129 pgs: 129 active+clean; 672 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 853 B/s wr, 12 op/s 2024-05-10T03:41:31.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:31 smithi045 ceph-mon[42520]: scrub summary: idle 2024-05-10T03:41:33.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:33 smithi106 ceph-mon[46996]: pgmap v323: 129 pgs: 129 active+clean; 672 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 682 B/s wr, 11 op/s 2024-05-10T03:41:33.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:33 smithi154 ceph-mon[46565]: pgmap v323: 129 pgs: 129 active+clean; 672 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 682 B/s wr, 11 op/s 2024-05-10T03:41:33.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:33 smithi045 ceph-mon[42520]: pgmap v323: 129 pgs: 129 active+clean; 672 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 682 B/s wr, 11 op/s 2024-05-10T03:41:35.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:35 smithi106 ceph-mon[46996]: pgmap v324: 129 pgs: 129 active+clean; 672 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-10T03:41:35.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:35 smithi154 ceph-mon[46565]: pgmap v324: 129 pgs: 129 active+clean; 672 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-10T03:41:35.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:35 smithi045 ceph-mon[42520]: pgmap v324: 129 pgs: 129 active+clean; 672 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-10T03:41:37.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:37 smithi106 ceph-mon[46996]: pgmap v325: 129 pgs: 129 active+clean; 672 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 767 B/s wr, 13 op/s 2024-05-10T03:41:37.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:37 smithi154 ceph-mon[46565]: pgmap v325: 129 pgs: 129 active+clean; 672 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 767 B/s wr, 13 op/s 2024-05-10T03:41:37.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:37 smithi045 ceph-mon[42520]: pgmap v325: 129 pgs: 129 active+clean; 672 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 767 B/s wr, 13 op/s 2024-05-10T03:41:39.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:39 smithi106 ceph-mon[46996]: pgmap v326: 129 pgs: 129 active+clean; 672 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-10T03:41:39.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:39 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:41:39.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:39 smithi154 ceph-mon[46565]: pgmap v326: 129 pgs: 129 active+clean; 672 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-10T03:41:39.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:39 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:41:39.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:39 smithi045 ceph-mon[42520]: pgmap v326: 129 pgs: 129 active+clean; 672 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-10T03:41:39.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:39 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:41:40.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:40 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:41:40.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:40 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:41:40.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:40 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:41:40.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:40 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:41:40.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:40 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:41:40.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:40 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:41:40.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:40 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:41:40.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:40 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:41:40.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:40 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:41:41.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:41 smithi106 ceph-mon[46996]: pgmap v327: 129 pgs: 129 active+clean; 672 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 767 B/s wr, 13 op/s 2024-05-10T03:41:41.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:41 smithi154 ceph-mon[46565]: pgmap v327: 129 pgs: 129 active+clean; 672 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 767 B/s wr, 13 op/s 2024-05-10T03:41:41.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:41 smithi045 ceph-mon[42520]: pgmap v327: 129 pgs: 129 active+clean; 672 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 767 B/s wr, 13 op/s 2024-05-10T03:41:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.324+0000 7ff7f402a700 1 -- 172.21.15.45:0/392135218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7ec0740d0 msgr2=0x7ff7ec104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.324+0000 7ff7f402a700 1 --2- 172.21.15.45:0/392135218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7ec0740d0 0x7ff7ec104780 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8009990 tx=0x7ff7e8009ca0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.324+0000 7ff7f402a700 1 -- 172.21.15.45:0/392135218 shutdown_connections 2024-05-10T03:41:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.324+0000 7ff7f402a700 1 --2- 172.21.15.45:0/392135218 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7ec1078c0 0x7ff7ec109da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.324+0000 7ff7f402a700 1 --2- 172.21.15.45:0/392135218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7ec0740d0 0x7ff7ec104780 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.324+0000 7ff7f402a700 1 --2- 172.21.15.45:0/392135218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7ec104d50 0x7ff7ec107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.324+0000 7ff7f402a700 1 -- 172.21.15.45:0/392135218 >> 172.21.15.45:0/392135218 conn(0x7ff7ec0fc0f0 msgr2=0x7ff7ec0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.324+0000 7ff7f402a700 1 -- 172.21.15.45:0/392135218 shutdown_connections 2024-05-10T03:41:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.324+0000 7ff7f402a700 1 -- 172.21.15.45:0/392135218 wait complete. 2024-05-10T03:41:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.325+0000 7ff7f402a700 1 Processor -- start 2024-05-10T03:41:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.325+0000 7ff7f402a700 1 -- start start 2024-05-10T03:41:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.325+0000 7ff7f402a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7ec0740d0 0x7ff7ec101f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.325+0000 7ff7f402a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7ec104d50 0x7ff7ec100680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.325+0000 7ff7f402a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7ec1078c0 0x7ff7ec100bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.325+0000 7ff7f402a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec1011d0 con 0x7ff7ec0740d0 2024-05-10T03:41:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.325+0000 7ff7f402a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec101340 con 0x7ff7ec1078c0 2024-05-10T03:41:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.325+0000 7ff7f402a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec101500 con 0x7ff7ec104d50 2024-05-10T03:41:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.325+0000 7ff7f1dc6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7ec0740d0 0x7ff7ec101f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.325+0000 7ff7f1dc6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7ec0740d0 0x7ff7ec101f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40994/0 (socket says 172.21.15.45:40994) 2024-05-10T03:41:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.325+0000 7ff7f1dc6700 1 -- 172.21.15.45:0/543552799 learned_addr learned my addr 172.21.15.45:0/543552799 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.325+0000 7ff7f15c5700 1 --2- 172.21.15.45:0/543552799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7ec104d50 0x7ff7ec100680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.325+0000 7ff7f25c7700 1 --2- 172.21.15.45:0/543552799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7ec1078c0 0x7ff7ec100bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:42.331 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.326+0000 7ff7f1dc6700 1 -- 172.21.15.45:0/543552799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7ec104d50 msgr2=0x7ff7ec100680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:42.331 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.326+0000 7ff7f1dc6700 1 --2- 172.21.15.45:0/543552799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7ec104d50 0x7ff7ec100680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.331 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.326+0000 7ff7f1dc6700 1 -- 172.21.15.45:0/543552799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7ec1078c0 msgr2=0x7ff7ec100bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:42.331 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.326+0000 7ff7f1dc6700 1 --2- 172.21.15.45:0/543552799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7ec1078c0 0x7ff7ec100bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.331 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.326+0000 7ff7f1dc6700 1 -- 172.21.15.45:0/543552799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e80095f0 con 0x7ff7ec0740d0 2024-05-10T03:41:42.331 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.326+0000 7ff7f25c7700 1 --2- 172.21.15.45:0/543552799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7ec1078c0 0x7ff7ec100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:41:42.331 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.326+0000 7ff7f1dc6700 1 --2- 172.21.15.45:0/543552799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7ec0740d0 0x7ff7ec101f90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80098e0 tx=0x7ff7e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:42.331 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.326+0000 7ff7e2ffd700 1 -- 172.21.15.45:0/543552799 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e801d070 con 0x7ff7ec0740d0 2024-05-10T03:41:42.331 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.326+0000 7ff7e2ffd700 1 -- 172.21.15.45:0/543552799 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff7e8022470 con 0x7ff7ec0740d0 2024-05-10T03:41:42.331 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.326+0000 7ff7e2ffd700 1 -- 172.21.15.45:0/543552799 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8017650 con 0x7ff7ec0740d0 2024-05-10T03:41:42.331 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.326+0000 7ff7f402a700 1 -- 172.21.15.45:0/543552799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7ec1a2300 con 0x7ff7ec0740d0 2024-05-10T03:41:42.331 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.326+0000 7ff7f402a700 1 -- 172.21.15.45:0/543552799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7ec1a26d0 con 0x7ff7ec0740d0 2024-05-10T03:41:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.330+0000 7ff7e2ffd700 1 -- 172.21.15.45:0/543552799 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff7e8022950 con 0x7ff7ec0740d0 2024-05-10T03:41:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.330+0000 7ff80436eb80 1 Processor -- start 2024-05-10T03:41:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.331+0000 7ff80436eb80 1 -- start start 2024-05-10T03:41:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.331+0000 7ff80436eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5597e1758180 0x5597e17585b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.331+0000 7ff80436eb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5597e1759050 0x5597e1759460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.331+0000 7ff80436eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e17599a0 0x5597e17602a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.331+0000 7ff80436eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597e167f0f0 con 0x5597e1758180 2024-05-10T03:41:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.331+0000 7ff80436eb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597e167cab0 con 0x5597e1759050 2024-05-10T03:41:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.331+0000 7ff80436eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597e16783a0 con 0x5597e17599a0 2024-05-10T03:41:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.331+0000 7ff7e2ffd700 1 --2- 172.21.15.45:0/543552799 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff7d80a1120 0x7ff7d80a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.331+0000 7ff7f25c7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5597e1758180 0x5597e17585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.331+0000 7ff7f25c7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5597e1758180 0x5597e17585b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41004/0 (socket says 172.21.15.45:41004) 2024-05-10T03:41:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.331+0000 7ff7f25c7700 1 -- 172.21.15.45:0/8126896 learned_addr learned my addr 172.21.15.45:0/8126896 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.331+0000 7ff7f15c5700 1 --2- 172.21.15.45:0/8126896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e17599a0 0x5597e17602a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.331+0000 7ff7f25c7700 1 --2- 172.21.15.45:0/543552799 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff7d80a1120 0x7ff7d80a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.331+0000 7ff7e2ffd700 1 -- 172.21.15.45:0/543552799 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff7e80cde80 con 0x7ff7ec0740d0 2024-05-10T03:41:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.331+0000 7ff7f1dc6700 1 --2- 172.21.15.45:0/8126896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5597e1759050 0x5597e1759460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.332+0000 7ff7f15c5700 1 -- 172.21.15.45:0/8126896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5597e1759050 msgr2=0x5597e1759460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.332+0000 7ff7f15c5700 1 --2- 172.21.15.45:0/8126896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5597e1759050 0x5597e1759460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.332+0000 7ff7f15c5700 1 -- 172.21.15.45:0/8126896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5597e1758180 msgr2=0x5597e17585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.332+0000 7ff7f15c5700 1 --2- 172.21.15.45:0/8126896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5597e1758180 0x5597e17585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.332+0000 7ff7f15c5700 1 -- 172.21.15.45:0/8126896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597e14f9350 con 0x5597e17599a0 2024-05-10T03:41:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.332+0000 7ff7f25c7700 1 --2- 172.21.15.45:0/8126896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5597e1758180 0x5597e17585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:41:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.332+0000 7ff7f15c5700 1 --2- 172.21.15.45:0/8126896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e17599a0 0x5597e17602a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009c80 tx=0x7ff7dc009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6c9aa5e887c6380 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.332+0000 7ff7f25c7700 1 --2- 172.21.15.45:0/543552799 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff7d80a1120 0x7ff7d80a3630 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x5597e1757f20 tx=0x7ff7e400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.332+0000 7ff7d7fff700 1 -- 172.21.15.45:0/8126896 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc004310 con 0x5597e17599a0 2024-05-10T03:41:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.332+0000 7ff7d7fff700 1 -- 172.21.15.45:0/8126896 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff7dc011e10 con 0x5597e17599a0 2024-05-10T03:41:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.332+0000 7ff7d7fff700 1 -- 172.21.15.45:0/8126896 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc005280 con 0x5597e17599a0 2024-05-10T03:41:42.341 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.333+0000 7ff80436eb80 1 -- 172.21.15.45:0/8126896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e17599a0 msgr2=0x5597e17602a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:42.341 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.333+0000 7ff80436eb80 1 --2- 172.21.15.45:0/8126896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e17599a0 0x5597e17602a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009c80 tx=0x7ff7dc009f90 comp rx=0 tx=0).stop 2024-05-10T03:41:42.341 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.333+0000 7ff80436eb80 1 -- 172.21.15.45:0/8126896 shutdown_connections 2024-05-10T03:41:42.342 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.333+0000 7ff80436eb80 1 --2- 172.21.15.45:0/8126896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e17599a0 0x5597e17602a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.342 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.333+0000 7ff80436eb80 1 --2- 172.21.15.45:0/8126896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5597e1758180 0x5597e17585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.342 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.333+0000 7ff80436eb80 1 --2- 172.21.15.45:0/8126896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5597e1759050 0x5597e1759460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.342 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.333+0000 7ff80436eb80 1 -- 172.21.15.45:0/8126896 >> 172.21.15.45:0/8126896 conn(0x5597e16baa00 msgr2=0x5597e1752a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:42.342 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.333+0000 7ff80436eb80 1 -- 172.21.15.45:0/8126896 shutdown_connections 2024-05-10T03:41:42.342 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.333+0000 7ff80436eb80 1 -- 172.21.15.45:0/8126896 wait complete. 2024-05-10T03:41:42.342 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.334+0000 7ff80436eb80 1 -- start start 2024-05-10T03:41:42.342 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.334+0000 7ff80436eb80 1 Processor -- start 2024-05-10T03:41:42.342 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.334+0000 7ff80436eb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5597e1758180 0x5597e1762210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:42.342 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.334+0000 7ff80436eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5597e1759050 0x5597e1762750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:42.342 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.334+0000 7ff80436eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e17599a0 0x5597e17696b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:42.342 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.334+0000 7ff80436eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597e1614500 con 0x5597e1759050 2024-05-10T03:41:42.342 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.334+0000 7ff80436eb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597e16141a0 con 0x5597e1758180 2024-05-10T03:41:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.334+0000 7ff80436eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597e14fb640 con 0x5597e17599a0 2024-05-10T03:41:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.334+0000 7ff80436eb80 10 client.0 _ll_register_callbacks cb 0x5597e161dad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.335+0000 7ff7f1dc6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5597e1758180 0x5597e1762210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.335+0000 7ff7f1dc6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5597e1758180 0x5597e1762210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.45:45762/0 (socket says 172.21.15.45:45762) 2024-05-10T03:41:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.335+0000 7ff7f1dc6700 1 -- 172.21.15.45:0/2870957140 learned_addr learned my addr 172.21.15.45:0/2870957140 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.335+0000 7ff7f25c7700 1 --2- 172.21.15.45:0/2870957140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e17599a0 0x5597e17696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.335+0000 7ff7f1dc6700 1 -- 172.21.15.45:0/2870957140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e17599a0 msgr2=0x5597e17696b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.335+0000 7ff7f1dc6700 1 --2- 172.21.15.45:0/2870957140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e17599a0 0x5597e17696b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.335+0000 7ff7f1dc6700 1 -- 172.21.15.45:0/2870957140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5597e1759050 msgr2=0x5597e1762750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.335+0000 7ff7f1dc6700 1 --2- 172.21.15.45:0/2870957140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5597e1759050 0x5597e1762750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.335+0000 7ff7f1dc6700 1 -- 172.21.15.45:0/2870957140 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e4012d20 con 0x5597e1758180 2024-05-10T03:41:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.335+0000 7ff7f1dc6700 1 --2- 172.21.15.45:0/2870957140 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5597e1758180 0x5597e1762210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80cb950 tx=0x7ff7e8009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=346476750da8d5dc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.335+0000 7ff7d57fa700 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-05-10T03:41:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.335+0000 7ff7d57fa700 1 -- 172.21.15.45:0/2870957140 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e80a10b0 con 0x5597e1758180 2024-05-10T03:41:42.344 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.335+0000 7ff7d57fa700 1 -- 172.21.15.45:0/2870957140 <== mon.2 v2:172.21.15.106:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff7e809b6c0 con 0x5597e1758180 2024-05-10T03:41:42.344 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.335+0000 7ff80436eb80 1 -- 172.21.15.45:0/2870957140 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5597e15d1210 con 0x5597e1758180 2024-05-10T03:41:42.344 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.336+0000 7ff7d57fa700 1 -- 172.21.15.45:0/2870957140 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7e80a33b0 con 0x5597e1758180 2024-05-10T03:41:42.344 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.336+0000 7ff80436eb80 10 client.25931 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:42.344 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.336+0000 7ff80436eb80 1 -- 172.21.15.45:0/2870957140 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7ff7dc0098e0 con 0x5597e1758180 2024-05-10T03:41:42.344 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.336+0000 7ff7d57fa700 1 -- 172.21.15.45:0/2870957140 <== mon.2 v2:172.21.15.106:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff7e80b9030 con 0x5597e1758180 2024-05-10T03:41:42.344 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.336+0000 7ff7d57fa700 1 -- 172.21.15.45:0/2870957140 <== mon.2 v2:172.21.15.106:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ff7e809b220 con 0x5597e1758180 2024-05-10T03:41:42.344 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.336+0000 7ff80436eb80 10 client.25931 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:42.344 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.336+0000 7ff80436eb80 10 client.25931 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:41:42.344 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.336+0000 7ff80436eb80 20 client.25931 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:42.344 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.336+0000 7ff80436eb80 1 --2- 172.21.15.45:0/2870957140 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5597e176dba0 0x5597e176fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:42.344 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.336+0000 7ff80436eb80 4 client.25931 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:41:42.344 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.336+0000 7ff80436eb80 1 -- 172.21.15.45:0/2870957140 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5597e1727720 con 0x5597e176dba0 2024-05-10T03:41:42.344 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.336+0000 7ff7f15c5700 1 --2- 172.21.15.45:0/2870957140 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5597e176dba0 0x5597e176fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:42.345 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.337+0000 7ff7d57fa700 10 client.25931 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:42.345 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.337+0000 7ff7f15c5700 1 --2- 172.21.15.45:0/2870957140 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5597e176dba0 0x5597e176fff0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5f2a668434f6220 server_cookie=d0f72d3de39d34c2 in_seq=0 out_seq=0 2024-05-10T03:41:42.345 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.338+0000 7ff7d57fa700 1 -- 172.21.15.45:0/2870957140 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5597e1727720 con 0x5597e176dba0 2024-05-10T03:41:42.345 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.338+0000 7ff7d57fa700 10 client.25931 handle_command_reply: tid=0 2024-05-10T03:41:42.345 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.338+0000 7ff80436eb80 1 client.25931 shutdown 2024-05-10T03:41:42.345 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.338+0000 7ff80436eb80 1 -- 172.21.15.45:0/2870957140 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5597e1758180 msgr2=0x5597e1762210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:42.345 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.338+0000 7ff80436eb80 1 --2- 172.21.15.45:0/2870957140 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5597e1758180 0x5597e1762210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80cb950 tx=0x7ff7e8009ca0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.345 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.338+0000 7ff80436eb80 1 -- 172.21.15.45:0/2870957140 shutdown_connections 2024-05-10T03:41:42.345 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.338+0000 7ff80436eb80 1 --2- 172.21.15.45:0/2870957140 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5597e176dba0 0x5597e176fff0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.345 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.338+0000 7ff80436eb80 1 --2- 172.21.15.45:0/2870957140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e17599a0 0x5597e17696b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.345 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.338+0000 7ff7d57fa700 0 client.25931 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:42.345 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.338+0000 7ff80436eb80 1 --2- 172.21.15.45:0/2870957140 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5597e1758180 0x5597e1762210 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.338+0000 7ff80436eb80 1 --2- 172.21.15.45:0/2870957140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5597e1759050 0x5597e1762750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.338+0000 7ff80436eb80 1 -- 172.21.15.45:0/2870957140 >> 172.21.15.45:0/2870957140 conn(0x5597e16baa00 msgr2=0x5597e1752a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.338+0000 7ff80436eb80 1 -- 172.21.15.45:0/2870957140 shutdown_connections 2024-05-10T03:41:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.338+0000 7ff80436eb80 1 -- 172.21.15.45:0/2870957140 wait complete. 2024-05-10T03:41:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.338+0000 7ff80436eb80 20 client.25931 trim_cache size 0 max 16384 2024-05-10T03:41:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.354+0000 7ff80436eb80 1 Processor -- start 2024-05-10T03:41:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.354+0000 7ff80436eb80 1 -- start start 2024-05-10T03:41:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.354+0000 7ff80436eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5597e1758180 0x5597e17605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.354+0000 7ff80436eb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5597e1759050 0x5597e1769670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.354+0000 7ff80436eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e17599a0 0x5597e1760b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.354+0000 7ff80436eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597e17602c0 con 0x5597e1758180 2024-05-10T03:41:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.354+0000 7ff80436eb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597e1758e40 con 0x5597e1759050 2024-05-10T03:41:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.354+0000 7ff80436eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597e175db20 con 0x5597e17599a0 2024-05-10T03:41:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.354+0000 7ff7f1dc6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5597e1758180 0x5597e17605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.354+0000 7ff7f1dc6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5597e1758180 0x5597e17605d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41018/0 (socket says 172.21.15.45:41018) 2024-05-10T03:41:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.355+0000 7ff7f1dc6700 1 -- 172.21.15.45:0/476264403 learned_addr learned my addr 172.21.15.45:0/476264403 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.355+0000 7ff7f15c5700 1 --2- 172.21.15.45:0/476264403 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5597e1759050 0x5597e1769670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.355+0000 7ff7f25c7700 1 --2- 172.21.15.45:0/476264403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e17599a0 0x5597e1760b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.355+0000 7ff7f1dc6700 1 -- 172.21.15.45:0/476264403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e17599a0 msgr2=0x5597e1760b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.355+0000 7ff7f1dc6700 1 --2- 172.21.15.45:0/476264403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e17599a0 0x5597e1760b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.355+0000 7ff7f1dc6700 1 -- 172.21.15.45:0/476264403 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5597e1759050 msgr2=0x5597e1769670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.355+0000 7ff7f1dc6700 1 --2- 172.21.15.45:0/476264403 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5597e1759050 0x5597e1769670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.355+0000 7ff7f1dc6700 1 -- 172.21.15.45:0/476264403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597e14a5b00 con 0x5597e1758180 2024-05-10T03:41:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.355+0000 7ff7f15c5700 1 --2- 172.21.15.45:0/476264403 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5597e1759050 0x5597e1769670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:41:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.355+0000 7ff7f1dc6700 1 --2- 172.21.15.45:0/476264403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5597e1758180 0x5597e17605d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8006010 tx=0x7ff7e8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3599d05ab4158596 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.355+0000 7ff7e0ff9700 1 -- 172.21.15.45:0/476264403 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8095bd0 con 0x5597e1758180 2024-05-10T03:41:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.355+0000 7ff7e0ff9700 1 -- 172.21.15.45:0/476264403 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff7e80b9040 con 0x5597e1758180 2024-05-10T03:41:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.355+0000 7ff7e0ff9700 1 -- 172.21.15.45:0/476264403 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8099360 con 0x5597e1758180 2024-05-10T03:41:42.363 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.356+0000 7ff80436eb80 1 -- 172.21.15.45:0/476264403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5597e1758180 msgr2=0x5597e17605d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:42.363 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.356+0000 7ff80436eb80 1 --2- 172.21.15.45:0/476264403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5597e1758180 0x5597e17605d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8006010 tx=0x7ff7e8009310 comp rx=0 tx=0).stop 2024-05-10T03:41:42.364 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.356+0000 7ff80436eb80 1 -- 172.21.15.45:0/476264403 shutdown_connections 2024-05-10T03:41:42.364 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.356+0000 7ff80436eb80 1 --2- 172.21.15.45:0/476264403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e17599a0 0x5597e1760b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.364 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.356+0000 7ff80436eb80 1 --2- 172.21.15.45:0/476264403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5597e1758180 0x5597e17605d0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.364 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.356+0000 7ff80436eb80 1 --2- 172.21.15.45:0/476264403 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5597e1759050 0x5597e1769670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.364 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.356+0000 7ff80436eb80 1 -- 172.21.15.45:0/476264403 >> 172.21.15.45:0/476264403 conn(0x5597e16baa00 msgr2=0x5597e175cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:42.364 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.356+0000 7ff80436eb80 1 -- 172.21.15.45:0/476264403 shutdown_connections 2024-05-10T03:41:42.364 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.356+0000 7ff80436eb80 1 -- 172.21.15.45:0/476264403 wait complete. 2024-05-10T03:41:42.364 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.357+0000 7ff80436eb80 1 -- start start 2024-05-10T03:41:42.364 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.357+0000 7ff80436eb80 1 Processor -- start 2024-05-10T03:41:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.357+0000 7ff80436eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e1758180 0x5597e17669a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.357+0000 7ff80436eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5597e1759050 0x5597e1766ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.357+0000 7ff80436eb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5597e17599a0 0x5597e1767e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.357+0000 7ff80436eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597e1768350 con 0x5597e1759050 2024-05-10T03:41:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.357+0000 7ff80436eb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597e17684c0 con 0x5597e17599a0 2024-05-10T03:41:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.357+0000 7ff80436eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597e1768680 con 0x5597e1758180 2024-05-10T03:41:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.358+0000 7ff80436eb80 10 client.0 _ll_register_callbacks cb 0x5597e161dad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.358+0000 7ff7f15c5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5597e1759050 0x5597e1766ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.358+0000 7ff7f1dc6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e1758180 0x5597e17669a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.358+0000 7ff7f15c5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5597e1759050 0x5597e1766ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41028/0 (socket says 172.21.15.45:41028) 2024-05-10T03:41:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.358+0000 7ff7f15c5700 1 -- 172.21.15.45:0/2507465275 learned_addr learned my addr 172.21.15.45:0/2507465275 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.358+0000 7ff7f25c7700 1 --2- 172.21.15.45:0/2507465275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5597e17599a0 0x5597e1767e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.358+0000 7ff7f15c5700 1 -- 172.21.15.45:0/2507465275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e1758180 msgr2=0x5597e17669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:42.365 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.358+0000 7ff7f15c5700 1 --2- 172.21.15.45:0/2507465275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e1758180 0x5597e17669a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.366 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.358+0000 7ff7f15c5700 1 -- 172.21.15.45:0/2507465275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5597e17599a0 msgr2=0x5597e1767e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:42.366 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.358+0000 7ff7f15c5700 1 --2- 172.21.15.45:0/2507465275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5597e17599a0 0x5597e1767e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.366 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.358+0000 7ff7f15c5700 1 -- 172.21.15.45:0/2507465275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7dc01d040 con 0x5597e1759050 2024-05-10T03:41:42.366 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.358+0000 7ff7f1dc6700 1 --2- 172.21.15.45:0/2507465275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e1758180 0x5597e17669a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:41:42.366 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.358+0000 7ff7f15c5700 1 --2- 172.21.15.45:0/2507465275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5597e1759050 0x5597e1766ee0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc014040 tx=0x7ff7dc004900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c0e14d3b0d1a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:42.366 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.358+0000 7ff7d57fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:41:42.366 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.358+0000 7ff7d57fa700 1 -- 172.21.15.45:0/2507465275 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc011a30 con 0x5597e1759050 2024-05-10T03:41:42.366 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.358+0000 7ff7d57fa700 1 -- 172.21.15.45:0/2507465275 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff7dc011b90 con 0x5597e1759050 2024-05-10T03:41:42.366 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.358+0000 7ff80436eb80 1 -- 172.21.15.45:0/2507465275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff7dc011e10 con 0x5597e1759050 2024-05-10T03:41:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.359+0000 7ff7d57fa700 1 -- 172.21.15.45:0/2507465275 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7dc004110 con 0x5597e1759050 2024-05-10T03:41:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.359+0000 7ff80436eb80 10 client.16098 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.359+0000 7ff80436eb80 1 -- 172.21.15.45:0/2507465275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7ff7dc0098e0 con 0x5597e1759050 2024-05-10T03:41:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.359+0000 7ff7d57fa700 1 -- 172.21.15.45:0/2507465275 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff7dc011e10 con 0x5597e1759050 2024-05-10T03:41:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.359+0000 7ff7d57fa700 1 -- 172.21.15.45:0/2507465275 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ff7dc0260b0 con 0x5597e1759050 2024-05-10T03:41:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.359+0000 7ff80436eb80 10 client.16098 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.359+0000 7ff80436eb80 10 client.16098 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:41:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.359+0000 7ff80436eb80 20 client.16098 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.359+0000 7ff80436eb80 1 --2- 172.21.15.45:0/2507465275 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5597e17c4420 0x5597e17c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:42.367 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.359+0000 7ff80436eb80 4 client.16098 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T03:41:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.359+0000 7ff80436eb80 1 -- 172.21.15.45:0/2507465275 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5597e1670e60 con 0x5597e17c4420 2024-05-10T03:41:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.359+0000 7ff7f1dc6700 1 --2- 172.21.15.45:0/2507465275 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5597e17c4420 0x5597e17c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.360+0000 7ff7d57fa700 10 client.16098 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:42.368 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.360+0000 7ff7f1dc6700 1 --2- 172.21.15.45:0/2507465275 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5597e17c4420 0x5597e17c6840 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=997da442a9622d5b server_cookie=8cb89f4b26e3c891 in_seq=0 out_seq=0 2024-05-10T03:41:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.364+0000 7ff7d57fa700 1 -- 172.21.15.45:0/2507465275 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5597e1670e60 con 0x5597e17c4420 2024-05-10T03:41:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.364+0000 7ff7d57fa700 10 client.16098 handle_command_reply: tid=0 2024-05-10T03:41:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.364+0000 7ff80436eb80 1 client.16098 shutdown 2024-05-10T03:41:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.364+0000 7ff80436eb80 1 -- 172.21.15.45:0/2507465275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5597e1759050 msgr2=0x5597e1766ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.364+0000 7ff80436eb80 1 --2- 172.21.15.45:0/2507465275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5597e1759050 0x5597e1766ee0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc014040 tx=0x7ff7dc004900 comp rx=0 tx=0).stop 2024-05-10T03:41:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.364+0000 7ff80436eb80 1 -- 172.21.15.45:0/2507465275 shutdown_connections 2024-05-10T03:41:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.364+0000 7ff80436eb80 1 --2- 172.21.15.45:0/2507465275 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5597e17c4420 0x5597e17c6840 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.369 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.364+0000 7ff80436eb80 1 --2- 172.21.15.45:0/2507465275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e1758180 0x5597e17669a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.364+0000 7ff80436eb80 1 --2- 172.21.15.45:0/2507465275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5597e17599a0 0x5597e1767e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.364+0000 7ff7d57fa700 0 client.16098 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.364+0000 7ff80436eb80 1 --2- 172.21.15.45:0/2507465275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5597e1759050 0x5597e1766ee0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.364+0000 7ff80436eb80 1 -- 172.21.15.45:0/2507465275 >> 172.21.15.45:0/2507465275 conn(0x5597e16baa00 msgr2=0x5597e1760550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.364+0000 7ff80436eb80 1 -- 172.21.15.45:0/2507465275 shutdown_connections 2024-05-10T03:41:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.364+0000 7ff80436eb80 1 -- 172.21.15.45:0/2507465275 wait complete. 2024-05-10T03:41:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.364+0000 7ff80436eb80 20 client.16098 trim_cache size 0 max 16384 2024-05-10T03:41:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:{ 2024-05-10T03:41:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "message": "", 2024-05-10T03:41:42.370 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "return_code": 0 2024-05-10T03:41:42.371 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:} 2024-05-10T03:41:42.371 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.365+0000 7ff7f402a700 1 -- 172.21.15.45:0/543552799 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff7d80a1120 msgr2=0x7ff7d80a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:42.371 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.365+0000 7ff7f402a700 1 --2- 172.21.15.45:0/543552799 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff7d80a1120 0x7ff7d80a3630 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x5597e1757f20 tx=0x7ff7e400b040 comp rx=0 tx=0).stop 2024-05-10T03:41:42.371 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.365+0000 7ff7f402a700 1 -- 172.21.15.45:0/543552799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7ec0740d0 msgr2=0x7ff7ec101f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:42.371 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.365+0000 7ff7f402a700 1 --2- 172.21.15.45:0/543552799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7ec0740d0 0x7ff7ec101f90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80098e0 tx=0x7ff7e8004730 comp rx=0 tx=0).stop 2024-05-10T03:41:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.365+0000 7ff7f402a700 1 -- 172.21.15.45:0/543552799 shutdown_connections 2024-05-10T03:41:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.365+0000 7ff7f402a700 1 --2- 172.21.15.45:0/543552799 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff7d80a1120 0x7ff7d80a3630 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.365+0000 7ff7f402a700 1 --2- 172.21.15.45:0/543552799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7ec1078c0 0x7ff7ec100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.365+0000 7ff7f402a700 1 --2- 172.21.15.45:0/543552799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7ec0740d0 0x7ff7ec101f90 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.365+0000 7ff7f402a700 1 --2- 172.21.15.45:0/543552799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7ec104d50 0x7ff7ec100680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.365+0000 7ff7f402a700 1 -- 172.21.15.45:0/543552799 >> 172.21.15.45:0/543552799 conn(0x7ff7ec0fc0f0 msgr2=0x7ff7ec1043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.365+0000 7ff7f402a700 1 -- 172.21.15.45:0/543552799 shutdown_connections 2024-05-10T03:41:42.372 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:42.365+0000 7ff7f402a700 1 -- 172.21.15.45:0/543552799 wait complete. 2024-05-10T03:41:43.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:43 smithi106 ceph-mon[46996]: pgmap v328: 129 pgs: 129 active+clean; 672 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 11 op/s 2024-05-10T03:41:43.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:43 smithi154 ceph-mon[46565]: pgmap v328: 129 pgs: 129 active+clean; 672 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 11 op/s 2024-05-10T03:41:43.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:43 smithi045 ceph-mon[42520]: pgmap v328: 129 pgs: 129 active+clean; 672 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 11 op/s 2024-05-10T03:41:45.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:45 smithi106 ceph-mon[46996]: pgmap v329: 129 pgs: 129 active+clean; 672 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-10T03:41:45.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:45 smithi154 ceph-mon[46565]: pgmap v329: 129 pgs: 129 active+clean; 672 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-10T03:41:45.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:45 smithi045 ceph-mon[42520]: pgmap v329: 129 pgs: 129 active+clean; 672 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-10T03:41:47.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:47 smithi106 ceph-mon[46996]: pgmap v330: 129 pgs: 129 active+clean; 673 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:41:47.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:47 smithi154 ceph-mon[46565]: pgmap v330: 129 pgs: 129 active+clean; 673 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:41:47.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:47 smithi045 ceph-mon[42520]: pgmap v330: 129 pgs: 129 active+clean; 673 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:41:49.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:49 smithi106 ceph-mon[46996]: pgmap v331: 129 pgs: 129 active+clean; 673 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:41:49.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:49 smithi154 ceph-mon[46565]: pgmap v331: 129 pgs: 129 active+clean; 673 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:41:49.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:49 smithi045 ceph-mon[42520]: pgmap v331: 129 pgs: 129 active+clean; 673 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:41:51.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:51 smithi106 ceph-mon[46996]: pgmap v332: 129 pgs: 129 active+clean; 673 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:41:51.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:51 smithi154 ceph-mon[46565]: pgmap v332: 129 pgs: 129 active+clean; 673 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:41:51.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:51 smithi045 ceph-mon[42520]: pgmap v332: 129 pgs: 129 active+clean; 673 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:41:53.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:53 smithi106 ceph-mon[46996]: pgmap v333: 129 pgs: 129 active+clean; 673 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:41:53.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:53 smithi154 ceph-mon[46565]: pgmap v333: 129 pgs: 129 active+clean; 673 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:41:53.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:53 smithi045 ceph-mon[42520]: pgmap v333: 129 pgs: 129 active+clean; 673 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:41:55.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:55 smithi106 ceph-mon[46996]: pgmap v334: 129 pgs: 129 active+clean; 673 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:41:55.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:55 smithi154 ceph-mon[46565]: pgmap v334: 129 pgs: 129 active+clean; 673 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:41:55.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:55 smithi045 ceph-mon[42520]: pgmap v334: 129 pgs: 129 active+clean; 673 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:41:55.568 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.565+0000 7f2c0c2ca700 1 -- 172.21.15.45:0/2211777990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c04100ae0 msgr2=0x7f2c04100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:55.568 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.565+0000 7f2c0c2ca700 1 --2- 172.21.15.45:0/2211777990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c04100ae0 0x7f2c04100ef0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f2c000098f0 tx=0x7f2c00009c00 comp rx=0 tx=0).stop 2024-05-10T03:41:55.568 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.565+0000 7f2c0c2ca700 1 -- 172.21.15.45:0/2211777990 shutdown_connections 2024-05-10T03:41:55.568 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.565+0000 7f2c0c2ca700 1 --2- 172.21.15.45:0/2211777990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c041025a0 0x7f2c04108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.568 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.565+0000 7f2c0c2ca700 1 --2- 172.21.15.45:0/2211777990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c04100ae0 0x7f2c04100ef0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.568 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.565+0000 7f2c0c2ca700 1 --2- 172.21.15.45:0/2211777990 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c04101c00 0x7f2c04102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.568 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.565+0000 7f2c0c2ca700 1 -- 172.21.15.45:0/2211777990 >> 172.21.15.45:0/2211777990 conn(0x7f2c040fc0f0 msgr2=0x7f2c040fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:55.569 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.565+0000 7f2c0c2ca700 1 -- 172.21.15.45:0/2211777990 shutdown_connections 2024-05-10T03:41:55.569 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.566+0000 7f2c0c2ca700 1 -- 172.21.15.45:0/2211777990 wait complete. 2024-05-10T03:41:55.569 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.567+0000 7f2c0c2ca700 1 Processor -- start 2024-05-10T03:41:55.569 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.567+0000 7f2c0c2ca700 1 -- start start 2024-05-10T03:41:55.569 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.567+0000 7f2c0c2ca700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c04100ae0 0x7f2c04073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:55.569 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.567+0000 7f2c0c2ca700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c04101c00 0x7f2c0419f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:55.570 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.567+0000 7f2c0c2ca700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c041025a0 0x7f2c041a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:55.570 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.567+0000 7f2c0c2ca700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c041a1d20 con 0x7f2c041025a0 2024-05-10T03:41:55.570 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.567+0000 7f2c0c2ca700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0419ae80 con 0x7f2c04100ae0 2024-05-10T03:41:55.570 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.567+0000 7f2c0c2ca700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0419b040 con 0x7f2c04101c00 2024-05-10T03:41:55.571 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.567+0000 7f2c09865700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c04101c00 0x7f2c0419f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:55.571 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.567+0000 7f2c09865700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c04101c00 0x7f2c0419f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:33492/0 (socket says 172.21.15.45:33492) 2024-05-10T03:41:55.571 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.567+0000 7f2c09865700 1 -- 172.21.15.45:0/372949334 learned_addr learned my addr 172.21.15.45:0/372949334 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:55.571 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.568+0000 7f2c0a066700 1 --2- 172.21.15.45:0/372949334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c04100ae0 0x7f2c04073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:55.572 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.568+0000 7f2c0a867700 1 --2- 172.21.15.45:0/372949334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c041025a0 0x7f2c041a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:55.572 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.568+0000 7f2c09865700 1 -- 172.21.15.45:0/372949334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c04100ae0 msgr2=0x7f2c04073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:55.572 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.568+0000 7f2c09865700 1 --2- 172.21.15.45:0/372949334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c04100ae0 0x7f2c04073ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.572 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.568+0000 7f2c09865700 1 -- 172.21.15.45:0/372949334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c041025a0 msgr2=0x7f2c041a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:55.572 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.568+0000 7f2c09865700 1 --2- 172.21.15.45:0/372949334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c041025a0 0x7f2c041a17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.572 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.568+0000 7f2c09865700 1 -- 172.21.15.45:0/372949334 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf40095f0 con 0x7f2c04101c00 2024-05-10T03:41:55.572 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.568+0000 7f2c0a066700 1 --2- 172.21.15.45:0/372949334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c04100ae0 0x7f2c04073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:41:55.572 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.568+0000 7f2c09865700 1 --2- 172.21.15.45:0/372949334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c04101c00 0x7f2c0419f290 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2bf400ec10 tx=0x7f2bf400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:55.572 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.568+0000 7f2bfb7fe700 1 -- 172.21.15.45:0/372949334 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf400cc90 con 0x7f2c04101c00 2024-05-10T03:41:55.572 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.569+0000 7f2bfb7fe700 1 -- 172.21.15.45:0/372949334 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2bf4004500 con 0x7f2c04101c00 2024-05-10T03:41:55.572 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.569+0000 7f2bfb7fe700 1 -- 172.21.15.45:0/372949334 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4010690 con 0x7f2c04101c00 2024-05-10T03:41:55.572 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.569+0000 7f2c0c2ca700 1 -- 172.21.15.45:0/372949334 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c00009520 con 0x7f2c04101c00 2024-05-10T03:41:55.572 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.569+0000 7f2c0c2ca700 1 -- 172.21.15.45:0/372949334 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c0419b650 con 0x7f2c04101c00 2024-05-10T03:41:55.576 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.573+0000 7f2bfb7fe700 1 -- 172.21.15.45:0/372949334 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2bf4003780 con 0x7f2c04101c00 2024-05-10T03:41:55.576 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.574+0000 7f2c1c60eb80 1 Processor -- start 2024-05-10T03:41:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.574+0000 7f2c1c60eb80 1 -- start start 2024-05-10T03:41:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.575+0000 7f2bfb7fe700 1 --2- 172.21.15.45:0/372949334 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2bf00a1120 0x7f2bf00a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.575+0000 7f2c1c60eb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9628180 0x55e3d96285b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.575+0000 7f2c1c60eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3d9629050 0x55e3d9629460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.575+0000 7f2c1c60eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3d96299a0 0x55e3d96302a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.575+0000 7f2c1c60eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3d954f0f0 con 0x55e3d96299a0 2024-05-10T03:41:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.575+0000 7f2c1c60eb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3d954cab0 con 0x55e3d9628180 2024-05-10T03:41:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.575+0000 7f2c1c60eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3d95483a0 con 0x55e3d9629050 2024-05-10T03:41:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.575+0000 7f2bfb7fe700 1 -- 172.21.15.45:0/372949334 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f2bf4014070 con 0x7f2c04101c00 2024-05-10T03:41:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.575+0000 7f2c09865700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3d9629050 0x55e3d9629460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:55.579 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.575+0000 7f2c0a066700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9628180 0x55e3d96285b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:55.579 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.575+0000 7f2c09865700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3d9629050 0x55e3d9629460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:33494/0 (socket says 172.21.15.45:33494) 2024-05-10T03:41:55.579 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.575+0000 7f2c09865700 1 -- 172.21.15.45:0/4042243139 learned_addr learned my addr 172.21.15.45:0/4042243139 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:55.579 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.576+0000 7f2c0a867700 1 --2- 172.21.15.45:0/4042243139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3d96299a0 0x55e3d96302a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:55.579 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.576+0000 7f2c0a867700 1 --2- 172.21.15.45:0/372949334 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2bf00a1120 0x7f2bf00a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:55.579 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.576+0000 7f2c09865700 1 -- 172.21.15.45:0/4042243139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9628180 msgr2=0x55e3d96285b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:55.579 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.576+0000 7f2c09865700 1 --2- 172.21.15.45:0/4042243139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9628180 0x55e3d96285b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.579 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.576+0000 7f2c09865700 1 -- 172.21.15.45:0/4042243139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3d96299a0 msgr2=0x55e3d96302a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:55.579 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.576+0000 7f2c09865700 1 --2- 172.21.15.45:0/4042243139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3d96299a0 0x55e3d96302a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.579 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.576+0000 7f2c09865700 1 -- 172.21.15.45:0/4042243139 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3d93c9350 con 0x55e3d9629050 2024-05-10T03:41:55.579 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.576+0000 7f2c0a066700 1 --2- 172.21.15.45:0/4042243139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9628180 0x55e3d96285b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:41:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.576+0000 7f2c09865700 1 --2- 172.21.15.45:0/4042243139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3d9629050 0x55e3d9629460 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2bf40a20e0 tx=0x7f2bf4000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=feafe983a35be38a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.576+0000 7f2bf8d7f700 1 -- 172.21.15.45:0/4042243139 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf409a890 con 0x55e3d9629050 2024-05-10T03:41:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.576+0000 7f2bf8d7f700 1 -- 172.21.15.45:0/4042243139 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2bf409a190 con 0x55e3d9629050 2024-05-10T03:41:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.576+0000 7f2bf8d7f700 1 -- 172.21.15.45:0/4042243139 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf40ca950 con 0x55e3d9629050 2024-05-10T03:41:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.578+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/4042243139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3d9629050 msgr2=0x55e3d9629460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.578+0000 7f2c1c60eb80 1 --2- 172.21.15.45:0/4042243139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3d9629050 0x55e3d9629460 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2bf40a20e0 tx=0x7f2bf4000bc0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.578+0000 7f2c0a867700 1 --2- 172.21.15.45:0/372949334 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2bf00a1120 0x7f2bf00a3630 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc0060b0 tx=0x7f2bfc007950 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.578+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/4042243139 shutdown_connections 2024-05-10T03:41:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.578+0000 7f2c1c60eb80 1 --2- 172.21.15.45:0/4042243139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3d96299a0 0x55e3d96302a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.578+0000 7f2c1c60eb80 1 --2- 172.21.15.45:0/4042243139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9628180 0x55e3d96285b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.578+0000 7f2c1c60eb80 1 --2- 172.21.15.45:0/4042243139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3d9629050 0x55e3d9629460 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.578+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/4042243139 >> 172.21.15.45:0/4042243139 conn(0x55e3d958aa00 msgr2=0x55e3d9622a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.578+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/4042243139 shutdown_connections 2024-05-10T03:41:55.582 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.578+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/4042243139 wait complete. 2024-05-10T03:41:55.582 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.579+0000 7f2c1c60eb80 1 -- start start 2024-05-10T03:41:55.582 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.579+0000 7f2c1c60eb80 1 Processor -- start 2024-05-10T03:41:55.582 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.579+0000 7f2c1c60eb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9628180 0x55e3d96431b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:55.582 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.579+0000 7f2c1c60eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3d9629050 0x55e3d96436f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:55.582 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.579+0000 7f2c1c60eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3d96299a0 0x55e3d964a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:55.582 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.579+0000 7f2c1c60eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3d94e4500 con 0x55e3d96299a0 2024-05-10T03:41:55.582 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.579+0000 7f2c1c60eb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3d94e41a0 con 0x55e3d9628180 2024-05-10T03:41:55.582 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.579+0000 7f2c1c60eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3d93cb640 con 0x55e3d9629050 2024-05-10T03:41:55.582 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.579+0000 7f2c1c60eb80 10 client.0 _ll_register_callbacks cb 0x55e3d94edad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:55.583 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.580+0000 7f2c0a066700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9628180 0x55e3d96431b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:55.584 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.580+0000 7f2c09865700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3d9629050 0x55e3d96436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:55.584 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.580+0000 7f2c0a066700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9628180 0x55e3d96431b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.45:35188/0 (socket says 172.21.15.45:35188) 2024-05-10T03:41:55.584 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.580+0000 7f2c09865700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3d9629050 0x55e3d96436f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:33496/0 (socket says 172.21.15.45:33496) 2024-05-10T03:41:55.584 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.580+0000 7f2c0a066700 1 -- 172.21.15.45:0/3845246386 learned_addr learned my addr 172.21.15.45:0/3845246386 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:55.584 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.580+0000 7f2c0a066700 1 -- 172.21.15.45:0/3845246386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3d9629050 msgr2=0x55e3d96436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:55.584 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.580+0000 7f2c0a066700 1 --2- 172.21.15.45:0/3845246386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3d9629050 0x55e3d96436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.584 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.580+0000 7f2c0a066700 1 -- 172.21.15.45:0/3845246386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3d96299a0 msgr2=0x55e3d964a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:55.584 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.580+0000 7f2c0a066700 1 --2- 172.21.15.45:0/3845246386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3d96299a0 0x55e3d964a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.584 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.580+0000 7f2c0a066700 1 -- 172.21.15.45:0/3845246386 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c041098e0 con 0x55e3d9628180 2024-05-10T03:41:55.584 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.580+0000 7f2c09865700 1 --2- 172.21.15.45:0/3845246386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3d9629050 0x55e3d96436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:41:55.584 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.580+0000 7f2c0a066700 1 --2- 172.21.15.45:0/3845246386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9628180 0x55e3d96431b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2c000098c0 tx=0x7f2c00005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f83bd5fedfd12979 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:55.584 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.580+0000 7f2bedffb700 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-05-10T03:41:55.584 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.581+0000 7f2bedffb700 1 -- 172.21.15.45:0/3845246386 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0001d050 con 0x55e3d9628180 2024-05-10T03:41:55.585 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.581+0000 7f2bedffb700 1 -- 172.21.15.45:0/3845246386 <== mon.2 v2:172.21.15.106:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f2c0000b760 con 0x55e3d9628180 2024-05-10T03:41:55.585 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.581+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/3845246386 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e3d94a1210 con 0x55e3d9628180 2024-05-10T03:41:55.585 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.581+0000 7f2bedffb700 1 -- 172.21.15.45:0/3845246386 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c00005720 con 0x55e3d9628180 2024-05-10T03:41:55.585 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.581+0000 7f2c1c60eb80 10 client.25949 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:55.585 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.581+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/3845246386 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f2c0419b650 con 0x55e3d9628180 2024-05-10T03:41:55.585 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.581+0000 7f2bedffb700 1 -- 172.21.15.45:0/3845246386 <== mon.2 v2:172.21.15.106:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55e3d94a1210 con 0x55e3d9628180 2024-05-10T03:41:55.586 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.582+0000 7f2bedffb700 1 -- 172.21.15.45:0/3845246386 <== mon.2 v2:172.21.15.106:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2c00015020 con 0x55e3d9628180 2024-05-10T03:41:55.586 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.582+0000 7f2c1c60eb80 10 client.25949 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:55.586 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.582+0000 7f2c1c60eb80 10 client.25949 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:41:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.582+0000 7f2c1c60eb80 20 client.25949 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.582+0000 7f2c1c60eb80 1 --2- 172.21.15.45:0/3845246386 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55e3d965fec0 0x55e3d9662310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.582+0000 7f2c1c60eb80 4 client.25949 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:41:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.582+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/3845246386 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e3d95f7720 con 0x55e3d965fec0 2024-05-10T03:41:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.582+0000 7f2c09865700 1 --2- 172.21.15.45:0/3845246386 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55e3d965fec0 0x55e3d9662310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.583+0000 7f2bedffb700 10 client.25949 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.583+0000 7f2c09865700 1 --2- 172.21.15.45:0/3845246386 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55e3d965fec0 0x55e3d9662310 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=414aa910941999d7 server_cookie=d2a1406466937318 in_seq=0 out_seq=0 2024-05-10T03:41:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.583+0000 7f2bedffb700 1 -- 172.21.15.45:0/3845246386 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e3d95f7720 con 0x55e3d965fec0 2024-05-10T03:41:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.583+0000 7f2bedffb700 10 client.25949 handle_command_reply: tid=0 2024-05-10T03:41:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.584+0000 7f2c1c60eb80 1 client.25949 shutdown 2024-05-10T03:41:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.584+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/3845246386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9628180 msgr2=0x55e3d96431b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.584+0000 7f2c1c60eb80 1 --2- 172.21.15.45:0/3845246386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9628180 0x55e3d96431b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2c000098c0 tx=0x7f2c00005270 comp rx=0 tx=0).stop 2024-05-10T03:41:55.587 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.584+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/3845246386 shutdown_connections 2024-05-10T03:41:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.584+0000 7f2c1c60eb80 1 --2- 172.21.15.45:0/3845246386 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55e3d965fec0 0x55e3d9662310 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.584+0000 7f2c1c60eb80 1 --2- 172.21.15.45:0/3845246386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3d96299a0 0x55e3d964a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.584+0000 7f2c1c60eb80 1 --2- 172.21.15.45:0/3845246386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9628180 0x55e3d96431b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.584+0000 7f2c1c60eb80 1 --2- 172.21.15.45:0/3845246386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3d9629050 0x55e3d96436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.584+0000 7f2bedffb700 0 client.25949 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.584+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/3845246386 >> 172.21.15.45:0/3845246386 conn(0x55e3d958aa00 msgr2=0x55e3d9622a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.584+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/3845246386 shutdown_connections 2024-05-10T03:41:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.584+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/3845246386 wait complete. 2024-05-10T03:41:55.588 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.585+0000 7f2c1c60eb80 20 client.25949 trim_cache size 0 max 16384 2024-05-10T03:41:55.616 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.614+0000 7f2c1c60eb80 1 Processor -- start 2024-05-10T03:41:55.618 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.614+0000 7f2c1c60eb80 1 -- start start 2024-05-10T03:41:55.618 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.614+0000 7f2c1c60eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3d9628180 0x55e3d9629460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:55.618 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.614+0000 7f2c1c60eb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9629050 0x55e3d964a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:55.618 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.614+0000 7f2c1c60eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3d96299a0 0x55e3d96622e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:55.618 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.614+0000 7f2c1c60eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3d961d360 con 0x55e3d9628180 2024-05-10T03:41:55.618 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.614+0000 7f2c1c60eb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3d9630170 con 0x55e3d9629050 2024-05-10T03:41:55.618 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.614+0000 7f2c1c60eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3d962da40 con 0x55e3d96299a0 2024-05-10T03:41:55.618 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.615+0000 7f2c0a066700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3d9628180 0x55e3d9629460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:55.618 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.615+0000 7f2c0a066700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3d9628180 0x55e3d9629460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37574/0 (socket says 172.21.15.45:37574) 2024-05-10T03:41:55.618 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.615+0000 7f2c0a066700 1 -- 172.21.15.45:0/2461018712 learned_addr learned my addr 172.21.15.45:0/2461018712 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:55.619 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.615+0000 7f2c09865700 1 --2- 172.21.15.45:0/2461018712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9629050 0x55e3d964a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:55.619 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.615+0000 7f2c09865700 1 -- 172.21.15.45:0/2461018712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3d96299a0 msgr2=0x55e3d96622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:55.619 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.615+0000 7f2c0a867700 1 --2- 172.21.15.45:0/2461018712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3d96299a0 0x55e3d96622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:55.619 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.615+0000 7f2c09865700 1 --2- 172.21.15.45:0/2461018712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3d96299a0 0x55e3d96622e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.619 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.615+0000 7f2c09865700 1 -- 172.21.15.45:0/2461018712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3d9628180 msgr2=0x55e3d9629460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:55.619 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.615+0000 7f2c09865700 1 --2- 172.21.15.45:0/2461018712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3d9628180 0x55e3d9629460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.619 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.615+0000 7f2c09865700 1 -- 172.21.15.45:0/2461018712 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3d9375b00 con 0x55e3d9629050 2024-05-10T03:41:55.619 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.615+0000 7f2c09865700 1 --2- 172.21.15.45:0/2461018712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9629050 0x55e3d964a610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4005d70 tx=0x7f2bf40cc040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e108ab81fc48d28b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:55.619 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.616+0000 7f2bf9580700 1 -- 172.21.15.45:0/2461018712 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4091120 con 0x55e3d9629050 2024-05-10T03:41:55.619 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.616+0000 7f2bf9580700 1 -- 172.21.15.45:0/2461018712 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2bf40982d0 con 0x55e3d9629050 2024-05-10T03:41:55.619 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.616+0000 7f2bf9580700 1 -- 172.21.15.45:0/2461018712 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf40ca950 con 0x55e3d9629050 2024-05-10T03:41:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.617+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/2461018712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9629050 msgr2=0x55e3d964a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.617+0000 7f2c1c60eb80 1 --2- 172.21.15.45:0/2461018712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9629050 0x55e3d964a610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4005d70 tx=0x7f2bf40cc040 comp rx=0 tx=0).stop 2024-05-10T03:41:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.617+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/2461018712 shutdown_connections 2024-05-10T03:41:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.617+0000 7f2c1c60eb80 1 --2- 172.21.15.45:0/2461018712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3d96299a0 0x55e3d96622e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.617+0000 7f2c1c60eb80 1 --2- 172.21.15.45:0/2461018712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3d9628180 0x55e3d9629460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.617+0000 7f2c1c60eb80 1 --2- 172.21.15.45:0/2461018712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9629050 0x55e3d964a610 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.617+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/2461018712 >> 172.21.15.45:0/2461018712 conn(0x55e3d958aa00 msgr2=0x55e3d962ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.617+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/2461018712 shutdown_connections 2024-05-10T03:41:55.620 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.617+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/2461018712 wait complete. 2024-05-10T03:41:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.618+0000 7f2c1c60eb80 1 -- start start 2024-05-10T03:41:55.621 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.618+0000 7f2c1c60eb80 1 Processor -- start 2024-05-10T03:41:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.619+0000 7f2c1c60eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3d9628180 0x55e3d9647330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.619+0000 7f2c1c60eb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9629050 0x55e3d9647870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.619+0000 7f2c1c60eb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3d96299a0 0x55e3d96b4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:55.622 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.619+0000 7f2c1c60eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3d964a7b0 con 0x55e3d9628180 2024-05-10T03:41:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.619+0000 7f2c1c60eb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3d964a920 con 0x55e3d9629050 2024-05-10T03:41:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.619+0000 7f2c1c60eb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3d96b4860 con 0x55e3d96299a0 2024-05-10T03:41:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.619+0000 7f2c1c60eb80 10 client.0 _ll_register_callbacks cb 0x55e3d94edad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:41:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.619+0000 7f2c09865700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9629050 0x55e3d9647870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.619+0000 7f2c09865700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9629050 0x55e3d9647870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.45:35210/0 (socket says 172.21.15.45:35210) 2024-05-10T03:41:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.619+0000 7f2c09865700 1 -- 172.21.15.45:0/542695885 learned_addr learned my addr 172.21.15.45:0/542695885 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:41:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.619+0000 7f2c0a066700 1 --2- 172.21.15.45:0/542695885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3d9628180 0x55e3d9647330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.619+0000 7f2c09865700 1 -- 172.21.15.45:0/542695885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3d96299a0 msgr2=0x55e3d96b4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.619+0000 7f2c09865700 1 --2- 172.21.15.45:0/542695885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3d96299a0 0x55e3d96b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.619+0000 7f2c09865700 1 -- 172.21.15.45:0/542695885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3d9628180 msgr2=0x55e3d9647330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:41:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.619+0000 7f2c09865700 1 --2- 172.21.15.45:0/542695885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3d9628180 0x55e3d9647330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.619+0000 7f2c09865700 1 -- 172.21.15.45:0/542695885 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3d93c9350 con 0x55e3d9629050 2024-05-10T03:41:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.620+0000 7f2c09865700 1 --2- 172.21.15.45:0/542695885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9629050 0x55e3d9647870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2bf400c5b0 tx=0x7f2bf4096600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=394a576b1a39c3fe server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:41:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.620+0000 7f2bedffb700 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-05-10T03:41:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.620+0000 7f2bedffb700 1 -- 172.21.15.45:0/542695885 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4091120 con 0x55e3d9629050 2024-05-10T03:41:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.620+0000 7f2bedffb700 1 -- 172.21.15.45:0/542695885 <== mon.2 v2:172.21.15.106:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f2bf40ca950 con 0x55e3d9629050 2024-05-10T03:41:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.620+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/542695885 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2bf409a190 con 0x55e3d9629050 2024-05-10T03:41:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.620+0000 7f2bedffb700 1 -- 172.21.15.45:0/542695885 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2bf4099680 con 0x55e3d9629050 2024-05-10T03:41:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.620+0000 7f2c1c60eb80 10 client.25955 fetch_fsmap learned FSMap version 28 2024-05-10T03:41:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.620+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/542695885 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55e3d950e500 con 0x55e3d9629050 2024-05-10T03:41:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.621+0000 7f2bedffb700 1 -- 172.21.15.45:0/542695885 <== mon.2 v2:172.21.15.106:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2bf409a190 con 0x55e3d9629050 2024-05-10T03:41:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.621+0000 7f2bedffb700 1 -- 172.21.15.45:0/542695885 <== mon.2 v2:172.21.15.106:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2bf40b8410 con 0x55e3d9629050 2024-05-10T03:41:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.621+0000 7f2c1c60eb80 10 client.25955 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:41:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.621+0000 7f2c1c60eb80 10 client.25955 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:41:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.621+0000 7f2c1c60eb80 20 client.25955 populate_metadata read hostname 'smithi045' 2024-05-10T03:41:55.625 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.621+0000 7f2c1c60eb80 1 --2- 172.21.15.45:0/542695885 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55e3d96b5ad0 0x55e3d96b7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:41:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.621+0000 7f2c1c60eb80 4 client.25955 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T03:41:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.621+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/542695885 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e3d9540e60 con 0x55e3d96b5ad0 2024-05-10T03:41:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.622+0000 7f2c0a066700 1 --2- 172.21.15.45:0/542695885 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55e3d96b5ad0 0x55e3d96b7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:41:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.622+0000 7f2bedffb700 10 client.25955 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.622+0000 7f2c0a066700 1 --2- 172.21.15.45:0/542695885 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55e3d96b5ad0 0x55e3d96b7ef0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d927b9d019afc5 server_cookie=9c882ab0ed375645 in_seq=0 out_seq=0 2024-05-10T03:41:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.626+0000 7f2bedffb700 1 -- 172.21.15.45:0/542695885 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e3d9540e60 con 0x55e3d96b5ad0 2024-05-10T03:41:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.626+0000 7f2bedffb700 10 client.25955 handle_command_reply: tid=0 2024-05-10T03:41:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.626+0000 7f2c1c60eb80 1 client.25955 shutdown 2024-05-10T03:41:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.626+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/542695885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9629050 msgr2=0x55e3d9647870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.626+0000 7f2c1c60eb80 1 --2- 172.21.15.45:0/542695885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9629050 0x55e3d9647870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2bf400c5b0 tx=0x7f2bf4096600 comp rx=0 tx=0).stop 2024-05-10T03:41:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.626+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/542695885 shutdown_connections 2024-05-10T03:41:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.626+0000 7f2c1c60eb80 1 --2- 172.21.15.45:0/542695885 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55e3d96b5ad0 0x55e3d96b7ef0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.626+0000 7f2c1c60eb80 1 --2- 172.21.15.45:0/542695885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e3d96299a0 0x55e3d96b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.626+0000 7f2c1c60eb80 1 --2- 172.21.15.45:0/542695885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3d9628180 0x55e3d9647330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.626+0000 7f2c1c60eb80 1 --2- 172.21.15.45:0/542695885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e3d9629050 0x55e3d9647870 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.626+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/542695885 >> 172.21.15.45:0/542695885 conn(0x55e3d958aa00 msgr2=0x55e3d962ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.626+0000 7f2bedffb700 0 client.25955 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:41:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.626+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/542695885 shutdown_connections 2024-05-10T03:41:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.626+0000 7f2c1c60eb80 1 -- 172.21.15.45:0/542695885 wait complete. 2024-05-10T03:41:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.626+0000 7f2c1c60eb80 20 client.25955 trim_cache size 0 max 16384 2024-05-10T03:41:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:{ 2024-05-10T03:41:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "message": "", 2024-05-10T03:41:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "return_code": 0 2024-05-10T03:41:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:} 2024-05-10T03:41:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.627+0000 7f2c0c2ca700 1 -- 172.21.15.45:0/372949334 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2bf00a1120 msgr2=0x7f2bf00a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.627+0000 7f2c0c2ca700 1 --2- 172.21.15.45:0/372949334 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2bf00a1120 0x7f2bf00a3630 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc0060b0 tx=0x7f2bfc007950 comp rx=0 tx=0).stop 2024-05-10T03:41:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.627+0000 7f2c0c2ca700 1 -- 172.21.15.45:0/372949334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c04101c00 msgr2=0x7f2c0419f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:41:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.627+0000 7f2c0c2ca700 1 --2- 172.21.15.45:0/372949334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c04101c00 0x7f2c0419f290 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2bf400ec10 tx=0x7f2bf400ef20 comp rx=0 tx=0).stop 2024-05-10T03:41:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.628+0000 7f2c0c2ca700 1 -- 172.21.15.45:0/372949334 shutdown_connections 2024-05-10T03:41:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.628+0000 7f2c0c2ca700 1 --2- 172.21.15.45:0/372949334 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2bf00a1120 0x7f2bf00a3630 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.628+0000 7f2c0c2ca700 1 --2- 172.21.15.45:0/372949334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c041025a0 0x7f2c041a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.628+0000 7f2c0c2ca700 1 --2- 172.21.15.45:0/372949334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c04100ae0 0x7f2c04073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.628+0000 7f2c0c2ca700 1 --2- 172.21.15.45:0/372949334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c04101c00 0x7f2c0419f290 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:41:55.632 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.628+0000 7f2c0c2ca700 1 -- 172.21.15.45:0/372949334 >> 172.21.15.45:0/372949334 conn(0x7f2c040fc0f0 msgr2=0x7f2c04104e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:41:55.632 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.628+0000 7f2c0c2ca700 1 -- 172.21.15.45:0/372949334 shutdown_connections 2024-05-10T03:41:55.632 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:41:55.628+0000 7f2c0c2ca700 1 -- 172.21.15.45:0/372949334 wait complete. 2024-05-10T03:41:57.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:57 smithi106 ceph-mon[46996]: pgmap v335: 129 pgs: 129 active+clean; 673 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:41:57.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:57 smithi154 ceph-mon[46565]: pgmap v335: 129 pgs: 129 active+clean; 673 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:41:57.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:57 smithi045 ceph-mon[42520]: pgmap v335: 129 pgs: 129 active+clean; 673 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:41:59.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:41:59 smithi106 ceph-mon[46996]: pgmap v336: 129 pgs: 129 active+clean; 673 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-10T03:41:59.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:41:59 smithi154 ceph-mon[46565]: pgmap v336: 129 pgs: 129 active+clean; 673 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-10T03:41:59.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:41:59 smithi045 ceph-mon[42520]: pgmap v336: 129 pgs: 129 active+clean; 673 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-10T03:41:59.891 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-10T03:42:00.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.109+0000 7f60fd51d700 1 -- 172.21.15.45:0/2708951524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60f8101a40 msgr2=0x7f60f8101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:00.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.109+0000 7f60fd51d700 1 --2- 172.21.15.45:0/2708951524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60f8101a40 0x7f60f8101f10 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f60e8009990 tx=0x7f60e8009ca0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.109+0000 7f60fd51d700 1 -- 172.21.15.45:0/2708951524 shutdown_connections 2024-05-10T03:42:00.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.109+0000 7f60fd51d700 1 --2- 172.21.15.45:0/2708951524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60f8101060 0x7f60f8101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.109+0000 7f60fd51d700 1 --2- 172.21.15.45:0/2708951524 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60f81025a0 0x7f60f8109020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.109+0000 7f60fd51d700 1 --2- 172.21.15.45:0/2708951524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60f8101a40 0x7f60f8101f10 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.109+0000 7f60fd51d700 1 -- 172.21.15.45:0/2708951524 >> 172.21.15.45:0/2708951524 conn(0x7f60f80fb880 msgr2=0x7f60f80fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:00.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.109+0000 7f60fd51d700 1 -- 172.21.15.45:0/2708951524 shutdown_connections 2024-05-10T03:42:00.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.110+0000 7f60fd51d700 1 -- 172.21.15.45:0/2708951524 wait complete. 2024-05-10T03:42:00.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.110+0000 7f60fd51d700 1 Processor -- start 2024-05-10T03:42:00.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.111+0000 7f60fd51d700 1 -- start start 2024-05-10T03:42:00.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.111+0000 7f60fd51d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60f8101060 0x7f60f8195e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.111+0000 7f60fd51d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60f8101a40 0x7f60f8196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.111+0000 7f60fd51d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60f81025a0 0x7f60f819d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.111+0000 7f60fd51d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f819d8c0 con 0x7f60f8101060 2024-05-10T03:42:00.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.111+0000 7f60fd51d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f819da30 con 0x7f60f81025a0 2024-05-10T03:42:00.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.111+0000 7f60fd51d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f819dbf0 con 0x7f60f8101a40 2024-05-10T03:42:00.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.111+0000 7f60f6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60f8101060 0x7f60f8195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.111+0000 7f60f6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60f8101060 0x7f60f8195e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43640/0 (socket says 172.21.15.45:43640) 2024-05-10T03:42:00.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.111+0000 7f60f6ffd700 1 -- 172.21.15.45:0/1746997343 learned_addr learned my addr 172.21.15.45:0/1746997343 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:00.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.112+0000 7f60f67fc700 1 --2- 172.21.15.45:0/1746997343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60f8101a40 0x7f60f8196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.112+0000 7f60f77fe700 1 --2- 172.21.15.45:0/1746997343 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60f81025a0 0x7f60f819d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.112+0000 7f60f6ffd700 1 -- 172.21.15.45:0/1746997343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60f8101a40 msgr2=0x7f60f8196380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:00.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.112+0000 7f60f6ffd700 1 --2- 172.21.15.45:0/1746997343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60f8101a40 0x7f60f8196380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.112+0000 7f60f6ffd700 1 -- 172.21.15.45:0/1746997343 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60f81025a0 msgr2=0x7f60f819d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:00.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.112+0000 7f60f6ffd700 1 --2- 172.21.15.45:0/1746997343 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60f81025a0 0x7f60f819d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.112+0000 7f60f6ffd700 1 -- 172.21.15.45:0/1746997343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e80095f0 con 0x7f60f8101060 2024-05-10T03:42:00.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.112+0000 7f60f6ffd700 1 --2- 172.21.15.45:0/1746997343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60f8101060 0x7f60f8195e40 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f60e000d980 tx=0x7f60e000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:00.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.112+0000 7f60effff700 1 -- 172.21.15.45:0/1746997343 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e0009b40 con 0x7f60f8101060 2024-05-10T03:42:00.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.112+0000 7f60effff700 1 -- 172.21.15.45:0/1746997343 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f60e000de60 con 0x7f60f8101060 2024-05-10T03:42:00.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.112+0000 7f60fd51d700 1 -- 172.21.15.45:0/1746997343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f819ded0 con 0x7f60f8101060 2024-05-10T03:42:00.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.112+0000 7f60effff700 1 -- 172.21.15.45:0/1746997343 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e000f6b0 con 0x7f60f8101060 2024-05-10T03:42:00.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.112+0000 7f60fd51d700 1 -- 172.21.15.45:0/1746997343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f819e2f0 con 0x7f60f8101060 2024-05-10T03:42:00.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.116+0000 7f60effff700 1 -- 172.21.15.45:0/1746997343 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f60e0009ca0 con 0x7f60f8101060 2024-05-10T03:42:00.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.116+0000 7f610d861b80 1 Processor -- start 2024-05-10T03:42:00.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.116+0000 7f610d861b80 1 -- start start 2024-05-10T03:42:00.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.117+0000 7f610d861b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efb43f6a0 0x556efb43faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.117+0000 7f610d861b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb440570 0x556efb440980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.117+0000 7f610d861b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556efb440ec0 0x556efb4477c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.117+0000 7f610d861b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556efb366150 con 0x556efb440570 2024-05-10T03:42:00.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.117+0000 7f610d861b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x556efb363b10 con 0x556efb440ec0 2024-05-10T03:42:00.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.117+0000 7f610d861b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x556efb35f400 con 0x556efb43f6a0 2024-05-10T03:42:00.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.117+0000 7f60effff700 1 --2- 172.21.15.45:0/1746997343 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f60e40a11c0 0x7f60e40a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.117+0000 7f60f6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb440570 0x556efb440980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.117+0000 7f60effff700 1 -- 172.21.15.45:0/1746997343 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f60e00cc840 con 0x7f60f8101060 2024-05-10T03:42:00.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.117+0000 7f60f6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb440570 0x556efb440980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43644/0 (socket says 172.21.15.45:43644) 2024-05-10T03:42:00.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.117+0000 7f60f6ffd700 1 -- 172.21.15.45:0/2346285730 learned_addr learned my addr 172.21.15.45:0/2346285730 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:00.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.117+0000 7f60f77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efb43f6a0 0x556efb43faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.117+0000 7f60f67fc700 1 --2- 172.21.15.45:0/2346285730 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556efb440ec0 0x556efb4477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.117+0000 7f60f77fe700 1 --2- 172.21.15.45:0/1746997343 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f60e40a11c0 0x7f60e40a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.118+0000 7f60f67fc700 1 -- 172.21.15.45:0/2346285730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efb43f6a0 msgr2=0x556efb43faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:00.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.118+0000 7f60f67fc700 1 --2- 172.21.15.45:0/2346285730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efb43f6a0 0x556efb43faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.118+0000 7f60f67fc700 1 -- 172.21.15.45:0/2346285730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb440570 msgr2=0x556efb440980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:00.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.118+0000 7f60f67fc700 1 --2- 172.21.15.45:0/2346285730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb440570 0x556efb440980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.118+0000 7f60f67fc700 1 -- 172.21.15.45:0/2346285730 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556efb1e03b0 con 0x556efb440ec0 2024-05-10T03:42:00.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.118+0000 7f60f6ffd700 1 --2- 172.21.15.45:0/2346285730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb440570 0x556efb440980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:00.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.118+0000 7f60f67fc700 1 --2- 172.21.15.45:0/2346285730 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556efb440ec0 0x556efb4477c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f60e8006010 tx=0x7f60e8005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11d5b98305b5fcd0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:00.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.118+0000 7f60f77fe700 1 --2- 172.21.15.45:0/1746997343 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f60e40a11c0 0x7f60e40a36d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f60f0009fd0 tx=0x7f60f0009920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:00.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.118+0000 7f60ed7fa700 1 -- 172.21.15.45:0/2346285730 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e801d040 con 0x556efb440ec0 2024-05-10T03:42:00.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.118+0000 7f60ed7fa700 1 -- 172.21.15.45:0/2346285730 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f60e80059a0 con 0x556efb440ec0 2024-05-10T03:42:00.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.118+0000 7f60ed7fa700 1 -- 172.21.15.45:0/2346285730 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e800f460 con 0x556efb440ec0 2024-05-10T03:42:00.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.119+0000 7f610d861b80 1 -- 172.21.15.45:0/2346285730 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556efb440ec0 msgr2=0x556efb4477c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.119+0000 7f610d861b80 1 --2- 172.21.15.45:0/2346285730 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556efb440ec0 0x556efb4477c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f60e8006010 tx=0x7f60e8005e80 comp rx=0 tx=0).stop 2024-05-10T03:42:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.119+0000 7f610d861b80 1 -- 172.21.15.45:0/2346285730 shutdown_connections 2024-05-10T03:42:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.119+0000 7f610d861b80 1 --2- 172.21.15.45:0/2346285730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efb43f6a0 0x556efb43faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.119+0000 7f610d861b80 1 --2- 172.21.15.45:0/2346285730 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556efb440ec0 0x556efb4477c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.119+0000 7f610d861b80 1 --2- 172.21.15.45:0/2346285730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb440570 0x556efb440980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.119+0000 7f610d861b80 1 -- 172.21.15.45:0/2346285730 >> 172.21.15.45:0/2346285730 conn(0x556efb3a1a60 msgr2=0x556efb439fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.119+0000 7f610d861b80 1 -- 172.21.15.45:0/2346285730 shutdown_connections 2024-05-10T03:42:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.119+0000 7f610d861b80 1 -- 172.21.15.45:0/2346285730 wait complete. 2024-05-10T03:42:00.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.120+0000 7f610d861b80 1 -- start start 2024-05-10T03:42:00.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.120+0000 7f610d861b80 1 Processor -- start 2024-05-10T03:42:00.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.121+0000 7f610d861b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb43f6a0 0x556efb449650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.121+0000 7f610d861b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556efb440570 0x556efb449b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.121+0000 7f610d861b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efb440ec0 0x556efb450af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.121+0000 7f610d861b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556efb2fb560 con 0x556efb43f6a0 2024-05-10T03:42:00.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.121+0000 7f610d861b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x556efb2fb200 con 0x556efb440570 2024-05-10T03:42:00.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.121+0000 7f610d861b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x556efb1e26a0 con 0x556efb440ec0 2024-05-10T03:42:00.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.121+0000 7f610d861b80 10 client.0 _ll_register_callbacks cb 0x556efb304b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:00.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.121+0000 7f60f6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb43f6a0 0x556efb449650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.121+0000 7f60f6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb43f6a0 0x556efb449650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43654/0 (socket says 172.21.15.45:43654) 2024-05-10T03:42:00.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.121+0000 7f60f6ffd700 1 -- 172.21.15.45:0/1479662369 learned_addr learned my addr 172.21.15.45:0/1479662369 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:00.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.121+0000 7f60f67fc700 1 --2- 172.21.15.45:0/1479662369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556efb440570 0x556efb449b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.121+0000 7f60f77fe700 1 --2- 172.21.15.45:0/1479662369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efb440ec0 0x556efb450af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.121+0000 7f60f6ffd700 1 -- 172.21.15.45:0/1479662369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efb440ec0 msgr2=0x556efb450af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:00.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.121+0000 7f60f6ffd700 1 --2- 172.21.15.45:0/1479662369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efb440ec0 0x556efb450af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.121+0000 7f60f6ffd700 1 -- 172.21.15.45:0/1479662369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556efb440570 msgr2=0x556efb449b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:00.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.121+0000 7f60f6ffd700 1 --2- 172.21.15.45:0/1479662369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556efb440570 0x556efb449b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.121+0000 7f60f6ffd700 1 -- 172.21.15.45:0/1479662369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f819e2f0 con 0x556efb43f6a0 2024-05-10T03:42:00.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.121+0000 7f60f77fe700 1 --2- 172.21.15.45:0/1479662369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efb440ec0 0x556efb450af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:42:00.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.122+0000 7f60f6ffd700 1 --2- 172.21.15.45:0/1479662369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb43f6a0 0x556efb449650 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f60e0010cf0 tx=0x7f60e0018460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3519d4a39147db87 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:00.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.122+0000 7f60de7fc700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:42:00.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.122+0000 7f60de7fc700 1 -- 172.21.15.45:0/1479662369 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e0099d50 con 0x556efb43f6a0 2024-05-10T03:42:00.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.122+0000 7f60de7fc700 1 -- 172.21.15.45:0/1479662369 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f60e00a1d70 con 0x556efb43f6a0 2024-05-10T03:42:00.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.122+0000 7f610d861b80 1 -- 172.21.15.45:0/1479662369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556efb2b8270 con 0x556efb43f6a0 2024-05-10T03:42:00.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.122+0000 7f60de7fc700 1 -- 172.21.15.45:0/1479662369 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60e0018270 con 0x556efb43f6a0 2024-05-10T03:42:00.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.123+0000 7f610d861b80 10 client.16125 fetch_fsmap learned FSMap version 28 2024-05-10T03:42:00.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.123+0000 7f610d861b80 1 -- 172.21.15.45:0/1479662369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f60f81098e0 con 0x556efb43f6a0 2024-05-10T03:42:00.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.124+0000 7f60de7fc700 1 -- 172.21.15.45:0/1479662369 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x556efb2b8270 con 0x556efb43f6a0 2024-05-10T03:42:00.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.124+0000 7f60de7fc700 1 -- 172.21.15.45:0/1479662369 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f60e00a18e0 con 0x556efb43f6a0 2024-05-10T03:42:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.124+0000 7f610d861b80 10 client.16125 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:42:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.124+0000 7f610d861b80 10 client.16125 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:42:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.124+0000 7f610d861b80 20 client.16125 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.124+0000 7f610d861b80 1 --2- 172.21.15.45:0/1479662369 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x556efb466330 0x556efb468780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.124+0000 7f610d861b80 4 client.16125 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:42:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.124+0000 7f610d861b80 1 -- 172.21.15.45:0/1479662369 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556efb40e780 con 0x556efb466330 2024-05-10T03:42:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.124+0000 7f60f67fc700 1 --2- 172.21.15.45:0/1479662369 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x556efb466330 0x556efb468780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.125+0000 7f60de7fc700 10 client.16125 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.125+0000 7f60f67fc700 1 --2- 172.21.15.45:0/1479662369 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x556efb466330 0x556efb468780 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6def9ecde5890a8f server_cookie=196bb71577d34871 in_seq=0 out_seq=0 2024-05-10T03:42:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.125+0000 7f60de7fc700 1 -- 172.21.15.45:0/1479662369 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556efb40e780 con 0x556efb466330 2024-05-10T03:42:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.125+0000 7f60de7fc700 10 client.16125 handle_command_reply: tid=0 2024-05-10T03:42:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.125+0000 7f610d861b80 1 client.16125 shutdown 2024-05-10T03:42:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.125+0000 7f610d861b80 1 -- 172.21.15.45:0/1479662369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb43f6a0 msgr2=0x556efb449650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.125+0000 7f610d861b80 1 --2- 172.21.15.45:0/1479662369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb43f6a0 0x556efb449650 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f60e0010cf0 tx=0x7f60e0018460 comp rx=0 tx=0).stop 2024-05-10T03:42:00.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.126+0000 7f610d861b80 1 -- 172.21.15.45:0/1479662369 shutdown_connections 2024-05-10T03:42:00.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.126+0000 7f610d861b80 1 --2- 172.21.15.45:0/1479662369 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x556efb466330 0x556efb468780 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.126+0000 7f610d861b80 1 --2- 172.21.15.45:0/1479662369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efb440ec0 0x556efb450af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.126+0000 7f610d861b80 1 --2- 172.21.15.45:0/1479662369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb43f6a0 0x556efb449650 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.126+0000 7f610d861b80 1 --2- 172.21.15.45:0/1479662369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556efb440570 0x556efb449b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.126+0000 7f610d861b80 1 -- 172.21.15.45:0/1479662369 >> 172.21.15.45:0/1479662369 conn(0x556efb3a1a60 msgr2=0x556efb439fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:00.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.126+0000 7f60de7fc700 0 client.16125 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:00.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.126+0000 7f610d861b80 1 -- 172.21.15.45:0/1479662369 shutdown_connections 2024-05-10T03:42:00.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.126+0000 7f610d861b80 1 -- 172.21.15.45:0/1479662369 wait complete. 2024-05-10T03:42:00.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.126+0000 7f610d861b80 20 client.16125 trim_cache size 0 max 16384 2024-05-10T03:42:00.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.157+0000 7f610d861b80 1 Processor -- start 2024-05-10T03:42:00.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.157+0000 7f610d861b80 1 -- start start 2024-05-10T03:42:00.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.158+0000 7f610d861b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556efb43f6a0 0x556efb448bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.158+0000 7f610d861b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efb440570 0x556efb450ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.158+0000 7f610d861b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb440ec0 0x556efb439f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.158+0000 7f610d861b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556efb43bb80 con 0x556efb440ec0 2024-05-10T03:42:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.158+0000 7f610d861b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x556efb46d940 con 0x556efb43f6a0 2024-05-10T03:42:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.158+0000 7f610d861b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x556efb43ff50 con 0x556efb440570 2024-05-10T03:42:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.158+0000 7f60f77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb440ec0 0x556efb439f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.158+0000 7f60f77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb440ec0 0x556efb439f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43660/0 (socket says 172.21.15.45:43660) 2024-05-10T03:42:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.158+0000 7f60f77fe700 1 -- 172.21.15.45:0/1720768306 learned_addr learned my addr 172.21.15.45:0/1720768306 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.158+0000 7f60f6ffd700 1 --2- 172.21.15.45:0/1720768306 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556efb43f6a0 0x556efb448bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.158+0000 7f60f67fc700 1 --2- 172.21.15.45:0/1720768306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efb440570 0x556efb450ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.158+0000 7f60f6ffd700 1 -- 172.21.15.45:0/1720768306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efb440570 msgr2=0x556efb450ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.158+0000 7f60f6ffd700 1 --2- 172.21.15.45:0/1720768306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efb440570 0x556efb450ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.158+0000 7f60f6ffd700 1 -- 172.21.15.45:0/1720768306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb440ec0 msgr2=0x556efb439f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.158+0000 7f60f6ffd700 1 --2- 172.21.15.45:0/1720768306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb440ec0 0x556efb439f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.158+0000 7f60f6ffd700 1 -- 172.21.15.45:0/1720768306 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556efb18cb60 con 0x556efb43f6a0 2024-05-10T03:42:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.158+0000 7f60f77fe700 1 --2- 172.21.15.45:0/1720768306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb440ec0 0x556efb439f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:00.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.159+0000 7f60f6ffd700 1 --2- 172.21.15.45:0/1720768306 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556efb43f6a0 0x556efb448bc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f60e0097c40 tx=0x7f60e0097ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0bdb3fac9f28c1a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:00.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.159+0000 7f60edffb700 1 -- 172.21.15.45:0/1720768306 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e0095c30 con 0x556efb43f6a0 2024-05-10T03:42:00.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.159+0000 7f60edffb700 1 -- 172.21.15.45:0/1720768306 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f60e0084040 con 0x556efb43f6a0 2024-05-10T03:42:00.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.159+0000 7f60edffb700 1 -- 172.21.15.45:0/1720768306 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e00998f0 con 0x556efb43f6a0 2024-05-10T03:42:00.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.160+0000 7f610d861b80 1 -- 172.21.15.45:0/1720768306 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556efb43f6a0 msgr2=0x556efb448bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:00.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.160+0000 7f610d861b80 1 --2- 172.21.15.45:0/1720768306 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556efb43f6a0 0x556efb448bc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f60e0097c40 tx=0x7f60e0097ea0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.160+0000 7f610d861b80 1 -- 172.21.15.45:0/1720768306 shutdown_connections 2024-05-10T03:42:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.160+0000 7f610d861b80 1 --2- 172.21.15.45:0/1720768306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb440ec0 0x556efb439f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.160+0000 7f610d861b80 1 --2- 172.21.15.45:0/1720768306 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556efb43f6a0 0x556efb448bc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.160+0000 7f610d861b80 1 --2- 172.21.15.45:0/1720768306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efb440570 0x556efb450ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.160+0000 7f610d861b80 1 -- 172.21.15.45:0/1720768306 >> 172.21.15.45:0/1720768306 conn(0x556efb3a1a60 msgr2=0x556efb436180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.160+0000 7f610d861b80 1 -- 172.21.15.45:0/1720768306 shutdown_connections 2024-05-10T03:42:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.160+0000 7f610d861b80 1 -- 172.21.15.45:0/1720768306 wait complete. 2024-05-10T03:42:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.161+0000 7f610d861b80 1 -- start start 2024-05-10T03:42:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.161+0000 7f610d861b80 1 Processor -- start 2024-05-10T03:42:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.161+0000 7f610d861b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb43f6a0 0x556efb44d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.161+0000 7f610d861b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efb440570 0x556efb44ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.161+0000 7f610d861b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556efb440ec0 0x556efb4ba7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.161+0000 7f610d861b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556efb450c90 con 0x556efb43f6a0 2024-05-10T03:42:00.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.161+0000 7f610d861b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x556efb450e00 con 0x556efb440ec0 2024-05-10T03:42:00.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.161+0000 7f610d861b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x556efb4bad30 con 0x556efb440570 2024-05-10T03:42:00.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.162+0000 7f610d861b80 10 client.0 _ll_register_callbacks cb 0x556efb304b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:00.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.162+0000 7f60f6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb43f6a0 0x556efb44d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.162+0000 7f60f6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb43f6a0 0x556efb44d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43670/0 (socket says 172.21.15.45:43670) 2024-05-10T03:42:00.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.162+0000 7f60f6ffd700 1 -- 172.21.15.45:0/1502502010 learned_addr learned my addr 172.21.15.45:0/1502502010 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:00.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.162+0000 7f60f77fe700 1 --2- 172.21.15.45:0/1502502010 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556efb440ec0 0x556efb4ba7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.162+0000 7f60f67fc700 1 --2- 172.21.15.45:0/1502502010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efb440570 0x556efb44ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.162+0000 7f60f6ffd700 1 -- 172.21.15.45:0/1502502010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efb440570 msgr2=0x556efb44ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:00.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.162+0000 7f60f6ffd700 1 --2- 172.21.15.45:0/1502502010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efb440570 0x556efb44ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.162+0000 7f60f6ffd700 1 -- 172.21.15.45:0/1502502010 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556efb440ec0 msgr2=0x556efb4ba7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:00.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.162+0000 7f60f6ffd700 1 --2- 172.21.15.45:0/1502502010 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556efb440ec0 0x556efb4ba7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.162+0000 7f60f6ffd700 1 -- 172.21.15.45:0/1502502010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f0009110 con 0x556efb43f6a0 2024-05-10T03:42:00.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.162+0000 7f60f77fe700 1 --2- 172.21.15.45:0/1502502010 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556efb440ec0 0x556efb4ba7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:42:00.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.162+0000 7f60f6ffd700 1 --2- 172.21.15.45:0/1502502010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb43f6a0 0x556efb44d8b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f60e0096360 tx=0x7f60e0005cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f26a5d6682a7be server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:00.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.163+0000 7f60de7fc700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:42:00.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.163+0000 7f60de7fc700 1 -- 172.21.15.45:0/1502502010 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e00b9250 con 0x556efb43f6a0 2024-05-10T03:42:00.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.163+0000 7f60de7fc700 1 -- 172.21.15.45:0/1502502010 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f60e009d720 con 0x556efb43f6a0 2024-05-10T03:42:00.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.163+0000 7f610d861b80 1 -- 172.21.15.45:0/1502502010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f60e80059a0 con 0x556efb43f6a0 2024-05-10T03:42:00.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.163+0000 7f60de7fc700 1 -- 172.21.15.45:0/1502502010 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60e0095c30 con 0x556efb43f6a0 2024-05-10T03:42:00.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.163+0000 7f610d861b80 10 client.16131 fetch_fsmap learned FSMap version 28 2024-05-10T03:42:00.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.163+0000 7f610d861b80 1 -- 172.21.15.45:0/1502502010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f60f81098e0 con 0x556efb43f6a0 2024-05-10T03:42:00.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.163+0000 7f60de7fc700 1 -- 172.21.15.45:0/1502502010 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f60e80059a0 con 0x556efb43f6a0 2024-05-10T03:42:00.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.164+0000 7f60de7fc700 1 -- 172.21.15.45:0/1502502010 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f60e0095870 con 0x556efb43f6a0 2024-05-10T03:42:00.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.164+0000 7f610d861b80 10 client.16131 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:42:00.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.164+0000 7f610d861b80 10 client.16131 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:42:00.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.164+0000 7f610d861b80 20 client.16131 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:00.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.164+0000 7f610d861b80 1 --2- 172.21.15.45:0/1502502010 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x556efb4bc1d0 0x556efb4be5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.164+0000 7f610d861b80 4 client.16131 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T03:42:00.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.164+0000 7f610d861b80 1 -- 172.21.15.45:0/1502502010 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556efb357ec0 con 0x556efb4bc1d0 2024-05-10T03:42:00.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.164+0000 7f60f67fc700 1 --2- 172.21.15.45:0/1502502010 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x556efb4bc1d0 0x556efb4be5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.164+0000 7f60de7fc700 10 client.16131 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:00.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.165+0000 7f60f67fc700 1 --2- 172.21.15.45:0/1502502010 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x556efb4bc1d0 0x556efb4be5f0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d976343e58ea851e server_cookie=1f403d4967eeb574 in_seq=0 out_seq=0 2024-05-10T03:42:00.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.165+0000 7f60de7fc700 1 -- 172.21.15.45:0/1502502010 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x556efb357ec0 con 0x556efb4bc1d0 2024-05-10T03:42:00.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.165+0000 7f60de7fc700 10 client.16131 handle_command_reply: tid=0 2024-05-10T03:42:00.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.165+0000 7f610d861b80 1 client.16131 shutdown 2024-05-10T03:42:00.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.165+0000 7f610d861b80 1 -- 172.21.15.45:0/1502502010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb43f6a0 msgr2=0x556efb44d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:00.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.165+0000 7f610d861b80 1 --2- 172.21.15.45:0/1502502010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb43f6a0 0x556efb44d8b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f60e0096360 tx=0x7f60e0005cb0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.165+0000 7f610d861b80 1 -- 172.21.15.45:0/1502502010 shutdown_connections 2024-05-10T03:42:00.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.165+0000 7f610d861b80 1 --2- 172.21.15.45:0/1502502010 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x556efb4bc1d0 0x556efb4be5f0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.165+0000 7f610d861b80 1 --2- 172.21.15.45:0/1502502010 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556efb440ec0 0x556efb4ba7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.165+0000 7f610d861b80 1 --2- 172.21.15.45:0/1502502010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556efb43f6a0 0x556efb44d8b0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.165+0000 7f60de7fc700 0 client.16131 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:00.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.165+0000 7f610d861b80 1 --2- 172.21.15.45:0/1502502010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556efb440570 0x556efb44ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.165+0000 7f610d861b80 1 -- 172.21.15.45:0/1502502010 >> 172.21.15.45:0/1502502010 conn(0x556efb3a1a60 msgr2=0x556efb436180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:00.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.165+0000 7f610d861b80 1 -- 172.21.15.45:0/1502502010 shutdown_connections 2024-05-10T03:42:00.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.165+0000 7f610d861b80 1 -- 172.21.15.45:0/1502502010 wait complete. 2024-05-10T03:42:00.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.166+0000 7f610d861b80 20 client.16131 trim_cache size 0 max 16384 2024-05-10T03:42:00.172 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:42:00.172 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-05-10T03:42:00.172 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-05-10T03:42:00.172 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:42:00.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.166+0000 7f60fd51d700 1 -- 172.21.15.45:0/1746997343 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f60e40a11c0 msgr2=0x7f60e40a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:00.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.166+0000 7f60fd51d700 1 --2- 172.21.15.45:0/1746997343 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f60e40a11c0 0x7f60e40a36d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f60f0009fd0 tx=0x7f60f0009920 comp rx=0 tx=0).stop 2024-05-10T03:42:00.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.166+0000 7f60fd51d700 1 -- 172.21.15.45:0/1746997343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60f8101060 msgr2=0x7f60f8195e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:00.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.166+0000 7f60fd51d700 1 --2- 172.21.15.45:0/1746997343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60f8101060 0x7f60f8195e40 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f60e000d980 tx=0x7f60e000dd40 comp rx=0 tx=0).stop 2024-05-10T03:42:00.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.166+0000 7f60fd51d700 1 -- 172.21.15.45:0/1746997343 shutdown_connections 2024-05-10T03:42:00.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.166+0000 7f60fd51d700 1 --2- 172.21.15.45:0/1746997343 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f60e40a11c0 0x7f60e40a36d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.166+0000 7f60fd51d700 1 --2- 172.21.15.45:0/1746997343 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60f81025a0 0x7f60f819d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.166+0000 7f60fd51d700 1 --2- 172.21.15.45:0/1746997343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60f8101060 0x7f60f8195e40 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.166+0000 7f60fd51d700 1 --2- 172.21.15.45:0/1746997343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60f8101a40 0x7f60f8196380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.166+0000 7f60fd51d700 1 -- 172.21.15.45:0/1746997343 >> 172.21.15.45:0/1746997343 conn(0x7f60f80fb880 msgr2=0x7f60f8105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:00.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.167+0000 7f60fd51d700 1 -- 172.21.15.45:0/1746997343 shutdown_connections 2024-05-10T03:42:00.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.167+0000 7f60fd51d700 1 -- 172.21.15.45:0/1746997343 wait complete. 2024-05-10T03:42:00.186 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-10T03:42:00.187 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:42:00.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.345+0000 7fd456330700 1 -- 172.21.15.45:0/1076404268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4501013e0 msgr2=0x7fd4501017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:00.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.345+0000 7fd456330700 1 --2- 172.21.15.45:0/1076404268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4501013e0 0x7fd4501017f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd438009920 tx=0x7fd438009c30 comp rx=0 tx=0).stop 2024-05-10T03:42:00.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.345+0000 7fd456330700 1 -- 172.21.15.45:0/1076404268 shutdown_connections 2024-05-10T03:42:00.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.345+0000 7fd456330700 1 --2- 172.21.15.45:0/1076404268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd450101d80 0x7fd450108630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.345+0000 7fd456330700 1 --2- 172.21.15.45:0/1076404268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4501002c0 0x7fd4501006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.345+0000 7fd456330700 1 --2- 172.21.15.45:0/1076404268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4501013e0 0x7fd4501017f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.345+0000 7fd456330700 1 -- 172.21.15.45:0/1076404268 >> 172.21.15.45:0/1076404268 conn(0x7fd4500fb8f0 msgr2=0x7fd4500fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:00.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.346+0000 7fd456330700 1 -- 172.21.15.45:0/1076404268 shutdown_connections 2024-05-10T03:42:00.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.346+0000 7fd456330700 1 -- 172.21.15.45:0/1076404268 wait complete. 2024-05-10T03:42:00.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.347+0000 7fd456330700 1 Processor -- start 2024-05-10T03:42:00.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.347+0000 7fd456330700 1 -- start start 2024-05-10T03:42:00.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.347+0000 7fd456330700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4501002c0 0x7fd450197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.347+0000 7fd456330700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4501013e0 0x7fd450195c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.347+0000 7fd456330700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd450101d80 0x7fd450196150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.347+0000 7fd456330700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45019bf20 con 0x7fd450101d80 2024-05-10T03:42:00.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.348+0000 7fd456330700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45019c090 con 0x7fd4501002c0 2024-05-10T03:42:00.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.348+0000 7fd456330700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45019c250 con 0x7fd4501013e0 2024-05-10T03:42:00.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.348+0000 7fd44ffff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4501002c0 0x7fd450197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.348+0000 7fd44ffff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4501002c0 0x7fd450197570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.45:57340/0 (socket says 172.21.15.45:57340) 2024-05-10T03:42:00.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.348+0000 7fd44ffff700 1 -- 172.21.15.45:0/1957173020 learned_addr learned my addr 172.21.15.45:0/1957173020 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:00.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.348+0000 7fd4548cd700 1 --2- 172.21.15.45:0/1957173020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd450101d80 0x7fd450196150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.348+0000 7fd44f7fe700 1 --2- 172.21.15.45:0/1957173020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4501013e0 0x7fd450195c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.348+0000 7fd44ffff700 1 -- 172.21.15.45:0/1957173020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4501013e0 msgr2=0x7fd450195c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:00.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.348+0000 7fd44ffff700 1 --2- 172.21.15.45:0/1957173020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4501013e0 0x7fd450195c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.348+0000 7fd44ffff700 1 -- 172.21.15.45:0/1957173020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd450101d80 msgr2=0x7fd450196150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:00.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.348+0000 7fd44ffff700 1 --2- 172.21.15.45:0/1957173020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd450101d80 0x7fd450196150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.348+0000 7fd44ffff700 1 -- 172.21.15.45:0/1957173020 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44800ae10 con 0x7fd4501002c0 2024-05-10T03:42:00.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.348+0000 7fd4548cd700 1 --2- 172.21.15.45:0/1957173020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd450101d80 0x7fd450196150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:42:00.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.348+0000 7fd44ffff700 1 --2- 172.21.15.45:0/1957173020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4501002c0 0x7fd450197570 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd44000e940 tx=0x7fd44000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:00.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.349+0000 7fd44d7fa700 1 -- 172.21.15.45:0/1957173020 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44000cbd0 con 0x7fd4501002c0 2024-05-10T03:42:00.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.349+0000 7fd44d7fa700 1 -- 172.21.15.45:0/1957173020 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd440004500 con 0x7fd4501002c0 2024-05-10T03:42:00.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.349+0000 7fd456330700 1 -- 172.21.15.45:0/1957173020 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd438009520 con 0x7fd4501002c0 2024-05-10T03:42:00.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.349+0000 7fd44d7fa700 1 -- 172.21.15.45:0/1957173020 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440003e30 con 0x7fd4501002c0 2024-05-10T03:42:00.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.349+0000 7fd456330700 1 -- 172.21.15.45:0/1957173020 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45019c900 con 0x7fd4501002c0 2024-05-10T03:42:00.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.351+0000 7fd456330700 1 -- 172.21.15.45:0/1957173020 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4501074d0 con 0x7fd4501002c0 2024-05-10T03:42:00.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.353+0000 7fd44d7fa700 1 -- 172.21.15.45:0/1957173020 <== mon.2 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd440003f90 con 0x7fd4501002c0 2024-05-10T03:42:00.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.354+0000 7fd44d7fa700 1 --2- 172.21.15.45:0/1957173020 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd43c0a1220 0x7fd43c0a3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.354+0000 7fd44d7fa700 1 -- 172.21.15.45:0/1957173020 <== mon.2 v2:172.21.15.106:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd440014070 con 0x7fd4501002c0 2024-05-10T03:42:00.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.357+0000 7fd44f7fe700 1 --2- 172.21.15.45:0/1957173020 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd43c0a1220 0x7fd43c0a3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.357+0000 7fd44d7fa700 1 -- 172.21.15.45:0/1957173020 <== mon.2 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd440051d60 con 0x7fd4501002c0 2024-05-10T03:42:00.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.358+0000 7fd44f7fe700 1 --2- 172.21.15.45:0/1957173020 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd43c0a1220 0x7fd43c0a3730 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd43800fcc0 tx=0x7fd438019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:00.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.639+0000 7fd456330700 1 -- 172.21.15.45:0/1957173020 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd45019c410 con 0x7fd4501002c0 2024-05-10T03:42:00.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.640+0000 7fd44d7fa700 1 -- 172.21.15.45:0/1957173020 <== mon.2 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+10926 (secure 0 0 0) 0x7fd4400964f0 con 0x7fd4501002c0 2024-05-10T03:42:00.643 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:42:00.643 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/378320264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":378320264},{"type":"v1","addr":"172.21.15.45:6835","nonce":378320264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3032381796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3032381796},{"type":"v1","addr":"172.21.15.45:6837","nonce":3032381796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T03:38:36.555290+0000","modified":"2024-05-10T03:40:14.047840+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24548,"mds_2":24547,"mds_3":24526,"mds_4":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14625":{"gid":14625,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6839/4007419304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":4007419304},{"type":"v1","addr":"172.21.15.45:6839","nonce":4007419304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14637":{"gid":14637,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6841/1355456195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1355456195},{"type":"v1","addr":"172.21.15.45:6841","nonce":1355456195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/4037121210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":4037121210},{"type":"v1","addr":"172.21.15.154:6835","nonce":4037121210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24521":{"gid":24521,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.106:6835/4162885659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4162885659},{"type":"v1","addr":"172.21.15.106:6835","nonce":4162885659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.154:6837/608167481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":608167481},{"type":"v1","addr":"172.21.15.154:6837","nonce":608167481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/1506563336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1506563336},{"type":"v1","addr":"172.21.15.154:6839","nonce":1506563336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.106:6837/3047487403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":3047487403},{"type":"v1","addr":"172.21.15.106:6837","nonce":3047487403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6839/3533867856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":3533867856},{"type":"v1","addr":"172.21.15.106:6839","nonce":3533867856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T03:42:00.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.643+0000 7fd456330700 1 -- 172.21.15.45:0/1957173020 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd43c0a1220 msgr2=0x7fd43c0a3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:00.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.643+0000 7fd456330700 1 --2- 172.21.15.45:0/1957173020 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd43c0a1220 0x7fd43c0a3730 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd43800fcc0 tx=0x7fd438019040 comp rx=0 tx=0).stop 2024-05-10T03:42:00.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.643+0000 7fd456330700 1 -- 172.21.15.45:0/1957173020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4501002c0 msgr2=0x7fd450197570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:00.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.643+0000 7fd456330700 1 --2- 172.21.15.45:0/1957173020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4501002c0 0x7fd450197570 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd44000e940 tx=0x7fd44000ed00 comp rx=0 tx=0).stop 2024-05-10T03:42:00.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.643+0000 7fd456330700 1 -- 172.21.15.45:0/1957173020 shutdown_connections 2024-05-10T03:42:00.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.643+0000 7fd456330700 1 --2- 172.21.15.45:0/1957173020 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd43c0a1220 0x7fd43c0a3730 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.643+0000 7fd456330700 1 --2- 172.21.15.45:0/1957173020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd450101d80 0x7fd450196150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.643+0000 7fd456330700 1 --2- 172.21.15.45:0/1957173020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4501002c0 0x7fd450197570 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.643+0000 7fd456330700 1 --2- 172.21.15.45:0/1957173020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4501013e0 0x7fd450195c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.643+0000 7fd456330700 1 -- 172.21.15.45:0/1957173020 >> 172.21.15.45:0/1957173020 conn(0x7fd4500fb8f0 msgr2=0x7fd450104610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:00.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.643+0000 7fd456330700 1 -- 172.21.15.45:0/1957173020 shutdown_connections 2024-05-10T03:42:00.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.643+0000 7fd456330700 1 -- 172.21.15.45:0/1957173020 wait complete. 2024-05-10T03:42:00.646 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 28 2024-05-10T03:42:00.662 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-05-10T03:42:00.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.824+0000 7fbc2abc6700 1 -- 172.21.15.45:0/3730967958 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc24104dc0 msgr2=0x7fbc241072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:00.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.824+0000 7fbc2abc6700 1 --2- 172.21.15.45:0/3730967958 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc24104dc0 0x7fbc241072a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fbc10009990 tx=0x7fbc10009ca0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.824+0000 7fbc2abc6700 1 -- 172.21.15.45:0/3730967958 shutdown_connections 2024-05-10T03:42:00.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.824+0000 7fbc2abc6700 1 --2- 172.21.15.45:0/3730967958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc2406a450 0x7fbc241047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.824+0000 7fbc2abc6700 1 --2- 172.21.15.45:0/3730967958 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc24107930 0x7fbc24109e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.824+0000 7fbc2abc6700 1 --2- 172.21.15.45:0/3730967958 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc24104dc0 0x7fbc241072a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.824+0000 7fbc2abc6700 1 -- 172.21.15.45:0/3730967958 >> 172.21.15.45:0/3730967958 conn(0x7fbc240fc180 msgr2=0x7fbc240fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:00.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.824+0000 7fbc2abc6700 1 -- 172.21.15.45:0/3730967958 shutdown_connections 2024-05-10T03:42:00.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.824+0000 7fbc2abc6700 1 -- 172.21.15.45:0/3730967958 wait complete. 2024-05-10T03:42:00.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.825+0000 7fbc2abc6700 1 Processor -- start 2024-05-10T03:42:00.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.825+0000 7fbc2abc6700 1 -- start start 2024-05-10T03:42:00.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.825+0000 7fbc2abc6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc2406a450 0x7fbc24195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.825+0000 7fbc2abc6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc24104dc0 0x7fbc241962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.825+0000 7fbc2abc6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc24107930 0x7fbc2419d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.825+0000 7fbc2abc6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2419d880 con 0x7fbc24107930 2024-05-10T03:42:00.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.825+0000 7fbc2abc6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2406ac60 con 0x7fbc2406a450 2024-05-10T03:42:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.825+0000 7fbc2abc6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2406ae20 con 0x7fbc24104dc0 2024-05-10T03:42:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.826+0000 7fbc23fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc24104dc0 0x7fbc241962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.826+0000 7fbc23fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc24104dc0 0x7fbc241962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:55794/0 (socket says 172.21.15.45:55794) 2024-05-10T03:42:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.826+0000 7fbc23fff700 1 -- 172.21.15.45:0/2107785070 learned_addr learned my addr 172.21.15.45:0/2107785070 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.826+0000 7fbc29163700 1 --2- 172.21.15.45:0/2107785070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc24107930 0x7fbc2419d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.826+0000 7fbc28962700 1 --2- 172.21.15.45:0/2107785070 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc2406a450 0x7fbc24195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.826+0000 7fbc23fff700 1 -- 172.21.15.45:0/2107785070 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc2406a450 msgr2=0x7fbc24195da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.826+0000 7fbc23fff700 1 --2- 172.21.15.45:0/2107785070 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc2406a450 0x7fbc24195da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.826+0000 7fbc23fff700 1 -- 172.21.15.45:0/2107785070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc24107930 msgr2=0x7fbc2419d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.826+0000 7fbc23fff700 1 --2- 172.21.15.45:0/2107785070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc24107930 0x7fbc2419d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.826+0000 7fbc23fff700 1 -- 172.21.15.45:0/2107785070 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc100095f0 con 0x7fbc24104dc0 2024-05-10T03:42:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.826+0000 7fbc23fff700 1 --2- 172.21.15.45:0/2107785070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc24104dc0 0x7fbc241962e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbc100098e0 tx=0x7fbc1000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.826+0000 7fbc21ffb700 1 -- 172.21.15.45:0/2107785070 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1001d070 con 0x7fbc24104dc0 2024-05-10T03:42:00.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.827+0000 7fbc21ffb700 1 -- 172.21.15.45:0/2107785070 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbc1000fdb0 con 0x7fbc24104dc0 2024-05-10T03:42:00.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.827+0000 7fbc2abc6700 1 -- 172.21.15.45:0/2107785070 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc2406b0a0 con 0x7fbc24104dc0 2024-05-10T03:42:00.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.827+0000 7fbc21ffb700 1 -- 172.21.15.45:0/2107785070 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10017650 con 0x7fbc24104dc0 2024-05-10T03:42:00.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.827+0000 7fbc2abc6700 1 -- 172.21.15.45:0/2107785070 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc2406b550 con 0x7fbc24104dc0 2024-05-10T03:42:00.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.831+0000 7fbc3af0ab80 1 Processor -- start 2024-05-10T03:42:00.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.831+0000 7fbc3af0ab80 1 -- start start 2024-05-10T03:42:00.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.832+0000 7fbc3af0ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab7d16a0 0x55dfab7d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.832+0000 7fbc3af0ab80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfab7d2570 0x55dfab7d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.832+0000 7fbc3af0ab80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfab7d2ec0 0x55dfab7d97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.832+0000 7fbc3af0ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfab6f8150 con 0x55dfab7d16a0 2024-05-10T03:42:00.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.832+0000 7fbc3af0ab80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfab6f5b10 con 0x55dfab7d2570 2024-05-10T03:42:00.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.832+0000 7fbc3af0ab80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfab6f1400 con 0x55dfab7d2ec0 2024-05-10T03:42:00.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.832+0000 7fbc21ffb700 1 -- 172.21.15.45:0/2107785070 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fbc100177b0 con 0x7fbc24104dc0 2024-05-10T03:42:00.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.832+0000 7fbc29163700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab7d16a0 0x55dfab7d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.832+0000 7fbc28962700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfab7d2570 0x55dfab7d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.832+0000 7fbc29163700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab7d16a0 0x55dfab7d1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43732/0 (socket says 172.21.15.45:43732) 2024-05-10T03:42:00.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.832+0000 7fbc29163700 1 -- 172.21.15.45:0/2866324739 learned_addr learned my addr 172.21.15.45:0/2866324739 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:00.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.832+0000 7fbc23fff700 1 --2- 172.21.15.45:0/2866324739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfab7d2ec0 0x55dfab7d97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.833+0000 7fbc28962700 1 -- 172.21.15.45:0/2866324739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfab7d2ec0 msgr2=0x55dfab7d97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:00.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.833+0000 7fbc28962700 1 --2- 172.21.15.45:0/2866324739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfab7d2ec0 0x55dfab7d97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.833+0000 7fbc28962700 1 -- 172.21.15.45:0/2866324739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab7d16a0 msgr2=0x55dfab7d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:00.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.833+0000 7fbc28962700 1 --2- 172.21.15.45:0/2866324739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab7d16a0 0x55dfab7d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.833+0000 7fbc28962700 1 -- 172.21.15.45:0/2866324739 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dfab5723b0 con 0x55dfab7d2570 2024-05-10T03:42:00.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.833+0000 7fbc21ffb700 1 --2- 172.21.15.45:0/2107785070 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fbc140a11c0 0x7fbc140a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.833+0000 7fbc28962700 1 --2- 172.21.15.45:0/2866324739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfab7d2570 0x55dfab7d2980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800feb0 tx=0x7fbc18004320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1528e0ca08db81f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:00.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.833+0000 7fbc21ffb700 1 -- 172.21.15.45:0/2107785070 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fbc10021e40 con 0x7fbc24104dc0 2024-05-10T03:42:00.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.833+0000 7fbc0effd700 1 -- 172.21.15.45:0/2866324739 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc18003ae0 con 0x55dfab7d2570 2024-05-10T03:42:00.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.833+0000 7fbc0effd700 1 -- 172.21.15.45:0/2866324739 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbc18015040 con 0x55dfab7d2570 2024-05-10T03:42:00.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.833+0000 7fbc0effd700 1 -- 172.21.15.45:0/2866324739 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc18009660 con 0x55dfab7d2570 2024-05-10T03:42:00.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.834+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/2866324739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfab7d2570 msgr2=0x55dfab7d2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:00.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.834+0000 7fbc3af0ab80 1 --2- 172.21.15.45:0/2866324739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfab7d2570 0x55dfab7d2980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800feb0 tx=0x7fbc18004320 comp rx=0 tx=0).stop 2024-05-10T03:42:00.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.834+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/2866324739 shutdown_connections 2024-05-10T03:42:00.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.834+0000 7fbc3af0ab80 1 --2- 172.21.15.45:0/2866324739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfab7d2ec0 0x55dfab7d97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.834+0000 7fbc3af0ab80 1 --2- 172.21.15.45:0/2866324739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab7d16a0 0x55dfab7d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.834+0000 7fbc3af0ab80 1 --2- 172.21.15.45:0/2866324739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfab7d2570 0x55dfab7d2980 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.834+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/2866324739 >> 172.21.15.45:0/2866324739 conn(0x55dfab733a60 msgr2=0x55dfab7cbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:00.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.834+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/2866324739 shutdown_connections 2024-05-10T03:42:00.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.834+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/2866324739 wait complete. 2024-05-10T03:42:00.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.835+0000 7fbc29163700 1 --2- 172.21.15.45:0/2107785070 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fbc140a11c0 0x7fbc140a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.835+0000 7fbc3af0ab80 1 -- start start 2024-05-10T03:42:00.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.835+0000 7fbc3af0ab80 1 Processor -- start 2024-05-10T03:42:00.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.836+0000 7fbc29163700 1 --2- 172.21.15.45:0/2107785070 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fbc140a11c0 0x7fbc140a36d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55dfab7d1380 tx=0x7fbc1c009130 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.836+0000 7fbc3af0ab80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfab7d16a0 0x55dfab7e3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.836+0000 7fbc3af0ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab7d2570 0x55dfab7e4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.836+0000 7fbc3af0ab80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfab7d2ec0 0x55dfab7eb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.836+0000 7fbc3af0ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfab68d560 con 0x55dfab7d2570 2024-05-10T03:42:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.836+0000 7fbc3af0ab80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfab68d200 con 0x55dfab7d2ec0 2024-05-10T03:42:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.836+0000 7fbc3af0ab80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfab5746a0 con 0x55dfab7d16a0 2024-05-10T03:42:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.836+0000 7fbc3af0ab80 10 client.0 _ll_register_callbacks cb 0x55dfab696b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.836+0000 7fbc23fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab7d2570 0x55dfab7e4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.836+0000 7fbc23fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab7d2570 0x55dfab7e4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43738/0 (socket says 172.21.15.45:43738) 2024-05-10T03:42:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.836+0000 7fbc23fff700 1 -- 172.21.15.45:0/4043383034 learned_addr learned my addr 172.21.15.45:0/4043383034 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.836+0000 7fbc29163700 1 --2- 172.21.15.45:0/4043383034 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfab7d2ec0 0x55dfab7eb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.836+0000 7fbc23fff700 1 -- 172.21.15.45:0/4043383034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfab7d16a0 msgr2=0x55dfab7e3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.836+0000 7fbc23fff700 1 --2- 172.21.15.45:0/4043383034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfab7d16a0 0x55dfab7e3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.836+0000 7fbc23fff700 1 -- 172.21.15.45:0/4043383034 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfab7d2ec0 msgr2=0x55dfab7eb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:00.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.837+0000 7fbc23fff700 1 --2- 172.21.15.45:0/4043383034 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfab7d2ec0 0x55dfab7eb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.837+0000 7fbc23fff700 1 -- 172.21.15.45:0/4043383034 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc1800fb90 con 0x55dfab7d2570 2024-05-10T03:42:00.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.837+0000 7fbc23fff700 1 --2- 172.21.15.45:0/4043383034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab7d2570 0x55dfab7e4400 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fbc1009b040 tx=0x7fbc100d1f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c04b467e1aeb2a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:00.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.837+0000 7fbc03fff700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:42:00.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.837+0000 7fbc03fff700 1 -- 172.21.15.45:0/4043383034 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc100d02d0 con 0x55dfab7d2570 2024-05-10T03:42:00.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.837+0000 7fbc03fff700 1 -- 172.21.15.45:0/4043383034 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fbc1009ba40 con 0x55dfab7d2570 2024-05-10T03:42:00.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.837+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/4043383034 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dfab64a270 con 0x55dfab7d2570 2024-05-10T03:42:00.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.838+0000 7fbc03fff700 1 -- 172.21.15.45:0/4043383034 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc10086070 con 0x55dfab7d2570 2024-05-10T03:42:00.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.838+0000 7fbc3af0ab80 10 client.16149 fetch_fsmap learned FSMap version 28 2024-05-10T03:42:00.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.838+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/4043383034 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55dfab51eb60 con 0x55dfab7d2570 2024-05-10T03:42:00.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.838+0000 7fbc03fff700 1 -- 172.21.15.45:0/4043383034 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55dfab64a270 con 0x55dfab7d2570 2024-05-10T03:42:00.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.838+0000 7fbc03fff700 1 -- 172.21.15.45:0/4043383034 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fbc1009a830 con 0x55dfab7d2570 2024-05-10T03:42:00.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.838+0000 7fbc3af0ab80 10 client.16149 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:42:00.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.838+0000 7fbc3af0ab80 10 client.16149 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2024-05-10T03:42:00.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.838+0000 7fbc3af0ab80 20 client.16149 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:00.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.838+0000 7fbc3af0ab80 1 --2- 172.21.15.45:0/4043383034 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x55dfab7ef880 0x55dfab7f1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.838+0000 7fbc3af0ab80 4 client.16149 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:42:00.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.838+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/4043383034 --> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dfab7a0780 con 0x55dfab7ef880 2024-05-10T03:42:00.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.839+0000 7fbc28962700 1 --2- 172.21.15.45:0/4043383034 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x55dfab7ef880 0x55dfab7f1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.839+0000 7fbc03fff700 10 client.16149 ms_handle_connect on v2:172.21.15.106:6834/4162885659 2024-05-10T03:42:00.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.839+0000 7fbc28962700 1 --2- 172.21.15.45:0/4043383034 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x55dfab7ef880 0x55dfab7f1cd0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2b5f55ee5288d3f server_cookie=1b06fdbc63dd2b5d in_seq=0 out_seq=0 2024-05-10T03:42:00.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.840+0000 7fbc03fff700 1 -- 172.21.15.45:0/4043383034 <== mds.4 v2:172.21.15.106:6834/4162885659 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55dfab7a0780 con 0x55dfab7ef880 2024-05-10T03:42:00.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.840+0000 7fbc03fff700 10 client.16149 handle_command_reply: tid=0 2024-05-10T03:42:00.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.840+0000 7fbc3af0ab80 1 client.16149 shutdown 2024-05-10T03:42:00.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.840+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/4043383034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab7d2570 msgr2=0x55dfab7e4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:00.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.840+0000 7fbc3af0ab80 1 --2- 172.21.15.45:0/4043383034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab7d2570 0x55dfab7e4400 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fbc1009b040 tx=0x7fbc100d1f70 comp rx=0 tx=0).stop 2024-05-10T03:42:00.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.840+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/4043383034 shutdown_connections 2024-05-10T03:42:00.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.840+0000 7fbc3af0ab80 1 --2- 172.21.15.45:0/4043383034 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x55dfab7ef880 0x55dfab7f1cd0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.840+0000 7fbc3af0ab80 1 --2- 172.21.15.45:0/4043383034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfab7d16a0 0x55dfab7e3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.840+0000 7fbc3af0ab80 1 --2- 172.21.15.45:0/4043383034 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfab7d2ec0 0x55dfab7eb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.840+0000 7fbc3af0ab80 1 --2- 172.21.15.45:0/4043383034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab7d2570 0x55dfab7e4400 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.840+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/4043383034 >> 172.21.15.45:0/4043383034 conn(0x55dfab733a60 msgr2=0x55dfab7cbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:00.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.840+0000 7fbc03fff700 0 client.16149 ms_handle_reset on v2:172.21.15.106:6834/4162885659 2024-05-10T03:42:00.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.840+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/4043383034 shutdown_connections 2024-05-10T03:42:00.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.840+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/4043383034 wait complete. 2024-05-10T03:42:00.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.841+0000 7fbc3af0ab80 20 client.16149 trim_cache size 0 max 16384 2024-05-10T03:42:00.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.855+0000 7fbc3af0ab80 1 Processor -- start 2024-05-10T03:42:00.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.855+0000 7fbc3af0ab80 1 -- start start 2024-05-10T03:42:00.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.855+0000 7fbc3af0ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab733a60 0x55dfab7d57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.855+0000 7fbc3af0ab80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfab7d16a0 0x55dfab7eb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.855+0000 7fbc3af0ab80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfab7d2570 0x55dfab7e2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.855+0000 7fbc3af0ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfab7d1f50 con 0x55dfab733a60 2024-05-10T03:42:00.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.855+0000 7fbc3af0ab80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfab7d95c0 con 0x55dfab7d16a0 2024-05-10T03:42:00.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.855+0000 7fbc3af0ab80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfab7e4f60 con 0x55dfab7d2570 2024-05-10T03:42:00.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.855+0000 7fbc28962700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab733a60 0x55dfab7d57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.856+0000 7fbc28962700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab733a60 0x55dfab7d57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43742/0 (socket says 172.21.15.45:43742) 2024-05-10T03:42:00.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.856+0000 7fbc28962700 1 -- 172.21.15.45:0/2067974110 learned_addr learned my addr 172.21.15.45:0/2067974110 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:00.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.856+0000 7fbc23fff700 1 --2- 172.21.15.45:0/2067974110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfab7d16a0 0x55dfab7eb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.856+0000 7fbc29163700 1 --2- 172.21.15.45:0/2067974110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfab7d2570 0x55dfab7e2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.856+0000 7fbc28962700 1 -- 172.21.15.45:0/2067974110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfab7d2570 msgr2=0x55dfab7e2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:00.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.856+0000 7fbc28962700 1 --2- 172.21.15.45:0/2067974110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfab7d2570 0x55dfab7e2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.856+0000 7fbc28962700 1 -- 172.21.15.45:0/2067974110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfab7d16a0 msgr2=0x55dfab7eb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:00.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.856+0000 7fbc28962700 1 --2- 172.21.15.45:0/2067974110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfab7d16a0 0x55dfab7eb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.856+0000 7fbc28962700 1 -- 172.21.15.45:0/2067974110 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dfab6b7560 con 0x55dfab733a60 2024-05-10T03:42:00.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.856+0000 7fbc23fff700 1 --2- 172.21.15.45:0/2067974110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfab7d16a0 0x55dfab7eb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:00.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.856+0000 7fbc28962700 1 --2- 172.21.15.45:0/2067974110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab733a60 0x55dfab7d57a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800feb0 tx=0x7fbc180092a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ec8b072188936a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:00.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.856+0000 7fbc0f7fe700 1 -- 172.21.15.45:0/2067974110 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1801b500 con 0x55dfab733a60 2024-05-10T03:42:00.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.857+0000 7fbc0f7fe700 1 -- 172.21.15.45:0/2067974110 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbc18003dc0 con 0x55dfab733a60 2024-05-10T03:42:00.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.857+0000 7fbc0f7fe700 1 -- 172.21.15.45:0/2067974110 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc180054b0 con 0x55dfab733a60 2024-05-10T03:42:00.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.857+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/2067974110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab733a60 msgr2=0x55dfab7d57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:00.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.857+0000 7fbc3af0ab80 1 --2- 172.21.15.45:0/2067974110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab733a60 0x55dfab7d57a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800feb0 tx=0x7fbc180092a0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.858+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/2067974110 shutdown_connections 2024-05-10T03:42:00.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.858+0000 7fbc3af0ab80 1 --2- 172.21.15.45:0/2067974110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfab7d2570 0x55dfab7e2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.858+0000 7fbc3af0ab80 1 --2- 172.21.15.45:0/2067974110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab733a60 0x55dfab7d57a0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.858+0000 7fbc3af0ab80 1 --2- 172.21.15.45:0/2067974110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfab7d16a0 0x55dfab7eb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.858+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/2067974110 >> 172.21.15.45:0/2067974110 conn(0x55dfab7d9c10 msgr2=0x55dfab7c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:00.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.858+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/2067974110 shutdown_connections 2024-05-10T03:42:00.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.858+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/2067974110 wait complete. 2024-05-10T03:42:00.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.858+0000 7fbc3af0ab80 1 -- start start 2024-05-10T03:42:00.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.858+0000 7fbc3af0ab80 1 Processor -- start 2024-05-10T03:42:00.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.859+0000 7fbc3af0ab80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfab733a60 0x55dfab7e8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.859+0000 7fbc3af0ab80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfab7d16a0 0x55dfab7e8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.859+0000 7fbc3af0ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab7d2570 0x55dfab7e9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.859+0000 7fbc3af0ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfab7ea2c0 con 0x55dfab7d2570 2024-05-10T03:42:00.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.859+0000 7fbc3af0ab80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfab7ea430 con 0x55dfab7d16a0 2024-05-10T03:42:00.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.859+0000 7fbc3af0ab80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfab7ea5f0 con 0x55dfab733a60 2024-05-10T03:42:00.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.859+0000 7fbc3af0ab80 10 client.0 _ll_register_callbacks cb 0x55dfab696b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:00.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.859+0000 7fbc28962700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfab733a60 0x55dfab7e8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.859+0000 7fbc29163700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab7d2570 0x55dfab7e9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.859+0000 7fbc28962700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfab733a60 0x55dfab7e8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:55838/0 (socket says 172.21.15.45:55838) 2024-05-10T03:42:00.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.859+0000 7fbc28962700 1 -- 172.21.15.45:0/356155921 learned_addr learned my addr 172.21.15.45:0/356155921 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:00.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.860+0000 7fbc23fff700 1 --2- 172.21.15.45:0/356155921 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfab7d16a0 0x55dfab7e8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.860+0000 7fbc28962700 1 -- 172.21.15.45:0/356155921 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfab7d16a0 msgr2=0x55dfab7e8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:00.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.860+0000 7fbc28962700 1 --2- 172.21.15.45:0/356155921 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfab7d16a0 0x55dfab7e8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.860+0000 7fbc28962700 1 -- 172.21.15.45:0/356155921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab7d2570 msgr2=0x55dfab7e9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:00.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.860+0000 7fbc28962700 1 --2- 172.21.15.45:0/356155921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab7d2570 0x55dfab7e9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.860+0000 7fbc28962700 1 -- 172.21.15.45:0/356155921 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dfab51eb60 con 0x55dfab733a60 2024-05-10T03:42:00.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.860+0000 7fbc29163700 1 --2- 172.21.15.45:0/356155921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab7d2570 0x55dfab7e9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:00.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.860+0000 7fbc28962700 1 --2- 172.21.15.45:0/356155921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfab733a60 0x55dfab7e8910 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbc1801ba40 tx=0x7fbc1800f940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db6e0b78bdb2b43 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:00.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.860+0000 7fbc03fff700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-05-10T03:42:00.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.860+0000 7fbc03fff700 1 -- 172.21.15.45:0/356155921 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc18003ae0 con 0x55dfab733a60 2024-05-10T03:42:00.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.860+0000 7fbc03fff700 1 -- 172.21.15.45:0/356155921 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fbc1801b5c0 con 0x55dfab733a60 2024-05-10T03:42:00.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.860+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/356155921 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbc18015040 con 0x55dfab733a60 2024-05-10T03:42:00.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.861+0000 7fbc03fff700 1 -- 172.21.15.45:0/356155921 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc18003c40 con 0x55dfab733a60 2024-05-10T03:42:00.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.861+0000 7fbc3af0ab80 10 client.26026 fetch_fsmap learned FSMap version 28 2024-05-10T03:42:00.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.861+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/356155921 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55dfab5723b0 con 0x55dfab733a60 2024-05-10T03:42:00.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.861+0000 7fbc03fff700 1 -- 172.21.15.45:0/356155921 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbc18015040 con 0x55dfab733a60 2024-05-10T03:42:00.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.861+0000 7fbc03fff700 1 -- 172.21.15.45:0/356155921 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fbc18004670 con 0x55dfab733a60 2024-05-10T03:42:00.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.862+0000 7fbc3af0ab80 10 client.26026 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:42:00.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.862+0000 7fbc3af0ab80 10 client.26026 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2024-05-10T03:42:00.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.862+0000 7fbc3af0ab80 20 client.26026 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:00.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.862+0000 7fbc3af0ab80 1 --2- 172.21.15.45:0/356155921 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x55dfab7d2ec0 0x55dfab848100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:00.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.862+0000 7fbc3af0ab80 4 client.26026 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-10T03:42:00.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.862+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/356155921 --> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55dfab6e9ec0 con 0x55dfab7d2ec0 2024-05-10T03:42:00.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.865+0000 7fbc23fff700 1 --2- 172.21.15.45:0/356155921 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x55dfab7d2ec0 0x55dfab848100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:00.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.869+0000 7fbc23fff700 1 --2- 172.21.15.45:0/356155921 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x55dfab7d2ec0 0x55dfab848100 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4870506be99fd41f server_cookie=c822b32b9bba294 in_seq=0 out_seq=0 2024-05-10T03:42:00.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.869+0000 7fbc03fff700 10 client.26026 ms_handle_connect on v2:172.21.15.106:6834/4162885659 2024-05-10T03:42:00.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.869+0000 7fbc03fff700 1 -- 172.21.15.45:0/356155921 <== mds.4 v2:172.21.15.106:6834/4162885659 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55dfab6e9ec0 con 0x55dfab7d2ec0 2024-05-10T03:42:00.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.869+0000 7fbc03fff700 10 client.26026 handle_command_reply: tid=0 2024-05-10T03:42:00.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.869+0000 7fbc3af0ab80 1 client.26026 shutdown 2024-05-10T03:42:00.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.869+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/356155921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfab733a60 msgr2=0x55dfab7e8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:00.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.869+0000 7fbc3af0ab80 1 --2- 172.21.15.45:0/356155921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfab733a60 0x55dfab7e8910 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbc1801ba40 tx=0x7fbc1800f940 comp rx=0 tx=0).stop 2024-05-10T03:42:00.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.869+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/356155921 shutdown_connections 2024-05-10T03:42:00.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.869+0000 7fbc3af0ab80 1 --2- 172.21.15.45:0/356155921 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x55dfab7d2ec0 0x55dfab848100 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.869+0000 7fbc3af0ab80 1 --2- 172.21.15.45:0/356155921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfab733a60 0x55dfab7e8910 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.869+0000 7fbc3af0ab80 1 --2- 172.21.15.45:0/356155921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfab7d2570 0x55dfab7e9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.869+0000 7fbc3af0ab80 1 --2- 172.21.15.45:0/356155921 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfab7d16a0 0x55dfab7e8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.869+0000 7fbc03fff700 0 client.26026 ms_handle_reset on v2:172.21.15.106:6834/4162885659 2024-05-10T03:42:00.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.869+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/356155921 >> 172.21.15.45:0/356155921 conn(0x55dfab7d9c10 msgr2=0x55dfab7c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:00.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.870+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/356155921 shutdown_connections 2024-05-10T03:42:00.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.870+0000 7fbc3af0ab80 1 -- 172.21.15.45:0/356155921 wait complete. 2024-05-10T03:42:00.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.870+0000 7fbc3af0ab80 20 client.26026 trim_cache size 0 max 16384 2024-05-10T03:42:00.873 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-05-10T03:42:00.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.870+0000 7fbc2abc6700 1 -- 172.21.15.45:0/2107785070 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fbc140a11c0 msgr2=0x7fbc140a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:00.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.870+0000 7fbc2abc6700 1 --2- 172.21.15.45:0/2107785070 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fbc140a11c0 0x7fbc140a36d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55dfab7d1380 tx=0x7fbc1c009130 comp rx=0 tx=0).stop 2024-05-10T03:42:00.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.871+0000 7fbc2abc6700 1 -- 172.21.15.45:0/2107785070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc24104dc0 msgr2=0x7fbc241962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:00.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.871+0000 7fbc2abc6700 1 --2- 172.21.15.45:0/2107785070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc24104dc0 0x7fbc241962e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbc100098e0 tx=0x7fbc1000f690 comp rx=0 tx=0).stop 2024-05-10T03:42:00.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.871+0000 7fbc2abc6700 1 -- 172.21.15.45:0/2107785070 shutdown_connections 2024-05-10T03:42:00.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.871+0000 7fbc2abc6700 1 --2- 172.21.15.45:0/2107785070 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fbc140a11c0 0x7fbc140a36d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.871+0000 7fbc2abc6700 1 --2- 172.21.15.45:0/2107785070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc24107930 0x7fbc2419d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.871+0000 7fbc2abc6700 1 --2- 172.21.15.45:0/2107785070 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc2406a450 0x7fbc24195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.871+0000 7fbc2abc6700 1 --2- 172.21.15.45:0/2107785070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc24104dc0 0x7fbc241962e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:00.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.871+0000 7fbc2abc6700 1 -- 172.21.15.45:0/2107785070 >> 172.21.15.45:0/2107785070 conn(0x7fbc240fc180 msgr2=0x7fbc24103210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:00.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.871+0000 7fbc2abc6700 1 -- 172.21.15.45:0/2107785070 shutdown_connections 2024-05-10T03:42:00.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:00.871+0000 7fbc2abc6700 1 -- 172.21.15.45:0/2107785070 wait complete. 2024-05-10T03:42:00.892 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-05-10T03:42:01.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.069+0000 7ff36646a700 1 -- 172.21.15.45:0/152094626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360102770 msgr2=0x7ff360104b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.069+0000 7ff36646a700 1 --2- 172.21.15.45:0/152094626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360102770 0x7ff360104b90 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff350009990 tx=0x7ff350009ca0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.069+0000 7ff36646a700 1 -- 172.21.15.45:0/152094626 shutdown_connections 2024-05-10T03:42:01.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.069+0000 7ff36646a700 1 --2- 172.21.15.45:0/152094626 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff360107a30 0x7ff360109e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.069+0000 7ff36646a700 1 --2- 172.21.15.45:0/152094626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360102770 0x7ff360104b90 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.069+0000 7ff36646a700 1 --2- 172.21.15.45:0/152094626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3601050d0 0x7ff3601074f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.069+0000 7ff36646a700 1 -- 172.21.15.45:0/152094626 >> 172.21.15.45:0/152094626 conn(0x7ff3600fc190 msgr2=0x7ff3600fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:01.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.069+0000 7ff36646a700 1 -- 172.21.15.45:0/152094626 shutdown_connections 2024-05-10T03:42:01.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.069+0000 7ff36646a700 1 -- 172.21.15.45:0/152094626 wait complete. 2024-05-10T03:42:01.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.070+0000 7ff36646a700 1 Processor -- start 2024-05-10T03:42:01.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.070+0000 7ff36646a700 1 -- start start 2024-05-10T03:42:01.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.070+0000 7ff36646a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff360102770 0x7ff360111120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.070+0000 7ff36646a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3601050d0 0x7ff360111660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.070+0000 7ff36646a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360107a30 0x7ff3601165e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.070+0000 7ff36646a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff360116bf0 con 0x7ff360107a30 2024-05-10T03:42:01.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.070+0000 7ff36646a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff360116d60 con 0x7ff360102770 2024-05-10T03:42:01.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.070+0000 7ff36646a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff360116f20 con 0x7ff3601050d0 2024-05-10T03:42:01.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.071+0000 7ff364a07700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360107a30 0x7ff3601165e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.071+0000 7ff364a07700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360107a30 0x7ff3601165e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43772/0 (socket says 172.21.15.45:43772) 2024-05-10T03:42:01.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.071+0000 7ff364a07700 1 -- 172.21.15.45:0/798117528 learned_addr learned my addr 172.21.15.45:0/798117528 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:01.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.071+0000 7ff35ffff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff360102770 0x7ff360111120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.071+0000 7ff35f7fe700 1 --2- 172.21.15.45:0/798117528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3601050d0 0x7ff360111660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.071+0000 7ff35ffff700 1 -- 172.21.15.45:0/798117528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3601050d0 msgr2=0x7ff360111660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.071+0000 7ff35ffff700 1 --2- 172.21.15.45:0/798117528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3601050d0 0x7ff360111660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.071+0000 7ff35ffff700 1 -- 172.21.15.45:0/798117528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360107a30 msgr2=0x7ff3601165e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.071+0000 7ff35ffff700 1 --2- 172.21.15.45:0/798117528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360107a30 0x7ff3601165e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.071+0000 7ff35ffff700 1 -- 172.21.15.45:0/798117528 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3500095f0 con 0x7ff360102770 2024-05-10T03:42:01.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.071+0000 7ff364a07700 1 --2- 172.21.15.45:0/798117528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360107a30 0x7ff3601165e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:01.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.071+0000 7ff35ffff700 1 --2- 172.21.15.45:0/798117528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff360102770 0x7ff360111120 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff350000c00 tx=0x7ff350009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:01.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.072+0000 7ff35d7fa700 1 -- 172.21.15.45:0/798117528 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35001d070 con 0x7ff360102770 2024-05-10T03:42:01.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.072+0000 7ff35d7fa700 1 -- 172.21.15.45:0/798117528 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff35000be50 con 0x7ff360102770 2024-05-10T03:42:01.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.072+0000 7ff35d7fa700 1 -- 172.21.15.45:0/798117528 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3500173f0 con 0x7ff360102770 2024-05-10T03:42:01.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.072+0000 7ff36646a700 1 -- 172.21.15.45:0/798117528 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3601171a0 con 0x7ff360102770 2024-05-10T03:42:01.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.072+0000 7ff36646a700 1 -- 172.21.15.45:0/798117528 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff360117600 con 0x7ff360102770 2024-05-10T03:42:01.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.076+0000 7ff35d7fa700 1 -- 172.21.15.45:0/798117528 <== mon.2 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff350017550 con 0x7ff360102770 2024-05-10T03:42:01.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.076+0000 7ff3767aeb80 1 Processor -- start 2024-05-10T03:42:01.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.076+0000 7ff3767aeb80 1 -- start start 2024-05-10T03:42:01.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.076+0000 7ff3767aeb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f06a0 0x55779e1f0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.076+0000 7ff3767aeb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55779e1f1570 0x55779e1f1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.076+0000 7ff3767aeb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55779e1f1ec0 0x55779e1f87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.076+0000 7ff3767aeb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55779e117150 con 0x55779e1f06a0 2024-05-10T03:42:01.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.076+0000 7ff3767aeb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55779e114b10 con 0x55779e1f1ec0 2024-05-10T03:42:01.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.076+0000 7ff3767aeb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55779e110400 con 0x55779e1f1570 2024-05-10T03:42:01.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.077+0000 7ff35f7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55779e1f1ec0 0x55779e1f87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.077+0000 7ff364a07700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f06a0 0x55779e1f0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.077+0000 7ff364a07700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f06a0 0x55779e1f0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43778/0 (socket says 172.21.15.45:43778) 2024-05-10T03:42:01.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.077+0000 7ff364a07700 1 -- 172.21.15.45:0/437137814 learned_addr learned my addr 172.21.15.45:0/437137814 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:01.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.077+0000 7ff35ffff700 1 --2- 172.21.15.45:0/437137814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55779e1f1570 0x55779e1f1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.077+0000 7ff35f7fe700 1 -- 172.21.15.45:0/437137814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55779e1f1570 msgr2=0x55779e1f1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.077+0000 7ff35f7fe700 1 --2- 172.21.15.45:0/437137814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55779e1f1570 0x55779e1f1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.077+0000 7ff35f7fe700 1 -- 172.21.15.45:0/437137814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f06a0 msgr2=0x55779e1f0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.077+0000 7ff35d7fa700 1 --2- 172.21.15.45:0/798117528 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff3480a1240 0x7ff3480a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.077+0000 7ff35f7fe700 1 --2- 172.21.15.45:0/437137814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f06a0 0x55779e1f0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.077+0000 7ff35f7fe700 1 -- 172.21.15.45:0/437137814 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55779df913b0 con 0x55779e1f1ec0 2024-05-10T03:42:01.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.077+0000 7ff35f7fe700 1 --2- 172.21.15.45:0/437137814 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55779e1f1ec0 0x55779e1f87c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff354009c80 tx=0x7ff354009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aac73f2bd2ee4170 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:01.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.077+0000 7ff35d7fa700 1 -- 172.21.15.45:0/798117528 <== mon.2 v2:172.21.15.106:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff3500cdd40 con 0x7ff360102770 2024-05-10T03:42:01.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.078+0000 7ff364a07700 1 --2- 172.21.15.45:0/798117528 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff3480a1240 0x7ff3480a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.078+0000 7ff3467fc700 1 -- 172.21.15.45:0/437137814 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354011cb0 con 0x55779e1f1ec0 2024-05-10T03:42:01.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.078+0000 7ff3467fc700 1 -- 172.21.15.45:0/437137814 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff354011e10 con 0x55779e1f1ec0 2024-05-10T03:42:01.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.078+0000 7ff3467fc700 1 -- 172.21.15.45:0/437137814 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354005280 con 0x55779e1f1ec0 2024-05-10T03:42:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.079+0000 7ff3767aeb80 1 -- 172.21.15.45:0/437137814 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55779e1f1ec0 msgr2=0x55779e1f87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.079+0000 7ff3767aeb80 1 --2- 172.21.15.45:0/437137814 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55779e1f1ec0 0x55779e1f87c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff354009c80 tx=0x7ff354009f90 comp rx=0 tx=0).stop 2024-05-10T03:42:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.079+0000 7ff364a07700 1 --2- 172.21.15.45:0/798117528 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff3480a1240 0x7ff3480a3750 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55779e1f0380 tx=0x7ff358004ad0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.079+0000 7ff3767aeb80 1 -- 172.21.15.45:0/437137814 shutdown_connections 2024-05-10T03:42:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.079+0000 7ff3767aeb80 1 --2- 172.21.15.45:0/437137814 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55779e1f1ec0 0x55779e1f87c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.079+0000 7ff3767aeb80 1 --2- 172.21.15.45:0/437137814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f06a0 0x55779e1f0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.079+0000 7ff3767aeb80 1 --2- 172.21.15.45:0/437137814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55779e1f1570 0x55779e1f1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.079+0000 7ff3767aeb80 1 -- 172.21.15.45:0/437137814 >> 172.21.15.45:0/437137814 conn(0x55779e152a60 msgr2=0x55779e1eafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.079+0000 7ff3767aeb80 1 -- 172.21.15.45:0/437137814 shutdown_connections 2024-05-10T03:42:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.080+0000 7ff3767aeb80 1 -- 172.21.15.45:0/437137814 wait complete. 2024-05-10T03:42:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.080+0000 7ff3767aeb80 1 -- start start 2024-05-10T03:42:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.080+0000 7ff3767aeb80 1 Processor -- start 2024-05-10T03:42:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.081+0000 7ff3767aeb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55779e1f06a0 0x55779e20b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.081+0000 7ff3767aeb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55779e1f1570 0x55779e20bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.081+0000 7ff3767aeb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f1ec0 0x55779e212be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.081+0000 7ff3767aeb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55779e0ac560 con 0x55779e1f1ec0 2024-05-10T03:42:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.081+0000 7ff3767aeb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55779e0ac200 con 0x55779e1f06a0 2024-05-10T03:42:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.081+0000 7ff3767aeb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55779df936a0 con 0x55779e1f1570 2024-05-10T03:42:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.081+0000 7ff3767aeb80 10 client.0 _ll_register_callbacks cb 0x55779e0b5b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.081+0000 7ff364a07700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f1ec0 0x55779e212be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.081+0000 7ff364a07700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f1ec0 0x55779e212be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43782/0 (socket says 172.21.15.45:43782) 2024-05-10T03:42:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.081+0000 7ff364a07700 1 -- 172.21.15.45:0/4274898218 learned_addr learned my addr 172.21.15.45:0/4274898218 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.081+0000 7ff35ffff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55779e1f06a0 0x55779e20b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.081+0000 7ff35f7fe700 1 --2- 172.21.15.45:0/4274898218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55779e1f1570 0x55779e20bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.081+0000 7ff364a07700 1 -- 172.21.15.45:0/4274898218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55779e1f1570 msgr2=0x55779e20bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.081+0000 7ff364a07700 1 --2- 172.21.15.45:0/4274898218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55779e1f1570 0x55779e20bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.081+0000 7ff364a07700 1 -- 172.21.15.45:0/4274898218 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55779e1f06a0 msgr2=0x55779e20b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.081+0000 7ff364a07700 1 --2- 172.21.15.45:0/4274898218 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55779e1f06a0 0x55779e20b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.082+0000 7ff364a07700 1 -- 172.21.15.45:0/4274898218 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3540098e0 con 0x55779e1f1ec0 2024-05-10T03:42:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.082+0000 7ff35f7fe700 1 --2- 172.21.15.45:0/4274898218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55779e1f1570 0x55779e20bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:42:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.082+0000 7ff35ffff700 1 --2- 172.21.15.45:0/4274898218 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55779e1f06a0 0x55779e20b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.082+0000 7ff364a07700 1 --2- 172.21.15.45:0/4274898218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f1ec0 0x55779e212be0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff35800ef00 tx=0x7ff35800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d509cfd19a32771 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.082+0000 7ff33f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:42:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.082+0000 7ff33f7fe700 1 -- 172.21.15.45:0/4274898218 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358022620 con 0x55779e1f1ec0 2024-05-10T03:42:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.082+0000 7ff3767aeb80 1 -- 172.21.15.45:0/4274898218 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55779e069270 con 0x55779e1f1ec0 2024-05-10T03:42:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.082+0000 7ff33f7fe700 1 -- 172.21.15.45:0/4274898218 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff35801b070 con 0x55779e1f1ec0 2024-05-10T03:42:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.082+0000 7ff33f7fe700 1 -- 172.21.15.45:0/4274898218 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff358017e40 con 0x55779e1f1ec0 2024-05-10T03:42:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.082+0000 7ff3767aeb80 10 client.16167 fetch_fsmap learned FSMap version 28 2024-05-10T03:42:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.082+0000 7ff3767aeb80 1 -- 172.21.15.45:0/4274898218 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55779df3db60 con 0x55779e1f1ec0 2024-05-10T03:42:01.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.083+0000 7ff33f7fe700 1 -- 172.21.15.45:0/4274898218 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55779e069270 con 0x55779e1f1ec0 2024-05-10T03:42:01.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.083+0000 7ff33f7fe700 1 -- 172.21.15.45:0/4274898218 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ff358028020 con 0x55779e1f1ec0 2024-05-10T03:42:01.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.083+0000 7ff3767aeb80 10 client.16167 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:42:01.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.083+0000 7ff3767aeb80 10 client.16167 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-05-10T03:42:01.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.083+0000 7ff3767aeb80 20 client.16167 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:01.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.083+0000 7ff3767aeb80 1 --2- 172.21.15.45:0/4274898218 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x55779e217410 0x55779e219860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.083+0000 7ff3767aeb80 4 client.16167 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:42:01.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.083+0000 7ff3767aeb80 1 -- 172.21.15.45:0/4274898218 --> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55779e1bf780 con 0x55779e217410 2024-05-10T03:42:01.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.083+0000 7ff35ffff700 1 --2- 172.21.15.45:0/4274898218 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x55779e217410 0x55779e219860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.084+0000 7ff33f7fe700 10 client.16167 ms_handle_connect on v2:172.21.15.154:6836/608167481 2024-05-10T03:42:01.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.084+0000 7ff35ffff700 1 --2- 172.21.15.45:0/4274898218 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x55779e217410 0x55779e219860 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=39f41544a77133b1 server_cookie=e21d2767479ad2d8 in_seq=0 out_seq=0 2024-05-10T03:42:01.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.085+0000 7ff33f7fe700 1 -- 172.21.15.45:0/4274898218 <== mds.3 v2:172.21.15.154:6836/608167481 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55779e1bf780 con 0x55779e217410 2024-05-10T03:42:01.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.085+0000 7ff33f7fe700 10 client.16167 handle_command_reply: tid=0 2024-05-10T03:42:01.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.085+0000 7ff3767aeb80 1 client.16167 shutdown 2024-05-10T03:42:01.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.085+0000 7ff3767aeb80 1 -- 172.21.15.45:0/4274898218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f1ec0 msgr2=0x55779e212be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.085+0000 7ff3767aeb80 1 --2- 172.21.15.45:0/4274898218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f1ec0 0x55779e212be0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff35800ef00 tx=0x7ff35800b040 comp rx=0 tx=0).stop 2024-05-10T03:42:01.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.085+0000 7ff3767aeb80 1 -- 172.21.15.45:0/4274898218 shutdown_connections 2024-05-10T03:42:01.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.085+0000 7ff3767aeb80 1 --2- 172.21.15.45:0/4274898218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f1ec0 0x55779e212be0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.085+0000 7ff3767aeb80 1 --2- 172.21.15.45:0/4274898218 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55779e1f06a0 0x55779e20b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.085+0000 7ff3767aeb80 1 --2- 172.21.15.45:0/4274898218 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x55779e217410 0x55779e219860 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.085+0000 7ff3767aeb80 1 --2- 172.21.15.45:0/4274898218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55779e1f1570 0x55779e20bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.085+0000 7ff33f7fe700 0 client.16167 ms_handle_reset on v2:172.21.15.154:6836/608167481 2024-05-10T03:42:01.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.085+0000 7ff3767aeb80 1 -- 172.21.15.45:0/4274898218 >> 172.21.15.45:0/4274898218 conn(0x55779e152a60 msgr2=0x55779e1eafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:01.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.085+0000 7ff3767aeb80 1 -- 172.21.15.45:0/4274898218 shutdown_connections 2024-05-10T03:42:01.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.085+0000 7ff3767aeb80 1 -- 172.21.15.45:0/4274898218 wait complete. 2024-05-10T03:42:01.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.085+0000 7ff3767aeb80 20 client.16167 trim_cache size 0 max 16384 2024-05-10T03:42:01.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.100+0000 7ff3767aeb80 1 Processor -- start 2024-05-10T03:42:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.100+0000 7ff3767aeb80 1 -- start start 2024-05-10T03:42:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.100+0000 7ff3767aeb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f06a0 0x55779e1f53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.100+0000 7ff3767aeb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55779e1f1570 0x55779e1f5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.100+0000 7ff3767aeb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55779e1f1ec0 0x55779e212ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.100+0000 7ff3767aeb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55779e1f0f50 con 0x55779e1f06a0 2024-05-10T03:42:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.100+0000 7ff3767aeb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55779e1f8780 con 0x55779e1f1ec0 2024-05-10T03:42:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.100+0000 7ff3767aeb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55779e217090 con 0x55779e1f1570 2024-05-10T03:42:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.100+0000 7ff35ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f06a0 0x55779e1f53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.100+0000 7ff35ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f06a0 0x55779e1f53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43788/0 (socket says 172.21.15.45:43788) 2024-05-10T03:42:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.100+0000 7ff35ffff700 1 -- 172.21.15.45:0/2353743935 learned_addr learned my addr 172.21.15.45:0/2353743935 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.100+0000 7ff35f7fe700 1 --2- 172.21.15.45:0/2353743935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55779e1f1570 0x55779e1f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.100+0000 7ff364a07700 1 --2- 172.21.15.45:0/2353743935 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55779e1f1ec0 0x55779e212ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.101+0000 7ff35ffff700 1 -- 172.21.15.45:0/2353743935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55779e1f1570 msgr2=0x55779e1f5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.101+0000 7ff35ffff700 1 --2- 172.21.15.45:0/2353743935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55779e1f1570 0x55779e1f5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.101+0000 7ff35ffff700 1 -- 172.21.15.45:0/2353743935 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55779e1f1ec0 msgr2=0x55779e212ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.101+0000 7ff35ffff700 1 --2- 172.21.15.45:0/2353743935 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55779e1f1ec0 0x55779e212ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.101+0000 7ff35ffff700 1 -- 172.21.15.45:0/2353743935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55779e0d6560 con 0x55779e1f06a0 2024-05-10T03:42:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.101+0000 7ff35ffff700 1 --2- 172.21.15.45:0/2353743935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f06a0 0x55779e1f53f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff3500978f0 tx=0x7ff3500a1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d522b9cfe122913d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.101+0000 7ff346ffd700 1 -- 172.21.15.45:0/2353743935 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35009ac50 con 0x55779e1f06a0 2024-05-10T03:42:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.101+0000 7ff346ffd700 1 -- 172.21.15.45:0/2353743935 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff35009a9c0 con 0x55779e1f06a0 2024-05-10T03:42:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.101+0000 7ff346ffd700 1 -- 172.21.15.45:0/2353743935 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff350099220 con 0x55779e1f06a0 2024-05-10T03:42:01.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.102+0000 7ff3767aeb80 1 -- 172.21.15.45:0/2353743935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f06a0 msgr2=0x55779e1f53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.102+0000 7ff3767aeb80 1 --2- 172.21.15.45:0/2353743935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f06a0 0x55779e1f53f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff3500978f0 tx=0x7ff3500a1040 comp rx=0 tx=0).stop 2024-05-10T03:42:01.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.103+0000 7ff3767aeb80 1 -- 172.21.15.45:0/2353743935 shutdown_connections 2024-05-10T03:42:01.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.103+0000 7ff3767aeb80 1 --2- 172.21.15.45:0/2353743935 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55779e1f1ec0 0x55779e212ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.103+0000 7ff3767aeb80 1 --2- 172.21.15.45:0/2353743935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f06a0 0x55779e1f53f0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.103+0000 7ff3767aeb80 1 --2- 172.21.15.45:0/2353743935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55779e1f1570 0x55779e1f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.103+0000 7ff3767aeb80 1 -- 172.21.15.45:0/2353743935 >> 172.21.15.45:0/2353743935 conn(0x55779e152a60 msgr2=0x55779e1eafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.104+0000 7ff3767aeb80 1 -- 172.21.15.45:0/2353743935 shutdown_connections 2024-05-10T03:42:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.104+0000 7ff3767aeb80 1 -- 172.21.15.45:0/2353743935 wait complete. 2024-05-10T03:42:01.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.104+0000 7ff3767aeb80 1 -- start start 2024-05-10T03:42:01.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.105+0000 7ff3767aeb80 1 Processor -- start 2024-05-10T03:42:01.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.105+0000 7ff3767aeb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f1570 0x55779e210c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.105+0000 7ff3767aeb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55779e1f1ec0 0x55779e2111c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.105+0000 7ff3767aeb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55779e2120f0 0x55779e212500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.105+0000 7ff3767aeb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55779e212a40 con 0x55779e1f1570 2024-05-10T03:42:01.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.105+0000 7ff3767aeb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55779e212bb0 con 0x55779e1f1ec0 2024-05-10T03:42:01.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.105+0000 7ff3767aeb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55779e212d70 con 0x55779e2120f0 2024-05-10T03:42:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.105+0000 7ff3767aeb80 10 client.0 _ll_register_callbacks cb 0x55779e0b5b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.106+0000 7ff35ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f1570 0x55779e210c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.106+0000 7ff35ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f1570 0x55779e210c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43796/0 (socket says 172.21.15.45:43796) 2024-05-10T03:42:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.106+0000 7ff35ffff700 1 -- 172.21.15.45:0/787819581 learned_addr learned my addr 172.21.15.45:0/787819581 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.106+0000 7ff35f7fe700 1 --2- 172.21.15.45:0/787819581 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55779e1f1ec0 0x55779e2111c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.106+0000 7ff364a07700 1 --2- 172.21.15.45:0/787819581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55779e2120f0 0x55779e212500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.106+0000 7ff35f7fe700 1 -- 172.21.15.45:0/787819581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55779e2120f0 msgr2=0x55779e212500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.106+0000 7ff35f7fe700 1 --2- 172.21.15.45:0/787819581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55779e2120f0 0x55779e212500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.106+0000 7ff35f7fe700 1 -- 172.21.15.45:0/787819581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f1570 msgr2=0x55779e210c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.106+0000 7ff35f7fe700 1 --2- 172.21.15.45:0/787819581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f1570 0x55779e210c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.106+0000 7ff35f7fe700 1 -- 172.21.15.45:0/787819581 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff360117600 con 0x55779e1f1ec0 2024-05-10T03:42:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.106+0000 7ff35ffff700 1 --2- 172.21.15.45:0/787819581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f1570 0x55779e210c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.107+0000 7ff35f7fe700 1 --2- 172.21.15.45:0/787819581 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55779e1f1ec0 0x55779e2111c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55779e20c7b0 tx=0x7ff3540051b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=949292cc737f788e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:01.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.107+0000 7ff33f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-05-10T03:42:01.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.108+0000 7ff33f7fe700 1 -- 172.21.15.45:0/787819581 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3540056a0 con 0x55779e1f1ec0 2024-05-10T03:42:01.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.108+0000 7ff33f7fe700 1 -- 172.21.15.45:0/787819581 <== mon.2 v2:172.21.15.106:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff354003680 con 0x55779e1f1ec0 2024-05-10T03:42:01.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.108+0000 7ff3767aeb80 1 -- 172.21.15.45:0/787819581 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff354011e10 con 0x55779e1f1ec0 2024-05-10T03:42:01.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.109+0000 7ff33f7fe700 1 -- 172.21.15.45:0/787819581 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff354003840 con 0x55779e1f1ec0 2024-05-10T03:42:01.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.109+0000 7ff3767aeb80 10 client.26015 fetch_fsmap learned FSMap version 28 2024-05-10T03:42:01.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.109+0000 7ff3767aeb80 1 -- 172.21.15.45:0/787819581 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55779df95cd0 con 0x55779e1f1ec0 2024-05-10T03:42:01.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.109+0000 7ff33f7fe700 1 -- 172.21.15.45:0/787819581 <== mon.2 v2:172.21.15.106:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff354011e10 con 0x55779e1f1ec0 2024-05-10T03:42:01.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.109+0000 7ff33f7fe700 1 -- 172.21.15.45:0/787819581 <== mon.2 v2:172.21.15.106:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ff35404d060 con 0x55779e1f1ec0 2024-05-10T03:42:01.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.109+0000 7ff3767aeb80 10 client.26015 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:42:01.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.109+0000 7ff3767aeb80 10 client.26015 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-05-10T03:42:01.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.109+0000 7ff3767aeb80 20 client.26015 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:01.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.109+0000 7ff3767aeb80 1 --2- 172.21.15.45:0/787819581 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x55779e1f9380 0x55779e1fb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.109+0000 7ff3767aeb80 4 client.26015 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-10T03:42:01.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.109+0000 7ff3767aeb80 1 -- 172.21.15.45:0/787819581 --> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55779e108ec0 con 0x55779e1f9380 2024-05-10T03:42:01.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.110+0000 7ff35ffff700 1 --2- 172.21.15.45:0/787819581 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x55779e1f9380 0x55779e1fb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.110+0000 7ff35ffff700 1 --2- 172.21.15.45:0/787819581 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x55779e1f9380 0x55779e1fb7a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ab0992f656fb5b63 server_cookie=4a9d258d7ba59689 in_seq=0 out_seq=0 2024-05-10T03:42:01.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.110+0000 7ff33f7fe700 10 client.26015 ms_handle_connect on v2:172.21.15.154:6836/608167481 2024-05-10T03:42:01.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.110+0000 7ff33f7fe700 1 -- 172.21.15.45:0/787819581 <== mds.3 v2:172.21.15.154:6836/608167481 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55779e108ec0 con 0x55779e1f9380 2024-05-10T03:42:01.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.110+0000 7ff33f7fe700 10 client.26015 handle_command_reply: tid=0 2024-05-10T03:42:01.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.110+0000 7ff3767aeb80 1 client.26015 shutdown 2024-05-10T03:42:01.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.110+0000 7ff3767aeb80 1 -- 172.21.15.45:0/787819581 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55779e1f1ec0 msgr2=0x55779e2111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.110+0000 7ff3767aeb80 1 --2- 172.21.15.45:0/787819581 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55779e1f1ec0 0x55779e2111c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55779e20c7b0 tx=0x7ff3540051b0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.111+0000 7ff3767aeb80 1 -- 172.21.15.45:0/787819581 shutdown_connections 2024-05-10T03:42:01.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.111+0000 7ff3767aeb80 1 --2- 172.21.15.45:0/787819581 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x55779e1f9380 0x55779e1fb7a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.111+0000 7ff3767aeb80 1 --2- 172.21.15.45:0/787819581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55779e2120f0 0x55779e212500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.111+0000 7ff3767aeb80 1 --2- 172.21.15.45:0/787819581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55779e1f1570 0x55779e210c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.111+0000 7ff3767aeb80 1 --2- 172.21.15.45:0/787819581 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55779e1f1ec0 0x55779e2111c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.111+0000 7ff3767aeb80 1 -- 172.21.15.45:0/787819581 >> 172.21.15.45:0/787819581 conn(0x55779e152a60 msgr2=0x55779e209d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:01.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.111+0000 7ff33f7fe700 0 client.26015 ms_handle_reset on v2:172.21.15.154:6836/608167481 2024-05-10T03:42:01.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.111+0000 7ff3767aeb80 1 -- 172.21.15.45:0/787819581 shutdown_connections 2024-05-10T03:42:01.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.111+0000 7ff3767aeb80 1 -- 172.21.15.45:0/787819581 wait complete. 2024-05-10T03:42:01.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.111+0000 7ff3767aeb80 20 client.26015 trim_cache size 0 max 16384 2024-05-10T03:42:01.116 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-05-10T03:42:01.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.111+0000 7ff36646a700 1 -- 172.21.15.45:0/798117528 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff3480a1240 msgr2=0x7ff3480a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.111+0000 7ff36646a700 1 --2- 172.21.15.45:0/798117528 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff3480a1240 0x7ff3480a3750 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55779e1f0380 tx=0x7ff358004ad0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.111+0000 7ff36646a700 1 -- 172.21.15.45:0/798117528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff360102770 msgr2=0x7ff360111120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.111+0000 7ff36646a700 1 --2- 172.21.15.45:0/798117528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff360102770 0x7ff360111120 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff350000c00 tx=0x7ff350009580 comp rx=0 tx=0).stop 2024-05-10T03:42:01.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.112+0000 7ff36646a700 1 -- 172.21.15.45:0/798117528 shutdown_connections 2024-05-10T03:42:01.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.112+0000 7ff36646a700 1 --2- 172.21.15.45:0/798117528 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7ff3480a1240 0x7ff3480a3750 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.112+0000 7ff36646a700 1 --2- 172.21.15.45:0/798117528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360107a30 0x7ff3601165e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.112+0000 7ff36646a700 1 --2- 172.21.15.45:0/798117528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff360102770 0x7ff360111120 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.112+0000 7ff36646a700 1 --2- 172.21.15.45:0/798117528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3601050d0 0x7ff360111660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.112+0000 7ff36646a700 1 -- 172.21.15.45:0/798117528 >> 172.21.15.45:0/798117528 conn(0x7ff3600fc190 msgr2=0x7ff3601035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:01.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.112+0000 7ff36646a700 1 -- 172.21.15.45:0/798117528 shutdown_connections 2024-05-10T03:42:01.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.112+0000 7ff36646a700 1 -- 172.21.15.45:0/798117528 wait complete. 2024-05-10T03:42:01.131 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-10T03:42:01.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:01 smithi045 ceph-mon[42520]: pgmap v337: 129 pgs: 129 active+clean; 674 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:42:01.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:01 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1957173020' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:42:01.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.325+0000 7f3fa4fac700 1 -- 172.21.15.45:0/43040346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fa0100ac0 msgr2=0x7f3fa0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.325+0000 7f3fa4fac700 1 --2- 172.21.15.45:0/43040346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fa0100ac0 0x7f3fa0100ed0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009990 tx=0x7f3f90009ca0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.326+0000 7f3fa4fac700 1 -- 172.21.15.45:0/43040346 shutdown_connections 2024-05-10T03:42:01.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.326+0000 7f3fa4fac700 1 --2- 172.21.15.45:0/43040346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3fa0102580 0x7f3fa0108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.326+0000 7f3fa4fac700 1 --2- 172.21.15.45:0/43040346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fa0100ac0 0x7f3fa0100ed0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.326+0000 7f3fa4fac700 1 --2- 172.21.15.45:0/43040346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa0101be0 0x7f3fa0101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.326+0000 7f3fa4fac700 1 -- 172.21.15.45:0/43040346 >> 172.21.15.45:0/43040346 conn(0x7f3fa00fc0d0 msgr2=0x7f3fa00fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:01.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.326+0000 7f3fa4fac700 1 -- 172.21.15.45:0/43040346 shutdown_connections 2024-05-10T03:42:01.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.326+0000 7f3fa4fac700 1 -- 172.21.15.45:0/43040346 wait complete. 2024-05-10T03:42:01.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.327+0000 7f3fa4fac700 1 Processor -- start 2024-05-10T03:42:01.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.327+0000 7f3fa4fac700 1 -- start start 2024-05-10T03:42:01.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.327+0000 7f3fa4fac700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa0100ac0 0x7f3fa0068e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.327+0000 7f3fa4fac700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fa0101be0 0x7f3fa019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.327+0000 7f3fa4fac700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3fa0102580 0x7f3fa019f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.327+0000 7f3fa4fac700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa019fa80 con 0x7f3fa0101be0 2024-05-10T03:42:01.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.327+0000 7f3fa4fac700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa019fbf0 con 0x7f3fa0102580 2024-05-10T03:42:01.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.327+0000 7f3fa4fac700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa019fdb0 con 0x7f3fa0100ac0 2024-05-10T03:42:01.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.328+0000 7f3f9dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fa0101be0 0x7f3fa019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.328+0000 7f3f9dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fa0101be0 0x7f3fa019cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43814/0 (socket says 172.21.15.45:43814) 2024-05-10T03:42:01.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.328+0000 7f3f9e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa0100ac0 0x7f3fa0068e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.328+0000 7f3f9dd9b700 1 -- 172.21.15.45:0/3616032871 learned_addr learned my addr 172.21.15.45:0/3616032871 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:01.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.328+0000 7f3f9ed9d700 1 --2- 172.21.15.45:0/3616032871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3fa0102580 0x7f3fa019f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.328+0000 7f3f9e59c700 1 -- 172.21.15.45:0/3616032871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3fa0102580 msgr2=0x7f3fa019f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.328+0000 7f3f9e59c700 1 --2- 172.21.15.45:0/3616032871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3fa0102580 0x7f3fa019f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.328+0000 7f3f9e59c700 1 -- 172.21.15.45:0/3616032871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fa0101be0 msgr2=0x7f3fa019cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.328+0000 7f3f9e59c700 1 --2- 172.21.15.45:0/3616032871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fa0101be0 0x7f3fa019cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.328+0000 7f3f9e59c700 1 -- 172.21.15.45:0/3616032871 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f900095f0 con 0x7f3fa0100ac0 2024-05-10T03:42:01.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.328+0000 7f3f9dd9b700 1 --2- 172.21.15.45:0/3616032871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fa0101be0 0x7f3fa019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:01.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.328+0000 7f3f9e59c700 1 --2- 172.21.15.45:0/3616032871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa0100ac0 0x7f3fa0068e30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3f90000c00 tx=0x7f3f90005b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:01.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.329+0000 7f3f8f7fe700 1 -- 172.21.15.45:0/3616032871 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90021070 con 0x7f3fa0100ac0 2024-05-10T03:42:01.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.329+0000 7f3fa4fac700 1 -- 172.21.15.45:0/3616032871 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa0196b40 con 0x7f3fa0100ac0 2024-05-10T03:42:01.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.329+0000 7f3f8f7fe700 1 -- 172.21.15.45:0/3616032871 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3f9000fb50 con 0x7f3fa0100ac0 2024-05-10T03:42:01.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.329+0000 7f3f8f7fe700 1 -- 172.21.15.45:0/3616032871 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90026930 con 0x7f3fa0100ac0 2024-05-10T03:42:01.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.329+0000 7f3fa4fac700 1 -- 172.21.15.45:0/3616032871 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa0197010 con 0x7f3fa0100ac0 2024-05-10T03:42:01.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.334+0000 7f3fb52f0b80 1 Processor -- start 2024-05-10T03:42:01.338 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.335+0000 7f3fb52f0b80 1 -- start start 2024-05-10T03:42:01.338 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.335+0000 7f3fb52f0b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565202a8feb0 0x565202a90300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.338 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.335+0000 7f3fb52f0b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565202a90d80 0x565202a91190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.338 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.335+0000 7f3fb52f0b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565202a916d0 0x565202a97fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.338 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.335+0000 7f3fb52f0b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652029ae150 con 0x565202a916d0 2024-05-10T03:42:01.338 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.335+0000 7f3fb52f0b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652029abb10 con 0x565202a90d80 2024-05-10T03:42:01.339 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.335+0000 7f3fb52f0b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652029a7400 con 0x565202a8feb0 2024-05-10T03:42:01.339 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.335+0000 7f3f9ed9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565202a8feb0 0x565202a90300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.339 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.335+0000 7f3f9ed9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565202a8feb0 0x565202a90300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:55910/0 (socket says 172.21.15.45:55910) 2024-05-10T03:42:01.339 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.335+0000 7f3f9ed9d700 1 -- 172.21.15.45:0/3646786264 learned_addr learned my addr 172.21.15.45:0/3646786264 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:01.339 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.336+0000 7f3f9dd9b700 1 --2- 172.21.15.45:0/3646786264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565202a916d0 0x565202a97fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.339 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.336+0000 7f3f8f7fe700 1 -- 172.21.15.45:0/3616032871 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3f9000f670 con 0x7f3fa0100ac0 2024-05-10T03:42:01.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.336+0000 7f3f9dd9b700 1 -- 172.21.15.45:0/3646786264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565202a8feb0 msgr2=0x565202a90300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.336+0000 7f3f9dd9b700 1 --2- 172.21.15.45:0/3646786264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565202a8feb0 0x565202a90300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.336+0000 7f3f9dd9b700 1 -- 172.21.15.45:0/3646786264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565202a90d80 msgr2=0x565202a91190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.336+0000 7f3f9dd9b700 1 --2- 172.21.15.45:0/3646786264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565202a90d80 0x565202a91190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.336+0000 7f3f9dd9b700 1 -- 172.21.15.45:0/3646786264 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652028283b0 con 0x565202a916d0 2024-05-10T03:42:01.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.336+0000 7f3f9dd9b700 1 --2- 172.21.15.45:0/3646786264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565202a916d0 0x565202a97fd0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f3f94005950 tx=0x7f3f94010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9e810f9fdd953f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:01.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.337+0000 7f3f8cff9700 1 -- 172.21.15.45:0/3646786264 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9401c680 con 0x565202a916d0 2024-05-10T03:42:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.337+0000 7f3f8f7fe700 1 --2- 172.21.15.45:0/3616032871 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3f880a11c0 0x7f3f880a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.337+0000 7f3f8cff9700 1 -- 172.21.15.45:0/3646786264 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3f94015070 con 0x565202a916d0 2024-05-10T03:42:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.337+0000 7f3f8cff9700 1 -- 172.21.15.45:0/3646786264 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9401a880 con 0x565202a916d0 2024-05-10T03:42:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.337+0000 7f3f8f7fe700 1 -- 172.21.15.45:0/3616032871 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3f900ce2f0 con 0x7f3fa0100ac0 2024-05-10T03:42:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.337+0000 7f3f9ed9d700 1 --2- 172.21.15.45:0/3646786264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565202a8feb0 0x565202a90300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:01.342 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.339+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/3646786264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565202a916d0 msgr2=0x565202a97fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.342 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.339+0000 7f3fb52f0b80 1 --2- 172.21.15.45:0/3646786264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565202a916d0 0x565202a97fd0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f3f94005950 tx=0x7f3f94010830 comp rx=0 tx=0).stop 2024-05-10T03:42:01.342 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.339+0000 7f3f9ed9d700 1 --2- 172.21.15.45:0/3616032871 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3f880a11c0 0x7f3f880a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.342 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.339+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/3646786264 shutdown_connections 2024-05-10T03:42:01.342 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.339+0000 7f3fb52f0b80 1 --2- 172.21.15.45:0/3646786264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565202a8feb0 0x565202a90300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.342 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.339+0000 7f3fb52f0b80 1 --2- 172.21.15.45:0/3646786264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565202a916d0 0x565202a97fd0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.339+0000 7f3fb52f0b80 1 --2- 172.21.15.45:0/3646786264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565202a90d80 0x565202a91190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.339+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/3646786264 >> 172.21.15.45:0/3646786264 conn(0x5652029e9a60 msgr2=0x565202a81fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:01.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.339+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/3646786264 shutdown_connections 2024-05-10T03:42:01.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.339+0000 7f3f9ed9d700 1 --2- 172.21.15.45:0/3616032871 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3f880a11c0 0x7f3f880a36d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x565202a8fb90 tx=0x7f3f9800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:01.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.339+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/3646786264 wait complete. 2024-05-10T03:42:01.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.340+0000 7f3fb52f0b80 1 -- start start 2024-05-10T03:42:01.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.340+0000 7f3fb52f0b80 1 Processor -- start 2024-05-10T03:42:01.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.340+0000 7f3fb52f0b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565202a8feb0 0x565202a99f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.340+0000 7f3fb52f0b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565202a90d80 0x565202a9a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.340+0000 7f3fb52f0b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565202a916d0 0x565202aa1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.340+0000 7f3fb52f0b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x565202943560 con 0x565202a916d0 2024-05-10T03:42:01.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.340+0000 7f3fb52f0b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x565202943200 con 0x565202a8feb0 2024-05-10T03:42:01.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.340+0000 7f3fb52f0b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x56520282a6a0 con 0x565202a90d80 2024-05-10T03:42:01.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.341+0000 7f3fb52f0b80 10 client.0 _ll_register_callbacks cb 0x56520294cb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:01.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.341+0000 7f3f9e59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565202a8feb0 0x565202a99f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.341+0000 7f3f9e59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565202a8feb0 0x565202a99f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.45:57482/0 (socket says 172.21.15.45:57482) 2024-05-10T03:42:01.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.341+0000 7f3f9e59c700 1 -- 172.21.15.45:0/2377956315 learned_addr learned my addr 172.21.15.45:0/2377956315 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:01.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.341+0000 7f3f9ed9d700 1 --2- 172.21.15.45:0/2377956315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565202a916d0 0x565202aa1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.341+0000 7f3f9dd9b700 1 --2- 172.21.15.45:0/2377956315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565202a90d80 0x565202a9a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.341+0000 7f3f9e59c700 1 -- 172.21.15.45:0/2377956315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565202a90d80 msgr2=0x565202a9a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.341+0000 7f3f9e59c700 1 --2- 172.21.15.45:0/2377956315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565202a90d80 0x565202a9a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.341+0000 7f3f9e59c700 1 -- 172.21.15.45:0/2377956315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565202a916d0 msgr2=0x565202aa1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.341+0000 7f3f9e59c700 1 --2- 172.21.15.45:0/2377956315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565202a916d0 0x565202aa1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.341+0000 7f3f9e59c700 1 -- 172.21.15.45:0/2377956315 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f980112b0 con 0x565202a8feb0 2024-05-10T03:42:01.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.341+0000 7f3f9dd9b700 1 --2- 172.21.15.45:0/2377956315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565202a90d80 0x565202a9a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:42:01.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.341+0000 7f3f9e59c700 1 --2- 172.21.15.45:0/2377956315 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565202a8feb0 0x565202a99f80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009990 tx=0x7f3f900978a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41341e2884838ce server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:01.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.341+0000 7f3f85ffb700 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-05-10T03:42:01.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.342+0000 7f3f85ffb700 1 -- 172.21.15.45:0/2377956315 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9009ad90 con 0x565202a8feb0 2024-05-10T03:42:01.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.342+0000 7f3f85ffb700 1 -- 172.21.15.45:0/2377956315 <== mon.2 v2:172.21.15.106:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3f9009bb30 con 0x565202a8feb0 2024-05-10T03:42:01.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.342+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/2377956315 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565202900270 con 0x565202a8feb0 2024-05-10T03:42:01.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.342+0000 7f3f85ffb700 1 -- 172.21.15.45:0/2377956315 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f9009b430 con 0x565202a8feb0 2024-05-10T03:42:01.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.342+0000 7f3fb52f0b80 10 client.26024 fetch_fsmap learned FSMap version 28 2024-05-10T03:42:01.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.342+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/2377956315 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f3f9400bda0 con 0x565202a8feb0 2024-05-10T03:42:01.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.342+0000 7f3f85ffb700 1 -- 172.21.15.45:0/2377956315 <== mon.2 v2:172.21.15.106:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x565202900270 con 0x565202a8feb0 2024-05-10T03:42:01.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.343+0000 7f3f85ffb700 1 -- 172.21.15.45:0/2377956315 <== mon.2 v2:172.21.15.106:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f3f900a3390 con 0x565202a8feb0 2024-05-10T03:42:01.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.343+0000 7f3fb52f0b80 10 client.26024 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:42:01.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.343+0000 7f3fb52f0b80 10 client.26024 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-10T03:42:01.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.343+0000 7f3fb52f0b80 20 client.26024 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:01.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.343+0000 7f3fb52f0b80 1 --2- 172.21.15.45:0/2377956315 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x565202aa58b0 0x565202aa7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.344+0000 7f3fb52f0b80 4 client.26024 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:42:01.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.344+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/2377956315 --> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565202a56780 con 0x565202aa58b0 2024-05-10T03:42:01.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.344+0000 7f3f9dd9b700 1 --2- 172.21.15.45:0/2377956315 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x565202aa58b0 0x565202aa7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.344+0000 7f3f85ffb700 10 client.26024 ms_handle_connect on v2:172.21.15.154:6838/1506563336 2024-05-10T03:42:01.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.344+0000 7f3f9dd9b700 1 --2- 172.21.15.45:0/2377956315 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x565202aa58b0 0x565202aa7cd0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8bbecabf06e8b319 server_cookie=cfb78638f4bf5d08 in_seq=0 out_seq=0 2024-05-10T03:42:01.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.345+0000 7f3f85ffb700 1 -- 172.21.15.45:0/2377956315 <== mds.2 v2:172.21.15.154:6838/1506563336 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x565202a56780 con 0x565202aa58b0 2024-05-10T03:42:01.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.345+0000 7f3f85ffb700 10 client.26024 handle_command_reply: tid=0 2024-05-10T03:42:01.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.345+0000 7f3fb52f0b80 1 client.26024 shutdown 2024-05-10T03:42:01.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.345+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/2377956315 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565202a8feb0 msgr2=0x565202a99f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.345+0000 7f3fb52f0b80 1 --2- 172.21.15.45:0/2377956315 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565202a8feb0 0x565202a99f80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009990 tx=0x7f3f900978a0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.345+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/2377956315 shutdown_connections 2024-05-10T03:42:01.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.345+0000 7f3fb52f0b80 1 --2- 172.21.15.45:0/2377956315 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x565202aa58b0 0x565202aa7cd0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.345+0000 7f3fb52f0b80 1 --2- 172.21.15.45:0/2377956315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565202a916d0 0x565202aa1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.345+0000 7f3f85ffb700 0 client.26024 ms_handle_reset on v2:172.21.15.154:6838/1506563336 2024-05-10T03:42:01.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.345+0000 7f3fb52f0b80 1 --2- 172.21.15.45:0/2377956315 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565202a8feb0 0x565202a99f80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.345+0000 7f3fb52f0b80 1 --2- 172.21.15.45:0/2377956315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565202a90d80 0x565202a9a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.345+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/2377956315 >> 172.21.15.45:0/2377956315 conn(0x5652029e9a60 msgr2=0x565202a81fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:01.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.345+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/2377956315 shutdown_connections 2024-05-10T03:42:01.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.346+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/2377956315 wait complete. 2024-05-10T03:42:01.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.346+0000 7f3fb52f0b80 20 client.26024 trim_cache size 0 max 16384 2024-05-10T03:42:01.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.360+0000 7f3fb52f0b80 1 Processor -- start 2024-05-10T03:42:01.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.360+0000 7f3fb52f0b80 1 -- start start 2024-05-10T03:42:01.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.360+0000 7f3fb52f0b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565202a8feb0 0x565202aa1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.360+0000 7f3fb52f0b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565202a90d80 0x565202aa13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.360+0000 7f3fb52f0b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565202a916d0 0x565202a82ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.360+0000 7f3fb52f0b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x565202aa2560 con 0x565202a8feb0 2024-05-10T03:42:01.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.360+0000 7f3fb52f0b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x565202a97f10 con 0x565202a90d80 2024-05-10T03:42:01.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.360+0000 7f3fb52f0b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x565202a98260 con 0x565202a916d0 2024-05-10T03:42:01.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.361+0000 7f3f9e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565202a8feb0 0x565202aa1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.361+0000 7f3f9e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565202a8feb0 0x565202aa1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43844/0 (socket says 172.21.15.45:43844) 2024-05-10T03:42:01.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.361+0000 7f3f9e59c700 1 -- 172.21.15.45:0/2936113008 learned_addr learned my addr 172.21.15.45:0/2936113008 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:01.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.361+0000 7f3f9ed9d700 1 --2- 172.21.15.45:0/2936113008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565202a916d0 0x565202a82ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.361+0000 7f3f9dd9b700 1 --2- 172.21.15.45:0/2936113008 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565202a90d80 0x565202aa13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.361+0000 7f3f9e59c700 1 -- 172.21.15.45:0/2936113008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565202a916d0 msgr2=0x565202a82ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.361+0000 7f3f9e59c700 1 --2- 172.21.15.45:0/2936113008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565202a916d0 0x565202a82ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.361+0000 7f3f9e59c700 1 -- 172.21.15.45:0/2936113008 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565202a90d80 msgr2=0x565202aa13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.361+0000 7f3f9e59c700 1 --2- 172.21.15.45:0/2936113008 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565202a90d80 0x565202aa13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.361+0000 7f3f9e59c700 1 -- 172.21.15.45:0/2936113008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652027d4b60 con 0x565202a8feb0 2024-05-10T03:42:01.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.362+0000 7f3f9e59c700 1 --2- 172.21.15.45:0/2936113008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565202a8feb0 0x565202aa1a00 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f3f9009b3c0 tx=0x7f3f9009ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50d7d515d0a0707 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:01.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.362+0000 7f3f8d7fa700 1 -- 172.21.15.45:0/2936113008 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9009ad90 con 0x565202a8feb0 2024-05-10T03:42:01.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.362+0000 7f3f8d7fa700 1 -- 172.21.15.45:0/2936113008 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3f9009bb30 con 0x565202a8feb0 2024-05-10T03:42:01.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.362+0000 7f3f8d7fa700 1 -- 172.21.15.45:0/2936113008 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90099570 con 0x565202a8feb0 2024-05-10T03:42:01.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.363+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/2936113008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565202a8feb0 msgr2=0x565202aa1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.363+0000 7f3fb52f0b80 1 --2- 172.21.15.45:0/2936113008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565202a8feb0 0x565202aa1a00 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f3f9009b3c0 tx=0x7f3f9009ba40 comp rx=0 tx=0).stop 2024-05-10T03:42:01.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.363+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/2936113008 shutdown_connections 2024-05-10T03:42:01.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.363+0000 7f3fb52f0b80 1 --2- 172.21.15.45:0/2936113008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565202a916d0 0x565202a82ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.363+0000 7f3fb52f0b80 1 --2- 172.21.15.45:0/2936113008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565202a8feb0 0x565202aa1a00 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.363+0000 7f3fb52f0b80 1 --2- 172.21.15.45:0/2936113008 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565202a90d80 0x565202aa13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.363+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/2936113008 >> 172.21.15.45:0/2936113008 conn(0x5652029e9a60 msgr2=0x565202a81fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:01.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.363+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/2936113008 shutdown_connections 2024-05-10T03:42:01.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.363+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/2936113008 wait complete. 2024-05-10T03:42:01.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.364+0000 7f3fb52f0b80 1 -- start start 2024-05-10T03:42:01.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.364+0000 7f3fb52f0b80 1 Processor -- start 2024-05-10T03:42:01.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.364+0000 7f3fb52f0b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565202a8feb0 0x565202a9cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.364+0000 7f3fb52f0b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565202a90d80 0x565202a9d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.364+0000 7f3fb52f0b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565202a916d0 0x565202aa01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.364+0000 7f3fb52f0b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x565202aa06f0 con 0x565202a90d80 2024-05-10T03:42:01.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.364+0000 7f3fb52f0b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x565202aa0860 con 0x565202a916d0 2024-05-10T03:42:01.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.364+0000 7f3fb52f0b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x565202aa0a20 con 0x565202a8feb0 2024-05-10T03:42:01.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.364+0000 7f3fb52f0b80 10 client.0 _ll_register_callbacks cb 0x56520294cb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:01.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.365+0000 7f3f9e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565202a8feb0 0x565202a9cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.365+0000 7f3f9e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565202a8feb0 0x565202a9cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:55940/0 (socket says 172.21.15.45:55940) 2024-05-10T03:42:01.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.365+0000 7f3f9e59c700 1 -- 172.21.15.45:0/2170216367 learned_addr learned my addr 172.21.15.45:0/2170216367 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:01.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.365+0000 7f3f9dd9b700 1 --2- 172.21.15.45:0/2170216367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565202a90d80 0x565202a9d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.365+0000 7f3f9ed9d700 1 --2- 172.21.15.45:0/2170216367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565202a916d0 0x565202aa01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.365+0000 7f3f9e59c700 1 -- 172.21.15.45:0/2170216367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565202a916d0 msgr2=0x565202aa01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.365+0000 7f3f9e59c700 1 --2- 172.21.15.45:0/2170216367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565202a916d0 0x565202aa01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.365+0000 7f3f9e59c700 1 -- 172.21.15.45:0/2170216367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565202a90d80 msgr2=0x565202a9d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.365+0000 7f3f9e59c700 1 --2- 172.21.15.45:0/2170216367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565202a90d80 0x565202a9d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.365+0000 7f3f9e59c700 1 -- 172.21.15.45:0/2170216367 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9400bda0 con 0x565202a8feb0 2024-05-10T03:42:01.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.365+0000 7f3f9dd9b700 1 --2- 172.21.15.45:0/2170216367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565202a90d80 0x565202a9d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:42:01.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.365+0000 7f3f9e59c700 1 --2- 172.21.15.45:0/2170216367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565202a8feb0 0x565202a9cd80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3f90097160 tx=0x7f3f900ce5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f84b1545319a876a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:01.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.365+0000 7f3f85ffb700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-05-10T03:42:01.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.366+0000 7f3f85ffb700 1 -- 172.21.15.45:0/2170216367 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9009ad90 con 0x565202a8feb0 2024-05-10T03:42:01.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.366+0000 7f3f85ffb700 1 -- 172.21.15.45:0/2170216367 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3f9009f260 con 0x565202a8feb0 2024-05-10T03:42:01.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.366+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/2170216367 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f94015070 con 0x565202a8feb0 2024-05-10T03:42:01.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.366+0000 7f3f85ffb700 1 -- 172.21.15.45:0/2170216367 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f9000fcc0 con 0x565202a8feb0 2024-05-10T03:42:01.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.366+0000 7f3fb52f0b80 10 client.26056 fetch_fsmap learned FSMap version 28 2024-05-10T03:42:01.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.366+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/2170216367 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x56520296d560 con 0x565202a8feb0 2024-05-10T03:42:01.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.366+0000 7f3f85ffb700 1 -- 172.21.15.45:0/2170216367 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3f90069020 con 0x565202a8feb0 2024-05-10T03:42:01.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.367+0000 7f3f85ffb700 1 -- 172.21.15.45:0/2170216367 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f3f9009a390 con 0x565202a8feb0 2024-05-10T03:42:01.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.367+0000 7f3fb52f0b80 10 client.26056 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:42:01.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.367+0000 7f3fb52f0b80 10 client.26056 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-10T03:42:01.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.367+0000 7f3fb52f0b80 20 client.26056 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:01.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.367+0000 7f3fb52f0b80 1 --2- 172.21.15.45:0/2170216367 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x565202b0cd40 0x565202b0f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.367+0000 7f3fb52f0b80 4 client.26056 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-10T03:42:01.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.367+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/2170216367 --> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56520299fec0 con 0x565202b0cd40 2024-05-10T03:42:01.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.367+0000 7f3f9dd9b700 1 --2- 172.21.15.45:0/2170216367 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x565202b0cd40 0x565202b0f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.368+0000 7f3f85ffb700 10 client.26056 ms_handle_connect on v2:172.21.15.154:6838/1506563336 2024-05-10T03:42:01.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.368+0000 7f3f9dd9b700 1 --2- 172.21.15.45:0/2170216367 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x565202b0cd40 0x565202b0f160 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8ae04116e623efa5 server_cookie=7408281ab6e32812 in_seq=0 out_seq=0 2024-05-10T03:42:01.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.368+0000 7f3f85ffb700 1 -- 172.21.15.45:0/2170216367 <== mds.2 v2:172.21.15.154:6838/1506563336 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56520299fec0 con 0x565202b0cd40 2024-05-10T03:42:01.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.368+0000 7f3f85ffb700 10 client.26056 handle_command_reply: tid=0 2024-05-10T03:42:01.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.368+0000 7f3fb52f0b80 1 client.26056 shutdown 2024-05-10T03:42:01.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.368+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/2170216367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565202a8feb0 msgr2=0x565202a9cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.368+0000 7f3fb52f0b80 1 --2- 172.21.15.45:0/2170216367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565202a8feb0 0x565202a9cd80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3f90097160 tx=0x7f3f900ce5d0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.368+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/2170216367 shutdown_connections 2024-05-10T03:42:01.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.368+0000 7f3fb52f0b80 1 --2- 172.21.15.45:0/2170216367 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x565202b0cd40 0x565202b0f160 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.368+0000 7f3fb52f0b80 1 --2- 172.21.15.45:0/2170216367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565202a8feb0 0x565202a9cd80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.368+0000 7f3fb52f0b80 1 --2- 172.21.15.45:0/2170216367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565202a916d0 0x565202aa01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.368+0000 7f3fb52f0b80 1 --2- 172.21.15.45:0/2170216367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565202a90d80 0x565202a9d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.368+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/2170216367 >> 172.21.15.45:0/2170216367 conn(0x5652029e9a60 msgr2=0x565202a94b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:01.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.368+0000 7f3f85ffb700 0 client.26056 ms_handle_reset on v2:172.21.15.154:6838/1506563336 2024-05-10T03:42:01.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.368+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/2170216367 shutdown_connections 2024-05-10T03:42:01.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.368+0000 7f3fb52f0b80 1 -- 172.21.15.45:0/2170216367 wait complete. 2024-05-10T03:42:01.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.368+0000 7f3fb52f0b80 20 client.26056 trim_cache size 0 max 16384 2024-05-10T03:42:01.374 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-05-10T03:42:01.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.369+0000 7f3fa4fac700 1 -- 172.21.15.45:0/3616032871 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3f880a11c0 msgr2=0x7f3f880a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.369+0000 7f3fa4fac700 1 --2- 172.21.15.45:0/3616032871 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3f880a11c0 0x7f3f880a36d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x565202a8fb90 tx=0x7f3f9800b040 comp rx=0 tx=0).stop 2024-05-10T03:42:01.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.369+0000 7f3fa4fac700 1 -- 172.21.15.45:0/3616032871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa0100ac0 msgr2=0x7f3fa0068e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.369+0000 7f3fa4fac700 1 --2- 172.21.15.45:0/3616032871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa0100ac0 0x7f3fa0068e30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3f90000c00 tx=0x7f3f90005b00 comp rx=0 tx=0).stop 2024-05-10T03:42:01.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.369+0000 7f3fa4fac700 1 -- 172.21.15.45:0/3616032871 shutdown_connections 2024-05-10T03:42:01.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.369+0000 7f3fa4fac700 1 --2- 172.21.15.45:0/3616032871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa0100ac0 0x7f3fa0068e30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.369+0000 7f3fa4fac700 1 --2- 172.21.15.45:0/3616032871 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f3f880a11c0 0x7f3f880a36d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.369+0000 7f3fa4fac700 1 --2- 172.21.15.45:0/3616032871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3fa0102580 0x7f3fa019f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.369+0000 7f3fa4fac700 1 --2- 172.21.15.45:0/3616032871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fa0101be0 0x7f3fa019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.369+0000 7f3fa4fac700 1 -- 172.21.15.45:0/3616032871 >> 172.21.15.45:0/3616032871 conn(0x7f3fa00fc0d0 msgr2=0x7f3fa0104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:01.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.369+0000 7f3fa4fac700 1 -- 172.21.15.45:0/3616032871 shutdown_connections 2024-05-10T03:42:01.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.369+0000 7f3fa4fac700 1 -- 172.21.15.45:0/3616032871 wait complete. 2024-05-10T03:42:01.392 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-10T03:42:01.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:01 smithi106 ceph-mon[46996]: pgmap v337: 129 pgs: 129 active+clean; 674 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:42:01.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:01 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1957173020' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:42:01.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:01 smithi154 ceph-mon[46565]: pgmap v337: 129 pgs: 129 active+clean; 674 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:42:01.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:01 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1957173020' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:42:01.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.546+0000 7f2eee350700 1 -- 172.21.15.45:0/948365319 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ee8100ae0 msgr2=0x7f2ee8100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.546+0000 7f2eee350700 1 --2- 172.21.15.45:0/948365319 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ee8100ae0 0x7f2ee8100ef0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8009920 tx=0x7f2ed8009c30 comp rx=0 tx=0).stop 2024-05-10T03:42:01.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.546+0000 7f2eee350700 1 -- 172.21.15.45:0/948365319 shutdown_connections 2024-05-10T03:42:01.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.546+0000 7f2eee350700 1 --2- 172.21.15.45:0/948365319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ee81025a0 0x7f2ee8108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.546+0000 7f2eee350700 1 --2- 172.21.15.45:0/948365319 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ee8100ae0 0x7f2ee8100ef0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.546+0000 7f2eee350700 1 --2- 172.21.15.45:0/948365319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ee8101c00 0x7f2ee8102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.546+0000 7f2eee350700 1 -- 172.21.15.45:0/948365319 >> 172.21.15.45:0/948365319 conn(0x7f2ee80fc0f0 msgr2=0x7f2ee80fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:01.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.547+0000 7f2eee350700 1 -- 172.21.15.45:0/948365319 shutdown_connections 2024-05-10T03:42:01.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.547+0000 7f2eee350700 1 -- 172.21.15.45:0/948365319 wait complete. 2024-05-10T03:42:01.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.547+0000 7f2eee350700 1 Processor -- start 2024-05-10T03:42:01.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.547+0000 7f2eee350700 1 -- start start 2024-05-10T03:42:01.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.548+0000 7f2eee350700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ee8100ae0 0x7f2ee81980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.548+0000 7f2eee350700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ee8101c00 0x7f2ee81985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.548+0000 7f2eee350700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ee81025a0 0x7f2ee819f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.548+0000 7f2eee350700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee819fb80 con 0x7f2ee8101c00 2024-05-10T03:42:01.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.548+0000 7f2eee350700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee819fcf0 con 0x7f2ee81025a0 2024-05-10T03:42:01.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.548+0000 7f2eee350700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee819feb0 con 0x7f2ee8100ae0 2024-05-10T03:42:01.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.548+0000 7f2ee77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ee8101c00 0x7f2ee81985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.548+0000 7f2ee77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ee8101c00 0x7f2ee81985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43874/0 (socket says 172.21.15.45:43874) 2024-05-10T03:42:01.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.548+0000 7f2ee77fe700 1 -- 172.21.15.45:0/1955025788 learned_addr learned my addr 172.21.15.45:0/1955025788 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:01.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.548+0000 7f2ee7fff700 1 --2- 172.21.15.45:0/1955025788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ee8100ae0 0x7f2ee81980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.548+0000 7f2eec8ed700 1 --2- 172.21.15.45:0/1955025788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ee81025a0 0x7f2ee819f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.549+0000 7f2ee7fff700 1 -- 172.21.15.45:0/1955025788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ee81025a0 msgr2=0x7f2ee819f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.549+0000 7f2ee7fff700 1 --2- 172.21.15.45:0/1955025788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ee81025a0 0x7f2ee819f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.549+0000 7f2ee7fff700 1 -- 172.21.15.45:0/1955025788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ee8101c00 msgr2=0x7f2ee81985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.549+0000 7f2ee7fff700 1 --2- 172.21.15.45:0/1955025788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ee8101c00 0x7f2ee81985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.549+0000 7f2ee7fff700 1 -- 172.21.15.45:0/1955025788 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee0009d00 con 0x7f2ee8100ae0 2024-05-10T03:42:01.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.549+0000 7f2ee77fe700 1 --2- 172.21.15.45:0/1955025788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ee8101c00 0x7f2ee81985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:01.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.549+0000 7f2ee7fff700 1 --2- 172.21.15.45:0/1955025788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ee8100ae0 0x7f2ee81980a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8009230 tx=0x7f2ed8005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:01.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.549+0000 7f2ee57fa700 1 -- 172.21.15.45:0/1955025788 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed801c070 con 0x7f2ee8100ae0 2024-05-10T03:42:01.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.549+0000 7f2eee350700 1 -- 172.21.15.45:0/1955025788 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed8009520 con 0x7f2ee8100ae0 2024-05-10T03:42:01.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.549+0000 7f2ee57fa700 1 -- 172.21.15.45:0/1955025788 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2ed800f950 con 0x7f2ee8100ae0 2024-05-10T03:42:01.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.549+0000 7f2ee57fa700 1 -- 172.21.15.45:0/1955025788 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed80038c0 con 0x7f2ee8100ae0 2024-05-10T03:42:01.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.549+0000 7f2eee350700 1 -- 172.21.15.45:0/1955025788 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee8109720 con 0x7f2ee8100ae0 2024-05-10T03:42:01.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.553+0000 7f2ee57fa700 1 -- 172.21.15.45:0/1955025788 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2ed8020030 con 0x7f2ee8100ae0 2024-05-10T03:42:01.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.553+0000 7f2efe694b80 1 Processor -- start 2024-05-10T03:42:01.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.553+0000 7f2efe694b80 1 -- start start 2024-05-10T03:42:01.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.554+0000 7f2efe694b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562d35ae4eb0 0x562d35ae5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.554+0000 7f2efe694b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d35ae5d80 0x562d35ae6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.554+0000 7f2efe694b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d35ae66d0 0x562d35aecfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.554+0000 7f2efe694b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d35a03150 con 0x562d35ae66d0 2024-05-10T03:42:01.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.554+0000 7f2efe694b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d35a00b10 con 0x562d35ae4eb0 2024-05-10T03:42:01.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.554+0000 7f2efe694b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d359fc400 con 0x562d35ae5d80 2024-05-10T03:42:01.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.554+0000 7f2ee57fa700 1 --2- 172.21.15.45:0/1955025788 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2ed00a1240 0x7f2ed00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.554+0000 7f2ee77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d35ae66d0 0x562d35aecfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.554+0000 7f2ee77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d35ae66d0 0x562d35aecfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43884/0 (socket says 172.21.15.45:43884) 2024-05-10T03:42:01.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.554+0000 7f2ee77fe700 1 -- 172.21.15.45:0/832851137 learned_addr learned my addr 172.21.15.45:0/832851137 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:01.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.554+0000 7f2ee57fa700 1 -- 172.21.15.45:0/1955025788 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f2ed80cdb20 con 0x7f2ee8100ae0 2024-05-10T03:42:01.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.554+0000 7f2ee77fe700 1 -- 172.21.15.45:0/832851137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d35ae5d80 msgr2=0x562d35ae6190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T03:42:01.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.554+0000 7f2ee77fe700 1 --2- 172.21.15.45:0/832851137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d35ae5d80 0x562d35ae6190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.554+0000 7f2ee77fe700 1 -- 172.21.15.45:0/832851137 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562d35ae4eb0 msgr2=0x562d35ae5300 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T03:42:01.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.554+0000 7f2ee77fe700 1 --2- 172.21.15.45:0/832851137 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562d35ae4eb0 0x562d35ae5300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.554+0000 7f2ee77fe700 1 -- 172.21.15.45:0/832851137 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d3587d3b0 con 0x562d35ae66d0 2024-05-10T03:42:01.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.555+0000 7f2ee77fe700 1 --2- 172.21.15.45:0/832851137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d35ae66d0 0x562d35aecfd0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f2edc011680 tx=0x7f2edc011990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99be89097135e27e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.555+0000 7f2eec8ed700 1 --2- 172.21.15.45:0/1955025788 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2ed00a1240 0x7f2ed00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.555+0000 7f2ece7fc700 1 -- 172.21.15.45:0/832851137 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc004030 con 0x562d35ae66d0 2024-05-10T03:42:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.555+0000 7f2ece7fc700 1 -- 172.21.15.45:0/832851137 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2edc003680 con 0x562d35ae66d0 2024-05-10T03:42:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.555+0000 7f2ece7fc700 1 -- 172.21.15.45:0/832851137 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc00f6a0 con 0x562d35ae66d0 2024-05-10T03:42:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.556+0000 7f2efe694b80 1 -- 172.21.15.45:0/832851137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d35ae66d0 msgr2=0x562d35aecfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.556+0000 7f2eec8ed700 1 --2- 172.21.15.45:0/1955025788 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2ed00a1240 0x7f2ed00a3750 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x562d35ae4b90 tx=0x7f2ee000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.556+0000 7f2efe694b80 1 --2- 172.21.15.45:0/832851137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d35ae66d0 0x562d35aecfd0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f2edc011680 tx=0x7f2edc011990 comp rx=0 tx=0).stop 2024-05-10T03:42:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.556+0000 7f2efe694b80 1 -- 172.21.15.45:0/832851137 shutdown_connections 2024-05-10T03:42:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.556+0000 7f2efe694b80 1 --2- 172.21.15.45:0/832851137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d35ae66d0 0x562d35aecfd0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.556+0000 7f2efe694b80 1 --2- 172.21.15.45:0/832851137 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562d35ae4eb0 0x562d35ae5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.556+0000 7f2efe694b80 1 --2- 172.21.15.45:0/832851137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d35ae5d80 0x562d35ae6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.556+0000 7f2efe694b80 1 -- 172.21.15.45:0/832851137 >> 172.21.15.45:0/832851137 conn(0x562d35a3ea60 msgr2=0x562d35ad6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.556+0000 7f2efe694b80 1 -- 172.21.15.45:0/832851137 shutdown_connections 2024-05-10T03:42:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.556+0000 7f2efe694b80 1 -- 172.21.15.45:0/832851137 wait complete. 2024-05-10T03:42:01.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.557+0000 7f2efe694b80 1 -- start start 2024-05-10T03:42:01.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.557+0000 7f2efe694b80 1 Processor -- start 2024-05-10T03:42:01.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.558+0000 7f2efe694b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d35ae4eb0 0x562d35aeee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.558+0000 7f2efe694b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d35ae5d80 0x562d35aef3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.558+0000 7f2efe694b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562d35ae66d0 0x562d35af6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.558+0000 7f2efe694b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d35998560 con 0x562d35ae5d80 2024-05-10T03:42:01.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.558+0000 7f2efe694b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d35998200 con 0x562d35ae66d0 2024-05-10T03:42:01.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.558+0000 7f2efe694b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d3587f6a0 con 0x562d35ae4eb0 2024-05-10T03:42:01.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.558+0000 7f2efe694b80 10 client.0 _ll_register_callbacks cb 0x562d359a1b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:01.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.558+0000 7f2ee7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d35ae4eb0 0x562d35aeee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.558+0000 7f2ee7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d35ae4eb0 0x562d35aeee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:55960/0 (socket says 172.21.15.45:55960) 2024-05-10T03:42:01.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.558+0000 7f2ee7fff700 1 -- 172.21.15.45:0/2962034781 learned_addr learned my addr 172.21.15.45:0/2962034781 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:01.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.558+0000 7f2ee77fe700 1 --2- 172.21.15.45:0/2962034781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d35ae5d80 0x562d35aef3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.558+0000 7f2eec8ed700 1 --2- 172.21.15.45:0/2962034781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562d35ae66d0 0x562d35af6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.559+0000 7f2ee77fe700 1 -- 172.21.15.45:0/2962034781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d35ae4eb0 msgr2=0x562d35aeee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.559+0000 7f2ee77fe700 1 --2- 172.21.15.45:0/2962034781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d35ae4eb0 0x562d35aeee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.559+0000 7f2ee77fe700 1 -- 172.21.15.45:0/2962034781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562d35ae66d0 msgr2=0x562d35af6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.559+0000 7f2ee77fe700 1 --2- 172.21.15.45:0/2962034781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562d35ae66d0 0x562d35af6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.559+0000 7f2ee77fe700 1 -- 172.21.15.45:0/2962034781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2edc009e10 con 0x562d35ae5d80 2024-05-10T03:42:01.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.559+0000 7f2ee77fe700 1 --2- 172.21.15.45:0/2962034781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d35ae5d80 0x562d35aef3d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f2edc01b040 tx=0x7f2edc004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21880dd9506ab16b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:01.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.559+0000 7f2ec77fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:42:01.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.559+0000 7f2ec77fe700 1 -- 172.21.15.45:0/2962034781 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc005260 con 0x562d35ae5d80 2024-05-10T03:42:01.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.559+0000 7f2ec77fe700 1 -- 172.21.15.45:0/2962034781 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f2edc0053c0 con 0x562d35ae5d80 2024-05-10T03:42:01.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.559+0000 7f2efe694b80 1 -- 172.21.15.45:0/2962034781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562d35955270 con 0x562d35ae5d80 2024-05-10T03:42:01.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.559+0000 7f2ec77fe700 1 -- 172.21.15.45:0/2962034781 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2edc0055c0 con 0x562d35ae5d80 2024-05-10T03:42:01.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.560+0000 7f2efe694b80 10 client.16203 fetch_fsmap learned FSMap version 28 2024-05-10T03:42:01.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.560+0000 7f2efe694b80 1 -- 172.21.15.45:0/2962034781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x562d35829b60 con 0x562d35ae5d80 2024-05-10T03:42:01.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.560+0000 7f2ec77fe700 1 -- 172.21.15.45:0/2962034781 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x562d35955270 con 0x562d35ae5d80 2024-05-10T03:42:01.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.560+0000 7f2ec77fe700 1 -- 172.21.15.45:0/2962034781 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2edc0227c0 con 0x562d35ae5d80 2024-05-10T03:42:01.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.560+0000 7f2efe694b80 10 client.16203 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:42:01.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.560+0000 7f2efe694b80 10 client.16203 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-10T03:42:01.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.560+0000 7f2efe694b80 20 client.16203 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:01.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.560+0000 7f2efe694b80 1 --2- 172.21.15.45:0/2962034781 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x562d35afa960 0x562d35afcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.560+0000 7f2efe694b80 4 client.16203 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:42:01.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.560+0000 7f2efe694b80 1 -- 172.21.15.45:0/2962034781 --> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562d35aab780 con 0x562d35afa960 2024-05-10T03:42:01.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.560+0000 7f2ee7fff700 1 --2- 172.21.15.45:0/2962034781 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x562d35afa960 0x562d35afcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.561+0000 7f2ec77fe700 10 client.16203 ms_handle_connect on v2:172.21.15.106:6836/3047487403 2024-05-10T03:42:01.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.561+0000 7f2ee7fff700 1 --2- 172.21.15.45:0/2962034781 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x562d35afa960 0x562d35afcdb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5a85ebb63255e9b5 server_cookie=4814abd9e9eb8b8d in_seq=0 out_seq=0 2024-05-10T03:42:01.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.562+0000 7f2ec77fe700 1 -- 172.21.15.45:0/2962034781 <== mds.1 v2:172.21.15.106:6836/3047487403 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562d35aab780 con 0x562d35afa960 2024-05-10T03:42:01.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.562+0000 7f2ec77fe700 10 client.16203 handle_command_reply: tid=0 2024-05-10T03:42:01.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.562+0000 7f2efe694b80 1 client.16203 shutdown 2024-05-10T03:42:01.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.562+0000 7f2efe694b80 1 -- 172.21.15.45:0/2962034781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d35ae5d80 msgr2=0x562d35aef3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.562+0000 7f2efe694b80 1 --2- 172.21.15.45:0/2962034781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d35ae5d80 0x562d35aef3d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f2edc01b040 tx=0x7f2edc004300 comp rx=0 tx=0).stop 2024-05-10T03:42:01.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.562+0000 7f2efe694b80 1 -- 172.21.15.45:0/2962034781 shutdown_connections 2024-05-10T03:42:01.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.562+0000 7f2efe694b80 1 --2- 172.21.15.45:0/2962034781 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x562d35afa960 0x562d35afcdb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.562+0000 7f2efe694b80 1 --2- 172.21.15.45:0/2962034781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d35ae4eb0 0x562d35aeee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.562+0000 7f2efe694b80 1 --2- 172.21.15.45:0/2962034781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562d35ae66d0 0x562d35af6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.562+0000 7f2efe694b80 1 --2- 172.21.15.45:0/2962034781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d35ae5d80 0x562d35aef3d0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.562+0000 7f2efe694b80 1 -- 172.21.15.45:0/2962034781 >> 172.21.15.45:0/2962034781 conn(0x562d35a3ea60 msgr2=0x562d35ad6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:01.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.562+0000 7f2ec77fe700 0 client.16203 ms_handle_reset on v2:172.21.15.106:6836/3047487403 2024-05-10T03:42:01.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.562+0000 7f2efe694b80 1 -- 172.21.15.45:0/2962034781 shutdown_connections 2024-05-10T03:42:01.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.562+0000 7f2efe694b80 1 -- 172.21.15.45:0/2962034781 wait complete. 2024-05-10T03:42:01.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.562+0000 7f2efe694b80 20 client.16203 trim_cache size 0 max 16384 2024-05-10T03:42:01.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.577+0000 7f2efe694b80 1 Processor -- start 2024-05-10T03:42:01.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.577+0000 7f2efe694b80 1 -- start start 2024-05-10T03:42:01.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.577+0000 7f2efe694b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d35ae4eb0 0x562d35af6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.577+0000 7f2efe694b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562d35ae5d80 0x562d35af62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.577+0000 7f2efe694b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d35ae66d0 0x562d35ae8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.577+0000 7f2efe694b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d35aeff30 con 0x562d35ae4eb0 2024-05-10T03:42:01.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.577+0000 7f2efe694b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d35ad8770 con 0x562d35ae5d80 2024-05-10T03:42:01.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.577+0000 7f2efe694b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d35ad17c0 con 0x562d35ae66d0 2024-05-10T03:42:01.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.577+0000 7f2eec8ed700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d35ae66d0 0x562d35ae8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.577+0000 7f2eec8ed700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d35ae66d0 0x562d35ae8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:55966/0 (socket says 172.21.15.45:55966) 2024-05-10T03:42:01.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.577+0000 7f2eec8ed700 1 -- 172.21.15.45:0/2159417450 learned_addr learned my addr 172.21.15.45:0/2159417450 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:01.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.578+0000 7f2ee7fff700 1 --2- 172.21.15.45:0/2159417450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d35ae4eb0 0x562d35af6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.578+0000 7f2ee77fe700 1 --2- 172.21.15.45:0/2159417450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562d35ae5d80 0x562d35af62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.578+0000 7f2eec8ed700 1 -- 172.21.15.45:0/2159417450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562d35ae5d80 msgr2=0x562d35af62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.578+0000 7f2eec8ed700 1 --2- 172.21.15.45:0/2159417450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562d35ae5d80 0x562d35af62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.578+0000 7f2eec8ed700 1 -- 172.21.15.45:0/2159417450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d35ae4eb0 msgr2=0x562d35af6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.578+0000 7f2eec8ed700 1 --2- 172.21.15.45:0/2159417450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d35ae4eb0 0x562d35af6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.578+0000 7f2eec8ed700 1 -- 172.21.15.45:0/2159417450 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d359c2560 con 0x562d35ae66d0 2024-05-10T03:42:01.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.578+0000 7f2ee77fe700 1 --2- 172.21.15.45:0/2159417450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562d35ae5d80 0x562d35af62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:42:01.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.578+0000 7f2eec8ed700 1 --2- 172.21.15.45:0/2159417450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d35ae66d0 0x562d35ae8fb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0017a10 tx=0x7f2ee0014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3a29439dedbf057 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:01.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.578+0000 7f2eceffd700 1 -- 172.21.15.45:0/2159417450 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee000e040 con 0x562d35ae66d0 2024-05-10T03:42:01.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.578+0000 7f2eceffd700 1 -- 172.21.15.45:0/2159417450 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2ee000f040 con 0x562d35ae66d0 2024-05-10T03:42:01.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.578+0000 7f2eceffd700 1 -- 172.21.15.45:0/2159417450 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee00143b0 con 0x562d35ae66d0 2024-05-10T03:42:01.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.579+0000 7f2efe694b80 1 -- 172.21.15.45:0/2159417450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d35ae66d0 msgr2=0x562d35ae8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.579+0000 7f2efe694b80 1 --2- 172.21.15.45:0/2159417450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d35ae66d0 0x562d35ae8fb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0017a10 tx=0x7f2ee0014000 comp rx=0 tx=0).stop 2024-05-10T03:42:01.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.579+0000 7f2efe694b80 1 -- 172.21.15.45:0/2159417450 shutdown_connections 2024-05-10T03:42:01.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.579+0000 7f2efe694b80 1 --2- 172.21.15.45:0/2159417450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d35ae66d0 0x562d35ae8fb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.579+0000 7f2efe694b80 1 --2- 172.21.15.45:0/2159417450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d35ae4eb0 0x562d35af6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.579+0000 7f2efe694b80 1 --2- 172.21.15.45:0/2159417450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562d35ae5d80 0x562d35af62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.579+0000 7f2efe694b80 1 -- 172.21.15.45:0/2159417450 >> 172.21.15.45:0/2159417450 conn(0x562d35a3ea60 msgr2=0x562d35ad6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:01.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.579+0000 7f2efe694b80 1 -- 172.21.15.45:0/2159417450 shutdown_connections 2024-05-10T03:42:01.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.579+0000 7f2efe694b80 1 -- 172.21.15.45:0/2159417450 wait complete. 2024-05-10T03:42:01.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.580+0000 7f2efe694b80 1 -- start start 2024-05-10T03:42:01.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.580+0000 7f2efe694b80 1 Processor -- start 2024-05-10T03:42:01.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.580+0000 7f2efe694b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562d35ae4eb0 0x562d35af3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.580+0000 7f2efe694b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d35ae5d80 0x562d35af3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.580+0000 7f2efe694b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d35ae66d0 0x562d35af4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.581+0000 7f2efe694b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d35af5130 con 0x562d35ae5d80 2024-05-10T03:42:01.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.581+0000 7f2efe694b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d35af52a0 con 0x562d35ae4eb0 2024-05-10T03:42:01.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.581+0000 7f2efe694b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d35af5460 con 0x562d35ae66d0 2024-05-10T03:42:01.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.581+0000 7f2efe694b80 10 client.0 _ll_register_callbacks cb 0x562d359a1b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:01.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.581+0000 7f2eec8ed700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d35ae66d0 0x562d35af4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.581+0000 7f2eec8ed700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d35ae66d0 0x562d35af4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:55968/0 (socket says 172.21.15.45:55968) 2024-05-10T03:42:01.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.581+0000 7f2eec8ed700 1 -- 172.21.15.45:0/3804460125 learned_addr learned my addr 172.21.15.45:0/3804460125 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:01.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.581+0000 7f2eec8ed700 1 -- 172.21.15.45:0/3804460125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562d35ae4eb0 msgr2=0x562d35af3780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T03:42:01.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.581+0000 7f2eec8ed700 1 --2- 172.21.15.45:0/3804460125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562d35ae4eb0 0x562d35af3780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.581+0000 7f2eec8ed700 1 -- 172.21.15.45:0/3804460125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d35ae5d80 msgr2=0x562d35af3cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T03:42:01.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.581+0000 7f2eec8ed700 1 --2- 172.21.15.45:0/3804460125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d35ae5d80 0x562d35af3cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.581+0000 7f2eec8ed700 1 -- 172.21.15.45:0/3804460125 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee00176f0 con 0x562d35ae66d0 2024-05-10T03:42:01.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.582+0000 7f2eec8ed700 1 --2- 172.21.15.45:0/3804460125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d35ae66d0 0x562d35af4bf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0009340 tx=0x7f2ee0023fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c88c3a79ba7871d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:01.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.582+0000 7f2ec77fe700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-05-10T03:42:01.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.582+0000 7f2ec77fe700 1 -- 172.21.15.45:0/3804460125 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee002f070 con 0x562d35ae66d0 2024-05-10T03:42:01.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.582+0000 7f2ec77fe700 1 -- 172.21.15.45:0/3804460125 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f2ee001c070 con 0x562d35ae66d0 2024-05-10T03:42:01.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.582+0000 7f2efe694b80 1 -- 172.21.15.45:0/3804460125 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2edc003680 con 0x562d35ae66d0 2024-05-10T03:42:01.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.582+0000 7f2ec77fe700 1 -- 172.21.15.45:0/3804460125 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ee000e040 con 0x562d35ae66d0 2024-05-10T03:42:01.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.582+0000 7f2efe694b80 10 client.26071 fetch_fsmap learned FSMap version 28 2024-05-10T03:42:01.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.582+0000 7f2efe694b80 1 -- 172.21.15.45:0/3804460125 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x562d35881cd0 con 0x562d35ae66d0 2024-05-10T03:42:01.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.582+0000 7f2ec77fe700 1 -- 172.21.15.45:0/3804460125 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2edc003680 con 0x562d35ae66d0 2024-05-10T03:42:01.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.583+0000 7f2ec77fe700 1 -- 172.21.15.45:0/3804460125 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2ee002aca0 con 0x562d35ae66d0 2024-05-10T03:42:01.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.583+0000 7f2efe694b80 10 client.26071 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:42:01.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.583+0000 7f2efe694b80 10 client.26071 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-10T03:42:01.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.583+0000 7f2efe694b80 20 client.26071 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:01.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.583+0000 7f2efe694b80 1 --2- 172.21.15.45:0/3804460125 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x562d35b511b0 0x562d35b535d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.583+0000 7f2efe694b80 4 client.26071 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-10T03:42:01.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.583+0000 7f2efe694b80 1 -- 172.21.15.45:0/3804460125 --> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562d359f4ec0 con 0x562d35b511b0 2024-05-10T03:42:01.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.583+0000 7f2ee7fff700 1 --2- 172.21.15.45:0/3804460125 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x562d35b511b0 0x562d35b535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.583+0000 7f2ec77fe700 10 client.26071 ms_handle_connect on v2:172.21.15.106:6836/3047487403 2024-05-10T03:42:01.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.583+0000 7f2ee7fff700 1 --2- 172.21.15.45:0/3804460125 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x562d35b511b0 0x562d35b535d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=eb2e9bdc553ea69d server_cookie=1cdc8444af6dea34 in_seq=0 out_seq=0 2024-05-10T03:42:01.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.584+0000 7f2ec77fe700 1 -- 172.21.15.45:0/3804460125 <== mds.1 v2:172.21.15.106:6836/3047487403 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562d359f4ec0 con 0x562d35b511b0 2024-05-10T03:42:01.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.584+0000 7f2ec77fe700 10 client.26071 handle_command_reply: tid=0 2024-05-10T03:42:01.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.584+0000 7f2efe694b80 1 client.26071 shutdown 2024-05-10T03:42:01.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.584+0000 7f2efe694b80 1 -- 172.21.15.45:0/3804460125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d35ae66d0 msgr2=0x562d35af4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.584+0000 7f2efe694b80 1 --2- 172.21.15.45:0/3804460125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d35ae66d0 0x562d35af4bf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0009340 tx=0x7f2ee0023fc0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.584+0000 7f2efe694b80 1 -- 172.21.15.45:0/3804460125 shutdown_connections 2024-05-10T03:42:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.584+0000 7f2efe694b80 1 --2- 172.21.15.45:0/3804460125 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x562d35b511b0 0x562d35b535d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.584+0000 7f2efe694b80 1 --2- 172.21.15.45:0/3804460125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d35ae66d0 0x562d35af4bf0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.584+0000 7f2efe694b80 1 --2- 172.21.15.45:0/3804460125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562d35ae4eb0 0x562d35af3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.584+0000 7f2ec77fe700 0 client.26071 ms_handle_reset on v2:172.21.15.106:6836/3047487403 2024-05-10T03:42:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.584+0000 7f2efe694b80 1 --2- 172.21.15.45:0/3804460125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d35ae5d80 0x562d35af3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.584+0000 7f2efe694b80 1 -- 172.21.15.45:0/3804460125 >> 172.21.15.45:0/3804460125 conn(0x562d35a3ea60 msgr2=0x562d35ad6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:01.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.584+0000 7f2efe694b80 1 -- 172.21.15.45:0/3804460125 shutdown_connections 2024-05-10T03:42:01.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.584+0000 7f2efe694b80 1 -- 172.21.15.45:0/3804460125 wait complete. 2024-05-10T03:42:01.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.584+0000 7f2efe694b80 20 client.26071 trim_cache size 0 max 16384 2024-05-10T03:42:01.593 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-05-10T03:42:01.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.585+0000 7f2eee350700 1 -- 172.21.15.45:0/1955025788 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2ed00a1240 msgr2=0x7f2ed00a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.585+0000 7f2eee350700 1 --2- 172.21.15.45:0/1955025788 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2ed00a1240 0x7f2ed00a3750 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x562d35ae4b90 tx=0x7f2ee000b040 comp rx=0 tx=0).stop 2024-05-10T03:42:01.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.585+0000 7f2eee350700 1 -- 172.21.15.45:0/1955025788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ee8100ae0 msgr2=0x7f2ee81980a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.585+0000 7f2eee350700 1 --2- 172.21.15.45:0/1955025788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ee8100ae0 0x7f2ee81980a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8009230 tx=0x7f2ed8005270 comp rx=0 tx=0).stop 2024-05-10T03:42:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.585+0000 7f2eee350700 1 -- 172.21.15.45:0/1955025788 shutdown_connections 2024-05-10T03:42:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.585+0000 7f2eee350700 1 --2- 172.21.15.45:0/1955025788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ee8100ae0 0x7f2ee81980a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.585+0000 7f2eee350700 1 --2- 172.21.15.45:0/1955025788 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2ed00a1240 0x7f2ed00a3750 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.585+0000 7f2eee350700 1 --2- 172.21.15.45:0/1955025788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ee81025a0 0x7f2ee819f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.585+0000 7f2eee350700 1 --2- 172.21.15.45:0/1955025788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ee8101c00 0x7f2ee81985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.585+0000 7f2eee350700 1 -- 172.21.15.45:0/1955025788 >> 172.21.15.45:0/1955025788 conn(0x7f2ee80fc0f0 msgr2=0x7f2ee8104e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:01.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.585+0000 7f2eee350700 1 -- 172.21.15.45:0/1955025788 shutdown_connections 2024-05-10T03:42:01.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.585+0000 7f2eee350700 1 -- 172.21.15.45:0/1955025788 wait complete. 2024-05-10T03:42:01.607 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-10T03:42:01.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.825+0000 7f6ad69fe700 1 -- 172.21.15.45:0/3991549508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ad0101090 msgr2=0x7f6ad01014a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.825+0000 7f6ad69fe700 1 --2- 172.21.15.45:0/3991549508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ad0101090 0x7f6ad01014a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000ba80 tx=0x7f6ac000bd90 comp rx=0 tx=0).stop 2024-05-10T03:42:01.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.825+0000 7f6ad69fe700 1 -- 172.21.15.45:0/3991549508 shutdown_connections 2024-05-10T03:42:01.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.825+0000 7f6ad69fe700 1 --2- 172.21.15.45:0/3991549508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ad0102590 0x7f6ad0109050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.825+0000 7f6ad69fe700 1 --2- 172.21.15.45:0/3991549508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ad0101090 0x7f6ad01014a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.825+0000 7f6ad69fe700 1 --2- 172.21.15.45:0/3991549508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ad0101a70 0x7f6ad0101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.825+0000 7f6ad69fe700 1 -- 172.21.15.45:0/3991549508 >> 172.21.15.45:0/3991549508 conn(0x7f6ad00fb8b0 msgr2=0x7f6ad00fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:01.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.826+0000 7f6ad69fe700 1 -- 172.21.15.45:0/3991549508 shutdown_connections 2024-05-10T03:42:01.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.826+0000 7f6ad69fe700 1 -- 172.21.15.45:0/3991549508 wait complete. 2024-05-10T03:42:01.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.826+0000 7f6ad69fe700 1 Processor -- start 2024-05-10T03:42:01.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.827+0000 7f6ad69fe700 1 -- start start 2024-05-10T03:42:01.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.827+0000 7f6ad69fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ad0101090 0x7f6ad019a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.827+0000 7f6ad69fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ad0101a70 0x7f6ad019a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.827+0000 7f6ad69fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ad0102590 0x7f6ad01a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.827+0000 7f6ad69fe700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad01a1cf0 con 0x7f6ad0101a70 2024-05-10T03:42:01.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.827+0000 7f6ad69fe700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad01a1e60 con 0x7f6ad0102590 2024-05-10T03:42:01.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.827+0000 7f6ad69fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad01a2020 con 0x7f6ad0101090 2024-05-10T03:42:01.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.827+0000 7f6acf7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ad0101a70 0x7f6ad019a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.828+0000 7f6acf7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ad0101a70 0x7f6ad019a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43922/0 (socket says 172.21.15.45:43922) 2024-05-10T03:42:01.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.828+0000 7f6acf7fe700 1 -- 172.21.15.45:0/2381399061 learned_addr learned my addr 172.21.15.45:0/2381399061 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:01.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.828+0000 7f6ad4f9b700 1 --2- 172.21.15.45:0/2381399061 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ad0102590 0x7f6ad01a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.828+0000 7f6ad4f9b700 1 -- 172.21.15.45:0/2381399061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ad0101090 msgr2=0x7f6ad019a210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-10T03:42:01.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.828+0000 7f6ad4f9b700 1 --2- 172.21.15.45:0/2381399061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ad0101090 0x7f6ad019a210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.828+0000 7f6ad4f9b700 1 -- 172.21.15.45:0/2381399061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ad0101a70 msgr2=0x7f6ad019a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.828+0000 7f6ad4f9b700 1 --2- 172.21.15.45:0/2381399061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ad0101a70 0x7f6ad019a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.828+0000 7f6ad4f9b700 1 -- 172.21.15.45:0/2381399061 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac40095f0 con 0x7f6ad0102590 2024-05-10T03:42:01.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.828+0000 7f6acf7fe700 1 --2- 172.21.15.45:0/2381399061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ad0101a70 0x7f6ad019a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:01.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.828+0000 7f6ad4f9b700 1 --2- 172.21.15.45:0/2381399061 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ad0102590 0x7f6ad01a16e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800efc0 tx=0x7f6ac800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:01.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.828+0000 7f6acd7fa700 1 -- 172.21.15.45:0/2381399061 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8018070 con 0x7f6ad0102590 2024-05-10T03:42:01.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.829+0000 7f6acd7fa700 1 -- 172.21.15.45:0/2381399061 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6ac800f040 con 0x7f6ad0102590 2024-05-10T03:42:01.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.829+0000 7f6acd7fa700 1 -- 172.21.15.45:0/2381399061 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac800ce20 con 0x7f6ad0102590 2024-05-10T03:42:01.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.830+0000 7f6ad69fe700 1 -- 172.21.15.45:0/2381399061 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac000b730 con 0x7f6ad0102590 2024-05-10T03:42:01.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.830+0000 7f6ad69fe700 1 -- 172.21.15.45:0/2381399061 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad01a25a0 con 0x7f6ad0102590 2024-05-10T03:42:01.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.834+0000 7f6acd7fa700 1 -- 172.21.15.45:0/2381399061 <== mon.2 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6ac8004ad0 con 0x7f6ad0102590 2024-05-10T03:42:01.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.835+0000 7f6acd7fa700 1 --2- 172.21.15.45:0/2381399061 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6ab80a1240 0x7f6ab80a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.835+0000 7f6acd7fa700 1 -- 172.21.15.45:0/2381399061 <== mon.2 v2:172.21.15.106:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f6ac80cbfa0 con 0x7f6ad0102590 2024-05-10T03:42:01.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.835+0000 7f6ae6d42b80 1 Processor -- start 2024-05-10T03:42:01.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.835+0000 7f6ae6d42b80 1 -- start start 2024-05-10T03:42:01.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.836+0000 7f6ae6d42b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573ac31ceb0 0x5573ac31d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.836+0000 7f6ae6d42b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573ac31dd80 0x5573ac31e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.836+0000 7f6ae6d42b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573ac31e6d0 0x5573ac324fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.836+0000 7f6ae6d42b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573ac23b150 con 0x5573ac31ceb0 2024-05-10T03:42:01.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.836+0000 7f6ae6d42b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573ac238b10 con 0x5573ac31dd80 2024-05-10T03:42:01.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.836+0000 7f6ae6d42b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573ac234400 con 0x5573ac31e6d0 2024-05-10T03:42:01.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.836+0000 7f6acf7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573ac31dd80 0x5573ac31e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.836+0000 7f6acf7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573ac31dd80 0x5573ac31e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.45:57564/0 (socket says 172.21.15.45:57564) 2024-05-10T03:42:01.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.836+0000 7f6acf7fe700 1 -- 172.21.15.45:0/2750832747 learned_addr learned my addr 172.21.15.45:0/2750832747 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:01.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.836+0000 7f6acffff700 1 --2- 172.21.15.45:0/2381399061 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6ab80a1240 0x7f6ab80a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.836+0000 7f6acf7fe700 1 -- 172.21.15.45:0/2750832747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573ac31e6d0 msgr2=0x5573ac324fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.836+0000 7f6acf7fe700 1 --2- 172.21.15.45:0/2750832747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573ac31e6d0 0x5573ac324fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.837+0000 7f6acf7fe700 1 -- 172.21.15.45:0/2750832747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573ac31ceb0 msgr2=0x5573ac31d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.837+0000 7f6acf7fe700 1 --2- 172.21.15.45:0/2750832747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573ac31ceb0 0x5573ac31d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.837+0000 7f6acf7fe700 1 -- 172.21.15.45:0/2750832747 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5573ac0b53b0 con 0x5573ac31dd80 2024-05-10T03:42:01.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.837+0000 7f6acf7fe700 1 --2- 172.21.15.45:0/2750832747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573ac31dd80 0x5573ac31e190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4011880 tx=0x7f6ac4011b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab8126a6aa1f1cbd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.837+0000 7f6ab67fc700 1 -- 172.21.15.45:0/2750832747 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac4011310 con 0x5573ac31dd80 2024-05-10T03:42:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.837+0000 7f6ab67fc700 1 -- 172.21.15.45:0/2750832747 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6ac4004d10 con 0x5573ac31dd80 2024-05-10T03:42:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.837+0000 7f6ab67fc700 1 -- 172.21.15.45:0/2750832747 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac400f8e0 con 0x5573ac31dd80 2024-05-10T03:42:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.838+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/2750832747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573ac31dd80 msgr2=0x5573ac31e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.838+0000 7f6ae6d42b80 1 --2- 172.21.15.45:0/2750832747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573ac31dd80 0x5573ac31e190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4011880 tx=0x7f6ac4011b90 comp rx=0 tx=0).stop 2024-05-10T03:42:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.838+0000 7f6acffff700 1 --2- 172.21.15.45:0/2381399061 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6ab80a1240 0x7f6ab80a3750 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x5573ac31cb90 tx=0x7f6ac000bf60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.838+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/2750832747 shutdown_connections 2024-05-10T03:42:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.838+0000 7f6ae6d42b80 1 --2- 172.21.15.45:0/2750832747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573ac31e6d0 0x5573ac324fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.838+0000 7f6ae6d42b80 1 --2- 172.21.15.45:0/2750832747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573ac31ceb0 0x5573ac31d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.838+0000 7f6ae6d42b80 1 --2- 172.21.15.45:0/2750832747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573ac31dd80 0x5573ac31e190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.838+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/2750832747 >> 172.21.15.45:0/2750832747 conn(0x5573ac276a60 msgr2=0x5573ac30efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:01.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.839+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/2750832747 shutdown_connections 2024-05-10T03:42:01.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.839+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/2750832747 wait complete. 2024-05-10T03:42:01.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.839+0000 7f6ae6d42b80 1 -- start start 2024-05-10T03:42:01.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.839+0000 7f6ae6d42b80 1 Processor -- start 2024-05-10T03:42:01.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.840+0000 7f6ae6d42b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573ac31ceb0 0x5573ac326ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.840+0000 7f6ae6d42b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573ac31dd80 0x5573ac327410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.840+0000 7f6ae6d42b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573ac31e6d0 0x5573ac32e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.840+0000 7f6ae6d42b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573ac1d0560 con 0x5573ac31ceb0 2024-05-10T03:42:01.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.840+0000 7f6ae6d42b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573ac1d0200 con 0x5573ac31e6d0 2024-05-10T03:42:01.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.840+0000 7f6ae6d42b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573ac0b76a0 con 0x5573ac31dd80 2024-05-10T03:42:01.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.840+0000 7f6ae6d42b80 10 client.0 _ll_register_callbacks cb 0x5573ac1d9b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:01.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.840+0000 7f6acf7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573ac31dd80 0x5573ac327410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.840+0000 7f6acf7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573ac31dd80 0x5573ac327410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:55992/0 (socket says 172.21.15.45:55992) 2024-05-10T03:42:01.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.840+0000 7f6acf7fe700 1 -- 172.21.15.45:0/3319000627 learned_addr learned my addr 172.21.15.45:0/3319000627 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:01.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.840+0000 7f6ad4f9b700 1 --2- 172.21.15.45:0/3319000627 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573ac31e6d0 0x5573ac32e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.841+0000 7f6acf7fe700 1 -- 172.21.15.45:0/3319000627 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573ac31e6d0 msgr2=0x5573ac32e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.841+0000 7f6acf7fe700 1 --2- 172.21.15.45:0/3319000627 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573ac31e6d0 0x5573ac32e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.841+0000 7f6acf7fe700 1 -- 172.21.15.45:0/3319000627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573ac31ceb0 msgr2=0x5573ac326ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.841+0000 7f6acf7fe700 1 --2- 172.21.15.45:0/3319000627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573ac31ceb0 0x5573ac326ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.841+0000 7f6acf7fe700 1 -- 172.21.15.45:0/3319000627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac40114e0 con 0x5573ac31dd80 2024-05-10T03:42:01.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.841+0000 7f6acf7fe700 1 --2- 172.21.15.45:0/3319000627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573ac31dd80 0x5573ac327410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4005d10 tx=0x7f6ac4011470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8672841476b300e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:01.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.841+0000 7f6aaf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-05-10T03:42:01.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.841+0000 7f6aaf7fe700 1 -- 172.21.15.45:0/3319000627 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac4004050 con 0x5573ac31dd80 2024-05-10T03:42:01.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.841+0000 7f6aaf7fe700 1 -- 172.21.15.45:0/3319000627 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f6ac40041b0 con 0x5573ac31dd80 2024-05-10T03:42:01.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.842+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/3319000627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5573ac18d270 con 0x5573ac31dd80 2024-05-10T03:42:01.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.842+0000 7f6aaf7fe700 1 -- 172.21.15.45:0/3319000627 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ac4004370 con 0x5573ac31dd80 2024-05-10T03:42:01.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.842+0000 7f6ae6d42b80 10 client.26077 fetch_fsmap learned FSMap version 28 2024-05-10T03:42:01.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.842+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/3319000627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5573ac061b60 con 0x5573ac31dd80 2024-05-10T03:42:01.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.842+0000 7f6aaf7fe700 1 -- 172.21.15.45:0/3319000627 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x5573ac18d270 con 0x5573ac31dd80 2024-05-10T03:42:01.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.842+0000 7f6aaf7fe700 1 -- 172.21.15.45:0/3319000627 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6ac4021040 con 0x5573ac31dd80 2024-05-10T03:42:01.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.843+0000 7f6ae6d42b80 10 client.26077 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:42:01.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.843+0000 7f6ae6d42b80 10 client.26077 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:42:01.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.843+0000 7f6ae6d42b80 20 client.26077 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:01.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.843+0000 7f6ae6d42b80 1 --2- 172.21.15.45:0/3319000627 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5573ac332ae0 0x5573ac334f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.843+0000 7f6ae6d42b80 4 client.26077 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:42:01.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.843+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/3319000627 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5573ac2e3780 con 0x5573ac332ae0 2024-05-10T03:42:01.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.843+0000 7f6acffff700 1 --2- 172.21.15.45:0/3319000627 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5573ac332ae0 0x5573ac334f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.844+0000 7f6acffff700 1 --2- 172.21.15.45:0/3319000627 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5573ac332ae0 0x5573ac334f30 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cce457b892e8277d server_cookie=4e24b1b9dd8ee485 in_seq=0 out_seq=0 2024-05-10T03:42:01.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.844+0000 7f6aaf7fe700 10 client.26077 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:01.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.845+0000 7f6aaf7fe700 1 -- 172.21.15.45:0/3319000627 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5573ac2e3780 con 0x5573ac332ae0 2024-05-10T03:42:01.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.845+0000 7f6aaf7fe700 10 client.26077 handle_command_reply: tid=0 2024-05-10T03:42:01.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.845+0000 7f6ae6d42b80 1 client.26077 shutdown 2024-05-10T03:42:01.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.845+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/3319000627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573ac31dd80 msgr2=0x5573ac327410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.845+0000 7f6ae6d42b80 1 --2- 172.21.15.45:0/3319000627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573ac31dd80 0x5573ac327410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4005d10 tx=0x7f6ac4011470 comp rx=0 tx=0).stop 2024-05-10T03:42:01.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.845+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/3319000627 shutdown_connections 2024-05-10T03:42:01.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.845+0000 7f6ae6d42b80 1 --2- 172.21.15.45:0/3319000627 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5573ac332ae0 0x5573ac334f30 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.845+0000 7f6ae6d42b80 1 --2- 172.21.15.45:0/3319000627 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573ac31e6d0 0x5573ac32e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.845+0000 7f6ae6d42b80 1 --2- 172.21.15.45:0/3319000627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573ac31ceb0 0x5573ac326ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.845+0000 7f6ae6d42b80 1 --2- 172.21.15.45:0/3319000627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573ac31dd80 0x5573ac327410 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.845+0000 7f6aaf7fe700 0 client.26077 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:01.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.845+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/3319000627 >> 172.21.15.45:0/3319000627 conn(0x5573ac276a60 msgr2=0x5573ac30efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:01.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.845+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/3319000627 shutdown_connections 2024-05-10T03:42:01.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.845+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/3319000627 wait complete. 2024-05-10T03:42:01.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.845+0000 7f6ae6d42b80 20 client.26077 trim_cache size 0 max 16384 2024-05-10T03:42:01.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.860+0000 7f6ae6d42b80 1 Processor -- start 2024-05-10T03:42:01.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.860+0000 7f6ae6d42b80 1 -- start start 2024-05-10T03:42:01.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.860+0000 7f6ae6d42b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573ac31ceb0 0x5573ac31e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.860+0000 7f6ae6d42b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573ac31dd80 0x5573ac32c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.860+0000 7f6ae6d42b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573ac31e6d0 0x5573ac32c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.860+0000 7f6ae6d42b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573ac3097e0 con 0x5573ac31ceb0 2024-05-10T03:42:01.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.860+0000 7f6ae6d42b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573ac327d90 con 0x5573ac31e6d0 2024-05-10T03:42:01.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.860+0000 7f6ae6d42b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573ac31daa0 con 0x5573ac31dd80 2024-05-10T03:42:01.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.861+0000 7f6ad4f9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573ac31e6d0 0x5573ac32c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.861+0000 7f6ad4f9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573ac31e6d0 0x5573ac32c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.45:57582/0 (socket says 172.21.15.45:57582) 2024-05-10T03:42:01.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.861+0000 7f6ad4f9b700 1 -- 172.21.15.45:0/1757057711 learned_addr learned my addr 172.21.15.45:0/1757057711 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:01.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.861+0000 7f6acf7fe700 1 --2- 172.21.15.45:0/1757057711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573ac31dd80 0x5573ac32c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.861+0000 7f6acffff700 1 --2- 172.21.15.45:0/1757057711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573ac31ceb0 0x5573ac31e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.861+0000 7f6acf7fe700 1 -- 172.21.15.45:0/1757057711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573ac31e6d0 msgr2=0x5573ac32c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.861+0000 7f6acf7fe700 1 --2- 172.21.15.45:0/1757057711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573ac31e6d0 0x5573ac32c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.861+0000 7f6acf7fe700 1 -- 172.21.15.45:0/1757057711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573ac31ceb0 msgr2=0x5573ac31e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.861+0000 7f6acf7fe700 1 --2- 172.21.15.45:0/1757057711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573ac31ceb0 0x5573ac31e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.861+0000 7f6acf7fe700 1 -- 172.21.15.45:0/1757057711 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5573ac1fa560 con 0x5573ac31dd80 2024-05-10T03:42:01.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.861+0000 7f6acf7fe700 1 --2- 172.21.15.45:0/1757057711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573ac31dd80 0x5573ac32c320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4005f50 tx=0x7f6ac4001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63f3e2cdb19066ac server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:01.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.862+0000 7f6ab6ffd700 1 -- 172.21.15.45:0/1757057711 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac40053a0 con 0x5573ac31dd80 2024-05-10T03:42:01.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.862+0000 7f6ab6ffd700 1 -- 172.21.15.45:0/1757057711 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6ac40055e0 con 0x5573ac31dd80 2024-05-10T03:42:01.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.862+0000 7f6ab6ffd700 1 -- 172.21.15.45:0/1757057711 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac4023d40 con 0x5573ac31dd80 2024-05-10T03:42:01.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.863+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/1757057711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573ac31dd80 msgr2=0x5573ac32c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.863+0000 7f6ae6d42b80 1 --2- 172.21.15.45:0/1757057711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573ac31dd80 0x5573ac32c320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4005f50 tx=0x7f6ac4001e70 comp rx=0 tx=0).stop 2024-05-10T03:42:01.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.863+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/1757057711 shutdown_connections 2024-05-10T03:42:01.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.863+0000 7f6ae6d42b80 1 --2- 172.21.15.45:0/1757057711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573ac31e6d0 0x5573ac32c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.863+0000 7f6ae6d42b80 1 --2- 172.21.15.45:0/1757057711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573ac31ceb0 0x5573ac31e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.863+0000 7f6ae6d42b80 1 --2- 172.21.15.45:0/1757057711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573ac31dd80 0x5573ac32c320 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.863+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/1757057711 >> 172.21.15.45:0/1757057711 conn(0x5573ac276a60 msgr2=0x5573ac320fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:01.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.863+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/1757057711 shutdown_connections 2024-05-10T03:42:01.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.863+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/1757057711 wait complete. 2024-05-10T03:42:01.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.863+0000 7f6ae6d42b80 1 -- start start 2024-05-10T03:42:01.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.864+0000 7f6ae6d42b80 1 Processor -- start 2024-05-10T03:42:01.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.864+0000 7f6ae6d42b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573ac31ceb0 0x5573ac32b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.864+0000 7f6ae6d42b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573ac31dd80 0x5573ac32b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.864+0000 7f6ae6d42b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573ac31e6d0 0x5573ac32bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.864+0000 7f6ae6d42b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573ac387050 con 0x5573ac31e6d0 2024-05-10T03:42:01.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.864+0000 7f6ae6d42b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573ac3871c0 con 0x5573ac31ceb0 2024-05-10T03:42:01.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.864+0000 7f6ae6d42b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573ac311320 con 0x5573ac31dd80 2024-05-10T03:42:01.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.864+0000 7f6ae6d42b80 10 client.0 _ll_register_callbacks cb 0x5573ac1d9b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:01.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.864+0000 7f6ad4f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573ac31e6d0 0x5573ac32bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.864+0000 7f6ad4f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573ac31e6d0 0x5573ac32bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43960/0 (socket says 172.21.15.45:43960) 2024-05-10T03:42:01.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.864+0000 7f6ad4f9b700 1 -- 172.21.15.45:0/648090481 learned_addr learned my addr 172.21.15.45:0/648090481 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:01.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.865+0000 7f6acf7fe700 1 --2- 172.21.15.45:0/648090481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573ac31dd80 0x5573ac32b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.865+0000 7f6ad4f9b700 1 -- 172.21.15.45:0/648090481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573ac31dd80 msgr2=0x5573ac32b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:01.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.865+0000 7f6ad4f9b700 1 --2- 172.21.15.45:0/648090481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573ac31dd80 0x5573ac32b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.865+0000 7f6ad4f9b700 1 -- 172.21.15.45:0/648090481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573ac31ceb0 msgr2=0x5573ac32b2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T03:42:01.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.865+0000 7f6ad4f9b700 1 --2- 172.21.15.45:0/648090481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573ac31ceb0 0x5573ac32b2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.865+0000 7f6ad4f9b700 1 -- 172.21.15.45:0/648090481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5573ac061b60 con 0x5573ac31e6d0 2024-05-10T03:42:01.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.865+0000 7f6ad4f9b700 1 --2- 172.21.15.45:0/648090481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573ac31e6d0 0x5573ac32bd60 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800ef90 tx=0x7f6ac80995b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1643d6d7276422 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:01.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.865+0000 7f6aaf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:42:01.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.865+0000 7f6aaf7fe700 1 -- 172.21.15.45:0/648090481 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac80a1260 con 0x5573ac31e6d0 2024-05-10T03:42:01.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.866+0000 7f6aaf7fe700 1 -- 172.21.15.45:0/648090481 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f6ac8099770 con 0x5573ac31e6d0 2024-05-10T03:42:01.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.866+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/648090481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6ac4004d10 con 0x5573ac31e6d0 2024-05-10T03:42:01.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.866+0000 7f6aaf7fe700 1 -- 172.21.15.45:0/648090481 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ac8099070 con 0x5573ac31e6d0 2024-05-10T03:42:01.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.866+0000 7f6ae6d42b80 10 client.16218 fetch_fsmap learned FSMap version 28 2024-05-10T03:42:01.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.866+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/648090481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5573ac0b9cd0 con 0x5573ac31e6d0 2024-05-10T03:42:01.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.866+0000 7f6aaf7fe700 1 -- 172.21.15.45:0/648090481 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6ac4004d10 con 0x5573ac31e6d0 2024-05-10T03:42:01.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.866+0000 7f6aaf7fe700 1 -- 172.21.15.45:0/648090481 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6ac80c9bc0 con 0x5573ac31e6d0 2024-05-10T03:42:01.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.867+0000 7f6ae6d42b80 10 client.16218 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:42:01.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.867+0000 7f6ae6d42b80 10 client.16218 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:42:01.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.867+0000 7f6ae6d42b80 20 client.16218 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:01.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.867+0000 7f6ae6d42b80 1 --2- 172.21.15.45:0/648090481 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5573ac312d70 0x5573ac315190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:01.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.867+0000 7f6ae6d42b80 4 client.16218 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-10T03:42:01.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.867+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/648090481 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5573ac22cec0 con 0x5573ac312d70 2024-05-10T03:42:01.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.867+0000 7f6acffff700 1 --2- 172.21.15.45:0/648090481 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5573ac312d70 0x5573ac315190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:01.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.867+0000 7f6aaf7fe700 10 client.16218 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:01.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.868+0000 7f6acffff700 1 --2- 172.21.15.45:0/648090481 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5573ac312d70 0x5573ac315190 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a69d7238bb12092 server_cookie=c84d7df18ddc5a42 in_seq=0 out_seq=0 2024-05-10T03:42:01.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.868+0000 7f6aaf7fe700 1 -- 172.21.15.45:0/648090481 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5573ac22cec0 con 0x5573ac312d70 2024-05-10T03:42:01.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.868+0000 7f6aaf7fe700 10 client.16218 handle_command_reply: tid=0 2024-05-10T03:42:01.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.868+0000 7f6ae6d42b80 1 client.16218 shutdown 2024-05-10T03:42:01.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.869+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/648090481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573ac31e6d0 msgr2=0x5573ac32bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.869+0000 7f6ae6d42b80 1 --2- 172.21.15.45:0/648090481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573ac31e6d0 0x5573ac32bd60 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800ef90 tx=0x7f6ac80995b0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.869+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/648090481 shutdown_connections 2024-05-10T03:42:01.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.869+0000 7f6ae6d42b80 1 --2- 172.21.15.45:0/648090481 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5573ac312d70 0x5573ac315190 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.869+0000 7f6ae6d42b80 1 --2- 172.21.15.45:0/648090481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573ac31e6d0 0x5573ac32bd60 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.869+0000 7f6ae6d42b80 1 --2- 172.21.15.45:0/648090481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573ac31ceb0 0x5573ac32b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.869+0000 7f6ae6d42b80 1 --2- 172.21.15.45:0/648090481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573ac31dd80 0x5573ac32b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.869+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/648090481 >> 172.21.15.45:0/648090481 conn(0x5573ac276a60 msgr2=0x5573ac321ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:01.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.869+0000 7f6aaf7fe700 0 client.16218 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:01.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.869+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/648090481 shutdown_connections 2024-05-10T03:42:01.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.869+0000 7f6ae6d42b80 1 -- 172.21.15.45:0/648090481 wait complete. 2024-05-10T03:42:01.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.869+0000 7f6ae6d42b80 20 client.16218 trim_cache size 0 max 16384 2024-05-10T03:42:01.875 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-05-10T03:42:01.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.874+0000 7f6ad69fe700 1 -- 172.21.15.45:0/2381399061 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6ab80a1240 msgr2=0x7f6ab80a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.874+0000 7f6ad69fe700 1 --2- 172.21.15.45:0/2381399061 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6ab80a1240 0x7f6ab80a3750 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x5573ac31cb90 tx=0x7f6ac000bf60 comp rx=0 tx=0).stop 2024-05-10T03:42:01.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.874+0000 7f6ad69fe700 1 -- 172.21.15.45:0/2381399061 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ad0102590 msgr2=0x7f6ad01a16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:01.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.874+0000 7f6ad69fe700 1 --2- 172.21.15.45:0/2381399061 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ad0102590 0x7f6ad01a16e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800efc0 tx=0x7f6ac800c3a0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.874+0000 7f6ad69fe700 1 -- 172.21.15.45:0/2381399061 shutdown_connections 2024-05-10T03:42:01.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.874+0000 7f6ad69fe700 1 --2- 172.21.15.45:0/2381399061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ad0101090 0x7f6ad019a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.874+0000 7f6ad69fe700 1 --2- 172.21.15.45:0/2381399061 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f6ab80a1240 0x7f6ab80a3750 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.874+0000 7f6ad69fe700 1 --2- 172.21.15.45:0/2381399061 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ad0102590 0x7f6ad01a16e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.874+0000 7f6ad69fe700 1 --2- 172.21.15.45:0/2381399061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ad0101a70 0x7f6ad019a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:01.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.874+0000 7f6ad69fe700 1 -- 172.21.15.45:0/2381399061 >> 172.21.15.45:0/2381399061 conn(0x7f6ad00fb8b0 msgr2=0x7f6ad0105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:01.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.874+0000 7f6ad69fe700 1 -- 172.21.15.45:0/2381399061 shutdown_connections 2024-05-10T03:42:01.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:01.874+0000 7f6ad69fe700 1 -- 172.21.15.45:0/2381399061 wait complete. 2024-05-10T03:42:02.895 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-10T03:42:02.896 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-10T03:42:03.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.063+0000 7f780db38700 1 -- 172.21.15.45:0/3253715831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7808101be0 msgr2=0x7f7808101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:03.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.063+0000 7f780db38700 1 --2- 172.21.15.45:0/3253715831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7808101be0 0x7f7808101ff0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009990 tx=0x7f77fc009ca0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.063+0000 7f780db38700 1 -- 172.21.15.45:0/3253715831 shutdown_connections 2024-05-10T03:42:03.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.063+0000 7f780db38700 1 --2- 172.21.15.45:0/3253715831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7808102580 0x7f7808108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.063+0000 7f780db38700 1 --2- 172.21.15.45:0/3253715831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7808100ac0 0x7f7808100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.063+0000 7f780db38700 1 --2- 172.21.15.45:0/3253715831 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7808101be0 0x7f7808101ff0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.063+0000 7f780db38700 1 -- 172.21.15.45:0/3253715831 >> 172.21.15.45:0/3253715831 conn(0x7f78080fc0d0 msgr2=0x7f78080fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:03.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.063+0000 7f780db38700 1 -- 172.21.15.45:0/3253715831 shutdown_connections 2024-05-10T03:42:03.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.063+0000 7f780db38700 1 -- 172.21.15.45:0/3253715831 wait complete. 2024-05-10T03:42:03.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.064+0000 7f780db38700 1 Processor -- start 2024-05-10T03:42:03.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.064+0000 7f780db38700 1 -- start start 2024-05-10T03:42:03.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.065+0000 7f780db38700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7808100ac0 0x7f780819a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.065+0000 7f780db38700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7808101be0 0x7f780819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.065+0000 7f780db38700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7808102580 0x7f78081a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.065+0000 7f780db38700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78081a1c40 con 0x7f7808102580 2024-05-10T03:42:03.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.065+0000 7f780db38700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78081a1db0 con 0x7f7808100ac0 2024-05-10T03:42:03.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.065+0000 7f780db38700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78081a1f70 con 0x7f7808101be0 2024-05-10T03:42:03.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.065+0000 7f78077fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7808100ac0 0x7f780819a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.065+0000 7f78077fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7808100ac0 0x7f780819a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.45:57608/0 (socket says 172.21.15.45:57608) 2024-05-10T03:42:03.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.065+0000 7f78077fe700 1 -- 172.21.15.45:0/3750733554 learned_addr learned my addr 172.21.15.45:0/3750733554 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:03.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.065+0000 7f7807fff700 1 --2- 172.21.15.45:0/3750733554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7808102580 0x7f78081a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.065+0000 7f7806ffd700 1 --2- 172.21.15.45:0/3750733554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7808101be0 0x7f780819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.065+0000 7f78077fe700 1 -- 172.21.15.45:0/3750733554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7808101be0 msgr2=0x7f780819a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:03.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.065+0000 7f78077fe700 1 --2- 172.21.15.45:0/3750733554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7808101be0 0x7f780819a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.065+0000 7f78077fe700 1 -- 172.21.15.45:0/3750733554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7808102580 msgr2=0x7f78081a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:03.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.065+0000 7f78077fe700 1 --2- 172.21.15.45:0/3750733554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7808102580 0x7f78081a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.065+0000 7f78077fe700 1 -- 172.21.15.45:0/3750733554 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc0095f0 con 0x7f7808100ac0 2024-05-10T03:42:03.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.066+0000 7f78077fe700 1 --2- 172.21.15.45:0/3750733554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7808100ac0 0x7f780819a160 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f77f80097b0 tx=0x7f77f8009ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:03.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.066+0000 7f7804ff9700 1 -- 172.21.15.45:0/3750733554 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f8018070 con 0x7f7808100ac0 2024-05-10T03:42:03.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.066+0000 7f7804ff9700 1 -- 172.21.15.45:0/3750733554 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f77f8004500 con 0x7f7808100ac0 2024-05-10T03:42:03.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.066+0000 7f7804ff9700 1 -- 172.21.15.45:0/3750733554 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f8010040 con 0x7f7808100ac0 2024-05-10T03:42:03.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.066+0000 7f780db38700 1 -- 172.21.15.45:0/3750733554 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78081a2250 con 0x7f7808100ac0 2024-05-10T03:42:03.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.066+0000 7f780db38700 1 -- 172.21.15.45:0/3750733554 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78081a2710 con 0x7f7808100ac0 2024-05-10T03:42:03.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.070+0000 7f7804ff9700 1 -- 172.21.15.45:0/3750733554 <== mon.2 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f77f8003910 con 0x7f7808100ac0 2024-05-10T03:42:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.071+0000 7f7804ff9700 1 --2- 172.21.15.45:0/3750733554 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f77f00a1240 0x7f77f00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.071+0000 7f7804ff9700 1 -- 172.21.15.45:0/3750733554 <== mon.2 v2:172.21.15.106:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f77f80cbe20 con 0x7f7808100ac0 2024-05-10T03:42:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.071+0000 7f781de7cb80 1 Processor -- start 2024-05-10T03:42:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.071+0000 7f781de7cb80 1 -- start start 2024-05-10T03:42:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.072+0000 7f7806ffd700 1 --2- 172.21.15.45:0/3750733554 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f77f00a1240 0x7f77f00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.072+0000 7f781de7cb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56489e11a720 0x56489e11ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.072+0000 7f781de7cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56489e11b5f0 0x56489e11ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.072+0000 7f781de7cb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56489e11bf40 0x56489e122840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.072+0000 7f781de7cb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56489e0411d0 con 0x56489e11a720 2024-05-10T03:42:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.072+0000 7f781de7cb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x56489e03eb90 con 0x56489e11bf40 2024-05-10T03:42:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.072+0000 7f781de7cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x56489e03a480 con 0x56489e11b5f0 2024-05-10T03:42:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.072+0000 7f7806ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56489e11b5f0 0x56489e11ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.072+0000 7f7806ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56489e11b5f0 0x56489e11ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:56036/0 (socket says 172.21.15.45:56036) 2024-05-10T03:42:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.072+0000 7f7806ffd700 1 -- 172.21.15.45:0/1127865266 learned_addr learned my addr 172.21.15.45:0/1127865266 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.072+0000 7f78077fe700 1 --2- 172.21.15.45:0/1127865266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56489e11a720 0x56489e11ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.072+0000 7f7806ffd700 1 -- 172.21.15.45:0/1127865266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56489e11bf40 msgr2=0x56489e122840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T03:42:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.072+0000 7f7806ffd700 1 --2- 172.21.15.45:0/1127865266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56489e11bf40 0x56489e122840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.073+0000 7f7806ffd700 1 -- 172.21.15.45:0/1127865266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56489e11a720 msgr2=0x56489e11ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.073+0000 7f7806ffd700 1 --2- 172.21.15.45:0/1127865266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56489e11a720 0x56489e11ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.073+0000 7f7806ffd700 1 -- 172.21.15.45:0/1127865266 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56489debb430 con 0x56489e11b5f0 2024-05-10T03:42:03.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.073+0000 7f7806ffd700 1 --2- 172.21.15.45:0/1127865266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56489e11b5f0 0x56489e11ba00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009990 tx=0x7f77fc02bba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33562b65ef1e7571 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:03.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.073+0000 7f77edffb700 1 -- 172.21.15.45:0/1127865266 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc030070 con 0x56489e11b5f0 2024-05-10T03:42:03.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.073+0000 7f77edffb700 1 -- 172.21.15.45:0/1127865266 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f77fc01e070 con 0x56489e11b5f0 2024-05-10T03:42:03.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.073+0000 7f77edffb700 1 -- 172.21.15.45:0/1127865266 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc00f6c0 con 0x56489e11b5f0 2024-05-10T03:42:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.074+0000 7f781de7cb80 1 -- 172.21.15.45:0/1127865266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56489e11b5f0 msgr2=0x56489e11ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.074+0000 7f781de7cb80 1 --2- 172.21.15.45:0/1127865266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56489e11b5f0 0x56489e11ba00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009990 tx=0x7f77fc02bba0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.074+0000 7f781de7cb80 1 -- 172.21.15.45:0/1127865266 shutdown_connections 2024-05-10T03:42:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.074+0000 7f781de7cb80 1 --2- 172.21.15.45:0/1127865266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56489e11bf40 0x56489e122840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.074+0000 7f781de7cb80 1 --2- 172.21.15.45:0/1127865266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56489e11a720 0x56489e11ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.074+0000 7f781de7cb80 1 --2- 172.21.15.45:0/1127865266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56489e11b5f0 0x56489e11ba00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.074+0000 7f781de7cb80 1 -- 172.21.15.45:0/1127865266 >> 172.21.15.45:0/1127865266 conn(0x56489e07cae0 msgr2=0x56489e115060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.074+0000 7f781de7cb80 1 -- 172.21.15.45:0/1127865266 shutdown_connections 2024-05-10T03:42:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.074+0000 7f781de7cb80 1 -- 172.21.15.45:0/1127865266 wait complete. 2024-05-10T03:42:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.075+0000 7f781de7cb80 1 -- start start 2024-05-10T03:42:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.075+0000 7f781de7cb80 1 Processor -- start 2024-05-10T03:42:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.075+0000 7f781de7cb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56489e11a720 0x56489e1246f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.076+0000 7f781de7cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56489e11b5f0 0x56489e124c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.076+0000 7f781de7cb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56489e11bf40 0x56489e12bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.076+0000 7f781de7cb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56489dfd65e0 con 0x56489e11bf40 2024-05-10T03:42:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.076+0000 7f781de7cb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x56489dfd6280 con 0x56489e11a720 2024-05-10T03:42:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.076+0000 7f781de7cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x56489debd720 con 0x56489e11b5f0 2024-05-10T03:42:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.076+0000 7f781de7cb80 10 client.0 _ll_register_callbacks cb 0x56489dfdfbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.076+0000 7f7806ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56489e11b5f0 0x56489e124c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.076+0000 7f7806ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56489e11b5f0 0x56489e124c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:56040/0 (socket says 172.21.15.45:56040) 2024-05-10T03:42:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.076+0000 7f7806ffd700 1 -- 172.21.15.45:0/423711869 learned_addr learned my addr 172.21.15.45:0/423711869 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.076+0000 7f7807fff700 1 --2- 172.21.15.45:0/423711869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56489e11bf40 0x56489e12bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.076+0000 7f7807fff700 1 -- 172.21.15.45:0/423711869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56489e11b5f0 msgr2=0x56489e124c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:03.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.076+0000 7f7807fff700 1 --2- 172.21.15.45:0/423711869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56489e11b5f0 0x56489e124c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.076+0000 7f7807fff700 1 -- 172.21.15.45:0/423711869 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56489e11a720 msgr2=0x56489e1246f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T03:42:03.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.076+0000 7f7807fff700 1 --2- 172.21.15.45:0/423711869 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56489e11a720 0x56489e1246f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.076+0000 7f7807fff700 1 -- 172.21.15.45:0/423711869 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78081098c0 con 0x56489e11bf40 2024-05-10T03:42:03.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.077+0000 7f7807fff700 1 --2- 172.21.15.45:0/423711869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56489e11bf40 0x56489e12bb90 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f7800011cb0 tx=0x7f780000f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a55561327b7ed56 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:03.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.077+0000 7f77e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:42:03.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.077+0000 7f77e6ffd700 1 -- 172.21.15.45:0/423711869 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780000e040 con 0x56489e11bf40 2024-05-10T03:42:03.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.077+0000 7f77e6ffd700 1 -- 172.21.15.45:0/423711869 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7800004bb0 con 0x56489e11bf40 2024-05-10T03:42:03.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.077+0000 7f781de7cb80 1 -- 172.21.15.45:0/423711869 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56489df932f0 con 0x56489e11bf40 2024-05-10T03:42:03.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.077+0000 7f77e6ffd700 1 -- 172.21.15.45:0/423711869 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7800004d70 con 0x56489e11bf40 2024-05-10T03:42:03.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.077+0000 7f781de7cb80 10 client.16230 fetch_fsmap learned FSMap version 28 2024-05-10T03:42:03.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.077+0000 7f781de7cb80 1 -- 172.21.15.45:0/423711869 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x56489de67be0 con 0x56489e11bf40 2024-05-10T03:42:03.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.077+0000 7f7806ffd700 1 --2- 172.21.15.45:0/3750733554 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f77f00a1240 0x7f77f00a3750 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f77fc006010 tx=0x7f77fc005610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:03.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.078+0000 7f77e6ffd700 1 -- 172.21.15.45:0/423711869 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x56489df932f0 con 0x56489e11bf40 2024-05-10T03:42:03.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.078+0000 7f77e6ffd700 1 -- 172.21.15.45:0/423711869 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f780001b020 con 0x56489e11bf40 2024-05-10T03:42:03.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.078+0000 7f781de7cb80 10 client.16230 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:42:03.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.078+0000 7f781de7cb80 10 client.16230 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:42:03.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.078+0000 7f781de7cb80 20 client.16230 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:03.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.078+0000 7f781de7cb80 1 --2- 172.21.15.45:0/423711869 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x56489e141450 0x56489e1438a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.078+0000 7f781de7cb80 4 client.16230 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:42:03.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.078+0000 7f781de7cb80 1 -- 172.21.15.45:0/423711869 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56489e0e9800 con 0x56489e141450 2024-05-10T03:42:03.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.079+0000 7f78077fe700 1 --2- 172.21.15.45:0/423711869 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x56489e141450 0x56489e1438a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.079+0000 7f77e6ffd700 10 client.16230 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:03.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.079+0000 7f78077fe700 1 --2- 172.21.15.45:0/423711869 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x56489e141450 0x56489e1438a0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7e714fe688d16e5 server_cookie=ece06faad2088d8b in_seq=0 out_seq=0 2024-05-10T03:42:03.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.080+0000 7f77e6ffd700 1 -- 172.21.15.45:0/423711869 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56489e0e9800 con 0x56489e141450 2024-05-10T03:42:03.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.080+0000 7f77e6ffd700 10 client.16230 handle_command_reply: tid=0 2024-05-10T03:42:03.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.080+0000 7f781de7cb80 1 client.16230 shutdown 2024-05-10T03:42:03.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.081+0000 7f781de7cb80 1 -- 172.21.15.45:0/423711869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56489e11bf40 msgr2=0x56489e12bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:03.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.081+0000 7f781de7cb80 1 --2- 172.21.15.45:0/423711869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56489e11bf40 0x56489e12bb90 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f7800011cb0 tx=0x7f780000f490 comp rx=0 tx=0).stop 2024-05-10T03:42:03.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.081+0000 7f781de7cb80 1 -- 172.21.15.45:0/423711869 shutdown_connections 2024-05-10T03:42:03.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.081+0000 7f781de7cb80 1 --2- 172.21.15.45:0/423711869 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x56489e141450 0x56489e1438a0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.081+0000 7f781de7cb80 1 --2- 172.21.15.45:0/423711869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56489e11bf40 0x56489e12bb90 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.081+0000 7f781de7cb80 1 --2- 172.21.15.45:0/423711869 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56489e11a720 0x56489e1246f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.081+0000 7f781de7cb80 1 --2- 172.21.15.45:0/423711869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56489e11b5f0 0x56489e124c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.081+0000 7f781de7cb80 1 -- 172.21.15.45:0/423711869 >> 172.21.15.45:0/423711869 conn(0x56489e07cae0 msgr2=0x56489e115030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.081+0000 7f77e6ffd700 0 client.16230 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.083+0000 7f781de7cb80 1 -- 172.21.15.45:0/423711869 shutdown_connections 2024-05-10T03:42:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.083+0000 7f781de7cb80 1 -- 172.21.15.45:0/423711869 wait complete. 2024-05-10T03:42:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.083+0000 7f781de7cb80 20 client.16230 trim_cache size 0 max 16384 2024-05-10T03:42:03.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.118+0000 7f781de7cb80 1 Processor -- start 2024-05-10T03:42:03.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.119+0000 7f781de7cb80 1 -- start start 2024-05-10T03:42:03.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.119+0000 7f781de7cb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56489e11a720 0x56489e123c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.119+0000 7f781de7cb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56489e11b5f0 0x56489e12b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.119+0000 7f781de7cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56489e11bf40 0x56489e1241a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.119+0000 7f781de7cb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56489e11b4a0 con 0x56489e11a720 2024-05-10T03:42:03.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.119+0000 7f781de7cb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x56489e13dcd0 con 0x56489e11b5f0 2024-05-10T03:42:03.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.119+0000 7f781de7cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x56489e11eea0 con 0x56489e11bf40 2024-05-10T03:42:03.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.119+0000 7f78077fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56489e11a720 0x56489e123c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.119+0000 7f78077fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56489e11a720 0x56489e123c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44016/0 (socket says 172.21.15.45:44016) 2024-05-10T03:42:03.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.119+0000 7f78077fe700 1 -- 172.21.15.45:0/2385793799 learned_addr learned my addr 172.21.15.45:0/2385793799 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:03.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.119+0000 7f7807fff700 1 --2- 172.21.15.45:0/2385793799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56489e11bf40 0x56489e1241a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.119+0000 7f78077fe700 1 -- 172.21.15.45:0/2385793799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56489e11bf40 msgr2=0x56489e1241a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:03.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.119+0000 7f78077fe700 1 --2- 172.21.15.45:0/2385793799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56489e11bf40 0x56489e1241a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.120+0000 7f78077fe700 1 -- 172.21.15.45:0/2385793799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56489e11b5f0 msgr2=0x56489e12b7c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T03:42:03.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.120+0000 7f78077fe700 1 --2- 172.21.15.45:0/2385793799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56489e11b5f0 0x56489e12b7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.120+0000 7f78077fe700 1 -- 172.21.15.45:0/2385793799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56489e1114d0 con 0x56489e11a720 2024-05-10T03:42:03.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.120+0000 7f78077fe700 1 --2- 172.21.15.45:0/2385793799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56489e11a720 0x56489e123c60 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f77f8095380 tx=0x7f77f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0bff0b1afa919e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:03.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.120+0000 7f77ee7fc700 1 -- 172.21.15.45:0/2385793799 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f809cd00 con 0x56489e11a720 2024-05-10T03:42:03.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.120+0000 7f77ee7fc700 1 -- 172.21.15.45:0/2385793799 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f77f80a1350 con 0x56489e11a720 2024-05-10T03:42:03.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.120+0000 7f77ee7fc700 1 -- 172.21.15.45:0/2385793799 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f80983c0 con 0x56489e11a720 2024-05-10T03:42:03.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.121+0000 7f781de7cb80 1 -- 172.21.15.45:0/2385793799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56489e11a720 msgr2=0x56489e123c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:03.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.121+0000 7f781de7cb80 1 --2- 172.21.15.45:0/2385793799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56489e11a720 0x56489e123c60 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f77f8095380 tx=0x7f77f8004750 comp rx=0 tx=0).stop 2024-05-10T03:42:03.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.121+0000 7f781de7cb80 1 -- 172.21.15.45:0/2385793799 shutdown_connections 2024-05-10T03:42:03.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.121+0000 7f781de7cb80 1 --2- 172.21.15.45:0/2385793799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56489e11bf40 0x56489e1241a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.121+0000 7f781de7cb80 1 --2- 172.21.15.45:0/2385793799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56489e11a720 0x56489e123c60 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.121+0000 7f781de7cb80 1 --2- 172.21.15.45:0/2385793799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56489e11b5f0 0x56489e12b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.121+0000 7f781de7cb80 1 -- 172.21.15.45:0/2385793799 >> 172.21.15.45:0/2385793799 conn(0x56489e07cae0 msgr2=0x56489e11f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.122+0000 7f781de7cb80 1 -- 172.21.15.45:0/2385793799 shutdown_connections 2024-05-10T03:42:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.122+0000 7f781de7cb80 1 -- 172.21.15.45:0/2385793799 wait complete. 2024-05-10T03:42:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.122+0000 7f781de7cb80 1 -- start start 2024-05-10T03:42:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.122+0000 7f781de7cb80 1 Processor -- start 2024-05-10T03:42:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.123+0000 7f781de7cb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56489e11a720 0x56489e12b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.123+0000 7f781de7cb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56489e11b5f0 0x56489e128370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.123+0000 7f781de7cb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56489e11bf40 0x56489e1288b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.123+0000 7f781de7cb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56489e128df0 con 0x56489e11b5f0 2024-05-10T03:42:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.123+0000 7f781de7cb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x56489e128f60 con 0x56489e11bf40 2024-05-10T03:42:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.123+0000 7f781de7cb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x56489e1a88d0 con 0x56489e11a720 2024-05-10T03:42:03.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.123+0000 7f781de7cb80 10 client.0 _ll_register_callbacks cb 0x56489dfdfbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:03.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.123+0000 7f78077fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56489e11a720 0x56489e12b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.123+0000 7f78077fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56489e11a720 0x56489e12b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:56060/0 (socket says 172.21.15.45:56060) 2024-05-10T03:42:03.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.123+0000 7f78077fe700 1 -- 172.21.15.45:0/3152236538 learned_addr learned my addr 172.21.15.45:0/3152236538 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:03.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.123+0000 7f7806ffd700 1 --2- 172.21.15.45:0/3152236538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56489e11b5f0 0x56489e128370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.123+0000 7f7807fff700 1 --2- 172.21.15.45:0/3152236538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56489e11bf40 0x56489e1288b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.124+0000 7f78077fe700 1 -- 172.21.15.45:0/3152236538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56489e11bf40 msgr2=0x56489e1288b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:03.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.124+0000 7f78077fe700 1 --2- 172.21.15.45:0/3152236538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56489e11bf40 0x56489e1288b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.124+0000 7f78077fe700 1 -- 172.21.15.45:0/3152236538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56489e11b5f0 msgr2=0x56489e128370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:03.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.124+0000 7f78077fe700 1 --2- 172.21.15.45:0/3152236538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56489e11b5f0 0x56489e128370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.124+0000 7f78077fe700 1 -- 172.21.15.45:0/3152236538 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78081a2710 con 0x56489e11a720 2024-05-10T03:42:03.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.124+0000 7f7807fff700 1 --2- 172.21.15.45:0/3152236538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56489e11bf40 0x56489e1288b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:42:03.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.124+0000 7f78077fe700 1 --2- 172.21.15.45:0/3152236538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56489e11a720 0x56489e12b7f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f77f80a0e20 tx=0x7f77f8099050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c284a9ae1d306e50 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:03.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.124+0000 7f77e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-05-10T03:42:03.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.124+0000 7f77e6ffd700 1 -- 172.21.15.45:0/3152236538 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f80985c0 con 0x56489e11a720 2024-05-10T03:42:03.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.124+0000 7f77e6ffd700 1 -- 172.21.15.45:0/3152236538 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f77f80b7260 con 0x56489e11a720 2024-05-10T03:42:03.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.124+0000 7f781de7cb80 1 -- 172.21.15.45:0/3152236538 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f77fc01e070 con 0x56489e11a720 2024-05-10T03:42:03.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.125+0000 7f77e6ffd700 1 -- 172.21.15.45:0/3152236538 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77f8003700 con 0x56489e11a720 2024-05-10T03:42:03.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.125+0000 7f781de7cb80 10 client.26101 fetch_fsmap learned FSMap version 28 2024-05-10T03:42:03.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.125+0000 7f781de7cb80 1 -- 172.21.15.45:0/3152236538 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x56489e0005e0 con 0x56489e11a720 2024-05-10T03:42:03.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.125+0000 7f77e6ffd700 1 -- 172.21.15.45:0/3152236538 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f77fc01e070 con 0x56489e11a720 2024-05-10T03:42:03.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.125+0000 7f77e6ffd700 1 -- 172.21.15.45:0/3152236538 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f77f8094cc0 con 0x56489e11a720 2024-05-10T03:42:03.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.125+0000 7f781de7cb80 10 client.26101 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:42:03.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.125+0000 7f781de7cb80 10 client.26101 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:42:03.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.125+0000 7f781de7cb80 20 client.26101 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:03.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.125+0000 7f781de7cb80 1 --2- 172.21.15.45:0/3152236538 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x56489e1a9ee0 0x56489e1ac300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.125+0000 7f781de7cb80 4 client.26101 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-10T03:42:03.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.125+0000 7f781de7cb80 1 -- 172.21.15.45:0/3152236538 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56489e032f40 con 0x56489e1a9ee0 2024-05-10T03:42:03.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.125+0000 7f7806ffd700 1 --2- 172.21.15.45:0/3152236538 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x56489e1a9ee0 0x56489e1ac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.126+0000 7f77e6ffd700 10 client.26101 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:03.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.126+0000 7f7806ffd700 1 --2- 172.21.15.45:0/3152236538 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x56489e1a9ee0 0x56489e1ac300 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfef37b904ad2c41 server_cookie=8f70ff1c4937b26b in_seq=0 out_seq=0 2024-05-10T03:42:03.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.127+0000 7f77e6ffd700 1 -- 172.21.15.45:0/3152236538 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56489e032f40 con 0x56489e1a9ee0 2024-05-10T03:42:03.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.127+0000 7f77e6ffd700 10 client.26101 handle_command_reply: tid=0 2024-05-10T03:42:03.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.127+0000 7f781de7cb80 1 client.26101 shutdown 2024-05-10T03:42:03.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.129+0000 7f781de7cb80 1 -- 172.21.15.45:0/3152236538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56489e11a720 msgr2=0x56489e12b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:03.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.129+0000 7f781de7cb80 1 --2- 172.21.15.45:0/3152236538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56489e11a720 0x56489e12b7f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f77f80a0e20 tx=0x7f77f8099050 comp rx=0 tx=0).stop 2024-05-10T03:42:03.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.129+0000 7f781de7cb80 1 -- 172.21.15.45:0/3152236538 shutdown_connections 2024-05-10T03:42:03.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.129+0000 7f781de7cb80 1 --2- 172.21.15.45:0/3152236538 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x56489e1a9ee0 0x56489e1ac300 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.129+0000 7f781de7cb80 1 --2- 172.21.15.45:0/3152236538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56489e11a720 0x56489e12b7f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.129+0000 7f781de7cb80 1 --2- 172.21.15.45:0/3152236538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56489e11bf40 0x56489e1288b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.129+0000 7f781de7cb80 1 --2- 172.21.15.45:0/3152236538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56489e11b5f0 0x56489e128370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.129+0000 7f781de7cb80 1 -- 172.21.15.45:0/3152236538 >> 172.21.15.45:0/3152236538 conn(0x56489e07cae0 msgr2=0x56489e11f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:03.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.129+0000 7f77e6ffd700 0 client.26101 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:03.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.129+0000 7f781de7cb80 1 -- 172.21.15.45:0/3152236538 shutdown_connections 2024-05-10T03:42:03.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.129+0000 7f781de7cb80 1 -- 172.21.15.45:0/3152236538 wait complete. 2024-05-10T03:42:03.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.129+0000 7f781de7cb80 20 client.26101 trim_cache size 0 max 16384 2024-05-10T03:42:03.136 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:42:03.136 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-05-10T03:42:03.137 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "585851b6-a581-406f-95aa-c89636d23cf0", 2024-05-10T03:42:03.137 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-05-10T03:42:03.137 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:42:03.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.130+0000 7f780db38700 1 -- 172.21.15.45:0/3750733554 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f77f00a1240 msgr2=0x7f77f00a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.130+0000 7f780db38700 1 --2- 172.21.15.45:0/3750733554 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f77f00a1240 0x7f77f00a3750 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f77fc006010 tx=0x7f77fc005610 comp rx=0 tx=0).stop 2024-05-10T03:42:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.130+0000 7f780db38700 1 -- 172.21.15.45:0/3750733554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7808100ac0 msgr2=0x7f780819a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.130+0000 7f780db38700 1 --2- 172.21.15.45:0/3750733554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7808100ac0 0x7f780819a160 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f77f80097b0 tx=0x7f77f8009ac0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.130+0000 7f780db38700 1 -- 172.21.15.45:0/3750733554 shutdown_connections 2024-05-10T03:42:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.130+0000 7f780db38700 1 --2- 172.21.15.45:0/3750733554 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f77f00a1240 0x7f77f00a3750 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.130+0000 7f780db38700 1 --2- 172.21.15.45:0/3750733554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7808102580 0x7f78081a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.130+0000 7f780db38700 1 --2- 172.21.15.45:0/3750733554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7808100ac0 0x7f780819a160 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.130+0000 7f780db38700 1 --2- 172.21.15.45:0/3750733554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7808101be0 0x7f780819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.130+0000 7f780db38700 1 -- 172.21.15.45:0/3750733554 >> 172.21.15.45:0/3750733554 conn(0x7f78080fc0d0 msgr2=0x7f7808104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.130+0000 7f780db38700 1 -- 172.21.15.45:0/3750733554 shutdown_connections 2024-05-10T03:42:03.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.130+0000 7f780db38700 1 -- 172.21.15.45:0/3750733554 wait complete. 2024-05-10T03:42:03.153 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-10T03:42:03.185 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:03 smithi045 ceph-mon[42520]: pgmap v338: 129 pgs: 129 active+clean; 674 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:42:03.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.363+0000 7f9e58f12700 1 -- 172.21.15.45:0/1289808856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e541002c0 msgr2=0x7f9e541006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:03.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.363+0000 7f9e58f12700 1 --2- 172.21.15.45:0/1289808856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e541002c0 0x7f9e541006d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400aaa0 tx=0x7f9e4400adb0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.363+0000 7f9e58f12700 1 -- 172.21.15.45:0/1289808856 shutdown_connections 2024-05-10T03:42:03.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.363+0000 7f9e58f12700 1 --2- 172.21.15.45:0/1289808856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e54101d80 0x7f9e54108630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.363+0000 7f9e58f12700 1 --2- 172.21.15.45:0/1289808856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e541002c0 0x7f9e541006d0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.363+0000 7f9e58f12700 1 --2- 172.21.15.45:0/1289808856 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e541013e0 0x7f9e541017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.363+0000 7f9e58f12700 1 -- 172.21.15.45:0/1289808856 >> 172.21.15.45:0/1289808856 conn(0x7f9e540fb8f0 msgr2=0x7f9e540fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:03.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.364+0000 7f9e58f12700 1 -- 172.21.15.45:0/1289808856 shutdown_connections 2024-05-10T03:42:03.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.364+0000 7f9e58f12700 1 -- 172.21.15.45:0/1289808856 wait complete. 2024-05-10T03:42:03.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.364+0000 7f9e58f12700 1 Processor -- start 2024-05-10T03:42:03.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.365+0000 7f9e58f12700 1 -- start start 2024-05-10T03:42:03.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.365+0000 7f9e58f12700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e541002c0 0x7f9e54195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.365+0000 7f9e58f12700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e541013e0 0x7f9e54196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.365+0000 7f9e58f12700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e54101d80 0x7f9e5419d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.365+0000 7f9e58f12700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5419d8d0 con 0x7f9e541002c0 2024-05-10T03:42:03.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.365+0000 7f9e58f12700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5406ac60 con 0x7f9e541013e0 2024-05-10T03:42:03.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.365+0000 7f9e58f12700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5406ae20 con 0x7f9e54101d80 2024-05-10T03:42:03.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.365+0000 7f9e5259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e541002c0 0x7f9e54195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.365+0000 7f9e5259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e541002c0 0x7f9e54195e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44032/0 (socket says 172.21.15.45:44032) 2024-05-10T03:42:03.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.365+0000 7f9e5259c700 1 -- 172.21.15.45:0/4168418772 learned_addr learned my addr 172.21.15.45:0/4168418772 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:03.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.365+0000 7f9e52d9d700 1 --2- 172.21.15.45:0/4168418772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e54101d80 0x7f9e5419d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.366+0000 7f9e5259c700 1 -- 172.21.15.45:0/4168418772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e54101d80 msgr2=0x7f9e5419d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:03.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.366+0000 7f9e5259c700 1 --2- 172.21.15.45:0/4168418772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e54101d80 0x7f9e5419d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.366+0000 7f9e5259c700 1 -- 172.21.15.45:0/4168418772 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e541013e0 msgr2=0x7f9e54196340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:03.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.366+0000 7f9e5259c700 1 --2- 172.21.15.45:0/4168418772 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e541013e0 0x7f9e54196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.366+0000 7f9e5259c700 1 -- 172.21.15.45:0/4168418772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4400a700 con 0x7f9e541002c0 2024-05-10T03:42:03.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.366+0000 7f9e5259c700 1 --2- 172.21.15.45:0/4168418772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e541002c0 0x7f9e54195e00 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400a9f0 tx=0x7f9e44005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:03.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.366+0000 7f9e437fe700 1 -- 172.21.15.45:0/4168418772 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4401e070 con 0x7f9e541002c0 2024-05-10T03:42:03.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.366+0000 7f9e437fe700 1 -- 172.21.15.45:0/4168418772 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9e4400e480 con 0x7f9e541002c0 2024-05-10T03:42:03.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.366+0000 7f9e437fe700 1 -- 172.21.15.45:0/4168418772 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e44022670 con 0x7f9e541002c0 2024-05-10T03:42:03.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.367+0000 7f9e58f12700 1 -- 172.21.15.45:0/4168418772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e5406b0a0 con 0x7f9e541002c0 2024-05-10T03:42:03.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.367+0000 7f9e58f12700 1 -- 172.21.15.45:0/4168418772 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e5406b4d0 con 0x7f9e541002c0 2024-05-10T03:42:03.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.372+0000 7f9e69256b80 1 Processor -- start 2024-05-10T03:42:03.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.373+0000 7f9e69256b80 1 -- start start 2024-05-10T03:42:03.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.373+0000 7f9e69256b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a50e41eb0 0x564a50e42300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.373+0000 7f9e69256b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a50e42d80 0x564a50e43190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.373+0000 7f9e69256b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a50e436d0 0x564a50e49fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.373+0000 7f9e69256b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a50d60150 con 0x564a50e436d0 2024-05-10T03:42:03.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.373+0000 7f9e69256b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a50d5db10 con 0x564a50e42d80 2024-05-10T03:42:03.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.373+0000 7f9e69256b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a50d59400 con 0x564a50e41eb0 2024-05-10T03:42:03.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.373+0000 7f9e51d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a50e436d0 0x564a50e49fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.373+0000 7f9e51d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a50e436d0 0x564a50e49fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44042/0 (socket says 172.21.15.45:44042) 2024-05-10T03:42:03.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.373+0000 7f9e51d9b700 1 -- 172.21.15.45:0/935592247 learned_addr learned my addr 172.21.15.45:0/935592247 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:03.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.373+0000 7f9e437fe700 1 -- 172.21.15.45:0/4168418772 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9e4400e5f0 con 0x7f9e541002c0 2024-05-10T03:42:03.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.373+0000 7f9e52d9d700 1 --2- 172.21.15.45:0/935592247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a50e41eb0 0x564a50e42300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.374+0000 7f9e52d9d700 1 -- 172.21.15.45:0/935592247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a50e42d80 msgr2=0x564a50e43190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T03:42:03.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.374+0000 7f9e52d9d700 1 --2- 172.21.15.45:0/935592247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a50e42d80 0x564a50e43190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.374+0000 7f9e52d9d700 1 -- 172.21.15.45:0/935592247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a50e436d0 msgr2=0x564a50e49fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:03.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.374+0000 7f9e52d9d700 1 --2- 172.21.15.45:0/935592247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a50e436d0 0x564a50e49fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.374+0000 7f9e52d9d700 1 -- 172.21.15.45:0/935592247 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a50bda3b0 con 0x564a50e41eb0 2024-05-10T03:42:03.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.374+0000 7f9e437fe700 1 --2- 172.21.15.45:0/4168418772 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9e3c0a13b0 0x7f9e3c0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.374+0000 7f9e52d9d700 1 --2- 172.21.15.45:0/935592247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a50e41eb0 0x564a50e42300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c00bfd0 tx=0x7f9e4c0094c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d38c25c5ddfe0a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:03.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.374+0000 7f9e437fe700 1 -- 172.21.15.45:0/4168418772 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f9e440cd7e0 con 0x7f9e541002c0 2024-05-10T03:42:03.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.374+0000 7f9e40ff9700 1 -- 172.21.15.45:0/935592247 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c010040 con 0x564a50e41eb0 2024-05-10T03:42:03.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.375+0000 7f9e40ff9700 1 -- 172.21.15.45:0/935592247 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9e4c00b5a0 con 0x564a50e41eb0 2024-05-10T03:42:03.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.375+0000 7f9e40ff9700 1 -- 172.21.15.45:0/935592247 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c015bd0 con 0x564a50e41eb0 2024-05-10T03:42:03.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.375+0000 7f9e69256b80 1 -- 172.21.15.45:0/935592247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a50e41eb0 msgr2=0x564a50e42300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:03.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.375+0000 7f9e69256b80 1 --2- 172.21.15.45:0/935592247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a50e41eb0 0x564a50e42300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c00bfd0 tx=0x7f9e4c0094c0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.376+0000 7f9e5259c700 1 --2- 172.21.15.45:0/4168418772 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9e3c0a13b0 0x7f9e3c0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.377+0000 7f9e69256b80 1 -- 172.21.15.45:0/935592247 shutdown_connections 2024-05-10T03:42:03.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.377+0000 7f9e69256b80 1 --2- 172.21.15.45:0/935592247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a50e41eb0 0x564a50e42300 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.377+0000 7f9e69256b80 1 --2- 172.21.15.45:0/935592247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a50e436d0 0x564a50e49fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.377+0000 7f9e69256b80 1 --2- 172.21.15.45:0/935592247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a50e42d80 0x564a50e43190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.377+0000 7f9e69256b80 1 -- 172.21.15.45:0/935592247 >> 172.21.15.45:0/935592247 conn(0x564a50d9ba60 msgr2=0x564a50e33fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:03.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.377+0000 7f9e69256b80 1 -- 172.21.15.45:0/935592247 shutdown_connections 2024-05-10T03:42:03.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.377+0000 7f9e69256b80 1 -- 172.21.15.45:0/935592247 wait complete. 2024-05-10T03:42:03.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.377+0000 7f9e69256b80 1 -- start start 2024-05-10T03:42:03.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.377+0000 7f9e69256b80 1 Processor -- start 2024-05-10T03:42:03.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.378+0000 7f9e69256b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a50e41eb0 0x564a50e4be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.378+0000 7f9e69256b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a50e42d80 0x564a50e4c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.378+0000 7f9e69256b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a50e436d0 0x564a50e53390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.378+0000 7f9e5259c700 1 --2- 172.21.15.45:0/4168418772 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9e3c0a13b0 0x7f9e3c0a38c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9e4409a850 tx=0x7f9e44005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:03.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.378+0000 7f9e69256b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a50cf5560 con 0x564a50e436d0 2024-05-10T03:42:03.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.378+0000 7f9e69256b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a50cf5200 con 0x564a50e42d80 2024-05-10T03:42:03.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.378+0000 7f9e69256b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a50bdc6a0 con 0x564a50e41eb0 2024-05-10T03:42:03.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.378+0000 7f9e69256b80 10 client.0 _ll_register_callbacks cb 0x564a50cfeb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:03.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.378+0000 7f9e52d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a50e436d0 0x564a50e53390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.378+0000 7f9e52d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a50e436d0 0x564a50e53390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44044/0 (socket says 172.21.15.45:44044) 2024-05-10T03:42:03.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.378+0000 7f9e52d9d700 1 -- 172.21.15.45:0/938798706 learned_addr learned my addr 172.21.15.45:0/938798706 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:03.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.378+0000 7f9e52d9d700 1 --2- 172.21.15.45:0/938798706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a50e41eb0 0x564a50e4be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.378+0000 7f9e51d9b700 1 --2- 172.21.15.45:0/938798706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a50e42d80 0x564a50e4c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.379+0000 7f9e52d9d700 1 -- 172.21.15.45:0/938798706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a50e42d80 msgr2=0x564a50e4c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:03.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.379+0000 7f9e52d9d700 1 --2- 172.21.15.45:0/938798706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a50e42d80 0x564a50e4c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.379+0000 7f9e52d9d700 1 -- 172.21.15.45:0/938798706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a50e436d0 msgr2=0x564a50e53390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:03.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.379+0000 7f9e52d9d700 1 --2- 172.21.15.45:0/938798706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a50e436d0 0x564a50e53390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.379+0000 7f9e52d9d700 1 -- 172.21.15.45:0/938798706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e4c0073e0 con 0x564a50e41eb0 2024-05-10T03:42:03.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.379+0000 7f9e52d9d700 1 --2- 172.21.15.45:0/938798706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a50e41eb0 0x564a50e4be90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c015cf0 tx=0x7f9e4c000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1709958f104dc19e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:03.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.379+0000 7f9e39ffb700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-05-10T03:42:03.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.380+0000 7f9e39ffb700 1 -- 172.21.15.45:0/938798706 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c00add0 con 0x564a50e41eb0 2024-05-10T03:42:03.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.380+0000 7f9e39ffb700 1 -- 172.21.15.45:0/938798706 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f9e4c010030 con 0x564a50e41eb0 2024-05-10T03:42:03.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.380+0000 7f9e69256b80 1 -- 172.21.15.45:0/938798706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a50cb2270 con 0x564a50e41eb0 2024-05-10T03:42:03.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.380+0000 7f9e39ffb700 1 -- 172.21.15.45:0/938798706 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e4c00af30 con 0x564a50e41eb0 2024-05-10T03:42:03.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.380+0000 7f9e69256b80 10 client.26113 fetch_fsmap learned FSMap version 28 2024-05-10T03:42:03.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.380+0000 7f9e69256b80 1 -- 172.21.15.45:0/938798706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x564a50b86b60 con 0x564a50e41eb0 2024-05-10T03:42:03.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.380+0000 7f9e39ffb700 1 -- 172.21.15.45:0/938798706 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9e4c054030 con 0x564a50e41eb0 2024-05-10T03:42:03.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.380+0000 7f9e39ffb700 1 -- 172.21.15.45:0/938798706 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9e4c01f4b0 con 0x564a50e41eb0 2024-05-10T03:42:03.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.380+0000 7f9e69256b80 10 client.26113 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:42:03.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.380+0000 7f9e69256b80 10 client.26113 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:42:03.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.380+0000 7f9e69256b80 20 client.26113 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:03.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.380+0000 7f9e69256b80 1 --2- 172.21.15.45:0/938798706 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x564a50e3d460 0x564a50e3f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.380+0000 7f9e69256b80 4 client.26113 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:42:03.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.380+0000 7f9e69256b80 1 -- 172.21.15.45:0/938798706 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a50e08780 con 0x564a50e3d460 2024-05-10T03:42:03.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.381+0000 7f9e51d9b700 1 --2- 172.21.15.45:0/938798706 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x564a50e3d460 0x564a50e3f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.381+0000 7f9e39ffb700 10 client.26113 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:03.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.381+0000 7f9e51d9b700 1 --2- 172.21.15.45:0/938798706 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x564a50e3d460 0x564a50e3f8b0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=163d87deea50bbed server_cookie=b73a896d6b418b4a in_seq=0 out_seq=0 2024-05-10T03:42:03.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.382+0000 7f9e39ffb700 1 -- 172.21.15.45:0/938798706 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564a50e08780 con 0x564a50e3d460 2024-05-10T03:42:03.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.382+0000 7f9e39ffb700 10 client.26113 handle_command_reply: tid=0 2024-05-10T03:42:03.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.382+0000 7f9e69256b80 1 client.26113 shutdown 2024-05-10T03:42:03.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.382+0000 7f9e69256b80 1 -- 172.21.15.45:0/938798706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a50e41eb0 msgr2=0x564a50e4be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:03.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.382+0000 7f9e69256b80 1 --2- 172.21.15.45:0/938798706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a50e41eb0 0x564a50e4be90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c015cf0 tx=0x7f9e4c000f40 comp rx=0 tx=0).stop 2024-05-10T03:42:03.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.382+0000 7f9e69256b80 1 -- 172.21.15.45:0/938798706 shutdown_connections 2024-05-10T03:42:03.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.382+0000 7f9e69256b80 1 --2- 172.21.15.45:0/938798706 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x564a50e3d460 0x564a50e3f8b0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.382+0000 7f9e69256b80 1 --2- 172.21.15.45:0/938798706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a50e41eb0 0x564a50e4be90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.382+0000 7f9e39ffb700 0 client.26113 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:03.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.382+0000 7f9e69256b80 1 --2- 172.21.15.45:0/938798706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a50e436d0 0x564a50e53390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.382+0000 7f9e69256b80 1 --2- 172.21.15.45:0/938798706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a50e42d80 0x564a50e4c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.382+0000 7f9e69256b80 1 -- 172.21.15.45:0/938798706 >> 172.21.15.45:0/938798706 conn(0x564a50d9ba60 msgr2=0x564a50e33fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:03.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.382+0000 7f9e69256b80 1 -- 172.21.15.45:0/938798706 shutdown_connections 2024-05-10T03:42:03.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.382+0000 7f9e69256b80 1 -- 172.21.15.45:0/938798706 wait complete. 2024-05-10T03:42:03.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.383+0000 7f9e69256b80 20 client.26113 trim_cache size 0 max 16384 2024-05-10T03:42:03.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:03 smithi106 ceph-mon[46996]: pgmap v338: 129 pgs: 129 active+clean; 674 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:42:03.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.406+0000 7f9e69256b80 1 Processor -- start 2024-05-10T03:42:03.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.407+0000 7f9e69256b80 1 -- start start 2024-05-10T03:42:03.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.407+0000 7f9e69256b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a50e41eb0 0x564a50e57de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.407+0000 7f9e69256b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a50e42d80 0x564a50e4c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.407+0000 7f9e69256b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a50e436d0 0x564a50e51310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.407+0000 7f9e69256b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a50e2e7c0 con 0x564a50e436d0 2024-05-10T03:42:03.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.407+0000 7f9e69256b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a50e4d100 con 0x564a50e42d80 2024-05-10T03:42:03.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.407+0000 7f9e69256b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a50e42860 con 0x564a50e41eb0 2024-05-10T03:42:03.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.407+0000 7f9e52d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a50e436d0 0x564a50e51310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.407+0000 7f9e52d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a50e436d0 0x564a50e51310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44050/0 (socket says 172.21.15.45:44050) 2024-05-10T03:42:03.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.407+0000 7f9e52d9d700 1 -- 172.21.15.45:0/359396544 learned_addr learned my addr 172.21.15.45:0/359396544 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:03.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.407+0000 7f9e52d9d700 1 --2- 172.21.15.45:0/359396544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a50e41eb0 0x564a50e57de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.408+0000 7f9e51d9b700 1 --2- 172.21.15.45:0/359396544 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a50e42d80 0x564a50e4c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.408+0000 7f9e52d9d700 1 -- 172.21.15.45:0/359396544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a50e41eb0 msgr2=0x564a50e57de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:03.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.408+0000 7f9e52d9d700 1 --2- 172.21.15.45:0/359396544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a50e41eb0 0x564a50e57de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.408+0000 7f9e52d9d700 1 -- 172.21.15.45:0/359396544 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a50e42d80 msgr2=0x564a50e4c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:03.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.408+0000 7f9e52d9d700 1 --2- 172.21.15.45:0/359396544 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a50e42d80 0x564a50e4c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.408+0000 7f9e52d9d700 1 -- 172.21.15.45:0/359396544 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a50d1f560 con 0x564a50e436d0 2024-05-10T03:42:03.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.408+0000 7f9e51d9b700 1 --2- 172.21.15.45:0/359396544 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a50e42d80 0x564a50e4c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:42:03.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.408+0000 7f9e52d9d700 1 --2- 172.21.15.45:0/359396544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a50e436d0 0x564a50e51310 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c015540 tx=0x7f9e4c0094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f928bd89dec8399a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:03.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.408+0000 7f9e417fa700 1 -- 172.21.15.45:0/359396544 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c01fc30 con 0x564a50e436d0 2024-05-10T03:42:03.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.408+0000 7f9e417fa700 1 -- 172.21.15.45:0/359396544 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9e4c054070 con 0x564a50e436d0 2024-05-10T03:42:03.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.408+0000 7f9e417fa700 1 -- 172.21.15.45:0/359396544 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c004030 con 0x564a50e436d0 2024-05-10T03:42:03.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.409+0000 7f9e69256b80 1 -- 172.21.15.45:0/359396544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a50e436d0 msgr2=0x564a50e51310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:03.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.409+0000 7f9e69256b80 1 --2- 172.21.15.45:0/359396544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a50e436d0 0x564a50e51310 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c015540 tx=0x7f9e4c0094c0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.410+0000 7f9e69256b80 1 -- 172.21.15.45:0/359396544 shutdown_connections 2024-05-10T03:42:03.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.410+0000 7f9e69256b80 1 --2- 172.21.15.45:0/359396544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a50e41eb0 0x564a50e57de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.410+0000 7f9e69256b80 1 --2- 172.21.15.45:0/359396544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a50e436d0 0x564a50e51310 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.410+0000 7f9e69256b80 1 --2- 172.21.15.45:0/359396544 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a50e42d80 0x564a50e4c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.410+0000 7f9e69256b80 1 -- 172.21.15.45:0/359396544 >> 172.21.15.45:0/359396544 conn(0x564a50d9ba60 msgr2=0x564a50e45fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:03.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.410+0000 7f9e69256b80 1 -- 172.21.15.45:0/359396544 shutdown_connections 2024-05-10T03:42:03.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.410+0000 7f9e69256b80 1 -- 172.21.15.45:0/359396544 wait complete. 2024-05-10T03:42:03.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.410+0000 7f9e69256b80 1 -- start start 2024-05-10T03:42:03.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.410+0000 7f9e69256b80 1 Processor -- start 2024-05-10T03:42:03.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.411+0000 7f9e69256b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a50e41eb0 0x564a50e4f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.411+0000 7f9e69256b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a50e42d80 0x564a50e4f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.411+0000 7f9e69256b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a50e436d0 0x564a50e50910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.411+0000 7f9e69256b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a50e50e50 con 0x564a50e42d80 2024-05-10T03:42:03.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.411+0000 7f9e69256b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a50e50fc0 con 0x564a50e436d0 2024-05-10T03:42:03.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.411+0000 7f9e69256b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a50e51180 con 0x564a50e41eb0 2024-05-10T03:42:03.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.411+0000 7f9e69256b80 10 client.0 _ll_register_callbacks cb 0x564a50cfeb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:03.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.411+0000 7f9e52d9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a50e436d0 0x564a50e50910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.411+0000 7f9e52d9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a50e436d0 0x564a50e50910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.45:57710/0 (socket says 172.21.15.45:57710) 2024-05-10T03:42:03.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.411+0000 7f9e52d9d700 1 -- 172.21.15.45:0/4201309176 learned_addr learned my addr 172.21.15.45:0/4201309176 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:03.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.411+0000 7f9e52d9d700 1 --2- 172.21.15.45:0/4201309176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a50e41eb0 0x564a50e4f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.411+0000 7f9e51d9b700 1 --2- 172.21.15.45:0/4201309176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a50e42d80 0x564a50e4f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.411+0000 7f9e52d9d700 1 -- 172.21.15.45:0/4201309176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a50e41eb0 msgr2=0x564a50e4f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:03.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.411+0000 7f9e52d9d700 1 --2- 172.21.15.45:0/4201309176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a50e41eb0 0x564a50e4f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.411+0000 7f9e52d9d700 1 -- 172.21.15.45:0/4201309176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a50e42d80 msgr2=0x564a50e4f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:03.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.411+0000 7f9e52d9d700 1 --2- 172.21.15.45:0/4201309176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a50e42d80 0x564a50e4f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.411+0000 7f9e52d9d700 1 -- 172.21.15.45:0/4201309176 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a50b86b60 con 0x564a50e436d0 2024-05-10T03:42:03.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.412+0000 7f9e52d9d700 1 --2- 172.21.15.45:0/4201309176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a50e436d0 0x564a50e50910 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c00a8d0 tx=0x7f9e4c006160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dee33bfcb57feeb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:03.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.412+0000 7f9e39ffb700 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-05-10T03:42:03.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.412+0000 7f9e39ffb700 1 -- 172.21.15.45:0/4201309176 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c01f620 con 0x564a50e436d0 2024-05-10T03:42:03.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.412+0000 7f9e39ffb700 1 -- 172.21.15.45:0/4201309176 <== mon.2 v2:172.21.15.106:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f9e4c010040 con 0x564a50e436d0 2024-05-10T03:42:03.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.412+0000 7f9e69256b80 1 -- 172.21.15.45:0/4201309176 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9e4c00b5a0 con 0x564a50e436d0 2024-05-10T03:42:03.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.412+0000 7f9e39ffb700 1 -- 172.21.15.45:0/4201309176 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e4c00abd0 con 0x564a50e436d0 2024-05-10T03:42:03.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.412+0000 7f9e69256b80 10 client.26075 fetch_fsmap learned FSMap version 28 2024-05-10T03:42:03.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.412+0000 7f9e69256b80 1 -- 172.21.15.45:0/4201309176 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x564a50bdecd0 con 0x564a50e436d0 2024-05-10T03:42:03.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.413+0000 7f9e39ffb700 1 -- 172.21.15.45:0/4201309176 <== mon.2 v2:172.21.15.106:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9e4c071080 con 0x564a50e436d0 2024-05-10T03:42:03.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.413+0000 7f9e39ffb700 1 -- 172.21.15.45:0/4201309176 <== mon.2 v2:172.21.15.106:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9e4c062070 con 0x564a50e436d0 2024-05-10T03:42:03.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.413+0000 7f9e69256b80 10 client.26075 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:42:03.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.413+0000 7f9e69256b80 10 client.26075 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:42:03.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.413+0000 7f9e69256b80 20 client.26075 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:03.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.413+0000 7f9e69256b80 1 --2- 172.21.15.45:0/4201309176 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x564a50ea58b0 0x564a50ea7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:03.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.413+0000 7f9e69256b80 4 client.26075 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T03:42:03.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.413+0000 7f9e69256b80 1 -- 172.21.15.45:0/4201309176 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564a50d51ec0 con 0x564a50ea58b0 2024-05-10T03:42:03.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.413+0000 7f9e51d9b700 1 --2- 172.21.15.45:0/4201309176 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x564a50ea58b0 0x564a50ea7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:03.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.414+0000 7f9e39ffb700 10 client.26075 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:03.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.414+0000 7f9e51d9b700 1 --2- 172.21.15.45:0/4201309176 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x564a50ea58b0 0x564a50ea7cd0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f304e654414b9d57 server_cookie=7f8c17658e79c090 in_seq=0 out_seq=0 2024-05-10T03:42:03.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.414+0000 7f9e39ffb700 1 -- 172.21.15.45:0/4201309176 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x564a50d51ec0 con 0x564a50ea58b0 2024-05-10T03:42:03.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.414+0000 7f9e39ffb700 10 client.26075 handle_command_reply: tid=0 2024-05-10T03:42:03.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.414+0000 7f9e69256b80 1 client.26075 shutdown 2024-05-10T03:42:03.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.414+0000 7f9e69256b80 1 -- 172.21.15.45:0/4201309176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a50e436d0 msgr2=0x564a50e50910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:03.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.414+0000 7f9e69256b80 1 --2- 172.21.15.45:0/4201309176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a50e436d0 0x564a50e50910 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c00a8d0 tx=0x7f9e4c006160 comp rx=0 tx=0).stop 2024-05-10T03:42:03.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.414+0000 7f9e69256b80 1 -- 172.21.15.45:0/4201309176 shutdown_connections 2024-05-10T03:42:03.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.414+0000 7f9e69256b80 1 --2- 172.21.15.45:0/4201309176 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x564a50ea58b0 0x564a50ea7cd0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.414+0000 7f9e69256b80 1 --2- 172.21.15.45:0/4201309176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a50e41eb0 0x564a50e4f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.414+0000 7f9e69256b80 1 --2- 172.21.15.45:0/4201309176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a50e436d0 0x564a50e50910 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.414+0000 7f9e69256b80 1 --2- 172.21.15.45:0/4201309176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564a50e42d80 0x564a50e4f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.414+0000 7f9e69256b80 1 -- 172.21.15.45:0/4201309176 >> 172.21.15.45:0/4201309176 conn(0x564a50d9ba60 msgr2=0x564a50e4b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:03.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.414+0000 7f9e39ffb700 0 client.26075 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:03.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.414+0000 7f9e69256b80 1 -- 172.21.15.45:0/4201309176 shutdown_connections 2024-05-10T03:42:03.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.414+0000 7f9e69256b80 1 -- 172.21.15.45:0/4201309176 wait complete. 2024-05-10T03:42:03.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.415+0000 7f9e69256b80 20 client.26075 trim_cache size 0 max 16384 2024-05-10T03:42:03.423 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:42:03.423 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-10T03:42:03.423 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": { 2024-05-10T03:42:03.423 INFO:teuthology.orchestra.run.smithi045.stdout: "585851b6-a581-406f-95aa-c89636d23cf0": { 2024-05-10T03:42:03.423 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/", 2024-05-10T03:42:03.423 INFO:teuthology.orchestra.run.smithi045.stdout: "tag": "585851b6-a581-406f-95aa-c89636d23cf0", 2024-05-10T03:42:03.423 INFO:teuthology.orchestra.run.smithi045.stdout: "options": "recursive,force" 2024-05-10T03:42:03.424 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:42:03.424 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:42:03.424 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:42:03.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.415+0000 7f9e58f12700 1 -- 172.21.15.45:0/4168418772 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9e3c0a13b0 msgr2=0x7f9e3c0a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:03.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.415+0000 7f9e58f12700 1 --2- 172.21.15.45:0/4168418772 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9e3c0a13b0 0x7f9e3c0a38c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9e4409a850 tx=0x7f9e44005e80 comp rx=0 tx=0).stop 2024-05-10T03:42:03.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.415+0000 7f9e58f12700 1 -- 172.21.15.45:0/4168418772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e541002c0 msgr2=0x7f9e54195e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:03.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.415+0000 7f9e58f12700 1 --2- 172.21.15.45:0/4168418772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e541002c0 0x7f9e54195e00 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400a9f0 tx=0x7f9e44005b00 comp rx=0 tx=0).stop 2024-05-10T03:42:03.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.415+0000 7f9e58f12700 1 -- 172.21.15.45:0/4168418772 shutdown_connections 2024-05-10T03:42:03.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.415+0000 7f9e58f12700 1 --2- 172.21.15.45:0/4168418772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e54101d80 0x7f9e5419d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.415+0000 7f9e58f12700 1 --2- 172.21.15.45:0/4168418772 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9e3c0a13b0 0x7f9e3c0a38c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.415+0000 7f9e58f12700 1 --2- 172.21.15.45:0/4168418772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e541002c0 0x7f9e54195e00 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.415+0000 7f9e58f12700 1 --2- 172.21.15.45:0/4168418772 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e541013e0 0x7f9e54196340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:03.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.416+0000 7f9e58f12700 1 -- 172.21.15.45:0/4168418772 >> 172.21.15.45:0/4168418772 conn(0x7f9e540fb8f0 msgr2=0x7f9e54104610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:03.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.416+0000 7f9e58f12700 1 -- 172.21.15.45:0/4168418772 shutdown_connections 2024-05-10T03:42:03.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:03.416+0000 7f9e58f12700 1 -- 172.21.15.45:0/4168418772 wait complete. 2024-05-10T03:42:03.432 INFO:tasks.cephfs.filesystem:scrub status for tag:585851b6-a581-406f-95aa-c89636d23cf0 - {'path': '/', 'tag': '585851b6-a581-406f-95aa-c89636d23cf0', 'options': 'recursive,force'} 2024-05-10T03:42:03.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:03 smithi154 ceph-mon[46565]: pgmap v338: 129 pgs: 129 active+clean; 674 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:42:04.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:04 smithi106 ceph-mon[46996]: scrub queued for path: / 2024-05-10T03:42:04.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:04 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:04.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:04 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:42:04.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:04 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:04.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:04 smithi154 ceph-mon[46565]: scrub queued for path: / 2024-05-10T03:42:04.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:04 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:04.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:04 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:42:04.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:04 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:04.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:04 smithi045 ceph-mon[42520]: scrub queued for path: / 2024-05-10T03:42:04.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:04 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:04.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:04 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:42:04.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:04 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:05.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:05 smithi106 ceph-mon[46996]: pgmap v339: 129 pgs: 129 active+clean; 674 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:42:05.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:05 smithi154 ceph-mon[46565]: pgmap v339: 129 pgs: 129 active+clean; 674 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:42:05.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:05 smithi045 ceph-mon[42520]: pgmap v339: 129 pgs: 129 active+clean; 674 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T03:42:06.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:06 smithi106 ceph-mon[46996]: scrub summary: idle 2024-05-10T03:42:06.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:06 smithi154 ceph-mon[46565]: scrub summary: idle 2024-05-10T03:42:06.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:06 smithi045 ceph-mon[42520]: scrub summary: idle 2024-05-10T03:42:07.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:07 smithi106 ceph-mon[46996]: pgmap v340: 129 pgs: 129 active+clean; 674 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:42:07.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:07 smithi154 ceph-mon[46565]: pgmap v340: 129 pgs: 129 active+clean; 674 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:42:07.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:07 smithi045 ceph-mon[42520]: pgmap v340: 129 pgs: 129 active+clean; 674 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:42:08.777 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.774+0000 7f8523664700 1 -- 172.21.15.45:0/1576164060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f851c102580 msgr2=0x7f851c108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:08.777 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.774+0000 7f8523664700 1 --2- 172.21.15.45:0/1576164060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f851c102580 0x7f851c108e30 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f8514009f90 tx=0x7f851400b330 comp rx=0 tx=0).stop 2024-05-10T03:42:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.776+0000 7f8523664700 1 -- 172.21.15.45:0/1576164060 shutdown_connections 2024-05-10T03:42:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.776+0000 7f8523664700 1 --2- 172.21.15.45:0/1576164060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f851c100ac0 0x7f851c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.776+0000 7f8523664700 1 --2- 172.21.15.45:0/1576164060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f851c102580 0x7f851c108e30 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.778 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.776+0000 7f8523664700 1 --2- 172.21.15.45:0/1576164060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f851c101be0 0x7f851c101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.776+0000 7f8523664700 1 -- 172.21.15.45:0/1576164060 >> 172.21.15.45:0/1576164060 conn(0x7f851c0fc0f0 msgr2=0x7f851c0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.776+0000 7f8523664700 1 -- 172.21.15.45:0/1576164060 shutdown_connections 2024-05-10T03:42:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.776+0000 7f8523664700 1 -- 172.21.15.45:0/1576164060 wait complete. 2024-05-10T03:42:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.777+0000 7f8523664700 1 Processor -- start 2024-05-10T03:42:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.777+0000 7f8523664700 1 -- start start 2024-05-10T03:42:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.777+0000 7f8523664700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f851c100ac0 0x7f851c197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.777+0000 7f8523664700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f851c101be0 0x7f851c1975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.777+0000 7f8523664700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f851c102580 0x7f851c19e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.777+0000 7f8523664700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c19eb00 con 0x7f851c102580 2024-05-10T03:42:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.777+0000 7f8523664700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c06ac30 con 0x7f851c101be0 2024-05-10T03:42:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.777+0000 7f8523664700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c06adf0 con 0x7f851c100ac0 2024-05-10T03:42:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.777+0000 7f8521c01700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f851c102580 0x7f851c19e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.777+0000 7f8521c01700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f851c102580 0x7f851c19e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50246/0 (socket says 172.21.15.45:50246) 2024-05-10T03:42:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.777+0000 7f8521c01700 1 -- 172.21.15.45:0/1835883236 learned_addr learned my addr 172.21.15.45:0/1835883236 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.777+0000 7f8521400700 1 --2- 172.21.15.45:0/1835883236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f851c100ac0 0x7f851c197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.778+0000 7f8520bff700 1 --2- 172.21.15.45:0/1835883236 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f851c101be0 0x7f851c1975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.778+0000 7f8521c01700 1 -- 172.21.15.45:0/1835883236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f851c100ac0 msgr2=0x7f851c197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.778+0000 7f8521c01700 1 --2- 172.21.15.45:0/1835883236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f851c100ac0 0x7f851c197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.778+0000 7f8521c01700 1 -- 172.21.15.45:0/1835883236 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f851c101be0 msgr2=0x7f851c1975a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.778+0000 7f8521c01700 1 --2- 172.21.15.45:0/1835883236 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f851c101be0 0x7f851c1975a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.778+0000 7f8521c01700 1 -- 172.21.15.45:0/1835883236 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850c009520 con 0x7f851c102580 2024-05-10T03:42:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.778+0000 7f8521c01700 1 --2- 172.21.15.45:0/1835883236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f851c102580 0x7f851c19e530 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8514007b70 tx=0x7f8514004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.778+0000 7f85127fc700 1 -- 172.21.15.45:0/1835883236 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851400e040 con 0x7f851c102580 2024-05-10T03:42:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.779+0000 7f85127fc700 1 -- 172.21.15.45:0/1835883236 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8514009390 con 0x7f851c102580 2024-05-10T03:42:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.779+0000 7f85127fc700 1 -- 172.21.15.45:0/1835883236 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85140052a0 con 0x7f851c102580 2024-05-10T03:42:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.780+0000 7f8523664700 1 -- 172.21.15.45:0/1835883236 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8514009c40 con 0x7f851c102580 2024-05-10T03:42:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.780+0000 7f8523664700 1 -- 172.21.15.45:0/1835883236 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f851c0688f0 con 0x7f851c102580 2024-05-10T03:42:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.784+0000 7f85127fc700 1 -- 172.21.15.45:0/1835883236 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f851401d470 con 0x7f851c102580 2024-05-10T03:42:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.785+0000 7f85339a8b80 1 Processor -- start 2024-05-10T03:42:08.788 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.785+0000 7f85339a8b80 1 -- start start 2024-05-10T03:42:08.788 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.786+0000 7f85127fc700 1 --2- 172.21.15.45:0/1835883236 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f85080a1120 0x7f85080a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:08.788 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.786+0000 7f85339a8b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e0a5f1f180 0x55e0a5f1f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:08.788 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.786+0000 7f85339a8b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f20050 0x55e0a5f20460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:08.788 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.786+0000 7f85339a8b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0a5f209a0 0x55e0a5f272a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.786+0000 7f85339a8b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a5e460f0 con 0x55e0a5f20050 2024-05-10T03:42:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.786+0000 7f85339a8b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a5e43ab0 con 0x55e0a5f1f180 2024-05-10T03:42:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.786+0000 7f85339a8b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a5e3f3a0 con 0x55e0a5f209a0 2024-05-10T03:42:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.786+0000 7f85127fc700 1 -- 172.21.15.45:0/1835883236 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f85140cdb40 con 0x7f851c102580 2024-05-10T03:42:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.786+0000 7f8520bff700 1 --2- 172.21.15.45:0/1835883236 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f85080a1120 0x7f85080a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.786+0000 7f8520bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f20050 0x55e0a5f20460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.786+0000 7f8520bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f20050 0x55e0a5f20460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50252/0 (socket says 172.21.15.45:50252) 2024-05-10T03:42:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.786+0000 7f8520bff700 1 -- 172.21.15.45:0/2977937090 learned_addr learned my addr 172.21.15.45:0/2977937090 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.787+0000 7f8521c01700 1 --2- 172.21.15.45:0/2977937090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0a5f209a0 0x55e0a5f272a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.787+0000 7f8521400700 1 --2- 172.21.15.45:0/2977937090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e0a5f1f180 0x55e0a5f1f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.787+0000 7f8521c01700 1 -- 172.21.15.45:0/2977937090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e0a5f1f180 msgr2=0x55e0a5f1f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.787+0000 7f8521c01700 1 --2- 172.21.15.45:0/2977937090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e0a5f1f180 0x55e0a5f1f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.787+0000 7f8521c01700 1 -- 172.21.15.45:0/2977937090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f20050 msgr2=0x55e0a5f20460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.787+0000 7f8521c01700 1 --2- 172.21.15.45:0/2977937090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f20050 0x55e0a5f20460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.787+0000 7f8521c01700 1 -- 172.21.15.45:0/2977937090 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0a5cc0350 con 0x55e0a5f209a0 2024-05-10T03:42:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.787+0000 7f8521400700 1 --2- 172.21.15.45:0/2977937090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e0a5f1f180 0x55e0a5f1f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.787+0000 7f8521c01700 1 --2- 172.21.15.45:0/2977937090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0a5f209a0 0x55e0a5f272a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f85140cb610 tx=0x7f851409abb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a709820b264df0b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.787+0000 7f85077fe700 1 -- 172.21.15.45:0/2977937090 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851409b410 con 0x55e0a5f209a0 2024-05-10T03:42:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.787+0000 7f85077fe700 1 -- 172.21.15.45:0/2977937090 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f851409ad10 con 0x55e0a5f209a0 2024-05-10T03:42:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.787+0000 7f85077fe700 1 -- 172.21.15.45:0/2977937090 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851409b1d0 con 0x55e0a5f209a0 2024-05-10T03:42:08.793 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.789+0000 7f85339a8b80 1 -- 172.21.15.45:0/2977937090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0a5f209a0 msgr2=0x55e0a5f272a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:08.793 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.789+0000 7f8520bff700 1 --2- 172.21.15.45:0/1835883236 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f85080a1120 0x7f85080a3630 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f850c009f30 tx=0x7f850c012d30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:08.793 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.789+0000 7f85339a8b80 1 --2- 172.21.15.45:0/2977937090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0a5f209a0 0x55e0a5f272a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f85140cb610 tx=0x7f851409abb0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.793 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.789+0000 7f85339a8b80 1 -- 172.21.15.45:0/2977937090 shutdown_connections 2024-05-10T03:42:08.793 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.789+0000 7f85339a8b80 1 --2- 172.21.15.45:0/2977937090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0a5f209a0 0x55e0a5f272a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.793 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.789+0000 7f85339a8b80 1 --2- 172.21.15.45:0/2977937090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e0a5f1f180 0x55e0a5f1f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.793 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.789+0000 7f85339a8b80 1 --2- 172.21.15.45:0/2977937090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f20050 0x55e0a5f20460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.789+0000 7f85339a8b80 1 -- 172.21.15.45:0/2977937090 >> 172.21.15.45:0/2977937090 conn(0x55e0a5e81a00 msgr2=0x55e0a5f19a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.789+0000 7f85339a8b80 1 -- 172.21.15.45:0/2977937090 shutdown_connections 2024-05-10T03:42:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.789+0000 7f85339a8b80 1 -- 172.21.15.45:0/2977937090 wait complete. 2024-05-10T03:42:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.789+0000 7f85339a8b80 1 -- start start 2024-05-10T03:42:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.790+0000 7f85339a8b80 1 Processor -- start 2024-05-10T03:42:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.790+0000 7f85339a8b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f1f180 0x55e0a5f28dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.790+0000 7f85339a8b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0a5f20050 0x55e0a5f29310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.790+0000 7f85339a8b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e0a5f209a0 0x55e0a5f30270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.790+0000 7f85339a8b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a5ddb500 con 0x55e0a5f1f180 2024-05-10T03:42:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.790+0000 7f85339a8b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a5ddb1a0 con 0x55e0a5f209a0 2024-05-10T03:42:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.790+0000 7f85339a8b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a5cc2640 con 0x55e0a5f20050 2024-05-10T03:42:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.790+0000 7f85339a8b80 10 client.0 _ll_register_callbacks cb 0x55e0a5de4ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.790+0000 7f8521400700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f1f180 0x55e0a5f28dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.790+0000 7f8521400700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f1f180 0x55e0a5f28dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50260/0 (socket says 172.21.15.45:50260) 2024-05-10T03:42:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.790+0000 7f8521400700 1 -- 172.21.15.45:0/2216009488 learned_addr learned my addr 172.21.15.45:0/2216009488 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.791+0000 7f8520bff700 1 --2- 172.21.15.45:0/2216009488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0a5f20050 0x55e0a5f29310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.791+0000 7f8521400700 1 -- 172.21.15.45:0/2216009488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0a5f20050 msgr2=0x55e0a5f29310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.791+0000 7f8521400700 1 --2- 172.21.15.45:0/2216009488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0a5f20050 0x55e0a5f29310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.791+0000 7f8521400700 1 -- 172.21.15.45:0/2216009488 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e0a5f209a0 msgr2=0x55e0a5f30270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T03:42:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.791+0000 7f8521400700 1 --2- 172.21.15.45:0/2216009488 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e0a5f209a0 0x55e0a5f30270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.791+0000 7f8521400700 1 -- 172.21.15.45:0/2216009488 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8518009920 con 0x55e0a5f1f180 2024-05-10T03:42:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.791+0000 7f8521400700 1 --2- 172.21.15.45:0/2216009488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f1f180 0x55e0a5f28dd0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8518012960 tx=0x7f8518012d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9775be48086a3fb7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.791+0000 7f8504ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:42:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.792+0000 7f8504ff9700 1 -- 172.21.15.45:0/2216009488 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8518017070 con 0x55e0a5f1f180 2024-05-10T03:42:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.792+0000 7f8504ff9700 1 -- 172.21.15.45:0/2216009488 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f8518004030 con 0x55e0a5f1f180 2024-05-10T03:42:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.792+0000 7f85339a8b80 1 -- 172.21.15.45:0/2216009488 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0a5d98210 con 0x55e0a5f1f180 2024-05-10T03:42:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.792+0000 7f8504ff9700 1 -- 172.21.15.45:0/2216009488 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8518004230 con 0x55e0a5f1f180 2024-05-10T03:42:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.792+0000 7f85339a8b80 10 client.16266 fetch_fsmap learned FSMap version 28 2024-05-10T03:42:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.792+0000 7f85339a8b80 1 -- 172.21.15.45:0/2216009488 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f851c0688f0 con 0x55e0a5f1f180 2024-05-10T03:42:08.800 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.793+0000 7f8504ff9700 1 -- 172.21.15.45:0/2216009488 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55e0a5d98210 con 0x55e0a5f1f180 2024-05-10T03:42:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.793+0000 7f8504ff9700 1 -- 172.21.15.45:0/2216009488 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f85180038e0 con 0x55e0a5f1f180 2024-05-10T03:42:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.793+0000 7f85339a8b80 10 client.16266 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:42:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.793+0000 7f85339a8b80 10 client.16266 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:42:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.793+0000 7f85339a8b80 20 client.16266 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.793+0000 7f85339a8b80 1 --2- 172.21.15.45:0/2216009488 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55e0a5f34bb0 0x55e0a5f37000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.793+0000 7f85339a8b80 4 client.16266 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:42:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.793+0000 7f85339a8b80 1 -- 172.21.15.45:0/2216009488 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0a5eee720 con 0x55e0a5f34bb0 2024-05-10T03:42:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.793+0000 7f8520bff700 1 --2- 172.21.15.45:0/2216009488 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55e0a5f34bb0 0x55e0a5f37000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.794+0000 7f8520bff700 1 --2- 172.21.15.45:0/2216009488 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55e0a5f34bb0 0x55e0a5f37000 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e06b7f59e157628 server_cookie=ead40d7664334ac4 in_seq=0 out_seq=0 2024-05-10T03:42:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.794+0000 7f8504ff9700 10 client.16266 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.795+0000 7f8504ff9700 1 -- 172.21.15.45:0/2216009488 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e0a5eee720 con 0x55e0a5f34bb0 2024-05-10T03:42:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.795+0000 7f8504ff9700 10 client.16266 handle_command_reply: tid=0 2024-05-10T03:42:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.795+0000 7f85339a8b80 1 client.16266 shutdown 2024-05-10T03:42:08.801 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.795+0000 7f85339a8b80 1 -- 172.21.15.45:0/2216009488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f1f180 msgr2=0x55e0a5f28dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:08.802 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.795+0000 7f85339a8b80 1 --2- 172.21.15.45:0/2216009488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f1f180 0x55e0a5f28dd0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8518012960 tx=0x7f8518012d20 comp rx=0 tx=0).stop 2024-05-10T03:42:08.802 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.795+0000 7f85339a8b80 1 -- 172.21.15.45:0/2216009488 shutdown_connections 2024-05-10T03:42:08.802 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.795+0000 7f85339a8b80 1 --2- 172.21.15.45:0/2216009488 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55e0a5f34bb0 0x55e0a5f37000 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.802 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.795+0000 7f85339a8b80 1 --2- 172.21.15.45:0/2216009488 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e0a5f209a0 0x55e0a5f30270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.802 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.795+0000 7f85339a8b80 1 --2- 172.21.15.45:0/2216009488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f1f180 0x55e0a5f28dd0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.802 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.795+0000 7f85339a8b80 1 --2- 172.21.15.45:0/2216009488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0a5f20050 0x55e0a5f29310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.802 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.795+0000 7f85339a8b80 1 -- 172.21.15.45:0/2216009488 >> 172.21.15.45:0/2216009488 conn(0x55e0a5e81a00 msgr2=0x55e0a5f19a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:08.802 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.795+0000 7f8504ff9700 0 client.16266 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:08.802 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.795+0000 7f85339a8b80 1 -- 172.21.15.45:0/2216009488 shutdown_connections 2024-05-10T03:42:08.802 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.795+0000 7f85339a8b80 1 -- 172.21.15.45:0/2216009488 wait complete. 2024-05-10T03:42:08.802 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.796+0000 7f85339a8b80 20 client.16266 trim_cache size 0 max 16384 2024-05-10T03:42:08.828 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.826+0000 7f85339a8b80 1 Processor -- start 2024-05-10T03:42:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.826+0000 7f85339a8b80 1 -- start start 2024-05-10T03:42:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.826+0000 7f85339a8b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0a5f1f180 0x55e0a5f30830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.826+0000 7f85339a8b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e0a5f20050 0x55e0a5f23280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.826+0000 7f85339a8b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f209a0 0x55e0a5f2fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.826+0000 7f85339a8b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a5f31fc0 con 0x55e0a5f209a0 2024-05-10T03:42:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.826+0000 7f85339a8b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a5f237c0 con 0x55e0a5f20050 2024-05-10T03:42:08.829 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.826+0000 7f85339a8b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a5f3c1b0 con 0x55e0a5f1f180 2024-05-10T03:42:08.830 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.827+0000 7f8521c01700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f209a0 0x55e0a5f2fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:08.830 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.827+0000 7f8521c01700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f209a0 0x55e0a5f2fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50268/0 (socket says 172.21.15.45:50268) 2024-05-10T03:42:08.830 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.827+0000 7f8521c01700 1 -- 172.21.15.45:0/2730621885 learned_addr learned my addr 172.21.15.45:0/2730621885 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:08.830 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.827+0000 7f8520bff700 1 --2- 172.21.15.45:0/2730621885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e0a5f20050 0x55e0a5f23280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:08.830 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.827+0000 7f8521400700 1 --2- 172.21.15.45:0/2730621885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0a5f1f180 0x55e0a5f30830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:08.830 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.827+0000 7f8520bff700 1 -- 172.21.15.45:0/2730621885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0a5f1f180 msgr2=0x55e0a5f30830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:08.830 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.827+0000 7f8520bff700 1 --2- 172.21.15.45:0/2730621885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0a5f1f180 0x55e0a5f30830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.831 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.827+0000 7f8520bff700 1 -- 172.21.15.45:0/2730621885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f209a0 msgr2=0x55e0a5f2fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:08.831 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.827+0000 7f8520bff700 1 --2- 172.21.15.45:0/2730621885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f209a0 0x55e0a5f2fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.831 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.827+0000 7f8520bff700 1 -- 172.21.15.45:0/2730621885 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0a5c6cb00 con 0x55e0a5f20050 2024-05-10T03:42:08.831 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.827+0000 7f8521c01700 1 --2- 172.21.15.45:0/2730621885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f209a0 0x55e0a5f2fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:42:08.831 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.827+0000 7f8521400700 1 --2- 172.21.15.45:0/2730621885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0a5f1f180 0x55e0a5f30830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:42:08.831 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.827+0000 7f8520bff700 1 --2- 172.21.15.45:0/2730621885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e0a5f20050 0x55e0a5f23280 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55e0a5f37850 tx=0x7f850c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=724f6b022eb8b213 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:08.831 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.828+0000 7f8507fff700 1 -- 172.21.15.45:0/2730621885 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c017030 con 0x55e0a5f20050 2024-05-10T03:42:08.831 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.828+0000 7f8507fff700 1 -- 172.21.15.45:0/2730621885 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f850c018040 con 0x55e0a5f20050 2024-05-10T03:42:08.831 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.828+0000 7f8507fff700 1 -- 172.21.15.45:0/2730621885 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c003c10 con 0x55e0a5f20050 2024-05-10T03:42:08.832 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.829+0000 7f85339a8b80 1 -- 172.21.15.45:0/2730621885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e0a5f20050 msgr2=0x55e0a5f23280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:08.832 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.829+0000 7f85339a8b80 1 --2- 172.21.15.45:0/2730621885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e0a5f20050 0x55e0a5f23280 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55e0a5f37850 tx=0x7f850c0047c0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.832 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.829+0000 7f85339a8b80 1 -- 172.21.15.45:0/2730621885 shutdown_connections 2024-05-10T03:42:08.832 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.829+0000 7f85339a8b80 1 --2- 172.21.15.45:0/2730621885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0a5f1f180 0x55e0a5f30830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.832 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.829+0000 7f85339a8b80 1 --2- 172.21.15.45:0/2730621885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f209a0 0x55e0a5f2fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.829+0000 7f85339a8b80 1 --2- 172.21.15.45:0/2730621885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e0a5f20050 0x55e0a5f23280 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.829+0000 7f85339a8b80 1 -- 172.21.15.45:0/2730621885 >> 172.21.15.45:0/2730621885 conn(0x55e0a5e81a00 msgr2=0x55e0a5f19a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.829+0000 7f85339a8b80 1 -- 172.21.15.45:0/2730621885 shutdown_connections 2024-05-10T03:42:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.829+0000 7f85339a8b80 1 -- 172.21.15.45:0/2730621885 wait complete. 2024-05-10T03:42:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.829+0000 7f85339a8b80 1 -- start start 2024-05-10T03:42:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.830+0000 7f85339a8b80 1 Processor -- start 2024-05-10T03:42:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.830+0000 7f85339a8b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0a5f1f180 0x55e0a5f2d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.830+0000 7f85339a8b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f20050 0x55e0a5f2d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.830+0000 7f85339a8b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e0a5f209a0 0x55e0a5f91840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.830+0000 7f85339a8b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a5f2de40 con 0x55e0a5f20050 2024-05-10T03:42:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.830+0000 7f85339a8b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a5f91d80 con 0x55e0a5f209a0 2024-05-10T03:42:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.830+0000 7f85339a8b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a5f85090 con 0x55e0a5f1f180 2024-05-10T03:42:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.830+0000 7f85339a8b80 10 client.0 _ll_register_callbacks cb 0x55e0a5de4ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.831+0000 7f8521400700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0a5f1f180 0x55e0a5f2d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.831+0000 7f8521c01700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e0a5f209a0 0x55e0a5f91840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.831+0000 7f8521c01700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e0a5f209a0 0x55e0a5f91840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.45:39946/0 (socket says 172.21.15.45:39946) 2024-05-10T03:42:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.831+0000 7f8521c01700 1 -- 172.21.15.45:0/1925381065 learned_addr learned my addr 172.21.15.45:0/1925381065 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.831+0000 7f8520bff700 1 --2- 172.21.15.45:0/1925381065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f20050 0x55e0a5f2d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.831+0000 7f8521c01700 1 -- 172.21.15.45:0/1925381065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0a5f1f180 msgr2=0x55e0a5f2d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.831+0000 7f8521c01700 1 --2- 172.21.15.45:0/1925381065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0a5f1f180 0x55e0a5f2d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.831+0000 7f8521c01700 1 -- 172.21.15.45:0/1925381065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f20050 msgr2=0x55e0a5f2d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.831+0000 7f8521c01700 1 --2- 172.21.15.45:0/1925381065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f20050 0x55e0a5f2d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.831+0000 7f8521c01700 1 -- 172.21.15.45:0/1925381065 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f850c028040 con 0x55e0a5f209a0 2024-05-10T03:42:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.831+0000 7f8521400700 1 --2- 172.21.15.45:0/1925381065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0a5f1f180 0x55e0a5f2d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:42:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.831+0000 7f8520bff700 1 --2- 172.21.15.45:0/1925381065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f20050 0x55e0a5f2d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:42:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.831+0000 7f8521c01700 1 --2- 172.21.15.45:0/1925381065 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e0a5f209a0 0x55e0a5f91840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f85140cb610 tx=0x7f851409aae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d1b681b9033e29c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.831+0000 7f8504ff9700 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-05-10T03:42:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.832+0000 7f8504ff9700 1 -- 172.21.15.45:0/1925381065 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851409b170 con 0x55e0a5f209a0 2024-05-10T03:42:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.832+0000 7f8504ff9700 1 -- 172.21.15.45:0/1925381065 <== mon.2 v2:172.21.15.106:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f85140a3100 con 0x55e0a5f209a0 2024-05-10T03:42:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.832+0000 7f85339a8b80 1 -- 172.21.15.45:0/1925381065 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f851409ad10 con 0x55e0a5f209a0 2024-05-10T03:42:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.832+0000 7f8504ff9700 1 -- 172.21.15.45:0/1925381065 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85140a2c70 con 0x55e0a5f209a0 2024-05-10T03:42:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.832+0000 7f85339a8b80 10 client.26090 fetch_fsmap learned FSMap version 28 2024-05-10T03:42:08.838 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.832+0000 7f85339a8b80 1 -- 172.21.15.45:0/1925381065 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55e0a5e05500 con 0x55e0a5f209a0 2024-05-10T03:42:08.838 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.832+0000 7f8504ff9700 1 -- 172.21.15.45:0/1925381065 <== mon.2 v2:172.21.15.106:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f851409ad10 con 0x55e0a5f209a0 2024-05-10T03:42:08.838 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.833+0000 7f8504ff9700 1 -- 172.21.15.45:0/1925381065 <== mon.2 v2:172.21.15.106:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f851409bd20 con 0x55e0a5f209a0 2024-05-10T03:42:08.838 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.833+0000 7f85339a8b80 10 client.26090 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:42:08.838 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.833+0000 7f85339a8b80 10 client.26090 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:42:08.838 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.833+0000 7f85339a8b80 20 client.26090 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:08.838 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.833+0000 7f85339a8b80 1 --2- 172.21.15.45:0/1925381065 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55e0a5f865c0 0x55e0a5f889e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:08.838 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.833+0000 7f85339a8b80 4 client.26090 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T03:42:08.838 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.833+0000 7f85339a8b80 1 -- 172.21.15.45:0/1925381065 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e0a5e37e60 con 0x55e0a5f865c0 2024-05-10T03:42:08.838 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.833+0000 7f8521400700 1 --2- 172.21.15.45:0/1925381065 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55e0a5f865c0 0x55e0a5f889e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:08.838 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.833+0000 7f8504ff9700 10 client.26090 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:08.838 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.834+0000 7f8521400700 1 --2- 172.21.15.45:0/1925381065 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55e0a5f865c0 0x55e0a5f889e0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89132d916fdef8b5 server_cookie=1be2c07f980d8342 in_seq=0 out_seq=0 2024-05-10T03:42:08.840 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.837+0000 7f8504ff9700 1 -- 172.21.15.45:0/1925381065 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e0a5e37e60 con 0x55e0a5f865c0 2024-05-10T03:42:08.840 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.837+0000 7f8504ff9700 10 client.26090 handle_command_reply: tid=0 2024-05-10T03:42:08.840 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.838+0000 7f85339a8b80 1 client.26090 shutdown 2024-05-10T03:42:08.840 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.838+0000 7f85339a8b80 1 -- 172.21.15.45:0/1925381065 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e0a5f209a0 msgr2=0x55e0a5f91840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:08.840 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.838+0000 7f85339a8b80 1 --2- 172.21.15.45:0/1925381065 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e0a5f209a0 0x55e0a5f91840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f85140cb610 tx=0x7f851409aae0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.840 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.838+0000 7f85339a8b80 1 -- 172.21.15.45:0/1925381065 shutdown_connections 2024-05-10T03:42:08.840 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.838+0000 7f85339a8b80 1 --2- 172.21.15.45:0/1925381065 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55e0a5f865c0 0x55e0a5f889e0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.841 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.838+0000 7f85339a8b80 1 --2- 172.21.15.45:0/1925381065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e0a5f1f180 0x55e0a5f2d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.841 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.838+0000 7f85339a8b80 1 --2- 172.21.15.45:0/1925381065 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e0a5f209a0 0x55e0a5f91840 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.841 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.838+0000 7f85339a8b80 1 --2- 172.21.15.45:0/1925381065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0a5f20050 0x55e0a5f2d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.841 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.838+0000 7f85339a8b80 1 -- 172.21.15.45:0/1925381065 >> 172.21.15.45:0/1925381065 conn(0x55e0a5e81a00 msgr2=0x55e0a5f28980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:08.841 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.838+0000 7f8504ff9700 0 client.26090 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:08.842 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.840+0000 7f85339a8b80 1 -- 172.21.15.45:0/1925381065 shutdown_connections 2024-05-10T03:42:08.842 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.840+0000 7f85339a8b80 1 -- 172.21.15.45:0/1925381065 wait complete. 2024-05-10T03:42:08.842 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.840+0000 7f85339a8b80 20 client.26090 trim_cache size 0 max 16384 2024-05-10T03:42:08.842 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:{ 2024-05-10T03:42:08.843 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "message": "", 2024-05-10T03:42:08.843 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "return_code": 0 2024-05-10T03:42:08.843 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:} 2024-05-10T03:42:08.844 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.840+0000 7f8523664700 1 -- 172.21.15.45:0/1835883236 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f85080a1120 msgr2=0x7f85080a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:08.844 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.840+0000 7f8523664700 1 --2- 172.21.15.45:0/1835883236 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f85080a1120 0x7f85080a3630 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f850c009f30 tx=0x7f850c012d30 comp rx=0 tx=0).stop 2024-05-10T03:42:08.844 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.840+0000 7f8523664700 1 -- 172.21.15.45:0/1835883236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f851c102580 msgr2=0x7f851c19e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:08.844 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.840+0000 7f8523664700 1 --2- 172.21.15.45:0/1835883236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f851c102580 0x7f851c19e530 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8514007b70 tx=0x7f8514004d00 comp rx=0 tx=0).stop 2024-05-10T03:42:08.844 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.841+0000 7f8523664700 1 -- 172.21.15.45:0/1835883236 shutdown_connections 2024-05-10T03:42:08.844 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.841+0000 7f8523664700 1 --2- 172.21.15.45:0/1835883236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f851c100ac0 0x7f851c197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.844 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.841+0000 7f8523664700 1 --2- 172.21.15.45:0/1835883236 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f85080a1120 0x7f85080a3630 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.844 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.841+0000 7f8523664700 1 --2- 172.21.15.45:0/1835883236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f851c102580 0x7f851c19e530 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.844 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.841+0000 7f8523664700 1 --2- 172.21.15.45:0/1835883236 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f851c101be0 0x7f851c1975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:08.844 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.841+0000 7f8523664700 1 -- 172.21.15.45:0/1835883236 >> 172.21.15.45:0/1835883236 conn(0x7f851c0fc0f0 msgr2=0x7f851c104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:08.844 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.841+0000 7f8523664700 1 -- 172.21.15.45:0/1835883236 shutdown_connections 2024-05-10T03:42:08.844 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:08.841+0000 7f8523664700 1 -- 172.21.15.45:0/1835883236 wait complete. 2024-05-10T03:42:09.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:09 smithi106 ceph-mon[46996]: pgmap v341: 129 pgs: 129 active+clean; 674 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:42:09.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:09 smithi154 ceph-mon[46565]: pgmap v341: 129 pgs: 129 active+clean; 674 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:42:09.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:09 smithi045 ceph-mon[42520]: pgmap v341: 129 pgs: 129 active+clean; 674 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:42:11.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:11 smithi106 ceph-mon[46996]: pgmap v342: 129 pgs: 129 active+clean; 675 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 12 op/s 2024-05-10T03:42:11.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:11 smithi154 ceph-mon[46565]: pgmap v342: 129 pgs: 129 active+clean; 675 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 12 op/s 2024-05-10T03:42:11.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:11 smithi045 ceph-mon[42520]: pgmap v342: 129 pgs: 129 active+clean; 675 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 12 op/s 2024-05-10T03:42:13.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:13 smithi106 ceph-mon[46996]: pgmap v343: 129 pgs: 129 active+clean; 675 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:42:13.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:13 smithi154 ceph-mon[46565]: pgmap v343: 129 pgs: 129 active+clean; 675 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:42:13.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:13 smithi045 ceph-mon[42520]: pgmap v343: 129 pgs: 129 active+clean; 675 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T03:42:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:15 smithi106 ceph-mon[46996]: pgmap v344: 129 pgs: 129 active+clean; 675 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-10T03:42:15.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:15 smithi154 ceph-mon[46565]: pgmap v344: 129 pgs: 129 active+clean; 675 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-10T03:42:15.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:15 smithi045 ceph-mon[42520]: pgmap v344: 129 pgs: 129 active+clean; 675 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-10T03:42:17.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:17 smithi106 ceph-mon[46996]: pgmap v345: 129 pgs: 129 active+clean; 675 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-10T03:42:17.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:17 smithi154 ceph-mon[46565]: pgmap v345: 129 pgs: 129 active+clean; 675 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-10T03:42:17.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:17 smithi045 ceph-mon[42520]: pgmap v345: 129 pgs: 129 active+clean; 675 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-10T03:42:17.643 INFO:tasks.workunit.client.0.smithi045.stderr:Updating files: 84% (10389/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-10T03:42:18.532 INFO:tasks.workunit.client.0.smithi045.stderr:Note: switching to '50174015a7e79f951b988949abe236791f52d4da'. 2024-05-10T03:42:18.533 INFO:tasks.workunit.client.0.smithi045.stderr: 2024-05-10T03:42:18.533 INFO:tasks.workunit.client.0.smithi045.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-10T03:42:18.533 INFO:tasks.workunit.client.0.smithi045.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-10T03:42:18.533 INFO:tasks.workunit.client.0.smithi045.stderr:state without impacting any branches by switching back to a branch. 2024-05-10T03:42:18.533 INFO:tasks.workunit.client.0.smithi045.stderr: 2024-05-10T03:42:18.533 INFO:tasks.workunit.client.0.smithi045.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-10T03:42:18.533 INFO:tasks.workunit.client.0.smithi045.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-10T03:42:18.533 INFO:tasks.workunit.client.0.smithi045.stderr: 2024-05-10T03:42:18.533 INFO:tasks.workunit.client.0.smithi045.stderr: git switch -c 2024-05-10T03:42:18.533 INFO:tasks.workunit.client.0.smithi045.stderr: 2024-05-10T03:42:18.533 INFO:tasks.workunit.client.0.smithi045.stderr:Or undo this operation with: 2024-05-10T03:42:18.533 INFO:tasks.workunit.client.0.smithi045.stderr: 2024-05-10T03:42:18.533 INFO:tasks.workunit.client.0.smithi045.stderr: git switch - 2024-05-10T03:42:18.533 INFO:tasks.workunit.client.0.smithi045.stderr: 2024-05-10T03:42:18.534 INFO:tasks.workunit.client.0.smithi045.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-10T03:42:18.534 INFO:tasks.workunit.client.0.smithi045.stderr: 2024-05-10T03:42:18.534 INFO:tasks.workunit.client.0.smithi045.stderr:HEAD is now at 50174015a7e Merge PR #57343 into wip-pdonnell-testing-20240509.171335-reef-debug 2024-05-10T03:42:18.539 DEBUG:teuthology.orchestra.run.smithi045:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-10T03:42:18.568 INFO:tasks.workunit.client.0.smithi045.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-10T03:42:18.571 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-10T03:42:18.571 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-10T03:42:19.042 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-10T03:42:19.107 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-10T03:42:19.150 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-10T03:42:19.152 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-10T03:42:19.152 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-10T03:42:19.193 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-10T03:42:19.197 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-10T03:42:19.197 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-10T03:42:19.257 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-05-10T03:42:19.259 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-05-10T03:42:19.259 DEBUG:teuthology.orchestra.run.smithi045:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=50174015a7e79f951b988949abe236791f52d4da TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-05-10T03:42:19.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:19 smithi106 ceph-mon[46996]: pgmap v346: 129 pgs: 129 active+clean; 675 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-10T03:42:19.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:19 smithi154 ceph-mon[46565]: pgmap v346: 129 pgs: 129 active+clean; 675 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-10T03:42:19.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:19 smithi045 ceph-mon[42520]: pgmap v346: 129 pgs: 129 active+clean; 675 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-10T03:42:20.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:20 smithi106 ceph-mon[46996]: pgmap v347: 129 pgs: 129 active+clean; 687 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-05-10T03:42:20.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:20 smithi154 ceph-mon[46565]: pgmap v347: 129 pgs: 129 active+clean; 687 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-05-10T03:42:20.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:20 smithi045 ceph-mon[42520]: pgmap v347: 129 pgs: 129 active+clean; 687 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-05-10T03:42:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.981+0000 7f30e12c6700 1 -- 172.21.15.45:0/2076508871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30dc101be0 msgr2=0x7f30dc101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.981+0000 7f30e12c6700 1 --2- 172.21.15.45:0/2076508871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30dc101be0 0x7f30dc101ff0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f30d0009990 tx=0x7f30d0009ca0 comp rx=0 tx=0).stop 2024-05-10T03:42:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.981+0000 7f30e12c6700 1 -- 172.21.15.45:0/2076508871 shutdown_connections 2024-05-10T03:42:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.981+0000 7f30e12c6700 1 --2- 172.21.15.45:0/2076508871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30dc100ac0 0x7f30dc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.981+0000 7f30e12c6700 1 --2- 172.21.15.45:0/2076508871 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30dc102580 0x7f30dc108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.981+0000 7f30e12c6700 1 --2- 172.21.15.45:0/2076508871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30dc101be0 0x7f30dc101ff0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.981+0000 7f30e12c6700 1 -- 172.21.15.45:0/2076508871 >> 172.21.15.45:0/2076508871 conn(0x7f30dc0fc0f0 msgr2=0x7f30dc0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.981+0000 7f30e12c6700 1 -- 172.21.15.45:0/2076508871 shutdown_connections 2024-05-10T03:42:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.981+0000 7f30e12c6700 1 -- 172.21.15.45:0/2076508871 wait complete. 2024-05-10T03:42:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.982+0000 7f30e12c6700 1 Processor -- start 2024-05-10T03:42:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.982+0000 7f30e12c6700 1 -- start start 2024-05-10T03:42:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.982+0000 7f30e12c6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30dc100ac0 0x7f30dc1980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.982+0000 7f30e12c6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30dc101be0 0x7f30dc198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.982+0000 7f30e12c6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30dc102580 0x7f30dc19f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.982+0000 7f30e12c6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc19fb80 con 0x7f30dc100ac0 2024-05-10T03:42:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.982+0000 7f30e12c6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc19fcc0 con 0x7f30dc101be0 2024-05-10T03:42:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.982+0000 7f30e12c6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc19fe50 con 0x7f30dc102580 2024-05-10T03:42:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.983+0000 7f30daffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30dc100ac0 0x7f30dc1980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.983+0000 7f30daffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30dc100ac0 0x7f30dc1980e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33902/0 (socket says 172.21.15.45:33902) 2024-05-10T03:42:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.983+0000 7f30daffd700 1 -- 172.21.15.45:0/2054597397 learned_addr learned my addr 172.21.15.45:0/2054597397 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.983+0000 7f30db7fe700 1 --2- 172.21.15.45:0/2054597397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30dc102580 0x7f30dc19f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.983+0000 7f30da7fc700 1 --2- 172.21.15.45:0/2054597397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30dc101be0 0x7f30dc198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.983+0000 7f30daffd700 1 -- 172.21.15.45:0/2054597397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30dc102580 msgr2=0x7f30dc19f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.983+0000 7f30daffd700 1 --2- 172.21.15.45:0/2054597397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30dc102580 0x7f30dc19f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.983+0000 7f30daffd700 1 -- 172.21.15.45:0/2054597397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30dc101be0 msgr2=0x7f30dc198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.983+0000 7f30daffd700 1 --2- 172.21.15.45:0/2054597397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30dc101be0 0x7f30dc198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.983+0000 7f30daffd700 1 -- 172.21.15.45:0/2054597397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d00095f0 con 0x7f30dc100ac0 2024-05-10T03:42:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.983+0000 7f30da7fc700 1 --2- 172.21.15.45:0/2054597397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30dc101be0 0x7f30dc198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:42:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.983+0000 7f30daffd700 1 --2- 172.21.15.45:0/2054597397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30dc100ac0 0x7f30dc1980e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00d980 tx=0x7f30cc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.983+0000 7f30c3fff700 1 -- 172.21.15.45:0/2054597397 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc004220 con 0x7f30dc100ac0 2024-05-10T03:42:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.983+0000 7f30c3fff700 1 -- 172.21.15.45:0/2054597397 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f30cc004380 con 0x7f30dc100ac0 2024-05-10T03:42:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.983+0000 7f30e12c6700 1 -- 172.21.15.45:0/2054597397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30dc1a0130 con 0x7f30dc100ac0 2024-05-10T03:42:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.983+0000 7f30c3fff700 1 -- 172.21.15.45:0/2054597397 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc003cb0 con 0x7f30dc100ac0 2024-05-10T03:42:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.984+0000 7f30e12c6700 1 -- 172.21.15.45:0/2054597397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30dc1a0640 con 0x7f30dc100ac0 2024-05-10T03:42:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.987+0000 7f30c3fff700 1 -- 172.21.15.45:0/2054597397 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f30cc010460 con 0x7f30dc100ac0 2024-05-10T03:42:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.987+0000 7f30c3fff700 1 --2- 172.21.15.45:0/2054597397 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f30c40a1120 0x7f30c40a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.988+0000 7f30da7fc700 1 --2- 172.21.15.45:0/2054597397 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f30c40a1120 0x7f30c40a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.988+0000 7f30c3fff700 1 -- 172.21.15.45:0/2054597397 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f30cc0cc890 con 0x7f30dc100ac0 2024-05-10T03:42:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.988+0000 7f30f160ab80 1 Processor -- start 2024-05-10T03:42:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.988+0000 7f30f160ab80 1 -- start start 2024-05-10T03:42:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.988+0000 7f30da7fc700 1 --2- 172.21.15.45:0/2054597397 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f30c40a1120 0x7f30c40a3630 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f30d000b5c0 tx=0x7f30d001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.988+0000 7f30f160ab80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96c7f6180 0x55f96c7f65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.988+0000 7f30f160ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f7050 0x55f96c7f7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.988+0000 7f30f160ab80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f96c7f79a0 0x55f96c7fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.988+0000 7f30f160ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f96c71d0f0 con 0x55f96c7f7050 2024-05-10T03:42:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.988+0000 7f30f160ab80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f96c71aab0 con 0x55f96c7f6180 2024-05-10T03:42:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.988+0000 7f30f160ab80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f96c7163a0 con 0x55f96c7f79a0 2024-05-10T03:42:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.989+0000 7f30da7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f7050 0x55f96c7f7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.989+0000 7f30da7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f7050 0x55f96c7f7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33904/0 (socket says 172.21.15.45:33904) 2024-05-10T03:42:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.989+0000 7f30da7fc700 1 -- 172.21.15.45:0/3063859544 learned_addr learned my addr 172.21.15.45:0/3063859544 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.989+0000 7f30daffd700 1 --2- 172.21.15.45:0/3063859544 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96c7f6180 0x55f96c7f65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.989+0000 7f30db7fe700 1 --2- 172.21.15.45:0/3063859544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f96c7f79a0 0x55f96c7fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.989+0000 7f30da7fc700 1 -- 172.21.15.45:0/3063859544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f96c7f79a0 msgr2=0x55f96c7fe2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.989+0000 7f30da7fc700 1 --2- 172.21.15.45:0/3063859544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f96c7f79a0 0x55f96c7fe2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.989+0000 7f30da7fc700 1 -- 172.21.15.45:0/3063859544 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96c7f6180 msgr2=0x55f96c7f65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.989+0000 7f30da7fc700 1 --2- 172.21.15.45:0/3063859544 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96c7f6180 0x55f96c7f65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.989+0000 7f30da7fc700 1 -- 172.21.15.45:0/3063859544 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f96c597350 con 0x55f96c7f7050 2024-05-10T03:42:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.989+0000 7f30da7fc700 1 --2- 172.21.15.45:0/3063859544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f7050 0x55f96c7f7460 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f30d0005f50 tx=0x7f30d001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba381f988c66f7c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.989+0000 7f30c17fa700 1 -- 172.21.15.45:0/3063859544 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d002a070 con 0x55f96c7f7050 2024-05-10T03:42:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.989+0000 7f30c17fa700 1 -- 172.21.15.45:0/3063859544 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f30d000f840 con 0x55f96c7f7050 2024-05-10T03:42:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.989+0000 7f30c17fa700 1 -- 172.21.15.45:0/3063859544 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d001d040 con 0x55f96c7f7050 2024-05-10T03:42:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.990+0000 7f30f160ab80 1 -- 172.21.15.45:0/3063859544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f7050 msgr2=0x55f96c7f7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.990+0000 7f30f160ab80 1 --2- 172.21.15.45:0/3063859544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f7050 0x55f96c7f7460 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f30d0005f50 tx=0x7f30d001e000 comp rx=0 tx=0).stop 2024-05-10T03:42:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.990+0000 7f30f160ab80 1 -- 172.21.15.45:0/3063859544 shutdown_connections 2024-05-10T03:42:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.990+0000 7f30f160ab80 1 --2- 172.21.15.45:0/3063859544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f96c7f79a0 0x55f96c7fe2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.990+0000 7f30f160ab80 1 --2- 172.21.15.45:0/3063859544 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96c7f6180 0x55f96c7f65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.990+0000 7f30f160ab80 1 --2- 172.21.15.45:0/3063859544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f7050 0x55f96c7f7460 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.990+0000 7f30f160ab80 1 -- 172.21.15.45:0/3063859544 >> 172.21.15.45:0/3063859544 conn(0x55f96c758a00 msgr2=0x55f96c7f0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.990+0000 7f30f160ab80 1 -- 172.21.15.45:0/3063859544 shutdown_connections 2024-05-10T03:42:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.990+0000 7f30f160ab80 1 -- 172.21.15.45:0/3063859544 wait complete. 2024-05-10T03:42:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.991+0000 7f30f160ab80 1 -- start start 2024-05-10T03:42:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.991+0000 7f30f160ab80 1 Processor -- start 2024-05-10T03:42:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.991+0000 7f30f160ab80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96c7f6180 0x55f96c800140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.991+0000 7f30f160ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f7050 0x55f96c800680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.991+0000 7f30f160ab80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f96c7f79a0 0x55f96c8075e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.991+0000 7f30f160ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f96c6b2500 con 0x55f96c7f7050 2024-05-10T03:42:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.991+0000 7f30f160ab80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f96c6b21a0 con 0x55f96c7f6180 2024-05-10T03:42:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.991+0000 7f30f160ab80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f96c599640 con 0x55f96c7f79a0 2024-05-10T03:42:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.991+0000 7f30f160ab80 10 client.0 _ll_register_callbacks cb 0x55f96c6bbad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.991+0000 7f30da7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f7050 0x55f96c800680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.991+0000 7f30da7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f7050 0x55f96c800680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33908/0 (socket says 172.21.15.45:33908) 2024-05-10T03:42:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.991+0000 7f30da7fc700 1 -- 172.21.15.45:0/2943804204 learned_addr learned my addr 172.21.15.45:0/2943804204 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.991+0000 7f30daffd700 1 --2- 172.21.15.45:0/2943804204 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96c7f6180 0x55f96c800140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.992+0000 7f30db7fe700 1 --2- 172.21.15.45:0/2943804204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f96c7f79a0 0x55f96c8075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.992+0000 7f30da7fc700 1 -- 172.21.15.45:0/2943804204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f96c7f79a0 msgr2=0x55f96c8075e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.992+0000 7f30da7fc700 1 --2- 172.21.15.45:0/2943804204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f96c7f79a0 0x55f96c8075e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.992+0000 7f30da7fc700 1 -- 172.21.15.45:0/2943804204 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96c7f6180 msgr2=0x55f96c800140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.992+0000 7f30da7fc700 1 --2- 172.21.15.45:0/2943804204 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96c7f6180 0x55f96c800140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.992+0000 7f30da7fc700 1 -- 172.21.15.45:0/2943804204 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30dc1098c0 con 0x55f96c7f7050 2024-05-10T03:42:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.992+0000 7f30db7fe700 1 --2- 172.21.15.45:0/2943804204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f96c7f79a0 0x55f96c8075e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:42:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.992+0000 7f30daffd700 1 --2- 172.21.15.45:0/2943804204 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96c7f6180 0x55f96c800140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.992+0000 7f30da7fc700 1 --2- 172.21.15.45:0/2943804204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f7050 0x55f96c800680 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f30d0003fd0 tx=0x7f30d000fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb353713f89488b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.992+0000 7f30beff5700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:42:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.992+0000 7f30beff5700 1 -- 172.21.15.45:0/2943804204 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d002a030 con 0x55f96c7f7050 2024-05-10T03:42:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.992+0000 7f30beff5700 1 -- 172.21.15.45:0/2943804204 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f30d0005460 con 0x55f96c7f7050 2024-05-10T03:42:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.992+0000 7f30f160ab80 1 -- 172.21.15.45:0/2943804204 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f96c66f210 con 0x55f96c7f7050 2024-05-10T03:42:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.993+0000 7f30beff5700 1 -- 172.21.15.45:0/2943804204 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30d0005620 con 0x55f96c7f7050 2024-05-10T03:42:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.993+0000 7f30f160ab80 10 client.16284 fetch_fsmap learned FSMap version 28 2024-05-10T03:42:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.993+0000 7f30f160ab80 1 -- 172.21.15.45:0/2943804204 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55f96c543b00 con 0x55f96c7f7050 2024-05-10T03:42:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.993+0000 7f30beff5700 1 -- 172.21.15.45:0/2943804204 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55f96c66f210 con 0x55f96c7f7050 2024-05-10T03:42:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.993+0000 7f30beff5700 1 -- 172.21.15.45:0/2943804204 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f30d0023400 con 0x55f96c7f7050 2024-05-10T03:42:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.993+0000 7f30f160ab80 10 client.16284 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:42:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.993+0000 7f30f160ab80 10 client.16284 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:42:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.993+0000 7f30f160ab80 20 client.16284 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.993+0000 7f30f160ab80 1 --2- 172.21.15.45:0/2943804204 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f96c80b8e0 0x55f96c80dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.993+0000 7f30f160ab80 4 client.16284 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:42:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.993+0000 7f30f160ab80 1 -- 172.21.15.45:0/2943804204 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f96c7c5720 con 0x55f96c80b8e0 2024-05-10T03:42:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.993+0000 7f30daffd700 1 --2- 172.21.15.45:0/2943804204 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f96c80b8e0 0x55f96c80dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.994+0000 7f30beff5700 10 client.16284 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.994+0000 7f30daffd700 1 --2- 172.21.15.45:0/2943804204 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f96c80b8e0 0x55f96c80dd00 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e2e0b94693d0918 server_cookie=5d7917217bd83aa9 in_seq=0 out_seq=0 2024-05-10T03:42:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.995+0000 7f30beff5700 1 -- 172.21.15.45:0/2943804204 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f96c7c5720 con 0x55f96c80b8e0 2024-05-10T03:42:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.995+0000 7f30beff5700 10 client.16284 handle_command_reply: tid=0 2024-05-10T03:42:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.995+0000 7f30f160ab80 1 client.16284 shutdown 2024-05-10T03:42:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.995+0000 7f30f160ab80 1 -- 172.21.15.45:0/2943804204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f7050 msgr2=0x55f96c800680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.995+0000 7f30f160ab80 1 --2- 172.21.15.45:0/2943804204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f7050 0x55f96c800680 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f30d0003fd0 tx=0x7f30d000fc30 comp rx=0 tx=0).stop 2024-05-10T03:42:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.995+0000 7f30f160ab80 1 -- 172.21.15.45:0/2943804204 shutdown_connections 2024-05-10T03:42:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.995+0000 7f30f160ab80 1 --2- 172.21.15.45:0/2943804204 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f96c80b8e0 0x55f96c80dd00 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.995+0000 7f30f160ab80 1 --2- 172.21.15.45:0/2943804204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f96c7f79a0 0x55f96c8075e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.995+0000 7f30beff5700 0 client.16284 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.995+0000 7f30f160ab80 1 --2- 172.21.15.45:0/2943804204 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96c7f6180 0x55f96c800140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.995+0000 7f30f160ab80 1 --2- 172.21.15.45:0/2943804204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f7050 0x55f96c800680 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.995+0000 7f30f160ab80 1 -- 172.21.15.45:0/2943804204 >> 172.21.15.45:0/2943804204 conn(0x55f96c758a00 msgr2=0x55f96c7f0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.995+0000 7f30f160ab80 1 -- 172.21.15.45:0/2943804204 shutdown_connections 2024-05-10T03:42:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.995+0000 7f30f160ab80 1 -- 172.21.15.45:0/2943804204 wait complete. 2024-05-10T03:42:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:21.995+0000 7f30f160ab80 20 client.16284 trim_cache size 0 max 16384 2024-05-10T03:42:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.015+0000 7f30f160ab80 1 Processor -- start 2024-05-10T03:42:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.015+0000 7f30f160ab80 1 -- start start 2024-05-10T03:42:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.015+0000 7f30f160ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f6180 0x55f96c807bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.015+0000 7f30f160ab80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96c7f7050 0x55f96c7f67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.015+0000 7f30f160ab80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f96c7f79a0 0x55f96c7ff720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.015+0000 7f30f160ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f96c807990 con 0x55f96c7f6180 2024-05-10T03:42:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.015+0000 7f30f160ab80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f96c7fe250 con 0x55f96c7f7050 2024-05-10T03:42:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.015+0000 7f30f160ab80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f96c7fbb20 con 0x55f96c7f79a0 2024-05-10T03:42:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.015+0000 7f30daffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f6180 0x55f96c807bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.015+0000 7f30daffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f6180 0x55f96c807bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33910/0 (socket says 172.21.15.45:33910) 2024-05-10T03:42:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.015+0000 7f30daffd700 1 -- 172.21.15.45:0/996515768 learned_addr learned my addr 172.21.15.45:0/996515768 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.016+0000 7f30da7fc700 1 --2- 172.21.15.45:0/996515768 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96c7f7050 0x55f96c7f67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.016+0000 7f30db7fe700 1 --2- 172.21.15.45:0/996515768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f96c7f79a0 0x55f96c7ff720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:22.021 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.016+0000 7f30daffd700 1 -- 172.21.15.45:0/996515768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f96c7f79a0 msgr2=0x55f96c7ff720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:22.021 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.016+0000 7f30daffd700 1 --2- 172.21.15.45:0/996515768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f96c7f79a0 0x55f96c7ff720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:22.021 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.016+0000 7f30daffd700 1 -- 172.21.15.45:0/996515768 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96c7f7050 msgr2=0x55f96c7f67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:22.021 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.016+0000 7f30daffd700 1 --2- 172.21.15.45:0/996515768 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96c7f7050 0x55f96c7f67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:22.021 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.016+0000 7f30daffd700 1 -- 172.21.15.45:0/996515768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f96c6dc500 con 0x55f96c7f6180 2024-05-10T03:42:22.021 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.016+0000 7f30daffd700 1 --2- 172.21.15.45:0/996515768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f6180 0x55f96c807bc0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0c9ff0 tx=0x7f30cc0b9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b177cd439aada33d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:22.021 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.016+0000 7f30c1ffb700 1 -- 172.21.15.45:0/996515768 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc0a1dc0 con 0x55f96c7f6180 2024-05-10T03:42:22.021 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.016+0000 7f30c1ffb700 1 -- 172.21.15.45:0/996515768 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f30cc003e10 con 0x55f96c7f6180 2024-05-10T03:42:22.021 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.016+0000 7f30c1ffb700 1 -- 172.21.15.45:0/996515768 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc099e00 con 0x55f96c7f6180 2024-05-10T03:42:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.017+0000 7f30f160ab80 1 -- 172.21.15.45:0/996515768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f6180 msgr2=0x55f96c807bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.017+0000 7f30f160ab80 1 --2- 172.21.15.45:0/996515768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f6180 0x55f96c807bc0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0c9ff0 tx=0x7f30cc0b9040 comp rx=0 tx=0).stop 2024-05-10T03:42:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.017+0000 7f30f160ab80 1 -- 172.21.15.45:0/996515768 shutdown_connections 2024-05-10T03:42:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.017+0000 7f30f160ab80 1 --2- 172.21.15.45:0/996515768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f96c7f79a0 0x55f96c7ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.017+0000 7f30f160ab80 1 --2- 172.21.15.45:0/996515768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f6180 0x55f96c807bc0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.017+0000 7f30f160ab80 1 --2- 172.21.15.45:0/996515768 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96c7f7050 0x55f96c7f67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.017+0000 7f30f160ab80 1 -- 172.21.15.45:0/996515768 >> 172.21.15.45:0/996515768 conn(0x55f96c758a00 msgr2=0x55f96c7f0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.017+0000 7f30f160ab80 1 -- 172.21.15.45:0/996515768 shutdown_connections 2024-05-10T03:42:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.017+0000 7f30f160ab80 1 -- 172.21.15.45:0/996515768 wait complete. 2024-05-10T03:42:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.018+0000 7f30f160ab80 1 -- start start 2024-05-10T03:42:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.018+0000 7f30f160ab80 1 Processor -- start 2024-05-10T03:42:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.018+0000 7f30f160ab80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96c7f6180 0x55f96c85cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.018+0000 7f30f160ab80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f96c7f7050 0x55f96c85d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.018+0000 7f30f160ab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f79a0 0x55f96c8640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.018+0000 7f30f160ab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f96c864620 con 0x55f96c7f79a0 2024-05-10T03:42:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.018+0000 7f30f160ab80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f96c864760 con 0x55f96c7f6180 2024-05-10T03:42:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.018+0000 7f30f160ab80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f96c8648f0 con 0x55f96c7f7050 2024-05-10T03:42:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.018+0000 7f30f160ab80 10 client.0 _ll_register_callbacks cb 0x55f96c6bbad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.018+0000 7f30db7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f79a0 0x55f96c8640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.018+0000 7f30db7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f79a0 0x55f96c8640e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33922/0 (socket says 172.21.15.45:33922) 2024-05-10T03:42:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.018+0000 7f30db7fe700 1 -- 172.21.15.45:0/2473091743 learned_addr learned my addr 172.21.15.45:0/2473091743 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.018+0000 7f30daffd700 1 --2- 172.21.15.45:0/2473091743 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96c7f6180 0x55f96c85cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.018+0000 7f30da7fc700 1 --2- 172.21.15.45:0/2473091743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f96c7f7050 0x55f96c85d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.018+0000 7f30db7fe700 1 -- 172.21.15.45:0/2473091743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f96c7f7050 msgr2=0x55f96c85d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.018+0000 7f30db7fe700 1 --2- 172.21.15.45:0/2473091743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f96c7f7050 0x55f96c85d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.019+0000 7f30db7fe700 1 -- 172.21.15.45:0/2473091743 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96c7f6180 msgr2=0x55f96c85cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.019+0000 7f30db7fe700 1 --2- 172.21.15.45:0/2473091743 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96c7f6180 0x55f96c85cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.019+0000 7f30db7fe700 1 -- 172.21.15.45:0/2473091743 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30dc1a0640 con 0x55f96c7f79a0 2024-05-10T03:42:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.019+0000 7f30db7fe700 1 --2- 172.21.15.45:0/2473091743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f79a0 0x55f96c8640e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f30d4007d00 tx=0x7f30d4007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3308711c1285843 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.019+0000 7f30beff5700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:42:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.019+0000 7f30beff5700 1 -- 172.21.15.45:0/2473091743 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d4017a80 con 0x55f96c7f79a0 2024-05-10T03:42:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.019+0000 7f30beff5700 1 -- 172.21.15.45:0/2473091743 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f30d4017be0 con 0x55f96c7f79a0 2024-05-10T03:42:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.019+0000 7f30f160ab80 1 -- 172.21.15.45:0/2473091743 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f30d000f840 con 0x55f96c7f79a0 2024-05-10T03:42:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.019+0000 7f30beff5700 1 -- 172.21.15.45:0/2473091743 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30d4017da0 con 0x55f96c7f79a0 2024-05-10T03:42:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.019+0000 7f30f160ab80 10 client.16290 fetch_fsmap learned FSMap version 28 2024-05-10T03:42:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.019+0000 7f30f160ab80 1 -- 172.21.15.45:0/2473091743 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55f96c59bc70 con 0x55f96c7f79a0 2024-05-10T03:42:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.019+0000 7f30beff5700 1 -- 172.21.15.45:0/2473091743 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f30d000f840 con 0x55f96c7f79a0 2024-05-10T03:42:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.020+0000 7f30beff5700 1 -- 172.21.15.45:0/2473091743 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f30d40185c0 con 0x55f96c7f79a0 2024-05-10T03:42:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.020+0000 7f30f160ab80 10 client.16290 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T03:42:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.020+0000 7f30f160ab80 10 client.16290 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:42:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.020+0000 7f30f160ab80 20 client.16290 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.020+0000 7f30f160ab80 1 --2- 172.21.15.45:0/2473091743 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f96c8663b0 0x55f96c8687d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.020+0000 7f30f160ab80 4 client.16290 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T03:42:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.020+0000 7f30f160ab80 1 -- 172.21.15.45:0/2473091743 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f96c70ee60 con 0x55f96c8663b0 2024-05-10T03:42:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.020+0000 7f30daffd700 1 --2- 172.21.15.45:0/2473091743 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f96c8663b0 0x55f96c8687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.021+0000 7f30daffd700 1 --2- 172.21.15.45:0/2473091743 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f96c8663b0 0x55f96c8687d0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80ae0e7b43bb7017 server_cookie=3831e9c949106db0 in_seq=0 out_seq=0 2024-05-10T03:42:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.021+0000 7f30beff5700 10 client.16290 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:22.034 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.030+0000 7f30beff5700 1 -- 172.21.15.45:0/2473091743 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f96c70ee60 con 0x55f96c8663b0 2024-05-10T03:42:22.034 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.030+0000 7f30beff5700 10 client.16290 handle_command_reply: tid=0 2024-05-10T03:42:22.034 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.030+0000 7f30f160ab80 1 client.16290 shutdown 2024-05-10T03:42:22.034 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.030+0000 7f30f160ab80 1 -- 172.21.15.45:0/2473091743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f79a0 msgr2=0x55f96c8640e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:22.034 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.030+0000 7f30f160ab80 1 --2- 172.21.15.45:0/2473091743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f79a0 0x55f96c8640e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f30d4007d00 tx=0x7f30d4007de0 comp rx=0 tx=0).stop 2024-05-10T03:42:22.034 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.030+0000 7f30f160ab80 1 -- 172.21.15.45:0/2473091743 shutdown_connections 2024-05-10T03:42:22.034 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.030+0000 7f30f160ab80 1 --2- 172.21.15.45:0/2473091743 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f96c8663b0 0x55f96c8687d0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.030+0000 7f30f160ab80 1 --2- 172.21.15.45:0/2473091743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f96c7f79a0 0x55f96c8640e0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.030+0000 7f30f160ab80 1 --2- 172.21.15.45:0/2473091743 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96c7f6180 0x55f96c85cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.030+0000 7f30beff5700 0 client.16290 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.030+0000 7f30f160ab80 1 --2- 172.21.15.45:0/2473091743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f96c7f7050 0x55f96c85d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.030+0000 7f30f160ab80 1 -- 172.21.15.45:0/2473091743 >> 172.21.15.45:0/2473091743 conn(0x55f96c758a00 msgr2=0x55f96c7faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.030+0000 7f30f160ab80 1 -- 172.21.15.45:0/2473091743 shutdown_connections 2024-05-10T03:42:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.030+0000 7f30f160ab80 1 -- 172.21.15.45:0/2473091743 wait complete. 2024-05-10T03:42:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.031+0000 7f30f160ab80 20 client.16290 trim_cache size 0 max 16384 2024-05-10T03:42:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:{ 2024-05-10T03:42:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "message": "", 2024-05-10T03:42:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "return_code": 0 2024-05-10T03:42:22.036 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:} 2024-05-10T03:42:22.036 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.031+0000 7f30e12c6700 1 -- 172.21.15.45:0/2054597397 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f30c40a1120 msgr2=0x7f30c40a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:22.036 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.031+0000 7f30e12c6700 1 --2- 172.21.15.45:0/2054597397 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f30c40a1120 0x7f30c40a3630 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f30d000b5c0 tx=0x7f30d001a040 comp rx=0 tx=0).stop 2024-05-10T03:42:22.036 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.031+0000 7f30e12c6700 1 -- 172.21.15.45:0/2054597397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30dc100ac0 msgr2=0x7f30dc1980e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:22.036 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.031+0000 7f30e12c6700 1 --2- 172.21.15.45:0/2054597397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30dc100ac0 0x7f30dc1980e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00d980 tx=0x7f30cc00dc90 comp rx=0 tx=0).stop 2024-05-10T03:42:22.037 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.031+0000 7f30e12c6700 1 -- 172.21.15.45:0/2054597397 shutdown_connections 2024-05-10T03:42:22.037 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.031+0000 7f30e12c6700 1 --2- 172.21.15.45:0/2054597397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30dc102580 0x7f30dc19f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:22.037 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.031+0000 7f30e12c6700 1 --2- 172.21.15.45:0/2054597397 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f30c40a1120 0x7f30c40a3630 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:22.037 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.031+0000 7f30e12c6700 1 --2- 172.21.15.45:0/2054597397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30dc100ac0 0x7f30dc1980e0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:22.037 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.031+0000 7f30e12c6700 1 --2- 172.21.15.45:0/2054597397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30dc101be0 0x7f30dc198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:22.037 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.031+0000 7f30e12c6700 1 -- 172.21.15.45:0/2054597397 >> 172.21.15.45:0/2054597397 conn(0x7f30dc0fc0f0 msgr2=0x7f30dc0fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:22.037 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.031+0000 7f30e12c6700 1 -- 172.21.15.45:0/2054597397 shutdown_connections 2024-05-10T03:42:22.037 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:22.031+0000 7f30e12c6700 1 -- 172.21.15.45:0/2054597397 wait complete. 2024-05-10T03:42:22.538 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ 2024-05-10T03:42:22.540 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/00-INDEX 2024-05-10T03:42:22.541 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/ 2024-05-10T03:42:22.542 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/README 2024-05-10T03:42:22.543 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-05-10T03:42:22.544 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-05-10T03:42:22.546 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-05-10T03:42:22.546 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-05-10T03:42:22.547 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-05-10T03:42:22.548 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-05-10T03:42:22.549 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-05-10T03:42:22.550 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-05-10T03:42:22.551 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-05-10T03:42:22.553 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-05-10T03:42:22.553 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-05-10T03:42:22.554 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-05-10T03:42:22.555 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-05-10T03:42:22.556 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-05-10T03:42:22.557 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-05-10T03:42:22.558 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-05-10T03:42:22.560 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-05-10T03:42:22.561 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-05-10T03:42:22.562 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-05-10T03:42:22.563 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-05-10T03:42:22.564 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-05-10T03:42:22.565 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-05-10T03:42:22.566 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-05-10T03:42:22.567 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-05-10T03:42:22.568 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-05-10T03:42:22.569 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-05-10T03:42:22.570 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-05-10T03:42:22.571 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-05-10T03:42:22.571 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-05-10T03:42:22.572 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-05-10T03:42:22.573 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-05-10T03:42:22.574 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-05-10T03:42:22.575 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-05-10T03:42:22.576 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-05-10T03:42:22.577 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-05-10T03:42:22.578 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-05-10T03:42:22.579 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-05-10T03:42:22.580 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-05-10T03:42:22.581 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-05-10T03:42:22.582 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-05-10T03:42:22.582 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-05-10T03:42:22.583 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-05-10T03:42:22.584 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-05-10T03:42:22.585 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-05-10T03:42:22.587 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-05-10T03:42:22.588 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-05-10T03:42:22.589 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-05-10T03:42:22.590 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-05-10T03:42:22.591 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-05-10T03:42:22.592 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-05-10T03:42:22.593 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-05-10T03:42:22.593 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-05-10T03:42:22.594 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-05-10T03:42:22.595 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-05-10T03:42:22.597 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-05-10T03:42:22.597 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-05-10T03:42:22.598 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-05-10T03:42:22.599 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-05-10T03:42:22.600 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-05-10T03:42:22.601 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-05-10T03:42:22.602 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-05-10T03:42:22.603 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-05-10T03:42:22.604 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-05-10T03:42:22.605 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-05-10T03:42:22.606 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-05-10T03:42:22.607 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-05-10T03:42:22.608 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-05-10T03:42:22.609 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-05-10T03:42:22.610 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-05-10T03:42:22.611 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-05-10T03:42:22.612 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-05-10T03:42:22.612 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-05-10T03:42:22.613 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-05-10T03:42:22.614 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-05-10T03:42:22.615 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-05-10T03:42:22.616 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-05-10T03:42:22.618 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-05-10T03:42:22.619 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-05-10T03:42:22.620 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-05-10T03:42:22.621 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-05-10T03:42:22.622 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-05-10T03:42:22.623 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-05-10T03:42:22.624 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-05-10T03:42:22.625 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-05-10T03:42:22.626 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-05-10T03:42:22.627 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-05-10T03:42:22.627 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-05-10T03:42:22.628 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-05-10T03:42:22.629 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-05-10T03:42:22.630 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-05-10T03:42:22.631 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-05-10T03:42:22.632 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-05-10T03:42:22.633 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-05-10T03:42:22.634 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-05-10T03:42:22.635 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-05-10T03:42:22.636 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-05-10T03:42:22.637 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-05-10T03:42:22.637 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-05-10T03:42:22.638 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-05-10T03:42:22.639 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-05-10T03:42:22.640 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-05-10T03:42:22.641 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-05-10T03:42:22.642 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-05-10T03:42:22.643 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-05-10T03:42:22.644 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-05-10T03:42:22.645 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-05-10T03:42:22.646 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-05-10T03:42:22.647 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-05-10T03:42:22.648 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-05-10T03:42:22.649 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-05-10T03:42:22.650 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-05-10T03:42:22.651 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-05-10T03:42:22.651 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-05-10T03:42:22.652 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-05-10T03:42:22.653 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-05-10T03:42:22.654 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-05-10T03:42:22.655 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-05-10T03:42:22.656 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-05-10T03:42:22.656 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-05-10T03:42:22.657 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-05-10T03:42:22.658 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-05-10T03:42:22.659 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-05-10T03:42:22.660 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-05-10T03:42:22.661 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-05-10T03:42:22.662 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-05-10T03:42:22.663 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-05-10T03:42:22.664 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-05-10T03:42:22.665 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-05-10T03:42:22.665 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-05-10T03:42:22.666 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-05-10T03:42:22.667 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-05-10T03:42:22.668 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-05-10T03:42:22.670 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-05-10T03:42:22.670 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-05-10T03:42:22.671 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-05-10T03:42:22.672 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-05-10T03:42:22.673 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-05-10T03:42:22.674 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-05-10T03:42:22.674 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-05-10T03:42:22.676 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-05-10T03:42:22.677 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-05-10T03:42:22.678 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-05-10T03:42:22.679 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-05-10T03:42:22.680 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-05-10T03:42:22.681 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-05-10T03:42:22.682 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-05-10T03:42:22.683 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-05-10T03:42:22.685 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-05-10T03:42:22.686 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-05-10T03:42:22.687 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-05-10T03:42:22.688 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-05-10T03:42:22.689 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-05-10T03:42:22.690 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-05-10T03:42:22.691 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-05-10T03:42:22.693 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-05-10T03:42:22.694 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-05-10T03:42:22.695 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-05-10T03:42:22.696 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-05-10T03:42:22.697 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-05-10T03:42:22.698 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-05-10T03:42:22.699 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-05-10T03:42:22.700 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-05-10T03:42:22.702 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-05-10T03:42:22.703 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-05-10T03:42:22.704 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-05-10T03:42:22.705 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-05-10T03:42:22.706 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-05-10T03:42:22.708 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-05-10T03:42:22.709 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-05-10T03:42:22.710 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-05-10T03:42:22.711 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-05-10T03:42:22.712 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-05-10T03:42:22.713 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-05-10T03:42:22.714 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-05-10T03:42:22.715 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-05-10T03:42:22.717 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-05-10T03:42:22.718 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-05-10T03:42:22.719 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-05-10T03:42:22.720 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-05-10T03:42:22.721 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-05-10T03:42:22.722 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-05-10T03:42:22.723 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-05-10T03:42:22.725 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-05-10T03:42:22.726 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-05-10T03:42:22.727 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-05-10T03:42:22.728 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-05-10T03:42:22.729 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-05-10T03:42:22.730 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-05-10T03:42:22.731 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-05-10T03:42:22.732 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-05-10T03:42:22.734 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-05-10T03:42:22.735 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-05-10T03:42:22.736 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-05-10T03:42:22.737 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-05-10T03:42:22.738 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-05-10T03:42:23.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:23 smithi045 ceph-mon[42520]: pgmap v348: 129 pgs: 129 active+clean; 687 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-05-10T03:42:23.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:23 smithi106 ceph-mon[46996]: pgmap v348: 129 pgs: 129 active+clean; 687 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-05-10T03:42:23.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:23 smithi154 ceph-mon[46565]: pgmap v348: 129 pgs: 129 active+clean; 687 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-05-10T03:42:24.802 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-05-10T03:42:24.804 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-05-10T03:42:24.805 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-05-10T03:42:24.806 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-05-10T03:42:24.807 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-05-10T03:42:24.808 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-05-10T03:42:24.809 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-05-10T03:42:24.810 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-05-10T03:42:24.811 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-05-10T03:42:24.812 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-05-10T03:42:24.813 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-05-10T03:42:24.814 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-05-10T03:42:24.815 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-05-10T03:42:24.816 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-05-10T03:42:24.816 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-05-10T03:42:24.817 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-05-10T03:42:24.818 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-05-10T03:42:24.819 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-05-10T03:42:24.820 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-05-10T03:42:24.821 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-05-10T03:42:24.822 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-05-10T03:42:24.823 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-05-10T03:42:24.824 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-05-10T03:42:24.825 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-05-10T03:42:24.825 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-05-10T03:42:24.826 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-05-10T03:42:24.827 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-05-10T03:42:24.828 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-05-10T03:42:24.829 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-05-10T03:42:24.830 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-05-10T03:42:24.831 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-05-10T03:42:24.832 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-05-10T03:42:24.832 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-05-10T03:42:24.833 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-05-10T03:42:24.834 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-05-10T03:42:24.835 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-05-10T03:42:24.836 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-05-10T03:42:24.836 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-05-10T03:42:24.837 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-05-10T03:42:24.838 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-05-10T03:42:24.840 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-05-10T03:42:24.841 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-05-10T03:42:24.842 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-05-10T03:42:24.843 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-05-10T03:42:24.843 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-05-10T03:42:24.844 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-05-10T03:42:24.845 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-05-10T03:42:24.846 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-05-10T03:42:24.848 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-05-10T03:42:24.848 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-05-10T03:42:24.849 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-05-10T03:42:24.850 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-05-10T03:42:24.851 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-05-10T03:42:24.852 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-05-10T03:42:24.853 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-05-10T03:42:24.854 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-05-10T03:42:24.855 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-05-10T03:42:24.855 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-05-10T03:42:24.856 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-05-10T03:42:24.858 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-05-10T03:42:24.859 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-05-10T03:42:24.860 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-05-10T03:42:24.861 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-05-10T03:42:24.862 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/Changes 2024-05-10T03:42:24.863 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-05-10T03:42:24.864 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/CodingStyle 2024-05-10T03:42:24.865 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-05-10T03:42:24.865 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-05-10T03:42:24.866 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-05-10T03:42:24.867 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-05-10T03:42:24.868 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/ 2024-05-10T03:42:24.869 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-05-10T03:42:24.870 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-05-10T03:42:24.871 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-05-10T03:42:24.872 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-05-10T03:42:24.873 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-05-10T03:42:24.874 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-05-10T03:42:24.875 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-05-10T03:42:24.876 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-05-10T03:42:24.876 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-05-10T03:42:24.878 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-05-10T03:42:24.880 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-05-10T03:42:24.880 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-05-10T03:42:24.881 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-05-10T03:42:24.882 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-05-10T03:42:24.883 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-05-10T03:42:24.885 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-05-10T03:42:24.886 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-05-10T03:42:24.886 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-05-10T03:42:24.887 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-05-10T03:42:24.888 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-05-10T03:42:24.889 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-05-10T03:42:24.890 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-05-10T03:42:24.891 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-05-10T03:42:24.892 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-05-10T03:42:24.892 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-05-10T03:42:24.893 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-05-10T03:42:24.894 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-05-10T03:42:24.895 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-05-10T03:42:24.896 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-05-10T03:42:24.897 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-05-10T03:42:24.898 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-05-10T03:42:24.899 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-05-10T03:42:24.899 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-05-10T03:42:24.900 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-05-10T03:42:24.901 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-05-10T03:42:24.902 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-05-10T03:42:24.903 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-05-10T03:42:24.904 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-05-10T03:42:24.905 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-05-10T03:42:24.906 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-05-10T03:42:24.908 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-05-10T03:42:24.909 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-05-10T03:42:24.910 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-05-10T03:42:24.911 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-05-10T03:42:24.911 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-05-10T03:42:24.912 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-05-10T03:42:24.913 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-05-10T03:42:24.914 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-05-10T03:42:24.915 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-05-10T03:42:24.915 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-05-10T03:42:24.916 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-05-10T03:42:24.918 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-05-10T03:42:24.920 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-05-10T03:42:24.921 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-05-10T03:42:24.922 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-05-10T03:42:24.923 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-05-10T03:42:24.923 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-05-10T03:42:24.924 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-05-10T03:42:24.925 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-05-10T03:42:24.925 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-05-10T03:42:24.926 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-05-10T03:42:24.927 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-05-10T03:42:24.928 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-05-10T03:42:24.929 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-05-10T03:42:24.930 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-05-10T03:42:24.930 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-05-10T03:42:24.931 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-05-10T03:42:24.932 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-05-10T03:42:24.933 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-05-10T03:42:24.934 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-05-10T03:42:24.934 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-05-10T03:42:24.935 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-05-10T03:42:24.936 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-05-10T03:42:24.937 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-05-10T03:42:24.937 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-05-10T03:42:24.938 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-05-10T03:42:24.939 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-05-10T03:42:24.940 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-05-10T03:42:24.941 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-05-10T03:42:24.942 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-05-10T03:42:24.942 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-05-10T03:42:24.943 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-05-10T03:42:24.944 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-05-10T03:42:24.945 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-05-10T03:42:24.946 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-05-10T03:42:24.946 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-05-10T03:42:24.947 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-05-10T03:42:24.948 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-05-10T03:42:24.949 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-05-10T03:42:24.950 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-05-10T03:42:24.951 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-05-10T03:42:24.952 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-05-10T03:42:24.953 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-05-10T03:42:24.953 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-05-10T03:42:24.954 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-05-10T03:42:24.955 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-05-10T03:42:24.956 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-05-10T03:42:24.957 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-05-10T03:42:24.957 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-05-10T03:42:24.958 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-05-10T03:42:24.959 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-05-10T03:42:24.960 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-05-10T03:42:24.961 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-05-10T03:42:24.962 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-05-10T03:42:24.963 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-05-10T03:42:24.964 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-05-10T03:42:24.964 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-05-10T03:42:24.965 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-05-10T03:42:24.966 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-05-10T03:42:24.967 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-05-10T03:42:24.968 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-05-10T03:42:24.969 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-05-10T03:42:24.970 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-05-10T03:42:24.971 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-05-10T03:42:24.971 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-05-10T03:42:24.972 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-05-10T03:42:24.973 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-05-10T03:42:24.974 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-05-10T03:42:24.974 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-05-10T03:42:24.975 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-05-10T03:42:24.976 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-05-10T03:42:24.977 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-05-10T03:42:24.978 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-05-10T03:42:24.979 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-05-10T03:42:24.980 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-05-10T03:42:24.981 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-05-10T03:42:24.981 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-05-10T03:42:24.983 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-05-10T03:42:24.984 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-05-10T03:42:24.984 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-05-10T03:42:24.985 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-05-10T03:42:24.986 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-05-10T03:42:24.987 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-05-10T03:42:24.988 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-05-10T03:42:24.988 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-05-10T03:42:24.989 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-05-10T03:42:24.991 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-05-10T03:42:24.991 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-05-10T03:42:24.992 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-05-10T03:42:24.993 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-05-10T03:42:24.994 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-05-10T03:42:24.995 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-05-10T03:42:24.996 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-05-10T03:42:24.997 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-05-10T03:42:24.998 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-05-10T03:42:24.998 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-05-10T03:42:25.000 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-05-10T03:42:25.000 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-05-10T03:42:25.001 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-05-10T03:42:25.002 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-05-10T03:42:25.003 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-05-10T03:42:25.004 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-05-10T03:42:25.004 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-05-10T03:42:25.005 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-05-10T03:42:25.006 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-05-10T03:42:25.007 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-05-10T03:42:25.008 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-05-10T03:42:25.009 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-05-10T03:42:25.010 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-05-10T03:42:25.010 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-05-10T03:42:25.011 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-05-10T03:42:25.012 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-05-10T03:42:25.013 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-05-10T03:42:25.014 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-05-10T03:42:25.014 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-05-10T03:42:25.015 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-05-10T03:42:25.016 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-05-10T03:42:25.016 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-05-10T03:42:25.017 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-05-10T03:42:25.018 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-05-10T03:42:25.019 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-05-10T03:42:25.020 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-05-10T03:42:25.021 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-05-10T03:42:25.023 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-05-10T03:42:25.024 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-05-10T03:42:25.025 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-05-10T03:42:25.026 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-05-10T03:42:25.027 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-05-10T03:42:25.028 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-05-10T03:42:25.029 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-05-10T03:42:25.030 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-05-10T03:42:25.032 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-05-10T03:42:25.033 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-05-10T03:42:25.034 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-05-10T03:42:25.035 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-05-10T03:42:25.036 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-05-10T03:42:25.037 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-05-10T03:42:25.038 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-05-10T03:42:25.039 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-05-10T03:42:25.040 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-05-10T03:42:25.041 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-05-10T03:42:25.042 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-05-10T03:42:25.043 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-05-10T03:42:25.044 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-05-10T03:42:25.045 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-05-10T03:42:25.046 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-05-10T03:42:25.047 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-05-10T03:42:25.049 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-05-10T03:42:25.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:25 smithi045 ceph-mon[42520]: pgmap v349: 129 pgs: 129 active+clean; 687 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-05-10T03:42:25.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:25 smithi106 ceph-mon[46996]: pgmap v349: 129 pgs: 129 active+clean; 687 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-05-10T03:42:25.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:25 smithi154 ceph-mon[46565]: pgmap v349: 129 pgs: 129 active+clean; 687 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-05-10T03:42:25.798 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-05-10T03:42:25.799 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-05-10T03:42:25.800 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-05-10T03:42:25.800 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-05-10T03:42:25.802 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-05-10T03:42:25.802 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-05-10T03:42:25.803 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-05-10T03:42:25.804 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-05-10T03:42:25.805 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-05-10T03:42:25.806 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-05-10T03:42:25.806 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-05-10T03:42:25.807 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-05-10T03:42:25.808 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-05-10T03:42:25.809 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-05-10T03:42:25.809 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-05-10T03:42:25.810 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-05-10T03:42:25.811 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-05-10T03:42:25.812 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-05-10T03:42:25.813 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-05-10T03:42:25.814 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-05-10T03:42:25.815 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-05-10T03:42:25.815 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-05-10T03:42:25.816 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-05-10T03:42:25.817 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-05-10T03:42:25.818 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-05-10T03:42:25.819 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-05-10T03:42:25.820 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-05-10T03:42:25.821 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-05-10T03:42:25.822 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-05-10T03:42:25.823 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-05-10T03:42:25.823 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-05-10T03:42:25.826 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-05-10T03:42:25.827 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-05-10T03:42:25.828 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-05-10T03:42:25.828 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/EDID/ 2024-05-10T03:42:25.831 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-05-10T03:42:25.833 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-05-10T03:42:25.835 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-05-10T03:42:25.836 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-05-10T03:42:25.837 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-05-10T03:42:25.838 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-05-10T03:42:25.839 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-05-10T03:42:25.840 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-05-10T03:42:25.842 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-05-10T03:42:25.843 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/EDID/hex 2024-05-10T03:42:25.844 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/HOWTO 2024-05-10T03:42:25.846 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-05-10T03:42:25.847 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-05-10T03:42:25.848 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-05-10T03:42:25.849 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-05-10T03:42:25.851 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-05-10T03:42:25.852 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/Makefile 2024-05-10T03:42:25.853 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-05-10T03:42:25.854 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/PCI/ 2024-05-10T03:42:25.857 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-05-10T03:42:25.859 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-05-10T03:42:25.860 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-05-10T03:42:25.861 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-05-10T03:42:25.862 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-05-10T03:42:25.863 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-05-10T03:42:25.865 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-05-10T03:42:25.865 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/ 2024-05-10T03:42:25.868 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-05-10T03:42:25.869 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-05-10T03:42:25.871 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-05-10T03:42:25.872 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-05-10T03:42:25.873 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-05-10T03:42:25.874 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-05-10T03:42:25.875 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-05-10T03:42:25.876 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-05-10T03:42:25.877 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-05-10T03:42:25.878 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-05-10T03:42:25.880 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-05-10T03:42:25.881 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-05-10T03:42:25.881 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-05-10T03:42:25.883 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-05-10T03:42:25.884 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-05-10T03:42:25.885 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-05-10T03:42:25.887 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-05-10T03:42:25.888 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-05-10T03:42:25.888 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/SAK.txt 2024-05-10T03:42:25.890 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/SM501.txt 2024-05-10T03:42:25.891 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-05-10T03:42:25.892 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-05-10T03:42:25.893 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-05-10T03:42:25.894 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-05-10T03:42:25.896 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-05-10T03:42:25.897 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/accounting/ 2024-05-10T03:42:25.899 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-05-10T03:42:25.901 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-05-10T03:42:25.902 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-05-10T03:42:25.903 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-05-10T03:42:25.904 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-05-10T03:42:25.905 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-05-10T03:42:25.906 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-05-10T03:42:25.907 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/ 2024-05-10T03:42:25.910 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-05-10T03:42:25.911 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-05-10T03:42:25.912 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-05-10T03:42:25.914 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-05-10T03:42:25.915 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-05-10T03:42:25.916 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-05-10T03:42:25.918 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-05-10T03:42:25.918 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-05-10T03:42:25.920 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-05-10T03:42:25.921 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-05-10T03:42:25.922 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-05-10T03:42:25.923 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-05-10T03:42:25.924 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-05-10T03:42:25.925 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/aoe/ 2024-05-10T03:42:25.927 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-05-10T03:42:25.929 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-05-10T03:42:25.930 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-05-10T03:42:25.931 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-05-10T03:42:25.932 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-05-10T03:42:25.934 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-05-10T03:42:25.935 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-05-10T03:42:25.936 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/ 2024-05-10T03:42:25.938 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-05-10T03:42:25.939 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-05-10T03:42:25.941 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-05-10T03:42:25.942 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Booting 2024-05-10T03:42:25.943 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-05-10T03:42:25.945 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-05-10T03:42:25.946 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-05-10T03:42:25.947 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-05-10T03:42:25.948 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-05-10T03:42:25.949 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-05-10T03:42:25.950 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-05-10T03:42:25.951 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-05-10T03:42:25.953 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-05-10T03:42:25.954 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-05-10T03:42:25.955 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Porting 2024-05-10T03:42:25.957 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/README 2024-05-10T03:42:25.958 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-05-10T03:42:25.959 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-05-10T03:42:25.961 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-05-10T03:42:25.962 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-05-10T03:42:25.963 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-05-10T03:42:25.964 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-05-10T03:42:25.965 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-05-10T03:42:25.965 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-05-10T03:42:25.966 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-05-10T03:42:25.967 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-05-10T03:42:25.968 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-05-10T03:42:25.968 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-05-10T03:42:25.969 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-05-10T03:42:25.970 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-05-10T03:42:25.971 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-05-10T03:42:25.972 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-05-10T03:42:25.972 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-05-10T03:42:25.973 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-05-10T03:42:25.974 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-05-10T03:42:25.975 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-05-10T03:42:25.976 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-05-10T03:42:25.977 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-05-10T03:42:25.978 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-05-10T03:42:25.979 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-05-10T03:42:25.979 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-05-10T03:42:25.980 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-05-10T03:42:25.981 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-05-10T03:42:25.982 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-05-10T03:42:25.983 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-05-10T03:42:25.984 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-05-10T03:42:25.985 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-05-10T03:42:25.985 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-05-10T03:42:25.986 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-05-10T03:42:25.987 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-05-10T03:42:25.989 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-05-10T03:42:25.990 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-05-10T03:42:25.990 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-05-10T03:42:25.990 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-05-10T03:42:25.991 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-05-10T03:42:25.992 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-05-10T03:42:25.993 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-05-10T03:42:25.994 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-05-10T03:42:25.995 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-05-10T03:42:25.996 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Setup 2024-05-10T03:42:25.997 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-05-10T03:42:25.998 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-05-10T03:42:25.999 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-05-10T03:42:26.000 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-05-10T03:42:26.001 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-05-10T03:42:26.002 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-05-10T03:42:26.002 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-05-10T03:42:26.003 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-05-10T03:42:26.004 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-05-10T03:42:26.005 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-05-10T03:42:26.006 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-05-10T03:42:26.007 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-05-10T03:42:26.007 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-05-10T03:42:26.008 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-05-10T03:42:26.009 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-05-10T03:42:26.009 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-05-10T03:42:26.010 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-05-10T03:42:26.011 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-05-10T03:42:26.012 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-05-10T03:42:26.013 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-05-10T03:42:26.015 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-05-10T03:42:27.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:27 smithi045 ceph-mon[42520]: pgmap v350: 129 pgs: 129 active+clean; 5.5 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 418 KiB/s wr, 14 op/s 2024-05-10T03:42:27.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:27 smithi045 ceph-mon[42520]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:42:27.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:27 smithi106 ceph-mon[46996]: pgmap v350: 129 pgs: 129 active+clean; 5.5 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 418 KiB/s wr, 14 op/s 2024-05-10T03:42:27.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:27 smithi106 ceph-mon[46996]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:42:27.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:27 smithi154 ceph-mon[46565]: pgmap v350: 129 pgs: 129 active+clean; 5.5 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 418 KiB/s wr, 14 op/s 2024-05-10T03:42:27.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:27 smithi154 ceph-mon[46565]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:42:29.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:29 smithi045 ceph-mon[42520]: pgmap v351: 129 pgs: 129 active+clean; 50 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.1 MiB/s wr, 26 op/s 2024-05-10T03:42:29.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:29 smithi106 ceph-mon[46996]: pgmap v351: 129 pgs: 129 active+clean; 50 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.1 MiB/s wr, 26 op/s 2024-05-10T03:42:29.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:29 smithi154 ceph-mon[46565]: pgmap v351: 129 pgs: 129 active+clean; 50 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.1 MiB/s wr, 26 op/s 2024-05-10T03:42:30.816 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-05-10T03:42:30.817 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-05-10T03:42:30.817 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-05-10T03:42:30.820 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-05-10T03:42:30.821 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-05-10T03:42:30.822 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-05-10T03:42:30.823 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-05-10T03:42:30.823 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-05-10T03:42:30.824 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-05-10T03:42:30.825 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm64/ 2024-05-10T03:42:30.838 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-05-10T03:42:30.840 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-05-10T03:42:30.840 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-05-10T03:42:30.841 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-05-10T03:42:30.842 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-05-10T03:42:30.843 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-05-10T03:42:30.844 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-05-10T03:42:30.846 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-05-10T03:42:30.847 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-05-10T03:42:30.847 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-05-10T03:42:30.848 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-05-10T03:42:30.849 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-05-10T03:42:30.850 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/backlight/ 2024-05-10T03:42:30.852 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-05-10T03:42:30.853 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-05-10T03:42:30.854 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-05-10T03:42:30.855 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/bcache.txt 2024-05-10T03:42:30.856 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-05-10T03:42:30.857 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blackfin/ 2024-05-10T03:42:30.859 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-05-10T03:42:30.860 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-05-10T03:42:30.861 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-05-10T03:42:30.862 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-05-10T03:42:30.863 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-05-10T03:42:30.863 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/ 2024-05-10T03:42:30.865 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-05-10T03:42:30.866 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-05-10T03:42:30.866 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-05-10T03:42:30.867 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-05-10T03:42:30.868 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-05-10T03:42:30.869 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-05-10T03:42:30.870 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-05-10T03:42:30.871 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-05-10T03:42:30.871 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-05-10T03:42:30.872 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-05-10T03:42:30.873 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-05-10T03:42:30.874 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/request.txt 2024-05-10T03:42:30.875 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-05-10T03:42:30.876 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-05-10T03:42:30.877 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-05-10T03:42:30.878 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/ 2024-05-10T03:42:30.879 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-05-10T03:42:30.880 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-05-10T03:42:30.881 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-05-10T03:42:30.882 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-05-10T03:42:30.883 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-05-10T03:42:30.884 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-05-10T03:42:30.885 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-05-10T03:42:30.886 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-05-10T03:42:30.887 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-05-10T03:42:30.888 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-05-10T03:42:30.889 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-05-10T03:42:30.889 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-05-10T03:42:30.890 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-05-10T03:42:30.891 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-05-10T03:42:30.892 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-05-10T03:42:30.893 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-05-10T03:42:30.894 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-05-10T03:42:30.894 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-05-10T03:42:30.895 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-05-10T03:42:30.896 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-05-10T03:42:30.897 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-05-10T03:42:30.898 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-05-10T03:42:30.898 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-05-10T03:42:30.901 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-05-10T03:42:30.902 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-05-10T03:42:30.902 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-05-10T03:42:30.903 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cdrom/ 2024-05-10T03:42:30.906 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-05-10T03:42:30.907 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-05-10T03:42:30.907 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-05-10T03:42:30.909 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-05-10T03:42:30.909 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-05-10T03:42:30.910 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/ 2024-05-10T03:42:30.911 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-05-10T03:42:30.912 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-05-10T03:42:30.913 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-05-10T03:42:30.913 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-05-10T03:42:30.914 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-05-10T03:42:30.916 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-05-10T03:42:30.916 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-05-10T03:42:30.917 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-05-10T03:42:30.917 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-05-10T03:42:30.918 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-05-10T03:42:30.919 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-05-10T03:42:30.920 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-05-10T03:42:30.921 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-05-10T03:42:30.922 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-05-10T03:42:30.922 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/clk.txt 2024-05-10T03:42:30.923 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-05-10T03:42:30.924 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/connector/ 2024-05-10T03:42:30.926 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-05-10T03:42:30.927 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-05-10T03:42:30.928 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-05-10T03:42:30.929 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-05-10T03:42:30.929 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-05-10T03:42:30.930 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/console/ 2024-05-10T03:42:30.932 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/console/console.txt 2024-05-10T03:42:30.933 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-05-10T03:42:30.935 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-05-10T03:42:30.936 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-05-10T03:42:30.937 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-05-10T03:42:30.938 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-05-10T03:42:30.939 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-05-10T03:42:30.940 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-05-10T03:42:30.942 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-05-10T03:42:30.943 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-05-10T03:42:30.944 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-05-10T03:42:30.945 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-05-10T03:42:30.946 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-05-10T03:42:30.947 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-05-10T03:42:30.948 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-05-10T03:42:30.949 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-05-10T03:42:30.952 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-05-10T03:42:30.953 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-05-10T03:42:30.954 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-05-10T03:42:30.955 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-05-10T03:42:30.956 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-05-10T03:42:30.958 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/crc32.txt 2024-05-10T03:42:30.959 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cris/ 2024-05-10T03:42:30.962 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cris/README 2024-05-10T03:42:30.963 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/crypto/ 2024-05-10T03:42:30.965 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-05-10T03:42:30.967 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-05-10T03:42:30.968 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-05-10T03:42:30.969 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-05-10T03:42:30.970 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-05-10T03:42:30.971 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-05-10T03:42:30.972 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-05-10T03:42:30.973 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-05-10T03:42:30.975 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-05-10T03:42:30.976 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/development-process/ 2024-05-10T03:42:30.978 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-05-10T03:42:30.980 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-05-10T03:42:30.982 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-05-10T03:42:30.982 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-05-10T03:42:30.983 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-05-10T03:42:30.984 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-05-10T03:42:30.986 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-05-10T03:42:30.987 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-05-10T03:42:30.988 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-05-10T03:42:30.990 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-05-10T03:42:30.992 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-05-10T03:42:30.993 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-05-10T03:42:30.994 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-05-10T03:42:30.994 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-05-10T03:42:30.995 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-05-10T03:42:30.996 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-05-10T03:42:30.997 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-05-10T03:42:30.998 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-05-10T03:42:30.999 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-05-10T03:42:31.000 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-05-10T03:42:31.000 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-05-10T03:42:31.002 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-05-10T03:42:31.003 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-05-10T03:42:31.003 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-05-10T03:42:31.004 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-05-10T03:42:31.005 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-05-10T03:42:31.006 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-05-10T03:42:31.007 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-05-10T03:42:31.008 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-05-10T03:42:31.009 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-05-10T03:42:31.010 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-05-10T03:42:31.011 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devices.txt 2024-05-10T03:42:31.012 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/ 2024-05-10T03:42:31.014 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-05-10T03:42:31.015 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-05-10T03:42:31.016 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-05-10T03:42:31.017 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-05-10T03:42:31.018 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-05-10T03:42:31.019 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-05-10T03:42:31.019 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-05-10T03:42:31.020 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-05-10T03:42:31.021 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-05-10T03:42:31.022 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-05-10T03:42:31.023 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-05-10T03:42:31.024 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-05-10T03:42:31.024 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-05-10T03:42:31.025 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-05-10T03:42:31.026 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-05-10T03:42:31.027 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-05-10T03:42:31.027 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-05-10T03:42:31.028 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-05-10T03:42:31.029 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-05-10T03:42:31.030 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-05-10T03:42:31.031 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-05-10T03:42:31.032 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-05-10T03:42:31.033 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-05-10T03:42:31.034 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-05-10T03:42:31.035 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-05-10T03:42:31.035 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-05-10T03:42:31.036 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-05-10T03:42:31.037 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-05-10T03:42:31.038 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-05-10T03:42:31.038 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-05-10T03:42:31.039 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-05-10T03:42:31.040 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-05-10T03:42:31.041 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-05-10T03:42:31.042 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-05-10T03:42:31.042 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-05-10T03:42:31.044 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-05-10T03:42:31.044 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-05-10T03:42:31.045 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-05-10T03:42:31.046 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-05-10T03:42:31.047 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-05-10T03:42:31.049 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-05-10T03:42:31.049 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-05-10T03:42:31.050 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-05-10T03:42:31.051 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-05-10T03:42:31.052 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-05-10T03:42:31.053 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-05-10T03:42:31.054 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-05-10T03:42:31.054 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-05-10T03:42:31.055 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-05-10T03:42:31.056 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-05-10T03:42:31.057 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-05-10T03:42:31.058 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-05-10T03:42:31.059 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-05-10T03:42:31.060 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-05-10T03:42:31.061 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-05-10T03:42:31.062 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-05-10T03:42:31.063 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-05-10T03:42:31.063 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-05-10T03:42:31.064 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-05-10T03:42:31.065 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-05-10T03:42:31.066 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-05-10T03:42:31.067 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-05-10T03:42:31.068 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-05-10T03:42:31.068 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-05-10T03:42:31.069 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-05-10T03:42:31.070 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-05-10T03:42:31.071 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-05-10T03:42:31.073 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-05-10T03:42:31.073 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-05-10T03:42:31.074 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-05-10T03:42:31.075 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-05-10T03:42:31.077 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-05-10T03:42:31.077 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-05-10T03:42:31.078 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-05-10T03:42:31.079 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-05-10T03:42:31.080 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-05-10T03:42:31.080 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-05-10T03:42:31.081 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-05-10T03:42:31.082 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-05-10T03:42:31.082 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-05-10T03:42:31.083 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-05-10T03:42:31.084 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-05-10T03:42:31.085 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-05-10T03:42:31.086 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-05-10T03:42:31.087 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-05-10T03:42:31.088 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-05-10T03:42:31.089 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-05-10T03:42:31.090 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-05-10T03:42:31.090 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-05-10T03:42:31.091 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-05-10T03:42:31.092 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-05-10T03:42:31.093 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-05-10T03:42:31.094 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-05-10T03:42:31.094 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-05-10T03:42:31.095 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-05-10T03:42:31.096 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-05-10T03:42:31.096 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-05-10T03:42:31.097 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-05-10T03:42:31.099 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-05-10T03:42:31.099 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-05-10T03:42:31.100 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-05-10T03:42:31.101 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-05-10T03:42:31.102 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-05-10T03:42:31.103 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-05-10T03:42:31.104 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-05-10T03:42:31.104 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-05-10T03:42:31.105 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-05-10T03:42:31.106 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-05-10T03:42:31.107 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-05-10T03:42:31.108 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-05-10T03:42:31.108 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-05-10T03:42:31.109 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-05-10T03:42:31.110 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-05-10T03:42:31.110 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-05-10T03:42:31.111 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-05-10T03:42:31.113 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-05-10T03:42:31.113 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-05-10T03:42:31.114 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-05-10T03:42:31.115 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-05-10T03:42:31.115 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-05-10T03:42:31.116 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-05-10T03:42:31.117 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-05-10T03:42:31.118 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-05-10T03:42:31.119 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-05-10T03:42:31.120 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-05-10T03:42:31.121 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-05-10T03:42:31.122 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-05-10T03:42:31.123 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-05-10T03:42:31.123 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-05-10T03:42:31.124 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-05-10T03:42:31.125 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-05-10T03:42:31.126 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-05-10T03:42:31.127 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-05-10T03:42:31.127 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-05-10T03:42:31.128 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-05-10T03:42:31.129 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-05-10T03:42:31.130 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-05-10T03:42:31.130 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-05-10T03:42:31.131 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-05-10T03:42:31.132 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-05-10T03:42:31.134 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-05-10T03:42:31.134 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-05-10T03:42:31.135 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-05-10T03:42:31.136 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-05-10T03:42:31.137 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-05-10T03:42:31.137 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-05-10T03:42:31.138 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-05-10T03:42:31.139 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-05-10T03:42:31.140 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-05-10T03:42:31.141 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-05-10T03:42:31.142 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-05-10T03:42:31.143 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-05-10T03:42:31.144 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-05-10T03:42:31.145 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-05-10T03:42:31.146 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-05-10T03:42:31.146 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-05-10T03:42:31.147 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-05-10T03:42:31.148 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-05-10T03:42:31.150 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-05-10T03:42:31.151 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-05-10T03:42:31.151 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-05-10T03:42:31.152 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-05-10T03:42:31.153 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-05-10T03:42:31.154 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-05-10T03:42:31.155 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-05-10T03:42:31.156 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-05-10T03:42:31.158 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-05-10T03:42:31.159 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-05-10T03:42:31.159 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-05-10T03:42:31.160 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-05-10T03:42:31.161 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-05-10T03:42:31.162 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-05-10T03:42:31.163 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-05-10T03:42:31.164 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-05-10T03:42:31.164 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-05-10T03:42:31.165 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-05-10T03:42:31.166 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-05-10T03:42:31.167 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-05-10T03:42:31.168 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-05-10T03:42:31.169 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-05-10T03:42:31.170 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-05-10T03:42:31.171 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-05-10T03:42:31.172 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-05-10T03:42:31.172 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-05-10T03:42:31.173 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-05-10T03:42:31.174 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-05-10T03:42:31.175 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-05-10T03:42:31.176 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-05-10T03:42:31.176 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-05-10T03:42:31.177 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-05-10T03:42:31.178 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-05-10T03:42:31.179 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-05-10T03:42:31.180 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-05-10T03:42:31.181 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-05-10T03:42:31.181 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-05-10T03:42:31.182 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-05-10T03:42:31.184 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-05-10T03:42:31.184 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-05-10T03:42:31.185 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-05-10T03:42:31.186 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-05-10T03:42:31.186 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-05-10T03:42:31.187 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-05-10T03:42:31.188 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-05-10T03:42:31.189 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-05-10T03:42:31.189 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-05-10T03:42:31.190 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-05-10T03:42:31.191 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-05-10T03:42:31.192 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-05-10T03:42:31.192 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-05-10T03:42:31.194 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-05-10T03:42:31.194 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-05-10T03:42:31.195 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-05-10T03:42:31.196 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-05-10T03:42:31.197 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-05-10T03:42:31.198 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-05-10T03:42:31.199 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-05-10T03:42:31.200 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-05-10T03:42:31.200 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-05-10T03:42:31.201 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-05-10T03:42:31.202 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-05-10T03:42:31.203 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-05-10T03:42:31.204 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-05-10T03:42:31.204 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-05-10T03:42:31.205 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-05-10T03:42:31.207 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-05-10T03:42:31.207 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-05-10T03:42:31.207 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-05-10T03:42:31.208 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-05-10T03:42:31.209 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-05-10T03:42:31.210 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-05-10T03:42:31.211 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-05-10T03:42:31.212 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-05-10T03:42:31.213 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-05-10T03:42:31.213 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-05-10T03:42:31.214 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-05-10T03:42:31.215 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-05-10T03:42:31.216 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-05-10T03:42:31.217 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-05-10T03:42:31.218 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-05-10T03:42:31.219 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-05-10T03:42:31.220 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-05-10T03:42:31.220 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-05-10T03:42:31.221 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-05-10T03:42:31.222 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-05-10T03:42:31.223 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-05-10T03:42:31.223 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-05-10T03:42:31.224 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-05-10T03:42:31.225 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-05-10T03:42:31.226 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-05-10T03:42:31.227 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-05-10T03:42:31.228 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-05-10T03:42:31.228 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-05-10T03:42:31.229 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-05-10T03:42:31.230 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-05-10T03:42:31.231 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-05-10T03:42:31.232 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-05-10T03:42:31.233 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-05-10T03:42:31.234 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-05-10T03:42:31.235 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-05-10T03:42:31.236 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-05-10T03:42:31.236 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-05-10T03:42:31.237 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-05-10T03:42:31.238 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-05-10T03:42:31.239 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-05-10T03:42:31.240 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-05-10T03:42:31.241 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-05-10T03:42:31.241 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-05-10T03:42:31.242 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-05-10T03:42:31.243 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-05-10T03:42:31.244 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-05-10T03:42:31.244 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-05-10T03:42:31.245 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-05-10T03:42:31.246 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-05-10T03:42:31.247 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-05-10T03:42:31.248 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-05-10T03:42:31.249 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-05-10T03:42:31.250 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-05-10T03:42:31.250 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-05-10T03:42:31.251 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-05-10T03:42:31.252 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-05-10T03:42:31.253 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-05-10T03:42:31.254 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-05-10T03:42:31.255 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-05-10T03:42:31.256 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-05-10T03:42:31.257 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-05-10T03:42:31.258 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-05-10T03:42:31.258 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-05-10T03:42:31.259 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-05-10T03:42:31.260 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-05-10T03:42:31.261 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-05-10T03:42:31.262 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-05-10T03:42:31.263 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-05-10T03:42:31.264 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-05-10T03:42:31.265 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-05-10T03:42:31.265 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-05-10T03:42:31.266 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-05-10T03:42:31.267 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-05-10T03:42:31.267 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-05-10T03:42:31.268 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-05-10T03:42:31.269 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-05-10T03:42:31.270 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-05-10T03:42:31.271 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-05-10T03:42:31.271 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-05-10T03:42:31.272 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-05-10T03:42:31.273 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-05-10T03:42:31.274 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-05-10T03:42:31.275 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-05-10T03:42:31.275 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-05-10T03:42:31.276 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-05-10T03:42:31.277 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-05-10T03:42:31.278 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-05-10T03:42:31.279 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-05-10T03:42:31.279 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-05-10T03:42:31.280 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-05-10T03:42:31.281 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-05-10T03:42:31.282 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-05-10T03:42:31.283 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:31 smithi045 ceph-mon[42520]: pgmap v352: 129 pgs: 129 active+clean; 81 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 6.7 MiB/s wr, 35 op/s 2024-05-10T03:42:31.284 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-05-10T03:42:31.284 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-05-10T03:42:31.285 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-05-10T03:42:31.286 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-05-10T03:42:31.286 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-05-10T03:42:31.287 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-05-10T03:42:31.288 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-05-10T03:42:31.289 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-05-10T03:42:31.290 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-05-10T03:42:31.290 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-05-10T03:42:31.291 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-05-10T03:42:31.292 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-05-10T03:42:31.293 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-05-10T03:42:31.293 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-05-10T03:42:31.294 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-05-10T03:42:31.295 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-05-10T03:42:31.296 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-05-10T03:42:31.297 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-05-10T03:42:31.299 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-05-10T03:42:31.299 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-05-10T03:42:31.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:31 smithi106 ceph-mon[46996]: pgmap v352: 129 pgs: 129 active+clean; 81 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 6.7 MiB/s wr, 35 op/s 2024-05-10T03:42:31.459 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-05-10T03:42:31.460 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-05-10T03:42:31.461 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-05-10T03:42:31.462 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-05-10T03:42:31.464 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-05-10T03:42:31.465 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-05-10T03:42:31.466 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-05-10T03:42:31.467 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-05-10T03:42:31.468 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-05-10T03:42:31.468 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-05-10T03:42:31.469 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-05-10T03:42:31.470 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-05-10T03:42:31.471 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-05-10T03:42:31.472 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-05-10T03:42:31.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:31 smithi154 ceph-mon[46565]: pgmap v352: 129 pgs: 129 active+clean; 81 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 6.7 MiB/s wr, 35 op/s 2024-05-10T03:42:31.474 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-05-10T03:42:31.474 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-05-10T03:42:31.475 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-05-10T03:42:31.475 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-05-10T03:42:31.475 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-05-10T03:42:31.476 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-05-10T03:42:31.477 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-05-10T03:42:31.478 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-05-10T03:42:31.480 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-05-10T03:42:31.480 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-05-10T03:42:31.481 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-05-10T03:42:31.482 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-05-10T03:42:31.483 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-05-10T03:42:31.484 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-05-10T03:42:31.484 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-05-10T03:42:31.485 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-05-10T03:42:31.486 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-05-10T03:42:31.487 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-05-10T03:42:31.488 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-05-10T03:42:31.489 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-05-10T03:42:31.490 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-05-10T03:42:31.491 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-05-10T03:42:31.492 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-05-10T03:42:31.493 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-05-10T03:42:31.494 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-05-10T03:42:31.495 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-05-10T03:42:31.496 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-05-10T03:42:31.497 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-05-10T03:42:31.498 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-05-10T03:42:31.499 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-05-10T03:42:31.499 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-05-10T03:42:31.500 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-05-10T03:42:31.501 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-05-10T03:42:31.502 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-05-10T03:42:31.503 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-05-10T03:42:31.504 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-05-10T03:42:31.504 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-05-10T03:42:31.505 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-05-10T03:42:31.506 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-05-10T03:42:31.507 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-05-10T03:42:31.508 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-05-10T03:42:31.509 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-05-10T03:42:31.510 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-05-10T03:42:31.511 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-05-10T03:42:31.512 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-05-10T03:42:31.513 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-05-10T03:42:31.514 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-05-10T03:42:31.515 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-05-10T03:42:31.516 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-05-10T03:42:31.517 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-05-10T03:42:31.518 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-05-10T03:42:31.518 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-05-10T03:42:31.519 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-05-10T03:42:31.520 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-05-10T03:42:31.521 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-05-10T03:42:31.522 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-05-10T03:42:31.522 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-05-10T03:42:31.523 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-05-10T03:42:31.524 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-05-10T03:42:31.525 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-05-10T03:42:31.525 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-05-10T03:42:31.526 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-05-10T03:42:31.527 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-05-10T03:42:31.528 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-05-10T03:42:31.529 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-05-10T03:42:31.529 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-05-10T03:42:31.530 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-05-10T03:42:31.531 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-05-10T03:42:31.532 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-05-10T03:42:31.532 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-05-10T03:42:31.533 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-05-10T03:42:31.534 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-05-10T03:42:31.535 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-05-10T03:42:31.535 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-05-10T03:42:31.536 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-05-10T03:42:31.538 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-05-10T03:42:31.539 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-05-10T03:42:31.540 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-05-10T03:42:31.541 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-05-10T03:42:31.542 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-05-10T03:42:31.542 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-05-10T03:42:31.543 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-05-10T03:42:31.543 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-05-10T03:42:31.544 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-05-10T03:42:31.545 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-05-10T03:42:31.545 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-05-10T03:42:31.546 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-05-10T03:42:31.547 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-05-10T03:42:31.547 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-05-10T03:42:31.548 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-05-10T03:42:31.549 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-05-10T03:42:31.550 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-05-10T03:42:31.551 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-05-10T03:42:31.552 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-05-10T03:42:31.553 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-05-10T03:42:31.553 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-05-10T03:42:31.554 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-05-10T03:42:31.555 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-05-10T03:42:31.556 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-05-10T03:42:31.557 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-05-10T03:42:31.558 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-05-10T03:42:31.558 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-05-10T03:42:31.559 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-05-10T03:42:31.560 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-05-10T03:42:31.561 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-05-10T03:42:31.562 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-05-10T03:42:31.562 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-05-10T03:42:31.563 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-05-10T03:42:31.564 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-05-10T03:42:31.564 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-05-10T03:42:31.565 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-05-10T03:42:31.566 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-05-10T03:42:31.567 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-05-10T03:42:31.568 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-05-10T03:42:31.569 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-05-10T03:42:31.570 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-05-10T03:42:31.571 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-05-10T03:42:31.572 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-05-10T03:42:31.573 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-05-10T03:42:31.574 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-05-10T03:42:31.574 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-05-10T03:42:31.575 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-05-10T03:42:31.576 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-05-10T03:42:31.577 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-05-10T03:42:31.577 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-05-10T03:42:31.578 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-05-10T03:42:31.579 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-05-10T03:42:31.581 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-05-10T03:42:31.581 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-05-10T03:42:31.582 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-05-10T03:42:31.583 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-05-10T03:42:31.585 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-05-10T03:42:31.585 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-05-10T03:42:31.586 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-05-10T03:42:31.587 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-05-10T03:42:31.587 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-05-10T03:42:31.588 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-05-10T03:42:31.589 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-05-10T03:42:31.589 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-05-10T03:42:31.590 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-05-10T03:42:31.591 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-05-10T03:42:31.592 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-05-10T03:42:31.593 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-05-10T03:42:31.594 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-05-10T03:42:31.595 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-05-10T03:42:31.595 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-05-10T03:42:31.596 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-05-10T03:42:31.597 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-05-10T03:42:31.598 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-05-10T03:42:31.599 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-05-10T03:42:31.599 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-05-10T03:42:31.600 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-05-10T03:42:31.601 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-05-10T03:42:31.602 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-05-10T03:42:31.603 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-05-10T03:42:31.604 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-05-10T03:42:31.605 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-05-10T03:42:31.606 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-05-10T03:42:31.606 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-05-10T03:42:31.607 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-05-10T03:42:31.608 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-05-10T03:42:31.609 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-05-10T03:42:31.610 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-05-10T03:42:31.610 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-05-10T03:42:31.611 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-05-10T03:42:31.612 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-05-10T03:42:31.613 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-05-10T03:42:31.614 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-05-10T03:42:31.615 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-05-10T03:42:31.616 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-05-10T03:42:31.617 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-05-10T03:42:31.618 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-05-10T03:42:31.618 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-05-10T03:42:31.619 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-05-10T03:42:31.620 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-05-10T03:42:31.620 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-05-10T03:42:31.621 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-05-10T03:42:31.622 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-05-10T03:42:31.623 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-05-10T03:42:31.624 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-05-10T03:42:31.625 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-05-10T03:42:31.626 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-05-10T03:42:31.626 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-05-10T03:42:31.627 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-05-10T03:42:31.628 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-05-10T03:42:31.629 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-05-10T03:42:31.630 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-05-10T03:42:31.632 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-05-10T03:42:31.633 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-05-10T03:42:31.634 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-05-10T03:42:31.634 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-05-10T03:42:31.635 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-05-10T03:42:31.636 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-05-10T03:42:31.637 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-05-10T03:42:31.637 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-05-10T03:42:31.638 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-05-10T03:42:31.639 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-05-10T03:42:31.639 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-05-10T03:42:31.640 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-05-10T03:42:31.641 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-05-10T03:42:31.642 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-05-10T03:42:31.643 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-05-10T03:42:31.644 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-05-10T03:42:31.645 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-05-10T03:42:31.646 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-05-10T03:42:31.647 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-05-10T03:42:31.649 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-05-10T03:42:31.649 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-05-10T03:42:31.650 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-05-10T03:42:31.651 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-05-10T03:42:31.652 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-05-10T03:42:31.653 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-05-10T03:42:31.654 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-05-10T03:42:31.655 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-05-10T03:42:31.656 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-05-10T03:42:31.657 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-05-10T03:42:31.658 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-05-10T03:42:31.659 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-05-10T03:42:31.661 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-05-10T03:42:31.661 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-05-10T03:42:31.663 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-05-10T03:42:31.664 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-05-10T03:42:31.664 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-05-10T03:42:31.666 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-05-10T03:42:31.666 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-05-10T03:42:31.667 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-05-10T03:42:31.668 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-05-10T03:42:31.668 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-05-10T03:42:31.669 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-05-10T03:42:31.671 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-05-10T03:42:31.671 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-05-10T03:42:31.672 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-05-10T03:42:31.674 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-05-10T03:42:31.675 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-05-10T03:42:31.675 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-05-10T03:42:31.677 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-05-10T03:42:31.678 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-05-10T03:42:31.679 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-05-10T03:42:31.680 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-05-10T03:42:31.681 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-05-10T03:42:31.682 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-05-10T03:42:31.683 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-05-10T03:42:31.684 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-05-10T03:42:31.685 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-05-10T03:42:31.686 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-05-10T03:42:31.687 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-05-10T03:42:31.689 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-05-10T03:42:31.689 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-05-10T03:42:31.690 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-05-10T03:42:31.692 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-05-10T03:42:31.692 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-05-10T03:42:31.693 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-05-10T03:42:31.695 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-05-10T03:42:31.696 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-05-10T03:42:31.697 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-05-10T03:42:31.698 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-05-10T03:42:31.700 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-05-10T03:42:31.701 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-05-10T03:42:31.702 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-05-10T03:42:31.703 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-05-10T03:42:31.704 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-05-10T03:42:31.705 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-05-10T03:42:31.706 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-05-10T03:42:31.707 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-05-10T03:42:31.708 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-05-10T03:42:31.709 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-05-10T03:42:31.710 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-05-10T03:42:31.711 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-05-10T03:42:31.713 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-05-10T03:42:31.714 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-05-10T03:42:31.715 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-05-10T03:42:31.716 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-05-10T03:42:31.717 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-05-10T03:42:31.718 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-05-10T03:42:31.720 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-05-10T03:42:31.721 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-05-10T03:42:31.722 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-05-10T03:42:31.723 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-05-10T03:42:31.724 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-05-10T03:42:31.725 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-05-10T03:42:31.726 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-05-10T03:42:31.727 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-05-10T03:42:31.727 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-05-10T03:42:31.728 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-05-10T03:42:31.729 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-05-10T03:42:31.730 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-05-10T03:42:31.730 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-05-10T03:42:31.731 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-05-10T03:42:31.732 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-05-10T03:42:31.733 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-05-10T03:42:31.734 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-05-10T03:42:31.734 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-05-10T03:42:31.735 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-05-10T03:42:31.736 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-05-10T03:42:31.737 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-05-10T03:42:31.738 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-05-10T03:42:31.739 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-05-10T03:42:31.740 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-05-10T03:42:31.740 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-05-10T03:42:31.741 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-05-10T03:42:31.742 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-05-10T03:42:31.743 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-05-10T03:42:31.743 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-05-10T03:42:31.744 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-05-10T03:42:31.745 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-05-10T03:42:31.746 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-05-10T03:42:31.748 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-05-10T03:42:31.749 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-05-10T03:42:31.750 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-05-10T03:42:31.750 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-05-10T03:42:31.751 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-05-10T03:42:31.752 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-05-10T03:42:31.753 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-05-10T03:42:31.754 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-05-10T03:42:31.755 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-05-10T03:42:31.756 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-05-10T03:42:31.757 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-05-10T03:42:31.758 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-05-10T03:42:31.759 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-05-10T03:42:31.760 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-05-10T03:42:31.761 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-05-10T03:42:31.762 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-05-10T03:42:31.763 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-05-10T03:42:31.764 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-05-10T03:42:31.765 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-05-10T03:42:31.766 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-05-10T03:42:31.767 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-05-10T03:42:31.767 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-05-10T03:42:31.768 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-05-10T03:42:31.769 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-05-10T03:42:31.770 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-05-10T03:42:31.771 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-05-10T03:42:31.772 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-05-10T03:42:31.773 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-05-10T03:42:31.773 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-05-10T03:42:31.774 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-05-10T03:42:31.775 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-05-10T03:42:31.776 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-05-10T03:42:31.777 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-05-10T03:42:31.777 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-05-10T03:42:31.778 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-05-10T03:42:31.779 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-05-10T03:42:31.780 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-05-10T03:42:31.781 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-05-10T03:42:31.782 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-05-10T03:42:31.783 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-05-10T03:42:31.784 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-05-10T03:42:31.785 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-05-10T03:42:31.785 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-05-10T03:42:31.786 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-05-10T03:42:31.787 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-05-10T03:42:31.788 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-05-10T03:42:31.789 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-05-10T03:42:31.789 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-05-10T03:42:31.790 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-05-10T03:42:31.791 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-05-10T03:42:31.791 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-05-10T03:42:31.792 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-05-10T03:42:31.794 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-05-10T03:42:31.794 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-05-10T03:42:31.796 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-05-10T03:42:31.797 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-05-10T03:42:31.798 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-05-10T03:42:31.798 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-05-10T03:42:31.799 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-05-10T03:42:31.800 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-05-10T03:42:31.800 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-05-10T03:42:31.801 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-05-10T03:42:31.803 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-05-10T03:42:31.804 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-05-10T03:42:31.805 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-05-10T03:42:31.806 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-05-10T03:42:31.807 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-05-10T03:42:31.808 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-05-10T03:42:31.809 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-05-10T03:42:31.809 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-05-10T03:42:31.810 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-05-10T03:42:31.811 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-05-10T03:42:31.811 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-05-10T03:42:31.813 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-05-10T03:42:31.813 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-05-10T03:42:31.814 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-05-10T03:42:31.815 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-05-10T03:42:31.816 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-05-10T03:42:31.816 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-05-10T03:42:31.817 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-05-10T03:42:31.818 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-05-10T03:42:31.819 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-05-10T03:42:31.820 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-05-10T03:42:31.820 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-05-10T03:42:31.821 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-05-10T03:42:31.822 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-05-10T03:42:31.823 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-05-10T03:42:31.823 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-05-10T03:42:31.824 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-05-10T03:42:31.825 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-05-10T03:42:31.826 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-05-10T03:42:31.827 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-05-10T03:42:31.827 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-05-10T03:42:31.828 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-05-10T03:42:31.829 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-05-10T03:42:31.830 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-05-10T03:42:31.830 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-05-10T03:42:31.831 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-05-10T03:42:31.832 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-05-10T03:42:31.833 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-05-10T03:42:31.833 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-05-10T03:42:31.834 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-05-10T03:42:31.835 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-05-10T03:42:31.836 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-05-10T03:42:31.837 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-05-10T03:42:31.838 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-05-10T03:42:31.839 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-05-10T03:42:31.839 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-05-10T03:42:31.841 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-05-10T03:42:31.842 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-05-10T03:42:31.843 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-05-10T03:42:31.844 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-05-10T03:42:31.845 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-05-10T03:42:31.846 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-05-10T03:42:31.847 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-05-10T03:42:31.847 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-05-10T03:42:31.849 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-05-10T03:42:31.849 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-05-10T03:42:31.850 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-05-10T03:42:31.851 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-05-10T03:42:31.852 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-05-10T03:42:31.853 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-05-10T03:42:31.854 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-05-10T03:42:31.855 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-05-10T03:42:31.856 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-05-10T03:42:31.857 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-05-10T03:42:31.858 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-05-10T03:42:31.859 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-05-10T03:42:31.860 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-05-10T03:42:31.861 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-05-10T03:42:31.862 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-05-10T03:42:31.862 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-05-10T03:42:31.863 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-05-10T03:42:31.865 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-05-10T03:42:31.866 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-05-10T03:42:31.867 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-05-10T03:42:31.868 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-05-10T03:42:31.869 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-05-10T03:42:31.870 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-05-10T03:42:31.870 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-05-10T03:42:31.871 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-05-10T03:42:31.872 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-05-10T03:42:31.873 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-05-10T03:42:31.874 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-05-10T03:42:31.874 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-05-10T03:42:31.876 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-05-10T03:42:31.877 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-05-10T03:42:31.877 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-05-10T03:42:31.878 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-05-10T03:42:31.879 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-05-10T03:42:31.880 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-05-10T03:42:31.881 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-05-10T03:42:31.881 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-05-10T03:42:31.882 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-05-10T03:42:31.883 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-05-10T03:42:31.884 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-05-10T03:42:31.885 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-05-10T03:42:31.886 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-05-10T03:42:31.886 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-05-10T03:42:31.888 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-05-10T03:42:31.889 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-05-10T03:42:31.890 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-05-10T03:42:31.890 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-05-10T03:42:31.891 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-05-10T03:42:31.892 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-05-10T03:42:31.893 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-05-10T03:42:31.894 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-05-10T03:42:31.895 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-05-10T03:42:31.896 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-05-10T03:42:31.896 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-05-10T03:42:31.897 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-05-10T03:42:31.898 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-05-10T03:42:31.899 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-05-10T03:42:31.900 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-05-10T03:42:31.901 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-05-10T03:42:31.901 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-05-10T03:42:31.902 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-05-10T03:42:31.903 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-05-10T03:42:31.904 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-05-10T03:42:31.904 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-05-10T03:42:31.905 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-05-10T03:42:31.906 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-05-10T03:42:31.907 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-05-10T03:42:32.043 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-05-10T03:42:32.044 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-05-10T03:42:32.046 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-05-10T03:42:32.047 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-05-10T03:42:32.047 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-05-10T03:42:32.048 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-05-10T03:42:32.049 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-05-10T03:42:32.050 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-05-10T03:42:32.051 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-05-10T03:42:32.052 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-05-10T03:42:32.053 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-05-10T03:42:32.054 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-05-10T03:42:32.055 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-05-10T03:42:32.056 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-05-10T03:42:32.057 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-05-10T03:42:32.058 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-05-10T03:42:32.058 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-05-10T03:42:32.059 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-05-10T03:42:32.060 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-05-10T03:42:32.060 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-05-10T03:42:32.061 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-05-10T03:42:32.062 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-05-10T03:42:32.063 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-05-10T03:42:32.063 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-05-10T03:42:32.064 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-05-10T03:42:32.065 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-05-10T03:42:32.065 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-05-10T03:42:32.066 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-05-10T03:42:32.067 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-05-10T03:42:32.067 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-05-10T03:42:32.068 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-05-10T03:42:32.069 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-05-10T03:42:32.070 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-05-10T03:42:32.071 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-05-10T03:42:32.072 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-05-10T03:42:32.073 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-05-10T03:42:32.073 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-05-10T03:42:32.074 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-05-10T03:42:32.075 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-05-10T03:42:32.075 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-05-10T03:42:32.076 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-05-10T03:42:32.077 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-05-10T03:42:32.078 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-05-10T03:42:32.079 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-05-10T03:42:32.080 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-05-10T03:42:32.080 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-05-10T03:42:32.081 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-05-10T03:42:32.082 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-05-10T03:42:32.083 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-05-10T03:42:32.084 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-05-10T03:42:32.085 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-05-10T03:42:32.086 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-05-10T03:42:32.087 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-05-10T03:42:32.088 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-05-10T03:42:32.088 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-05-10T03:42:32.089 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-05-10T03:42:32.090 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-05-10T03:42:32.091 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-05-10T03:42:32.093 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-05-10T03:42:32.094 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-05-10T03:42:32.095 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-05-10T03:42:32.096 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-05-10T03:42:32.097 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-05-10T03:42:32.098 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-05-10T03:42:32.099 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-05-10T03:42:32.101 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-05-10T03:42:32.102 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-05-10T03:42:32.103 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-05-10T03:42:32.105 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-05-10T03:42:32.106 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-05-10T03:42:32.107 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-05-10T03:42:32.109 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-05-10T03:42:32.110 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-05-10T03:42:32.111 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-05-10T03:42:32.112 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-05-10T03:42:32.113 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-05-10T03:42:32.114 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-05-10T03:42:32.115 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-05-10T03:42:32.117 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-05-10T03:42:32.118 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-05-10T03:42:32.119 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-05-10T03:42:32.120 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-05-10T03:42:32.121 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-05-10T03:42:32.121 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-05-10T03:42:32.122 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-05-10T03:42:32.123 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-05-10T03:42:32.125 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-05-10T03:42:32.126 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-05-10T03:42:32.127 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-05-10T03:42:32.129 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-05-10T03:42:32.129 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-05-10T03:42:32.130 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-05-10T03:42:32.131 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-05-10T03:42:32.131 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-05-10T03:42:32.132 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-05-10T03:42:32.133 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-05-10T03:42:32.134 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-05-10T03:42:32.134 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-05-10T03:42:32.135 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-05-10T03:42:32.136 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-05-10T03:42:32.137 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-05-10T03:42:32.138 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-05-10T03:42:32.139 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-05-10T03:42:32.140 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-05-10T03:42:32.141 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-05-10T03:42:32.142 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-05-10T03:42:32.143 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-05-10T03:42:32.143 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-05-10T03:42:32.144 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-05-10T03:42:32.145 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-05-10T03:42:32.146 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-05-10T03:42:32.147 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-05-10T03:42:32.148 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-05-10T03:42:32.148 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-05-10T03:42:32.149 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-05-10T03:42:32.150 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-05-10T03:42:32.151 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-05-10T03:42:32.152 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-05-10T03:42:32.153 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-05-10T03:42:32.154 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-05-10T03:42:32.155 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-05-10T03:42:32.156 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-05-10T03:42:32.157 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-05-10T03:42:32.158 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-05-10T03:42:32.159 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-05-10T03:42:32.160 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-05-10T03:42:32.161 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-05-10T03:42:32.162 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-05-10T03:42:32.162 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-05-10T03:42:32.163 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-05-10T03:42:32.164 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-05-10T03:42:32.165 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-05-10T03:42:32.165 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-05-10T03:42:32.166 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-05-10T03:42:32.167 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-05-10T03:42:32.168 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-05-10T03:42:32.169 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-05-10T03:42:32.170 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-05-10T03:42:32.170 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-05-10T03:42:32.171 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-05-10T03:42:32.172 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-05-10T03:42:32.173 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-05-10T03:42:32.173 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-05-10T03:42:32.174 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-05-10T03:42:32.175 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-05-10T03:42:32.176 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-05-10T03:42:32.176 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-05-10T03:42:32.177 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-05-10T03:42:32.178 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-05-10T03:42:32.179 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-05-10T03:42:32.180 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-05-10T03:42:32.181 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-05-10T03:42:32.182 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-05-10T03:42:32.183 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-05-10T03:42:32.184 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-05-10T03:42:32.185 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-05-10T03:42:32.186 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-05-10T03:42:32.187 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-05-10T03:42:32.187 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-05-10T03:42:32.188 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-05-10T03:42:32.189 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-05-10T03:42:32.190 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-05-10T03:42:32.191 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-05-10T03:42:32.192 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-05-10T03:42:32.193 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-05-10T03:42:32.194 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-05-10T03:42:32.194 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-05-10T03:42:32.195 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-05-10T03:42:32.196 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-05-10T03:42:32.197 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-05-10T03:42:32.197 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-05-10T03:42:32.198 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-05-10T03:42:32.199 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-05-10T03:42:32.199 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-05-10T03:42:32.200 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-05-10T03:42:32.201 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-05-10T03:42:32.202 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-05-10T03:42:32.203 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-05-10T03:42:32.204 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-05-10T03:42:32.205 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-05-10T03:42:32.205 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-05-10T03:42:32.206 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-05-10T03:42:32.207 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-05-10T03:42:32.208 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-05-10T03:42:32.209 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-05-10T03:42:32.210 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-05-10T03:42:32.210 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-05-10T03:42:32.211 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-05-10T03:42:32.212 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-05-10T03:42:32.213 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-05-10T03:42:32.214 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-05-10T03:42:32.215 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-05-10T03:42:32.215 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-05-10T03:42:32.216 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-05-10T03:42:32.217 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-05-10T03:42:32.217 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-05-10T03:42:32.219 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-05-10T03:42:32.219 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-05-10T03:42:32.220 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-05-10T03:42:32.221 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-05-10T03:42:32.222 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-05-10T03:42:32.223 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-05-10T03:42:32.224 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-05-10T03:42:32.225 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-05-10T03:42:32.227 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-05-10T03:42:32.228 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-05-10T03:42:32.229 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-05-10T03:42:32.230 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-05-10T03:42:32.231 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-05-10T03:42:32.232 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-05-10T03:42:32.233 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-05-10T03:42:32.234 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-05-10T03:42:32.235 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-05-10T03:42:32.236 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-05-10T03:42:32.236 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-05-10T03:42:32.237 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-05-10T03:42:32.238 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-05-10T03:42:32.239 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-05-10T03:42:32.240 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-05-10T03:42:32.241 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-05-10T03:42:32.241 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-05-10T03:42:32.242 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-05-10T03:42:32.243 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-05-10T03:42:32.243 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-05-10T03:42:32.244 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-05-10T03:42:32.245 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-05-10T03:42:32.245 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-05-10T03:42:32.246 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-05-10T03:42:32.247 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-05-10T03:42:32.247 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-05-10T03:42:32.248 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-05-10T03:42:32.249 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-05-10T03:42:32.250 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-05-10T03:42:32.250 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-05-10T03:42:32.251 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-05-10T03:42:32.252 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-05-10T03:42:32.253 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-05-10T03:42:32.254 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-05-10T03:42:32.255 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-05-10T03:42:32.255 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-05-10T03:42:32.256 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-05-10T03:42:32.257 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-05-10T03:42:32.258 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-05-10T03:42:32.259 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-05-10T03:42:32.260 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-05-10T03:42:32.261 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-05-10T03:42:32.261 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-05-10T03:42:32.262 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-05-10T03:42:32.263 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-05-10T03:42:32.264 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-05-10T03:42:32.264 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-05-10T03:42:32.265 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-05-10T03:42:32.266 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-05-10T03:42:32.267 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-05-10T03:42:32.268 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-05-10T03:42:32.269 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-05-10T03:42:32.270 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-05-10T03:42:32.271 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-05-10T03:42:32.272 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-05-10T03:42:32.273 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-05-10T03:42:32.274 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-05-10T03:42:32.275 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-05-10T03:42:32.276 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-05-10T03:42:32.276 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-05-10T03:42:32.277 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-05-10T03:42:32.278 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-05-10T03:42:32.279 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-05-10T03:42:32.279 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-05-10T03:42:32.280 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-05-10T03:42:32.281 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-05-10T03:42:32.282 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-05-10T03:42:32.283 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-05-10T03:42:32.284 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-05-10T03:42:32.285 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-05-10T03:42:32.286 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-05-10T03:42:32.287 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-05-10T03:42:32.288 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-05-10T03:42:32.289 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-05-10T03:42:32.290 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-05-10T03:42:32.291 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-05-10T03:42:32.291 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-05-10T03:42:32.292 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-05-10T03:42:32.293 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-05-10T03:42:32.294 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-05-10T03:42:32.295 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-05-10T03:42:32.296 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-05-10T03:42:32.297 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-05-10T03:42:32.297 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-05-10T03:42:32.298 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-05-10T03:42:32.299 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-05-10T03:42:32.300 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-05-10T03:42:32.301 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-05-10T03:42:32.302 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-05-10T03:42:32.303 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-05-10T03:42:32.304 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-05-10T03:42:32.305 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-05-10T03:42:32.306 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-05-10T03:42:32.307 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-05-10T03:42:32.307 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-05-10T03:42:32.308 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-05-10T03:42:32.309 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-05-10T03:42:32.310 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-05-10T03:42:32.311 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-05-10T03:42:32.312 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-05-10T03:42:32.313 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-05-10T03:42:32.314 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-05-10T03:42:32.315 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-05-10T03:42:32.316 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-05-10T03:42:32.316 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-05-10T03:42:32.317 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-05-10T03:42:32.318 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-05-10T03:42:32.319 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-05-10T03:42:32.320 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-05-10T03:42:32.320 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-05-10T03:42:32.321 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-05-10T03:42:32.323 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-05-10T03:42:32.323 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-05-10T03:42:32.324 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-05-10T03:42:32.325 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-05-10T03:42:32.326 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-05-10T03:42:32.326 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-05-10T03:42:32.327 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-05-10T03:42:32.328 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-05-10T03:42:32.329 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-05-10T03:42:32.330 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-05-10T03:42:32.331 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-05-10T03:42:32.332 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-05-10T03:42:32.333 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-05-10T03:42:32.334 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-05-10T03:42:32.334 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-05-10T03:42:32.335 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-05-10T03:42:32.336 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-05-10T03:42:32.336 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-05-10T03:42:32.337 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-05-10T03:42:32.338 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-05-10T03:42:32.339 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-05-10T03:42:32.340 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-05-10T03:42:32.341 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-05-10T03:42:32.341 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-05-10T03:42:32.342 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-05-10T03:42:32.343 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-05-10T03:42:32.343 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-05-10T03:42:32.344 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-05-10T03:42:32.345 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-05-10T03:42:32.346 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-05-10T03:42:32.346 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-05-10T03:42:32.347 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-05-10T03:42:32.349 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-05-10T03:42:32.349 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-05-10T03:42:32.351 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-05-10T03:42:32.352 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-05-10T03:42:32.353 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-05-10T03:42:32.354 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-05-10T03:42:32.354 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-05-10T03:42:32.355 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-05-10T03:42:32.356 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-05-10T03:42:32.357 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-05-10T03:42:32.358 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-05-10T03:42:32.358 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-05-10T03:42:32.359 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-05-10T03:42:32.360 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-05-10T03:42:32.361 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-05-10T03:42:32.362 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-05-10T03:42:32.363 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-05-10T03:42:32.364 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-05-10T03:42:32.365 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-05-10T03:42:32.366 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-05-10T03:42:32.367 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-05-10T03:42:32.368 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-05-10T03:42:32.369 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-05-10T03:42:32.370 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-05-10T03:42:32.370 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-05-10T03:42:32.371 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-05-10T03:42:32.372 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-05-10T03:42:32.373 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-05-10T03:42:32.374 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-05-10T03:42:32.374 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-05-10T03:42:32.375 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-05-10T03:42:32.376 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-05-10T03:42:32.377 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-05-10T03:42:32.378 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-05-10T03:42:32.380 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-05-10T03:42:32.381 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-05-10T03:42:32.382 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-05-10T03:42:32.382 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-05-10T03:42:32.383 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-05-10T03:42:32.384 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-05-10T03:42:32.384 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-05-10T03:42:32.385 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-05-10T03:42:32.386 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-05-10T03:42:32.386 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-05-10T03:42:32.387 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-05-10T03:42:32.388 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-05-10T03:42:32.389 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-05-10T03:42:32.390 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-05-10T03:42:32.391 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-05-10T03:42:32.391 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-05-10T03:42:32.392 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-05-10T03:42:32.393 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-05-10T03:42:32.394 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-05-10T03:42:32.395 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-05-10T03:42:32.396 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-05-10T03:42:32.397 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-05-10T03:42:32.398 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-05-10T03:42:32.399 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-05-10T03:42:32.399 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-05-10T03:42:32.400 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-05-10T03:42:32.401 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-05-10T03:42:32.401 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-05-10T03:42:32.402 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-05-10T03:42:32.403 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-05-10T03:42:32.404 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-05-10T03:42:32.405 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-05-10T03:42:32.406 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-05-10T03:42:32.406 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-05-10T03:42:32.407 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-05-10T03:42:32.408 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-05-10T03:42:32.409 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-05-10T03:42:32.409 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-05-10T03:42:32.410 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-05-10T03:42:32.411 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-05-10T03:42:32.412 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-05-10T03:42:32.413 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-05-10T03:42:32.414 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-05-10T03:42:32.416 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-05-10T03:42:32.416 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-05-10T03:42:32.417 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-05-10T03:42:32.418 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-05-10T03:42:32.419 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-05-10T03:42:32.420 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-05-10T03:42:32.421 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-05-10T03:42:32.421 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-05-10T03:42:32.422 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-05-10T03:42:32.423 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-05-10T03:42:32.424 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-05-10T03:42:32.425 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-05-10T03:42:32.425 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-05-10T03:42:32.426 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-05-10T03:42:32.427 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-05-10T03:42:32.428 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-05-10T03:42:32.429 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-05-10T03:42:32.429 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-05-10T03:42:32.430 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-05-10T03:42:32.431 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-05-10T03:42:32.432 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-05-10T03:42:32.432 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-05-10T03:42:32.433 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-05-10T03:42:32.434 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-05-10T03:42:32.435 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-05-10T03:42:32.436 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-05-10T03:42:32.437 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-05-10T03:42:32.437 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-05-10T03:42:32.438 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-05-10T03:42:32.439 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-05-10T03:42:32.440 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-05-10T03:42:32.440 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-05-10T03:42:32.441 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-05-10T03:42:32.442 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-05-10T03:42:32.442 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-05-10T03:42:32.443 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-05-10T03:42:32.444 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-05-10T03:42:32.444 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-05-10T03:42:32.445 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-05-10T03:42:32.446 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-05-10T03:42:32.446 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-05-10T03:42:32.447 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-05-10T03:42:32.448 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-05-10T03:42:32.448 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-05-10T03:42:32.449 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-05-10T03:42:32.450 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-05-10T03:42:32.451 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-05-10T03:42:32.452 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-05-10T03:42:32.453 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-05-10T03:42:32.454 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-05-10T03:42:32.455 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-05-10T03:42:32.456 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-05-10T03:42:32.456 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-05-10T03:42:32.457 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-05-10T03:42:32.458 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-05-10T03:42:32.459 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-05-10T03:42:32.459 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-05-10T03:42:32.460 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-05-10T03:42:32.461 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-05-10T03:42:32.461 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-05-10T03:42:32.462 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-05-10T03:42:32.463 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-05-10T03:42:32.464 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-05-10T03:42:32.464 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-05-10T03:42:32.465 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-05-10T03:42:32.466 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-05-10T03:42:32.467 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-05-10T03:42:32.467 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-05-10T03:42:32.468 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-05-10T03:42:32.469 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-05-10T03:42:32.469 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-05-10T03:42:32.470 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-05-10T03:42:32.471 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-05-10T03:42:32.471 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-05-10T03:42:32.472 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-05-10T03:42:32.472 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-05-10T03:42:32.473 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-05-10T03:42:32.474 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-05-10T03:42:32.604 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-05-10T03:42:32.605 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-05-10T03:42:32.605 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-05-10T03:42:32.606 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-05-10T03:42:32.607 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-05-10T03:42:32.607 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-05-10T03:42:32.609 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-05-10T03:42:32.610 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-05-10T03:42:32.611 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-05-10T03:42:32.612 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-05-10T03:42:32.613 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-05-10T03:42:32.614 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-05-10T03:42:32.615 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-05-10T03:42:32.616 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-05-10T03:42:32.617 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-05-10T03:42:32.617 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-05-10T03:42:32.618 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-05-10T03:42:32.619 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-05-10T03:42:32.620 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-05-10T03:42:32.621 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-05-10T03:42:32.622 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-05-10T03:42:32.622 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-05-10T03:42:32.623 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-05-10T03:42:32.624 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-05-10T03:42:32.625 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-05-10T03:42:32.626 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-05-10T03:42:32.627 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-05-10T03:42:32.628 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-05-10T03:42:32.629 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-05-10T03:42:32.630 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-05-10T03:42:32.631 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-05-10T03:42:32.632 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-05-10T03:42:32.633 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-05-10T03:42:32.633 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-05-10T03:42:32.634 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-05-10T03:42:32.635 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-05-10T03:42:32.636 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-05-10T03:42:32.637 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-05-10T03:42:32.639 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-05-10T03:42:32.639 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-05-10T03:42:32.641 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-05-10T03:42:32.642 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-05-10T03:42:32.643 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-05-10T03:42:32.644 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-05-10T03:42:32.644 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-05-10T03:42:32.645 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-05-10T03:42:32.646 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-05-10T03:42:32.647 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-05-10T03:42:32.648 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-05-10T03:42:32.649 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-05-10T03:42:32.650 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-05-10T03:42:32.650 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-05-10T03:42:32.651 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-05-10T03:42:32.652 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-05-10T03:42:32.653 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-05-10T03:42:32.653 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-05-10T03:42:32.654 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-05-10T03:42:32.655 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-05-10T03:42:32.656 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-05-10T03:42:32.657 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-05-10T03:42:32.657 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-05-10T03:42:32.658 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-05-10T03:42:32.658 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-05-10T03:42:32.659 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-05-10T03:42:32.660 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-05-10T03:42:32.660 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-05-10T03:42:32.661 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-05-10T03:42:32.662 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-05-10T03:42:32.662 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-05-10T03:42:32.663 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-05-10T03:42:32.664 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-05-10T03:42:32.665 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-05-10T03:42:32.666 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-05-10T03:42:32.666 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-05-10T03:42:32.667 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-05-10T03:42:32.668 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-05-10T03:42:32.668 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-05-10T03:42:32.669 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-05-10T03:42:32.670 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-05-10T03:42:32.670 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-05-10T03:42:32.671 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-05-10T03:42:32.672 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-05-10T03:42:32.672 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-05-10T03:42:32.673 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-05-10T03:42:32.674 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-05-10T03:42:32.674 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-05-10T03:42:32.675 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-05-10T03:42:32.676 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-05-10T03:42:32.676 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-05-10T03:42:32.677 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-05-10T03:42:32.678 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-05-10T03:42:32.678 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-05-10T03:42:32.679 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-05-10T03:42:32.680 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-05-10T03:42:32.680 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-05-10T03:42:32.681 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-05-10T03:42:32.682 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-05-10T03:42:32.682 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-05-10T03:42:32.683 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-05-10T03:42:32.684 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-05-10T03:42:32.684 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-05-10T03:42:32.685 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-05-10T03:42:32.686 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-05-10T03:42:32.686 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-05-10T03:42:32.687 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-05-10T03:42:32.688 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-05-10T03:42:32.688 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-05-10T03:42:32.689 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-05-10T03:42:32.690 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-05-10T03:42:32.690 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-05-10T03:42:32.691 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-05-10T03:42:32.692 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-05-10T03:42:32.692 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-05-10T03:42:32.693 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-05-10T03:42:32.694 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-05-10T03:42:32.694 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-05-10T03:42:32.695 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-05-10T03:42:32.696 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-05-10T03:42:32.696 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-05-10T03:42:32.697 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-05-10T03:42:32.698 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-05-10T03:42:32.698 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-05-10T03:42:32.699 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-05-10T03:42:32.700 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-05-10T03:42:32.701 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-05-10T03:42:32.701 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-05-10T03:42:32.702 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-05-10T03:42:32.703 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-05-10T03:42:32.703 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-05-10T03:42:32.704 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-05-10T03:42:32.705 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-05-10T03:42:32.705 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-05-10T03:42:32.706 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-05-10T03:42:32.707 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-05-10T03:42:32.708 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-05-10T03:42:32.709 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-05-10T03:42:32.709 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-05-10T03:42:32.710 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-05-10T03:42:32.711 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-05-10T03:42:32.712 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-05-10T03:42:32.714 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-05-10T03:42:32.714 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-05-10T03:42:32.715 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-05-10T03:42:32.716 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-05-10T03:42:32.716 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-05-10T03:42:32.717 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-05-10T03:42:32.718 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-05-10T03:42:32.719 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-05-10T03:42:32.720 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-05-10T03:42:32.721 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-05-10T03:42:32.722 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-05-10T03:42:32.723 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-05-10T03:42:32.724 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-05-10T03:42:32.725 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-05-10T03:42:32.726 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-05-10T03:42:32.727 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-05-10T03:42:32.728 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-05-10T03:42:32.728 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-05-10T03:42:32.729 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-05-10T03:42:32.730 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-05-10T03:42:32.731 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-05-10T03:42:32.731 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-05-10T03:42:32.732 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-05-10T03:42:32.733 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-05-10T03:42:32.734 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-05-10T03:42:32.735 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-05-10T03:42:32.736 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-05-10T03:42:32.736 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-05-10T03:42:32.737 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-05-10T03:42:32.738 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-05-10T03:42:32.739 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-05-10T03:42:32.740 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-05-10T03:42:32.741 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-05-10T03:42:32.742 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-05-10T03:42:32.743 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-05-10T03:42:32.744 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-05-10T03:42:32.744 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-05-10T03:42:32.745 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-05-10T03:42:32.746 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-05-10T03:42:32.751 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-05-10T03:42:32.751 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-05-10T03:42:32.751 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-05-10T03:42:32.751 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-05-10T03:42:32.751 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-05-10T03:42:32.752 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-05-10T03:42:32.752 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-05-10T03:42:32.753 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-05-10T03:42:32.754 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-05-10T03:42:32.755 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-05-10T03:42:32.756 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-05-10T03:42:32.757 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-05-10T03:42:32.758 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-05-10T03:42:32.759 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-05-10T03:42:32.760 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-05-10T03:42:32.761 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-05-10T03:42:32.762 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-05-10T03:42:32.763 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-05-10T03:42:32.764 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-05-10T03:42:32.765 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-05-10T03:42:32.766 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-05-10T03:42:32.767 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-05-10T03:42:32.767 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-05-10T03:42:32.768 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-05-10T03:42:32.769 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-05-10T03:42:32.770 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-05-10T03:42:32.771 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-05-10T03:42:32.772 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-05-10T03:42:32.772 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-05-10T03:42:32.773 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-05-10T03:42:32.774 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-05-10T03:42:32.775 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-05-10T03:42:32.776 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-05-10T03:42:32.777 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-05-10T03:42:32.778 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-05-10T03:42:32.779 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-05-10T03:42:32.780 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-05-10T03:42:32.781 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-05-10T03:42:32.782 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-05-10T03:42:32.782 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-05-10T03:42:32.783 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-05-10T03:42:32.784 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-05-10T03:42:32.785 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-05-10T03:42:32.785 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-05-10T03:42:32.786 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-05-10T03:42:32.787 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-05-10T03:42:32.788 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-05-10T03:42:32.788 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-05-10T03:42:32.789 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-05-10T03:42:32.790 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-05-10T03:42:32.791 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-05-10T03:42:32.792 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-05-10T03:42:32.792 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-05-10T03:42:32.793 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-05-10T03:42:32.794 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-05-10T03:42:32.794 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-05-10T03:42:32.795 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-05-10T03:42:32.796 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-05-10T03:42:32.796 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-05-10T03:42:32.797 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-05-10T03:42:32.798 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-05-10T03:42:32.799 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-05-10T03:42:32.800 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-05-10T03:42:32.801 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-05-10T03:42:32.802 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-05-10T03:42:32.803 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-05-10T03:42:32.804 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-05-10T03:42:32.805 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-05-10T03:42:32.805 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-05-10T03:42:32.806 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-05-10T03:42:32.807 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-05-10T03:42:32.808 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-05-10T03:42:32.809 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-05-10T03:42:32.810 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-05-10T03:42:32.810 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-05-10T03:42:32.811 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-05-10T03:42:32.812 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-05-10T03:42:32.813 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-05-10T03:42:32.813 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-05-10T03:42:32.814 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-05-10T03:42:32.815 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-05-10T03:42:32.816 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-05-10T03:42:32.817 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-05-10T03:42:32.818 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-05-10T03:42:32.818 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-05-10T03:42:32.819 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-05-10T03:42:32.820 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-05-10T03:42:32.821 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-05-10T03:42:32.822 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-05-10T03:42:32.823 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-05-10T03:42:32.824 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-05-10T03:42:32.825 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-05-10T03:42:32.826 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-05-10T03:42:32.826 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-05-10T03:42:32.827 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-05-10T03:42:32.828 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-05-10T03:42:32.828 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-05-10T03:42:32.829 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-05-10T03:42:32.830 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-05-10T03:42:32.831 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-05-10T03:42:32.831 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-05-10T03:42:32.832 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-05-10T03:42:32.833 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-05-10T03:42:32.834 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-05-10T03:42:32.834 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-05-10T03:42:32.835 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-05-10T03:42:32.836 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-05-10T03:42:32.837 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-05-10T03:42:32.838 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-05-10T03:42:32.839 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-05-10T03:42:32.840 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-05-10T03:42:32.841 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-05-10T03:42:32.842 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-05-10T03:42:32.843 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-05-10T03:42:32.844 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-05-10T03:42:32.845 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-05-10T03:42:32.846 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-05-10T03:42:32.846 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-05-10T03:42:32.847 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-05-10T03:42:32.848 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-05-10T03:42:32.848 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-05-10T03:42:32.849 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-05-10T03:42:32.850 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-05-10T03:42:32.851 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-05-10T03:42:32.852 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-05-10T03:42:32.853 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-05-10T03:42:32.854 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-05-10T03:42:32.854 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-05-10T03:42:32.855 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-05-10T03:42:32.856 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-05-10T03:42:32.857 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-05-10T03:42:32.858 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-05-10T03:42:32.859 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-05-10T03:42:32.860 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-05-10T03:42:32.861 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-05-10T03:42:32.862 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-05-10T03:42:32.862 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-05-10T03:42:32.863 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-05-10T03:42:32.864 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-05-10T03:42:32.865 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-05-10T03:42:32.865 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-05-10T03:42:32.866 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-05-10T03:42:32.867 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-05-10T03:42:32.868 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-05-10T03:42:32.869 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-05-10T03:42:32.870 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-05-10T03:42:32.871 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-05-10T03:42:32.871 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-05-10T03:42:32.872 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-05-10T03:42:32.873 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-05-10T03:42:32.874 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-05-10T03:42:32.875 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-05-10T03:42:32.876 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-05-10T03:42:32.876 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-05-10T03:42:32.877 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-05-10T03:42:32.878 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-05-10T03:42:32.879 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-05-10T03:42:32.880 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-05-10T03:42:32.881 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-05-10T03:42:32.881 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-05-10T03:42:32.882 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-05-10T03:42:32.883 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-05-10T03:42:32.883 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-05-10T03:42:32.884 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-05-10T03:42:32.885 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-05-10T03:42:32.886 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-05-10T03:42:32.887 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-05-10T03:42:32.888 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-05-10T03:42:32.889 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-05-10T03:42:32.891 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-05-10T03:42:32.892 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-05-10T03:42:32.893 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-05-10T03:42:32.894 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-05-10T03:42:32.895 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-05-10T03:42:32.896 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-05-10T03:42:32.897 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-05-10T03:42:32.898 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-05-10T03:42:32.899 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-05-10T03:42:32.900 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-05-10T03:42:32.900 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-05-10T03:42:32.901 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-05-10T03:42:32.902 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-05-10T03:42:32.903 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-05-10T03:42:32.904 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-05-10T03:42:32.904 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-05-10T03:42:32.905 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-05-10T03:42:32.906 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-05-10T03:42:32.907 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-05-10T03:42:32.907 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-05-10T03:42:32.908 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-05-10T03:42:32.909 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-05-10T03:42:32.910 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-05-10T03:42:32.911 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-05-10T03:42:32.911 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-05-10T03:42:32.912 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-05-10T03:42:32.913 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-05-10T03:42:32.915 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-05-10T03:42:32.916 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-05-10T03:42:32.917 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-05-10T03:42:32.917 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-05-10T03:42:32.919 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-05-10T03:42:32.920 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-05-10T03:42:32.921 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-05-10T03:42:32.921 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-05-10T03:42:32.922 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-05-10T03:42:32.924 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-05-10T03:42:32.925 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-05-10T03:42:32.926 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-05-10T03:42:32.926 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-05-10T03:42:32.928 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-05-10T03:42:32.929 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-05-10T03:42:32.930 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-05-10T03:42:32.930 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-05-10T03:42:32.931 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/digsig.txt 2024-05-10T03:42:32.932 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-05-10T03:42:32.934 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-05-10T03:42:32.936 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-05-10T03:42:32.937 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-05-10T03:42:32.938 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-05-10T03:42:32.939 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-05-10T03:42:32.940 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dontdiff 2024-05-10T03:42:32.941 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/driver-model/ 2024-05-10T03:42:32.943 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-05-10T03:42:32.944 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-05-10T03:42:32.946 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-05-10T03:42:32.947 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-05-10T03:42:32.948 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-05-10T03:42:32.949 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-05-10T03:42:32.954 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-05-10T03:42:32.954 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-05-10T03:42:32.954 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-05-10T03:42:32.954 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-05-10T03:42:32.956 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/ 2024-05-10T03:42:32.959 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-05-10T03:42:32.961 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-05-10T03:42:32.962 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-05-10T03:42:32.964 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-05-10T03:42:32.965 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-05-10T03:42:32.966 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-05-10T03:42:32.967 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-05-10T03:42:32.968 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-05-10T03:42:32.970 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-05-10T03:42:32.971 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-05-10T03:42:32.972 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-05-10T03:42:32.973 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-05-10T03:42:32.975 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-05-10T03:42:32.976 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-05-10T03:42:32.977 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-05-10T03:42:32.978 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-05-10T03:42:32.982 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-05-10T03:42:32.983 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-05-10T03:42:32.985 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/edac.txt 2024-05-10T03:42:32.986 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-05-10T03:42:32.988 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/eisa.txt 2024-05-10T03:42:32.989 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-05-10T03:42:32.990 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/extcon/ 2024-05-10T03:42:32.993 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-05-10T03:42:32.995 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-05-10T03:42:32.998 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-05-10T03:42:32.999 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-05-10T03:42:33.001 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-05-10T03:42:33.002 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/ 2024-05-10T03:42:33.005 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-05-10T03:42:33.006 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-05-10T03:42:33.008 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-05-10T03:42:33.010 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-05-10T03:42:33.011 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-05-10T03:42:33.012 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-05-10T03:42:33.013 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-05-10T03:42:33.014 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-05-10T03:42:33.015 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-05-10T03:42:33.016 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-05-10T03:42:33.017 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-05-10T03:42:33.018 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-05-10T03:42:33.019 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-05-10T03:42:33.020 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-05-10T03:42:33.021 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-05-10T03:42:33.021 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-05-10T03:42:33.022 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-05-10T03:42:33.023 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-05-10T03:42:33.024 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-05-10T03:42:33.025 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-05-10T03:42:33.026 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-05-10T03:42:33.027 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-05-10T03:42:33.028 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-05-10T03:42:33.029 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-05-10T03:42:33.029 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-05-10T03:42:33.030 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-05-10T03:42:33.031 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-05-10T03:42:33.033 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-05-10T03:42:33.033 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-05-10T03:42:33.034 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-05-10T03:42:33.035 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-05-10T03:42:33.037 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-05-10T03:42:33.037 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-05-10T03:42:33.038 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-05-10T03:42:33.039 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-05-10T03:42:33.040 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/ 2024-05-10T03:42:33.042 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-05-10T03:42:33.044 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-05-10T03:42:33.045 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-05-10T03:42:33.046 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-05-10T03:42:33.047 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-05-10T03:42:33.048 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-05-10T03:42:33.048 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-05-10T03:42:33.049 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-05-10T03:42:33.050 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-05-10T03:42:33.052 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-05-10T03:42:33.053 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-05-10T03:42:33.054 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-05-10T03:42:33.055 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-05-10T03:42:33.056 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-05-10T03:42:33.057 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-05-10T03:42:33.058 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-05-10T03:42:33.059 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-05-10T03:42:33.061 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-05-10T03:42:33.062 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-05-10T03:42:33.063 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-05-10T03:42:33.064 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-05-10T03:42:33.065 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-05-10T03:42:33.066 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-05-10T03:42:33.067 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-05-10T03:42:33.068 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-05-10T03:42:33.070 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-05-10T03:42:33.071 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-05-10T03:42:33.071 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-05-10T03:42:33.072 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-05-10T03:42:33.073 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-05-10T03:42:33.075 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-05-10T03:42:33.076 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-05-10T03:42:33.078 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-05-10T03:42:33.079 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-05-10T03:42:33.080 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-05-10T03:42:33.081 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-05-10T03:42:33.082 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-05-10T03:42:33.083 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-05-10T03:42:33.083 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-05-10T03:42:33.084 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-05-10T03:42:33.085 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-05-10T03:42:33.086 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-05-10T03:42:33.087 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-05-10T03:42:33.088 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-05-10T03:42:33.089 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-05-10T03:42:33.090 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-05-10T03:42:33.091 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-05-10T03:42:33.092 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-05-10T03:42:33.093 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-05-10T03:42:33.094 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-05-10T03:42:33.094 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-05-10T03:42:33.095 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-05-10T03:42:33.096 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-05-10T03:42:33.097 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-05-10T03:42:33.098 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-05-10T03:42:33.099 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-05-10T03:42:33.100 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-05-10T03:42:33.101 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-05-10T03:42:33.102 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-05-10T03:42:33.103 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-05-10T03:42:33.104 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-05-10T03:42:33.104 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-05-10T03:42:33.105 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-05-10T03:42:33.106 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-05-10T03:42:33.107 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-05-10T03:42:33.108 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-05-10T03:42:33.109 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-05-10T03:42:33.110 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-05-10T03:42:33.111 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-05-10T03:42:33.112 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-05-10T03:42:33.112 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-05-10T03:42:33.114 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-05-10T03:42:33.114 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-05-10T03:42:33.115 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-05-10T03:42:33.116 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-05-10T03:42:33.117 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-05-10T03:42:33.118 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-05-10T03:42:33.119 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-05-10T03:42:33.120 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-05-10T03:42:33.121 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-05-10T03:42:33.122 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-05-10T03:42:33.122 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-05-10T03:42:33.123 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-05-10T03:42:33.124 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-05-10T03:42:33.125 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-05-10T03:42:33.126 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-05-10T03:42:33.127 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-05-10T03:42:33.127 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-05-10T03:42:33.128 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-05-10T03:42:33.130 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-05-10T03:42:33.131 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-05-10T03:42:33.132 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-05-10T03:42:33.133 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-05-10T03:42:33.134 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-05-10T03:42:33.135 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-05-10T03:42:33.136 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-05-10T03:42:33.136 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-05-10T03:42:33.137 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-05-10T03:42:33.138 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-05-10T03:42:33.139 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-05-10T03:42:33.140 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-05-10T03:42:33.140 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-05-10T03:42:33.141 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-05-10T03:42:33.142 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-05-10T03:42:33.143 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-05-10T03:42:33.144 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-05-10T03:42:33.145 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-05-10T03:42:33.145 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-05-10T03:42:33.146 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-05-10T03:42:33.147 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-05-10T03:42:33.148 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-05-10T03:42:33.149 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-05-10T03:42:33.150 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-05-10T03:42:33.151 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-05-10T03:42:33.152 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-05-10T03:42:33.152 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-05-10T03:42:33.154 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-05-10T03:42:33.155 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-05-10T03:42:33.157 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-05-10T03:42:33.158 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fmc/ 2024-05-10T03:42:33.160 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-05-10T03:42:33.161 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-05-10T03:42:33.162 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-05-10T03:42:33.163 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-05-10T03:42:33.164 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-05-10T03:42:33.165 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-05-10T03:42:33.166 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-05-10T03:42:33.167 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-05-10T03:42:33.167 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-05-10T03:42:33.168 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-05-10T03:42:33.170 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-05-10T03:42:33.170 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/frv/ 2024-05-10T03:42:33.172 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-05-10T03:42:33.173 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-05-10T03:42:33.174 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-05-10T03:42:33.175 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-05-10T03:42:33.177 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-05-10T03:42:33.178 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-05-10T03:42:33.179 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-05-10T03:42:33.181 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-05-10T03:42:33.181 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-05-10T03:42:33.182 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-05-10T03:42:33.183 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-05-10T03:42:33.184 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/gcov.txt 2024-05-10T03:42:33.185 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-05-10T03:42:33.186 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/gpio/ 2024-05-10T03:42:33.188 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-05-10T03:42:33.189 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-05-10T03:42:33.190 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-05-10T03:42:33.191 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-05-10T03:42:33.192 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-05-10T03:42:33.192 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-05-10T03:42:33.193 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-05-10T03:42:33.194 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hid/ 2024-05-10T03:42:33.195 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-05-10T03:42:33.196 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-05-10T03:42:33.197 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-05-10T03:42:33.198 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-05-10T03:42:33.199 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-05-10T03:42:33.200 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/highuid.txt 2024-05-10T03:42:33.201 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hsi.txt 2024-05-10T03:42:33.202 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-05-10T03:42:33.202 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ 2024-05-10T03:42:33.205 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-05-10T03:42:33.205 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-05-10T03:42:33.206 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-05-10T03:42:33.207 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-05-10T03:42:33.208 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-05-10T03:42:33.209 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-05-10T03:42:33.209 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-05-10T03:42:33.210 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-05-10T03:42:33.211 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-05-10T03:42:33.212 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-05-10T03:42:33.212 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-05-10T03:42:33.213 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-05-10T03:42:33.214 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-05-10T03:42:33.215 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-05-10T03:42:33.216 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-05-10T03:42:33.217 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-05-10T03:42:33.217 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-05-10T03:42:33.218 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-05-10T03:42:33.219 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-05-10T03:42:33.220 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-05-10T03:42:33.221 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-05-10T03:42:33.222 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-05-10T03:42:33.222 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-05-10T03:42:33.223 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-05-10T03:42:33.224 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-05-10T03:42:33.225 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-05-10T03:42:33.226 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-05-10T03:42:33.227 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-05-10T03:42:33.228 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-05-10T03:42:33.229 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-05-10T03:42:33.229 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-05-10T03:42:33.230 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-05-10T03:42:33.231 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-05-10T03:42:33.232 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-05-10T03:42:33.233 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-05-10T03:42:33.234 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-05-10T03:42:33.235 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-05-10T03:42:33.236 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-05-10T03:42:33.236 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-05-10T03:42:33.237 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-05-10T03:42:33.238 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-05-10T03:42:33.239 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-05-10T03:42:33.240 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-05-10T03:42:33.240 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-05-10T03:42:33.241 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-05-10T03:42:33.242 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-05-10T03:42:33.243 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-05-10T03:42:33.244 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-05-10T03:42:33.245 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-05-10T03:42:33.246 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-05-10T03:42:33.247 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-05-10T03:42:33.248 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-05-10T03:42:33.248 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-05-10T03:42:33.249 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-05-10T03:42:33.250 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-05-10T03:42:33.251 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-05-10T03:42:33.252 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-05-10T03:42:33.252 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-05-10T03:42:33.253 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-05-10T03:42:33.254 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-05-10T03:42:33.255 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-05-10T03:42:33.256 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-05-10T03:42:33.256 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-05-10T03:42:33.257 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-05-10T03:42:33.258 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-05-10T03:42:33.259 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-05-10T03:42:33.260 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-05-10T03:42:33.261 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-05-10T03:42:33.261 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-05-10T03:42:33.262 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-05-10T03:42:33.263 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-05-10T03:42:33.264 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-05-10T03:42:33.265 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-05-10T03:42:33.265 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-05-10T03:42:33.266 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-05-10T03:42:33.267 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-05-10T03:42:33.268 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-05-10T03:42:33.269 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-05-10T03:42:33.270 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-05-10T03:42:33.270 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-05-10T03:42:33.271 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-05-10T03:42:33.272 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-05-10T03:42:33.273 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-05-10T03:42:33.273 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-05-10T03:42:33.274 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-05-10T03:42:33.275 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-05-10T03:42:33.276 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-05-10T03:42:33.277 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-05-10T03:42:33.278 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-05-10T03:42:33.278 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-05-10T03:42:33.279 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-05-10T03:42:33.280 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-05-10T03:42:33.281 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-05-10T03:42:33.281 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-05-10T03:42:33.282 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-05-10T03:42:33.283 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-05-10T03:42:33.283 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:33 smithi045 ceph-mon[42520]: pgmap v353: 129 pgs: 129 active+clean; 81 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 6.7 MiB/s wr, 35 op/s 2024-05-10T03:42:33.284 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-05-10T03:42:33.284 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-05-10T03:42:33.285 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-05-10T03:42:33.286 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-05-10T03:42:33.287 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-05-10T03:42:33.287 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-05-10T03:42:33.288 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-05-10T03:42:33.289 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-05-10T03:42:33.290 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-05-10T03:42:33.291 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-05-10T03:42:33.291 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-05-10T03:42:33.292 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-05-10T03:42:33.293 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-05-10T03:42:33.293 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-05-10T03:42:33.294 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-05-10T03:42:33.295 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-05-10T03:42:33.296 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-05-10T03:42:33.297 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-05-10T03:42:33.297 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-05-10T03:42:33.298 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-05-10T03:42:33.299 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-05-10T03:42:33.300 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-05-10T03:42:33.301 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-05-10T03:42:33.301 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-05-10T03:42:33.302 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-05-10T03:42:33.303 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-05-10T03:42:33.304 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-05-10T03:42:33.305 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-05-10T03:42:33.305 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-05-10T03:42:33.306 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-05-10T03:42:33.307 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-05-10T03:42:33.308 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-05-10T03:42:33.309 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-05-10T03:42:33.309 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-05-10T03:42:33.310 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-05-10T03:42:33.311 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-05-10T03:42:33.312 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-05-10T03:42:33.313 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-05-10T03:42:33.314 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-05-10T03:42:33.314 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-05-10T03:42:33.315 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-05-10T03:42:33.316 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/ 2024-05-10T03:42:33.318 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-05-10T03:42:33.319 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-05-10T03:42:33.320 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-05-10T03:42:33.321 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-05-10T03:42:33.322 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-05-10T03:42:33.323 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-05-10T03:42:33.324 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-05-10T03:42:33.324 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-05-10T03:42:33.325 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-05-10T03:42:33.326 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-05-10T03:42:33.327 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-05-10T03:42:33.328 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-05-10T03:42:33.329 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-05-10T03:42:33.329 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-05-10T03:42:33.330 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-05-10T03:42:33.331 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-05-10T03:42:33.332 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-05-10T03:42:33.332 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-05-10T03:42:33.333 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-05-10T03:42:33.334 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-05-10T03:42:33.335 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-05-10T03:42:33.335 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-05-10T03:42:33.336 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-05-10T03:42:33.337 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-05-10T03:42:33.338 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-05-10T03:42:33.339 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-05-10T03:42:33.341 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-05-10T03:42:33.341 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-05-10T03:42:33.342 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-05-10T03:42:33.343 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-05-10T03:42:33.344 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-05-10T03:42:33.345 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-05-10T03:42:33.346 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/summary 2024-05-10T03:42:33.347 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-05-10T03:42:33.348 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-05-10T03:42:33.349 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-05-10T03:42:33.350 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2o/ 2024-05-10T03:42:33.351 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2o/README 2024-05-10T03:42:33.352 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-05-10T03:42:33.354 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/ 2024-05-10T03:42:33.356 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-05-10T03:42:33.357 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-05-10T03:42:33.357 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-05-10T03:42:33.358 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/README 2024-05-10T03:42:33.359 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-05-10T03:42:33.360 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-05-10T03:42:33.361 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-05-10T03:42:33.362 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-05-10T03:42:33.362 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-05-10T03:42:33.363 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-05-10T03:42:33.365 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-05-10T03:42:33.365 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-05-10T03:42:33.366 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ide/ 2024-05-10T03:42:33.368 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-05-10T03:42:33.369 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-05-10T03:42:33.369 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-05-10T03:42:33.370 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-05-10T03:42:33.371 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-05-10T03:42:33.371 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-05-10T03:42:33.372 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-05-10T03:42:33.373 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/infiniband/ 2024-05-10T03:42:33.375 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-05-10T03:42:33.376 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-05-10T03:42:33.377 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-05-10T03:42:33.378 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-05-10T03:42:33.379 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-05-10T03:42:33.380 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/init.txt 2024-05-10T03:42:33.380 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/initrd.txt 2024-05-10T03:42:33.381 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/ 2024-05-10T03:42:33.383 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-05-10T03:42:33.384 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-05-10T03:42:33.385 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-05-10T03:42:33.386 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-05-10T03:42:33.387 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-05-10T03:42:33.388 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-05-10T03:42:33.389 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-05-10T03:42:33.389 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-05-10T03:42:33.390 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-05-10T03:42:33.391 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-05-10T03:42:33.391 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-05-10T03:42:33.392 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-05-10T03:42:33.393 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-05-10T03:42:33.394 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-05-10T03:42:33.395 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-05-10T03:42:33.395 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-05-10T03:42:33.396 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-05-10T03:42:33.397 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/input.txt 2024-05-10T03:42:33.398 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-05-10T03:42:33.399 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-05-10T03:42:33.399 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-05-10T03:42:33.400 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-05-10T03:42:33.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:33 smithi106 ceph-mon[46996]: pgmap v353: 129 pgs: 129 active+clean; 81 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 6.7 MiB/s wr, 35 op/s 2024-05-10T03:42:33.401 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-05-10T03:42:33.402 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-05-10T03:42:33.403 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-05-10T03:42:33.404 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-05-10T03:42:33.405 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-05-10T03:42:33.405 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-05-10T03:42:33.406 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-05-10T03:42:33.407 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-05-10T03:42:33.408 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-05-10T03:42:33.409 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-05-10T03:42:33.409 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-05-10T03:42:33.410 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-05-10T03:42:33.411 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ioctl/ 2024-05-10T03:42:33.412 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-05-10T03:42:33.414 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-05-10T03:42:33.415 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-05-10T03:42:33.415 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-05-10T03:42:33.416 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-05-10T03:42:33.417 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-05-10T03:42:33.418 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/iostats.txt 2024-05-10T03:42:33.418 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-05-10T03:42:33.419 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-05-10T03:42:33.420 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/ 2024-05-10T03:42:33.421 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-05-10T03:42:33.423 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-05-10T03:42:33.423 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-05-10T03:42:33.424 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-05-10T03:42:33.425 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-05-10T03:42:33.426 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-05-10T03:42:33.427 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README 2024-05-10T03:42:33.428 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-05-10T03:42:33.428 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-05-10T03:42:33.429 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-05-10T03:42:33.430 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-05-10T03:42:33.430 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-05-10T03:42:33.431 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-05-10T03:42:33.432 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-05-10T03:42:33.433 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-10T03:42:33.433 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-05-10T03:42:33.434 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-05-10T03:42:33.436 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-05-10T03:42:33.436 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-05-10T03:42:33.436 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-05-10T03:42:33.437 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-05-10T03:42:33.437 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-05-10T03:42:33.438 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-05-10T03:42:33.439 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-05-10T03:42:33.439 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-05-10T03:42:33.440 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-05-10T03:42:33.441 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-05-10T03:42:33.443 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-05-10T03:42:33.444 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-05-10T03:42:33.445 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-05-10T03:42:33.446 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-05-10T03:42:33.447 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-05-10T03:42:33.447 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/java.txt 2024-05-10T03:42:33.448 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kasan.txt 2024-05-10T03:42:33.449 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kbuild/ 2024-05-10T03:42:33.451 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-05-10T03:42:33.452 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-05-10T03:42:33.453 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-05-10T03:42:33.453 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-05-10T03:42:33.454 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-05-10T03:42:33.455 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-05-10T03:42:33.456 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-05-10T03:42:33.457 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kdump/ 2024-05-10T03:42:33.460 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-05-10T03:42:33.461 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-05-10T03:42:33.461 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-05-10T03:42:33.462 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-05-10T03:42:33.463 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-05-10T03:42:33.465 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-05-10T03:42:33.467 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-05-10T03:42:33.473 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-05-10T03:42:33.473 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:33 smithi154 ceph-mon[46565]: pgmap v353: 129 pgs: 129 active+clean; 81 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 6.7 MiB/s wr, 35 op/s 2024-05-10T03:42:33.474 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-05-10T03:42:33.478 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-05-10T03:42:33.480 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-05-10T03:42:33.480 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kobject.txt 2024-05-10T03:42:33.481 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-05-10T03:42:33.482 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kref.txt 2024-05-10T03:42:33.483 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-05-10T03:42:33.484 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/ 2024-05-10T03:42:33.485 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-05-10T03:42:33.486 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-05-10T03:42:33.487 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-05-10T03:42:33.487 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-05-10T03:42:33.488 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-05-10T03:42:33.489 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-05-10T03:42:33.489 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-05-10T03:42:33.490 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-05-10T03:42:33.490 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-05-10T03:42:33.491 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-05-10T03:42:33.492 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-05-10T03:42:33.493 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-05-10T03:42:33.493 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ldm.txt 2024-05-10T03:42:33.494 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/leds/ 2024-05-10T03:42:33.496 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-05-10T03:42:33.497 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-05-10T03:42:33.497 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-05-10T03:42:33.498 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-05-10T03:42:33.499 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-05-10T03:42:33.499 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-05-10T03:42:33.500 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-05-10T03:42:33.501 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-05-10T03:42:33.501 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-05-10T03:42:33.502 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-05-10T03:42:33.503 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-05-10T03:42:33.504 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-05-10T03:42:33.504 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/locking/ 2024-05-10T03:42:33.505 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-05-10T03:42:33.506 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-05-10T03:42:33.507 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-05-10T03:42:33.507 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-05-10T03:42:33.508 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-05-10T03:42:33.509 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-05-10T03:42:33.509 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-05-10T03:42:33.510 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-05-10T03:42:33.511 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-05-10T03:42:33.512 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-05-10T03:42:33.513 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-05-10T03:42:33.514 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/logo.gif 2024-05-10T03:42:33.515 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/logo.txt 2024-05-10T03:42:33.516 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/lzo.txt 2024-05-10T03:42:33.518 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/m68k/ 2024-05-10T03:42:33.520 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-05-10T03:42:33.521 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-05-10T03:42:33.522 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-05-10T03:42:33.524 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-05-10T03:42:33.524 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-05-10T03:42:33.525 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/md.txt 2024-05-10T03:42:33.527 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-05-10T03:42:33.528 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-05-10T03:42:33.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.609+0000 7fc7ff179700 1 -- 172.21.15.45:0/2425928780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7f8102d00 msgr2=0x7fc7f8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:33.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.609+0000 7fc7ff179700 1 --2- 172.21.15.45:0/2425928780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7f8102d00 0x7fc7f8103110 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8009990 tx=0x7fc7e8009ca0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.609+0000 7fc7ff179700 1 -- 172.21.15.45:0/2425928780 shutdown_connections 2024-05-10T03:42:33.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.609+0000 7fc7ff179700 1 --2- 172.21.15.45:0/2425928780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7f8101be0 0x7fc7f8101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.609+0000 7fc7ff179700 1 --2- 172.21.15.45:0/2425928780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7f81036a0 0x7fc7f8109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.609+0000 7fc7ff179700 1 --2- 172.21.15.45:0/2425928780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7f8102d00 0x7fc7f8103110 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.609+0000 7fc7ff179700 1 -- 172.21.15.45:0/2425928780 >> 172.21.15.45:0/2425928780 conn(0x7fc7f80fd1d0 msgr2=0x7fc7f80ff6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:33.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.609+0000 7fc7ff179700 1 -- 172.21.15.45:0/2425928780 shutdown_connections 2024-05-10T03:42:33.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.609+0000 7fc7ff179700 1 -- 172.21.15.45:0/2425928780 wait complete. 2024-05-10T03:42:33.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.610+0000 7fc7ff179700 1 Processor -- start 2024-05-10T03:42:33.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.610+0000 7fc7ff179700 1 -- start start 2024-05-10T03:42:33.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.611+0000 7fc7ff179700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7f8101be0 0x7fc7f8197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:33.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.611+0000 7fc7ff179700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7f8102d00 0x7fc7f81984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:33.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.611+0000 7fc7ff179700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7f81036a0 0x7fc7f819f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:33.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.611+0000 7fc7ff179700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f819fa80 con 0x7fc7f8101be0 2024-05-10T03:42:33.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.611+0000 7fc7ff179700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f819fbf0 con 0x7fc7f8102d00 2024-05-10T03:42:33.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.611+0000 7fc7ff179700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f819fdb0 con 0x7fc7f81036a0 2024-05-10T03:42:33.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.611+0000 7fc7fcf15700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7f8101be0 0x7fc7f8197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:33.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.611+0000 7fc7fcf15700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7f8101be0 0x7fc7f8197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57686/0 (socket says 172.21.15.45:57686) 2024-05-10T03:42:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.611+0000 7fc7fcf15700 1 -- 172.21.15.45:0/1981898132 learned_addr learned my addr 172.21.15.45:0/1981898132 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.611+0000 7fc7fd716700 1 --2- 172.21.15.45:0/1981898132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7f81036a0 0x7fc7f819f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.611+0000 7fc7effff700 1 --2- 172.21.15.45:0/1981898132 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7f8102d00 0x7fc7f81984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.611+0000 7fc7fcf15700 1 -- 172.21.15.45:0/1981898132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7f81036a0 msgr2=0x7fc7f819f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.611+0000 7fc7fcf15700 1 --2- 172.21.15.45:0/1981898132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7f81036a0 0x7fc7f819f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.611+0000 7fc7fcf15700 1 -- 172.21.15.45:0/1981898132 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7f8102d00 msgr2=0x7fc7f81984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.611+0000 7fc7fcf15700 1 --2- 172.21.15.45:0/1981898132 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7f8102d00 0x7fc7f81984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.611+0000 7fc7fcf15700 1 -- 172.21.15.45:0/1981898132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e80095f0 con 0x7fc7f8101be0 2024-05-10T03:42:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.612+0000 7fc7fcf15700 1 --2- 172.21.15.45:0/1981898132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7f8101be0 0x7fc7f8197fa0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc7f400ef70 tx=0x7fc7f400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.612+0000 7fc7edffb700 1 -- 172.21.15.45:0/1981898132 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4018070 con 0x7fc7f8101be0 2024-05-10T03:42:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.612+0000 7fc7ff179700 1 -- 172.21.15.45:0/1981898132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f81a0030 con 0x7fc7f8101be0 2024-05-10T03:42:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.612+0000 7fc7edffb700 1 -- 172.21.15.45:0/1981898132 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc7f400f040 con 0x7fc7f8101be0 2024-05-10T03:42:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.612+0000 7fc7edffb700 1 -- 172.21.15.45:0/1981898132 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4004310 con 0x7fc7f8101be0 2024-05-10T03:42:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.612+0000 7fc7ff179700 1 -- 172.21.15.45:0/1981898132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f81a0590 con 0x7fc7f8101be0 2024-05-10T03:42:33.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.614+0000 7fc7edffb700 1 -- 172.21.15.45:0/1981898132 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc7f4003a00 con 0x7fc7f8101be0 2024-05-10T03:42:33.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.615+0000 7fc7edffb700 1 --2- 172.21.15.45:0/1981898132 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc7e00a11c0 0x7fc7e00a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:33.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.615+0000 7fc7edffb700 1 -- 172.21.15.45:0/1981898132 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fc7f40ccb60 con 0x7fc7f8101be0 2024-05-10T03:42:33.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.615+0000 7fc7effff700 1 --2- 172.21.15.45:0/1981898132 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc7e00a11c0 0x7fc7e00a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:33.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.616+0000 7fc7effff700 1 --2- 172.21.15.45:0/1981898132 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc7e00a11c0 0x7fc7e00a36d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800b2e0 tx=0x7fc7e801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:33.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.616+0000 7fc80f4bdb80 1 Processor -- start 2024-05-10T03:42:33.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.616+0000 7fc80f4bdb80 1 -- start start 2024-05-10T03:42:33.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.616+0000 7fc80f4bdb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f77096a0 0x5651f7709af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:33.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.616+0000 7fc80f4bdb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651f770a570 0x5651f770a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:33.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.616+0000 7fc80f4bdb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651f770aec0 0x5651f77117c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:33.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.617+0000 7fc80f4bdb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651f7630150 con 0x5651f77096a0 2024-05-10T03:42:33.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.617+0000 7fc80f4bdb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651f762db10 con 0x5651f770a570 2024-05-10T03:42:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.617+0000 7fc80f4bdb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651f7629400 con 0x5651f770aec0 2024-05-10T03:42:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.617+0000 7fc7fcf15700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f77096a0 0x5651f7709af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.617+0000 7fc7fcf15700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f77096a0 0x5651f7709af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57702/0 (socket says 172.21.15.45:57702) 2024-05-10T03:42:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.617+0000 7fc7fcf15700 1 -- 172.21.15.45:0/2224062172 learned_addr learned my addr 172.21.15.45:0/2224062172 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.617+0000 7fc7fd716700 1 --2- 172.21.15.45:0/2224062172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651f770aec0 0x5651f77117c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.617+0000 7fc7effff700 1 --2- 172.21.15.45:0/2224062172 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651f770a570 0x5651f770a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.617+0000 7fc7fcf15700 1 -- 172.21.15.45:0/2224062172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651f770aec0 msgr2=0x5651f77117c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.617+0000 7fc7fcf15700 1 --2- 172.21.15.45:0/2224062172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651f770aec0 0x5651f77117c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.617+0000 7fc7fcf15700 1 -- 172.21.15.45:0/2224062172 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651f770a570 msgr2=0x5651f770a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.617+0000 7fc7fcf15700 1 --2- 172.21.15.45:0/2224062172 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651f770a570 0x5651f770a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.617+0000 7fc7fcf15700 1 -- 172.21.15.45:0/2224062172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651f74aa3b0 con 0x5651f77096a0 2024-05-10T03:42:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.617+0000 7fc7fcf15700 1 --2- 172.21.15.45:0/2224062172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f77096a0 0x5651f7709af0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4096140 tx=0x7fc7f4099a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d792175c124d70f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.617+0000 7fc7deffd700 1 -- 172.21.15.45:0/2224062172 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f409a340 con 0x5651f77096a0 2024-05-10T03:42:33.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.617+0000 7fc7deffd700 1 -- 172.21.15.45:0/2224062172 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc7f4099c40 con 0x5651f77096a0 2024-05-10T03:42:33.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.617+0000 7fc7deffd700 1 -- 172.21.15.45:0/2224062172 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f401b560 con 0x5651f77096a0 2024-05-10T03:42:33.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.618+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/2224062172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f77096a0 msgr2=0x5651f7709af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:33.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.618+0000 7fc80f4bdb80 1 --2- 172.21.15.45:0/2224062172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f77096a0 0x5651f7709af0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4096140 tx=0x7fc7f4099a10 comp rx=0 tx=0).stop 2024-05-10T03:42:33.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.618+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/2224062172 shutdown_connections 2024-05-10T03:42:33.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.618+0000 7fc80f4bdb80 1 --2- 172.21.15.45:0/2224062172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651f770aec0 0x5651f77117c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.618+0000 7fc80f4bdb80 1 --2- 172.21.15.45:0/2224062172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f77096a0 0x5651f7709af0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.618+0000 7fc80f4bdb80 1 --2- 172.21.15.45:0/2224062172 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651f770a570 0x5651f770a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.618+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/2224062172 >> 172.21.15.45:0/2224062172 conn(0x5651f766ba60 msgr2=0x5651f7703fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:33.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.618+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/2224062172 shutdown_connections 2024-05-10T03:42:33.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.618+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/2224062172 wait complete. 2024-05-10T03:42:33.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.619+0000 7fc80f4bdb80 1 -- start start 2024-05-10T03:42:33.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.619+0000 7fc80f4bdb80 1 Processor -- start 2024-05-10T03:42:33.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.619+0000 7fc80f4bdb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651f77096a0 0x5651f7713640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:33.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.619+0000 7fc80f4bdb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f770a570 0x5651f7713b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:33.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.619+0000 7fc80f4bdb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651f770aec0 0x5651f771aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:33.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.619+0000 7fc80f4bdb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651f75c5560 con 0x5651f770a570 2024-05-10T03:42:33.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.619+0000 7fc80f4bdb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651f75c5200 con 0x5651f77096a0 2024-05-10T03:42:33.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.619+0000 7fc80f4bdb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651f74ac6a0 con 0x5651f770aec0 2024-05-10T03:42:33.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.620+0000 7fc80f4bdb80 10 client.0 _ll_register_callbacks cb 0x5651f75ceb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:33.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.620+0000 7fc7effff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f770a570 0x5651f7713b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:33.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.620+0000 7fc7fd716700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651f770aec0 0x5651f771aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:33.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.620+0000 7fc7effff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f770a570 0x5651f7713b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57712/0 (socket says 172.21.15.45:57712) 2024-05-10T03:42:33.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.620+0000 7fc7fcf15700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651f77096a0 0x5651f7713640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:33.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.620+0000 7fc7effff700 1 -- 172.21.15.45:0/3793762119 learned_addr learned my addr 172.21.15.45:0/3793762119 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:33.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.620+0000 7fc7fd716700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651f770aec0 0x5651f771aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:53742/0 (socket says 172.21.15.45:53742) 2024-05-10T03:42:33.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.620+0000 7fc7effff700 1 -- 172.21.15.45:0/3793762119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651f770aec0 msgr2=0x5651f771aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:33.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.620+0000 7fc7effff700 1 --2- 172.21.15.45:0/3793762119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651f770aec0 0x5651f771aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.620+0000 7fc7effff700 1 -- 172.21.15.45:0/3793762119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651f77096a0 msgr2=0x5651f7713640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:33.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.620+0000 7fc7effff700 1 --2- 172.21.15.45:0/3793762119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651f77096a0 0x5651f7713640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.620+0000 7fc7effff700 1 -- 172.21.15.45:0/3793762119 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f81a0590 con 0x5651f770a570 2024-05-10T03:42:33.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.620+0000 7fc7effff700 1 --2- 172.21.15.45:0/3793762119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f770a570 0x5651f7713b80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8015000 tx=0x7fc7e8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a95e8a105605085 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:33.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.620+0000 7fc7d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:42:33.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.620+0000 7fc7d7fff700 1 -- 172.21.15.45:0/3793762119 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8031640 con 0x5651f770a570 2024-05-10T03:42:33.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.621+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/3793762119 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5651f7582270 con 0x5651f770a570 2024-05-10T03:42:33.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.621+0000 7fc7d7fff700 1 -- 172.21.15.45:0/3793762119 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fc7e8024410 con 0x5651f770a570 2024-05-10T03:42:33.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.621+0000 7fc7d7fff700 1 -- 172.21.15.45:0/3793762119 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7e80317a0 con 0x5651f770a570 2024-05-10T03:42:33.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.621+0000 7fc80f4bdb80 10 client.16302 fetch_fsmap learned FSMap version 29 2024-05-10T03:42:33.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.621+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/3793762119 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5651f7456b60 con 0x5651f770a570 2024-05-10T03:42:33.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.621+0000 7fc7d7fff700 1 -- 172.21.15.45:0/3793762119 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc7e803a080 con 0x5651f770a570 2024-05-10T03:42:33.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.621+0000 7fc7d7fff700 1 -- 172.21.15.45:0/3793762119 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 29) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fc7e80303e0 con 0x5651f770a570 2024-05-10T03:42:33.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.621+0000 7fc80f4bdb80 10 client.16302 fetch_fsmap finished waiting for FSMap version 29 2024-05-10T03:42:33.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.621+0000 7fc80f4bdb80 10 client.16302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:42:33.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.621+0000 7fc80f4bdb80 20 client.16302 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:33.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.621+0000 7fc80f4bdb80 1 --2- 172.21.15.45:0/3793762119 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5651f771f2b0 0x5651f7721700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:33.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.621+0000 7fc80f4bdb80 4 client.16302 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:42:33.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.621+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/3793762119 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5651f76d8780 con 0x5651f771f2b0 2024-05-10T03:42:33.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.622+0000 7fc7fcf15700 1 --2- 172.21.15.45:0/3793762119 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5651f771f2b0 0x5651f7721700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:33.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.622+0000 7fc7fcf15700 1 --2- 172.21.15.45:0/3793762119 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5651f771f2b0 0x5651f7721700 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4154d90bcd98e96f server_cookie=659acd3a15c5b13b in_seq=0 out_seq=0 2024-05-10T03:42:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.622+0000 7fc7d7fff700 10 client.16302 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.623+0000 7fc7d7fff700 1 -- 172.21.15.45:0/3793762119 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5651f76d8780 con 0x5651f771f2b0 2024-05-10T03:42:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.623+0000 7fc7d7fff700 10 client.16302 handle_command_reply: tid=0 2024-05-10T03:42:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.623+0000 7fc80f4bdb80 1 client.16302 shutdown 2024-05-10T03:42:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.623+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/3793762119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f770a570 msgr2=0x5651f7713b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.623+0000 7fc80f4bdb80 1 --2- 172.21.15.45:0/3793762119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f770a570 0x5651f7713b80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8015000 tx=0x7fc7e8009310 comp rx=0 tx=0).stop 2024-05-10T03:42:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.623+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/3793762119 shutdown_connections 2024-05-10T03:42:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.623+0000 7fc80f4bdb80 1 --2- 172.21.15.45:0/3793762119 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5651f771f2b0 0x5651f7721700 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.623+0000 7fc80f4bdb80 1 --2- 172.21.15.45:0/3793762119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651f770aec0 0x5651f771aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.623+0000 7fc80f4bdb80 1 --2- 172.21.15.45:0/3793762119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651f77096a0 0x5651f7713640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.623+0000 7fc80f4bdb80 1 --2- 172.21.15.45:0/3793762119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f770a570 0x5651f7713b80 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.623+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/3793762119 >> 172.21.15.45:0/3793762119 conn(0x5651f766ba60 msgr2=0x5651f7703fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.623+0000 7fc7d7fff700 0 client.16302 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.623+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/3793762119 shutdown_connections 2024-05-10T03:42:33.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.623+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/3793762119 wait complete. 2024-05-10T03:42:33.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.623+0000 7fc80f4bdb80 20 client.16302 trim_cache size 0 max 16384 2024-05-10T03:42:33.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.641+0000 7fc80f4bdb80 1 Processor -- start 2024-05-10T03:42:33.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.641+0000 7fc80f4bdb80 1 -- start start 2024-05-10T03:42:33.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.641+0000 7fc80f4bdb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651f77096a0 0x5651f7718a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:33.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.642+0000 7fc80f4bdb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651f770a570 0x5651f7718fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:33.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.642+0000 7fc80f4bdb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f770aec0 0x5651f770e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:33.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.642+0000 7fc80f4bdb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651f7714720 con 0x5651f770aec0 2024-05-10T03:42:33.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.642+0000 7fc80f4bdb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651f7705770 con 0x5651f77096a0 2024-05-10T03:42:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.642+0000 7fc80f4bdb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651f76fe7c0 con 0x5651f770a570 2024-05-10T03:42:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.642+0000 7fc7fd716700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f770aec0 0x5651f770e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.642+0000 7fc7fd716700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f770aec0 0x5651f770e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57714/0 (socket says 172.21.15.45:57714) 2024-05-10T03:42:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.642+0000 7fc7fd716700 1 -- 172.21.15.45:0/2129210763 learned_addr learned my addr 172.21.15.45:0/2129210763 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.642+0000 7fc7fcf15700 1 --2- 172.21.15.45:0/2129210763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651f77096a0 0x5651f7718a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.642+0000 7fc7effff700 1 --2- 172.21.15.45:0/2129210763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651f770a570 0x5651f7718fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.642+0000 7fc7fd716700 1 -- 172.21.15.45:0/2129210763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651f770a570 msgr2=0x5651f7718fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.642+0000 7fc7fd716700 1 --2- 172.21.15.45:0/2129210763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651f770a570 0x5651f7718fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.642+0000 7fc7fd716700 1 -- 172.21.15.45:0/2129210763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651f77096a0 msgr2=0x5651f7718a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.642+0000 7fc7fd716700 1 --2- 172.21.15.45:0/2129210763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651f77096a0 0x5651f7718a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.642+0000 7fc7fd716700 1 -- 172.21.15.45:0/2129210763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651f75ef560 con 0x5651f770aec0 2024-05-10T03:42:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.642+0000 7fc7fd716700 1 --2- 172.21.15.45:0/2129210763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f770aec0 0x5651f770e350 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc7f000b830 tx=0x7fc7f000bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4559bcda7795b465 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.642+0000 7fc7df7fe700 1 -- 172.21.15.45:0/2129210763 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f001f070 con 0x5651f770aec0 2024-05-10T03:42:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.642+0000 7fc7df7fe700 1 -- 172.21.15.45:0/2129210763 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc7f0017040 con 0x5651f770aec0 2024-05-10T03:42:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.642+0000 7fc7df7fe700 1 -- 172.21.15.45:0/2129210763 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f0016070 con 0x5651f770aec0 2024-05-10T03:42:33.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.643+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/2129210763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f770aec0 msgr2=0x5651f770e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:33.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.643+0000 7fc80f4bdb80 1 --2- 172.21.15.45:0/2129210763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f770aec0 0x5651f770e350 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc7f000b830 tx=0x7fc7f000bb40 comp rx=0 tx=0).stop 2024-05-10T03:42:33.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.643+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/2129210763 shutdown_connections 2024-05-10T03:42:33.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.643+0000 7fc80f4bdb80 1 --2- 172.21.15.45:0/2129210763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f770aec0 0x5651f770e350 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.643+0000 7fc80f4bdb80 1 --2- 172.21.15.45:0/2129210763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651f77096a0 0x5651f7718a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.643+0000 7fc80f4bdb80 1 --2- 172.21.15.45:0/2129210763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651f770a570 0x5651f7718fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.643+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/2129210763 >> 172.21.15.45:0/2129210763 conn(0x5651f766ba60 msgr2=0x5651f7713640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:33.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.643+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/2129210763 shutdown_connections 2024-05-10T03:42:33.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.643+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/2129210763 wait complete. 2024-05-10T03:42:33.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.644+0000 7fc80f4bdb80 1 -- start start 2024-05-10T03:42:33.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.644+0000 7fc80f4bdb80 1 Processor -- start 2024-05-10T03:42:33.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.644+0000 7fc80f4bdb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651f77096a0 0x5651f7718710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:33.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.644+0000 7fc80f4bdb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f770a570 0x5651f7718c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:33.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.644+0000 7fc80f4bdb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651f770aec0 0x5651f7773d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:33.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.644+0000 7fc80f4bdb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651f77742d0 con 0x5651f770a570 2024-05-10T03:42:33.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.644+0000 7fc80f4bdb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651f7774440 con 0x5651f77096a0 2024-05-10T03:42:33.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.644+0000 7fc80f4bdb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651f7774600 con 0x5651f770aec0 2024-05-10T03:42:33.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.644+0000 7fc80f4bdb80 10 client.0 _ll_register_callbacks cb 0x5651f75ceb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:33.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.645+0000 7fc7effff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f770a570 0x5651f7718c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:33.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.645+0000 7fc7fcf15700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651f77096a0 0x5651f7718710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:33.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.645+0000 7fc7effff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f770a570 0x5651f7718c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57730/0 (socket says 172.21.15.45:57730) 2024-05-10T03:42:33.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.645+0000 7fc7effff700 1 -- 172.21.15.45:0/2237021503 learned_addr learned my addr 172.21.15.45:0/2237021503 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:33.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.645+0000 7fc7fd716700 1 --2- 172.21.15.45:0/2237021503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651f770aec0 0x5651f7773d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:33.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.645+0000 7fc7effff700 1 -- 172.21.15.45:0/2237021503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651f770aec0 msgr2=0x5651f7773d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:33.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.645+0000 7fc7effff700 1 --2- 172.21.15.45:0/2237021503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651f770aec0 0x5651f7773d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.645+0000 7fc7effff700 1 -- 172.21.15.45:0/2237021503 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651f77096a0 msgr2=0x5651f7718710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:33.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.645+0000 7fc7effff700 1 --2- 172.21.15.45:0/2237021503 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651f77096a0 0x5651f7718710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.645+0000 7fc7effff700 1 -- 172.21.15.45:0/2237021503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f0004550 con 0x5651f770a570 2024-05-10T03:42:33.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.645+0000 7fc7fcf15700 1 --2- 172.21.15.45:0/2237021503 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651f77096a0 0x5651f7718710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:33.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.645+0000 7fc7effff700 1 --2- 172.21.15.45:0/2237021503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f770a570 0x5651f7718c50 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8006010 tx=0x7fc7e8030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a540fdb209dd00 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:33.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.645+0000 7fc7d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:42:33.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.645+0000 7fc7d7fff700 1 -- 172.21.15.45:0/2237021503 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8024820 con 0x5651f770a570 2024-05-10T03:42:33.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.645+0000 7fc7d7fff700 1 -- 172.21.15.45:0/2237021503 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fc7e803d070 con 0x5651f770a570 2024-05-10T03:42:33.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.645+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/2237021503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc7f4099c40 con 0x5651f770a570 2024-05-10T03:42:33.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.646+0000 7fc7d7fff700 1 -- 172.21.15.45:0/2237021503 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7e8030e50 con 0x5651f770a570 2024-05-10T03:42:33.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.646+0000 7fc80f4bdb80 10 client.16308 fetch_fsmap learned FSMap version 29 2024-05-10T03:42:33.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.646+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/2237021503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5651f74aecd0 con 0x5651f770a570 2024-05-10T03:42:33.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.646+0000 7fc7d7fff700 1 -- 172.21.15.45:0/2237021503 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc7f4099c40 con 0x5651f770a570 2024-05-10T03:42:33.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.646+0000 7fc7d7fff700 1 -- 172.21.15.45:0/2237021503 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 29) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fc7e80173f0 con 0x5651f770a570 2024-05-10T03:42:33.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.646+0000 7fc80f4bdb80 10 client.16308 fetch_fsmap finished waiting for FSMap version 29 2024-05-10T03:42:33.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.646+0000 7fc80f4bdb80 10 client.16308 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:42:33.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.646+0000 7fc80f4bdb80 20 client.16308 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:33.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.646+0000 7fc80f4bdb80 1 --2- 172.21.15.45:0/2237021503 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5651f7775b10 0x5651f7777f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:33.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.646+0000 7fc80f4bdb80 4 client.16308 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T03:42:33.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.646+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/2237021503 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5651f7621ec0 con 0x5651f7775b10 2024-05-10T03:42:33.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.646+0000 7fc7fcf15700 1 --2- 172.21.15.45:0/2237021503 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5651f7775b10 0x5651f7777f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:33.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.647+0000 7fc7d7fff700 10 client.16308 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:33.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.647+0000 7fc7fcf15700 1 --2- 172.21.15.45:0/2237021503 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5651f7775b10 0x5651f7777f30 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea3fea09eb40874f server_cookie=952204b78441a80f in_seq=0 out_seq=0 2024-05-10T03:42:33.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.647+0000 7fc7d7fff700 1 -- 172.21.15.45:0/2237021503 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5651f7621ec0 con 0x5651f7775b10 2024-05-10T03:42:33.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.647+0000 7fc7d7fff700 10 client.16308 handle_command_reply: tid=0 2024-05-10T03:42:33.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.647+0000 7fc80f4bdb80 1 client.16308 shutdown 2024-05-10T03:42:33.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.647+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/2237021503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f770a570 msgr2=0x5651f7718c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:33.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.647+0000 7fc80f4bdb80 1 --2- 172.21.15.45:0/2237021503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f770a570 0x5651f7718c50 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8006010 tx=0x7fc7e8030d60 comp rx=0 tx=0).stop 2024-05-10T03:42:33.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.647+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/2237021503 shutdown_connections 2024-05-10T03:42:33.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.647+0000 7fc80f4bdb80 1 --2- 172.21.15.45:0/2237021503 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5651f7775b10 0x5651f7777f30 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.647+0000 7fc80f4bdb80 1 --2- 172.21.15.45:0/2237021503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651f770aec0 0x5651f7773d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.647+0000 7fc80f4bdb80 1 --2- 172.21.15.45:0/2237021503 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651f77096a0 0x5651f7718710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.647+0000 7fc80f4bdb80 1 --2- 172.21.15.45:0/2237021503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5651f770a570 0x5651f7718c50 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.647+0000 7fc7d7fff700 0 client.16308 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:33.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.647+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/2237021503 >> 172.21.15.45:0/2237021503 conn(0x5651f766ba60 msgr2=0x5651f770e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:33.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.647+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/2237021503 shutdown_connections 2024-05-10T03:42:33.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.647+0000 7fc80f4bdb80 1 -- 172.21.15.45:0/2237021503 wait complete. 2024-05-10T03:42:33.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.648+0000 7fc80f4bdb80 20 client.16308 trim_cache size 0 max 16384 2024-05-10T03:42:33.657 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:42:33.657 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-05-10T03:42:33.657 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-05-10T03:42:33.657 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:42:33.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.648+0000 7fc7ff179700 1 -- 172.21.15.45:0/1981898132 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc7e00a11c0 msgr2=0x7fc7e00a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:33.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.648+0000 7fc7ff179700 1 --2- 172.21.15.45:0/1981898132 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc7e00a11c0 0x7fc7e00a36d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800b2e0 tx=0x7fc7e801a040 comp rx=0 tx=0).stop 2024-05-10T03:42:33.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.648+0000 7fc7ff179700 1 -- 172.21.15.45:0/1981898132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7f8101be0 msgr2=0x7fc7f8197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:33.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.648+0000 7fc7ff179700 1 --2- 172.21.15.45:0/1981898132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7f8101be0 0x7fc7f8197fa0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc7f400ef70 tx=0x7fc7f400c3a0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.648+0000 7fc7ff179700 1 -- 172.21.15.45:0/1981898132 shutdown_connections 2024-05-10T03:42:33.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.648+0000 7fc7ff179700 1 --2- 172.21.15.45:0/1981898132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7f81036a0 0x7fc7f819f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.648+0000 7fc7ff179700 1 --2- 172.21.15.45:0/1981898132 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc7e00a11c0 0x7fc7e00a36d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.648+0000 7fc7ff179700 1 --2- 172.21.15.45:0/1981898132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7f8101be0 0x7fc7f8197fa0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.648+0000 7fc7ff179700 1 --2- 172.21.15.45:0/1981898132 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7f8102d00 0x7fc7f81984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.648+0000 7fc7ff179700 1 -- 172.21.15.45:0/1981898132 >> 172.21.15.45:0/1981898132 conn(0x7fc7f80fd1d0 msgr2=0x7fc7f8105f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:33.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.648+0000 7fc7ff179700 1 -- 172.21.15.45:0/1981898132 shutdown_connections 2024-05-10T03:42:33.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.648+0000 7fc7ff179700 1 -- 172.21.15.45:0/1981898132 wait complete. 2024-05-10T03:42:33.666 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-10T03:42:33.666 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:42:33.730 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-05-10T03:42:33.732 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-05-10T03:42:33.733 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-05-10T03:42:33.733 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/metag/ 2024-05-10T03:42:33.735 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-05-10T03:42:33.736 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-05-10T03:42:33.737 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mic/ 2024-05-10T03:42:33.738 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-05-10T03:42:33.739 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-05-10T03:42:33.740 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-05-10T03:42:33.740 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-05-10T03:42:33.741 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-05-10T03:42:33.742 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-05-10T03:42:33.742 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-05-10T03:42:33.743 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-05-10T03:42:33.744 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-05-10T03:42:33.744 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-05-10T03:42:33.745 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mips/ 2024-05-10T03:42:33.747 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-05-10T03:42:33.747 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-05-10T03:42:33.748 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-05-10T03:42:33.749 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-05-10T03:42:33.750 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-05-10T03:42:33.751 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-05-10T03:42:33.752 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-05-10T03:42:33.752 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-05-10T03:42:33.753 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-05-10T03:42:33.754 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-05-10T03:42:33.754 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-05-10T03:42:33.755 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-05-10T03:42:33.756 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-05-10T03:42:33.756 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-05-10T03:42:33.757 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-05-10T03:42:33.758 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-05-10T03:42:33.759 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-05-10T03:42:33.759 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-05-10T03:42:33.760 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-05-10T03:42:33.761 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-05-10T03:42:33.761 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-05-10T03:42:33.762 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mmc/ 2024-05-10T03:42:33.763 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-05-10T03:42:33.764 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-05-10T03:42:33.765 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-05-10T03:42:33.766 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-05-10T03:42:33.766 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mn10300/ 2024-05-10T03:42:33.768 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-05-10T03:42:33.769 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-05-10T03:42:33.769 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-05-10T03:42:33.771 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mono.txt 2024-05-10T03:42:33.771 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mtd/ 2024-05-10T03:42:33.773 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-05-10T03:42:33.773 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-05-10T03:42:33.778 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-05-10T03:42:33.778 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-05-10T03:42:33.778 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/namespaces/ 2024-05-10T03:42:33.779 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-05-10T03:42:33.779 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-05-10T03:42:33.779 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/netlabel/ 2024-05-10T03:42:33.780 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-05-10T03:42:33.781 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-05-10T03:42:33.782 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-05-10T03:42:33.782 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-05-10T03:42:33.783 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-05-10T03:42:33.784 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ 2024-05-10T03:42:33.785 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-05-10T03:42:33.786 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-05-10T03:42:33.787 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-05-10T03:42:33.787 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-05-10T03:42:33.788 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-05-10T03:42:33.789 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-05-10T03:42:33.789 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-05-10T03:42:33.790 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-05-10T03:42:33.791 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-05-10T03:42:33.791 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-05-10T03:42:33.792 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-05-10T03:42:33.793 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-05-10T03:42:33.793 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-05-10T03:42:33.794 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-05-10T03:42:33.795 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-05-10T03:42:33.796 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-05-10T03:42:33.797 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-05-10T03:42:33.797 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-05-10T03:42:33.798 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-05-10T03:42:33.799 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-05-10T03:42:33.800 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-05-10T03:42:33.801 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-05-10T03:42:33.802 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-05-10T03:42:33.802 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-05-10T03:42:33.803 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-05-10T03:42:33.804 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-05-10T03:42:33.804 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-05-10T03:42:33.805 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-05-10T03:42:33.806 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-05-10T03:42:33.806 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-05-10T03:42:33.807 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-05-10T03:42:33.808 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-05-10T03:42:33.808 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-05-10T03:42:33.809 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-05-10T03:42:33.810 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-05-10T03:42:33.811 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-05-10T03:42:33.811 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-05-10T03:42:33.812 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-05-10T03:42:33.813 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-05-10T03:42:33.813 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-05-10T03:42:33.814 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-05-10T03:42:33.815 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-05-10T03:42:33.815 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-05-10T03:42:33.816 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-05-10T03:42:33.817 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-05-10T03:42:33.817 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-05-10T03:42:33.818 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-05-10T03:42:33.819 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-05-10T03:42:33.820 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-05-10T03:42:33.820 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-05-10T03:42:33.821 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-05-10T03:42:33.822 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-05-10T03:42:33.822 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-05-10T03:42:33.823 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-05-10T03:42:33.823 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-05-10T03:42:33.825 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-05-10T03:42:33.825 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-05-10T03:42:33.825 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-05-10T03:42:33.826 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-05-10T03:42:33.827 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-05-10T03:42:33.827 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-05-10T03:42:33.828 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-05-10T03:42:33.829 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-05-10T03:42:33.830 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-05-10T03:42:33.830 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-05-10T03:42:33.831 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-05-10T03:42:33.831 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-05-10T03:42:33.832 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-05-10T03:42:33.833 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-05-10T03:42:33.834 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-05-10T03:42:33.834 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-05-10T03:42:33.835 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-05-10T03:42:33.836 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-05-10T03:42:33.836 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-05-10T03:42:33.837 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-05-10T03:42:33.838 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-05-10T03:42:33.838 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-05-10T03:42:33.839 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-05-10T03:42:33.840 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-05-10T03:42:33.841 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-05-10T03:42:33.841 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-05-10T03:42:33.842 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-05-10T03:42:33.843 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-05-10T03:42:33.843 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-05-10T03:42:33.844 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-05-10T03:42:33.845 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-05-10T03:42:33.846 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-05-10T03:42:33.847 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-05-10T03:42:33.847 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-05-10T03:42:33.848 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-05-10T03:42:33.849 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-05-10T03:42:33.849 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-05-10T03:42:33.850 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-05-10T03:42:33.851 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-05-10T03:42:33.852 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-05-10T03:42:33.852 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-05-10T03:42:33.853 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-05-10T03:42:33.857 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-05-10T03:42:33.858 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-05-10T03:42:33.859 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-05-10T03:42:33.860 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-05-10T03:42:33.860 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-05-10T03:42:33.861 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-05-10T03:42:33.862 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-05-10T03:42:33.862 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-05-10T03:42:33.863 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-05-10T03:42:33.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.861+0000 7fb459d10700 1 -- 172.21.15.45:0/1687119633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb454103690 msgr2=0x7fb454109f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:33.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.861+0000 7fb459d10700 1 --2- 172.21.15.45:0/1687119633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb454103690 0x7fb454109f40 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb44c00b0a0 tx=0x7fb44c00b3b0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.861+0000 7fb459d10700 1 -- 172.21.15.45:0/1687119633 shutdown_connections 2024-05-10T03:42:33.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.861+0000 7fb459d10700 1 --2- 172.21.15.45:0/1687119633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb454101bd0 0x7fb454101fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.861+0000 7fb459d10700 1 --2- 172.21.15.45:0/1687119633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb454103690 0x7fb454109f40 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.861+0000 7fb459d10700 1 --2- 172.21.15.45:0/1687119633 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb454102cf0 0x7fb454103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.861+0000 7fb459d10700 1 -- 172.21.15.45:0/1687119633 >> 172.21.15.45:0/1687119633 conn(0x7fb4540fd1e0 msgr2=0x7fb4540ff690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:33.865 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-05-10T03:42:33.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.861+0000 7fb459d10700 1 -- 172.21.15.45:0/1687119633 shutdown_connections 2024-05-10T03:42:33.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.861+0000 7fb459d10700 1 -- 172.21.15.45:0/1687119633 wait complete. 2024-05-10T03:42:33.866 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-05-10T03:42:33.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.861+0000 7fb459d10700 1 Processor -- start 2024-05-10T03:42:33.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.862+0000 7fb459d10700 1 -- start start 2024-05-10T03:42:33.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.862+0000 7fb459d10700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb454101bd0 0x7fb4541981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:33.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.862+0000 7fb459d10700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb454102cf0 0x7fb454198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:33.867 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-05-10T03:42:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.862+0000 7fb459d10700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb454103690 0x7fb45419f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.862+0000 7fb459d10700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45419fc80 con 0x7fb454103690 2024-05-10T03:42:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.862+0000 7fb459d10700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45419fdf0 con 0x7fb454101bd0 2024-05-10T03:42:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.862+0000 7fb459d10700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45419ffb0 con 0x7fb454102cf0 2024-05-10T03:42:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.862+0000 7fb453fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb454103690 0x7fb45419f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.862+0000 7fb452ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb454102cf0 0x7fb454198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.862+0000 7fb452ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb454102cf0 0x7fb454198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:53778/0 (socket says 172.21.15.45:53778) 2024-05-10T03:42:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.862+0000 7fb453fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb454103690 0x7fb45419f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57754/0 (socket says 172.21.15.45:57754) 2024-05-10T03:42:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.862+0000 7fb452ffd700 1 -- 172.21.15.45:0/3404392851 learned_addr learned my addr 172.21.15.45:0/3404392851 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.862+0000 7fb4537fe700 1 --2- 172.21.15.45:0/3404392851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb454101bd0 0x7fb4541981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.863+0000 7fb452ffd700 1 -- 172.21.15.45:0/3404392851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb454101bd0 msgr2=0x7fb4541981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.863+0000 7fb452ffd700 1 --2- 172.21.15.45:0/3404392851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb454101bd0 0x7fb4541981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.863+0000 7fb452ffd700 1 -- 172.21.15.45:0/3404392851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb454103690 msgr2=0x7fb45419f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.863+0000 7fb452ffd700 1 --2- 172.21.15.45:0/3404392851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb454103690 0x7fb45419f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.863+0000 7fb452ffd700 1 -- 172.21.15.45:0/3404392851 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c009d00 con 0x7fb454102cf0 2024-05-10T03:42:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.863+0000 7fb453fff700 1 --2- 172.21.15.45:0/3404392851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb454103690 0x7fb45419f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:33.869 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-05-10T03:42:33.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.863+0000 7fb452ffd700 1 --2- 172.21.15.45:0/3404392851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb454102cf0 0x7fb454198730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb44800e9a0 tx=0x7fb44800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:33.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.863+0000 7fb450ff9700 1 -- 172.21.15.45:0/3404392851 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb448009790 con 0x7fb454102cf0 2024-05-10T03:42:33.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.863+0000 7fb459d10700 1 -- 172.21.15.45:0/3404392851 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4541a0290 con 0x7fb454102cf0 2024-05-10T03:42:33.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.863+0000 7fb450ff9700 1 -- 172.21.15.45:0/3404392851 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb448010430 con 0x7fb454102cf0 2024-05-10T03:42:33.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.863+0000 7fb450ff9700 1 -- 172.21.15.45:0/3404392851 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb448018680 con 0x7fb454102cf0 2024-05-10T03:42:33.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.863+0000 7fb459d10700 1 -- 172.21.15.45:0/3404392851 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4541a07f0 con 0x7fb454102cf0 2024-05-10T03:42:33.871 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-05-10T03:42:33.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.864+0000 7fb459d10700 1 -- 172.21.15.45:0/3404392851 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb454108de0 con 0x7fb454102cf0 2024-05-10T03:42:33.872 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-05-10T03:42:33.872 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-05-10T03:42:33.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.866+0000 7fb450ff9700 1 -- 172.21.15.45:0/3404392851 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb448010910 con 0x7fb454102cf0 2024-05-10T03:42:33.872 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-05-10T03:42:33.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.866+0000 7fb450ff9700 1 --2- 172.21.15.45:0/3404392851 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb43c0a1120 0x7fb43c0a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:33.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.866+0000 7fb4537fe700 1 --2- 172.21.15.45:0/3404392851 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb43c0a1120 0x7fb43c0a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:33.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.866+0000 7fb450ff9700 1 -- 172.21.15.45:0/3404392851 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb448014070 con 0x7fb454102cf0 2024-05-10T03:42:33.873 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-05-10T03:42:33.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.867+0000 7fb4537fe700 1 --2- 172.21.15.45:0/3404392851 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb43c0a1120 0x7fb43c0a3630 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb454102bf0 tx=0x7fb444009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:33.874 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-05-10T03:42:33.874 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-05-10T03:42:33.874 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-05-10T03:42:33.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:33.870+0000 7fb450ff9700 1 -- 172.21.15.45:0/3404392851 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb448096290 con 0x7fb454102cf0 2024-05-10T03:42:33.875 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-05-10T03:42:33.875 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-05-10T03:42:33.876 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-05-10T03:42:33.876 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-05-10T03:42:33.876 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-05-10T03:42:33.876 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-05-10T03:42:33.877 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-05-10T03:42:33.877 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-05-10T03:42:33.878 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-05-10T03:42:33.879 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-05-10T03:42:33.879 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-05-10T03:42:33.880 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-05-10T03:42:33.880 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-05-10T03:42:33.881 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-05-10T03:42:33.882 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-05-10T03:42:33.882 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-05-10T03:42:33.883 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-05-10T03:42:33.884 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/nfc/ 2024-05-10T03:42:33.885 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-05-10T03:42:33.886 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-05-10T03:42:33.887 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/nios2/ 2024-05-10T03:42:33.889 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/nios2/README 2024-05-10T03:42:33.890 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-05-10T03:42:33.890 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/numastat.txt 2024-05-10T03:42:33.891 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-05-10T03:42:33.892 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/padata.txt 2024-05-10T03:42:33.893 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/parisc/ 2024-05-10T03:42:33.894 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-05-10T03:42:33.895 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-05-10T03:42:33.895 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/parisc/registers 2024-05-10T03:42:33.896 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-05-10T03:42:33.897 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/parport.txt 2024-05-10T03:42:33.898 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-05-10T03:42:33.899 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-05-10T03:42:33.900 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-05-10T03:42:33.900 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-05-10T03:42:33.901 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-05-10T03:42:33.902 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-05-10T03:42:33.902 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-05-10T03:42:33.904 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-05-10T03:42:33.904 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-05-10T03:42:33.904 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/phy.txt 2024-05-10T03:42:33.905 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/phy/ 2024-05-10T03:42:33.907 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-05-10T03:42:33.908 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-05-10T03:42:33.908 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-05-10T03:42:33.909 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/platform/ 2024-05-10T03:42:33.911 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-05-10T03:42:33.912 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pnp.txt 2024-05-10T03:42:33.913 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/ 2024-05-10T03:42:33.914 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-05-10T03:42:33.915 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-05-10T03:42:33.916 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-05-10T03:42:33.917 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-05-10T03:42:33.917 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-05-10T03:42:33.918 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-05-10T03:42:33.919 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-05-10T03:42:33.920 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-05-10T03:42:33.920 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-05-10T03:42:33.921 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-05-10T03:42:33.922 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-05-10T03:42:33.922 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-05-10T03:42:33.923 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-05-10T03:42:33.924 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-05-10T03:42:33.925 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-05-10T03:42:33.925 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-05-10T03:42:33.926 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-05-10T03:42:33.927 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-05-10T03:42:33.928 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-05-10T03:42:33.928 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-05-10T03:42:33.929 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-05-10T03:42:33.929 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-05-10T03:42:33.930 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-05-10T03:42:33.931 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/states.txt 2024-05-10T03:42:33.932 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-05-10T03:42:33.933 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-05-10T03:42:33.933 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-05-10T03:42:33.934 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-05-10T03:42:33.935 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-05-10T03:42:33.935 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-05-10T03:42:33.936 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-05-10T03:42:33.937 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/video.txt 2024-05-10T03:42:33.937 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/ 2024-05-10T03:42:33.939 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-05-10T03:42:33.940 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-05-10T03:42:33.940 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-05-10T03:42:33.941 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-05-10T03:42:33.941 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-05-10T03:42:33.942 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-05-10T03:42:33.943 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-05-10T03:42:33.943 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-05-10T03:42:33.944 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-05-10T03:42:33.945 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-05-10T03:42:33.945 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-05-10T03:42:33.946 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-05-10T03:42:33.947 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-05-10T03:42:33.947 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pps/ 2024-05-10T03:42:33.949 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-05-10T03:42:33.949 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/prctl/ 2024-05-10T03:42:33.951 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-05-10T03:42:33.952 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-05-10T03:42:33.952 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-05-10T03:42:33.953 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-05-10T03:42:33.953 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-05-10T03:42:33.954 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-05-10T03:42:33.955 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-05-10T03:42:33.956 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-05-10T03:42:33.956 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-05-10T03:42:33.957 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pti/ 2024-05-10T03:42:33.959 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-05-10T03:42:33.960 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ptp/ 2024-05-10T03:42:33.961 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-05-10T03:42:33.962 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-05-10T03:42:33.962 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-05-10T03:42:33.963 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-05-10T03:42:33.964 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-05-10T03:42:33.964 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pwm.txt 2024-05-10T03:42:33.965 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-05-10T03:42:33.966 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/rapidio/ 2024-05-10T03:42:33.968 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-05-10T03:42:33.969 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-05-10T03:42:33.969 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-05-10T03:42:33.970 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-05-10T03:42:33.971 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-05-10T03:42:33.971 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-05-10T03:42:33.972 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-05-10T03:42:33.973 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-05-10T03:42:33.974 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-05-10T03:42:33.974 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/rtc.txt 2024-05-10T03:42:33.975 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/ 2024-05-10T03:42:33.977 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-05-10T03:42:33.978 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-05-10T03:42:33.982 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-05-10T03:42:33.982 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-05-10T03:42:33.982 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/DASD 2024-05-10T03:42:33.982 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-05-10T03:42:33.982 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-05-10T03:42:33.982 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-05-10T03:42:33.983 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-05-10T03:42:33.983 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-05-10T03:42:33.984 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-05-10T03:42:33.985 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-05-10T03:42:33.985 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-05-10T03:42:33.986 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-05-10T03:42:33.987 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scheduler/ 2024-05-10T03:42:33.988 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-05-10T03:42:33.989 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-05-10T03:42:33.990 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-05-10T03:42:33.991 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-05-10T03:42:33.991 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-05-10T03:42:33.992 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-05-10T03:42:33.993 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-05-10T03:42:33.993 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-05-10T03:42:33.994 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-05-10T03:42:33.995 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-05-10T03:42:33.995 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ 2024-05-10T03:42:33.997 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-05-10T03:42:33.998 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-05-10T03:42:33.999 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-05-10T03:42:34.000 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-05-10T03:42:34.000 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-05-10T03:42:34.001 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-05-10T03:42:34.002 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-05-10T03:42:34.003 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-05-10T03:42:34.004 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-05-10T03:42:34.004 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-05-10T03:42:34.005 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-05-10T03:42:34.006 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-05-10T03:42:34.006 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-05-10T03:42:34.007 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-05-10T03:42:34.008 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-05-10T03:42:34.008 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-05-10T03:42:34.009 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-05-10T03:42:34.010 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-05-10T03:42:34.010 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-05-10T03:42:34.011 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-05-10T03:42:34.012 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-05-10T03:42:34.012 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-05-10T03:42:34.013 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-05-10T03:42:34.014 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-05-10T03:42:34.014 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-05-10T03:42:34.015 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-05-10T03:42:34.016 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-05-10T03:42:34.016 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-05-10T03:42:34.017 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-05-10T03:42:34.018 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-05-10T03:42:34.018 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-05-10T03:42:34.019 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-05-10T03:42:34.020 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-05-10T03:42:34.020 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-05-10T03:42:34.021 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-05-10T03:42:34.022 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-05-10T03:42:34.022 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-05-10T03:42:34.026 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-05-10T03:42:34.027 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-05-10T03:42:34.027 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-05-10T03:42:34.028 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-05-10T03:42:34.029 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-05-10T03:42:34.029 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-05-10T03:42:34.030 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-05-10T03:42:34.031 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-05-10T03:42:34.031 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-05-10T03:42:34.032 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-05-10T03:42:34.033 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-05-10T03:42:34.033 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-05-10T03:42:34.034 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-05-10T03:42:34.035 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-05-10T03:42:34.035 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-05-10T03:42:34.036 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-05-10T03:42:34.037 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-05-10T03:42:34.038 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-05-10T03:42:34.038 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-05-10T03:42:34.039 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-05-10T03:42:34.040 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-05-10T03:42:34.040 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-05-10T03:42:34.041 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/ 2024-05-10T03:42:34.042 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-05-10T03:42:34.043 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-05-10T03:42:34.044 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-05-10T03:42:34.045 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-05-10T03:42:34.045 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-05-10T03:42:34.046 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-05-10T03:42:34.047 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-05-10T03:42:34.047 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-05-10T03:42:34.048 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-05-10T03:42:34.049 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-05-10T03:42:34.049 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-05-10T03:42:34.050 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-05-10T03:42:34.051 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-05-10T03:42:34.051 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-05-10T03:42:34.052 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/serial/ 2024-05-10T03:42:34.054 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-05-10T03:42:34.055 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-05-10T03:42:34.056 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/serial/driver 2024-05-10T03:42:34.056 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-05-10T03:42:34.057 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-05-10T03:42:34.058 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-05-10T03:42:34.058 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-05-10T03:42:34.059 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-05-10T03:42:34.060 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-05-10T03:42:34.060 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sh/ 2024-05-10T03:42:34.062 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-05-10T03:42:34.062 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-05-10T03:42:34.063 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-05-10T03:42:34.064 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/ 2024-05-10T03:42:34.065 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-05-10T03:42:34.066 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-05-10T03:42:34.067 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-05-10T03:42:34.068 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-05-10T03:42:34.069 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-05-10T03:42:34.069 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-05-10T03:42:34.070 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-05-10T03:42:34.070 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-05-10T03:42:34.071 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-05-10T03:42:34.072 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-05-10T03:42:34.072 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-05-10T03:42:34.073 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-05-10T03:42:34.074 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-05-10T03:42:34.074 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-05-10T03:42:34.075 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-05-10T03:42:34.076 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-05-10T03:42:34.076 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-05-10T03:42:34.077 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-05-10T03:42:34.078 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-05-10T03:42:34.079 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-05-10T03:42:34.079 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-05-10T03:42:34.080 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-05-10T03:42:34.080 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-05-10T03:42:34.081 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-05-10T03:42:34.082 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-05-10T03:42:34.082 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-05-10T03:42:34.083 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-05-10T03:42:34.084 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-05-10T03:42:34.085 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-05-10T03:42:34.086 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-05-10T03:42:34.086 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-05-10T03:42:34.087 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-05-10T03:42:34.088 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-05-10T03:42:34.088 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-05-10T03:42:34.089 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-05-10T03:42:34.090 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-05-10T03:42:34.090 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-05-10T03:42:34.091 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-05-10T03:42:34.092 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-05-10T03:42:34.093 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-05-10T03:42:34.094 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-05-10T03:42:34.094 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-05-10T03:42:34.095 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-05-10T03:42:34.096 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-05-10T03:42:34.096 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-05-10T03:42:34.097 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-05-10T03:42:34.098 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-05-10T03:42:34.098 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-05-10T03:42:34.099 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-05-10T03:42:34.100 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-05-10T03:42:34.100 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-05-10T03:42:34.101 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-05-10T03:42:34.102 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-05-10T03:42:34.102 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-05-10T03:42:34.103 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-05-10T03:42:34.104 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-05-10T03:42:34.104 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-05-10T03:42:34.105 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-05-10T03:42:34.106 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-05-10T03:42:34.106 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-05-10T03:42:34.107 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-05-10T03:42:34.108 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-05-10T03:42:34.108 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sparse.txt 2024-05-10T03:42:34.109 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/ 2024-05-10T03:42:34.111 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-05-10T03:42:34.112 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-05-10T03:42:34.112 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-05-10T03:42:34.113 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-05-10T03:42:34.114 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-05-10T03:42:34.114 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-05-10T03:42:34.115 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-05-10T03:42:34.116 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-05-10T03:42:34.116 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-05-10T03:42:34.117 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/spidev 2024-05-10T03:42:34.118 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-05-10T03:42:34.118 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-05-10T03:42:34.119 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-05-10T03:42:34.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.160+0000 7fb459d10700 1 -- 172.21.15.45:0/3404392851 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4540678b0 con 0x7fb454102cf0 2024-05-10T03:42:34.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.161+0000 7fb450ff9700 1 -- 172.21.15.45:0/3404392851 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+10927 (secure 0 0 0) 0x7fb4480105a0 con 0x7fb454102cf0 2024-05-10T03:42:34.165 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:42:34.165 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/378320264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":378320264},{"type":"v1","addr":"172.21.15.45:6835","nonce":378320264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3032381796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3032381796},{"type":"v1","addr":"172.21.15.45:6837","nonce":3032381796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T03:38:36.555290+0000","modified":"2024-05-10T03:42:26.005175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24548,"mds_2":24547,"mds_3":24526,"mds_4":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14625":{"gid":14625,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6839/4007419304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":4007419304},{"type":"v1","addr":"172.21.15.45:6839","nonce":4007419304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14637":{"gid":14637,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6841/1355456195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1355456195},{"type":"v1","addr":"172.21.15.45:6841","nonce":1355456195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/4037121210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":4037121210},{"type":"v1","addr":"172.21.15.154:6835","nonce":4037121210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24521":{"gid":24521,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.106:6835/4162885659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4162885659},{"type":"v1","addr":"172.21.15.106:6835","nonce":4162885659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.154:6837/608167481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":608167481},{"type":"v1","addr":"172.21.15.154:6837","nonce":608167481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6839/1506563336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1506563336},{"type":"v1","addr":"172.21.15.154:6839","nonce":1506563336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.106:6837/3047487403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":3047487403},{"type":"v1","addr":"172.21.15.106:6837","nonce":3047487403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6839/3533867856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":3533867856},{"type":"v1","addr":"172.21.15.106:6839","nonce":3533867856}]},"join_fscid":-1,"export_targets":[2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T03:42:34.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.164+0000 7fb459d10700 1 -- 172.21.15.45:0/3404392851 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb43c0a1120 msgr2=0x7fb43c0a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.164+0000 7fb459d10700 1 --2- 172.21.15.45:0/3404392851 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb43c0a1120 0x7fb43c0a3630 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb454102bf0 tx=0x7fb444009260 comp rx=0 tx=0).stop 2024-05-10T03:42:34.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.164+0000 7fb459d10700 1 -- 172.21.15.45:0/3404392851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb454102cf0 msgr2=0x7fb454198730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.164+0000 7fb459d10700 1 --2- 172.21.15.45:0/3404392851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb454102cf0 0x7fb454198730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb44800e9a0 tx=0x7fb44800ecb0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.164+0000 7fb459d10700 1 -- 172.21.15.45:0/3404392851 shutdown_connections 2024-05-10T03:42:34.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.164+0000 7fb459d10700 1 --2- 172.21.15.45:0/3404392851 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb43c0a1120 0x7fb43c0a3630 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.164+0000 7fb459d10700 1 --2- 172.21.15.45:0/3404392851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb454103690 0x7fb45419f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.164+0000 7fb459d10700 1 --2- 172.21.15.45:0/3404392851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb454101bd0 0x7fb4541981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.164+0000 7fb459d10700 1 --2- 172.21.15.45:0/3404392851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb454102cf0 0x7fb454198730 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.164+0000 7fb459d10700 1 -- 172.21.15.45:0/3404392851 >> 172.21.15.45:0/3404392851 conn(0x7fb4540fd1e0 msgr2=0x7fb454105f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:34.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.164+0000 7fb459d10700 1 -- 172.21.15.45:0/3404392851 shutdown_connections 2024-05-10T03:42:34.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.164+0000 7fb459d10700 1 -- 172.21.15.45:0/3404392851 wait complete. 2024-05-10T03:42:34.169 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 29 2024-05-10T03:42:34.182 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-05-10T03:42:34.249 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-05-10T03:42:34.250 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-05-10T03:42:34.251 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/svga.txt 2024-05-10T03:42:34.252 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sysctl/ 2024-05-10T03:42:34.255 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-05-10T03:42:34.256 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sysctl/README 2024-05-10T03:42:34.257 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-05-10T03:42:34.258 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-05-10T03:42:34.259 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-05-10T03:42:34.260 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-05-10T03:42:34.268 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-05-10T03:42:34.271 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-05-10T03:42:34.272 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-05-10T03:42:34.273 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-05-10T03:42:34.274 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/target/ 2024-05-10T03:42:34.276 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-05-10T03:42:34.277 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-05-10T03:42:34.279 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-05-10T03:42:34.280 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/thermal/ 2024-05-10T03:42:34.282 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-05-10T03:42:34.283 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-05-10T03:42:34.284 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-05-10T03:42:34.285 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-05-10T03:42:34.286 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-05-10T03:42:34.287 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-05-10T03:42:34.288 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-05-10T03:42:34.294 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-05-10T03:42:34.305 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/timers/ 2024-05-10T03:42:34.307 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-05-10T03:42:34.308 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-05-10T03:42:34.309 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-05-10T03:42:34.310 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-05-10T03:42:34.311 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-05-10T03:42:34.312 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-05-10T03:42:34.313 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-05-10T03:42:34.314 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-05-10T03:42:34.315 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-05-10T03:42:34.316 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-05-10T03:42:34.317 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-05-10T03:42:34.318 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/tpm/ 2024-05-10T03:42:34.320 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-05-10T03:42:34.321 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/ 2024-05-10T03:42:34.334 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-05-10T03:42:34.335 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-05-10T03:42:34.343 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-05-10T03:42:34.344 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-05-10T03:42:34.345 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-05-10T03:42:34.346 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-05-10T03:42:34.347 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-05-10T03:42:34.348 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-05-10T03:42:34.349 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-05-10T03:42:34.350 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-05-10T03:42:34.351 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-05-10T03:42:34.353 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-05-10T03:42:34.354 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-05-10T03:42:34.355 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-05-10T03:42:34.356 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-05-10T03:42:34.357 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-05-10T03:42:34.358 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-05-10T03:42:34.368 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-05-10T03:42:34.369 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/unicode.txt 2024-05-10T03:42:34.370 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/unshare.txt 2024-05-10T03:42:34.371 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/ 2024-05-10T03:42:34.374 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-05-10T03:42:34.375 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-05-10T03:42:34.376 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-05-10T03:42:34.377 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-05-10T03:42:34.378 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-05-10T03:42:34.379 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-05-10T03:42:34.380 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-05-10T03:42:34.381 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-05-10T03:42:34.382 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-05-10T03:42:34.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.379+0000 7f614d6dd700 1 -- 172.21.15.45:0/36705813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f614810d6e0 msgr2=0x7f614810daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.379+0000 7f614d6dd700 1 --2- 172.21.15.45:0/36705813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f614810d6e0 0x7f614810daf0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f613c009990 tx=0x7f613c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.379+0000 7f614d6dd700 1 -- 172.21.15.45:0/36705813 shutdown_connections 2024-05-10T03:42:34.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.379+0000 7f614d6dd700 1 --2- 172.21.15.45:0/36705813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f614810c610 0x7f614810ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.379+0000 7f614d6dd700 1 --2- 172.21.15.45:0/36705813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f614810e080 0x7f6148114930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.379+0000 7f614d6dd700 1 --2- 172.21.15.45:0/36705813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f614810d6e0 0x7f614810daf0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.379+0000 7f614d6dd700 1 -- 172.21.15.45:0/36705813 >> 172.21.15.45:0/36705813 conn(0x7f614806c820 msgr2=0x7f614810a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:34.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.379+0000 7f614d6dd700 1 -- 172.21.15.45:0/36705813 shutdown_connections 2024-05-10T03:42:34.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.379+0000 7f614d6dd700 1 -- 172.21.15.45:0/36705813 wait complete. 2024-05-10T03:42:34.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.380+0000 7f614d6dd700 1 Processor -- start 2024-05-10T03:42:34.384 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-05-10T03:42:34.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.380+0000 7f614d6dd700 1 -- start start 2024-05-10T03:42:34.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.380+0000 7f614d6dd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f614810c610 0x7f61481a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.380+0000 7f614d6dd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f614810d6e0 0x7f61481a2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.380+0000 7f614d6dd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f614810e080 0x7f61481a9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.380+0000 7f614d6dd700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61481aa480 con 0x7f614810d6e0 2024-05-10T03:42:34.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.380+0000 7f614d6dd700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61481aa5f0 con 0x7f614810c610 2024-05-10T03:42:34.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.380+0000 7f614d6dd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61481aa7b0 con 0x7f614810e080 2024-05-10T03:42:34.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.381+0000 7f61467fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f614810d6e0 0x7f61481a2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.381+0000 7f61467fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f614810d6e0 0x7f61481a2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57770/0 (socket says 172.21.15.45:57770) 2024-05-10T03:42:34.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.381+0000 7f61467fc700 1 -- 172.21.15.45:0/4085996357 learned_addr learned my addr 172.21.15.45:0/4085996357 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:34.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.381+0000 7f61477fe700 1 --2- 172.21.15.45:0/4085996357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f614810e080 0x7f61481a9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.381+0000 7f6146ffd700 1 --2- 172.21.15.45:0/4085996357 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f614810c610 0x7f61481a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.381+0000 7f61467fc700 1 -- 172.21.15.45:0/4085996357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f614810e080 msgr2=0x7f61481a9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.381+0000 7f61467fc700 1 --2- 172.21.15.45:0/4085996357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f614810e080 0x7f61481a9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.381+0000 7f61467fc700 1 -- 172.21.15.45:0/4085996357 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f614810c610 msgr2=0x7f61481a29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.381+0000 7f61467fc700 1 --2- 172.21.15.45:0/4085996357 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f614810c610 0x7f61481a29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.381+0000 7f61467fc700 1 -- 172.21.15.45:0/4085996357 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f613c0095f0 con 0x7f614810d6e0 2024-05-10T03:42:34.387 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-05-10T03:42:34.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.381+0000 7f61467fc700 1 --2- 172.21.15.45:0/4085996357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f614810d6e0 0x7f61481a2ee0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f613c0098e0 tx=0x7f613c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:34.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.381+0000 7f612ffff700 1 -- 172.21.15.45:0/4085996357 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c01d070 con 0x7f614810d6e0 2024-05-10T03:42:34.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.381+0000 7f612ffff700 1 -- 172.21.15.45:0/4085996357 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f613c00fdb0 con 0x7f614810d6e0 2024-05-10T03:42:34.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.381+0000 7f612ffff700 1 -- 172.21.15.45:0/4085996357 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c017650 con 0x7f614810d6e0 2024-05-10T03:42:34.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.381+0000 7f614d6dd700 1 -- 172.21.15.45:0/4085996357 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61481aaa30 con 0x7f614810d6e0 2024-05-10T03:42:34.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.381+0000 7f614d6dd700 1 -- 172.21.15.45:0/4085996357 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61481aae50 con 0x7f614810d6e0 2024-05-10T03:42:34.388 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-05-10T03:42:34.388 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-05-10T03:42:34.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.384+0000 7f612ffff700 1 -- 172.21.15.45:0/4085996357 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f613c0177b0 con 0x7f614810d6e0 2024-05-10T03:42:34.389 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-05-10T03:42:34.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.384+0000 7f612ffff700 1 --2- 172.21.15.45:0/4085996357 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f61300a1240 0x7f61300a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.385+0000 7f612ffff700 1 -- 172.21.15.45:0/4085996357 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f613c0cdf40 con 0x7f614810d6e0 2024-05-10T03:42:34.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.385+0000 7f6146ffd700 1 --2- 172.21.15.45:0/4085996357 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f61300a1240 0x7f61300a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.390 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-05-10T03:42:34.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.385+0000 7f6146ffd700 1 --2- 172.21.15.45:0/4085996357 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f61300a1240 0x7f61300a3750 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f614810d5e0 tx=0x7f6138009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:34.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.385+0000 7f615da21b80 1 Processor -- start 2024-05-10T03:42:34.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.385+0000 7f615da21b80 1 -- start start 2024-05-10T03:42:34.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.386+0000 7f615da21b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564accfa66a0 0x564accfa6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.386+0000 7f615da21b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa7570 0x564accfa7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.386+0000 7f615da21b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564accfa7ec0 0x564accfae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.386+0000 7f615da21b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564accecd150 con 0x564accfa7ec0 2024-05-10T03:42:34.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.386+0000 7f615da21b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564accecab10 con 0x564accfa66a0 2024-05-10T03:42:34.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.386+0000 7f615da21b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x564accec6400 con 0x564accfa7570 2024-05-10T03:42:34.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.386+0000 7f61477fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564accfa7ec0 0x564accfae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.386+0000 7f61477fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564accfa7ec0 0x564accfae7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57782/0 (socket says 172.21.15.45:57782) 2024-05-10T03:42:34.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.386+0000 7f61477fe700 1 -- 172.21.15.45:0/164931062 learned_addr learned my addr 172.21.15.45:0/164931062 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:34.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.386+0000 7f61467fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa7570 0x564accfa7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.386+0000 7f6146ffd700 1 --2- 172.21.15.45:0/164931062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564accfa66a0 0x564accfa6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.396 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-05-10T03:42:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.386+0000 7f61467fc700 1 -- 172.21.15.45:0/164931062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564accfa66a0 msgr2=0x564accfa6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.386+0000 7f61467fc700 1 --2- 172.21.15.45:0/164931062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564accfa66a0 0x564accfa6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.386+0000 7f61467fc700 1 -- 172.21.15.45:0/164931062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564accfa7ec0 msgr2=0x564accfae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.386+0000 7f61467fc700 1 --2- 172.21.15.45:0/164931062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564accfa7ec0 0x564accfae7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.386+0000 7f61467fc700 1 -- 172.21.15.45:0/164931062 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564accd473b0 con 0x564accfa7570 2024-05-10T03:42:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.386+0000 7f61477fe700 1 --2- 172.21.15.45:0/164931062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564accfa7ec0 0x564accfae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:34.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.386+0000 7f6146ffd700 1 --2- 172.21.15.45:0/164931062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564accfa66a0 0x564accfa6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:42:34.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.386+0000 7f61467fc700 1 --2- 172.21.15.45:0/164931062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa7570 0x564accfa7980 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f613c0cb6f0 tx=0x7f613c005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9739df9ad4295a78 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:34.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.387+0000 7f612d7fa700 1 -- 172.21.15.45:0/164931062 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c09e020 con 0x564accfa7570 2024-05-10T03:42:34.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.387+0000 7f612d7fa700 1 -- 172.21.15.45:0/164931062 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f613c09b780 con 0x564accfa7570 2024-05-10T03:42:34.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.387+0000 7f612d7fa700 1 -- 172.21.15.45:0/164931062 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c09b2e0 con 0x564accfa7570 2024-05-10T03:42:34.398 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-05-10T03:42:34.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.388+0000 7f615da21b80 1 -- 172.21.15.45:0/164931062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa7570 msgr2=0x564accfa7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.388+0000 7f615da21b80 1 --2- 172.21.15.45:0/164931062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa7570 0x564accfa7980 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f613c0cb6f0 tx=0x7f613c005f10 comp rx=0 tx=0).stop 2024-05-10T03:42:34.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.388+0000 7f615da21b80 1 -- 172.21.15.45:0/164931062 shutdown_connections 2024-05-10T03:42:34.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.388+0000 7f615da21b80 1 --2- 172.21.15.45:0/164931062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564accfa7ec0 0x564accfae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.388+0000 7f615da21b80 1 --2- 172.21.15.45:0/164931062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564accfa66a0 0x564accfa6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.388+0000 7f615da21b80 1 --2- 172.21.15.45:0/164931062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa7570 0x564accfa7980 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.388+0000 7f615da21b80 1 -- 172.21.15.45:0/164931062 >> 172.21.15.45:0/164931062 conn(0x564accf08a60 msgr2=0x564accfa0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:34.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.388+0000 7f615da21b80 1 -- 172.21.15.45:0/164931062 shutdown_connections 2024-05-10T03:42:34.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.388+0000 7f615da21b80 1 -- 172.21.15.45:0/164931062 wait complete. 2024-05-10T03:42:34.400 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-05-10T03:42:34.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.388+0000 7f615da21b80 1 -- start start 2024-05-10T03:42:34.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.388+0000 7f615da21b80 1 Processor -- start 2024-05-10T03:42:34.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.389+0000 7f615da21b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564accfa66a0 0x564accfb0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.389+0000 7f615da21b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa7570 0x564accfb0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.389+0000 7f615da21b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564accfa7ec0 0x564accfb78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.389+0000 7f615da21b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564acce62560 con 0x564accfa7ec0 2024-05-10T03:42:34.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.389+0000 7f615da21b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564acce62200 con 0x564accfa66a0 2024-05-10T03:42:34.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.389+0000 7f615da21b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x564accd496a0 con 0x564accfa7570 2024-05-10T03:42:34.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.389+0000 7f615da21b80 10 client.0 _ll_register_callbacks cb 0x564acce6bb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:34.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.389+0000 7f61477fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564accfa7ec0 0x564accfb78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.389+0000 7f61467fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa7570 0x564accfb0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.389+0000 7f61477fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564accfa7ec0 0x564accfb78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57788/0 (socket says 172.21.15.45:57788) 2024-05-10T03:42:34.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.389+0000 7f61467fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa7570 0x564accfb0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:53808/0 (socket says 172.21.15.45:53808) 2024-05-10T03:42:34.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.389+0000 7f61477fe700 1 -- 172.21.15.45:0/3144887563 learned_addr learned my addr 172.21.15.45:0/3144887563 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:34.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.389+0000 7f6146ffd700 1 --2- 172.21.15.45:0/3144887563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564accfa66a0 0x564accfb0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.403 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-05-10T03:42:34.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.389+0000 7f61467fc700 1 -- 172.21.15.45:0/3144887563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564accfa66a0 msgr2=0x564accfb0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:34.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.389+0000 7f61467fc700 1 --2- 172.21.15.45:0/3144887563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564accfa66a0 0x564accfb0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.389+0000 7f61467fc700 1 -- 172.21.15.45:0/3144887563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564accfa7ec0 msgr2=0x564accfb78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:34.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.389+0000 7f61467fc700 1 --2- 172.21.15.45:0/3144887563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564accfa7ec0 0x564accfb78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.389+0000 7f61467fc700 1 -- 172.21.15.45:0/3144887563 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6140003b60 con 0x564accfa7570 2024-05-10T03:42:34.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.389+0000 7f61477fe700 1 --2- 172.21.15.45:0/3144887563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564accfa7ec0 0x564accfb78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:34.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.389+0000 7f61467fc700 1 --2- 172.21.15.45:0/3144887563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa7570 0x564accfb0950 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x564accfa8440 tx=0x7f613c00b6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2776eeb144b04c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:34.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.389+0000 7f612aff5700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-05-10T03:42:34.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.390+0000 7f612aff5700 1 -- 172.21.15.45:0/3144887563 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c09e070 con 0x564accfa7570 2024-05-10T03:42:34.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.390+0000 7f615da21b80 1 -- 172.21.15.45:0/3144887563 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564acce1f270 con 0x564accfa7570 2024-05-10T03:42:34.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.390+0000 7f612aff5700 1 -- 172.21.15.45:0/3144887563 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f613c0b2030 con 0x564accfa7570 2024-05-10T03:42:34.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.390+0000 7f612aff5700 1 -- 172.21.15.45:0/3144887563 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f613c09eeb0 con 0x564accfa7570 2024-05-10T03:42:34.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.390+0000 7f615da21b80 10 client.26188 fetch_fsmap learned FSMap version 29 2024-05-10T03:42:34.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.390+0000 7f615da21b80 1 -- 172.21.15.45:0/3144887563 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f61481aae50 con 0x564accfa7570 2024-05-10T03:42:34.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.390+0000 7f612aff5700 1 -- 172.21.15.45:0/3144887563 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x564acce1f270 con 0x564accfa7570 2024-05-10T03:42:34.406 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-05-10T03:42:34.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.390+0000 7f612aff5700 1 -- 172.21.15.45:0/3144887563 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f613c0b3ba0 con 0x564accfa7570 2024-05-10T03:42:34.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.390+0000 7f615da21b80 10 client.26188 fetch_fsmap finished waiting for FSMap version 29 2024-05-10T03:42:34.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.391+0000 7f615da21b80 10 client.26188 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2024-05-10T03:42:34.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.391+0000 7f615da21b80 20 client.26188 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:34.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.391+0000 7f615da21b80 1 --2- 172.21.15.45:0/3144887563 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x564accfbbb90 0x564accfbdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.391+0000 7f615da21b80 4 client.26188 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:42:34.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.391+0000 7f615da21b80 1 -- 172.21.15.45:0/3144887563 --> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564accf75780 con 0x564accfbbb90 2024-05-10T03:42:34.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.391+0000 7f6146ffd700 1 --2- 172.21.15.45:0/3144887563 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x564accfbbb90 0x564accfbdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.391+0000 7f6146ffd700 1 --2- 172.21.15.45:0/3144887563 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x564accfbbb90 0x564accfbdfb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b7493e05f5ebc8ee server_cookie=5a45759c234477ef in_seq=0 out_seq=0 2024-05-10T03:42:34.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.391+0000 7f612aff5700 10 client.26188 ms_handle_connect on v2:172.21.15.106:6834/4162885659 2024-05-10T03:42:34.408 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-05-10T03:42:34.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.392+0000 7f612aff5700 1 -- 172.21.15.45:0/3144887563 <== mds.4 v2:172.21.15.106:6834/4162885659 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564accf75780 con 0x564accfbbb90 2024-05-10T03:42:34.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.392+0000 7f612aff5700 10 client.26188 handle_command_reply: tid=0 2024-05-10T03:42:34.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.392+0000 7f615da21b80 1 client.26188 shutdown 2024-05-10T03:42:34.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.392+0000 7f615da21b80 1 -- 172.21.15.45:0/3144887563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa7570 msgr2=0x564accfb0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.392+0000 7f615da21b80 1 --2- 172.21.15.45:0/3144887563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa7570 0x564accfb0950 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x564accfa8440 tx=0x7f613c00b6a0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.392+0000 7f615da21b80 1 -- 172.21.15.45:0/3144887563 shutdown_connections 2024-05-10T03:42:34.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.392+0000 7f615da21b80 1 --2- 172.21.15.45:0/3144887563 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x564accfbbb90 0x564accfbdfb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.392+0000 7f615da21b80 1 --2- 172.21.15.45:0/3144887563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564accfa7ec0 0x564accfb78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.392+0000 7f615da21b80 1 --2- 172.21.15.45:0/3144887563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564accfa66a0 0x564accfb0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.392+0000 7f612aff5700 0 client.26188 ms_handle_reset on v2:172.21.15.106:6834/4162885659 2024-05-10T03:42:34.410 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-05-10T03:42:34.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.392+0000 7f615da21b80 1 --2- 172.21.15.45:0/3144887563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa7570 0x564accfb0950 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.392+0000 7f615da21b80 1 -- 172.21.15.45:0/3144887563 >> 172.21.15.45:0/3144887563 conn(0x564accf08a60 msgr2=0x564accfa0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:34.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.392+0000 7f615da21b80 1 -- 172.21.15.45:0/3144887563 shutdown_connections 2024-05-10T03:42:34.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.393+0000 7f615da21b80 1 -- 172.21.15.45:0/3144887563 wait complete. 2024-05-10T03:42:34.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.393+0000 7f615da21b80 20 client.26188 trim_cache size 0 max 16384 2024-05-10T03:42:34.413 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-05-10T03:42:34.413 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-05-10T03:42:34.414 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-05-10T03:42:34.414 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-05-10T03:42:34.414 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-05-10T03:42:34.414 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-05-10T03:42:34.414 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-05-10T03:42:34.414 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-05-10T03:42:34.414 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-05-10T03:42:34.414 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-05-10T03:42:34.414 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-05-10T03:42:34.414 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-05-10T03:42:34.414 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-05-10T03:42:34.415 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-05-10T03:42:34.415 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vDSO/ 2024-05-10T03:42:34.415 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-05-10T03:42:34.415 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-05-10T03:42:34.415 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-05-10T03:42:34.415 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-05-10T03:42:34.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.408+0000 7f615da21b80 1 Processor -- start 2024-05-10T03:42:34.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.408+0000 7f615da21b80 1 -- start start 2024-05-10T03:42:34.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.408+0000 7f615da21b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564accfa66a0 0x564accfa7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.408+0000 7f615da21b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa7570 0x564accfb7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.409+0000 7f615da21b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564accfa7ec0 0x564accfa1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.409+0000 7f615da21b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564acce1f270 con 0x564accfa7ec0 2024-05-10T03:42:34.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.409+0000 7f615da21b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564accfa82d0 con 0x564accfa66a0 2024-05-10T03:42:34.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.409+0000 7f615da21b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x564accfbe570 con 0x564accfa7570 2024-05-10T03:42:34.417 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-05-10T03:42:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.409+0000 7f61467fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa7570 0x564accfb7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.409+0000 7f61477fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564accfa7ec0 0x564accfa1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.409+0000 7f61467fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa7570 0x564accfb7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:53812/0 (socket says 172.21.15.45:53812) 2024-05-10T03:42:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.409+0000 7f61467fc700 1 -- 172.21.15.45:0/2819855583 learned_addr learned my addr 172.21.15.45:0/2819855583 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.409+0000 7f6146ffd700 1 --2- 172.21.15.45:0/2819855583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564accfa66a0 0x564accfa7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.409+0000 7f61467fc700 1 -- 172.21.15.45:0/2819855583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564accfa66a0 msgr2=0x564accfa7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.409+0000 7f61467fc700 1 --2- 172.21.15.45:0/2819855583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564accfa66a0 0x564accfa7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.409+0000 7f61467fc700 1 -- 172.21.15.45:0/2819855583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564accfa7ec0 msgr2=0x564accfa1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.409+0000 7f61467fc700 1 --2- 172.21.15.45:0/2819855583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564accfa7ec0 0x564accfa1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.409+0000 7f61467fc700 1 -- 172.21.15.45:0/2819855583 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564acccf3b60 con 0x564accfa7570 2024-05-10T03:42:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.409+0000 7f61467fc700 1 --2- 172.21.15.45:0/2819855583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa7570 0x564accfb7870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f613c09b010 tx=0x7f613c005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2f30440b56f949a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:34.419 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vfio.txt 2024-05-10T03:42:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.409+0000 7f612dffb700 1 -- 172.21.15.45:0/2819855583 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c09e050 con 0x564accfa7570 2024-05-10T03:42:34.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.410+0000 7f612dffb700 1 -- 172.21.15.45:0/2819855583 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f613c09eeb0 con 0x564accfa7570 2024-05-10T03:42:34.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.410+0000 7f612dffb700 1 -- 172.21.15.45:0/2819855583 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c0cbb60 con 0x564accfa7570 2024-05-10T03:42:34.420 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-05-10T03:42:34.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.410+0000 7f615da21b80 1 -- 172.21.15.45:0/2819855583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa7570 msgr2=0x564accfb7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.410+0000 7f615da21b80 1 --2- 172.21.15.45:0/2819855583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa7570 0x564accfb7870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f613c09b010 tx=0x7f613c005f10 comp rx=0 tx=0).stop 2024-05-10T03:42:34.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.410+0000 7f615da21b80 1 -- 172.21.15.45:0/2819855583 shutdown_connections 2024-05-10T03:42:34.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.410+0000 7f615da21b80 1 --2- 172.21.15.45:0/2819855583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564accfa7ec0 0x564accfa1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.410+0000 7f615da21b80 1 --2- 172.21.15.45:0/2819855583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564accfa66a0 0x564accfa7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.410+0000 7f615da21b80 1 --2- 172.21.15.45:0/2819855583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa7570 0x564accfb7870 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.410+0000 7f615da21b80 1 -- 172.21.15.45:0/2819855583 >> 172.21.15.45:0/2819855583 conn(0x564accf08a60 msgr2=0x564accfa0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:34.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.410+0000 7f615da21b80 1 -- 172.21.15.45:0/2819855583 shutdown_connections 2024-05-10T03:42:34.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.411+0000 7f615da21b80 1 -- 172.21.15.45:0/2819855583 wait complete. 2024-05-10T03:42:34.422 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video-output.txt 2024-05-10T03:42:34.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.411+0000 7f615da21b80 1 -- start start 2024-05-10T03:42:34.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.411+0000 7f615da21b80 1 Processor -- start 2024-05-10T03:42:34.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.411+0000 7f615da21b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa66a0 0x564accfb4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.411+0000 7f615da21b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564accfa7570 0x564accfb4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.411+0000 7f615da21b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564accfa7ec0 0x564acd00ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.411+0000 7f615da21b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564accfb79c0 con 0x564accfa7570 2024-05-10T03:42:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.411+0000 7f615da21b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564accfb7b30 con 0x564accfa7ec0 2024-05-10T03:42:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.411+0000 7f615da21b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x564acd010440 con 0x564accfa66a0 2024-05-10T03:42:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.411+0000 7f615da21b80 10 client.0 _ll_register_callbacks cb 0x564acce6bb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.411+0000 7f61467fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564accfa7570 0x564accfb4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.411+0000 7f6146ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa66a0 0x564accfb4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.412+0000 7f6146ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa66a0 0x564accfb4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:53826/0 (socket says 172.21.15.45:53826) 2024-05-10T03:42:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.412+0000 7f6146ffd700 1 -- 172.21.15.45:0/688823726 learned_addr learned my addr 172.21.15.45:0/688823726 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.412+0000 7f61477fe700 1 --2- 172.21.15.45:0/688823726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564accfa7ec0 0x564acd00ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.412+0000 7f61467fc700 1 --2- 172.21.15.45:0/688823726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564accfa7570 0x564accfb4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57796/0 (socket says 172.21.15.45:57796) 2024-05-10T03:42:34.425 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/ 2024-05-10T03:42:34.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.412+0000 7f6146ffd700 1 -- 172.21.15.45:0/688823726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564accfa7ec0 msgr2=0x564acd00ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.412+0000 7f6146ffd700 1 --2- 172.21.15.45:0/688823726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564accfa7ec0 0x564acd00ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.412+0000 7f6146ffd700 1 -- 172.21.15.45:0/688823726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564accfa7570 msgr2=0x564accfb4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.412+0000 7f6146ffd700 1 --2- 172.21.15.45:0/688823726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564accfa7570 0x564accfb4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.412+0000 7f6146ffd700 1 -- 172.21.15.45:0/688823726 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61481aae50 con 0x564accfa66a0 2024-05-10T03:42:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.412+0000 7f6146ffd700 1 --2- 172.21.15.45:0/688823726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa66a0 0x564accfb4540 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x564accfbe750 tx=0x7f61380047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=285a8e9e0128c05d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.412+0000 7f612aff5700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-05-10T03:42:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.412+0000 7f612aff5700 1 -- 172.21.15.45:0/688823726 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6138023040 con 0x564accfa66a0 2024-05-10T03:42:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.412+0000 7f612aff5700 1 -- 172.21.15.45:0/688823726 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f6138028370 con 0x564accfa66a0 2024-05-10T03:42:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.412+0000 7f615da21b80 1 -- 172.21.15.45:0/688823726 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f613c09b780 con 0x564accfa66a0 2024-05-10T03:42:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.412+0000 7f612aff5700 1 -- 172.21.15.45:0/688823726 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6138028530 con 0x564accfa66a0 2024-05-10T03:42:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.412+0000 7f615da21b80 10 client.26194 fetch_fsmap learned FSMap version 29 2024-05-10T03:42:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.413+0000 7f615da21b80 1 -- 172.21.15.45:0/688823726 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x564acce8c560 con 0x564accfa66a0 2024-05-10T03:42:34.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.413+0000 7f612aff5700 1 -- 172.21.15.45:0/688823726 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f613c09b780 con 0x564accfa66a0 2024-05-10T03:42:34.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.413+0000 7f612aff5700 1 -- 172.21.15.45:0/688823726 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f613801c400 con 0x564accfa66a0 2024-05-10T03:42:34.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.413+0000 7f615da21b80 10 client.26194 fetch_fsmap finished waiting for FSMap version 29 2024-05-10T03:42:34.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.413+0000 7f615da21b80 10 client.26194 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2024-05-10T03:42:34.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.413+0000 7f615da21b80 20 client.26194 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:34.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.413+0000 7f615da21b80 1 --2- 172.21.15.45:0/688823726 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x564acd011d00 0x564acd014120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.413+0000 7f615da21b80 4 client.26194 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-10T03:42:34.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.413+0000 7f615da21b80 1 -- 172.21.15.45:0/688823726 --> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564accebeec0 con 0x564acd011d00 2024-05-10T03:42:34.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.413+0000 7f61467fc700 1 --2- 172.21.15.45:0/688823726 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x564acd011d00 0x564acd014120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.429 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-05-10T03:42:34.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.414+0000 7f61467fc700 1 --2- 172.21.15.45:0/688823726 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x564acd011d00 0x564acd014120 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ddcf1ecf1aa68a7e server_cookie=bc87e7b00adce4b in_seq=0 out_seq=0 2024-05-10T03:42:34.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.414+0000 7f612aff5700 10 client.26194 ms_handle_connect on v2:172.21.15.106:6834/4162885659 2024-05-10T03:42:34.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.414+0000 7f612aff5700 1 -- 172.21.15.45:0/688823726 <== mds.4 v2:172.21.15.106:6834/4162885659 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564accebeec0 con 0x564acd011d00 2024-05-10T03:42:34.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.414+0000 7f612aff5700 10 client.26194 handle_command_reply: tid=0 2024-05-10T03:42:34.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.414+0000 7f615da21b80 1 client.26194 shutdown 2024-05-10T03:42:34.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.414+0000 7f615da21b80 1 -- 172.21.15.45:0/688823726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa66a0 msgr2=0x564accfb4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.414+0000 7f615da21b80 1 --2- 172.21.15.45:0/688823726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa66a0 0x564accfb4540 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x564accfbe750 tx=0x7f61380047c0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.414+0000 7f615da21b80 1 -- 172.21.15.45:0/688823726 shutdown_connections 2024-05-10T03:42:34.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.414+0000 7f615da21b80 1 --2- 172.21.15.45:0/688823726 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x564acd011d00 0x564acd014120 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.414+0000 7f615da21b80 1 --2- 172.21.15.45:0/688823726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564accfa66a0 0x564accfb4540 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.414+0000 7f612aff5700 0 client.26194 ms_handle_reset on v2:172.21.15.106:6834/4162885659 2024-05-10T03:42:34.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.414+0000 7f615da21b80 1 --2- 172.21.15.45:0/688823726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564accfa7ec0 0x564acd00ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.414+0000 7f615da21b80 1 --2- 172.21.15.45:0/688823726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564accfa7570 0x564accfb4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.414+0000 7f615da21b80 1 -- 172.21.15.45:0/688823726 >> 172.21.15.45:0/688823726 conn(0x564accf08a60 msgr2=0x564accfa0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:34.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.414+0000 7f615da21b80 1 -- 172.21.15.45:0/688823726 shutdown_connections 2024-05-10T03:42:34.431 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-05-10T03:42:34.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.414+0000 7f615da21b80 1 -- 172.21.15.45:0/688823726 wait complete. 2024-05-10T03:42:34.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.414+0000 7f615da21b80 20 client.26194 trim_cache size 0 max 16384 2024-05-10T03:42:34.432 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-05-10T03:42:34.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.415+0000 7f614d6dd700 1 -- 172.21.15.45:0/4085996357 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f61300a1240 msgr2=0x7f61300a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.415+0000 7f614d6dd700 1 --2- 172.21.15.45:0/4085996357 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f61300a1240 0x7f61300a3750 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f614810d5e0 tx=0x7f6138009260 comp rx=0 tx=0).stop 2024-05-10T03:42:34.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.415+0000 7f614d6dd700 1 -- 172.21.15.45:0/4085996357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f614810d6e0 msgr2=0x7f61481a2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.415+0000 7f614d6dd700 1 --2- 172.21.15.45:0/4085996357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f614810d6e0 0x7f61481a2ee0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f613c0098e0 tx=0x7f613c00f690 comp rx=0 tx=0).stop 2024-05-10T03:42:34.433 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-05-10T03:42:34.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.415+0000 7f614d6dd700 1 -- 172.21.15.45:0/4085996357 shutdown_connections 2024-05-10T03:42:34.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.415+0000 7f614d6dd700 1 --2- 172.21.15.45:0/4085996357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f614810e080 0x7f61481a9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.415+0000 7f614d6dd700 1 --2- 172.21.15.45:0/4085996357 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f61300a1240 0x7f61300a3750 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.415+0000 7f614d6dd700 1 --2- 172.21.15.45:0/4085996357 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f614810c610 0x7f61481a29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.415+0000 7f614d6dd700 1 --2- 172.21.15.45:0/4085996357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f614810d6e0 0x7f61481a2ee0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.415+0000 7f614d6dd700 1 -- 172.21.15.45:0/4085996357 >> 172.21.15.45:0/4085996357 conn(0x7f614806c820 msgr2=0x7f6148110910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:34.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.415+0000 7f614d6dd700 1 -- 172.21.15.45:0/4085996357 shutdown_connections 2024-05-10T03:42:34.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.415+0000 7f614d6dd700 1 -- 172.21.15.45:0/4085996357 wait complete. 2024-05-10T03:42:34.436 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-05-10T03:42:34.437 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-05-10T03:42:34.437 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-05-10T03:42:34.437 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-05-10T03:42:34.437 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-05-10T03:42:34.437 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-05-10T03:42:34.437 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-05-10T03:42:34.437 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-05-10T03:42:34.437 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-05-10T03:42:34.437 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-05-10T03:42:34.437 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-05-10T03:42:34.437 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-05-10T03:42:34.437 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-05-10T03:42:34.438 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-05-10T03:42:34.438 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-05-10T03:42:34.438 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-05-10T03:42:34.439 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-05-10T03:42:34.440 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-05-10T03:42:34.440 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-05-10T03:42:34.440 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-05-10T03:42:34.440 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-05-10T03:42:34.440 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-05-10T03:42:34.440 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-05-10T03:42:34.441 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-05-10T03:42:34.443 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-05-10T03:42:34.444 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-05-10T03:42:34.445 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-05-10T03:42:34.446 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-05-10T03:42:34.447 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-05-10T03:42:34.448 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-05-10T03:42:34.449 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-05-10T03:42:34.450 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-05-10T03:42:34.451 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-05-10T03:42:34.451 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-05-10T03:42:34.452 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-05-10T03:42:34.453 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-05-10T03:42:34.454 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-05-10T03:42:34.454 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-05-10T03:42:34.455 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-05-10T03:42:34.456 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-05-10T03:42:34.456 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-05-10T03:42:34.458 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-05-10T03:42:34.459 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-05-10T03:42:34.459 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-05-10T03:42:34.460 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-05-10T03:42:34.461 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-05-10T03:42:34.461 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-05-10T03:42:34.462 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-05-10T03:42:34.463 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-05-10T03:42:34.463 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-05-10T03:42:34.464 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-05-10T03:42:34.465 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-05-10T03:42:34.465 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-05-10T03:42:34.467 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-05-10T03:42:34.468 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-05-10T03:42:34.469 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-05-10T03:42:34.470 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-05-10T03:42:34.471 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-05-10T03:42:34.472 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-05-10T03:42:34.473 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-05-10T03:42:34.480 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-05-10T03:42:34.481 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-05-10T03:42:34.482 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-05-10T03:42:34.483 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-05-10T03:42:34.484 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-05-10T03:42:34.484 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-05-10T03:42:34.485 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-05-10T03:42:34.486 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-05-10T03:42:34.487 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-05-10T03:42:34.488 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-05-10T03:42:34.489 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-05-10T03:42:34.490 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-05-10T03:42:34.491 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-05-10T03:42:34.492 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-05-10T03:42:34.493 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-05-10T03:42:34.494 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-05-10T03:42:34.495 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/ 2024-05-10T03:42:34.497 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-05-10T03:42:34.499 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-05-10T03:42:34.500 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-05-10T03:42:34.501 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-05-10T03:42:34.502 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-05-10T03:42:34.503 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-05-10T03:42:34.505 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-05-10T03:42:34.506 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-05-10T03:42:34.507 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-05-10T03:42:34.508 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-05-10T03:42:34.509 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-05-10T03:42:34.510 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-05-10T03:42:34.510 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-05-10T03:42:34.511 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-05-10T03:42:34.512 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-05-10T03:42:34.513 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-05-10T03:42:34.514 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-05-10T03:42:34.515 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-05-10T03:42:34.516 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-05-10T03:42:34.517 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-05-10T03:42:34.518 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-05-10T03:42:34.519 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-05-10T03:42:34.520 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-05-10T03:42:34.521 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-05-10T03:42:34.522 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-05-10T03:42:34.524 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/ 2024-05-10T03:42:34.527 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-05-10T03:42:34.528 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-05-10T03:42:34.529 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-05-10T03:42:34.529 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/balance 2024-05-10T03:42:34.530 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-05-10T03:42:34.531 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-05-10T03:42:34.531 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-05-10T03:42:34.532 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-05-10T03:42:34.533 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-05-10T03:42:34.533 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-05-10T03:42:34.534 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/numa 2024-05-10T03:42:34.535 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-05-10T03:42:34.535 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-05-10T03:42:34.536 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-05-10T03:42:34.537 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-05-10T03:42:34.537 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-05-10T03:42:34.538 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-05-10T03:42:34.539 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-05-10T03:42:34.539 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-05-10T03:42:34.540 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-05-10T03:42:34.541 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-05-10T03:42:34.541 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-05-10T03:42:34.542 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-05-10T03:42:34.543 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-05-10T03:42:34.544 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-05-10T03:42:34.544 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/ 2024-05-10T03:42:34.546 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-05-10T03:42:34.547 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-05-10T03:42:34.548 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-05-10T03:42:34.549 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-05-10T03:42:34.549 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-05-10T03:42:34.550 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-05-10T03:42:34.551 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-05-10T03:42:34.551 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-05-10T03:42:34.552 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-05-10T03:42:34.553 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-05-10T03:42:34.553 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-05-10T03:42:34.554 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-05-10T03:42:34.555 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-05-10T03:42:34.555 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-05-10T03:42:34.556 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-05-10T03:42:34.557 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-05-10T03:42:34.557 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/ 2024-05-10T03:42:34.559 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-05-10T03:42:34.560 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-05-10T03:42:34.561 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-05-10T03:42:34.561 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-05-10T03:42:34.562 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-05-10T03:42:34.563 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-05-10T03:42:34.564 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-05-10T03:42:34.564 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-05-10T03:42:34.565 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-05-10T03:42:34.565 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-05-10T03:42:34.566 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-05-10T03:42:34.567 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-05-10T03:42:34.568 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-05-10T03:42:34.568 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/wimax/ 2024-05-10T03:42:34.570 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-05-10T03:42:34.570 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-05-10T03:42:34.571 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-05-10T03:42:34.572 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/ 2024-05-10T03:42:34.575 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-05-10T03:42:34.576 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-05-10T03:42:34.576 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-05-10T03:42:34.577 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-05-10T03:42:34.578 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-05-10T03:42:34.578 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-05-10T03:42:34.579 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-05-10T03:42:34.580 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-05-10T03:42:34.581 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-05-10T03:42:34.581 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-05-10T03:42:34.582 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-05-10T03:42:34.583 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-05-10T03:42:34.583 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-05-10T03:42:34.588 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-05-10T03:42:34.589 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-05-10T03:42:34.590 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-05-10T03:42:34.593 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-05-10T03:42:34.594 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-05-10T03:42:34.595 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-05-10T03:42:34.595 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-05-10T03:42:34.597 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-05-10T03:42:34.597 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-05-10T03:42:34.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.594+0000 7fcb7e99e700 1 -- 172.21.15.45:0/305566942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb78100ae0 msgr2=0x7fcb78100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.594+0000 7fcb7e99e700 1 --2- 172.21.15.45:0/305566942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb78100ae0 0x7fcb78100ef0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fcb68009990 tx=0x7fcb68009ca0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.594+0000 7fcb7e99e700 1 -- 172.21.15.45:0/305566942 shutdown_connections 2024-05-10T03:42:34.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.594+0000 7fcb7e99e700 1 --2- 172.21.15.45:0/305566942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb781025a0 0x7fcb78108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.594+0000 7fcb7e99e700 1 --2- 172.21.15.45:0/305566942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb78100ae0 0x7fcb78100ef0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.594+0000 7fcb7e99e700 1 --2- 172.21.15.45:0/305566942 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb78101c00 0x7fcb78102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.594+0000 7fcb7e99e700 1 -- 172.21.15.45:0/305566942 >> 172.21.15.45:0/305566942 conn(0x7fcb780fc110 msgr2=0x7fcb780fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:34.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.594+0000 7fcb7e99e700 1 -- 172.21.15.45:0/305566942 shutdown_connections 2024-05-10T03:42:34.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.594+0000 7fcb7e99e700 1 -- 172.21.15.45:0/305566942 wait complete. 2024-05-10T03:42:34.599 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-05-10T03:42:34.600 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-05-10T03:42:34.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.595+0000 7fcb7e99e700 1 Processor -- start 2024-05-10T03:42:34.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.595+0000 7fcb7e99e700 1 -- start start 2024-05-10T03:42:34.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.595+0000 7fcb7e99e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb78100ae0 0x7fcb78196f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.595+0000 7fcb7e99e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb78101c00 0x7fcb78197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.595+0000 7fcb7e99e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb781025a0 0x7fcb7819e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.596+0000 7fcb7e99e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7819ea20 con 0x7fcb78101c00 2024-05-10T03:42:34.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.596+0000 7fcb7e99e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7819eb90 con 0x7fcb781025a0 2024-05-10T03:42:34.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.596+0000 7fcb7e99e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7819ed50 con 0x7fcb78100ae0 2024-05-10T03:42:34.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.596+0000 7fcb6ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb78101c00 0x7fcb78197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.596+0000 7fcb77fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb78100ae0 0x7fcb78196f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.596+0000 7fcb6ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb78101c00 0x7fcb78197480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57806/0 (socket says 172.21.15.45:57806) 2024-05-10T03:42:34.602 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/xtensa/ 2024-05-10T03:42:34.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.596+0000 7fcb6ffff700 1 -- 172.21.15.45:0/4094082465 learned_addr learned my addr 172.21.15.45:0/4094082465 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:34.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.596+0000 7fcb7cf3b700 1 --2- 172.21.15.45:0/4094082465 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb781025a0 0x7fcb7819e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.596+0000 7fcb77fff700 1 -- 172.21.15.45:0/4094082465 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb781025a0 msgr2=0x7fcb7819e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.596+0000 7fcb77fff700 1 --2- 172.21.15.45:0/4094082465 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb781025a0 0x7fcb7819e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.596+0000 7fcb77fff700 1 -- 172.21.15.45:0/4094082465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb78101c00 msgr2=0x7fcb78197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.596+0000 7fcb77fff700 1 --2- 172.21.15.45:0/4094082465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb78101c00 0x7fcb78197480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.596+0000 7fcb77fff700 1 -- 172.21.15.45:0/4094082465 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb680095f0 con 0x7fcb78100ae0 2024-05-10T03:42:34.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.596+0000 7fcb7cf3b700 1 --2- 172.21.15.45:0/4094082465 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb781025a0 0x7fcb7819e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:42:34.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.596+0000 7fcb77fff700 1 --2- 172.21.15.45:0/4094082465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb78100ae0 0x7fcb78196f40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcb68000c00 tx=0x7fcb68004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:34.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.596+0000 7fcb75ffb700 1 -- 172.21.15.45:0/4094082465 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6801d070 con 0x7fcb78100ae0 2024-05-10T03:42:34.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.597+0000 7fcb75ffb700 1 -- 172.21.15.45:0/4094082465 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcb68005030 con 0x7fcb78100ae0 2024-05-10T03:42:34.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.597+0000 7fcb7e99e700 1 -- 172.21.15.45:0/4094082465 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb7819efd0 con 0x7fcb78100ae0 2024-05-10T03:42:34.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.597+0000 7fcb75ffb700 1 -- 172.21.15.45:0/4094082465 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb68004d10 con 0x7fcb78100ae0 2024-05-10T03:42:34.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.597+0000 7fcb7e99e700 1 -- 172.21.15.45:0/4094082465 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb7819f340 con 0x7fcb78100ae0 2024-05-10T03:42:34.605 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-05-10T03:42:34.605 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-05-10T03:42:34.605 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/xz.txt 2024-05-10T03:42:34.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.599+0000 7fcb75ffb700 1 -- 172.21.15.45:0/4094082465 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fcb68005530 con 0x7fcb78100ae0 2024-05-10T03:42:34.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.600+0000 7fcb75ffb700 1 --2- 172.21.15.45:0/4094082465 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcb640a1240 0x7fcb640a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.600+0000 7fcb6ffff700 1 --2- 172.21.15.45:0/4094082465 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcb640a1240 0x7fcb640a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.600+0000 7fcb75ffb700 1 -- 172.21.15.45:0/4094082465 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fcb680cdec0 con 0x7fcb78100ae0 2024-05-10T03:42:34.606 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-05-10T03:42:34.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.600+0000 7fcb6ffff700 1 --2- 172.21.15.45:0/4094082465 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcb640a1240 0x7fcb640a3750 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcb78197fe0 tx=0x7fcb6000b500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:34.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.601+0000 7fcb8ece2b80 1 Processor -- start 2024-05-10T03:42:34.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.601+0000 7fcb8ece2b80 1 -- start start 2024-05-10T03:42:34.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.601+0000 7fcb8ece2b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559311b9f6a0 0x559311b9faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.601+0000 7fcb8ece2b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559311ba0570 0x559311ba0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.601+0000 7fcb8ece2b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311ba0ec0 0x559311ba77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.601+0000 7fcb8ece2b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559311ac6150 con 0x559311ba0ec0 2024-05-10T03:42:34.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.601+0000 7fcb8ece2b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559311ac3b10 con 0x559311ba0570 2024-05-10T03:42:34.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.601+0000 7fcb8ece2b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559311abf400 con 0x559311b9f6a0 2024-05-10T03:42:34.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.601+0000 7fcb7cf3b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311ba0ec0 0x559311ba77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.601+0000 7fcb77fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559311b9f6a0 0x559311b9faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.601+0000 7fcb7cf3b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311ba0ec0 0x559311ba77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57820/0 (socket says 172.21.15.45:57820) 2024-05-10T03:42:34.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.601+0000 7fcb7cf3b700 1 -- 172.21.15.45:0/3495010710 learned_addr learned my addr 172.21.15.45:0/3495010710 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:34.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.602+0000 7fcb6ffff700 1 --2- 172.21.15.45:0/3495010710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559311ba0570 0x559311ba0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.602+0000 7fcb7cf3b700 1 -- 172.21.15.45:0/3495010710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559311b9f6a0 msgr2=0x559311b9faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:34.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.602+0000 7fcb7cf3b700 1 --2- 172.21.15.45:0/3495010710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559311b9f6a0 0x559311b9faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.602+0000 7fcb7cf3b700 1 -- 172.21.15.45:0/3495010710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559311ba0570 msgr2=0x559311ba0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:34.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.602+0000 7fcb7cf3b700 1 --2- 172.21.15.45:0/3495010710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559311ba0570 0x559311ba0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.602+0000 7fcb7cf3b700 1 -- 172.21.15.45:0/3495010710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593119403b0 con 0x559311ba0ec0 2024-05-10T03:42:34.610 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-05-10T03:42:34.610 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.602+0000 7fcb7cf3b700 1 --2- 172.21.15.45:0/3495010710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311ba0ec0 0x559311ba77c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fcb700093a0 tx=0x7fcb70009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef722bd9a374c11e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:34.610 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.602+0000 7fcb6e7fc700 1 -- 172.21.15.45:0/3495010710 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7000e030 con 0x559311ba0ec0 2024-05-10T03:42:34.610 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.602+0000 7fcb6e7fc700 1 -- 172.21.15.45:0/3495010710 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcb7000f040 con 0x559311ba0ec0 2024-05-10T03:42:34.610 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.602+0000 7fcb6e7fc700 1 -- 172.21.15.45:0/3495010710 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb70015c60 con 0x559311ba0ec0 2024-05-10T03:42:34.611 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-05-10T03:42:34.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.603+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/3495010710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311ba0ec0 msgr2=0x559311ba77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.603+0000 7fcb8ece2b80 1 --2- 172.21.15.45:0/3495010710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311ba0ec0 0x559311ba77c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fcb700093a0 tx=0x7fcb70009920 comp rx=0 tx=0).stop 2024-05-10T03:42:34.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.603+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/3495010710 shutdown_connections 2024-05-10T03:42:34.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.603+0000 7fcb8ece2b80 1 --2- 172.21.15.45:0/3495010710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559311b9f6a0 0x559311b9faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.603+0000 7fcb8ece2b80 1 --2- 172.21.15.45:0/3495010710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311ba0ec0 0x559311ba77c0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.603+0000 7fcb8ece2b80 1 --2- 172.21.15.45:0/3495010710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559311ba0570 0x559311ba0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.603+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/3495010710 >> 172.21.15.45:0/3495010710 conn(0x559311b01a60 msgr2=0x559311b99fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:34.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.603+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/3495010710 shutdown_connections 2024-05-10T03:42:34.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.603+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/3495010710 wait complete. 2024-05-10T03:42:34.613 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-05-10T03:42:34.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.604+0000 7fcb8ece2b80 1 -- start start 2024-05-10T03:42:34.613 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-05-10T03:42:34.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.604+0000 7fcb8ece2b80 1 Processor -- start 2024-05-10T03:42:34.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.604+0000 7fcb8ece2b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559311b9f6a0 0x559311ba96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.604+0000 7fcb8ece2b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311ba0570 0x559311ba9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.604+0000 7fcb8ece2b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559311ba0ec0 0x559311bb0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.604+0000 7fcb8ece2b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559311a5b560 con 0x559311ba0570 2024-05-10T03:42:34.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.604+0000 7fcb8ece2b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559311a5b200 con 0x559311ba0ec0 2024-05-10T03:42:34.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.604+0000 7fcb8ece2b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593119426a0 con 0x559311b9f6a0 2024-05-10T03:42:34.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.604+0000 7fcb8ece2b80 10 client.0 _ll_register_callbacks cb 0x559311a64b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:34.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.605+0000 7fcb77fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559311b9f6a0 0x559311ba96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.605+0000 7fcb6ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311ba0570 0x559311ba9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.605+0000 7fcb77fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559311b9f6a0 0x559311ba96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:53870/0 (socket says 172.21.15.45:53870) 2024-05-10T03:42:34.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.605+0000 7fcb77fff700 1 -- 172.21.15.45:0/3934629210 learned_addr learned my addr 172.21.15.45:0/3934629210 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:34.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.605+0000 7fcb7cf3b700 1 --2- 172.21.15.45:0/3934629210 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559311ba0ec0 0x559311bb0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.616 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-05-10T03:42:34.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.605+0000 7fcb6ffff700 1 -- 172.21.15.45:0/3934629210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559311b9f6a0 msgr2=0x559311ba96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:34.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.605+0000 7fcb6ffff700 1 --2- 172.21.15.45:0/3934629210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559311b9f6a0 0x559311ba96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.605+0000 7fcb6ffff700 1 -- 172.21.15.45:0/3934629210 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559311ba0ec0 msgr2=0x559311bb0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:34.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.605+0000 7fcb6ffff700 1 --2- 172.21.15.45:0/3934629210 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559311ba0ec0 0x559311bb0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.605+0000 7fcb6ffff700 1 -- 172.21.15.45:0/3934629210 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb70009050 con 0x559311ba0570 2024-05-10T03:42:34.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.605+0000 7fcb77fff700 1 --2- 172.21.15.45:0/3934629210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559311b9f6a0 0x559311ba96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:34.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.605+0000 7fcb6ffff700 1 --2- 172.21.15.45:0/3934629210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311ba0570 0x559311ba9be0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fcb600116f0 tx=0x7fcb600047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee231b4acd5726f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:34.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.605+0000 7fcb577fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:42:34.618 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-05-10T03:42:34.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.605+0000 7fcb577fe700 1 -- 172.21.15.45:0/3934629210 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb60004230 con 0x559311ba0570 2024-05-10T03:42:34.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.605+0000 7fcb577fe700 1 -- 172.21.15.45:0/3934629210 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fcb60017070 con 0x559311ba0570 2024-05-10T03:42:34.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.605+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/3934629210 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559311a18270 con 0x559311ba0570 2024-05-10T03:42:34.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.606+0000 7fcb577fe700 1 -- 172.21.15.45:0/3934629210 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb60011e90 con 0x559311ba0570 2024-05-10T03:42:34.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.606+0000 7fcb8ece2b80 10 client.16344 fetch_fsmap learned FSMap version 29 2024-05-10T03:42:34.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.606+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/3934629210 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5593118ecb60 con 0x559311ba0570 2024-05-10T03:42:34.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.606+0000 7fcb577fe700 1 -- 172.21.15.45:0/3934629210 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x559311a18270 con 0x559311ba0570 2024-05-10T03:42:34.620 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-05-10T03:42:34.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.606+0000 7fcb577fe700 1 -- 172.21.15.45:0/3934629210 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 29) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fcb6001f760 con 0x559311ba0570 2024-05-10T03:42:34.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.606+0000 7fcb8ece2b80 10 client.16344 fetch_fsmap finished waiting for FSMap version 29 2024-05-10T03:42:34.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.606+0000 7fcb8ece2b80 10 client.16344 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-05-10T03:42:34.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.606+0000 7fcb8ece2b80 20 client.16344 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:34.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.606+0000 7fcb8ece2b80 1 --2- 172.21.15.45:0/3934629210 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x559311bb53d0 0x559311bb7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.606+0000 7fcb8ece2b80 4 client.16344 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:42:34.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.606+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/3934629210 --> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559311b6e780 con 0x559311bb53d0 2024-05-10T03:42:34.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.607+0000 7fcb77fff700 1 --2- 172.21.15.45:0/3934629210 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x559311bb53d0 0x559311bb7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.622 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-05-10T03:42:34.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.607+0000 7fcb577fe700 10 client.16344 ms_handle_connect on v2:172.21.15.154:6836/608167481 2024-05-10T03:42:34.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.607+0000 7fcb77fff700 1 --2- 172.21.15.45:0/3934629210 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x559311bb53d0 0x559311bb7820 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a22bb46abdf759d2 server_cookie=3666ae3b44d78acd in_seq=0 out_seq=0 2024-05-10T03:42:34.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.608+0000 7fcb577fe700 1 -- 172.21.15.45:0/3934629210 <== mds.3 v2:172.21.15.154:6836/608167481 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559311b6e780 con 0x559311bb53d0 2024-05-10T03:42:34.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.608+0000 7fcb577fe700 10 client.16344 handle_command_reply: tid=0 2024-05-10T03:42:34.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.608+0000 7fcb8ece2b80 1 client.16344 shutdown 2024-05-10T03:42:34.623 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-05-10T03:42:34.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.608+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/3934629210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311ba0570 msgr2=0x559311ba9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.608+0000 7fcb8ece2b80 1 --2- 172.21.15.45:0/3934629210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311ba0570 0x559311ba9be0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fcb600116f0 tx=0x7fcb600047c0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.608+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/3934629210 shutdown_connections 2024-05-10T03:42:34.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.608+0000 7fcb8ece2b80 1 --2- 172.21.15.45:0/3934629210 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x559311bb53d0 0x559311bb7820 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.608+0000 7fcb8ece2b80 1 --2- 172.21.15.45:0/3934629210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559311b9f6a0 0x559311ba96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.608+0000 7fcb8ece2b80 1 --2- 172.21.15.45:0/3934629210 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559311ba0ec0 0x559311bb0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.609+0000 7fcb577fe700 0 client.16344 ms_handle_reset on v2:172.21.15.154:6836/608167481 2024-05-10T03:42:34.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.608+0000 7fcb8ece2b80 1 --2- 172.21.15.45:0/3934629210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311ba0570 0x559311ba9be0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.609+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/3934629210 >> 172.21.15.45:0/3934629210 conn(0x559311b01a60 msgr2=0x559311b99fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:34.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.609+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/3934629210 shutdown_connections 2024-05-10T03:42:34.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.609+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/3934629210 wait complete. 2024-05-10T03:42:34.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.609+0000 7fcb8ece2b80 20 client.16344 trim_cache size 0 max 16384 2024-05-10T03:42:34.627 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-05-10T03:42:34.628 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-05-10T03:42:34.628 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-05-10T03:42:34.628 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-05-10T03:42:34.628 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-05-10T03:42:34.628 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-05-10T03:42:34.628 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-05-10T03:42:34.628 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-05-10T03:42:34.628 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-05-10T03:42:34.628 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-05-10T03:42:34.628 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-05-10T03:42:34.628 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-05-10T03:42:34.628 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-05-10T03:42:34.628 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-05-10T03:42:34.629 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-05-10T03:42:34.629 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-05-10T03:42:34.629 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-05-10T03:42:34.629 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-05-10T03:42:34.629 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-05-10T03:42:34.629 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zorro.txt 2024-05-10T03:42:34.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.623+0000 7fcb8ece2b80 1 Processor -- start 2024-05-10T03:42:34.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.623+0000 7fcb8ece2b80 1 -- start start 2024-05-10T03:42:34.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.623+0000 7fcb8ece2b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559311b9f6a0 0x559311ba42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.623+0000 7fcb8ece2b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559311ba0570 0x559311baeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.623+0000 7fcb8ece2b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311ba0ec0 0x559311baf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.623+0000 7fcb8ece2b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559311bb2820 con 0x559311ba0ec0 2024-05-10T03:42:34.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.623+0000 7fcb8ece2b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559311b9b770 con 0x559311ba0570 2024-05-10T03:42:34.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.623+0000 7fcb8ece2b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559311ba3e20 con 0x559311b9f6a0 2024-05-10T03:42:34.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.623+0000 7fcb77fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559311b9f6a0 0x559311ba42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.623+0000 7fcb7cf3b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311ba0ec0 0x559311baf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.623+0000 7fcb77fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559311b9f6a0 0x559311ba42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:53878/0 (socket says 172.21.15.45:53878) 2024-05-10T03:42:34.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.623+0000 7fcb77fff700 1 -- 172.21.15.45:0/1349436880 learned_addr learned my addr 172.21.15.45:0/1349436880 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:34.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.624+0000 7fcb6ffff700 1 --2- 172.21.15.45:0/1349436880 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559311ba0570 0x559311baeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.624+0000 7fcb7cf3b700 1 -- 172.21.15.45:0/1349436880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559311b9f6a0 msgr2=0x559311ba42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:34.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.624+0000 7fcb7cf3b700 1 --2- 172.21.15.45:0/1349436880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559311b9f6a0 0x559311ba42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.624+0000 7fcb7cf3b700 1 -- 172.21.15.45:0/1349436880 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559311ba0570 msgr2=0x559311baeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:34.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.624+0000 7fcb7cf3b700 1 --2- 172.21.15.45:0/1349436880 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559311ba0570 0x559311baeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.624+0000 7fcb7cf3b700 1 -- 172.21.15.45:0/1349436880 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559311a85560 con 0x559311ba0ec0 2024-05-10T03:42:34.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.624+0000 7fcb7cf3b700 1 --2- 172.21.15.45:0/1349436880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311ba0ec0 0x559311baf030 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fcb70000f80 tx=0x7fcb70009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92440cfc1a53166b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:34.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.624+0000 7fcb6effd700 1 -- 172.21.15.45:0/1349436880 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7000e070 con 0x559311ba0ec0 2024-05-10T03:42:34.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.624+0000 7fcb6effd700 1 -- 172.21.15.45:0/1349436880 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcb70015580 con 0x559311ba0ec0 2024-05-10T03:42:34.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.624+0000 7fcb6effd700 1 -- 172.21.15.45:0/1349436880 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb70023070 con 0x559311ba0ec0 2024-05-10T03:42:34.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.625+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/1349436880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311ba0ec0 msgr2=0x559311baf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.625+0000 7fcb8ece2b80 1 --2- 172.21.15.45:0/1349436880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311ba0ec0 0x559311baf030 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fcb70000f80 tx=0x7fcb70009c80 comp rx=0 tx=0).stop 2024-05-10T03:42:34.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.625+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/1349436880 shutdown_connections 2024-05-10T03:42:34.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.625+0000 7fcb8ece2b80 1 --2- 172.21.15.45:0/1349436880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559311b9f6a0 0x559311ba42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.625+0000 7fcb8ece2b80 1 --2- 172.21.15.45:0/1349436880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311ba0ec0 0x559311baf030 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.625+0000 7fcb8ece2b80 1 --2- 172.21.15.45:0/1349436880 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559311ba0570 0x559311baeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.625+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/1349436880 >> 172.21.15.45:0/1349436880 conn(0x559311b01a60 msgr2=0x559311bb7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:34.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.625+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/1349436880 shutdown_connections 2024-05-10T03:42:34.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.625+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/1349436880 wait complete. 2024-05-10T03:42:34.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.626+0000 7fcb8ece2b80 1 -- start start 2024-05-10T03:42:34.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.626+0000 7fcb8ece2b80 1 Processor -- start 2024-05-10T03:42:34.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.626+0000 7fcb8ece2b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311b9f6a0 0x559311bacae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.626+0000 7fcb8ece2b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559311ba0570 0x559311baf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.626+0000 7fcb8ece2b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559311ba0ec0 0x559311c124b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.626+0000 7fcb8ece2b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559311c12b20 con 0x559311b9f6a0 2024-05-10T03:42:34.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.626+0000 7fcb8ece2b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559311c12c90 con 0x559311ba0570 2024-05-10T03:42:34.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.626+0000 7fcb8ece2b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559311c12e50 con 0x559311ba0ec0 2024-05-10T03:42:34.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.627+0000 7fcb8ece2b80 10 client.0 _ll_register_callbacks cb 0x559311a64b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:34.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.627+0000 7fcb77fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311b9f6a0 0x559311bacae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.627+0000 7fcb7cf3b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559311ba0ec0 0x559311c124b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.627+0000 7fcb6ffff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559311ba0570 0x559311baf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.627+0000 7fcb77fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311b9f6a0 0x559311bacae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57860/0 (socket says 172.21.15.45:57860) 2024-05-10T03:42:34.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.627+0000 7fcb77fff700 1 -- 172.21.15.45:0/4114118857 learned_addr learned my addr 172.21.15.45:0/4114118857 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:34.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.627+0000 7fcb7cf3b700 1 -- 172.21.15.45:0/4114118857 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559311ba0570 msgr2=0x559311baf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:34.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.627+0000 7fcb7cf3b700 1 --2- 172.21.15.45:0/4114118857 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559311ba0570 0x559311baf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.627+0000 7fcb7cf3b700 1 -- 172.21.15.45:0/4114118857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311b9f6a0 msgr2=0x559311bacae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:34.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.627+0000 7fcb7cf3b700 1 --2- 172.21.15.45:0/4114118857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311b9f6a0 0x559311bacae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.627+0000 7fcb7cf3b700 1 -- 172.21.15.45:0/4114118857 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5593119403b0 con 0x559311ba0ec0 2024-05-10T03:42:34.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.627+0000 7fcb6ffff700 1 --2- 172.21.15.45:0/4114118857 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559311ba0570 0x559311baf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:34.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.627+0000 7fcb77fff700 1 --2- 172.21.15.45:0/4114118857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311b9f6a0 0x559311bacae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:34.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.627+0000 7fcb7cf3b700 1 --2- 172.21.15.45:0/4114118857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559311ba0ec0 0x559311c124b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcb70009a90 tx=0x7fcb70003cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=583f72a27a01ab97 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:34.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.627+0000 7fcb577fe700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-05-10T03:42:34.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.627+0000 7fcb577fe700 1 -- 172.21.15.45:0/4114118857 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7000e070 con 0x559311ba0ec0 2024-05-10T03:42:34.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.627+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/4114118857 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcb7000f040 con 0x559311ba0ec0 2024-05-10T03:42:34.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.627+0000 7fcb577fe700 1 -- 172.21.15.45:0/4114118857 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fcb70015e30 con 0x559311ba0ec0 2024-05-10T03:42:34.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.628+0000 7fcb577fe700 1 -- 172.21.15.45:0/4114118857 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb70023070 con 0x559311ba0ec0 2024-05-10T03:42:34.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.628+0000 7fcb8ece2b80 10 client.26212 fetch_fsmap learned FSMap version 29 2024-05-10T03:42:34.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.628+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/4114118857 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x559311944cd0 con 0x559311ba0ec0 2024-05-10T03:42:34.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.628+0000 7fcb577fe700 1 -- 172.21.15.45:0/4114118857 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcb7000f040 con 0x559311ba0ec0 2024-05-10T03:42:34.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.628+0000 7fcb577fe700 1 -- 172.21.15.45:0/4114118857 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fcb700145f0 con 0x559311ba0ec0 2024-05-10T03:42:34.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.628+0000 7fcb8ece2b80 10 client.26212 fetch_fsmap finished waiting for FSMap version 29 2024-05-10T03:42:34.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.628+0000 7fcb8ece2b80 10 client.26212 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-05-10T03:42:34.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.628+0000 7fcb8ece2b80 20 client.26212 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:34.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.628+0000 7fcb8ece2b80 1 --2- 172.21.15.45:0/4114118857 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x559311bb53d0 0x559311c16570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.628+0000 7fcb8ece2b80 4 client.26212 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-10T03:42:34.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.628+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/4114118857 --> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559311ab7ec0 con 0x559311bb53d0 2024-05-10T03:42:34.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.628+0000 7fcb77fff700 1 --2- 172.21.15.45:0/4114118857 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x559311bb53d0 0x559311c16570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.629+0000 7fcb577fe700 10 client.26212 ms_handle_connect on v2:172.21.15.154:6836/608167481 2024-05-10T03:42:34.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.629+0000 7fcb77fff700 1 --2- 172.21.15.45:0/4114118857 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x559311bb53d0 0x559311c16570 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=899d7a7b5d34f2e7 server_cookie=c074ea3375a721a4 in_seq=0 out_seq=0 2024-05-10T03:42:34.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.629+0000 7fcb577fe700 1 -- 172.21.15.45:0/4114118857 <== mds.3 v2:172.21.15.154:6836/608167481 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559311ab7ec0 con 0x559311bb53d0 2024-05-10T03:42:34.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.629+0000 7fcb577fe700 10 client.26212 handle_command_reply: tid=0 2024-05-10T03:42:34.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.629+0000 7fcb8ece2b80 1 client.26212 shutdown 2024-05-10T03:42:34.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.629+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/4114118857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559311ba0ec0 msgr2=0x559311c124b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.629+0000 7fcb8ece2b80 1 --2- 172.21.15.45:0/4114118857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559311ba0ec0 0x559311c124b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcb70009a90 tx=0x7fcb70003cb0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.629+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/4114118857 shutdown_connections 2024-05-10T03:42:34.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.629+0000 7fcb8ece2b80 1 --2- 172.21.15.45:0/4114118857 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x559311bb53d0 0x559311c16570 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.629+0000 7fcb8ece2b80 1 --2- 172.21.15.45:0/4114118857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559311ba0ec0 0x559311c124b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.629+0000 7fcb8ece2b80 1 --2- 172.21.15.45:0/4114118857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559311b9f6a0 0x559311bacae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.629+0000 7fcb577fe700 0 client.26212 ms_handle_reset on v2:172.21.15.154:6836/608167481 2024-05-10T03:42:34.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.629+0000 7fcb8ece2b80 1 --2- 172.21.15.45:0/4114118857 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559311ba0570 0x559311baf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.629+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/4114118857 >> 172.21.15.45:0/4114118857 conn(0x559311b01a60 msgr2=0x559311bb7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:34.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.630+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/4114118857 shutdown_connections 2024-05-10T03:42:34.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.630+0000 7fcb8ece2b80 1 -- 172.21.15.45:0/4114118857 wait complete. 2024-05-10T03:42:34.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.630+0000 7fcb8ece2b80 20 client.26212 trim_cache size 0 max 16384 2024-05-10T03:42:34.642 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-05-10T03:42:34.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.630+0000 7fcb7e99e700 1 -- 172.21.15.45:0/4094082465 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcb640a1240 msgr2=0x7fcb640a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.630+0000 7fcb7e99e700 1 --2- 172.21.15.45:0/4094082465 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcb640a1240 0x7fcb640a3750 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcb78197fe0 tx=0x7fcb6000b500 comp rx=0 tx=0).stop 2024-05-10T03:42:34.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.630+0000 7fcb7e99e700 1 -- 172.21.15.45:0/4094082465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb78100ae0 msgr2=0x7fcb78196f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.630+0000 7fcb7e99e700 1 --2- 172.21.15.45:0/4094082465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb78100ae0 0x7fcb78196f40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcb68000c00 tx=0x7fcb68004730 comp rx=0 tx=0).stop 2024-05-10T03:42:34.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.630+0000 7fcb7e99e700 1 -- 172.21.15.45:0/4094082465 shutdown_connections 2024-05-10T03:42:34.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.630+0000 7fcb7e99e700 1 --2- 172.21.15.45:0/4094082465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb78100ae0 0x7fcb78196f40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.630+0000 7fcb7e99e700 1 --2- 172.21.15.45:0/4094082465 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcb640a1240 0x7fcb640a3750 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.630+0000 7fcb7e99e700 1 --2- 172.21.15.45:0/4094082465 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb781025a0 0x7fcb7819e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.630+0000 7fcb7e99e700 1 --2- 172.21.15.45:0/4094082465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb78101c00 0x7fcb78197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.630+0000 7fcb7e99e700 1 -- 172.21.15.45:0/4094082465 >> 172.21.15.45:0/4094082465 conn(0x7fcb780fc110 msgr2=0x7fcb78104e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:34.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.630+0000 7fcb7e99e700 1 -- 172.21.15.45:0/4094082465 shutdown_connections 2024-05-10T03:42:34.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.630+0000 7fcb7e99e700 1 -- 172.21.15.45:0/4094082465 wait complete. 2024-05-10T03:42:34.648 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-10T03:42:34.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.837+0000 7febc1ca6700 1 -- 172.21.15.45:0/2856012826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febbc107970 msgr2=0x7febbc109d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.837+0000 7febc1ca6700 1 --2- 172.21.15.45:0/2856012826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febbc107970 0x7febbc109d90 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7febb400b0a0 tx=0x7febb400b3b0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.837+0000 7febc1ca6700 1 -- 172.21.15.45:0/2856012826 shutdown_connections 2024-05-10T03:42:34.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.837+0000 7febc1ca6700 1 --2- 172.21.15.45:0/2856012826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febbc1026b0 0x7febbc104ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.837+0000 7febc1ca6700 1 --2- 172.21.15.45:0/2856012826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febbc107970 0x7febbc109d90 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.837+0000 7febc1ca6700 1 --2- 172.21.15.45:0/2856012826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7febbc105010 0x7febbc107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.837+0000 7febc1ca6700 1 -- 172.21.15.45:0/2856012826 >> 172.21.15.45:0/2856012826 conn(0x7febbc0fc0d0 msgr2=0x7febbc0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:34.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.837+0000 7febc1ca6700 1 -- 172.21.15.45:0/2856012826 shutdown_connections 2024-05-10T03:42:34.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.837+0000 7febc1ca6700 1 -- 172.21.15.45:0/2856012826 wait complete. 2024-05-10T03:42:34.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.838+0000 7febc1ca6700 1 Processor -- start 2024-05-10T03:42:34.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.838+0000 7febc1ca6700 1 -- start start 2024-05-10T03:42:34.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.838+0000 7febc1ca6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7febbc1026b0 0x7febbc198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.838+0000 7febc1ca6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febbc105010 0x7febbc1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.838+0000 7febc1ca6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febbc107970 0x7febbc19f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.838+0000 7febc1ca6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febbc19fb60 con 0x7febbc105010 2024-05-10T03:42:34.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.838+0000 7febc1ca6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febbc19fcd0 con 0x7febbc1026b0 2024-05-10T03:42:34.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.838+0000 7febc1ca6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febbc19fe90 con 0x7febbc107970 2024-05-10T03:42:34.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.838+0000 7febbaffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febbc105010 0x7febbc1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.839+0000 7febbaffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febbc105010 0x7febbc1985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57880/0 (socket says 172.21.15.45:57880) 2024-05-10T03:42:34.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.839+0000 7febbaffd700 1 -- 172.21.15.45:0/630587351 learned_addr learned my addr 172.21.15.45:0/630587351 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:34.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.839+0000 7febbb7fe700 1 --2- 172.21.15.45:0/630587351 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7febbc1026b0 0x7febbc198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.839+0000 7febbbfff700 1 --2- 172.21.15.45:0/630587351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febbc107970 0x7febbc19f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.839+0000 7febbaffd700 1 -- 172.21.15.45:0/630587351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febbc107970 msgr2=0x7febbc19f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.839+0000 7febbaffd700 1 --2- 172.21.15.45:0/630587351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febbc107970 0x7febbc19f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.839+0000 7febbaffd700 1 -- 172.21.15.45:0/630587351 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7febbc1026b0 msgr2=0x7febbc198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.839+0000 7febbaffd700 1 --2- 172.21.15.45:0/630587351 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7febbc1026b0 0x7febbc198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.839+0000 7febbaffd700 1 -- 172.21.15.45:0/630587351 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb4009d00 con 0x7febbc105010 2024-05-10T03:42:34.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.839+0000 7febbaffd700 1 --2- 172.21.15.45:0/630587351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febbc105010 0x7febbc1985c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7febb000d950 tx=0x7febb000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:34.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.839+0000 7febb8ff9700 1 -- 172.21.15.45:0/630587351 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb000f890 con 0x7febbc105010 2024-05-10T03:42:34.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.839+0000 7febc1ca6700 1 -- 172.21.15.45:0/630587351 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febbc1a0170 con 0x7febbc105010 2024-05-10T03:42:34.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.839+0000 7febb8ff9700 1 -- 172.21.15.45:0/630587351 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7febb0010460 con 0x7febbc105010 2024-05-10T03:42:34.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.839+0000 7febb8ff9700 1 -- 172.21.15.45:0/630587351 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb000e610 con 0x7febbc105010 2024-05-10T03:42:34.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.839+0000 7febc1ca6700 1 -- 172.21.15.45:0/630587351 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febbc1a06d0 con 0x7febbc105010 2024-05-10T03:42:34.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.842+0000 7febb8ff9700 1 -- 172.21.15.45:0/630587351 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7febb000e770 con 0x7febbc105010 2024-05-10T03:42:34.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.843+0000 7febb8ff9700 1 --2- 172.21.15.45:0/630587351 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7feba40a11c0 0x7feba40a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.843+0000 7febb8ff9700 1 -- 172.21.15.45:0/630587351 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7febb00ccdd0 con 0x7febbc105010 2024-05-10T03:42:34.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.843+0000 7febbb7fe700 1 --2- 172.21.15.45:0/630587351 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7feba40a11c0 0x7feba40a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.843+0000 7febd1feab80 1 Processor -- start 2024-05-10T03:42:34.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.844+0000 7febd1feab80 1 -- start start 2024-05-10T03:42:34.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.844+0000 7febbb7fe700 1 --2- 172.21.15.45:0/630587351 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7feba40a11c0 0x7feba40a36d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7febbc068de0 tx=0x7febac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:34.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.844+0000 7febd1feab80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612a21deab0 0x5612a21def00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.844+0000 7febd1feab80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5612a21df980 0x5612a21dfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.844+0000 7febd1feab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21e02d0 0x5612a21e6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.844+0000 7febd1feab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a2101150 con 0x5612a21e02d0 2024-05-10T03:42:34.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.844+0000 7febd1feab80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a20feb10 con 0x5612a21deab0 2024-05-10T03:42:34.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.844+0000 7febd1feab80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a20fa400 con 0x5612a21df980 2024-05-10T03:42:34.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.844+0000 7febbbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21e02d0 0x5612a21e6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.844+0000 7febbbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21e02d0 0x5612a21e6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57894/0 (socket says 172.21.15.45:57894) 2024-05-10T03:42:34.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.844+0000 7febbbfff700 1 -- 172.21.15.45:0/2294900536 learned_addr learned my addr 172.21.15.45:0/2294900536 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:34.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.844+0000 7febbaffd700 1 --2- 172.21.15.45:0/2294900536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5612a21df980 0x5612a21dfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.844+0000 7febbb7fe700 1 --2- 172.21.15.45:0/2294900536 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612a21deab0 0x5612a21def00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.844+0000 7febbbfff700 1 -- 172.21.15.45:0/2294900536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5612a21df980 msgr2=0x5612a21dfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:34.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.844+0000 7febbbfff700 1 --2- 172.21.15.45:0/2294900536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5612a21df980 0x5612a21dfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.844+0000 7febbbfff700 1 -- 172.21.15.45:0/2294900536 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612a21deab0 msgr2=0x5612a21def00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:34.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.844+0000 7febbbfff700 1 --2- 172.21.15.45:0/2294900536 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612a21deab0 0x5612a21def00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.844+0000 7febbbfff700 1 -- 172.21.15.45:0/2294900536 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612a1f7b3b0 con 0x5612a21e02d0 2024-05-10T03:42:34.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.844+0000 7febbaffd700 1 --2- 172.21.15.45:0/2294900536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5612a21df980 0x5612a21dfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:42:34.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.844+0000 7febbb7fe700 1 --2- 172.21.15.45:0/2294900536 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612a21deab0 0x5612a21def00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:42:34.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.845+0000 7febbbfff700 1 --2- 172.21.15.45:0/2294900536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21e02d0 0x5612a21e6bd0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7febbc0694a0 tx=0x7febb40098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc153b89bb9da202 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:34.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.845+0000 7feba1ffb700 1 -- 172.21.15.45:0/2294900536 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb400e040 con 0x5612a21e02d0 2024-05-10T03:42:34.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.845+0000 7feba1ffb700 1 -- 172.21.15.45:0/2294900536 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7febb40077c0 con 0x5612a21e02d0 2024-05-10T03:42:34.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.845+0000 7feba1ffb700 1 -- 172.21.15.45:0/2294900536 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb40052a0 con 0x5612a21e02d0 2024-05-10T03:42:34.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.846+0000 7febd1feab80 1 -- 172.21.15.45:0/2294900536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21e02d0 msgr2=0x5612a21e6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.846+0000 7febd1feab80 1 --2- 172.21.15.45:0/2294900536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21e02d0 0x5612a21e6bd0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7febbc0694a0 tx=0x7febb40098b0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.846+0000 7febd1feab80 1 -- 172.21.15.45:0/2294900536 shutdown_connections 2024-05-10T03:42:34.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.846+0000 7febd1feab80 1 --2- 172.21.15.45:0/2294900536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21e02d0 0x5612a21e6bd0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.846+0000 7febd1feab80 1 --2- 172.21.15.45:0/2294900536 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612a21deab0 0x5612a21def00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.846+0000 7febd1feab80 1 --2- 172.21.15.45:0/2294900536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5612a21df980 0x5612a21dfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.846+0000 7febd1feab80 1 -- 172.21.15.45:0/2294900536 >> 172.21.15.45:0/2294900536 conn(0x5612a213ca60 msgr2=0x5612a21d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:34.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.846+0000 7febd1feab80 1 -- 172.21.15.45:0/2294900536 shutdown_connections 2024-05-10T03:42:34.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.846+0000 7febd1feab80 1 -- 172.21.15.45:0/2294900536 wait complete. 2024-05-10T03:42:34.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.846+0000 7febd1feab80 1 -- start start 2024-05-10T03:42:34.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.847+0000 7febd1feab80 1 Processor -- start 2024-05-10T03:42:34.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.847+0000 7febd1feab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21deab0 0x5612a21e8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.847+0000 7febd1feab80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612a21df980 0x5612a21e8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.847+0000 7febd1feab80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5612a21e02d0 0x5612a21efef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.847+0000 7febd1feab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a2096560 con 0x5612a21deab0 2024-05-10T03:42:34.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.847+0000 7febd1feab80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a2096200 con 0x5612a21df980 2024-05-10T03:42:34.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.847+0000 7febd1feab80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a1f7d6a0 con 0x5612a21e02d0 2024-05-10T03:42:34.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.847+0000 7febd1feab80 10 client.0 _ll_register_callbacks cb 0x5612a209fb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:34.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.847+0000 7febbb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21deab0 0x5612a21e8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.847+0000 7febbb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21deab0 0x5612a21e8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57896/0 (socket says 172.21.15.45:57896) 2024-05-10T03:42:34.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.847+0000 7febbb7fe700 1 -- 172.21.15.45:0/2955372411 learned_addr learned my addr 172.21.15.45:0/2955372411 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:34.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.847+0000 7febbbfff700 1 --2- 172.21.15.45:0/2955372411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5612a21e02d0 0x5612a21efef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.847+0000 7febbaffd700 1 --2- 172.21.15.45:0/2955372411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612a21df980 0x5612a21e8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.848+0000 7febbbfff700 1 -- 172.21.15.45:0/2955372411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612a21df980 msgr2=0x5612a21e8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:34.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.848+0000 7febbbfff700 1 --2- 172.21.15.45:0/2955372411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612a21df980 0x5612a21e8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.848+0000 7febbbfff700 1 -- 172.21.15.45:0/2955372411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21deab0 msgr2=0x5612a21e8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:34.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.848+0000 7febbbfff700 1 --2- 172.21.15.45:0/2955372411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21deab0 0x5612a21e8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.848+0000 7febbbfff700 1 -- 172.21.15.45:0/2955372411 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febbc10a9b0 con 0x5612a21e02d0 2024-05-10T03:42:34.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.848+0000 7febbb7fe700 1 --2- 172.21.15.45:0/2955372411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21deab0 0x5612a21e8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:34.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.848+0000 7febbbfff700 1 --2- 172.21.15.45:0/2955372411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5612a21e02d0 0x5612a21efef0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7febb4009fd0 tx=0x7febb400bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbd02a698fe3b0f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:34.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.848+0000 7feb9affd700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-05-10T03:42:34.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.848+0000 7feb9affd700 1 -- 172.21.15.45:0/2955372411 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb400e040 con 0x5612a21e02d0 2024-05-10T03:42:34.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.848+0000 7febd1feab80 1 -- 172.21.15.45:0/2955372411 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5612a2053270 con 0x5612a21e02d0 2024-05-10T03:42:34.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.848+0000 7feb9affd700 1 -- 172.21.15.45:0/2955372411 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7febb40075c0 con 0x5612a21e02d0 2024-05-10T03:42:34.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.848+0000 7feb9affd700 1 -- 172.21.15.45:0/2955372411 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7febb4006130 con 0x5612a21e02d0 2024-05-10T03:42:34.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.848+0000 7febd1feab80 10 client.26224 fetch_fsmap learned FSMap version 29 2024-05-10T03:42:34.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.848+0000 7febd1feab80 1 -- 172.21.15.45:0/2955372411 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5612a1f27b60 con 0x5612a21e02d0 2024-05-10T03:42:34.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.849+0000 7feb9affd700 1 -- 172.21.15.45:0/2955372411 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x5612a2053270 con 0x5612a21e02d0 2024-05-10T03:42:34.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.849+0000 7feb9affd700 1 -- 172.21.15.45:0/2955372411 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) v1 ==== 7474+0+0 (secure 0 0 0) 0x7febb400b0d0 con 0x5612a21e02d0 2024-05-10T03:42:34.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.849+0000 7febd1feab80 10 client.26224 fetch_fsmap finished waiting for FSMap version 29 2024-05-10T03:42:34.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.849+0000 7febd1feab80 10 client.26224 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-10T03:42:34.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.849+0000 7febd1feab80 20 client.26224 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:34.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.849+0000 7febd1feab80 1 --2- 172.21.15.45:0/2955372411 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x5612a21f4140 0x5612a21f6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.849+0000 7febd1feab80 4 client.26224 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:42:34.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.849+0000 7febd1feab80 1 -- 172.21.15.45:0/2955372411 --> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5612a21a9780 con 0x5612a21f4140 2024-05-10T03:42:34.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.849+0000 7febbb7fe700 1 --2- 172.21.15.45:0/2955372411 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x5612a21f4140 0x5612a21f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.850+0000 7feb9affd700 10 client.26224 ms_handle_connect on v2:172.21.15.154:6838/1506563336 2024-05-10T03:42:34.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.850+0000 7febbb7fe700 1 --2- 172.21.15.45:0/2955372411 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x5612a21f4140 0x5612a21f6590 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=db24b81722d4ae92 server_cookie=d508dbac9cfc305f in_seq=0 out_seq=0 2024-05-10T03:42:34.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.850+0000 7feb9affd700 1 -- 172.21.15.45:0/2955372411 <== mds.2 v2:172.21.15.154:6838/1506563336 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5612a21a9780 con 0x5612a21f4140 2024-05-10T03:42:34.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.850+0000 7feb9affd700 10 client.26224 handle_command_reply: tid=0 2024-05-10T03:42:34.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.850+0000 7febd1feab80 1 client.26224 shutdown 2024-05-10T03:42:34.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.850+0000 7febd1feab80 1 -- 172.21.15.45:0/2955372411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5612a21e02d0 msgr2=0x5612a21efef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.851+0000 7febd1feab80 1 --2- 172.21.15.45:0/2955372411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5612a21e02d0 0x5612a21efef0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7febb4009fd0 tx=0x7febb400bce0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.851+0000 7febd1feab80 1 -- 172.21.15.45:0/2955372411 shutdown_connections 2024-05-10T03:42:34.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.851+0000 7febd1feab80 1 --2- 172.21.15.45:0/2955372411 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x5612a21f4140 0x5612a21f6590 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.851+0000 7febd1feab80 1 --2- 172.21.15.45:0/2955372411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5612a21e02d0 0x5612a21efef0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.851+0000 7febd1feab80 1 --2- 172.21.15.45:0/2955372411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21deab0 0x5612a21e8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.851+0000 7feb9affd700 0 client.26224 ms_handle_reset on v2:172.21.15.154:6838/1506563336 2024-05-10T03:42:34.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.851+0000 7febd1feab80 1 --2- 172.21.15.45:0/2955372411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612a21df980 0x5612a21e8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.851+0000 7febd1feab80 1 -- 172.21.15.45:0/2955372411 >> 172.21.15.45:0/2955372411 conn(0x5612a213ca60 msgr2=0x5612a21d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:34.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.851+0000 7febd1feab80 1 -- 172.21.15.45:0/2955372411 shutdown_connections 2024-05-10T03:42:34.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.851+0000 7febd1feab80 1 -- 172.21.15.45:0/2955372411 wait complete. 2024-05-10T03:42:34.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.851+0000 7febd1feab80 20 client.26224 trim_cache size 0 max 16384 2024-05-10T03:42:34.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.865+0000 7febd1feab80 1 Processor -- start 2024-05-10T03:42:34.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.865+0000 7febd1feab80 1 -- start start 2024-05-10T03:42:34.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.865+0000 7febd1feab80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612a21deab0 0x5612a21e7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.865+0000 7febd1feab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21df980 0x5612a21d4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.865+0000 7febd1feab80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5612a21e02d0 0x5612a21edea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.865+0000 7febd1feab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a21e9af0 con 0x5612a21df980 2024-05-10T03:42:34.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.865+0000 7febd1feab80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a21f0ff0 con 0x5612a21deab0 2024-05-10T03:42:34.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.865+0000 7febd1feab80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a21d6770 con 0x5612a21e02d0 2024-05-10T03:42:34.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.865+0000 7febbaffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21df980 0x5612a21d4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.865+0000 7febbaffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21df980 0x5612a21d4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57906/0 (socket says 172.21.15.45:57906) 2024-05-10T03:42:34.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.865+0000 7febbaffd700 1 -- 172.21.15.45:0/3763901669 learned_addr learned my addr 172.21.15.45:0/3763901669 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:34.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.865+0000 7febbb7fe700 1 --2- 172.21.15.45:0/3763901669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612a21deab0 0x5612a21e7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.866+0000 7febbbfff700 1 --2- 172.21.15.45:0/3763901669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5612a21e02d0 0x5612a21edea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.866+0000 7febbaffd700 1 -- 172.21.15.45:0/3763901669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5612a21e02d0 msgr2=0x5612a21edea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:34.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.866+0000 7febbaffd700 1 --2- 172.21.15.45:0/3763901669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5612a21e02d0 0x5612a21edea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.866+0000 7febbaffd700 1 -- 172.21.15.45:0/3763901669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612a21deab0 msgr2=0x5612a21e7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:34.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.866+0000 7febbaffd700 1 --2- 172.21.15.45:0/3763901669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612a21deab0 0x5612a21e7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.866+0000 7febbaffd700 1 -- 172.21.15.45:0/3763901669 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612a20c0560 con 0x5612a21df980 2024-05-10T03:42:34.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.866+0000 7febbbfff700 1 --2- 172.21.15.45:0/3763901669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5612a21e02d0 0x5612a21edea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:42:34.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.866+0000 7febbb7fe700 1 --2- 172.21.15.45:0/3763901669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612a21deab0 0x5612a21e7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:34.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.866+0000 7febbaffd700 1 --2- 172.21.15.45:0/3763901669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21df980 0x5612a21d4f00 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7febb0099e10 tx=0x7febb0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d34d17438b1fa3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:34.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.866+0000 7feba27fc700 1 -- 172.21.15.45:0/3763901669 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb009dcb0 con 0x5612a21df980 2024-05-10T03:42:34.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.866+0000 7feba27fc700 1 -- 172.21.15.45:0/3763901669 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7febb009ae90 con 0x5612a21df980 2024-05-10T03:42:34.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.866+0000 7feba27fc700 1 -- 172.21.15.45:0/3763901669 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb00105d0 con 0x5612a21df980 2024-05-10T03:42:34.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.867+0000 7febd1feab80 1 -- 172.21.15.45:0/3763901669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21df980 msgr2=0x5612a21d4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.867+0000 7febd1feab80 1 --2- 172.21.15.45:0/3763901669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21df980 0x5612a21d4f00 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7febb0099e10 tx=0x7febb0000bc0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.867+0000 7febd1feab80 1 -- 172.21.15.45:0/3763901669 shutdown_connections 2024-05-10T03:42:34.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.867+0000 7febd1feab80 1 --2- 172.21.15.45:0/3763901669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5612a21e02d0 0x5612a21edea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.867+0000 7febd1feab80 1 --2- 172.21.15.45:0/3763901669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612a21deab0 0x5612a21e7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.867+0000 7febd1feab80 1 --2- 172.21.15.45:0/3763901669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21df980 0x5612a21d4f00 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.867+0000 7febd1feab80 1 -- 172.21.15.45:0/3763901669 >> 172.21.15.45:0/3763901669 conn(0x5612a213ca60 msgr2=0x5612a21d1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:34.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.867+0000 7febd1feab80 1 -- 172.21.15.45:0/3763901669 shutdown_connections 2024-05-10T03:42:34.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.867+0000 7febd1feab80 1 -- 172.21.15.45:0/3763901669 wait complete. 2024-05-10T03:42:34.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.868+0000 7febd1feab80 1 -- start start 2024-05-10T03:42:34.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.868+0000 7febd1feab80 1 Processor -- start 2024-05-10T03:42:34.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.868+0000 7febd1feab80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5612a21deab0 0x5612a21ed850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.868+0000 7febd1feab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21df980 0x5612a21edd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.868+0000 7febd1feab80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612a21e02d0 0x5612a2248940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.868+0000 7febd1feab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a2248e80 con 0x5612a21df980 2024-05-10T03:42:34.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.868+0000 7febd1feab80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a2248fc0 con 0x5612a21e02d0 2024-05-10T03:42:34.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.868+0000 7febd1feab80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a2249150 con 0x5612a21deab0 2024-05-10T03:42:34.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.868+0000 7febd1feab80 10 client.0 _ll_register_callbacks cb 0x5612a209fb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:34.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.868+0000 7febbaffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21df980 0x5612a21edd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.868+0000 7febbaffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21df980 0x5612a21edd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57916/0 (socket says 172.21.15.45:57916) 2024-05-10T03:42:34.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.868+0000 7febbaffd700 1 -- 172.21.15.45:0/3825820238 learned_addr learned my addr 172.21.15.45:0/3825820238 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:34.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.869+0000 7febbb7fe700 1 --2- 172.21.15.45:0/3825820238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5612a21deab0 0x5612a21ed850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.869+0000 7febbbfff700 1 --2- 172.21.15.45:0/3825820238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612a21e02d0 0x5612a2248940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.869+0000 7febbb7fe700 1 -- 172.21.15.45:0/3825820238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612a21e02d0 msgr2=0x5612a2248940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:34.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.869+0000 7febbb7fe700 1 --2- 172.21.15.45:0/3825820238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612a21e02d0 0x5612a2248940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.869+0000 7febbb7fe700 1 -- 172.21.15.45:0/3825820238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21df980 msgr2=0x5612a21edd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:34.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.869+0000 7febbb7fe700 1 --2- 172.21.15.45:0/3825820238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21df980 0x5612a21edd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.869+0000 7febbb7fe700 1 -- 172.21.15.45:0/3825820238 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febac017070 con 0x5612a21deab0 2024-05-10T03:42:34.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.869+0000 7febbaffd700 1 --2- 172.21.15.45:0/3825820238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21df980 0x5612a21edd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:34.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.869+0000 7febbb7fe700 1 --2- 172.21.15.45:0/3825820238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5612a21deab0 0x5612a21ed850 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x5612a21f6ad0 tx=0x7febac0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4353ef4769b5cb2e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:34.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.869+0000 7feb9affd700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-05-10T03:42:34.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.869+0000 7feb9affd700 1 -- 172.21.15.45:0/3825820238 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac023040 con 0x5612a21deab0 2024-05-10T03:42:34.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.869+0000 7feb9affd700 1 -- 172.21.15.45:0/3825820238 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7febac01e980 con 0x5612a21deab0 2024-05-10T03:42:34.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.869+0000 7febd1feab80 1 -- 172.21.15.45:0/3825820238 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7febb40077c0 con 0x5612a21deab0 2024-05-10T03:42:34.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.870+0000 7feb9affd700 1 -- 172.21.15.45:0/3825820238 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7febac01e420 con 0x5612a21deab0 2024-05-10T03:42:34.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.870+0000 7febd1feab80 10 client.26230 fetch_fsmap learned FSMap version 29 2024-05-10T03:42:34.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.870+0000 7febd1feab80 1 -- 172.21.15.45:0/3825820238 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7febbc1a06d0 con 0x5612a21deab0 2024-05-10T03:42:34.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.870+0000 7feb9affd700 1 -- 172.21.15.45:0/3825820238 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7febb40077c0 con 0x5612a21deab0 2024-05-10T03:42:34.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.870+0000 7feb9affd700 1 -- 172.21.15.45:0/3825820238 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) v1 ==== 7474+0+0 (secure 0 0 0) 0x7febac01dcc0 con 0x5612a21deab0 2024-05-10T03:42:34.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.870+0000 7febd1feab80 10 client.26230 fetch_fsmap finished waiting for FSMap version 29 2024-05-10T03:42:34.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.870+0000 7febd1feab80 10 client.26230 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-10T03:42:34.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.870+0000 7febd1feab80 20 client.26230 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:34.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.870+0000 7febd1feab80 1 --2- 172.21.15.45:0/3825820238 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x5612a224ab30 0x5612a224cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:34.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.870+0000 7febd1feab80 4 client.26230 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-10T03:42:34.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.870+0000 7febd1feab80 1 -- 172.21.15.45:0/3825820238 --> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5612a20f2ec0 con 0x5612a224ab30 2024-05-10T03:42:34.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.870+0000 7febbaffd700 1 --2- 172.21.15.45:0/3825820238 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x5612a224ab30 0x5612a224cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:34.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.871+0000 7feb9affd700 10 client.26230 ms_handle_connect on v2:172.21.15.154:6838/1506563336 2024-05-10T03:42:34.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.871+0000 7febbaffd700 1 --2- 172.21.15.45:0/3825820238 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x5612a224ab30 0x5612a224cf50 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bdb06eff9dcfe5c4 server_cookie=c4f8528c82091ca5 in_seq=0 out_seq=0 2024-05-10T03:42:34.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.871+0000 7feb9affd700 1 -- 172.21.15.45:0/3825820238 <== mds.2 v2:172.21.15.154:6838/1506563336 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5612a20f2ec0 con 0x5612a224ab30 2024-05-10T03:42:34.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.871+0000 7feb9affd700 10 client.26230 handle_command_reply: tid=0 2024-05-10T03:42:34.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.871+0000 7febd1feab80 1 client.26230 shutdown 2024-05-10T03:42:34.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.871+0000 7febd1feab80 1 -- 172.21.15.45:0/3825820238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5612a21deab0 msgr2=0x5612a21ed850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.871+0000 7febd1feab80 1 --2- 172.21.15.45:0/3825820238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5612a21deab0 0x5612a21ed850 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x5612a21f6ad0 tx=0x7febac0047c0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.871+0000 7febd1feab80 1 -- 172.21.15.45:0/3825820238 shutdown_connections 2024-05-10T03:42:34.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.871+0000 7febd1feab80 1 --2- 172.21.15.45:0/3825820238 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x5612a224ab30 0x5612a224cf50 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.871+0000 7febd1feab80 1 --2- 172.21.15.45:0/3825820238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5612a21deab0 0x5612a21ed850 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.871+0000 7febd1feab80 1 --2- 172.21.15.45:0/3825820238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612a21e02d0 0x5612a2248940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.871+0000 7febd1feab80 1 --2- 172.21.15.45:0/3825820238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5612a21df980 0x5612a21edd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.871+0000 7feb9affd700 0 client.26230 ms_handle_reset on v2:172.21.15.154:6838/1506563336 2024-05-10T03:42:34.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.871+0000 7febd1feab80 1 -- 172.21.15.45:0/3825820238 >> 172.21.15.45:0/3825820238 conn(0x5612a213ca60 msgr2=0x5612a21d1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:34.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.871+0000 7febd1feab80 1 -- 172.21.15.45:0/3825820238 shutdown_connections 2024-05-10T03:42:34.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.871+0000 7febd1feab80 1 -- 172.21.15.45:0/3825820238 wait complete. 2024-05-10T03:42:34.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.872+0000 7febd1feab80 20 client.26230 trim_cache size 0 max 16384 2024-05-10T03:42:34.881 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-05-10T03:42:34.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.872+0000 7febc1ca6700 1 -- 172.21.15.45:0/630587351 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7feba40a11c0 msgr2=0x7feba40a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.872+0000 7febc1ca6700 1 --2- 172.21.15.45:0/630587351 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7feba40a11c0 0x7feba40a36d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7febbc068de0 tx=0x7febac009260 comp rx=0 tx=0).stop 2024-05-10T03:42:34.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.872+0000 7febc1ca6700 1 -- 172.21.15.45:0/630587351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febbc105010 msgr2=0x7febbc1985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:34.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.872+0000 7febc1ca6700 1 --2- 172.21.15.45:0/630587351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febbc105010 0x7febbc1985c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7febb000d950 tx=0x7febb000dc60 comp rx=0 tx=0).stop 2024-05-10T03:42:34.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.872+0000 7febc1ca6700 1 -- 172.21.15.45:0/630587351 shutdown_connections 2024-05-10T03:42:34.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.872+0000 7febc1ca6700 1 --2- 172.21.15.45:0/630587351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febbc107970 0x7febbc19f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.872+0000 7febc1ca6700 1 --2- 172.21.15.45:0/630587351 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7feba40a11c0 0x7feba40a36d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.872+0000 7febc1ca6700 1 --2- 172.21.15.45:0/630587351 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7febbc1026b0 0x7febbc198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.872+0000 7febc1ca6700 1 --2- 172.21.15.45:0/630587351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febbc105010 0x7febbc1985c0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:34.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.872+0000 7febc1ca6700 1 -- 172.21.15.45:0/630587351 >> 172.21.15.45:0/630587351 conn(0x7febbc0fc0d0 msgr2=0x7febbc1034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:34.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.872+0000 7febc1ca6700 1 -- 172.21.15.45:0/630587351 shutdown_connections 2024-05-10T03:42:34.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:34.872+0000 7febc1ca6700 1 -- 172.21.15.45:0/630587351 wait complete. 2024-05-10T03:42:34.890 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-10T03:42:35.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.047+0000 7fb4d85a3700 1 -- 172.21.15.45:0/3345277325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4d0100ac0 msgr2=0x7fb4d0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.047+0000 7fb4d85a3700 1 --2- 172.21.15.45:0/3345277325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4d0100ac0 0x7fb4d0100ed0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc009990 tx=0x7fb4cc009ca0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.047+0000 7fb4d85a3700 1 -- 172.21.15.45:0/3345277325 shutdown_connections 2024-05-10T03:42:35.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.047+0000 7fb4d85a3700 1 --2- 172.21.15.45:0/3345277325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4d0102580 0x7fb4d0108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.047+0000 7fb4d85a3700 1 --2- 172.21.15.45:0/3345277325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4d0100ac0 0x7fb4d0100ed0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.047+0000 7fb4d85a3700 1 --2- 172.21.15.45:0/3345277325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4d0101be0 0x7fb4d0101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.047+0000 7fb4d85a3700 1 -- 172.21.15.45:0/3345277325 >> 172.21.15.45:0/3345277325 conn(0x7fb4d00fc0d0 msgr2=0x7fb4d00fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:35.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.047+0000 7fb4d85a3700 1 -- 172.21.15.45:0/3345277325 shutdown_connections 2024-05-10T03:42:35.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.047+0000 7fb4d85a3700 1 -- 172.21.15.45:0/3345277325 wait complete. 2024-05-10T03:42:35.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.048+0000 7fb4d85a3700 1 Processor -- start 2024-05-10T03:42:35.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.048+0000 7fb4d85a3700 1 -- start start 2024-05-10T03:42:35.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.048+0000 7fb4d85a3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4d0100ac0 0x7fb4d0068e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.048+0000 7fb4d85a3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4d0101be0 0x7fb4d019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.048+0000 7fb4d85a3700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4d0102580 0x7fb4d019f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.048+0000 7fb4d85a3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d019faa0 con 0x7fb4d0100ac0 2024-05-10T03:42:35.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.048+0000 7fb4d85a3700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d019fc10 con 0x7fb4d0102580 2024-05-10T03:42:35.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.048+0000 7fb4d85a3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d019fdd0 con 0x7fb4d0101be0 2024-05-10T03:42:35.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.048+0000 7fb4d633f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4d0100ac0 0x7fb4d0068e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.048+0000 7fb4d633f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4d0100ac0 0x7fb4d0068e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57922/0 (socket says 172.21.15.45:57922) 2024-05-10T03:42:35.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.048+0000 7fb4d633f700 1 -- 172.21.15.45:0/3696995999 learned_addr learned my addr 172.21.15.45:0/3696995999 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:35.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.049+0000 7fb4d6b40700 1 --2- 172.21.15.45:0/3696995999 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4d0102580 0x7fb4d019f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.049+0000 7fb4d633f700 1 -- 172.21.15.45:0/3696995999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4d0101be0 msgr2=0x7fb4d019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.049+0000 7fb4d633f700 1 --2- 172.21.15.45:0/3696995999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4d0101be0 0x7fb4d019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.049+0000 7fb4d633f700 1 -- 172.21.15.45:0/3696995999 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4d0102580 msgr2=0x7fb4d019f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.049+0000 7fb4d633f700 1 --2- 172.21.15.45:0/3696995999 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4d0102580 0x7fb4d019f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.049+0000 7fb4d633f700 1 -- 172.21.15.45:0/3696995999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4cc0095f0 con 0x7fb4d0100ac0 2024-05-10T03:42:35.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.049+0000 7fb4d633f700 1 --2- 172.21.15.45:0/3696995999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4d0100ac0 0x7fb4d0068e30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc0098e0 tx=0x7fb4cc005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:35.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.049+0000 7fb4c77fe700 1 -- 172.21.15.45:0/3696995999 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc01d070 con 0x7fb4d0100ac0 2024-05-10T03:42:35.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.049+0000 7fb4c77fe700 1 -- 172.21.15.45:0/3696995999 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb4cc00fdf0 con 0x7fb4d0100ac0 2024-05-10T03:42:35.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.049+0000 7fb4c77fe700 1 -- 172.21.15.45:0/3696995999 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc017650 con 0x7fb4d0100ac0 2024-05-10T03:42:35.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.049+0000 7fb4d85a3700 1 -- 172.21.15.45:0/3696995999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d01a0050 con 0x7fb4d0100ac0 2024-05-10T03:42:35.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.049+0000 7fb4d85a3700 1 -- 172.21.15.45:0/3696995999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d01a0420 con 0x7fb4d0100ac0 2024-05-10T03:42:35.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.054+0000 7fb4e88e7b80 1 Processor -- start 2024-05-10T03:42:35.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.054+0000 7fb4e88e7b80 1 -- start start 2024-05-10T03:42:35.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.054+0000 7fb4e88e7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a0cf10ab0 0x555a0cf10f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.054+0000 7fb4e88e7b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555a0cf11980 0x555a0cf11d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.054+0000 7fb4e88e7b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a0cf122d0 0x555a0cf18bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.054+0000 7fb4e88e7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a0ce33150 con 0x555a0cf10ab0 2024-05-10T03:42:35.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.054+0000 7fb4e88e7b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a0ce30b10 con 0x555a0cf11980 2024-05-10T03:42:35.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.054+0000 7fb4e88e7b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a0ce2c400 con 0x555a0cf122d0 2024-05-10T03:42:35.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.054+0000 7fb4c77fe700 1 -- 172.21.15.45:0/3696995999 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb4cc021410 con 0x7fb4d0100ac0 2024-05-10T03:42:35.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.055+0000 7fb4d6b40700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a0cf10ab0 0x555a0cf10f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.055+0000 7fb4d6b40700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a0cf10ab0 0x555a0cf10f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57926/0 (socket says 172.21.15.45:57926) 2024-05-10T03:42:35.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.055+0000 7fb4d6b40700 1 -- 172.21.15.45:0/1102126560 learned_addr learned my addr 172.21.15.45:0/1102126560 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:35.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.055+0000 7fb4d633f700 1 --2- 172.21.15.45:0/1102126560 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555a0cf11980 0x555a0cf11d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.055+0000 7fb4d5b3e700 1 --2- 172.21.15.45:0/1102126560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a0cf122d0 0x555a0cf18bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.055+0000 7fb4d6b40700 1 -- 172.21.15.45:0/1102126560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a0cf122d0 msgr2=0x555a0cf18bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:35.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.055+0000 7fb4d6b40700 1 --2- 172.21.15.45:0/1102126560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a0cf122d0 0x555a0cf18bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.055+0000 7fb4d6b40700 1 -- 172.21.15.45:0/1102126560 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555a0cf11980 msgr2=0x555a0cf11d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:35.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.055+0000 7fb4d6b40700 1 --2- 172.21.15.45:0/1102126560 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555a0cf11980 0x555a0cf11d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.055+0000 7fb4d6b40700 1 -- 172.21.15.45:0/1102126560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a0ccad3b0 con 0x555a0cf10ab0 2024-05-10T03:42:35.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.055+0000 7fb4d6b40700 1 --2- 172.21.15.45:0/1102126560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a0cf10ab0 0x555a0cf10f00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fb4c80115d0 tx=0x7fb4c8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460058986970f3fc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:35.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.055+0000 7fb4c77fe700 1 --2- 172.21.15.45:0/3696995999 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb4bc0a11c0 0x7fb4bc0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.056+0000 7fb4d633f700 1 --2- 172.21.15.45:0/3696995999 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb4bc0a11c0 0x7fb4bc0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.056+0000 7fb4c77fe700 1 -- 172.21.15.45:0/3696995999 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb4cc0ce120 con 0x7fb4d0100ac0 2024-05-10T03:42:35.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.056+0000 7fb4d633f700 1 --2- 172.21.15.45:0/3696995999 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb4bc0a11c0 0x7fb4bc0a36d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc09af60 tx=0x7fb4cc0d1bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:35.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.057+0000 7fb4c4ff9700 1 -- 172.21.15.45:0/1102126560 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c800e040 con 0x555a0cf10ab0 2024-05-10T03:42:35.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.057+0000 7fb4c4ff9700 1 -- 172.21.15.45:0/1102126560 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb4c800f040 con 0x555a0cf10ab0 2024-05-10T03:42:35.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.057+0000 7fb4c4ff9700 1 -- 172.21.15.45:0/1102126560 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8004720 con 0x555a0cf10ab0 2024-05-10T03:42:35.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.057+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/1102126560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a0cf10ab0 msgr2=0x555a0cf10f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.057+0000 7fb4e88e7b80 1 --2- 172.21.15.45:0/1102126560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a0cf10ab0 0x555a0cf10f00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fb4c80115d0 tx=0x7fb4c8009920 comp rx=0 tx=0).stop 2024-05-10T03:42:35.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.058+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/1102126560 shutdown_connections 2024-05-10T03:42:35.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.058+0000 7fb4e88e7b80 1 --2- 172.21.15.45:0/1102126560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a0cf122d0 0x555a0cf18bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.058+0000 7fb4e88e7b80 1 --2- 172.21.15.45:0/1102126560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a0cf10ab0 0x555a0cf10f00 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.058+0000 7fb4e88e7b80 1 --2- 172.21.15.45:0/1102126560 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555a0cf11980 0x555a0cf11d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.058+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/1102126560 >> 172.21.15.45:0/1102126560 conn(0x555a0ce6ea60 msgr2=0x555a0cf06fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:35.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.058+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/1102126560 shutdown_connections 2024-05-10T03:42:35.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.058+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/1102126560 wait complete. 2024-05-10T03:42:35.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.058+0000 7fb4e88e7b80 1 -- start start 2024-05-10T03:42:35.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.058+0000 7fb4e88e7b80 1 Processor -- start 2024-05-10T03:42:35.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.059+0000 7fb4e88e7b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a0cf10ab0 0x555a0cf1aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.059+0000 7fb4e88e7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a0cf11980 0x555a0cf1b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.059+0000 7fb4e88e7b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555a0cf122d0 0x555a0cf21f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.059+0000 7fb4e88e7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a0cdc8560 con 0x555a0cf11980 2024-05-10T03:42:35.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.059+0000 7fb4e88e7b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a0cdc8200 con 0x555a0cf122d0 2024-05-10T03:42:35.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.059+0000 7fb4e88e7b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a0ccaf6a0 con 0x555a0cf10ab0 2024-05-10T03:42:35.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.059+0000 7fb4e88e7b80 10 client.0 _ll_register_callbacks cb 0x555a0cdd1b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:35.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.059+0000 7fb4d5b3e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a0cf11980 0x555a0cf1b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.059+0000 7fb4d5b3e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a0cf11980 0x555a0cf1b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57936/0 (socket says 172.21.15.45:57936) 2024-05-10T03:42:35.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.059+0000 7fb4d5b3e700 1 -- 172.21.15.45:0/4106955966 learned_addr learned my addr 172.21.15.45:0/4106955966 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:35.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.059+0000 7fb4d6b40700 1 --2- 172.21.15.45:0/4106955966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a0cf10ab0 0x555a0cf1aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.059+0000 7fb4d6b40700 1 --2- 172.21.15.45:0/4106955966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555a0cf122d0 0x555a0cf21f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.060+0000 7fb4d5b3e700 1 -- 172.21.15.45:0/4106955966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a0cf10ab0 msgr2=0x555a0cf1aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:35.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.060+0000 7fb4d5b3e700 1 --2- 172.21.15.45:0/4106955966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a0cf10ab0 0x555a0cf1aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.060+0000 7fb4d5b3e700 1 -- 172.21.15.45:0/4106955966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555a0cf122d0 msgr2=0x555a0cf21f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:35.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.060+0000 7fb4d5b3e700 1 --2- 172.21.15.45:0/4106955966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555a0cf122d0 0x555a0cf21f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.060+0000 7fb4d5b3e700 1 -- 172.21.15.45:0/4106955966 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c80112b0 con 0x555a0cf11980 2024-05-10T03:42:35.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.060+0000 7fb4d5b3e700 1 --2- 172.21.15.45:0/4106955966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a0cf11980 0x555a0cf1b030 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb4c000de30 tx=0x7fb4c000f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1eda27188d4d39a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:35.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.060+0000 7fb4b9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:42:35.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.060+0000 7fb4b9ffb700 1 -- 172.21.15.45:0/4106955966 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c001a460 con 0x555a0cf11980 2024-05-10T03:42:35.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.060+0000 7fb4b9ffb700 1 -- 172.21.15.45:0/4106955966 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb4c001a5c0 con 0x555a0cf11980 2024-05-10T03:42:35.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.060+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/4106955966 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555a0cd85270 con 0x555a0cf11980 2024-05-10T03:42:35.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.060+0000 7fb4b9ffb700 1 -- 172.21.15.45:0/4106955966 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4c001a7c0 con 0x555a0cf11980 2024-05-10T03:42:35.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.060+0000 7fb4e88e7b80 10 client.16380 fetch_fsmap learned FSMap version 29 2024-05-10T03:42:35.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.060+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/4106955966 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x555a0cc59b60 con 0x555a0cf11980 2024-05-10T03:42:35.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.061+0000 7fb4b9ffb700 1 -- 172.21.15.45:0/4106955966 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x555a0cd85270 con 0x555a0cf11980 2024-05-10T03:42:35.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.061+0000 7fb4b9ffb700 1 -- 172.21.15.45:0/4106955966 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 29) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fb4c0011ac0 con 0x555a0cf11980 2024-05-10T03:42:35.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.061+0000 7fb4e88e7b80 10 client.16380 fetch_fsmap finished waiting for FSMap version 29 2024-05-10T03:42:35.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.061+0000 7fb4e88e7b80 10 client.16380 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-10T03:42:35.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.061+0000 7fb4e88e7b80 20 client.16380 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:35.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.061+0000 7fb4e88e7b80 1 --2- 172.21.15.45:0/4106955966 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x555a0cf267d0 0x555a0cf28c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.061+0000 7fb4e88e7b80 4 client.16380 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:42:35.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.061+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/4106955966 --> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555a0cedb780 con 0x555a0cf267d0 2024-05-10T03:42:35.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.061+0000 7fb4d6b40700 1 --2- 172.21.15.45:0/4106955966 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x555a0cf267d0 0x555a0cf28c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.062+0000 7fb4b9ffb700 10 client.16380 ms_handle_connect on v2:172.21.15.106:6836/3047487403 2024-05-10T03:42:35.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.062+0000 7fb4d6b40700 1 --2- 172.21.15.45:0/4106955966 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x555a0cf267d0 0x555a0cf28c20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8f6fd525b0682c03 server_cookie=53481e597a61ee65 in_seq=0 out_seq=0 2024-05-10T03:42:35.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.062+0000 7fb4b9ffb700 1 -- 172.21.15.45:0/4106955966 <== mds.1 v2:172.21.15.106:6836/3047487403 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555a0cedb780 con 0x555a0cf267d0 2024-05-10T03:42:35.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.062+0000 7fb4b9ffb700 10 client.16380 handle_command_reply: tid=0 2024-05-10T03:42:35.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.062+0000 7fb4e88e7b80 1 client.16380 shutdown 2024-05-10T03:42:35.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.063+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/4106955966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a0cf11980 msgr2=0x555a0cf1b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.063+0000 7fb4e88e7b80 1 --2- 172.21.15.45:0/4106955966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a0cf11980 0x555a0cf1b030 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb4c000de30 tx=0x7fb4c000f640 comp rx=0 tx=0).stop 2024-05-10T03:42:35.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.063+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/4106955966 shutdown_connections 2024-05-10T03:42:35.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.063+0000 7fb4e88e7b80 1 --2- 172.21.15.45:0/4106955966 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x555a0cf267d0 0x555a0cf28c20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.063+0000 7fb4e88e7b80 1 --2- 172.21.15.45:0/4106955966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a0cf10ab0 0x555a0cf1aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.063+0000 7fb4e88e7b80 1 --2- 172.21.15.45:0/4106955966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555a0cf122d0 0x555a0cf21f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.063+0000 7fb4e88e7b80 1 --2- 172.21.15.45:0/4106955966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a0cf11980 0x555a0cf1b030 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.063+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/4106955966 >> 172.21.15.45:0/4106955966 conn(0x555a0ce6ea60 msgr2=0x555a0cf06fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:35.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.063+0000 7fb4b9ffb700 0 client.16380 ms_handle_reset on v2:172.21.15.106:6836/3047487403 2024-05-10T03:42:35.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.063+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/4106955966 shutdown_connections 2024-05-10T03:42:35.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.063+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/4106955966 wait complete. 2024-05-10T03:42:35.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.063+0000 7fb4e88e7b80 20 client.16380 trim_cache size 0 max 16384 2024-05-10T03:42:35.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.077+0000 7fb4e88e7b80 1 Processor -- start 2024-05-10T03:42:35.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.078+0000 7fb4e88e7b80 1 -- start start 2024-05-10T03:42:35.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.078+0000 7fb4e88e7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a0cf10ab0 0x555a0cf22570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.078+0000 7fb4e88e7b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a0cf11980 0x555a0cf21f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.078+0000 7fb4e88e7b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555a0cf122d0 0x555a0cf1aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.078+0000 7fb4e88e7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a0cf23ca0 con 0x555a0cf10ab0 2024-05-10T03:42:35.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.078+0000 7fb4e88e7b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a0cf152c0 con 0x555a0cf122d0 2024-05-10T03:42:35.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.078+0000 7fb4e88e7b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a0cf087f0 con 0x555a0cf11980 2024-05-10T03:42:35.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.078+0000 7fb4d6b40700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a0cf10ab0 0x555a0cf22570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.078+0000 7fb4d6b40700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a0cf10ab0 0x555a0cf22570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57942/0 (socket says 172.21.15.45:57942) 2024-05-10T03:42:35.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.078+0000 7fb4d6b40700 1 -- 172.21.15.45:0/1328401999 learned_addr learned my addr 172.21.15.45:0/1328401999 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:35.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.078+0000 7fb4d5b3e700 1 --2- 172.21.15.45:0/1328401999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a0cf11980 0x555a0cf21f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.078+0000 7fb4d6b40700 1 --2- 172.21.15.45:0/1328401999 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555a0cf122d0 0x555a0cf1aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.079+0000 7fb4d6b40700 1 -- 172.21.15.45:0/1328401999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a0cf11980 msgr2=0x555a0cf21f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.079+0000 7fb4d6b40700 1 --2- 172.21.15.45:0/1328401999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a0cf11980 0x555a0cf21f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.079+0000 7fb4d6b40700 1 -- 172.21.15.45:0/1328401999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a0cf10ab0 msgr2=0x555a0cf22570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.079+0000 7fb4d6b40700 1 --2- 172.21.15.45:0/1328401999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a0cf10ab0 0x555a0cf22570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.079+0000 7fb4d6b40700 1 -- 172.21.15.45:0/1328401999 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a0cdf2560 con 0x555a0cf122d0 2024-05-10T03:42:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.079+0000 7fb4d6b40700 1 --2- 172.21.15.45:0/1328401999 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555a0cf122d0 0x555a0cf1aaf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x555a0cf11430 tx=0x7fb4c800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fc1f7354f932e60 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.079+0000 7fb4c57fa700 1 -- 172.21.15.45:0/1328401999 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c800e070 con 0x555a0cf122d0 2024-05-10T03:42:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.079+0000 7fb4c57fa700 1 -- 172.21.15.45:0/1328401999 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb4c802d7c0 con 0x555a0cf122d0 2024-05-10T03:42:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.079+0000 7fb4c57fa700 1 -- 172.21.15.45:0/1328401999 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8004860 con 0x555a0cf122d0 2024-05-10T03:42:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.080+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/1328401999 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555a0cf122d0 msgr2=0x555a0cf1aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.080+0000 7fb4e88e7b80 1 --2- 172.21.15.45:0/1328401999 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555a0cf122d0 0x555a0cf1aaf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x555a0cf11430 tx=0x7fb4c800b040 comp rx=0 tx=0).stop 2024-05-10T03:42:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.080+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/1328401999 shutdown_connections 2024-05-10T03:42:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.080+0000 7fb4e88e7b80 1 --2- 172.21.15.45:0/1328401999 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555a0cf122d0 0x555a0cf1aaf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.080+0000 7fb4e88e7b80 1 --2- 172.21.15.45:0/1328401999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a0cf10ab0 0x555a0cf22570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.080+0000 7fb4e88e7b80 1 --2- 172.21.15.45:0/1328401999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a0cf11980 0x555a0cf21f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.080+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/1328401999 >> 172.21.15.45:0/1328401999 conn(0x555a0ce6ea60 msgr2=0x555a0cf14bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.081+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/1328401999 shutdown_connections 2024-05-10T03:42:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.081+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/1328401999 wait complete. 2024-05-10T03:42:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.081+0000 7fb4e88e7b80 1 -- start start 2024-05-10T03:42:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.081+0000 7fb4e88e7b80 1 Processor -- start 2024-05-10T03:42:35.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.081+0000 7fb4e88e7b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a0cf10ab0 0x555a0cf1f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.081+0000 7fb4e88e7b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555a0cf11980 0x555a0cf1f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.081+0000 7fb4e88e7b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a0cf122d0 0x555a0cf7ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.081+0000 7fb4e88e7b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a0cf7b1b0 con 0x555a0cf122d0 2024-05-10T03:42:35.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.081+0000 7fb4e88e7b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a0cf7b2f0 con 0x555a0cf11980 2024-05-10T03:42:35.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.081+0000 7fb4e88e7b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a0cf7b480 con 0x555a0cf10ab0 2024-05-10T03:42:35.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.082+0000 7fb4e88e7b80 10 client.0 _ll_register_callbacks cb 0x555a0cdd1b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:35.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.082+0000 7fb4d6b40700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a0cf10ab0 0x555a0cf1f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.082+0000 7fb4d6b40700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a0cf10ab0 0x555a0cf1f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:53996/0 (socket says 172.21.15.45:53996) 2024-05-10T03:42:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.082+0000 7fb4d6b40700 1 -- 172.21.15.45:0/2560026524 learned_addr learned my addr 172.21.15.45:0/2560026524 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.082+0000 7fb4d6b40700 1 --2- 172.21.15.45:0/2560026524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a0cf122d0 0x555a0cf7ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.082+0000 7fb4d5b3e700 1 --2- 172.21.15.45:0/2560026524 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555a0cf11980 0x555a0cf1f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.082+0000 7fb4d6b40700 1 -- 172.21.15.45:0/2560026524 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555a0cf11980 msgr2=0x555a0cf1f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.082+0000 7fb4d6b40700 1 --2- 172.21.15.45:0/2560026524 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555a0cf11980 0x555a0cf1f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.082+0000 7fb4d6b40700 1 -- 172.21.15.45:0/2560026524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a0cf122d0 msgr2=0x555a0cf7ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.082+0000 7fb4d6b40700 1 --2- 172.21.15.45:0/2560026524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a0cf122d0 0x555a0cf7ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.082+0000 7fb4d6b40700 1 -- 172.21.15.45:0/2560026524 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c8028040 con 0x555a0cf10ab0 2024-05-10T03:42:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.082+0000 7fb4d6b40700 1 --2- 172.21.15.45:0/2560026524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a0cf10ab0 0x555a0cf1f080 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8004090 tx=0x7fb4c8021040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cde53889d0345994 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.082+0000 7fb4b9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-05-10T03:42:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.083+0000 7fb4b9ffb700 1 -- 172.21.15.45:0/2560026524 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c800e070 con 0x555a0cf10ab0 2024-05-10T03:42:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.083+0000 7fb4b9ffb700 1 -- 172.21.15.45:0/2560026524 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb4c802eac0 con 0x555a0cf10ab0 2024-05-10T03:42:35.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.083+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/2560026524 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb4c800f040 con 0x555a0cf10ab0 2024-05-10T03:42:35.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.083+0000 7fb4b9ffb700 1 -- 172.21.15.45:0/2560026524 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4c8003c00 con 0x555a0cf10ab0 2024-05-10T03:42:35.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.083+0000 7fb4e88e7b80 10 client.26245 fetch_fsmap learned FSMap version 29 2024-05-10T03:42:35.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.083+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/2560026524 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x555a0ccb1cd0 con 0x555a0cf10ab0 2024-05-10T03:42:35.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.083+0000 7fb4b9ffb700 1 -- 172.21.15.45:0/2560026524 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb4c8043020 con 0x555a0cf10ab0 2024-05-10T03:42:35.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.083+0000 7fb4b9ffb700 1 -- 172.21.15.45:0/2560026524 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fb4c8007570 con 0x555a0cf10ab0 2024-05-10T03:42:35.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.083+0000 7fb4e88e7b80 10 client.26245 fetch_fsmap finished waiting for FSMap version 29 2024-05-10T03:42:35.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.083+0000 7fb4e88e7b80 10 client.26245 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-10T03:42:35.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.083+0000 7fb4e88e7b80 20 client.26245 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:35.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.083+0000 7fb4e88e7b80 1 --2- 172.21.15.45:0/2560026524 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x555a0cf7ca60 0x555a0cf7ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.083+0000 7fb4e88e7b80 4 client.26245 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-10T03:42:35.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.083+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/2560026524 --> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555a0ce24ec0 con 0x555a0cf7ca60 2024-05-10T03:42:35.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.084+0000 7fb4d5b3e700 1 --2- 172.21.15.45:0/2560026524 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x555a0cf7ca60 0x555a0cf7ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.084+0000 7fb4d5b3e700 1 --2- 172.21.15.45:0/2560026524 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x555a0cf7ca60 0x555a0cf7ee80 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1790cc1ae84d2aa1 server_cookie=8edd4de18ad545c5 in_seq=0 out_seq=0 2024-05-10T03:42:35.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.084+0000 7fb4b9ffb700 10 client.26245 ms_handle_connect on v2:172.21.15.106:6836/3047487403 2024-05-10T03:42:35.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.084+0000 7fb4b9ffb700 1 -- 172.21.15.45:0/2560026524 <== mds.1 v2:172.21.15.106:6836/3047487403 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555a0ce24ec0 con 0x555a0cf7ca60 2024-05-10T03:42:35.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.084+0000 7fb4b9ffb700 10 client.26245 handle_command_reply: tid=0 2024-05-10T03:42:35.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.084+0000 7fb4e88e7b80 1 client.26245 shutdown 2024-05-10T03:42:35.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.084+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/2560026524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a0cf10ab0 msgr2=0x555a0cf1f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.084+0000 7fb4e88e7b80 1 --2- 172.21.15.45:0/2560026524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a0cf10ab0 0x555a0cf1f080 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8004090 tx=0x7fb4c8021040 comp rx=0 tx=0).stop 2024-05-10T03:42:35.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.084+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/2560026524 shutdown_connections 2024-05-10T03:42:35.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.084+0000 7fb4e88e7b80 1 --2- 172.21.15.45:0/2560026524 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x555a0cf7ca60 0x555a0cf7ee80 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.084+0000 7fb4e88e7b80 1 --2- 172.21.15.45:0/2560026524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a0cf10ab0 0x555a0cf1f080 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.084+0000 7fb4e88e7b80 1 --2- 172.21.15.45:0/2560026524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a0cf122d0 0x555a0cf7ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.085+0000 7fb4e88e7b80 1 --2- 172.21.15.45:0/2560026524 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555a0cf11980 0x555a0cf1f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.084+0000 7fb4b9ffb700 0 client.26245 ms_handle_reset on v2:172.21.15.106:6836/3047487403 2024-05-10T03:42:35.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.085+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/2560026524 >> 172.21.15.45:0/2560026524 conn(0x555a0ce6ea60 msgr2=0x555a0cf14bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:35.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.085+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/2560026524 shutdown_connections 2024-05-10T03:42:35.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.085+0000 7fb4e88e7b80 1 -- 172.21.15.45:0/2560026524 wait complete. 2024-05-10T03:42:35.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.085+0000 7fb4e88e7b80 20 client.26245 trim_cache size 0 max 16384 2024-05-10T03:42:35.093 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-05-10T03:42:35.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.085+0000 7fb4d85a3700 1 -- 172.21.15.45:0/3696995999 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb4bc0a11c0 msgr2=0x7fb4bc0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.085+0000 7fb4d85a3700 1 --2- 172.21.15.45:0/3696995999 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb4bc0a11c0 0x7fb4bc0a36d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc09af60 tx=0x7fb4cc0d1bc0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.085+0000 7fb4d85a3700 1 -- 172.21.15.45:0/3696995999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4d0100ac0 msgr2=0x7fb4d0068e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.085+0000 7fb4d85a3700 1 --2- 172.21.15.45:0/3696995999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4d0100ac0 0x7fb4d0068e30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc0098e0 tx=0x7fb4cc005b00 comp rx=0 tx=0).stop 2024-05-10T03:42:35.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.086+0000 7fb4d85a3700 1 -- 172.21.15.45:0/3696995999 shutdown_connections 2024-05-10T03:42:35.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.086+0000 7fb4d85a3700 1 --2- 172.21.15.45:0/3696995999 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb4bc0a11c0 0x7fb4bc0a36d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.086+0000 7fb4d85a3700 1 --2- 172.21.15.45:0/3696995999 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4d0102580 0x7fb4d019f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.086+0000 7fb4d85a3700 1 --2- 172.21.15.45:0/3696995999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4d0100ac0 0x7fb4d0068e30 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.086+0000 7fb4d85a3700 1 --2- 172.21.15.45:0/3696995999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4d0101be0 0x7fb4d019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.086+0000 7fb4d85a3700 1 -- 172.21.15.45:0/3696995999 >> 172.21.15.45:0/3696995999 conn(0x7fb4d00fc0d0 msgr2=0x7fb4d0104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:35.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.086+0000 7fb4d85a3700 1 -- 172.21.15.45:0/3696995999 shutdown_connections 2024-05-10T03:42:35.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.086+0000 7fb4d85a3700 1 -- 172.21.15.45:0/3696995999 wait complete. 2024-05-10T03:42:35.110 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-10T03:42:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.194+0000 7f28b07f2700 1 -- 172.21.15.45:0/2794548772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28a8100ac0 msgr2=0x7f28a8100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.194+0000 7f28b07f2700 1 --2- 172.21.15.45:0/2794548772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28a8100ac0 0x7f28a8100ed0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f28a4009920 tx=0x7f28a4009c30 comp rx=0 tx=0).stop 2024-05-10T03:42:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.194+0000 7f28b07f2700 1 -- 172.21.15.45:0/2794548772 shutdown_connections 2024-05-10T03:42:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.194+0000 7f28b07f2700 1 --2- 172.21.15.45:0/2794548772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28a8100ac0 0x7f28a8100ed0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.194+0000 7f28b07f2700 1 --2- 172.21.15.45:0/2794548772 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28a8102580 0x7f28a8108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.194+0000 7f28b07f2700 1 --2- 172.21.15.45:0/2794548772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28a8101be0 0x7f28a8101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.194+0000 7f28b07f2700 1 -- 172.21.15.45:0/2794548772 >> 172.21.15.45:0/2794548772 conn(0x7f28a80fc0f0 msgr2=0x7f28a80fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.195+0000 7f28b07f2700 1 -- 172.21.15.45:0/2794548772 shutdown_connections 2024-05-10T03:42:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.195+0000 7f28b07f2700 1 -- 172.21.15.45:0/2794548772 wait complete. 2024-05-10T03:42:35.201 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.195+0000 7f28b07f2700 1 Processor -- start 2024-05-10T03:42:35.201 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.196+0000 7f28b07f2700 1 -- start start 2024-05-10T03:42:35.201 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.196+0000 7f28b07f2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28a8100ac0 0x7f28a80690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.201 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.196+0000 7f28b07f2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28a8101be0 0x7f28a819cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.201 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.196+0000 7f28b07f2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28a8102580 0x7f28a819f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.196+0000 7f28b07f2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a819fbf0 con 0x7f28a8101be0 2024-05-10T03:42:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.196+0000 7f28b07f2700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a819fd60 con 0x7f28a8102580 2024-05-10T03:42:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.196+0000 7f28b07f2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a819ff20 con 0x7f28a8100ac0 2024-05-10T03:42:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.196+0000 7f28add8d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28a8101be0 0x7f28a819cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.196+0000 7f28ae58e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28a8100ac0 0x7f28a80690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.196+0000 7f28ae58e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28a8100ac0 0x7f28a80690c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:54014/0 (socket says 172.21.15.45:54014) 2024-05-10T03:42:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.196+0000 7f28ae58e700 1 -- 172.21.15.45:0/1981514553 learned_addr learned my addr 172.21.15.45:0/1981514553 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.196+0000 7f28aed8f700 1 --2- 172.21.15.45:0/1981514553 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28a8102580 0x7f28a819f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.196+0000 7f28ae58e700 1 -- 172.21.15.45:0/1981514553 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28a8102580 msgr2=0x7f28a819f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.196+0000 7f28ae58e700 1 --2- 172.21.15.45:0/1981514553 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28a8102580 0x7f28a819f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.196+0000 7f28ae58e700 1 -- 172.21.15.45:0/1981514553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28a8101be0 msgr2=0x7f28a819cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.196+0000 7f28ae58e700 1 --2- 172.21.15.45:0/1981514553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28a8101be0 0x7f28a819cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.196+0000 7f28ae58e700 1 -- 172.21.15.45:0/1981514553 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28980095f0 con 0x7f28a8100ac0 2024-05-10T03:42:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.197+0000 7f28add8d700 1 --2- 172.21.15.45:0/1981514553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28a8101be0 0x7f28a819cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.197+0000 7f28ae58e700 1 --2- 172.21.15.45:0/1981514553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28a8100ac0 0x7f28a80690c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f28a4000c00 tx=0x7f28a4005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:35.204 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.197+0000 7f289f7fe700 1 -- 172.21.15.45:0/1981514553 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a401c070 con 0x7f28a8100ac0 2024-05-10T03:42:35.204 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.197+0000 7f289f7fe700 1 -- 172.21.15.45:0/1981514553 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f28a400ba40 con 0x7f28a8100ac0 2024-05-10T03:42:35.204 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.197+0000 7f28b07f2700 1 -- 172.21.15.45:0/1981514553 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a4009520 con 0x7f28a8100ac0 2024-05-10T03:42:35.204 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.197+0000 7f289f7fe700 1 -- 172.21.15.45:0/1981514553 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a4003a40 con 0x7f28a8100ac0 2024-05-10T03:42:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.197+0000 7f28b07f2700 1 -- 172.21.15.45:0/1981514553 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a8197030 con 0x7f28a8100ac0 2024-05-10T03:42:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.199+0000 7f289f7fe700 1 -- 172.21.15.45:0/1981514553 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f28a4020030 con 0x7f28a8100ac0 2024-05-10T03:42:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.200+0000 7f289f7fe700 1 --2- 172.21.15.45:0/1981514553 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f28940a1120 0x7f28940a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.201+0000 7f28add8d700 1 --2- 172.21.15.45:0/1981514553 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f28940a1120 0x7f28940a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.201+0000 7f289f7fe700 1 -- 172.21.15.45:0/1981514553 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f28a40cdd10 con 0x7f28a8100ac0 2024-05-10T03:42:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.201+0000 7f28add8d700 1 --2- 172.21.15.45:0/1981514553 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f28940a1120 0x7f28940a3630 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f28a8068a60 tx=0x7f2898009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.203+0000 7f28c0b36b80 1 Processor -- start 2024-05-10T03:42:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.203+0000 7f28c0b36b80 1 -- start start 2024-05-10T03:42:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.203+0000 7f28c0b36b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5565b96b7180 0x5565b96b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.203+0000 7f28c0b36b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5565b96b8050 0x5565b96b8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.203+0000 7f28c0b36b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565b96b89a0 0x5565b96bf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.203+0000 7f28c0b36b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565b95de0f0 con 0x5565b96b89a0 2024-05-10T03:42:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.203+0000 7f28c0b36b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565b95dbab0 con 0x5565b96b7180 2024-05-10T03:42:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.203+0000 7f28c0b36b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565b95d73a0 con 0x5565b96b8050 2024-05-10T03:42:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.204+0000 7f28add8d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5565b96b8050 0x5565b96b8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.204+0000 7f28add8d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5565b96b8050 0x5565b96b8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:54028/0 (socket says 172.21.15.45:54028) 2024-05-10T03:42:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.204+0000 7f28aed8f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565b96b89a0 0x5565b96bf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.204+0000 7f28add8d700 1 -- 172.21.15.45:0/1180348471 learned_addr learned my addr 172.21.15.45:0/1180348471 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.204+0000 7f28ae58e700 1 --2- 172.21.15.45:0/1180348471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5565b96b7180 0x5565b96b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.204+0000 7f28add8d700 1 -- 172.21.15.45:0/1180348471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5565b96b7180 msgr2=0x5565b96b75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.204+0000 7f28add8d700 1 --2- 172.21.15.45:0/1180348471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5565b96b7180 0x5565b96b75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.204+0000 7f28add8d700 1 -- 172.21.15.45:0/1180348471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565b96b89a0 msgr2=0x5565b96bf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.204+0000 7f28add8d700 1 --2- 172.21.15.45:0/1180348471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565b96b89a0 0x5565b96bf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.204+0000 7f28add8d700 1 -- 172.21.15.45:0/1180348471 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565b9458350 con 0x5565b96b8050 2024-05-10T03:42:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.204+0000 7f28add8d700 1 --2- 172.21.15.45:0/1180348471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5565b96b8050 0x5565b96b8460 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f28980043a0 tx=0x7f2898014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17df250116708f6d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.204+0000 7f289cff9700 1 -- 172.21.15.45:0/1180348471 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898003d10 con 0x5565b96b8050 2024-05-10T03:42:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.205+0000 7f289cff9700 1 -- 172.21.15.45:0/1180348471 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2898003e70 con 0x5565b96b8050 2024-05-10T03:42:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.205+0000 7f289cff9700 1 -- 172.21.15.45:0/1180348471 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289801e890 con 0x5565b96b8050 2024-05-10T03:42:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.206+0000 7f28c0b36b80 1 -- 172.21.15.45:0/1180348471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5565b96b8050 msgr2=0x5565b96b8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.206+0000 7f28c0b36b80 1 --2- 172.21.15.45:0/1180348471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5565b96b8050 0x5565b96b8460 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f28980043a0 tx=0x7f2898014000 comp rx=0 tx=0).stop 2024-05-10T03:42:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.206+0000 7f28c0b36b80 1 -- 172.21.15.45:0/1180348471 shutdown_connections 2024-05-10T03:42:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.206+0000 7f28c0b36b80 1 --2- 172.21.15.45:0/1180348471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565b96b89a0 0x5565b96bf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.206+0000 7f28c0b36b80 1 --2- 172.21.15.45:0/1180348471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5565b96b7180 0x5565b96b75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.206+0000 7f28c0b36b80 1 --2- 172.21.15.45:0/1180348471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5565b96b8050 0x5565b96b8460 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.206+0000 7f28c0b36b80 1 -- 172.21.15.45:0/1180348471 >> 172.21.15.45:0/1180348471 conn(0x5565b9619a00 msgr2=0x5565b96b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.206+0000 7f28c0b36b80 1 -- 172.21.15.45:0/1180348471 shutdown_connections 2024-05-10T03:42:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.206+0000 7f28c0b36b80 1 -- 172.21.15.45:0/1180348471 wait complete. 2024-05-10T03:42:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.207+0000 7f28c0b36b80 1 -- start start 2024-05-10T03:42:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.207+0000 7f28c0b36b80 1 Processor -- start 2024-05-10T03:42:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.207+0000 7f28c0b36b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5565b96b7180 0x5565b96c1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.207+0000 7f28c0b36b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5565b96b8050 0x5565b96c1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.207+0000 7f28c0b36b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565b96b89a0 0x5565b96c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.207+0000 7f28c0b36b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565b9573500 con 0x5565b96b89a0 2024-05-10T03:42:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.207+0000 7f28c0b36b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565b95731a0 con 0x5565b96b7180 2024-05-10T03:42:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.207+0000 7f28c0b36b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565b945a640 con 0x5565b96b8050 2024-05-10T03:42:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.207+0000 7f28c0b36b80 10 client.0 _ll_register_callbacks cb 0x5565b957cad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.207+0000 7f28add8d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5565b96b8050 0x5565b96c1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.207+0000 7f28add8d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5565b96b8050 0x5565b96c1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:54030/0 (socket says 172.21.15.45:54030) 2024-05-10T03:42:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.207+0000 7f28add8d700 1 -- 172.21.15.45:0/2526120701 learned_addr learned my addr 172.21.15.45:0/2526120701 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.208+0000 7f28aed8f700 1 --2- 172.21.15.45:0/2526120701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565b96b89a0 0x5565b96c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.208+0000 7f28ae58e700 1 --2- 172.21.15.45:0/2526120701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5565b96b7180 0x5565b96c1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.208+0000 7f28aed8f700 1 -- 172.21.15.45:0/2526120701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5565b96b8050 msgr2=0x5565b96c1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:35.218 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.208+0000 7f28aed8f700 1 --2- 172.21.15.45:0/2526120701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5565b96b8050 0x5565b96c1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.218 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.208+0000 7f28aed8f700 1 -- 172.21.15.45:0/2526120701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5565b96b7180 msgr2=0x5565b96c1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:35.218 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.208+0000 7f28aed8f700 1 --2- 172.21.15.45:0/2526120701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5565b96b7180 0x5565b96c1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.218 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.208+0000 7f28aed8f700 1 -- 172.21.15.45:0/2526120701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2898017070 con 0x5565b96b89a0 2024-05-10T03:42:35.218 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.208+0000 7f28ae58e700 1 --2- 172.21.15.45:0/2526120701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5565b96b7180 0x5565b96c1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:35.218 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.208+0000 7f28aed8f700 1 --2- 172.21.15.45:0/2526120701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565b96b89a0 0x5565b96c86a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f28a0007b20 tx=0x7f28a0007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dae2c2694f1cce8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:35.218 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.208+0000 7f2891ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:42:35.218 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.208+0000 7f2891ffb700 1 -- 172.21.15.45:0/2526120701 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a0012c00 con 0x5565b96b89a0 2024-05-10T03:42:35.218 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.208+0000 7f2891ffb700 1 -- 172.21.15.45:0/2526120701 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f28a0012d60 con 0x5565b96b89a0 2024-05-10T03:42:35.218 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.208+0000 7f28c0b36b80 1 -- 172.21.15.45:0/2526120701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5565b9530210 con 0x5565b96b89a0 2024-05-10T03:42:35.218 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.209+0000 7f2891ffb700 1 -- 172.21.15.45:0/2526120701 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28a0016420 con 0x5565b96b89a0 2024-05-10T03:42:35.218 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.209+0000 7f28c0b36b80 10 client.16398 fetch_fsmap learned FSMap version 29 2024-05-10T03:42:35.218 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.209+0000 7f28c0b36b80 1 -- 172.21.15.45:0/2526120701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5565b9404b00 con 0x5565b96b89a0 2024-05-10T03:42:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.209+0000 7f2891ffb700 1 -- 172.21.15.45:0/2526120701 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x5565b9530210 con 0x5565b96b89a0 2024-05-10T03:42:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.209+0000 7f2891ffb700 1 -- 172.21.15.45:0/2526120701 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 29) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f28a0014040 con 0x5565b96b89a0 2024-05-10T03:42:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.209+0000 7f28c0b36b80 10 client.16398 fetch_fsmap finished waiting for FSMap version 29 2024-05-10T03:42:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.209+0000 7f28c0b36b80 10 client.16398 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:42:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.209+0000 7f28c0b36b80 20 client.16398 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.209+0000 7f28c0b36b80 1 --2- 172.21.15.45:0/2526120701 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5565b96ccf60 0x5565b96cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.209+0000 7f28c0b36b80 4 client.16398 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:42:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.209+0000 7f28c0b36b80 1 -- 172.21.15.45:0/2526120701 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5565b9686720 con 0x5565b96ccf60 2024-05-10T03:42:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.210+0000 7f28ae58e700 1 --2- 172.21.15.45:0/2526120701 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5565b96ccf60 0x5565b96cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.210+0000 7f28ae58e700 1 --2- 172.21.15.45:0/2526120701 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5565b96ccf60 0x5565b96cf3b0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a125774ec109067 server_cookie=77602a11b75521e6 in_seq=0 out_seq=0 2024-05-10T03:42:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.210+0000 7f2891ffb700 10 client.16398 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.211+0000 7f2891ffb700 1 -- 172.21.15.45:0/2526120701 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5565b9686720 con 0x5565b96ccf60 2024-05-10T03:42:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.211+0000 7f2891ffb700 10 client.16398 handle_command_reply: tid=0 2024-05-10T03:42:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.211+0000 7f28c0b36b80 1 client.16398 shutdown 2024-05-10T03:42:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.211+0000 7f28c0b36b80 1 -- 172.21.15.45:0/2526120701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565b96b89a0 msgr2=0x5565b96c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.211+0000 7f28c0b36b80 1 --2- 172.21.15.45:0/2526120701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565b96b89a0 0x5565b96c86a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f28a0007b20 tx=0x7f28a0007e30 comp rx=0 tx=0).stop 2024-05-10T03:42:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.211+0000 7f28c0b36b80 1 -- 172.21.15.45:0/2526120701 shutdown_connections 2024-05-10T03:42:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.211+0000 7f28c0b36b80 1 --2- 172.21.15.45:0/2526120701 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5565b96ccf60 0x5565b96cf3b0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.211+0000 7f28c0b36b80 1 --2- 172.21.15.45:0/2526120701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565b96b89a0 0x5565b96c86a0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.211+0000 7f28c0b36b80 1 --2- 172.21.15.45:0/2526120701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5565b96b7180 0x5565b96c1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.211+0000 7f28c0b36b80 1 --2- 172.21.15.45:0/2526120701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5565b96b8050 0x5565b96c1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.211+0000 7f2891ffb700 0 client.16398 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:35.222 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.211+0000 7f28c0b36b80 1 -- 172.21.15.45:0/2526120701 >> 172.21.15.45:0/2526120701 conn(0x5565b9619a00 msgr2=0x5565b96b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:35.222 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.211+0000 7f28c0b36b80 1 -- 172.21.15.45:0/2526120701 shutdown_connections 2024-05-10T03:42:35.222 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.211+0000 7f28c0b36b80 1 -- 172.21.15.45:0/2526120701 wait complete. 2024-05-10T03:42:35.222 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.212+0000 7f28c0b36b80 20 client.16398 trim_cache size 0 max 16384 2024-05-10T03:42:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.229+0000 7f28c0b36b80 1 Processor -- start 2024-05-10T03:42:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.229+0000 7f28c0b36b80 1 -- start start 2024-05-10T03:42:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.230+0000 7f28c0b36b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5565b96b7180 0x5565b96c07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.230+0000 7f28c0b36b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565b96b8050 0x5565b96c6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.230+0000 7f28c0b36b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5565b96b89a0 0x5565b96c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.230+0000 7f28c0b36b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565b96ac360 con 0x5565b96b8050 2024-05-10T03:42:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.230+0000 7f28c0b36b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565b96b7a10 con 0x5565b96b89a0 2024-05-10T03:42:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.230+0000 7f28c0b36b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565b96bf590 con 0x5565b96b7180 2024-05-10T03:42:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.230+0000 7f28add8d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565b96b8050 0x5565b96c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.230+0000 7f28aed8f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5565b96b89a0 0x5565b96c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.230+0000 7f28add8d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565b96b8050 0x5565b96c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57976/0 (socket says 172.21.15.45:57976) 2024-05-10T03:42:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.230+0000 7f28aed8f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5565b96b89a0 0x5565b96c6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.45:46046/0 (socket says 172.21.15.45:46046) 2024-05-10T03:42:35.236 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.230+0000 7f28add8d700 1 -- 172.21.15.45:0/2644387824 learned_addr learned my addr 172.21.15.45:0/2644387824 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:35.236 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.230+0000 7f28ae58e700 1 --2- 172.21.15.45:0/2644387824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5565b96b7180 0x5565b96c07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.236 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.230+0000 7f28aed8f700 1 -- 172.21.15.45:0/2644387824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5565b96b7180 msgr2=0x5565b96c07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:35.236 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.230+0000 7f28aed8f700 1 --2- 172.21.15.45:0/2644387824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5565b96b7180 0x5565b96c07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.236 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.230+0000 7f28aed8f700 1 -- 172.21.15.45:0/2644387824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565b96b8050 msgr2=0x5565b96c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:35.236 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.230+0000 7f28aed8f700 1 --2- 172.21.15.45:0/2644387824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565b96b8050 0x5565b96c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.236 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.230+0000 7f28aed8f700 1 -- 172.21.15.45:0/2644387824 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565b959d500 con 0x5565b96b89a0 2024-05-10T03:42:35.236 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.231+0000 7f28aed8f700 1 --2- 172.21.15.45:0/2644387824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5565b96b89a0 0x5565b96c6a80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f28a0002230 tx=0x7f28a0015820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49a23f3acf428889 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:35.236 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.231+0000 7f289d7fa700 1 -- 172.21.15.45:0/2644387824 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a0015d30 con 0x5565b96b89a0 2024-05-10T03:42:35.236 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.231+0000 7f289d7fa700 1 -- 172.21.15.45:0/2644387824 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f28a000f040 con 0x5565b96b89a0 2024-05-10T03:42:35.237 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.231+0000 7f289d7fa700 1 -- 172.21.15.45:0/2644387824 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a0012c80 con 0x5565b96b89a0 2024-05-10T03:42:35.242 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.232+0000 7f28c0b36b80 1 -- 172.21.15.45:0/2644387824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5565b96b89a0 msgr2=0x5565b96c6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.242 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.232+0000 7f28c0b36b80 1 --2- 172.21.15.45:0/2644387824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5565b96b89a0 0x5565b96c6a80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f28a0002230 tx=0x7f28a0015820 comp rx=0 tx=0).stop 2024-05-10T03:42:35.242 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.232+0000 7f28c0b36b80 1 -- 172.21.15.45:0/2644387824 shutdown_connections 2024-05-10T03:42:35.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.232+0000 7f28c0b36b80 1 --2- 172.21.15.45:0/2644387824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5565b96b7180 0x5565b96c07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.232+0000 7f28c0b36b80 1 --2- 172.21.15.45:0/2644387824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5565b96b89a0 0x5565b96c6a80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.232+0000 7f28c0b36b80 1 --2- 172.21.15.45:0/2644387824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565b96b8050 0x5565b96c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.232+0000 7f28c0b36b80 1 -- 172.21.15.45:0/2644387824 >> 172.21.15.45:0/2644387824 conn(0x5565b9619a00 msgr2=0x5565b96b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:35.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.232+0000 7f28c0b36b80 1 -- 172.21.15.45:0/2644387824 shutdown_connections 2024-05-10T03:42:35.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.232+0000 7f28c0b36b80 1 -- 172.21.15.45:0/2644387824 wait complete. 2024-05-10T03:42:35.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.232+0000 7f28c0b36b80 1 -- start start 2024-05-10T03:42:35.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.233+0000 7f28c0b36b80 1 Processor -- start 2024-05-10T03:42:35.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.233+0000 7f28c0b36b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565b96b7180 0x5565b96c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.233+0000 7f28c0b36b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5565b96b8050 0x5565b96c6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.233+0000 7f28c0b36b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5565b96b89a0 0x5565b9721420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.233+0000 7f28c0b36b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565b96c6740 con 0x5565b96b7180 2024-05-10T03:42:35.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.233+0000 7f28c0b36b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565b9721990 con 0x5565b96b8050 2024-05-10T03:42:35.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.233+0000 7f28c0b36b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565b9721b50 con 0x5565b96b89a0 2024-05-10T03:42:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.233+0000 7f28c0b36b80 10 client.0 _ll_register_callbacks cb 0x5565b957cad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.233+0000 7f28ae58e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565b96b7180 0x5565b96c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.233+0000 7f28ae58e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565b96b7180 0x5565b96c5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57984/0 (socket says 172.21.15.45:57984) 2024-05-10T03:42:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.233+0000 7f28ae58e700 1 -- 172.21.15.45:0/919258268 learned_addr learned my addr 172.21.15.45:0/919258268 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.233+0000 7f28aed8f700 1 --2- 172.21.15.45:0/919258268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5565b96b89a0 0x5565b9721420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.233+0000 7f28add8d700 1 --2- 172.21.15.45:0/919258268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5565b96b8050 0x5565b96c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.233+0000 7f28ae58e700 1 -- 172.21.15.45:0/919258268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5565b96b89a0 msgr2=0x5565b9721420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.234+0000 7f28ae58e700 1 --2- 172.21.15.45:0/919258268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5565b96b89a0 0x5565b9721420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.234+0000 7f28ae58e700 1 -- 172.21.15.45:0/919258268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5565b96b8050 msgr2=0x5565b96c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.234+0000 7f28ae58e700 1 --2- 172.21.15.45:0/919258268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5565b96b8050 0x5565b96c6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.234+0000 7f28ae58e700 1 -- 172.21.15.45:0/919258268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5565b9404b00 con 0x5565b96b7180 2024-05-10T03:42:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.234+0000 7f28aed8f700 1 --2- 172.21.15.45:0/919258268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5565b96b89a0 0x5565b9721420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.234+0000 7f28add8d700 1 --2- 172.21.15.45:0/919258268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5565b96b8050 0x5565b96c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:42:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.234+0000 7f28ae58e700 1 --2- 172.21.15.45:0/919258268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565b96b7180 0x5565b96c5b10 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f28a4005f40 tx=0x7f28a4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be68e800b931c75 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.234+0000 7f2891ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:42:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.234+0000 7f2891ffb700 1 -- 172.21.15.45:0/919258268 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a40a3240 con 0x5565b96b7180 2024-05-10T03:42:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.234+0000 7f2891ffb700 1 -- 172.21.15.45:0/919258268 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f28a40053e0 con 0x5565b96b7180 2024-05-10T03:42:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.234+0000 7f28c0b36b80 1 -- 172.21.15.45:0/919258268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2898003e70 con 0x5565b96b7180 2024-05-10T03:42:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.234+0000 7f2891ffb700 1 -- 172.21.15.45:0/919258268 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28a40b9120 con 0x5565b96b7180 2024-05-10T03:42:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.234+0000 7f28c0b36b80 10 client.16404 fetch_fsmap learned FSMap version 29 2024-05-10T03:42:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.234+0000 7f28c0b36b80 1 -- 172.21.15.45:0/919258268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5565b945cc70 con 0x5565b96b7180 2024-05-10T03:42:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.235+0000 7f2891ffb700 1 -- 172.21.15.45:0/919258268 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2898003e70 con 0x5565b96b7180 2024-05-10T03:42:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.235+0000 7f2891ffb700 1 -- 172.21.15.45:0/919258268 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 29) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f28a409b0b0 con 0x5565b96b7180 2024-05-10T03:42:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.235+0000 7f28c0b36b80 10 client.16404 fetch_fsmap finished waiting for FSMap version 29 2024-05-10T03:42:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.235+0000 7f28c0b36b80 10 client.16404 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:42:35.246 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.235+0000 7f28c0b36b80 20 client.16404 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:35.246 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.235+0000 7f28c0b36b80 1 --2- 172.21.15.45:0/919258268 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5565b9723170 0x5565b9725590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.246 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.235+0000 7f28c0b36b80 4 client.16404 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T03:42:35.247 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.235+0000 7f28c0b36b80 1 -- 172.21.15.45:0/919258268 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5565b95cfe60 con 0x5565b9723170 2024-05-10T03:42:35.247 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.235+0000 7f28add8d700 1 --2- 172.21.15.45:0/919258268 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5565b9723170 0x5565b9725590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.247 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.236+0000 7f28add8d700 1 --2- 172.21.15.45:0/919258268 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5565b9723170 0x5565b9725590 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f91b477ff77cfca8 server_cookie=eba45d99396c1d12 in_seq=0 out_seq=0 2024-05-10T03:42:35.247 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.236+0000 7f2891ffb700 10 client.16404 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:35.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:35 smithi045 ceph-mon[42520]: pgmap v354: 129 pgs: 129 active+clean; 81 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 6.7 MiB/s wr, 34 op/s 2024-05-10T03:42:35.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:35 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3404392851' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:42:35.341 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.335+0000 7faf7da0e700 1 -- 172.21.15.45:0/2790451375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf78108630 msgr2=0x7faf78108a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.342 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.335+0000 7faf7da0e700 1 --2- 172.21.15.45:0/2790451375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf78108630 0x7faf78108a40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7faf6c0098f0 tx=0x7faf6c009c00 comp rx=0 tx=0).stop 2024-05-10T03:42:35.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.343+0000 7faf7da0e700 1 -- 172.21.15.45:0/2790451375 shutdown_connections 2024-05-10T03:42:35.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.343+0000 7faf7da0e700 1 --2- 172.21.15.45:0/2790451375 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf78109c50 0x7faf7810e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.343+0000 7faf7da0e700 1 --2- 172.21.15.45:0/2790451375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf78108630 0x7faf78108a40 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.343+0000 7faf7da0e700 1 --2- 172.21.15.45:0/2790451375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf78109300 0x7faf78109710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.343+0000 7faf7da0e700 1 -- 172.21.15.45:0/2790451375 >> 172.21.15.45:0/2790451375 conn(0x7faf7806ea00 msgr2=0x7faf78070eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:35.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.347+0000 7faf7da0e700 1 -- 172.21.15.45:0/2790451375 shutdown_connections 2024-05-10T03:42:35.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.347+0000 7faf7da0e700 1 -- 172.21.15.45:0/2790451375 wait complete. 2024-05-10T03:42:35.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.347+0000 7faf7da0e700 1 Processor -- start 2024-05-10T03:42:35.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.348+0000 7faf7da0e700 1 -- start start 2024-05-10T03:42:35.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.348+0000 7faf7da0e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf78108630 0x7faf78115430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.348+0000 7faf7da0e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf78109300 0x7faf78115970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.348+0000 7faf7da0e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf78109c50 0x7faf781b6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.348+0000 7faf7da0e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf781b71b0 con 0x7faf78109c50 2024-05-10T03:42:35.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.348+0000 7faf7da0e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf781b72f0 con 0x7faf78108630 2024-05-10T03:42:35.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.348+0000 7faf7da0e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf781b74b0 con 0x7faf78109300 2024-05-10T03:42:35.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.350+0000 7faf777fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf78109c50 0x7faf781b6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.350+0000 7faf777fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf78109c50 0x7faf781b6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58002/0 (socket says 172.21.15.45:58002) 2024-05-10T03:42:35.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.350+0000 7faf777fe700 1 -- 172.21.15.45:0/4219354280 learned_addr learned my addr 172.21.15.45:0/4219354280 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:35.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.350+0000 7faf777fe700 1 -- 172.21.15.45:0/4219354280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf78109300 msgr2=0x7faf78115970 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-10T03:42:35.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.350+0000 7faf777fe700 1 --2- 172.21.15.45:0/4219354280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf78109300 0x7faf78115970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.350+0000 7faf777fe700 1 -- 172.21.15.45:0/4219354280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf78108630 msgr2=0x7faf78115430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.350+0000 7faf777fe700 1 --2- 172.21.15.45:0/4219354280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf78108630 0x7faf78115430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.350+0000 7faf777fe700 1 -- 172.21.15.45:0/4219354280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6c009520 con 0x7faf78109c50 2024-05-10T03:42:35.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.351+0000 7faf777fe700 1 --2- 172.21.15.45:0/4219354280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf78109c50 0x7faf781b6c70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7faf6800d980 tx=0x7faf6800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:35.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.353+0000 7faf7ca0c700 1 -- 172.21.15.45:0/4219354280 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf68009940 con 0x7faf78109c50 2024-05-10T03:42:35.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.353+0000 7faf7ca0c700 1 -- 172.21.15.45:0/4219354280 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faf68004830 con 0x7faf78109c50 2024-05-10T03:42:35.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.353+0000 7faf7ca0c700 1 -- 172.21.15.45:0/4219354280 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf68005580 con 0x7faf78109c50 2024-05-10T03:42:35.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.353+0000 7faf7da0e700 1 -- 172.21.15.45:0/4219354280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf781b7790 con 0x7faf78109c50 2024-05-10T03:42:35.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.353+0000 7faf7da0e700 1 -- 172.21.15.45:0/4219354280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf781b7c50 con 0x7faf78109c50 2024-05-10T03:42:35.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.365+0000 7faf8dd52b80 1 Processor -- start 2024-05-10T03:42:35.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.365+0000 7faf7ca0c700 1 -- 172.21.15.45:0/4219354280 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7faf68004d30 con 0x7faf78109c50 2024-05-10T03:42:35.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.367+0000 7faf7ca0c700 1 --2- 172.21.15.45:0/4219354280 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7faf600a1400 0x7faf600a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.367+0000 7faf7ca0c700 1 -- 172.21.15.45:0/4219354280 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7faf680cca90 con 0x7faf78109c50 2024-05-10T03:42:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.367+0000 7faf767fc700 1 --2- 172.21.15.45:0/4219354280 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7faf600a1400 0x7faf600a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.367+0000 7faf8dd52b80 1 -- start start 2024-05-10T03:42:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.368+0000 7faf8dd52b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ac8616c6a0 0x55ac8616caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.368+0000 7faf8dd52b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac8616d570 0x55ac8616d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.368+0000 7faf8dd52b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ac8616dec0 0x55ac861747c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.368+0000 7faf8dd52b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac86093150 con 0x55ac8616dec0 2024-05-10T03:42:35.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.368+0000 7faf8dd52b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac86090b10 con 0x55ac8616c6a0 2024-05-10T03:42:35.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.368+0000 7faf8dd52b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac8608c400 con 0x55ac8616d570 2024-05-10T03:42:35.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.370+0000 7faf767fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac8616d570 0x55ac8616d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.370+0000 7faf767fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac8616d570 0x55ac8616d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:54072/0 (socket says 172.21.15.45:54072) 2024-05-10T03:42:35.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.370+0000 7faf767fc700 1 -- 172.21.15.45:0/77237446 learned_addr learned my addr 172.21.15.45:0/77237446 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:35.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.371+0000 7faf777fe700 1 --2- 172.21.15.45:0/77237446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ac8616dec0 0x55ac861747c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.371+0000 7faf767fc700 1 --2- 172.21.15.45:0/4219354280 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7faf600a1400 0x7faf600a3910 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7faf70009750 tx=0x7faf700078a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:35.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.372+0000 7faf767fc700 1 -- 172.21.15.45:0/77237446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ac8616c6a0 msgr2=0x55ac8616caf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T03:42:35.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.372+0000 7faf767fc700 1 --2- 172.21.15.45:0/77237446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ac8616c6a0 0x55ac8616caf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.372+0000 7faf767fc700 1 -- 172.21.15.45:0/77237446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ac8616dec0 msgr2=0x55ac861747c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:35.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.372+0000 7faf767fc700 1 --2- 172.21.15.45:0/77237446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ac8616dec0 0x55ac861747c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.372+0000 7faf767fc700 1 -- 172.21.15.45:0/77237446 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac85f0d3b0 con 0x55ac8616d570 2024-05-10T03:42:35.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.372+0000 7faf767fc700 1 --2- 172.21.15.45:0/77237446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac8616d570 0x55ac8616d980 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faf70019730 tx=0x7faf7001a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da19f27cd2997f57 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:35.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.372+0000 7faf5dffb700 1 -- 172.21.15.45:0/77237446 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf70004db0 con 0x55ac8616d570 2024-05-10T03:42:35.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.372+0000 7faf5dffb700 1 -- 172.21.15.45:0/77237446 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faf7000f030 con 0x55ac8616d570 2024-05-10T03:42:35.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.372+0000 7faf5dffb700 1 -- 172.21.15.45:0/77237446 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf70018670 con 0x55ac8616d570 2024-05-10T03:42:35.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.374+0000 7faf8dd52b80 1 -- 172.21.15.45:0/77237446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac8616d570 msgr2=0x55ac8616d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.374+0000 7faf8dd52b80 1 --2- 172.21.15.45:0/77237446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac8616d570 0x55ac8616d980 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faf70019730 tx=0x7faf7001a000 comp rx=0 tx=0).stop 2024-05-10T03:42:35.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.374+0000 7faf8dd52b80 1 -- 172.21.15.45:0/77237446 shutdown_connections 2024-05-10T03:42:35.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.374+0000 7faf8dd52b80 1 --2- 172.21.15.45:0/77237446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ac8616dec0 0x55ac861747c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.374+0000 7faf8dd52b80 1 --2- 172.21.15.45:0/77237446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ac8616c6a0 0x55ac8616caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.374+0000 7faf8dd52b80 1 --2- 172.21.15.45:0/77237446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac8616d570 0x55ac8616d980 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.374+0000 7faf8dd52b80 1 -- 172.21.15.45:0/77237446 >> 172.21.15.45:0/77237446 conn(0x55ac860cea60 msgr2=0x55ac86166fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:35.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.374+0000 7faf8dd52b80 1 -- 172.21.15.45:0/77237446 shutdown_connections 2024-05-10T03:42:35.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.374+0000 7faf8dd52b80 1 -- 172.21.15.45:0/77237446 wait complete. 2024-05-10T03:42:35.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.375+0000 7faf8dd52b80 1 -- start start 2024-05-10T03:42:35.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.375+0000 7faf8dd52b80 1 Processor -- start 2024-05-10T03:42:35.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.376+0000 7faf8dd52b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ac8616c6a0 0x55ac861766d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.376+0000 7faf8dd52b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ac8616d570 0x55ac86176c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.376+0000 7faf8dd52b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac8616dec0 0x55ac8617db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.376+0000 7faf8dd52b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac86028560 con 0x55ac8616d570 2024-05-10T03:42:35.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.376+0000 7faf8dd52b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac86028200 con 0x55ac8616c6a0 2024-05-10T03:42:35.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.376+0000 7faf8dd52b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac85f0f6a0 con 0x55ac8616dec0 2024-05-10T03:42:35.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.376+0000 7faf8dd52b80 10 client.0 _ll_register_callbacks cb 0x55ac86031b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:35.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.376+0000 7faf777fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac8616dec0 0x55ac8617db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.376+0000 7faf777fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac8616dec0 0x55ac8617db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:54074/0 (socket says 172.21.15.45:54074) 2024-05-10T03:42:35.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.376+0000 7faf777fe700 1 -- 172.21.15.45:0/1533943835 learned_addr learned my addr 172.21.15.45:0/1533943835 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:35.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.376+0000 7faf76ffd700 1 --2- 172.21.15.45:0/1533943835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ac8616c6a0 0x55ac861766d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.376+0000 7faf767fc700 1 --2- 172.21.15.45:0/1533943835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ac8616d570 0x55ac86176c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.377+0000 7faf777fe700 1 -- 172.21.15.45:0/1533943835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ac8616c6a0 msgr2=0x55ac861766d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:35.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.377+0000 7faf777fe700 1 --2- 172.21.15.45:0/1533943835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ac8616c6a0 0x55ac861766d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.377+0000 7faf777fe700 1 -- 172.21.15.45:0/1533943835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ac8616d570 msgr2=0x55ac86176c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:35.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.377+0000 7faf777fe700 1 --2- 172.21.15.45:0/1533943835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ac8616d570 0x55ac86176c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.377+0000 7faf777fe700 1 -- 172.21.15.45:0/1533943835 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf70019410 con 0x55ac8616dec0 2024-05-10T03:42:35.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.377+0000 7faf777fe700 1 --2- 172.21.15.45:0/1533943835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac8616dec0 0x55ac8617db70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faf68095fe0 tx=0x7faf6809a320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7374ef0e3658180 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:35.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.377+0000 7faf56ffd700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-05-10T03:42:35.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.378+0000 7faf56ffd700 1 -- 172.21.15.45:0/1533943835 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf68014070 con 0x55ac8616dec0 2024-05-10T03:42:35.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.378+0000 7faf56ffd700 1 -- 172.21.15.45:0/1533943835 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7faf680a1f60 con 0x55ac8616dec0 2024-05-10T03:42:35.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.378+0000 7faf8dd52b80 1 -- 172.21.15.45:0/1533943835 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ac85fe5270 con 0x55ac8616dec0 2024-05-10T03:42:35.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.380+0000 7faf56ffd700 1 -- 172.21.15.45:0/1533943835 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf680ca2a0 con 0x55ac8616dec0 2024-05-10T03:42:35.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.383+0000 7faf8dd52b80 10 client.26272 fetch_fsmap learned FSMap version 29 2024-05-10T03:42:35.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.383+0000 7faf8dd52b80 1 -- 172.21.15.45:0/1533943835 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55ac85eb9b60 con 0x55ac8616dec0 2024-05-10T03:42:35.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.383+0000 7faf56ffd700 1 -- 172.21.15.45:0/1533943835 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55ac85fe5270 con 0x55ac8616dec0 2024-05-10T03:42:35.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.383+0000 7faf56ffd700 1 -- 172.21.15.45:0/1533943835 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) v1 ==== 7474+0+0 (secure 0 0 0) 0x7faf680b2200 con 0x55ac8616dec0 2024-05-10T03:42:35.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.388+0000 7faf8dd52b80 10 client.26272 fetch_fsmap finished waiting for FSMap version 29 2024-05-10T03:42:35.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.388+0000 7faf8dd52b80 10 client.26272 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:42:35.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.388+0000 7faf8dd52b80 20 client.26272 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:35.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.388+0000 7faf8dd52b80 1 --2- 172.21.15.45:0/1533943835 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55ac86182380 0x55ac861847d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.388+0000 7faf8dd52b80 4 client.26272 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:42:35.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.388+0000 7faf8dd52b80 1 -- 172.21.15.45:0/1533943835 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ac8613b780 con 0x55ac86182380 2024-05-10T03:42:35.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.388+0000 7faf76ffd700 1 --2- 172.21.15.45:0/1533943835 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55ac86182380 0x55ac861847d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.389+0000 7faf56ffd700 10 client.26272 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:35.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.389+0000 7faf76ffd700 1 --2- 172.21.15.45:0/1533943835 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55ac86182380 0x55ac861847d0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76bb593ab0d2be17 server_cookie=bb94c2bf58ab1775 in_seq=0 out_seq=0 2024-05-10T03:42:35.400 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:35 smithi106 ceph-mon[46996]: pgmap v354: 129 pgs: 129 active+clean; 81 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 6.7 MiB/s wr, 34 op/s 2024-05-10T03:42:35.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:35 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3404392851' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:42:35.419 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.416+0000 7f2891ffb700 1 -- 172.21.15.45:0/919258268 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5565b95cfe60 con 0x5565b9723170 2024-05-10T03:42:35.419 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.416+0000 7f2891ffb700 10 client.16404 handle_command_reply: tid=0 2024-05-10T03:42:35.419 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.416+0000 7f28c0b36b80 1 client.16404 shutdown 2024-05-10T03:42:35.420 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.416+0000 7f28c0b36b80 1 -- 172.21.15.45:0/919258268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565b96b7180 msgr2=0x5565b96c5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.420 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.416+0000 7f28c0b36b80 1 --2- 172.21.15.45:0/919258268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565b96b7180 0x5565b96c5b10 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f28a4005f40 tx=0x7f28a4009c30 comp rx=0 tx=0).stop 2024-05-10T03:42:35.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.416+0000 7faf56ffd700 1 -- 172.21.15.45:0/1533943835 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ac8613b780 con 0x55ac86182380 2024-05-10T03:42:35.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.416+0000 7faf56ffd700 10 client.26272 handle_command_reply: tid=0 2024-05-10T03:42:35.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.416+0000 7faf8dd52b80 1 client.26272 shutdown 2024-05-10T03:42:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.416+0000 7f28c0b36b80 1 -- 172.21.15.45:0/919258268 shutdown_connections 2024-05-10T03:42:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.416+0000 7f28c0b36b80 1 --2- 172.21.15.45:0/919258268 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5565b9723170 0x5565b9725590 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.416+0000 7f28c0b36b80 1 --2- 172.21.15.45:0/919258268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5565b96b89a0 0x5565b9721420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.416+0000 7f28c0b36b80 1 --2- 172.21.15.45:0/919258268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565b96b7180 0x5565b96c5b10 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.416+0000 7f28c0b36b80 1 --2- 172.21.15.45:0/919258268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5565b96b8050 0x5565b96c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.416+0000 7f28c0b36b80 1 -- 172.21.15.45:0/919258268 >> 172.21.15.45:0/919258268 conn(0x5565b9619a00 msgr2=0x5565b96bf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.416+0000 7f2891ffb700 0 client.16404 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.416+0000 7f28c0b36b80 1 -- 172.21.15.45:0/919258268 shutdown_connections 2024-05-10T03:42:35.421 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.416+0000 7f28c0b36b80 1 -- 172.21.15.45:0/919258268 wait complete. 2024-05-10T03:42:35.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.417+0000 7faf8dd52b80 1 -- 172.21.15.45:0/1533943835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac8616dec0 msgr2=0x55ac8617db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.417+0000 7faf8dd52b80 1 --2- 172.21.15.45:0/1533943835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac8616dec0 0x55ac8617db70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faf68095fe0 tx=0x7faf6809a320 comp rx=0 tx=0).stop 2024-05-10T03:42:35.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.417+0000 7faf8dd52b80 1 -- 172.21.15.45:0/1533943835 shutdown_connections 2024-05-10T03:42:35.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.417+0000 7faf8dd52b80 1 --2- 172.21.15.45:0/1533943835 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55ac86182380 0x55ac861847d0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.422 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.417+0000 7f28c0b36b80 20 client.16404 trim_cache size 0 max 16384 2024-05-10T03:42:35.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.417+0000 7faf8dd52b80 1 --2- 172.21.15.45:0/1533943835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac8616dec0 0x55ac8617db70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.417+0000 7faf8dd52b80 1 --2- 172.21.15.45:0/1533943835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ac8616c6a0 0x55ac861766d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.417+0000 7faf8dd52b80 1 --2- 172.21.15.45:0/1533943835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ac8616d570 0x55ac86176c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.417+0000 7faf8dd52b80 1 -- 172.21.15.45:0/1533943835 >> 172.21.15.45:0/1533943835 conn(0x55ac860cea60 msgr2=0x55ac86166fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:35.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.417+0000 7faf56ffd700 0 client.26272 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:35.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.417+0000 7faf8dd52b80 1 -- 172.21.15.45:0/1533943835 shutdown_connections 2024-05-10T03:42:35.423 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:{ 2024-05-10T03:42:35.424 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "message": "", 2024-05-10T03:42:35.424 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "return_code": 0 2024-05-10T03:42:35.424 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:} 2024-05-10T03:42:35.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.417+0000 7faf8dd52b80 1 -- 172.21.15.45:0/1533943835 wait complete. 2024-05-10T03:42:35.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.417+0000 7faf8dd52b80 20 client.26272 trim_cache size 0 max 16384 2024-05-10T03:42:35.425 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.418+0000 7f28b07f2700 1 -- 172.21.15.45:0/1981514553 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f28940a1120 msgr2=0x7f28940a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.425 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.418+0000 7f28b07f2700 1 --2- 172.21.15.45:0/1981514553 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f28940a1120 0x7f28940a3630 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f28a8068a60 tx=0x7f2898009310 comp rx=0 tx=0).stop 2024-05-10T03:42:35.425 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.418+0000 7f28b07f2700 1 -- 172.21.15.45:0/1981514553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28a8100ac0 msgr2=0x7f28a80690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.425 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.418+0000 7f28b07f2700 1 --2- 172.21.15.45:0/1981514553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28a8100ac0 0x7f28a80690c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f28a4000c00 tx=0x7f28a4005270 comp rx=0 tx=0).stop 2024-05-10T03:42:35.425 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.418+0000 7f28b07f2700 1 -- 172.21.15.45:0/1981514553 shutdown_connections 2024-05-10T03:42:35.425 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.418+0000 7f28b07f2700 1 --2- 172.21.15.45:0/1981514553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28a8100ac0 0x7f28a80690c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.425 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.418+0000 7f28b07f2700 1 --2- 172.21.15.45:0/1981514553 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f28940a1120 0x7f28940a3630 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.426 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.418+0000 7f28b07f2700 1 --2- 172.21.15.45:0/1981514553 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28a8102580 0x7f28a819f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.426 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.418+0000 7f28b07f2700 1 --2- 172.21.15.45:0/1981514553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28a8101be0 0x7f28a819cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.426 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.418+0000 7f28b07f2700 1 -- 172.21.15.45:0/1981514553 >> 172.21.15.45:0/1981514553 conn(0x7f28a80fc0f0 msgr2=0x7f28a8104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:35.426 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.419+0000 7f28b07f2700 1 -- 172.21.15.45:0/1981514553 shutdown_connections 2024-05-10T03:42:35.426 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:35.419+0000 7f28b07f2700 1 -- 172.21.15.45:0/1981514553 wait complete. 2024-05-10T03:42:35.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.433+0000 7faf8dd52b80 1 Processor -- start 2024-05-10T03:42:35.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.433+0000 7faf8dd52b80 1 -- start start 2024-05-10T03:42:35.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.433+0000 7faf8dd52b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ac8616c6a0 0x55ac8616d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.433+0000 7faf8dd52b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ac8616d570 0x55ac86175c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.433+0000 7faf8dd52b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac8616dec0 0x55ac8617d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.433+0000 7faf8dd52b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac86168770 con 0x55ac8616c6a0 2024-05-10T03:42:35.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.433+0000 7faf8dd52b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac8616d3a0 con 0x55ac8616d570 2024-05-10T03:42:35.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.433+0000 7faf8dd52b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac86167ad0 con 0x55ac8616dec0 2024-05-10T03:42:35.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.433+0000 7faf76ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ac8616c6a0 0x55ac8616d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.433+0000 7faf76ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ac8616c6a0 0x55ac8616d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58032/0 (socket says 172.21.15.45:58032) 2024-05-10T03:42:35.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.433+0000 7faf76ffd700 1 -- 172.21.15.45:0/301996244 learned_addr learned my addr 172.21.15.45:0/301996244 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:35.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.434+0000 7faf777fe700 1 --2- 172.21.15.45:0/301996244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac8616dec0 0x55ac8617d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.434+0000 7faf767fc700 1 --2- 172.21.15.45:0/301996244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ac8616d570 0x55ac86175c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.434+0000 7faf76ffd700 1 -- 172.21.15.45:0/301996244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac8616dec0 msgr2=0x55ac8617d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:35.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.434+0000 7faf76ffd700 1 --2- 172.21.15.45:0/301996244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac8616dec0 0x55ac8617d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.434+0000 7faf76ffd700 1 -- 172.21.15.45:0/301996244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ac8616d570 msgr2=0x55ac86175c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:35.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.434+0000 7faf76ffd700 1 --2- 172.21.15.45:0/301996244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ac8616d570 0x55ac86175c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.434+0000 7faf76ffd700 1 -- 172.21.15.45:0/301996244 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac86052560 con 0x55ac8616c6a0 2024-05-10T03:42:35.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.434+0000 7faf76ffd700 1 --2- 172.21.15.45:0/301996244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ac8616c6a0 0x55ac8616d980 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00fc90 tx=0x7faf6c0058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a388ea08570e73 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:35.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.434+0000 7faf5e7fc700 1 -- 172.21.15.45:0/301996244 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c01d040 con 0x55ac8616c6a0 2024-05-10T03:42:35.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.434+0000 7faf5e7fc700 1 -- 172.21.15.45:0/301996244 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faf6c022890 con 0x55ac8616c6a0 2024-05-10T03:42:35.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.434+0000 7faf5e7fc700 1 -- 172.21.15.45:0/301996244 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c00bc30 con 0x55ac8616c6a0 2024-05-10T03:42:35.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.436+0000 7faf8dd52b80 1 -- 172.21.15.45:0/301996244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ac8616c6a0 msgr2=0x55ac8616d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.436+0000 7faf8dd52b80 1 --2- 172.21.15.45:0/301996244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ac8616c6a0 0x55ac8616d980 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00fc90 tx=0x7faf6c0058e0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.436+0000 7faf8dd52b80 1 -- 172.21.15.45:0/301996244 shutdown_connections 2024-05-10T03:42:35.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.436+0000 7faf8dd52b80 1 --2- 172.21.15.45:0/301996244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac8616dec0 0x55ac8617d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.436+0000 7faf8dd52b80 1 --2- 172.21.15.45:0/301996244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ac8616c6a0 0x55ac8616d980 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.436+0000 7faf8dd52b80 1 --2- 172.21.15.45:0/301996244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ac8616d570 0x55ac86175c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.436+0000 7faf8dd52b80 1 -- 172.21.15.45:0/301996244 >> 172.21.15.45:0/301996244 conn(0x55ac860cea60 msgr2=0x55ac86166f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:35.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.436+0000 7faf8dd52b80 1 -- 172.21.15.45:0/301996244 shutdown_connections 2024-05-10T03:42:35.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.436+0000 7faf8dd52b80 1 -- 172.21.15.45:0/301996244 wait complete. 2024-05-10T03:42:35.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.436+0000 7faf8dd52b80 1 -- start start 2024-05-10T03:42:35.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.436+0000 7faf8dd52b80 1 Processor -- start 2024-05-10T03:42:35.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.437+0000 7faf8dd52b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ac8616c6a0 0x55ac8617ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.437+0000 7faf8dd52b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ac8616d570 0x55ac8617b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.437+0000 7faf8dd52b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac8616dec0 0x55ac861d6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.437+0000 7faf8dd52b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac8617e0e0 con 0x55ac8616c6a0 2024-05-10T03:42:35.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.437+0000 7faf8dd52b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac8617e250 con 0x55ac8616d570 2024-05-10T03:42:35.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.437+0000 7faf8dd52b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac861d6d60 con 0x55ac8616dec0 2024-05-10T03:42:35.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.437+0000 7faf8dd52b80 10 client.0 _ll_register_callbacks cb 0x55ac86031b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:35.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.437+0000 7faf76ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ac8616c6a0 0x55ac8617ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.437+0000 7faf76ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ac8616c6a0 0x55ac8617ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58038/0 (socket says 172.21.15.45:58038) 2024-05-10T03:42:35.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.437+0000 7faf76ffd700 1 -- 172.21.15.45:0/1440607966 learned_addr learned my addr 172.21.15.45:0/1440607966 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:35.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.437+0000 7faf777fe700 1 --2- 172.21.15.45:0/1440607966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac8616dec0 0x55ac861d6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.437+0000 7faf767fc700 1 --2- 172.21.15.45:0/1440607966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ac8616d570 0x55ac8617b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.437+0000 7faf76ffd700 1 -- 172.21.15.45:0/1440607966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac8616dec0 msgr2=0x55ac861d6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:35.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.437+0000 7faf76ffd700 1 --2- 172.21.15.45:0/1440607966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac8616dec0 0x55ac861d6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.437+0000 7faf76ffd700 1 -- 172.21.15.45:0/1440607966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ac8616d570 msgr2=0x55ac8617b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:35.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.437+0000 7faf76ffd700 1 --2- 172.21.15.45:0/1440607966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ac8616d570 0x55ac8617b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.437+0000 7faf76ffd700 1 -- 172.21.15.45:0/1440607966 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7810efc0 con 0x55ac8616c6a0 2024-05-10T03:42:35.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.437+0000 7faf76ffd700 1 --2- 172.21.15.45:0/1440607966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ac8616c6a0 0x55ac8617ac60 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7faf6c009810 tx=0x7faf6c00b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c93998cea6b9e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:35.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.437+0000 7faf56ffd700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:42:35.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.438+0000 7faf56ffd700 1 -- 172.21.15.45:0/1440607966 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c01d040 con 0x55ac8616c6a0 2024-05-10T03:42:35.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.438+0000 7faf56ffd700 1 -- 172.21.15.45:0/1440607966 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7faf6c0223b0 con 0x55ac8616c6a0 2024-05-10T03:42:35.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.438+0000 7faf8dd52b80 1 -- 172.21.15.45:0/1440607966 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faf7000f030 con 0x55ac8616c6a0 2024-05-10T03:42:35.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.438+0000 7faf56ffd700 1 -- 172.21.15.45:0/1440607966 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf6c022570 con 0x55ac8616c6a0 2024-05-10T03:42:35.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.438+0000 7faf8dd52b80 10 client.16422 fetch_fsmap learned FSMap version 29 2024-05-10T03:42:35.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.438+0000 7faf8dd52b80 1 -- 172.21.15.45:0/1440607966 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55ac85f11cd0 con 0x55ac8616c6a0 2024-05-10T03:42:35.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.438+0000 7faf56ffd700 1 -- 172.21.15.45:0/1440607966 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faf7000f030 con 0x55ac8616c6a0 2024-05-10T03:42:35.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.438+0000 7faf56ffd700 1 -- 172.21.15.45:0/1440607966 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 29) v1 ==== 7474+0+0 (secure 0 0 0) 0x7faf6c015020 con 0x55ac8616c6a0 2024-05-10T03:42:35.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.438+0000 7faf8dd52b80 10 client.16422 fetch_fsmap finished waiting for FSMap version 29 2024-05-10T03:42:35.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.438+0000 7faf8dd52b80 10 client.16422 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:42:35.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.438+0000 7faf8dd52b80 20 client.16422 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:35.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.438+0000 7faf8dd52b80 1 --2- 172.21.15.45:0/1440607966 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55ac861d8160 0x55ac861da580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:35.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.438+0000 7faf8dd52b80 4 client.16422 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-10T03:42:35.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.438+0000 7faf8dd52b80 1 -- 172.21.15.45:0/1440607966 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ac86084ec0 con 0x55ac861d8160 2024-05-10T03:42:35.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.439+0000 7faf767fc700 1 --2- 172.21.15.45:0/1440607966 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55ac861d8160 0x55ac861da580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:35.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.439+0000 7faf56ffd700 10 client.16422 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:35.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.439+0000 7faf767fc700 1 --2- 172.21.15.45:0/1440607966 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55ac861d8160 0x55ac861da580 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbb3d659c8afd856 server_cookie=cb71afc0fbcff1f6 in_seq=0 out_seq=0 2024-05-10T03:42:35.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.439+0000 7faf56ffd700 1 -- 172.21.15.45:0/1440607966 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ac86084ec0 con 0x55ac861d8160 2024-05-10T03:42:35.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.439+0000 7faf56ffd700 10 client.16422 handle_command_reply: tid=0 2024-05-10T03:42:35.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.439+0000 7faf8dd52b80 1 client.16422 shutdown 2024-05-10T03:42:35.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.440+0000 7faf8dd52b80 1 -- 172.21.15.45:0/1440607966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ac8616c6a0 msgr2=0x55ac8617ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.440+0000 7faf8dd52b80 1 --2- 172.21.15.45:0/1440607966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ac8616c6a0 0x55ac8617ac60 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7faf6c009810 tx=0x7faf6c00b690 comp rx=0 tx=0).stop 2024-05-10T03:42:35.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.440+0000 7faf8dd52b80 1 -- 172.21.15.45:0/1440607966 shutdown_connections 2024-05-10T03:42:35.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.440+0000 7faf8dd52b80 1 --2- 172.21.15.45:0/1440607966 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55ac861d8160 0x55ac861da580 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.440+0000 7faf8dd52b80 1 --2- 172.21.15.45:0/1440607966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac8616dec0 0x55ac861d6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.440+0000 7faf8dd52b80 1 --2- 172.21.15.45:0/1440607966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ac8616c6a0 0x55ac8617ac60 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.440+0000 7faf8dd52b80 1 --2- 172.21.15.45:0/1440607966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ac8616d570 0x55ac8617b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.440+0000 7faf8dd52b80 1 -- 172.21.15.45:0/1440607966 >> 172.21.15.45:0/1440607966 conn(0x55ac860cea60 msgr2=0x55ac861766d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:35.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.440+0000 7faf56ffd700 0 client.16422 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:35.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.440+0000 7faf8dd52b80 1 -- 172.21.15.45:0/1440607966 shutdown_connections 2024-05-10T03:42:35.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.440+0000 7faf8dd52b80 1 -- 172.21.15.45:0/1440607966 wait complete. 2024-05-10T03:42:35.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.440+0000 7faf8dd52b80 20 client.16422 trim_cache size 0 max 16384 2024-05-10T03:42:35.448 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-05-10T03:42:35.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.441+0000 7faf7da0e700 1 -- 172.21.15.45:0/4219354280 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7faf600a1400 msgr2=0x7faf600a3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.441+0000 7faf7da0e700 1 --2- 172.21.15.45:0/4219354280 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7faf600a1400 0x7faf600a3910 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7faf70009750 tx=0x7faf700078a0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.441+0000 7faf7da0e700 1 -- 172.21.15.45:0/4219354280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf78109c50 msgr2=0x7faf781b6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:35.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.441+0000 7faf7da0e700 1 --2- 172.21.15.45:0/4219354280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf78109c50 0x7faf781b6c70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7faf6800d980 tx=0x7faf6800dd40 comp rx=0 tx=0).stop 2024-05-10T03:42:35.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.441+0000 7faf7da0e700 1 -- 172.21.15.45:0/4219354280 shutdown_connections 2024-05-10T03:42:35.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.441+0000 7faf7da0e700 1 --2- 172.21.15.45:0/4219354280 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7faf600a1400 0x7faf600a3910 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.441+0000 7faf7da0e700 1 --2- 172.21.15.45:0/4219354280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faf78109c50 0x7faf781b6c70 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.441+0000 7faf7da0e700 1 --2- 172.21.15.45:0/4219354280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf78108630 0x7faf78115430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.441+0000 7faf7da0e700 1 --2- 172.21.15.45:0/4219354280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf78109300 0x7faf78115970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:35.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.441+0000 7faf7da0e700 1 -- 172.21.15.45:0/4219354280 >> 172.21.15.45:0/4219354280 conn(0x7faf7806ea00 msgr2=0x7faf7810a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:35.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.441+0000 7faf7da0e700 1 -- 172.21.15.45:0/4219354280 shutdown_connections 2024-05-10T03:42:35.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:35.441+0000 7faf7da0e700 1 -- 172.21.15.45:0/4219354280 wait complete. 2024-05-10T03:42:35.473 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:35 smithi154 ceph-mon[46565]: pgmap v354: 129 pgs: 129 active+clean; 81 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 6.7 MiB/s wr, 34 op/s 2024-05-10T03:42:35.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:35 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3404392851' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:42:36.460 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-10T03:42:36.461 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-10T03:42:36.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.614+0000 7f9df284f700 1 -- 172.21.15.45:0/970994650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dec1026b0 msgr2=0x7f9dec104ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:36.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.614+0000 7f9df284f700 1 --2- 172.21.15.45:0/970994650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dec1026b0 0x7f9dec104ad0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc009990 tx=0x7f9ddc009ca0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.614+0000 7f9df284f700 1 -- 172.21.15.45:0/970994650 shutdown_connections 2024-05-10T03:42:36.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.614+0000 7f9df284f700 1 --2- 172.21.15.45:0/970994650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dec107970 0x7f9dec109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.614+0000 7f9df284f700 1 --2- 172.21.15.45:0/970994650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dec1026b0 0x7f9dec104ad0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.614+0000 7f9df284f700 1 --2- 172.21.15.45:0/970994650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dec105010 0x7f9dec107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.614+0000 7f9df284f700 1 -- 172.21.15.45:0/970994650 >> 172.21.15.45:0/970994650 conn(0x7f9dec0fc0d0 msgr2=0x7f9dec0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:36.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.615+0000 7f9df284f700 1 -- 172.21.15.45:0/970994650 shutdown_connections 2024-05-10T03:42:36.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.615+0000 7f9df284f700 1 -- 172.21.15.45:0/970994650 wait complete. 2024-05-10T03:42:36.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.615+0000 7f9df284f700 1 Processor -- start 2024-05-10T03:42:36.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.615+0000 7f9df284f700 1 -- start start 2024-05-10T03:42:36.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.616+0000 7f9df284f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dec1026b0 0x7f9dec101f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.616+0000 7f9df284f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dec105010 0x7f9dec1005c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.616+0000 7f9df284f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dec107970 0x7f9dec100b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.616+0000 7f9df284f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec1011e0 con 0x7f9dec1026b0 2024-05-10T03:42:36.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.616+0000 7f9df284f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec101350 con 0x7f9dec105010 2024-05-10T03:42:36.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.616+0000 7f9df284f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec1a2090 con 0x7f9dec107970 2024-05-10T03:42:36.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.616+0000 7f9debfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dec1026b0 0x7f9dec101f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.616+0000 7f9debfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dec1026b0 0x7f9dec101f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58050/0 (socket says 172.21.15.45:58050) 2024-05-10T03:42:36.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.616+0000 7f9debfff700 1 -- 172.21.15.45:0/3451646612 learned_addr learned my addr 172.21.15.45:0/3451646612 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:36.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.616+0000 7f9deb7fe700 1 --2- 172.21.15.45:0/3451646612 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dec105010 0x7f9dec1005c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.616+0000 7f9df0dec700 1 --2- 172.21.15.45:0/3451646612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dec107970 0x7f9dec100b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.616+0000 7f9debfff700 1 -- 172.21.15.45:0/3451646612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dec107970 msgr2=0x7f9dec100b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:36.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.616+0000 7f9debfff700 1 --2- 172.21.15.45:0/3451646612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dec107970 0x7f9dec100b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.616+0000 7f9debfff700 1 -- 172.21.15.45:0/3451646612 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dec105010 msgr2=0x7f9dec1005c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:36.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.616+0000 7f9debfff700 1 --2- 172.21.15.45:0/3451646612 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dec105010 0x7f9dec1005c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.616+0000 7f9debfff700 1 -- 172.21.15.45:0/3451646612 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ddc0095f0 con 0x7f9dec1026b0 2024-05-10T03:42:36.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.616+0000 7f9debfff700 1 --2- 172.21.15.45:0/3451646612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dec1026b0 0x7f9dec101f20 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc00b2e0 tx=0x7f9ddc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:36.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.617+0000 7f9de97fa700 1 -- 172.21.15.45:0/3451646612 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc01d070 con 0x7f9dec1026b0 2024-05-10T03:42:36.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.617+0000 7f9de97fa700 1 -- 172.21.15.45:0/3451646612 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9ddc00fdb0 con 0x7f9dec1026b0 2024-05-10T03:42:36.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.617+0000 7f9de97fa700 1 -- 172.21.15.45:0/3451646612 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc017650 con 0x7f9dec1026b0 2024-05-10T03:42:36.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.617+0000 7f9df284f700 1 -- 172.21.15.45:0/3451646612 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dec1a2290 con 0x7f9dec1026b0 2024-05-10T03:42:36.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.617+0000 7f9df284f700 1 -- 172.21.15.45:0/3451646612 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dec1a2660 con 0x7f9dec1026b0 2024-05-10T03:42:36.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.621+0000 7f9de97fa700 1 -- 172.21.15.45:0/3451646612 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9ddc022470 con 0x7f9dec1026b0 2024-05-10T03:42:36.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.621+0000 7f9e02b93b80 1 Processor -- start 2024-05-10T03:42:36.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.622+0000 7f9e02b93b80 1 -- start start 2024-05-10T03:42:36.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.622+0000 7f9de97fa700 1 --2- 172.21.15.45:0/3451646612 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9dd40a11c0 0x7f9dd40a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.622+0000 7f9e02b93b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a038f720 0x55e7a038fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.622+0000 7f9e02b93b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7a03905f0 0x55e7a0390a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.622+0000 7f9e02b93b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7a0390f40 0x55e7a0397840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.622+0000 7f9e02b93b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7a02b61d0 con 0x55e7a038f720 2024-05-10T03:42:36.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.622+0000 7f9e02b93b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7a02b3b90 con 0x55e7a0390f40 2024-05-10T03:42:36.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.622+0000 7f9e02b93b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7a02af480 con 0x55e7a03905f0 2024-05-10T03:42:36.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.622+0000 7f9df0dec700 1 --2- 172.21.15.45:0/3451646612 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9dd40a11c0 0x7f9dd40a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.622+0000 7f9de97fa700 1 -- 172.21.15.45:0/3451646612 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f9ddc0ce150 con 0x7f9dec1026b0 2024-05-10T03:42:36.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.622+0000 7f9debfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a038f720 0x55e7a038fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.622+0000 7f9debfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a038f720 0x55e7a038fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58062/0 (socket says 172.21.15.45:58062) 2024-05-10T03:42:36.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.622+0000 7f9debfff700 1 -- 172.21.15.45:0/1445079584 learned_addr learned my addr 172.21.15.45:0/1445079584 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:36.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.622+0000 7f9df0dec700 1 --2- 172.21.15.45:0/1445079584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7a0390f40 0x55e7a0397840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.622+0000 7f9debfff700 1 -- 172.21.15.45:0/1445079584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7a03905f0 msgr2=0x55e7a0390a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:36.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.622+0000 7f9debfff700 1 --2- 172.21.15.45:0/1445079584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7a03905f0 0x55e7a0390a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.622+0000 7f9debfff700 1 -- 172.21.15.45:0/1445079584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7a0390f40 msgr2=0x55e7a0397840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:36.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.622+0000 7f9debfff700 1 --2- 172.21.15.45:0/1445079584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7a0390f40 0x55e7a0397840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.622+0000 7f9debfff700 1 -- 172.21.15.45:0/1445079584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7a0130430 con 0x55e7a038f720 2024-05-10T03:42:36.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.623+0000 7f9df0dec700 1 --2- 172.21.15.45:0/3451646612 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9dd40a11c0 0x7f9dd40a36d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9de4009fd0 tx=0x7f9de4009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:36.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.623+0000 7f9debfff700 1 --2- 172.21.15.45:0/1445079584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a038f720 0x55e7a038fb70 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc00ffd0 tx=0x7f9ddc022c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eea5321f8472140 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:36.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.623+0000 7f9dd27fc700 1 -- 172.21.15.45:0/1445079584 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc09abd0 con 0x55e7a038f720 2024-05-10T03:42:36.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.623+0000 7f9dd27fc700 1 -- 172.21.15.45:0/1445079584 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9ddc09b970 con 0x55e7a038f720 2024-05-10T03:42:36.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.623+0000 7f9dd27fc700 1 -- 172.21.15.45:0/1445079584 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc0cb350 con 0x55e7a038f720 2024-05-10T03:42:36.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.624+0000 7f9e02b93b80 1 -- 172.21.15.45:0/1445079584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a038f720 msgr2=0x55e7a038fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:36.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.624+0000 7f9e02b93b80 1 --2- 172.21.15.45:0/1445079584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a038f720 0x55e7a038fb70 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc00ffd0 tx=0x7f9ddc022c10 comp rx=0 tx=0).stop 2024-05-10T03:42:36.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.624+0000 7f9e02b93b80 1 -- 172.21.15.45:0/1445079584 shutdown_connections 2024-05-10T03:42:36.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.624+0000 7f9e02b93b80 1 --2- 172.21.15.45:0/1445079584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7a0390f40 0x55e7a0397840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.624+0000 7f9e02b93b80 1 --2- 172.21.15.45:0/1445079584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a038f720 0x55e7a038fb70 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.624+0000 7f9e02b93b80 1 --2- 172.21.15.45:0/1445079584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7a03905f0 0x55e7a0390a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.624+0000 7f9e02b93b80 1 -- 172.21.15.45:0/1445079584 >> 172.21.15.45:0/1445079584 conn(0x55e7a02f1ae0 msgr2=0x55e7a038a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.624+0000 7f9e02b93b80 1 -- 172.21.15.45:0/1445079584 shutdown_connections 2024-05-10T03:42:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.624+0000 7f9e02b93b80 1 -- 172.21.15.45:0/1445079584 wait complete. 2024-05-10T03:42:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.625+0000 7f9e02b93b80 1 -- start start 2024-05-10T03:42:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.625+0000 7f9e02b93b80 1 Processor -- start 2024-05-10T03:42:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.626+0000 7f9e02b93b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a038f720 0x55e7a03993d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.626+0000 7f9e02b93b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7a03905f0 0x55e7a0399910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.626+0000 7f9e02b93b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7a0390f40 0x55e7a03a0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.626+0000 7f9e02b93b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7a024b5e0 con 0x55e7a038f720 2024-05-10T03:42:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.626+0000 7f9e02b93b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7a024b280 con 0x55e7a0390f40 2024-05-10T03:42:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.626+0000 7f9e02b93b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7a0132720 con 0x55e7a03905f0 2024-05-10T03:42:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.626+0000 7f9e02b93b80 10 client.0 _ll_register_callbacks cb 0x55e7a0254bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.626+0000 7f9debfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a038f720 0x55e7a03993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.626+0000 7f9debfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a038f720 0x55e7a03993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58070/0 (socket says 172.21.15.45:58070) 2024-05-10T03:42:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.626+0000 7f9debfff700 1 -- 172.21.15.45:0/2898384400 learned_addr learned my addr 172.21.15.45:0/2898384400 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.626+0000 7f9df0dec700 1 --2- 172.21.15.45:0/2898384400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7a0390f40 0x55e7a03a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.626+0000 7f9deb7fe700 1 --2- 172.21.15.45:0/2898384400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7a03905f0 0x55e7a0399910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.626+0000 7f9debfff700 1 -- 172.21.15.45:0/2898384400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7a03905f0 msgr2=0x55e7a0399910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.626+0000 7f9debfff700 1 --2- 172.21.15.45:0/2898384400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7a03905f0 0x55e7a0399910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.626+0000 7f9debfff700 1 -- 172.21.15.45:0/2898384400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7a0390f40 msgr2=0x55e7a03a0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.626+0000 7f9debfff700 1 --2- 172.21.15.45:0/2898384400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7a0390f40 0x55e7a03a0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.626+0000 7f9debfff700 1 -- 172.21.15.45:0/2898384400 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dec1a2660 con 0x55e7a038f720 2024-05-10T03:42:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.626+0000 7f9df0dec700 1 --2- 172.21.15.45:0/2898384400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7a0390f40 0x55e7a03a0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:42:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.626+0000 7f9deb7fe700 1 --2- 172.21.15.45:0/2898384400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7a03905f0 0x55e7a0399910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:42:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.626+0000 7f9debfff700 1 --2- 172.21.15.45:0/2898384400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a038f720 0x55e7a03993d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc097ce0 tx=0x7f9ddc009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790d849c68c62f27 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.626+0000 7f9dcb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:42:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.627+0000 7f9dcb7fe700 1 -- 172.21.15.45:0/2898384400 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc09f0a0 con 0x55e7a038f720 2024-05-10T03:42:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.627+0000 7f9dcb7fe700 1 -- 172.21.15.45:0/2898384400 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f9ddc0a3660 con 0x55e7a038f720 2024-05-10T03:42:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.627+0000 7f9e02b93b80 1 -- 172.21.15.45:0/2898384400 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e7a02082f0 con 0x55e7a038f720 2024-05-10T03:42:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.627+0000 7f9dcb7fe700 1 -- 172.21.15.45:0/2898384400 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ddc09a970 con 0x55e7a038f720 2024-05-10T03:42:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.627+0000 7f9e02b93b80 10 client.16434 fetch_fsmap learned FSMap version 30 2024-05-10T03:42:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.627+0000 7f9e02b93b80 1 -- 172.21.15.45:0/2898384400 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55e7a00dcbe0 con 0x55e7a038f720 2024-05-10T03:42:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.627+0000 7f9dcb7fe700 1 -- 172.21.15.45:0/2898384400 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55e7a02082f0 con 0x55e7a038f720 2024-05-10T03:42:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.627+0000 7f9dcb7fe700 1 -- 172.21.15.45:0/2898384400 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f9ddc0c5b60 con 0x55e7a038f720 2024-05-10T03:42:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.627+0000 7f9e02b93b80 10 client.16434 fetch_fsmap finished waiting for FSMap version 30 2024-05-10T03:42:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.627+0000 7f9e02b93b80 10 client.16434 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:42:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.627+0000 7f9e02b93b80 20 client.16434 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:36.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.627+0000 7f9e02b93b80 1 --2- 172.21.15.45:0/2898384400 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55e7a03a4ba0 0x55e7a03a6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.627+0000 7f9e02b93b80 4 client.16434 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:42:36.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.627+0000 7f9e02b93b80 1 -- 172.21.15.45:0/2898384400 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e7a035e800 con 0x55e7a03a4ba0 2024-05-10T03:42:36.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.628+0000 7f9deb7fe700 1 --2- 172.21.15.45:0/2898384400 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55e7a03a4ba0 0x55e7a03a6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.628+0000 7f9deb7fe700 1 --2- 172.21.15.45:0/2898384400 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55e7a03a4ba0 0x55e7a03a6ff0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=909f6dd06349cfa9 server_cookie=d5ba39e81379e0c8 in_seq=0 out_seq=0 2024-05-10T03:42:36.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.628+0000 7f9dcb7fe700 10 client.16434 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:36.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.629+0000 7f9dcb7fe700 1 -- 172.21.15.45:0/2898384400 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e7a035e800 con 0x55e7a03a4ba0 2024-05-10T03:42:36.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.629+0000 7f9dcb7fe700 10 client.16434 handle_command_reply: tid=0 2024-05-10T03:42:36.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.629+0000 7f9e02b93b80 1 client.16434 shutdown 2024-05-10T03:42:36.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.629+0000 7f9e02b93b80 1 -- 172.21.15.45:0/2898384400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a038f720 msgr2=0x55e7a03993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:36.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.629+0000 7f9e02b93b80 1 --2- 172.21.15.45:0/2898384400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a038f720 0x55e7a03993d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc097ce0 tx=0x7f9ddc009ca0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.629+0000 7f9e02b93b80 1 -- 172.21.15.45:0/2898384400 shutdown_connections 2024-05-10T03:42:36.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.629+0000 7f9e02b93b80 1 --2- 172.21.15.45:0/2898384400 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55e7a03a4ba0 0x55e7a03a6ff0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.629+0000 7f9e02b93b80 1 --2- 172.21.15.45:0/2898384400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7a0390f40 0x55e7a03a0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.629+0000 7f9e02b93b80 1 --2- 172.21.15.45:0/2898384400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a038f720 0x55e7a03993d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.629+0000 7f9e02b93b80 1 --2- 172.21.15.45:0/2898384400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7a03905f0 0x55e7a0399910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.629+0000 7f9dcb7fe700 0 client.16434 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:36.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.629+0000 7f9e02b93b80 1 -- 172.21.15.45:0/2898384400 >> 172.21.15.45:0/2898384400 conn(0x55e7a02f1ae0 msgr2=0x55e7a038a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:36.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.629+0000 7f9e02b93b80 1 -- 172.21.15.45:0/2898384400 shutdown_connections 2024-05-10T03:42:36.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.629+0000 7f9e02b93b80 1 -- 172.21.15.45:0/2898384400 wait complete. 2024-05-10T03:42:36.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.630+0000 7f9e02b93b80 20 client.16434 trim_cache size 0 max 16384 2024-05-10T03:42:36.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.648+0000 7f9e02b93b80 1 Processor -- start 2024-05-10T03:42:36.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.648+0000 7f9e02b93b80 1 -- start start 2024-05-10T03:42:36.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.649+0000 7f9e02b93b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7a02f1ae0 0x55e7a03948f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.649+0000 7f9e02b93b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a038f720 0x55e7a03a0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.649+0000 7f9e02b93b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7a03905f0 0x55e7a038ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.649+0000 7f9e02b93b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7a02082f0 con 0x55e7a038f720 2024-05-10T03:42:36.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.649+0000 7f9e02b93b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7a0386db0 con 0x55e7a03905f0 2024-05-10T03:42:36.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.649+0000 7f9e02b93b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7a03a1970 con 0x55e7a02f1ae0 2024-05-10T03:42:36.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.649+0000 7f9deb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a038f720 0x55e7a03a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.649+0000 7f9deb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a038f720 0x55e7a03a0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58076/0 (socket says 172.21.15.45:58076) 2024-05-10T03:42:36.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.649+0000 7f9debfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7a02f1ae0 0x55e7a03948f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.649+0000 7f9deb7fe700 1 -- 172.21.15.45:0/2448651262 learned_addr learned my addr 172.21.15.45:0/2448651262 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:36.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.649+0000 7f9df0dec700 1 --2- 172.21.15.45:0/2448651262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7a03905f0 0x55e7a038ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.649+0000 7f9debfff700 1 -- 172.21.15.45:0/2448651262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7a03905f0 msgr2=0x55e7a038ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:36.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.649+0000 7f9debfff700 1 --2- 172.21.15.45:0/2448651262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7a03905f0 0x55e7a038ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.649+0000 7f9debfff700 1 -- 172.21.15.45:0/2448651262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a038f720 msgr2=0x55e7a03a0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:36.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.649+0000 7f9debfff700 1 --2- 172.21.15.45:0/2448651262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a038f720 0x55e7a03a0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.649+0000 7f9debfff700 1 -- 172.21.15.45:0/2448651262 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7a02755e0 con 0x55e7a02f1ae0 2024-05-10T03:42:36.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.650+0000 7f9debfff700 1 --2- 172.21.15.45:0/2448651262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7a02f1ae0 0x55e7a03948f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc09b200 tx=0x7f9ddc022c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fba72c434a02ce9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:36.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.650+0000 7f9dd2ffd700 1 -- 172.21.15.45:0/2448651262 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc0996f0 con 0x55e7a02f1ae0 2024-05-10T03:42:36.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.650+0000 7f9dd2ffd700 1 -- 172.21.15.45:0/2448651262 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9ddc09b040 con 0x55e7a02f1ae0 2024-05-10T03:42:36.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.650+0000 7f9dd2ffd700 1 -- 172.21.15.45:0/2448651262 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc0a31d0 con 0x55e7a02f1ae0 2024-05-10T03:42:36.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.651+0000 7f9e02b93b80 1 -- 172.21.15.45:0/2448651262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7a02f1ae0 msgr2=0x55e7a03948f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:36.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.651+0000 7f9e02b93b80 1 --2- 172.21.15.45:0/2448651262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7a02f1ae0 0x55e7a03948f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc09b200 tx=0x7f9ddc022c10 comp rx=0 tx=0).stop 2024-05-10T03:42:36.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.651+0000 7f9e02b93b80 1 -- 172.21.15.45:0/2448651262 shutdown_connections 2024-05-10T03:42:36.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.651+0000 7f9e02b93b80 1 --2- 172.21.15.45:0/2448651262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7a02f1ae0 0x55e7a03948f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.651+0000 7f9e02b93b80 1 --2- 172.21.15.45:0/2448651262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7a03905f0 0x55e7a038ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.651+0000 7f9e02b93b80 1 --2- 172.21.15.45:0/2448651262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a038f720 0x55e7a03a0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.651+0000 7f9e02b93b80 1 -- 172.21.15.45:0/2448651262 >> 172.21.15.45:0/2448651262 conn(0x55e7a03864d0 msgr2=0x55e7a038e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:36.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.651+0000 7f9e02b93b80 1 -- 172.21.15.45:0/2448651262 shutdown_connections 2024-05-10T03:42:36.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.651+0000 7f9e02b93b80 1 -- 172.21.15.45:0/2448651262 wait complete. 2024-05-10T03:42:36.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.652+0000 7f9e02b93b80 1 -- start start 2024-05-10T03:42:36.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.652+0000 7f9e02b93b80 1 Processor -- start 2024-05-10T03:42:36.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.652+0000 7f9e02b93b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a02f1ae0 0x55e7a039f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.652+0000 7f9e02b93b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7a038f720 0x55e7a039f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.652+0000 7f9e02b93b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7a03905f0 0x55e7a039fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.652+0000 7f9e02b93b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7a03fb070 con 0x55e7a02f1ae0 2024-05-10T03:42:36.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.652+0000 7f9e02b93b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7a03fb1e0 con 0x55e7a03905f0 2024-05-10T03:42:36.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.652+0000 7f9e02b93b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7a03fb3a0 con 0x55e7a038f720 2024-05-10T03:42:36.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.652+0000 7f9e02b93b80 10 client.0 _ll_register_callbacks cb 0x55e7a0254bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:36.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.652+0000 7f9debfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a02f1ae0 0x55e7a039f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.652+0000 7f9debfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a02f1ae0 0x55e7a039f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58090/0 (socket says 172.21.15.45:58090) 2024-05-10T03:42:36.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.652+0000 7f9debfff700 1 -- 172.21.15.45:0/500691807 learned_addr learned my addr 172.21.15.45:0/500691807 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:36.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.652+0000 7f9deb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7a038f720 0x55e7a039f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.653+0000 7f9df0dec700 1 --2- 172.21.15.45:0/500691807 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7a03905f0 0x55e7a039fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.653+0000 7f9debfff700 1 -- 172.21.15.45:0/500691807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7a038f720 msgr2=0x55e7a039f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:36.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.653+0000 7f9debfff700 1 --2- 172.21.15.45:0/500691807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7a038f720 0x55e7a039f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.653+0000 7f9debfff700 1 -- 172.21.15.45:0/500691807 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7a03905f0 msgr2=0x55e7a039fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:36.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.653+0000 7f9debfff700 1 --2- 172.21.15.45:0/500691807 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7a03905f0 0x55e7a039fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.653+0000 7f9debfff700 1 -- 172.21.15.45:0/500691807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e7a00dcbe0 con 0x55e7a02f1ae0 2024-05-10T03:42:36.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.653+0000 7f9deb7fe700 1 --2- 172.21.15.45:0/500691807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7a038f720 0x55e7a039f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:36.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.653+0000 7f9debfff700 1 --2- 172.21.15.45:0/500691807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a02f1ae0 0x55e7a039f270 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc00ffd0 tx=0x7f9ddc00b490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a678dae9f86b11 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:36.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.653+0000 7f9dcb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:42:36.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.653+0000 7f9dcb7fe700 1 -- 172.21.15.45:0/500691807 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc09a970 con 0x55e7a02f1ae0 2024-05-10T03:42:36.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.653+0000 7f9dcb7fe700 1 -- 172.21.15.45:0/500691807 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f9ddc0a31d0 con 0x55e7a02f1ae0 2024-05-10T03:42:36.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.653+0000 7f9e02b93b80 1 -- 172.21.15.45:0/500691807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9ddc09b970 con 0x55e7a02f1ae0 2024-05-10T03:42:36.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.653+0000 7f9dcb7fe700 1 -- 172.21.15.45:0/500691807 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ddc0a3390 con 0x55e7a02f1ae0 2024-05-10T03:42:36.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.653+0000 7f9e02b93b80 10 client.16440 fetch_fsmap learned FSMap version 30 2024-05-10T03:42:36.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.653+0000 7f9e02b93b80 1 -- 172.21.15.45:0/500691807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55e7a0134d50 con 0x55e7a02f1ae0 2024-05-10T03:42:36.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.654+0000 7f9dcb7fe700 1 -- 172.21.15.45:0/500691807 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9ddc07e080 con 0x55e7a02f1ae0 2024-05-10T03:42:36.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.654+0000 7f9dcb7fe700 1 -- 172.21.15.45:0/500691807 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f9ddc09a1d0 con 0x55e7a02f1ae0 2024-05-10T03:42:36.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.654+0000 7f9e02b93b80 10 client.16440 fetch_fsmap finished waiting for FSMap version 30 2024-05-10T03:42:36.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.654+0000 7f9e02b93b80 10 client.16440 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:42:36.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.654+0000 7f9e02b93b80 20 client.16440 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:36.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.654+0000 7f9e02b93b80 1 --2- 172.21.15.45:0/500691807 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55e7a0390f40 0x55e7a03fe660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.654+0000 7f9e02b93b80 4 client.16440 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-10T03:42:36.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.654+0000 7f9e02b93b80 1 -- 172.21.15.45:0/500691807 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55e7a02a7f40 con 0x55e7a0390f40 2024-05-10T03:42:36.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.654+0000 7f9deb7fe700 1 --2- 172.21.15.45:0/500691807 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55e7a0390f40 0x55e7a03fe660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.655+0000 7f9dcb7fe700 10 client.16440 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:36.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.655+0000 7f9deb7fe700 1 --2- 172.21.15.45:0/500691807 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55e7a0390f40 0x55e7a03fe660 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f95d8c5073db92b1 server_cookie=6434c7d0f9836472 in_seq=0 out_seq=0 2024-05-10T03:42:36.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.655+0000 7f9dcb7fe700 1 -- 172.21.15.45:0/500691807 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55e7a02a7f40 con 0x55e7a0390f40 2024-05-10T03:42:36.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.655+0000 7f9dcb7fe700 10 client.16440 handle_command_reply: tid=0 2024-05-10T03:42:36.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.656+0000 7f9e02b93b80 1 client.16440 shutdown 2024-05-10T03:42:36.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.656+0000 7f9e02b93b80 1 -- 172.21.15.45:0/500691807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a02f1ae0 msgr2=0x55e7a039f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:36.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.656+0000 7f9e02b93b80 1 --2- 172.21.15.45:0/500691807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a02f1ae0 0x55e7a039f270 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc00ffd0 tx=0x7f9ddc00b490 comp rx=0 tx=0).stop 2024-05-10T03:42:36.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.656+0000 7f9e02b93b80 1 -- 172.21.15.45:0/500691807 shutdown_connections 2024-05-10T03:42:36.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.656+0000 7f9e02b93b80 1 --2- 172.21.15.45:0/500691807 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55e7a0390f40 0x55e7a03fe660 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.656+0000 7f9e02b93b80 1 --2- 172.21.15.45:0/500691807 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7a03905f0 0x55e7a039fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.656+0000 7f9e02b93b80 1 --2- 172.21.15.45:0/500691807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7a02f1ae0 0x55e7a039f270 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.656+0000 7f9e02b93b80 1 --2- 172.21.15.45:0/500691807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e7a038f720 0x55e7a039f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.656+0000 7f9dcb7fe700 0 client.16440 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:36.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.656+0000 7f9e02b93b80 1 -- 172.21.15.45:0/500691807 >> 172.21.15.45:0/500691807 conn(0x55e7a03864d0 msgr2=0x55e7a038ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:36.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.656+0000 7f9e02b93b80 1 -- 172.21.15.45:0/500691807 shutdown_connections 2024-05-10T03:42:36.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.656+0000 7f9e02b93b80 1 -- 172.21.15.45:0/500691807 wait complete. 2024-05-10T03:42:36.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.656+0000 7f9e02b93b80 20 client.16440 trim_cache size 0 max 16384 2024-05-10T03:42:36.666 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:42:36.666 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-05-10T03:42:36.666 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "f9df00c4-9409-4911-ab7e-dd576b6d6082", 2024-05-10T03:42:36.666 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-05-10T03:42:36.666 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:42:36.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.657+0000 7f9df284f700 1 -- 172.21.15.45:0/3451646612 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9dd40a11c0 msgr2=0x7f9dd40a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:36.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.657+0000 7f9df284f700 1 --2- 172.21.15.45:0/3451646612 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9dd40a11c0 0x7f9dd40a36d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9de4009fd0 tx=0x7f9de4009270 comp rx=0 tx=0).stop 2024-05-10T03:42:36.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.657+0000 7f9df284f700 1 -- 172.21.15.45:0/3451646612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dec1026b0 msgr2=0x7f9dec101f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:36.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.657+0000 7f9df284f700 1 --2- 172.21.15.45:0/3451646612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dec1026b0 0x7f9dec101f20 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc00b2e0 tx=0x7f9ddc00f690 comp rx=0 tx=0).stop 2024-05-10T03:42:36.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.657+0000 7f9df284f700 1 -- 172.21.15.45:0/3451646612 shutdown_connections 2024-05-10T03:42:36.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.657+0000 7f9df284f700 1 --2- 172.21.15.45:0/3451646612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dec107970 0x7f9dec100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.657+0000 7f9df284f700 1 --2- 172.21.15.45:0/3451646612 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f9dd40a11c0 0x7f9dd40a36d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.657+0000 7f9df284f700 1 --2- 172.21.15.45:0/3451646612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dec1026b0 0x7f9dec101f20 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.657+0000 7f9df284f700 1 --2- 172.21.15.45:0/3451646612 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9dec105010 0x7f9dec1005c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.657+0000 7f9df284f700 1 -- 172.21.15.45:0/3451646612 >> 172.21.15.45:0/3451646612 conn(0x7f9dec0fc0d0 msgr2=0x7f9dec103180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:36.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.657+0000 7f9df284f700 1 -- 172.21.15.45:0/3451646612 shutdown_connections 2024-05-10T03:42:36.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.658+0000 7f9df284f700 1 -- 172.21.15.45:0/3451646612 wait complete. 2024-05-10T03:42:36.679 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-10T03:42:36.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.861+0000 7feaa3371700 1 -- 172.21.15.45:0/1474028154 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea9c102590 msgr2=0x7fea9c108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:36.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.861+0000 7feaa3371700 1 --2- 172.21.15.45:0/1474028154 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea9c102590 0x7fea9c108e40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fea94009fc0 tx=0x7fea9400b330 comp rx=0 tx=0).stop 2024-05-10T03:42:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.861+0000 7feaa3371700 1 -- 172.21.15.45:0/1474028154 shutdown_connections 2024-05-10T03:42:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.861+0000 7feaa3371700 1 --2- 172.21.15.45:0/1474028154 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea9c102590 0x7fea9c108e40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.861+0000 7feaa3371700 1 --2- 172.21.15.45:0/1474028154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea9c100ad0 0x7fea9c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.861+0000 7feaa3371700 1 --2- 172.21.15.45:0/1474028154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea9c101bf0 0x7fea9c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.861+0000 7feaa3371700 1 -- 172.21.15.45:0/1474028154 >> 172.21.15.45:0/1474028154 conn(0x7fea9c0fc0e0 msgr2=0x7fea9c0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.861+0000 7feaa3371700 1 -- 172.21.15.45:0/1474028154 shutdown_connections 2024-05-10T03:42:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.861+0000 7feaa3371700 1 -- 172.21.15.45:0/1474028154 wait complete. 2024-05-10T03:42:36.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.862+0000 7feaa3371700 1 Processor -- start 2024-05-10T03:42:36.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.863+0000 7feaa3371700 1 -- start start 2024-05-10T03:42:36.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.863+0000 7feaa3371700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea9c100ad0 0x7fea9c073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.863+0000 7feaa3371700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea9c101bf0 0x7fea9c19cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.863+0000 7feaa3371700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea9c102590 0x7fea9c1a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.863+0000 7feaa3371700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c1a1dc0 con 0x7fea9c102590 2024-05-10T03:42:36.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.863+0000 7feaa3371700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c1a1f30 con 0x7fea9c100ad0 2024-05-10T03:42:36.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.863+0000 7feaa3371700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c1a20f0 con 0x7fea9c101bf0 2024-05-10T03:42:36.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.863+0000 7feaa090c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea9c101bf0 0x7fea9c19cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.863+0000 7feaa090c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea9c101bf0 0x7fea9c19cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:54156/0 (socket says 172.21.15.45:54156) 2024-05-10T03:42:36.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.863+0000 7feaa090c700 1 -- 172.21.15.45:0/3686175905 learned_addr learned my addr 172.21.15.45:0/3686175905 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:36.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.863+0000 7feaa190e700 1 --2- 172.21.15.45:0/3686175905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea9c102590 0x7fea9c1a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.863+0000 7feaa110d700 1 --2- 172.21.15.45:0/3686175905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea9c100ad0 0x7fea9c073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.864+0000 7feaa190e700 1 -- 172.21.15.45:0/3686175905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea9c101bf0 msgr2=0x7fea9c19cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:36.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.864+0000 7feaa190e700 1 --2- 172.21.15.45:0/3686175905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea9c101bf0 0x7fea9c19cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.864+0000 7feaa190e700 1 -- 172.21.15.45:0/3686175905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea9c100ad0 msgr2=0x7fea9c073eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:36.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.864+0000 7feaa190e700 1 --2- 172.21.15.45:0/3686175905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea9c100ad0 0x7fea9c073eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.864+0000 7feaa190e700 1 -- 172.21.15.45:0/3686175905 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea94009c40 con 0x7fea9c102590 2024-05-10T03:42:36.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.864+0000 7feaa190e700 1 --2- 172.21.15.45:0/3686175905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea9c102590 0x7fea9c1a17f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fea9400b6c0 tx=0x7fea94004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:36.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.864+0000 7fea927fc700 1 -- 172.21.15.45:0/3686175905 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9400e040 con 0x7fea9c102590 2024-05-10T03:42:36.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.864+0000 7feaa3371700 1 -- 172.21.15.45:0/3686175905 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea9c19d520 con 0x7fea9c102590 2024-05-10T03:42:36.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.864+0000 7fea927fc700 1 -- 172.21.15.45:0/3686175905 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fea9401d470 con 0x7fea9c102590 2024-05-10T03:42:36.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.864+0000 7fea927fc700 1 -- 172.21.15.45:0/3686175905 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea940052a0 con 0x7fea9c102590 2024-05-10T03:42:36.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.864+0000 7feaa3371700 1 -- 172.21.15.45:0/3686175905 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9c19da80 con 0x7fea9c102590 2024-05-10T03:42:36.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.868+0000 7fea927fc700 1 -- 172.21.15.45:0/3686175905 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fea94005400 con 0x7fea9c102590 2024-05-10T03:42:36.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.869+0000 7fea927fc700 1 --2- 172.21.15.45:0/3686175905 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fea880a11c0 0x7fea880a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.869+0000 7feaa110d700 1 --2- 172.21.15.45:0/3686175905 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fea880a11c0 0x7fea880a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.869+0000 7fea927fc700 1 -- 172.21.15.45:0/3686175905 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fea940cdb10 con 0x7fea9c102590 2024-05-10T03:42:36.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.870+0000 7feaa110d700 1 --2- 172.21.15.45:0/3686175905 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fea880a11c0 0x7fea880a36d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fea9c101af0 tx=0x7fea98009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:36.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.870+0000 7feab36b5b80 1 Processor -- start 2024-05-10T03:42:36.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.870+0000 7feab36b5b80 1 -- start start 2024-05-10T03:42:36.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.870+0000 7feab36b5b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5625631176a0 0x562563117af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.870+0000 7feab36b5b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562563118570 0x562563118980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.870+0000 7feab36b5b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562563118ec0 0x56256311f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.870+0000 7feab36b5b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56256303e150 con 0x562563118570 2024-05-10T03:42:36.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.870+0000 7feab36b5b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x56256303bb10 con 0x562563118ec0 2024-05-10T03:42:36.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.870+0000 7feab36b5b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x562563037400 con 0x5625631176a0 2024-05-10T03:42:36.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.871+0000 7feaa090c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562563118570 0x562563118980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.871+0000 7feaa090c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562563118570 0x562563118980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58120/0 (socket says 172.21.15.45:58120) 2024-05-10T03:42:36.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.871+0000 7feaa090c700 1 -- 172.21.15.45:0/2460121963 learned_addr learned my addr 172.21.15.45:0/2460121963 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:36.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.871+0000 7feaa110d700 1 --2- 172.21.15.45:0/2460121963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5625631176a0 0x562563117af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.871+0000 7feaa190e700 1 --2- 172.21.15.45:0/2460121963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562563118ec0 0x56256311f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.871+0000 7feaa110d700 1 -- 172.21.15.45:0/2460121963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562563118ec0 msgr2=0x56256311f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:36.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.871+0000 7feaa110d700 1 --2- 172.21.15.45:0/2460121963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562563118ec0 0x56256311f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.871+0000 7feaa110d700 1 -- 172.21.15.45:0/2460121963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562563118570 msgr2=0x562563118980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:36.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.871+0000 7feaa110d700 1 --2- 172.21.15.45:0/2460121963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562563118570 0x562563118980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.871+0000 7feaa110d700 1 -- 172.21.15.45:0/2460121963 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562562eb83b0 con 0x5625631176a0 2024-05-10T03:42:36.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.871+0000 7feaa090c700 1 --2- 172.21.15.45:0/2460121963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562563118570 0x562563118980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:36.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.871+0000 7feaa110d700 1 --2- 172.21.15.45:0/2460121963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5625631176a0 0x562563117af0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fea98005fd0 tx=0x7fea98014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc981566d6edba02 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:36.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.872+0000 7fea877fe700 1 -- 172.21.15.45:0/2460121963 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9800edd0 con 0x5625631176a0 2024-05-10T03:42:36.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.872+0000 7fea877fe700 1 -- 172.21.15.45:0/2460121963 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fea98021070 con 0x5625631176a0 2024-05-10T03:42:36.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.872+0000 7fea877fe700 1 -- 172.21.15.45:0/2460121963 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9801d770 con 0x5625631176a0 2024-05-10T03:42:36.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.873+0000 7feab36b5b80 1 -- 172.21.15.45:0/2460121963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5625631176a0 msgr2=0x562563117af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:36.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.873+0000 7feab36b5b80 1 --2- 172.21.15.45:0/2460121963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5625631176a0 0x562563117af0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fea98005fd0 tx=0x7fea98014000 comp rx=0 tx=0).stop 2024-05-10T03:42:36.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.873+0000 7feab36b5b80 1 -- 172.21.15.45:0/2460121963 shutdown_connections 2024-05-10T03:42:36.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.873+0000 7feab36b5b80 1 --2- 172.21.15.45:0/2460121963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5625631176a0 0x562563117af0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.873+0000 7feab36b5b80 1 --2- 172.21.15.45:0/2460121963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562563118ec0 0x56256311f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.873+0000 7feab36b5b80 1 --2- 172.21.15.45:0/2460121963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562563118570 0x562563118980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.873+0000 7feab36b5b80 1 -- 172.21.15.45:0/2460121963 >> 172.21.15.45:0/2460121963 conn(0x562563079a60 msgr2=0x562563111fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:36.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.873+0000 7feab36b5b80 1 -- 172.21.15.45:0/2460121963 shutdown_connections 2024-05-10T03:42:36.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.873+0000 7feab36b5b80 1 -- 172.21.15.45:0/2460121963 wait complete. 2024-05-10T03:42:36.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.874+0000 7feab36b5b80 1 -- start start 2024-05-10T03:42:36.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.874+0000 7feab36b5b80 1 Processor -- start 2024-05-10T03:42:36.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.874+0000 7feab36b5b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625631176a0 0x5625631327a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.874+0000 7feab36b5b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562563118570 0x562563132ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.874+0000 7feab36b5b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562563118ec0 0x562563139c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.874+0000 7feab36b5b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562562fd3560 con 0x562563118ec0 2024-05-10T03:42:36.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.874+0000 7feab36b5b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x562562fd3200 con 0x5625631176a0 2024-05-10T03:42:36.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.874+0000 7feab36b5b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x562562eba6a0 con 0x562563118570 2024-05-10T03:42:36.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.875+0000 7feab36b5b80 10 client.0 _ll_register_callbacks cb 0x562562fdcb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:36.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.875+0000 7feaa090c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562563118570 0x562563132ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.875+0000 7feaa090c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562563118570 0x562563132ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:54170/0 (socket says 172.21.15.45:54170) 2024-05-10T03:42:36.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.875+0000 7feaa090c700 1 -- 172.21.15.45:0/3945892503 learned_addr learned my addr 172.21.15.45:0/3945892503 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:36.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.875+0000 7feaa110d700 1 --2- 172.21.15.45:0/3945892503 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625631176a0 0x5625631327a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.875+0000 7feaa190e700 1 --2- 172.21.15.45:0/3945892503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562563118ec0 0x562563139c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.875+0000 7feaa090c700 1 -- 172.21.15.45:0/3945892503 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625631176a0 msgr2=0x5625631327a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:36.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.875+0000 7feaa090c700 1 --2- 172.21.15.45:0/3945892503 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625631176a0 0x5625631327a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.875+0000 7feaa090c700 1 -- 172.21.15.45:0/3945892503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562563118ec0 msgr2=0x562563139c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:36.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.875+0000 7feaa090c700 1 --2- 172.21.15.45:0/3945892503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562563118ec0 0x562563139c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.875+0000 7feaa090c700 1 -- 172.21.15.45:0/3945892503 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea8c009a30 con 0x562563118570 2024-05-10T03:42:36.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.875+0000 7feaa090c700 1 --2- 172.21.15.45:0/3945892503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562563118570 0x562563132ce0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fea8c012d50 tx=0x7fea8c00f6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=240b20439cba8648 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:36.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.875+0000 7fea84ff9700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-05-10T03:42:36.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.876+0000 7fea84ff9700 1 -- 172.21.15.45:0/3945892503 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c017070 con 0x562563118570 2024-05-10T03:42:36.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.876+0000 7feab36b5b80 1 -- 172.21.15.45:0/3945892503 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562562f90270 con 0x562563118570 2024-05-10T03:42:36.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.876+0000 7fea84ff9700 1 -- 172.21.15.45:0/3945892503 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fea8c00fc30 con 0x562563118570 2024-05-10T03:42:36.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.876+0000 7fea84ff9700 1 -- 172.21.15.45:0/3945892503 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea8c0122e0 con 0x562563118570 2024-05-10T03:42:36.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.876+0000 7feab36b5b80 10 client.26305 fetch_fsmap learned FSMap version 30 2024-05-10T03:42:36.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.876+0000 7feab36b5b80 1 -- 172.21.15.45:0/3945892503 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x7fea98017070 con 0x562563118570 2024-05-10T03:42:36.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.876+0000 7fea84ff9700 1 -- 172.21.15.45:0/3945892503 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x562562f90270 con 0x562563118570 2024-05-10T03:42:36.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.876+0000 7fea84ff9700 1 -- 172.21.15.45:0/3945892503 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fea8c01c420 con 0x562563118570 2024-05-10T03:42:36.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.876+0000 7feab36b5b80 10 client.26305 fetch_fsmap finished waiting for FSMap version 30 2024-05-10T03:42:36.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.876+0000 7feab36b5b80 10 client.26305 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:42:36.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.876+0000 7feab36b5b80 20 client.26305 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:36.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.876+0000 7feab36b5b80 1 --2- 172.21.15.45:0/3945892503 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x56256313e520 0x562563140970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.876+0000 7feab36b5b80 4 client.26305 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:42:36.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.876+0000 7feab36b5b80 1 -- 172.21.15.45:0/3945892503 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5625630e6780 con 0x56256313e520 2024-05-10T03:42:36.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.877+0000 7feaa110d700 1 --2- 172.21.15.45:0/3945892503 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x56256313e520 0x562563140970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.877+0000 7feaa110d700 1 --2- 172.21.15.45:0/3945892503 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x56256313e520 0x562563140970 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eee8ed4bc0c60185 server_cookie=9ae75ce82b6e3f25 in_seq=0 out_seq=0 2024-05-10T03:42:36.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.877+0000 7fea84ff9700 10 client.26305 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:36.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.878+0000 7fea84ff9700 1 -- 172.21.15.45:0/3945892503 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5625630e6780 con 0x56256313e520 2024-05-10T03:42:36.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.878+0000 7fea84ff9700 10 client.26305 handle_command_reply: tid=0 2024-05-10T03:42:36.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.878+0000 7feab36b5b80 1 client.26305 shutdown 2024-05-10T03:42:36.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.878+0000 7feab36b5b80 1 -- 172.21.15.45:0/3945892503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562563118570 msgr2=0x562563132ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:36.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.878+0000 7feab36b5b80 1 --2- 172.21.15.45:0/3945892503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562563118570 0x562563132ce0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fea8c012d50 tx=0x7fea8c00f6a0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.878+0000 7feab36b5b80 1 -- 172.21.15.45:0/3945892503 shutdown_connections 2024-05-10T03:42:36.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.878+0000 7feab36b5b80 1 --2- 172.21.15.45:0/3945892503 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x56256313e520 0x562563140970 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.878+0000 7feab36b5b80 1 --2- 172.21.15.45:0/3945892503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562563118ec0 0x562563139c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.878+0000 7feab36b5b80 1 --2- 172.21.15.45:0/3945892503 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625631176a0 0x5625631327a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.878+0000 7feab36b5b80 1 --2- 172.21.15.45:0/3945892503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562563118570 0x562563132ce0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.878+0000 7feab36b5b80 1 -- 172.21.15.45:0/3945892503 >> 172.21.15.45:0/3945892503 conn(0x562563079a60 msgr2=0x562563111fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:36.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.878+0000 7fea84ff9700 0 client.26305 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:36.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.878+0000 7feab36b5b80 1 -- 172.21.15.45:0/3945892503 shutdown_connections 2024-05-10T03:42:36.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.878+0000 7feab36b5b80 1 -- 172.21.15.45:0/3945892503 wait complete. 2024-05-10T03:42:36.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.879+0000 7feab36b5b80 20 client.26305 trim_cache size 0 max 16384 2024-05-10T03:42:36.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.901+0000 7feab36b5b80 1 Processor -- start 2024-05-10T03:42:36.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.901+0000 7feab36b5b80 1 -- start start 2024-05-10T03:42:36.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.902+0000 7feab36b5b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562563079a60 0x562563137860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.902+0000 7feab36b5b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625631176a0 0x562563137da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.902+0000 7feab36b5b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562563118570 0x5625631327a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.902+0000 7feab36b5b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56256311f870 con 0x5625631176a0 2024-05-10T03:42:36.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.902+0000 7feab36b5b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x56256313e250 con 0x562563118570 2024-05-10T03:42:36.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.902+0000 7feab36b5b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625631333a0 con 0x562563079a60 2024-05-10T03:42:36.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.902+0000 7feaa110d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562563079a60 0x562563137860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.902+0000 7feaa110d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562563079a60 0x562563137860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:54172/0 (socket says 172.21.15.45:54172) 2024-05-10T03:42:36.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.902+0000 7feaa110d700 1 -- 172.21.15.45:0/2166848044 learned_addr learned my addr 172.21.15.45:0/2166848044 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:36.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.902+0000 7feaa190e700 1 --2- 172.21.15.45:0/2166848044 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562563118570 0x5625631327a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.902+0000 7feaa190e700 1 -- 172.21.15.45:0/2166848044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562563079a60 msgr2=0x562563137860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:36.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.902+0000 7feaa190e700 1 --2- 172.21.15.45:0/2166848044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562563079a60 0x562563137860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.902+0000 7feaa190e700 1 -- 172.21.15.45:0/2166848044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625631176a0 msgr2=0x562563137da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:36.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.902+0000 7feaa190e700 1 --2- 172.21.15.45:0/2166848044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625631176a0 0x562563137da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.902+0000 7feaa190e700 1 -- 172.21.15.45:0/2166848044 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562562e64b60 con 0x562563118570 2024-05-10T03:42:36.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.903+0000 7feaa190e700 1 --2- 172.21.15.45:0/2166848044 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562563118570 0x5625631327a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fea94007b40 tx=0x7fea9400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3389ee927b2e58f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:36.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.903+0000 7fea87fff700 1 -- 172.21.15.45:0/2166848044 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9409b350 con 0x562563118570 2024-05-10T03:42:36.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.903+0000 7fea87fff700 1 -- 172.21.15.45:0/2166848044 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fea9409ac50 con 0x562563118570 2024-05-10T03:42:36.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.903+0000 7fea87fff700 1 -- 172.21.15.45:0/2166848044 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea94011390 con 0x562563118570 2024-05-10T03:42:36.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.904+0000 7feab36b5b80 1 -- 172.21.15.45:0/2166848044 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562563118570 msgr2=0x5625631327a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:36.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.904+0000 7feab36b5b80 1 --2- 172.21.15.45:0/2166848044 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562563118570 0x5625631327a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fea94007b40 tx=0x7fea9400b330 comp rx=0 tx=0).stop 2024-05-10T03:42:36.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.904+0000 7feab36b5b80 1 -- 172.21.15.45:0/2166848044 shutdown_connections 2024-05-10T03:42:36.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.904+0000 7feab36b5b80 1 --2- 172.21.15.45:0/2166848044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562563079a60 0x562563137860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.904+0000 7feab36b5b80 1 --2- 172.21.15.45:0/2166848044 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562563118570 0x5625631327a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.904+0000 7feab36b5b80 1 --2- 172.21.15.45:0/2166848044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625631176a0 0x562563137da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.904+0000 7feab36b5b80 1 -- 172.21.15.45:0/2166848044 >> 172.21.15.45:0/2166848044 conn(0x56256310e450 msgr2=0x56256311b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:36.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.904+0000 7feab36b5b80 1 -- 172.21.15.45:0/2166848044 shutdown_connections 2024-05-10T03:42:36.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.904+0000 7feab36b5b80 1 -- 172.21.15.45:0/2166848044 wait complete. 2024-05-10T03:42:36.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.904+0000 7feab36b5b80 1 -- start start 2024-05-10T03:42:36.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.905+0000 7feab36b5b80 1 Processor -- start 2024-05-10T03:42:36.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.905+0000 7feab36b5b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562563079a60 0x56256318e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.905+0000 7feab36b5b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625631176a0 0x562563190e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.905+0000 7feab36b5b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562563118570 0x562563193380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.905+0000 7feab36b5b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562563138130 con 0x562563079a60 2024-05-10T03:42:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.905+0000 7feab36b5b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625631938c0 con 0x5625631176a0 2024-05-10T03:42:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.905+0000 7feab36b5b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625631a4a60 con 0x562563118570 2024-05-10T03:42:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.905+0000 7feab36b5b80 10 client.0 _ll_register_callbacks cb 0x562562fdcb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.905+0000 7feaa110d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562563079a60 0x56256318e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.905+0000 7feaa110d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562563079a60 0x56256318e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58154/0 (socket says 172.21.15.45:58154) 2024-05-10T03:42:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.905+0000 7feaa110d700 1 -- 172.21.15.45:0/2507147579 learned_addr learned my addr 172.21.15.45:0/2507147579 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.906+0000 7feaa190e700 1 --2- 172.21.15.45:0/2507147579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562563118570 0x562563193380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.906+0000 7feaa110d700 1 -- 172.21.15.45:0/2507147579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562563118570 msgr2=0x562563193380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.906+0000 7feaa110d700 1 --2- 172.21.15.45:0/2507147579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562563118570 0x562563193380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.906+0000 7feaa110d700 1 -- 172.21.15.45:0/2507147579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625631176a0 msgr2=0x562563190e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T03:42:36.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.906+0000 7feaa110d700 1 --2- 172.21.15.45:0/2507147579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625631176a0 0x562563190e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.906+0000 7feaa110d700 1 -- 172.21.15.45:0/2507147579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9c19da80 con 0x562563079a60 2024-05-10T03:42:36.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.906+0000 7feaa190e700 1 --2- 172.21.15.45:0/2507147579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562563118570 0x562563193380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:36.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.906+0000 7feaa110d700 1 --2- 172.21.15.45:0/2507147579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562563079a60 0x56256318e8e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fea98005920 tx=0x7fea9801cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b5610a811924ba server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:36.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.906+0000 7fea84ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:42:36.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.907+0000 7fea84ff9700 1 -- 172.21.15.45:0/2507147579 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea98004020 con 0x562563079a60 2024-05-10T03:42:36.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.907+0000 7fea84ff9700 1 -- 172.21.15.45:0/2507147579 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fea98004180 con 0x562563079a60 2024-05-10T03:42:36.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.907+0000 7feab36b5b80 1 -- 172.21.15.45:0/2507147579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fea98021070 con 0x562563079a60 2024-05-10T03:42:36.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.907+0000 7fea84ff9700 1 -- 172.21.15.45:0/2507147579 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea98004340 con 0x562563079a60 2024-05-10T03:42:36.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.907+0000 7feab36b5b80 10 client.16455 fetch_fsmap learned FSMap version 30 2024-05-10T03:42:36.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.907+0000 7feab36b5b80 1 -- 172.21.15.45:0/2507147579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x562562ffd560 con 0x562563079a60 2024-05-10T03:42:36.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.907+0000 7fea84ff9700 1 -- 172.21.15.45:0/2507147579 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fea98021070 con 0x562563079a60 2024-05-10T03:42:36.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.907+0000 7fea84ff9700 1 -- 172.21.15.45:0/2507147579 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 30) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fea980048f0 con 0x562563079a60 2024-05-10T03:42:36.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.907+0000 7feab36b5b80 10 client.16455 fetch_fsmap finished waiting for FSMap version 30 2024-05-10T03:42:36.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.907+0000 7feab36b5b80 10 client.16455 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:42:36.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.907+0000 7feab36b5b80 20 client.16455 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:36.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.907+0000 7feab36b5b80 1 --2- 172.21.15.45:0/2507147579 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x562563118ec0 0x5625631a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:36.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.907+0000 7feab36b5b80 4 client.16455 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T03:42:36.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.907+0000 7feab36b5b80 1 -- 172.21.15.45:0/2507147579 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56256302fec0 con 0x562563118ec0 2024-05-10T03:42:36.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.908+0000 7feaa090c700 1 --2- 172.21.15.45:0/2507147579 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x562563118ec0 0x5625631a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:36.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.908+0000 7fea84ff9700 10 client.16455 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.908+0000 7feaa090c700 1 --2- 172.21.15.45:0/2507147579 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x562563118ec0 0x5625631a84b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7407c3590336c1fd server_cookie=224c21b15f3ff6a4 in_seq=0 out_seq=0 2024-05-10T03:42:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.908+0000 7fea84ff9700 1 -- 172.21.15.45:0/2507147579 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56256302fec0 con 0x562563118ec0 2024-05-10T03:42:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.908+0000 7fea84ff9700 10 client.16455 handle_command_reply: tid=0 2024-05-10T03:42:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.908+0000 7feab36b5b80 1 client.16455 shutdown 2024-05-10T03:42:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.909+0000 7feab36b5b80 1 -- 172.21.15.45:0/2507147579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562563079a60 msgr2=0x56256318e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.909+0000 7feab36b5b80 1 --2- 172.21.15.45:0/2507147579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562563079a60 0x56256318e8e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fea98005920 tx=0x7fea9801cf20 comp rx=0 tx=0).stop 2024-05-10T03:42:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.909+0000 7feab36b5b80 1 -- 172.21.15.45:0/2507147579 shutdown_connections 2024-05-10T03:42:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.909+0000 7feab36b5b80 1 --2- 172.21.15.45:0/2507147579 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x562563118ec0 0x5625631a84b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.909+0000 7feab36b5b80 1 --2- 172.21.15.45:0/2507147579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562563118570 0x562563193380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.909+0000 7feab36b5b80 1 --2- 172.21.15.45:0/2507147579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562563079a60 0x56256318e8e0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.909+0000 7feab36b5b80 1 --2- 172.21.15.45:0/2507147579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625631176a0 0x562563190e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.909+0000 7feab36b5b80 1 -- 172.21.15.45:0/2507147579 >> 172.21.15.45:0/2507147579 conn(0x56256310e450 msgr2=0x56256311c490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.909+0000 7fea84ff9700 0 client.16455 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.909+0000 7feab36b5b80 1 -- 172.21.15.45:0/2507147579 shutdown_connections 2024-05-10T03:42:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.909+0000 7feab36b5b80 1 -- 172.21.15.45:0/2507147579 wait complete. 2024-05-10T03:42:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.909+0000 7feab36b5b80 20 client.16455 trim_cache size 0 max 16384 2024-05-10T03:42:36.917 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:42:36.917 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-10T03:42:36.917 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": { 2024-05-10T03:42:36.917 INFO:teuthology.orchestra.run.smithi045.stdout: "f9df00c4-9409-4911-ab7e-dd576b6d6082": { 2024-05-10T03:42:36.917 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/", 2024-05-10T03:42:36.917 INFO:teuthology.orchestra.run.smithi045.stdout: "tag": "f9df00c4-9409-4911-ab7e-dd576b6d6082", 2024-05-10T03:42:36.918 INFO:teuthology.orchestra.run.smithi045.stdout: "options": "recursive,force" 2024-05-10T03:42:36.918 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:42:36.918 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:42:36.918 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:42:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.909+0000 7feaa3371700 1 -- 172.21.15.45:0/3686175905 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fea880a11c0 msgr2=0x7fea880a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.909+0000 7feaa3371700 1 --2- 172.21.15.45:0/3686175905 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fea880a11c0 0x7fea880a36d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fea9c101af0 tx=0x7fea98009310 comp rx=0 tx=0).stop 2024-05-10T03:42:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.909+0000 7feaa3371700 1 -- 172.21.15.45:0/3686175905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea9c102590 msgr2=0x7fea9c1a17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.909+0000 7feaa3371700 1 --2- 172.21.15.45:0/3686175905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea9c102590 0x7fea9c1a17f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fea9400b6c0 tx=0x7fea94004e20 comp rx=0 tx=0).stop 2024-05-10T03:42:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.909+0000 7feaa3371700 1 -- 172.21.15.45:0/3686175905 shutdown_connections 2024-05-10T03:42:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.909+0000 7feaa3371700 1 --2- 172.21.15.45:0/3686175905 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fea880a11c0 0x7fea880a36d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.909+0000 7feaa3371700 1 --2- 172.21.15.45:0/3686175905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea9c102590 0x7fea9c1a17f0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.909+0000 7feaa3371700 1 --2- 172.21.15.45:0/3686175905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea9c100ad0 0x7fea9c073eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.909+0000 7feaa3371700 1 --2- 172.21.15.45:0/3686175905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea9c101bf0 0x7fea9c19cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.909+0000 7feaa3371700 1 -- 172.21.15.45:0/3686175905 >> 172.21.15.45:0/3686175905 conn(0x7fea9c0fc0e0 msgr2=0x7fea9c104e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.910+0000 7feaa3371700 1 -- 172.21.15.45:0/3686175905 shutdown_connections 2024-05-10T03:42:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:42:36.910+0000 7feaa3371700 1 -- 172.21.15.45:0/3686175905 wait complete. 2024-05-10T03:42:36.928 INFO:tasks.cephfs.filesystem:scrub status for tag:f9df00c4-9409-4911-ab7e-dd576b6d6082 - {'path': '/', 'tag': 'f9df00c4-9409-4911-ab7e-dd576b6d6082', 'options': 'recursive,force'} 2024-05-10T03:42:37.033 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.749+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001c4 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Setup auth v120 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae178580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001c4:[<0x10000000188/Setup v120>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001c4:[<0x10000000188/Setup v120>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.034 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.750+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001cf [...2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/ auth{0=1} v184 ap=1 f(v0 m2024-05-10T03:42:26.006838+0000 4=4+0) n(v0 rc2024-05-10T03:42:26.006838+0000 5=4+1) (inest mix) (ifile excl) (iversion lock) caps={25391=pAsLsXsFsx/pAsLsXsFsx@2},l=25391 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5636acec0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000001cf:[<0x10000000188/nwfpe v150>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x100000001cf:[<0x10000000188/nwfpe v184>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-10T03:42:26.006838+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-05-10T03:42:26.006838+0000 5=4+1)","memory_value.dirstat":"f(v0 m2024-05-10T03:42:26.006838+0000 4=4+0)","memory_value.rstat":"n(v0 rc2024-05-10T03:42:26.006838+0000 5=4+1)","error_str":""},"return_code":0} 2024-05-10T03:42:37.034 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.750+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001d4 [...2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/pxa/ auth{0=1} v186 ap=1 f(v0 m2024-05-10T03:42:26.007838+0000 1=1+0) n(v0 rc2024-05-10T03:42:26.008838+0000 2=1+1) (inest mix) (ifile excl) (iversion lock) caps={25391=pAsLsXsFsx/pAsLsXsFsx@2},l=25391 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5636acec2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000001d4:[<0x10000000188/pxa v154>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x100000001d4:[<0x10000000188/pxa v186>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-10T03:42:26.007838+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-05-10T03:42:26.007838+0000 2=1+1)","memory_value.dirstat":"f(v0 m2024-05-10T03:42:26.007838+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-05-10T03:42:26.008838+0000 2=1+1)","error_str":""},"return_code":0} 2024-05-10T03:42:37.034 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.750+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001e1 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/uefi.txt auth{0=1} v178 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5636ae178b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001e1:[<0x10000000188/uefi.txt v178>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001e1:[<0x10000000188/uefi.txt v178>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.034 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.750+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000197 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Porting auth v30 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae179080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000197:[<0x10000000188/Porting v30>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000197:[<0x10000000188/Porting v30>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.034 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.751+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000189 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/00-INDEX auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae179600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000189:[<0x10000000188/00-INDEX v2>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000189:[<0x10000000188/00-INDEX v2>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.034 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.751+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000199 [...2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/ auth{0=1} v70 ap=1 RANDEPHEMERALPIN f(v0 m2024-05-10T03:42:25.971838+0000 18=18+0) n(v0 rc2024-05-10T03:42:25.971838+0000 19=18+1) (inest lock) (ifile excl) (iversion lock) caps={25391=pAsLsXsFsx/pAsLsXsFsx@1},l=25391 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 randepin 0x5636ae179b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000199:[<0x10000000188/SA1100 v70>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x10000000199:[<0x10000000188/SA1100 v70>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-10T03:42:25.971838+0000 18=18+0)","ondisk_value.rstat":"n(v0 rc2024-05-10T03:42:25.971838+0000 19=18+1)","memory_value.dirstat":"f(v0 m2024-05-10T03:42:25.971838+0000 18=18+0)","memory_value.rstat":"n(v0 rc2024-05-10T03:42:25.971838+0000 19=18+1)","error_str":""},"return_code":0} 2024-05-10T03:42:37.034 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.751+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000193 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Netwinder auth v22 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae17a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000193:[<0x10000000188/Netwinder v22>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000193:[<0x10000000188/Netwinder v22>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.034 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.752+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000194 [...2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/OMAP/ auth{0=1} v188 ap=1 f(v0 m2024-05-10T03:42:25.951839+0000 2=2+0) n(v0 rc2024-05-10T03:42:25.952839+0000 3=2+1) (inest mix) (ifile excl) (iversion lock) caps={25391=pAsLsXsFsx/pAsLsXsFsx@2},l=25391 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5636acec3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000194:[<0x10000000188/OMAP v28>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x10000000194:[<0x10000000188/OMAP v188>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-10T03:42:25.951839+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-05-10T03:42:25.951839+0000 3=2+1)","memory_value.dirstat":"f(v0 m2024-05-10T03:42:25.951839+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-05-10T03:42:25.952839+0000 3=2+1)","error_str":""},"return_code":0} 2024-05-10T03:42:37.034 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.752+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001ca [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/kernel_user_helpers.txt auth v132 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae17a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001ca:[<0x10000000188/kernel_user_helpers.txt v132>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001ca:[<0x10000000188/kernel_user_helpers.txt v132>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.035 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.752+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001b2 [...2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SPEAr/ auth{0=1} v190 ap=1 f(v0 m2024-05-10T03:42:25.978838+0000 1=1+0) n(v0 rc2024-05-10T03:42:25.979838+0000 2=1+1) (inest mix) (ifile excl) (iversion lock) caps={25391=pAsLsXsFsx/pAsLsXsFsx@2},l=25391 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5636acec3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000001b2:[<0x10000000188/SPEAr v86>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x100000001b2:[<0x10000000188/SPEAr v190>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-10T03:42:25.978838+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-05-10T03:42:25.978838+0000 2=1+1)","memory_value.dirstat":"f(v0 m2024-05-10T03:42:25.978838+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-05-10T03:42:25.979838+0000 2=1+1)","error_str":""},"return_code":0} 2024-05-10T03:42:37.035 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.752+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000018a [...2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Atmel/ auth{0=1} v192 ap=1 f(v0 m2024-05-10T03:42:25.938839+0000 1=1+0) n(v0 rc2024-05-10T03:42:25.939839+0000 2=1+1) (inest mix) (ifile excl) (iversion lock) caps={25391=pAsLsXsFsx/pAsLsXsFsx@2},l=25391 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5636ad6a4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000018a:[<0x10000000188/Atmel v6>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x1000000018a:[<0x10000000188/Atmel v192>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-10T03:42:25.938839+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-05-10T03:42:25.938839+0000 2=1+1)","memory_value.dirstat":"f(v0 m2024-05-10T03:42:25.938839+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-05-10T03:42:25.939839+0000 2=1+1)","error_str":""},"return_code":0} 2024-05-10T03:42:37.035 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.752+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000190 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Makefile auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae17ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000190:[<0x10000000188/Makefile v16>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000190:[<0x10000000188/Makefile v16>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.035 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.753+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001e0 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/tcm.txt auth{0=1} v176 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5636ae17b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001e0:[<0x10000000188/tcm.txt v176>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001e0:[<0x10000000188/tcm.txt v176>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.035 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.753+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001d6 [...2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/ auth{0=1} v194 ap=1 f(v0 m2024-05-10T03:42:30.814763+0000 5=5+0) n(v0 rc2024-05-10T03:42:30.814763+0000 6=5+1) (inest mix) (ifile excl) (iversion lock) caps={25391=pAsLsXsFsx/pAsLsXsFsx@2},l=25391 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5636ad6a4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000001d6:[<0x10000000188/sti v166>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x100000001d6:[<0x10000000188/sti v194>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-10T03:42:30.814763+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-05-10T03:42:30.814763+0000 6=5+1)","memory_value.dirstat":"f(v0 m2024-05-10T03:42:30.814763+0000 5=5+0)","memory_value.rstat":"n(v0 rc2024-05-10T03:42:30.814763+0000 6=5+1)","error_str":""},"return_code":0} 2024-05-10T03:42:37.035 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.753+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001e2 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/vlocks.txt auth{0=1} v180 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5636ae17b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001e2:[<0x10000000188/vlocks.txt v180>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001e2:[<0x10000000188/vlocks.txt v180>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.035 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.754+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001c7 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt auth v126 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636adc30000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001c7:[<0x10000000188/cluster-pm-race-avoidance.txt v126>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001c7:[<0x10000000188/cluster-pm-race-avoidance.txt v126>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.035 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.754+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001c8 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/firmware.txt auth v128 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636adc30580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001c8:[<0x10000000188/firmware.txt v128>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001c8:[<0x10000000188/firmware.txt v128>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.035 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.754+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001b4 [...2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ auth{0=1} v196 ap=1 f(v0 m2024-05-10T03:42:25.988838+0000 11=11+0) n(v0 rc2024-05-10T03:42:25.989838+0000 12=11+1) (inest mix) (ifile excl) (iversion lock) caps={25391=pAsLsXsFsx/pAsLsXsFsx@2},l=25391 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5636ad6a4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000001b4:[<0x10000000188/Samsung-S3C24XX v110>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x100000001b4:[<0x10000000188/Samsung-S3C24XX v196>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-10T03:42:25.988838+0000 11=11+0)","ondisk_value.rstat":"n(v0 rc2024-05-10T03:42:25.988838+0000 12=11+1)","memory_value.dirstat":"f(v0 m2024-05-10T03:42:25.988838+0000 11=11+0)","memory_value.rstat":"n(v0 rc2024-05-10T03:42:25.989838+0000 12=11+1)","error_str":""},"return_code":0} 2024-05-10T03:42:37.035 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.754+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000018e [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/IXP4xx auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636adc30b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000018e:[<0x10000000188/IXP4xx v12>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000018e:[<0x10000000188/IXP4xx v12>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.035 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.755+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001dc [...2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sunxi/ auth{0=1} v198 ap=1 f(v0 m2024-05-10T03:42:30.818763+0000 2=2+0) n(v0 rc2024-05-10T03:42:30.819763+0000 3=2+1) (inest mix) (ifile excl) (iversion lock) caps={25391=pAsLsXsFsx/pAsLsXsFsx@2},l=25391 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5636acf9d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000001dc:[<0x10000000188/sunxi v172>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x100000001dc:[<0x10000000188/sunxi v198>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-10T03:42:30.818763+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-05-10T03:42:30.818763+0000 3=2+1)","memory_value.dirstat":"f(v0 m2024-05-10T03:42:30.818763+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-05-10T03:42:30.819763+0000 3=2+1)","error_str":""},"return_code":0} 2024-05-10T03:42:37.035 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.755+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000018f [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Interrupts auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636adc31080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000018f:[<0x10000000188/Interrupts v14>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000018f:[<0x10000000188/Interrupts v14>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.035 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.755+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000018d [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/CCN.txt auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636adc31600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000018d:[<0x10000000188/CCN.txt v10>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000018d:[<0x10000000188/CCN.txt v10>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.036 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.755+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000191 [...2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Marvell/ auth{0=1} v200 ap=1 f(v0 m2024-05-10T03:42:25.946839+0000 1=1+0) n(v0 rc2024-05-10T03:42:25.947839+0000 2=1+1) (inest mix) (ifile excl) (iversion lock) caps={25391=pAsLsXsFsx/pAsLsXsFsx@2},l=25391 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5636ad56a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000191:[<0x10000000188/Marvell v20>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x10000000191:[<0x10000000188/Marvell v200>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-10T03:42:25.946839+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-05-10T03:42:25.946839+0000 2=1+1)","memory_value.dirstat":"f(v0 m2024-05-10T03:42:25.946839+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-05-10T03:42:25.947839+0000 2=1+1)","error_str":""},"return_code":0} 2024-05-10T03:42:37.036 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.756+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001c0 [...2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung/ auth{0=1} v202 ap=1 f(v0 m2024-05-10T03:42:25.992838+0000 3=3+0) n(v0 rc2024-05-10T03:42:25.993838+0000 4=3+1) (inest mix) (ifile excl) (iversion lock) caps={25391=pAsLsXsFsx/pAsLsXsFsx@2},l=25391 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5636ad56a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000001c0:[<0x10000000188/Samsung v118>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x100000001c0:[<0x10000000188/Samsung v202>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-10T03:42:25.992838+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-05-10T03:42:25.992838+0000 4=3+1)","memory_value.dirstat":"f(v0 m2024-05-10T03:42:25.992838+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-05-10T03:42:25.993838+0000 4=3+1)","error_str":""},"return_code":0} 2024-05-10T03:42:37.040 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.756+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000198 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/README auth v32 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636adc31b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000198:[<0x10000000188/README v32>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000198:[<0x10000000188/README v32>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.040 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.756+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001c5 [...2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/VFP/ auth{0=1} v204 ap=1 f(v0 m2024-05-10T03:42:25.995838+0000 1=1+0) n(v0 rc2024-05-10T03:42:25.996838+0000 2=1+1) (inest mix) (ifile excl) (iversion lock) caps={25391=pAsLsXsFsx/pAsLsXsFsx@2},l=25391 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5636ad56ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000001c5:[<0x10000000188/VFP v124>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x100000001c5:[<0x10000000188/VFP v204>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-10T03:42:25.995838+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-05-10T03:42:25.995838+0000 2=1+1)","memory_value.dirstat":"f(v0 m2024-05-10T03:42:25.995838+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-05-10T03:42:25.996838+0000 2=1+1)","error_str":""},"return_code":0} 2024-05-10T03:42:37.041 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.756+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001cd [...2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/msm/ auth{0=1} v206 ap=1 f(v0 m2024-05-10T03:42:26.002838+0000 1=1+0) n(v0 rc2024-05-10T03:42:26.003838+0000 2=1+1) (inest mix) (ifile excl) (iversion lock) caps={25391=pAsLsXsFsx/pAsLsXsFsx@2},l=25391 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5636ad56b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000001cd:[<0x10000000188/msm v140>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x100000001cd:[<0x10000000188/msm v206>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-10T03:42:26.002838+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-05-10T03:42:26.002838+0000 2=1+1)","memory_value.dirstat":"f(v0 m2024-05-10T03:42:26.002838+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-05-10T03:42:26.003838+0000 2=1+1)","error_str":""},"return_code":0} 2024-05-10T03:42:37.041 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.757+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001cc [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/memory.txt auth v136 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636adc32100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001cc:[<0x10000000188/memory.txt v136>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001cc:[<0x10000000188/memory.txt v136>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.041 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.757+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001ac [...2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/ auth{0=1} v208 ap=1 f(v0 m2024-05-10T03:42:25.976838+0000 5=5+0) n(v0 rc2024-05-10T03:42:25.977838+0000 6=5+1) (inest mix) (ifile excl) (iversion lock) caps={25391=pAsLsXsFsx/pAsLsXsFsx@2},l=25391 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5636ad56b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000001ac:[<0x10000000188/SH-Mobile v82>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x100000001ac:[<0x10000000188/SH-Mobile v208>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-10T03:42:25.976838+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-05-10T03:42:25.976838+0000 6=5+1)","memory_value.dirstat":"f(v0 m2024-05-10T03:42:25.976838+0000 5=5+0)","memory_value.rstat":"n(v0 rc2024-05-10T03:42:25.977838+0000 6=5+1)","error_str":""},"return_code":0} 2024-05-10T03:42:37.041 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.757+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001c9 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/kernel_mode_neon.txt auth v130 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636adc32680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001c9:[<0x10000000188/kernel_mode_neon.txt v130>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001c9:[<0x10000000188/kernel_mode_neon.txt v130>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.041 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.757+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001cb [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/mem_alignment auth v134 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636adc32c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001cb:[<0x10000000188/mem_alignment v134>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001cb:[<0x10000000188/mem_alignment v134>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.041 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.757+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000018c [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Booting auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636adc33180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000018c:[<0x10000000188/Booting v8>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000018c:[<0x10000000188/Booting v8>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.041 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.757+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001df [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/swp_emulation auth{0=1} v174 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5636adc33700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001df:[<0x10000000188/swp_emulation v174>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001df:[<0x10000000188/swp_emulation v174>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.041 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.806+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000016e [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/delay-accounting.txt auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636acec0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000016e:[<0x1000000016a/delay-accounting.txt v8>,<0x100000007db/accounting v236>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000016e:[<0x1000000016a/delay-accounting.txt v8>,<0x100000007db/accounting v1922>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.041 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.806+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000016f [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/getdelays.c auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636acec0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000016f:[<0x1000000016a/getdelays.c v10>,<0x100000007db/accounting v236>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000016f:[<0x1000000016a/getdelays.c v10>,<0x100000007db/accounting v1922>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.041 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.806+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000016c [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636acec1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000016c:[<0x1000000016a/Makefile v4>,<0x100000007db/accounting v236>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000016c:[<0x1000000016a/Makefile v4>,<0x100000007db/accounting v1922>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.041 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.806+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000171 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/taskstats.txt auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636acec1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000171:[<0x1000000016a/taskstats.txt v14>,<0x100000007db/accounting v236>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000171:[<0x1000000016a/taskstats.txt v14>,<0x100000007db/accounting v1922>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.041 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.806+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000016d [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/cgroupstats.txt auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636acec1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000016d:[<0x1000000016a/cgroupstats.txt v6>,<0x100000007db/accounting v236>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000016d:[<0x1000000016a/cgroupstats.txt v6>,<0x100000007db/accounting v1922>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.042 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.807+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000170 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/taskstats-struct.txt auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636acec2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000170:[<0x1000000016a/taskstats-struct.txt v12>,<0x100000007db/accounting v236>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000170:[<0x1000000016a/taskstats-struct.txt v12>,<0x100000007db/accounting v1922>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.042 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.807+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000016b [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/.gitignore auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636acec2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000016b:[<0x1000000016a/.gitignore v2>,<0x100000007db/accounting v236>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000016b:[<0x1000000016a/.gitignore v2>,<0x100000007db/accounting v1922>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.042 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.836+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000017a [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/initrd_table_override.txt auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636adb9f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000017a:[<0x10000000172/initrd_table_override.txt v16>,<0x100000007db/acpi v260>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000017a:[<0x10000000172/initrd_table_override.txt v16>,<0x100000007db/acpi v1838>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.042 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.836+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000176 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/debug.txt auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636adb9f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000176:[<0x10000000172/debug.txt v8>,<0x100000007db/acpi v260>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000176:[<0x10000000172/debug.txt v8>,<0x100000007db/acpi v1838>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.042 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.836+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000177 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/dsdt-override.txt auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae0fe000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000177:[<0x10000000172/dsdt-override.txt v10>,<0x100000007db/acpi v260>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000177:[<0x10000000172/dsdt-override.txt v10>,<0x100000007db/acpi v1838>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.042 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.837+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000017f [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/video_extension.txt auth v26 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae0fe580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000017f:[<0x10000000172/video_extension.txt v26>,<0x100000007db/acpi v260>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000017f:[<0x10000000172/video_extension.txt v26>,<0x100000007db/acpi v1838>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.042 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.837+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000017d [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/namespace.txt auth v22 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae0feb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000017d:[<0x10000000172/namespace.txt v22>,<0x100000007db/acpi v260>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000017d:[<0x10000000172/namespace.txt v22>,<0x100000007db/acpi v1838>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.042 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.837+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000017b [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/method-customizing.txt auth v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae0ff080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000017b:[<0x10000000172/method-customizing.txt v18>,<0x100000007db/acpi v260>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000017b:[<0x10000000172/method-customizing.txt v18>,<0x100000007db/acpi v1838>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.042 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.837+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000173 [...2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/apei/ auth v6 ap=1 f(v0 m2024-05-10T03:42:25.909839+0000 2=2+0) n(v0 rc2024-05-10T03:42:25.909839+0000 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={25391=pAsLsXsFsx/pAsLsXsFsx@1},l=25391 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae0ff600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000173:[<0x10000000172/apei v6>,<0x100000007db/acpi v260>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[]","memoryvalue":"(2)0x10000000173:[<0x10000000172/apei v6>,<0x100000007db/acpi v1838>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-10T03:42:25.909839+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-05-10T03:42:25.909839+0000 3=2+1)","memory_value.dirstat":"f(v0 m2024-05-10T03:42:25.909839+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-05-10T03:42:25.909839+0000 3=2+1)","error_str":""},"return_code":0} 2024-05-10T03:42:37.042 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.837+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000017c [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/method-tracing.txt auth v20 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae0ffb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000017c:[<0x10000000172/method-tracing.txt v20>,<0x100000007db/acpi v260>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000017c:[<0x10000000172/method-tracing.txt v20>,<0x100000007db/acpi v1838>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.042 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.837+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000179 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/gpio-properties.txt auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae100100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000179:[<0x10000000172/gpio-properties.txt v14>,<0x100000007db/acpi v260>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000179:[<0x10000000172/gpio-properties.txt v14>,<0x100000007db/acpi v1838>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.043 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.838+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000017e [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/scan_handlers.txt auth v24 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae100680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000017e:[<0x10000000172/scan_handlers.txt v24>,<0x100000007db/acpi v260>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000017e:[<0x10000000172/scan_handlers.txt v24>,<0x100000007db/acpi v1838>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.043 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.838+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000183 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/status.sh auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636add51600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000183:[<0x10000000180/status.sh v6>,<0x100000007db/aoe v274>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000183:[<0x10000000180/status.sh v6>,<0x100000007db/aoe v1834>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.043 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.838+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000178 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/enumeration.txt auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae100c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000178:[<0x10000000172/enumeration.txt v12>,<0x100000007db/acpi v260>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000178:[<0x10000000172/enumeration.txt v12>,<0x100000007db/acpi v1838>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.043 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.838+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000182 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/autoload.sh auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636add51080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000182:[<0x10000000180/autoload.sh v4>,<0x100000007db/aoe v274>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000182:[<0x10000000180/autoload.sh v4>,<0x100000007db/aoe v1834>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.043 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.838+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000184 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/todo.txt auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636add50580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000184:[<0x10000000180/todo.txt v8>,<0x100000007db/aoe v274>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000184:[<0x10000000180/todo.txt v8>,<0x100000007db/aoe v1834>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.043 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.838+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000181 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/aoe.txt auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636add50b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000181:[<0x10000000180/aoe.txt v2>,<0x100000007db/aoe v274>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000181:[<0x10000000180/aoe.txt v2>,<0x100000007db/aoe v1834>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.043 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.838+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000185 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/udev-install.sh auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636add50000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000185:[<0x10000000180/udev-install.sh v10>,<0x100000007db/aoe v274>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000185:[<0x10000000180/udev-install.sh v10>,<0x100000007db/aoe v1834>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.043 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.839+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000186 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/udev.txt auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636add51b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000186:[<0x10000000180/udev.txt v12>,<0x100000007db/aoe v274>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000186:[<0x10000000180/udev.txt v12>,<0x100000007db/aoe v1834>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.043 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.843+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000013b [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/800x600.S auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636add52100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000013b:[<0x10000000135/800x600.S v12>,<0x100000007db/EDID v136>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000013b:[<0x10000000135/800x600.S v12>,<0x100000007db/EDID v1836>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.043 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.843+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000013e [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/edid.S auth v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636add52680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000013e:[<0x10000000135/edid.S v18>,<0x100000007db/EDID v136>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000013e:[<0x10000000135/edid.S v18>,<0x100000007db/EDID v1836>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.043 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.843+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000013d [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/Makefile auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636add52c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000013d:[<0x10000000135/Makefile v16>,<0x100000007db/EDID v136>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000013d:[<0x10000000135/Makefile v16>,<0x100000007db/EDID v1836>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.043 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.843+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000013f [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/hex auth v20 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636add53180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000013f:[<0x10000000135/hex v20>,<0x100000007db/EDID v136>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000013f:[<0x10000000135/hex v20>,<0x100000007db/EDID v1836>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.044 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.843+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000136 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1024x768.S auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636add53700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000136:[<0x10000000135/1024x768.S v2>,<0x100000007db/EDID v136>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000136:[<0x10000000135/1024x768.S v2>,<0x100000007db/EDID v1836>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.044 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.844+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000013a [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1920x1080.S auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ac4dc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000013a:[<0x10000000135/1920x1080.S v10>,<0x100000007db/EDID v136>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000013a:[<0x10000000135/1920x1080.S v10>,<0x100000007db/EDID v1836>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.044 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.844+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000013c [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/HOWTO.txt auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ac2ce100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000013c:[<0x10000000135/HOWTO.txt v14>,<0x100000007db/EDID v136>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000013c:[<0x10000000135/HOWTO.txt v14>,<0x100000007db/EDID v1836>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.044 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.844+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000137 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1280x1024.S auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636a7565080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000137:[<0x10000000135/1280x1024.S v4>,<0x100000007db/EDID v136>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000137:[<0x10000000135/1280x1024.S v4>,<0x100000007db/EDID v1836>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.044 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.844+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000138 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1600x1200.S auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636adb9c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000138:[<0x10000000135/1600x1200.S v6>,<0x100000007db/EDID v136>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000138:[<0x10000000135/1600x1200.S v6>,<0x100000007db/EDID v1836>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.044 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.844+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000139 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1680x1050.S auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636adb9c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000139:[<0x10000000135/1680x1050.S v8>,<0x100000007db/EDID v136>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000139:[<0x10000000135/1680x1050.S v8>,<0x100000007db/EDID v1836>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.044 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.898+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000015e [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rcuref.txt auth v28 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad6a5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000015e:[<0x10000000150/rcuref.txt v28>,<0x100000007db/RCU v206>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000015e:[<0x10000000150/rcuref.txt v28>,<0x100000007db/RCU v2078>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.044 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.898+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000152 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/NMI-RCU.txt auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad6a5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000152:[<0x10000000150/NMI-RCU.txt v4>,<0x100000007db/RCU v206>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000152:[<0x10000000150/NMI-RCU.txt v4>,<0x100000007db/RCU v2078>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.044 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.898+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000161 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/trace.txt auth v34 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad6a5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000161:[<0x10000000150/trace.txt v34>,<0x100000007db/RCU v206>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000161:[<0x10000000150/trace.txt v34>,<0x100000007db/RCU v2078>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.044 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.898+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000158 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/lockdep-splat.txt auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad6a6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000158:[<0x10000000150/lockdep-splat.txt v16>,<0x100000007db/RCU v206>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000158:[<0x10000000150/lockdep-splat.txt v16>,<0x100000007db/RCU v2078>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.044 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.898+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000159 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/lockdep.txt auth v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad6a6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000159:[<0x10000000150/lockdep.txt v18>,<0x100000007db/RCU v206>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000159:[<0x10000000150/lockdep.txt v18>,<0x100000007db/RCU v2078>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.044 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.898+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000151 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/00-INDEX auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad6a6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000151:[<0x10000000150/00-INDEX v2>,<0x100000007db/RCU v206>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000151:[<0x10000000150/00-INDEX v2>,<0x100000007db/RCU v2078>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.045 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.898+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000160 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/torture.txt auth v32 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad6a7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000160:[<0x10000000150/torture.txt v32>,<0x100000007db/RCU v206>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000160:[<0x10000000150/torture.txt v32>,<0x100000007db/RCU v2078>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.045 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.898+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000015c [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rcubarrier.txt auth v24 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad6a7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000015c:[<0x10000000150/rcubarrier.txt v24>,<0x100000007db/RCU v206>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000015c:[<0x10000000150/rcubarrier.txt v24>,<0x100000007db/RCU v2078>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.045 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.899+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000153 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/RTFP.txt auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636acf9a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000153:[<0x10000000150/RTFP.txt v6>,<0x100000007db/RCU v206>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000153:[<0x10000000150/RTFP.txt v6>,<0x100000007db/RCU v2078>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.045 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.899+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000015b [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rcu_dereference.txt auth v22 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636acf9a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000015b:[<0x10000000150/rcu_dereference.txt v22>,<0x100000007db/RCU v206>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000015b:[<0x10000000150/rcu_dereference.txt v22>,<0x100000007db/RCU v2078>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.045 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.899+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000157 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/listRCU.txt auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636acf9b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000157:[<0x10000000150/listRCU.txt v14>,<0x100000007db/RCU v206>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000157:[<0x10000000150/listRCU.txt v14>,<0x100000007db/RCU v2078>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.045 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.899+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000154 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/UP.txt auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636acf9ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000154:[<0x10000000150/UP.txt v8>,<0x100000007db/RCU v206>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000154:[<0x10000000150/UP.txt v8>,<0x100000007db/RCU v2078>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.045 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.899+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000015f [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/stallwarn.txt auth v30 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636acf9b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000015f:[<0x10000000150/stallwarn.txt v30>,<0x100000007db/RCU v206>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000015f:[<0x10000000150/stallwarn.txt v30>,<0x100000007db/RCU v2078>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.045 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.899+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000156 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/checklist.txt auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636acf9bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000156:[<0x10000000150/checklist.txt v12>,<0x100000007db/RCU v206>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000156:[<0x10000000150/checklist.txt v12>,<0x100000007db/RCU v2078>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.045 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.900+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000162 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/whatisRCU.txt auth v36 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636acf9c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000162:[<0x10000000150/whatisRCU.txt v36>,<0x100000007db/RCU v206>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000162:[<0x10000000150/whatisRCU.txt v36>,<0x100000007db/RCU v2078>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.045 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.900+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000155 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/arrayRCU.txt auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636acf9c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000155:[<0x10000000150/arrayRCU.txt v10>,<0x100000007db/RCU v206>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000155:[<0x10000000150/arrayRCU.txt v10>,<0x100000007db/RCU v2078>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.045 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.900+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000015d [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rculist_nulls.txt auth v26 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636acf9cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000015d:[<0x10000000150/rculist_nulls.txt v26>,<0x100000007db/RCU v206>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000015d:[<0x10000000150/rculist_nulls.txt v26>,<0x100000007db/RCU v2078>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.046 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.900+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000015a [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rcu.txt auth v20 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636acf9d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000015a:[<0x10000000150/rcu.txt v20>,<0x100000007db/RCU v206>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000015a:[<0x10000000150/rcu.txt v20>,<0x100000007db/RCU v2078>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.046 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.902+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000014a [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636adb9cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000014a:[<0x10000000148/MSI-HOWTO.txt v4>,<0x100000007db/PCI v168>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000014a:[<0x10000000148/MSI-HOWTO.txt v4>,<0x100000007db/PCI v2076>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.046 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.902+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000014b [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636adb9d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000014b:[<0x10000000148/PCIEBUS-HOWTO.txt v6>,<0x100000007db/PCI v168>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000014b:[<0x10000000148/PCIEBUS-HOWTO.txt v6>,<0x100000007db/PCI v2076>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.046 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.902+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000014e [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/pci.txt auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636adb9d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000014e:[<0x10000000148/pci.txt v12>,<0x100000007db/PCI v168>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000014e:[<0x10000000148/pci.txt v12>,<0x100000007db/PCI v2076>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.046 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.902+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000149 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/00-INDEX auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636adb9db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000149:[<0x10000000148/00-INDEX v2>,<0x100000007db/PCI v168>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000149:[<0x10000000148/00-INDEX v2>,<0x100000007db/PCI v2076>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.046 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.903+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000014d [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/pci-iov-howto.txt auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636adb9e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000014d:[<0x10000000148/pci-iov-howto.txt v10>,<0x100000007db/PCI v168>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000014d:[<0x10000000148/pci-iov-howto.txt v10>,<0x100000007db/PCI v2076>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.046 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.903+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000014c [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/pci-error-recovery.txt auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636adb9e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000014c:[<0x10000000148/pci-error-recovery.txt v8>,<0x100000007db/PCI v168>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000014c:[<0x10000000148/pci-error-recovery.txt v8>,<0x100000007db/PCI v2076>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.046 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.903+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000014f [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/pcieaer-howto.txt auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636adb9ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000014f:[<0x10000000148/pcieaer-howto.txt v14>,<0x100000007db/PCI v168>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000014f:[<0x10000000148/pcieaer-howto.txt v14>,<0x100000007db/PCI v2076>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.046 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.952+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001d0 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/NOTES auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad56c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001d0:[<0x100000001cf/NOTES v2>,<0x10000000188/nwfpe v150>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001d0:[<0x100000001cf/NOTES v2>,<0x10000000188/nwfpe v184>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.046 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.952+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001d2 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/README.FPE auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad56c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001d2:[<0x100000001cf/README.FPE v6>,<0x10000000188/nwfpe v150>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001d2:[<0x100000001cf/README.FPE v6>,<0x10000000188/nwfpe v184>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.046 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.952+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001d3 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/TODO auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad56bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001d3:[<0x100000001cf/TODO v8>,<0x10000000188/nwfpe v150>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001d3:[<0x100000001cf/TODO v8>,<0x10000000188/nwfpe v184>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.047 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.952+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001d5 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/pxa/mfp.txt auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad56d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001d5:[<0x100000001d4/mfp.txt v2>,<0x10000000188/pxa v154>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001d5:[<0x100000001d4/mfp.txt v2>,<0x10000000188/pxa v186>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.047 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.953+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001d1 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/README auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad56cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001d1:[<0x100000001cf/README v4>,<0x10000000188/nwfpe v150>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001d1:[<0x100000001cf/README v4>,<0x10000000188/nwfpe v184>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.047 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.953+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000019b [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Assabet auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ac5d6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000019b:[<0x10000000199/Assabet v4>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000019b:[<0x10000000199/Assabet v4>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.047 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.953+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001a9 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/empeg auth v32 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ac5d6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001a9:[<0x10000000199/empeg v32>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001a9:[<0x10000000199/empeg v32>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.047 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.953+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001a4 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/PLEB auth v22 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ac5d6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001a4:[<0x10000000199/PLEB v22>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001a4:[<0x10000000199/PLEB v22>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.047 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.953+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001aa [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/nanoEngine auth v34 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ac5d7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001aa:[<0x10000000199/nanoEngine v34>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001aa:[<0x10000000199/nanoEngine v34>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.047 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.953+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001a2 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Itsy auth v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ac5d7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001a2:[<0x10000000199/Itsy v18>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001a2:[<0x10000000199/Itsy v18>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.047 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.953+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000019c [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Brutus auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ac5d7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000019c:[<0x10000000199/Brutus v6>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000019c:[<0x10000000199/Brutus v6>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.047 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.953+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000019d [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/CERF auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ac5d8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000019d:[<0x10000000199/CERF v8>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000019d:[<0x10000000199/CERF v8>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.047 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.954+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000019a [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/ADSBitsy auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ac5d8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000019a:[<0x10000000199/ADSBitsy v2>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000019a:[<0x10000000199/ADSBitsy v2>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.047 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.954+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001a6 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Tifon auth v26 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ac5d8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001a6:[<0x10000000199/Tifon v26>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001a6:[<0x10000000199/Tifon v26>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.047 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.954+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001a7 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Victor auth v28 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ac5d9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001a7:[<0x10000000199/Victor v28>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001a7:[<0x10000000199/Victor v28>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.048 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.954+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000019f [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/GraphicsClient auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ac5d9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000019f:[<0x10000000199/GraphicsClient v12>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000019f:[<0x10000000199/GraphicsClient v12>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.048 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.954+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001a1 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad5b6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001a1:[<0x10000000199/HUW_WEBPANEL v16>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001a1:[<0x10000000199/HUW_WEBPANEL v16>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.048 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.954+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001a5 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Pangolin auth v24 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad5b6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001a5:[<0x10000000199/Pangolin v24>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001a5:[<0x10000000199/Pangolin v24>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.048 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.954+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001a8 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Yopy auth v30 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad5b6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001a8:[<0x10000000199/Yopy v30>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001a8:[<0x10000000199/Yopy v30>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.048 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.954+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001a0 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad5b7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001a0:[<0x10000000199/GraphicsMaster v14>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001a0:[<0x10000000199/GraphicsMaster v14>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.048 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.955+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001ab [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/serial_UART auth v36 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad5b7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001ab:[<0x10000000199/serial_UART v36>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001ab:[<0x10000000199/serial_UART v36>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.048 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.955+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000019e [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/FreeBird auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad5b7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000019e:[<0x10000000199/FreeBird v10>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000019e:[<0x10000000199/FreeBird v10>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.048 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.955+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001a3 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/LART auth v20 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad5b8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001a3:[<0x10000000199/LART v20>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001a3:[<0x10000000199/LART v20>,<0x10000000188/SA1100 v70>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.048 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.955+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000195 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/OMAP/DSS auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad56d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000195:[<0x10000000194/DSS v2>,<0x10000000188/OMAP v28>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000195:[<0x10000000194/DSS v2>,<0x10000000188/OMAP v188>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.048 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.955+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000196 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/OMAP/omap_pm auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad8f0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000196:[<0x10000000194/omap_pm v4>,<0x10000000188/OMAP v28>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000196:[<0x10000000194/omap_pm v4>,<0x10000000188/OMAP v188>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.048 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.955+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001b3 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SPEAr/overview.txt auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad8f0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001b3:[<0x100000001b2/overview.txt v2>,<0x10000000188/SPEAr v86>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001b3:[<0x100000001b2/overview.txt v2>,<0x10000000188/SPEAr v190>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.048 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.955+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000018b [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Atmel/README auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad8f0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000018b:[<0x1000000018a/README v2>,<0x10000000188/Atmel v6>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x1000000018b:[<0x1000000018a/README v2>,<0x10000000188/Atmel v192>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.049 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.955+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001d8 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/stih407-overview.txt auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad8f1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001d8:[<0x100000001d6/stih407-overview.txt v4>,<0x10000000188/sti v166>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001d8:[<0x100000001d6/stih407-overview.txt v4>,<0x10000000188/sti v194>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.049 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.955+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001da [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/stih416-overview.txt auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad8f1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001da:[<0x100000001d6/stih416-overview.txt v8>,<0x10000000188/sti v166>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001da:[<0x100000001d6/stih416-overview.txt v8>,<0x10000000188/sti v194>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.049 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.956+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001d9 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/stih415-overview.txt auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad8f1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001d9:[<0x100000001d6/stih415-overview.txt v6>,<0x10000000188/sti v166>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001d9:[<0x100000001d6/stih415-overview.txt v6>,<0x10000000188/sti v194>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.049 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.956+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001db [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/stih418-overview.txt auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad8f2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001db:[<0x100000001d6/stih418-overview.txt v10>,<0x10000000188/sti v166>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001db:[<0x100000001d6/stih418-overview.txt v10>,<0x10000000188/sti v194>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.049 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.956+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001d7 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/overview.txt auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad8f2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001d7:[<0x100000001d6/overview.txt v2>,<0x10000000188/sti v166>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001d7:[<0x100000001d6/overview.txt v2>,<0x10000000188/sti v194>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.049 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.956+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001bf [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt auth v22 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad8f2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001bf:[<0x100000001b4/USB-Host.txt v22>,<0x10000000188/Samsung-S3C24XX v110>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001bf:[<0x100000001b4/USB-Host.txt v22>,<0x10000000188/Samsung-S3C24XX v196>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.049 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.956+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001b8 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad8f3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001b8:[<0x100000001b4/H1940.txt v8>,<0x10000000188/Samsung-S3C24XX v110>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001b8:[<0x100000001b4/H1940.txt v8>,<0x10000000188/Samsung-S3C24XX v196>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.049 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.956+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001bb [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad8f3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001bb:[<0x100000001b4/S3C2412.txt v14>,<0x10000000188/Samsung-S3C24XX v110>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001bb:[<0x100000001b4/S3C2412.txt v14>,<0x10000000188/Samsung-S3C24XX v196>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.049 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.956+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001bc [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad8e4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001bc:[<0x100000001b4/S3C2413.txt v16>,<0x10000000188/Samsung-S3C24XX v110>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001bc:[<0x100000001b4/S3C2413.txt v16>,<0x10000000188/Samsung-S3C24XX v196>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.050 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.957+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001ba [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad8e4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001ba:[<0x100000001b4/Overview.txt v12>,<0x10000000188/Samsung-S3C24XX v110>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001ba:[<0x100000001b4/Overview.txt v12>,<0x10000000188/Samsung-S3C24XX v196>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.050 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.957+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001b7 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad8e4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001b7:[<0x100000001b4/GPIO.txt v6>,<0x10000000188/Samsung-S3C24XX v110>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001b7:[<0x100000001b4/GPIO.txt v6>,<0x10000000188/Samsung-S3C24XX v196>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.050 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.957+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001bd [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt auth v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad8e5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001bd:[<0x100000001b4/SMDK2440.txt v18>,<0x10000000188/Samsung-S3C24XX v110>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001bd:[<0x100000001b4/SMDK2440.txt v18>,<0x10000000188/Samsung-S3C24XX v196>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.050 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.957+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001b6 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad8e5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001b6:[<0x100000001b4/EB2410ITX.txt v4>,<0x10000000188/Samsung-S3C24XX v110>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001b6:[<0x100000001b4/EB2410ITX.txt v4>,<0x10000000188/Samsung-S3C24XX v196>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.050 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.957+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001b5 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad8e5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001b5:[<0x100000001b4/CPUfreq.txt v2>,<0x10000000188/Samsung-S3C24XX v110>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001b5:[<0x100000001b4/CPUfreq.txt v2>,<0x10000000188/Samsung-S3C24XX v196>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.050 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.957+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001b9 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad8e6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001b9:[<0x100000001b4/NAND.txt v10>,<0x10000000188/Samsung-S3C24XX v110>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001b9:[<0x100000001b4/NAND.txt v10>,<0x10000000188/Samsung-S3C24XX v196>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.050 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.957+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001be [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt auth v20 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad8e6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001be:[<0x100000001b4/Suspend.txt v20>,<0x10000000188/Samsung-S3C24XX v110>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001be:[<0x100000001b4/Suspend.txt v20>,<0x10000000188/Samsung-S3C24XX v196>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.050 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.957+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001de [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sunxi/clocks.txt auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad8e6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001de:[<0x100000001dc/clocks.txt v4>,<0x10000000188/sunxi v172>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001de:[<0x100000001dc/clocks.txt v4>,<0x10000000188/sunxi v198>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.050 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.957+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001dd [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sunxi/README auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad8e7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001dd:[<0x100000001dc/README v2>,<0x10000000188/sunxi v172>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001dd:[<0x100000001dc/README v2>,<0x10000000188/sunxi v198>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.050 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.958+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000192 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Marvell/README auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ad8e7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000192:[<0x10000000191/README v2>,<0x10000000188/Marvell v20>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000192:[<0x10000000191/README v2>,<0x10000000188/Marvell v200>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.050 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.958+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001c2 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung/Overview.txt auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae17c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001c2:[<0x100000001c0/Overview.txt v4>,<0x10000000188/Samsung v118>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001c2:[<0x100000001c0/Overview.txt v4>,<0x10000000188/Samsung v202>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.051 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.958+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001c1 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung/GPIO.txt auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae17c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001c1:[<0x100000001c0/GPIO.txt v2>,<0x10000000188/Samsung v118>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001c1:[<0x100000001c0/GPIO.txt v2>,<0x10000000188/Samsung v202>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.051 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.958+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001c3 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae17cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001c3:[<0x100000001c0/clksrc-change-registers.awk v6>,<0x10000000188/Samsung v118>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001c3:[<0x100000001c0/clksrc-change-registers.awk v6>,<0x10000000188/Samsung v202>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.051 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.958+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001c6 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/VFP/release-notes.txt auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae17d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001c6:[<0x100000001c5/release-notes.txt v2>,<0x10000000188/VFP v124>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001c6:[<0x100000001c5/release-notes.txt v2>,<0x10000000188/VFP v204>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.051 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.958+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001ce [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/msm/gpiomux.txt auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae17d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001ce:[<0x100000001cd/gpiomux.txt v2>,<0x10000000188/msm v140>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001ce:[<0x100000001cd/gpiomux.txt v2>,<0x10000000188/msm v206>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.051 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.959+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001b1 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae17db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001b1:[<0x100000001ac/zboot-rom-sdhi.txt v10>,<0x10000000188/SH-Mobile v82>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001b1:[<0x100000001ac/zboot-rom-sdhi.txt v10>,<0x10000000188/SH-Mobile v208>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.051 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.959+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001b0 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae17e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001b0:[<0x100000001ac/zboot-rom-mmcif.txt v8>,<0x10000000188/SH-Mobile v82>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001b0:[<0x100000001ac/zboot-rom-mmcif.txt v8>,<0x10000000188/SH-Mobile v208>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.051 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.959+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001ae [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae17e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001ae:[<0x100000001ac/Makefile v4>,<0x10000000188/SH-Mobile v82>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001ae:[<0x100000001ac/Makefile v4>,<0x10000000188/SH-Mobile v208>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.051 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.959+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001ad [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae17ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001ad:[<0x100000001ac/.gitignore v2>,<0x10000000188/SH-Mobile v82>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001ad:[<0x100000001ac/.gitignore v2>,<0x10000000188/SH-Mobile v208>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.051 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.959+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001af [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae17f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001af:[<0x100000001ac/vrl4.c v6>,<0x10000000188/SH-Mobile v82>,<0x100000007db/arm v340>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x100000001af:[<0x100000001ac/vrl4.c v6>,<0x10000000188/SH-Mobile v208>,<0x100000007db/arm v1918>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.051 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.966+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000175 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/apei/output_format.txt auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae101180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000175:[<0x10000000173/output_format.txt v4>,<0x10000000172/apei v6>,<0x100000007db/acpi v260>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000175:[<0x10000000173/output_format.txt v4>,<0x10000000172/apei v6>,<0x100000007db/acpi v1838>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.052 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:42:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:42:36.966+0000 7f868fec9700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000174 [2,head] /volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/apei/einj.txt auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25391=0-4194304@1} caps={25391=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=25391 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5636ae101700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000174:[<0x10000000173/einj.txt v2>,<0x10000000172/apei v6>,<0x100000007db/acpi v260>,<0x100000007da/Documentation v317>,<0x100000007d9/linux-4.0.5 v11>,<0x100000005e3/untar_tar v29>,<0x100000005e2/tmp v30>,<0x100000001fb/client.0 v18>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v35>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v45>,<0x1/volumes v43>]//[3]","memoryvalue":"(4)0x10000000174:[<0x10000000173/einj.txt v2>,<0x10000000172/apei v6>,<0x100000007db/acpi v1838>,<0x100000007da/Documentation v550>,<0x100000007d9/linux-4.0.5 v17>,<0x100000005e3/untar_tar v33>,<0x100000005e2/tmp v34>,<0x100000001fb/client.0 v20>,<0x100000001fa/2a614eef-8518-4aff-a815-c846baf08bfb v32>,<0x10000000001/sv_1 v57>,<0x10000000000/qa v33>,<0x1/volumes v23>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-10T03:42:37.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:37 smithi045 ceph-mon[42520]: pgmap v355: 129 pgs: 129 active+clean; 82 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 6.8 MiB/s wr, 36 op/s 2024-05-10T03:42:37.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:37 smithi045 ceph-mon[42520]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:42:37.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:37 smithi045 ceph-mon[42520]: scrub queued for path: / 2024-05-10T03:42:37.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:37 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:37.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:37 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:42:37.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:37 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:37.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:37 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:42:37.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:37 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:37.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:37 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:42:37.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:37 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:42:37.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:37 smithi106 ceph-mon[46996]: pgmap v355: 129 pgs: 129 active+clean; 82 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 6.8 MiB/s wr, 36 op/s 2024-05-10T03:42:37.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:37 smithi106 ceph-mon[46996]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:42:37.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:37 smithi106 ceph-mon[46996]: scrub queued for path: / 2024-05-10T03:42:37.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:37 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:37.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:37 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:42:37.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:37 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:37.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:37 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:42:37.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:37 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:37.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:37 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:42:37.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:37 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:42:37.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:37 smithi154 ceph-mon[46565]: pgmap v355: 129 pgs: 129 active+clean; 82 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 6.8 MiB/s wr, 36 op/s 2024-05-10T03:42:37.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:37 smithi154 ceph-mon[46565]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:42:37.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:37 smithi154 ceph-mon[46565]: scrub queued for path: / 2024-05-10T03:42:37.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:37 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:37.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:37 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:42:37.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:37 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:37.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:37 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:42:37.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:37 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:37.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:37 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:42:37.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:37 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:42:38.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:42:38.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:42:38.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:42:38.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:42:38.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:42:38.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001c4 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Setup) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001cf (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001d4 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/pxa) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.404 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001e1 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/uefi.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.404 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000197 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Porting) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.404 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000189 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/00-INDEX) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.404 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000199 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.404 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000193 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Netwinder) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.404 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000194 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/OMAP) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.404 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001ca (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/kernel_user_helpers.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.404 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001b2 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SPEAr) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.404 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000018a (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Atmel) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.404 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000190 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Makefile) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.404 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001e0 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/tcm.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.404 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001d6 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.404 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001e2 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/vlocks.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.404 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001c7 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.405 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001c8 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/firmware.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.405 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001b4 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.405 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000018e (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/IXP4xx) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.405 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001dc (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sunxi) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.405 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000018f (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Interrupts) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.405 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000018d (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/CCN.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.405 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000191 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Marvell) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.405 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001c0 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.405 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000198 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/README) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.405 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001c5 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/VFP) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.405 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001cd (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/msm) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.405 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001cc (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/memory.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.405 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001ac (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.405 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001c9 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/kernel_mode_neon.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.405 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001cb (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/mem_alignment) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.406 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000018c (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Booting) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.406 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001df (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/swp_emulation) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.406 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.406 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:42:38.406 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.406 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000016e (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/delay-accounting.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.406 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000016f (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/getdelays.c) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.406 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000016c (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/Makefile) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.406 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000171 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/taskstats.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.406 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000016d (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/cgroupstats.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.406 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000170 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/taskstats-struct.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.406 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000016b (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/.gitignore) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.407 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:42:38.407 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.407 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000017a (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/initrd_table_override.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.407 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000176 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/debug.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.407 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000177 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/dsdt-override.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.407 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000017f (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/video_extension.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.407 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000017d (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/namespace.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.407 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000017b (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/method-customizing.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.407 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000173 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/apei) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.407 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000017c (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/method-tracing.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.407 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000179 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/gpio-properties.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.407 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000017e (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/scan_handlers.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.407 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000183 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/status.sh) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.407 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000178 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/enumeration.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.407 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000182 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/autoload.sh) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.408 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000184 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/todo.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.408 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000181 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/aoe.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.408 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000185 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/udev-install.sh) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.408 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000186 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/udev.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.408 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000013b (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/800x600.S) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.408 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000013e (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/edid.S) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.408 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000013d (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/Makefile) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.408 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000013f (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/hex) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.408 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000136 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1024x768.S) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.408 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000013a (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1920x1080.S) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.408 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000013c (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/HOWTO.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.408 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000137 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1280x1024.S) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.408 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000138 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1600x1200.S) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.408 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000139 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1680x1050.S) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.409 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:42:38.409 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.409 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.409 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000015e (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rcuref.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.409 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000152 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/NMI-RCU.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.409 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000161 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/trace.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.409 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000158 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/lockdep-splat.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.409 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000159 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/lockdep.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.409 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000151 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/00-INDEX) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.409 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000160 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/torture.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.409 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000015c (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rcubarrier.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.409 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000153 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/RTFP.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.409 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000015b (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rcu_dereference.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.410 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000157 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/listRCU.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.410 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000154 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/UP.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.410 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000015f (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/stallwarn.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.410 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000156 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/checklist.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.410 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000162 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/whatisRCU.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.410 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000155 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/arrayRCU.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.410 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000015d (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rculist_nulls.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.410 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000015a (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rcu.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.410 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000014a (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.410 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000014b (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.410 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000014e (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/pci.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.410 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000149 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/00-INDEX) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.411 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000014d (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/pci-iov-howto.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.411 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000014c (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/pci-error-recovery.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.411 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000014f (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/pcieaer-howto.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.411 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:42:38.411 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.411 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:42:38.411 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:42:38.411 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.411 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.411 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:42:38.411 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.411 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:42:38.411 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.411 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001d0 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/NOTES) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.412 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001d2 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/README.FPE) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.412 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001d3 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/TODO) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.412 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001d5 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/pxa/mfp.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.412 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001d1 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/README) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.412 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000019b (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Assabet) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.412 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001a9 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/empeg) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.412 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001a4 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/PLEB) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.412 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001aa (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/nanoEngine) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.412 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001a2 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Itsy) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.412 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000019c (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Brutus) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.412 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000019d (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/CERF) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.412 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000019a (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/ADSBitsy) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.412 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001a6 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Tifon) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.412 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001a7 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Victor) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.412 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000019f (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/GraphicsClient) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.413 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001a1 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.413 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001a5 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Pangolin) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.413 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001a8 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Yopy) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.413 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001a0 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.413 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001ab (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/serial_UART) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.413 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000019e (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/FreeBird) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.413 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001a3 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/LART) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.413 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000195 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/OMAP/DSS) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.413 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000196 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/OMAP/omap_pm) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.413 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001b3 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SPEAr/overview.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.413 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x1000000018b (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Atmel/README) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.413 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001d8 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/stih407-overview.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.413 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001da (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/stih416-overview.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.413 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001d9 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/stih415-overview.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.413 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001db (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/stih418-overview.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.414 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001d7 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/overview.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.414 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001bf (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.414 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001b8 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.414 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001bb (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.414 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001bc (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.414 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001ba (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.414 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001b7 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.414 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001bd (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.414 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001b6 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.414 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001b5 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.414 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001b9 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.414 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001be (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.414 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001de (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sunxi/clocks.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.414 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001dd (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sunxi/README) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.415 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000192 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Marvell/README) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.415 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001c2 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung/Overview.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.415 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001c1 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung/GPIO.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.415 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001c3 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.415 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001c6 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/VFP/release-notes.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.415 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001ce (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/msm/gpiomux.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.415 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001b1 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.415 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001b0 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.415 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001ae (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/Makefile) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.415 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001ad (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.415 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x100000001af (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.415 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000175 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/apei/output_format.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.415 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: Scrub error on inode 0x10000000174 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/apei/einj.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.415 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:42:38.415 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.416 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:42:38.416 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.416 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:42:38.416 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.416 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:42:38.416 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.416 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:42:38.416 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.416 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: active paths [/] 2024-05-10T03:42:38.416 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:38 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:42:38.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:42:38.477 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.477 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:42:38.477 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.477 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:42:38.477 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:42:38.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001c4 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Setup) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001cf (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001d4 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/pxa) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001e1 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/uefi.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000197 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Porting) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000189 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/00-INDEX) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000199 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000193 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Netwinder) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000194 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/OMAP) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001ca (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/kernel_user_helpers.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.479 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001b2 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SPEAr) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.479 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000018a (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Atmel) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.479 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000190 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Makefile) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.479 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001e0 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/tcm.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.479 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001d6 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.479 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001e2 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/vlocks.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.479 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001c7 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.479 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001c8 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/firmware.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.479 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001b4 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.479 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000018e (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/IXP4xx) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.479 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001dc (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sunxi) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.481 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000018f (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Interrupts) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.482 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000018d (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/CCN.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.482 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000191 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Marvell) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.482 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001c0 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.482 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000198 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/README) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.482 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001c5 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/VFP) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.482 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001cd (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/msm) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.482 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001cc (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/memory.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.483 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001ac (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.483 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001c9 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/kernel_mode_neon.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.483 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001cb (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/mem_alignment) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.483 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000018c (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Booting) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.483 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001df (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/swp_emulation) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.483 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.483 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:42:38.483 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.483 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000016e (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/delay-accounting.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.483 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000016f (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/getdelays.c) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.483 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000016c (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/Makefile) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.483 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000171 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/taskstats.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.483 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000016d (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/cgroupstats.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.484 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000170 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/taskstats-struct.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.484 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000016b (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/.gitignore) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.484 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:42:38.484 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.484 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000017a (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/initrd_table_override.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.484 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000176 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/debug.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.484 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000177 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/dsdt-override.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.484 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000017f (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/video_extension.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.484 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000017d (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/namespace.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.484 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000017b (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/method-customizing.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.484 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000173 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/apei) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.484 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000017c (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/method-tracing.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.484 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000179 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/gpio-properties.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.484 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000017e (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/scan_handlers.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.484 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000183 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/status.sh) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.485 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000178 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/enumeration.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.485 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000182 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/autoload.sh) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.485 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000184 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/todo.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.485 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000181 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/aoe.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.485 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000185 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/udev-install.sh) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.485 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000186 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/udev.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.485 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000013b (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/800x600.S) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.486 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000013e (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/edid.S) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.486 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000013d (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/Makefile) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.486 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000013f (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/hex) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.486 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000136 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1024x768.S) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.486 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000013a (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1920x1080.S) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.486 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000013c (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/HOWTO.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.486 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000137 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1280x1024.S) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.486 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000138 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1600x1200.S) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.486 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000139 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1680x1050.S) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.486 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:42:38.486 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.486 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.487 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000015e (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rcuref.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.487 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000152 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/NMI-RCU.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.487 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000161 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/trace.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.487 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000158 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/lockdep-splat.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.487 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000159 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/lockdep.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.487 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000151 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/00-INDEX) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.487 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000160 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/torture.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.488 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000015c (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rcubarrier.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.488 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000153 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/RTFP.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.488 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000015b (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rcu_dereference.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.488 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000157 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/listRCU.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.488 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000154 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/UP.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.488 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000015f (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/stallwarn.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.488 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000156 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/checklist.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.488 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000162 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/whatisRCU.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.488 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000155 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/arrayRCU.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.489 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000015d (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rculist_nulls.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.489 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000015a (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rcu.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.489 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000014a (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.489 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000014b (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.489 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000014e (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/pci.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.489 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000149 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/00-INDEX) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.489 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000014d (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/pci-iov-howto.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.489 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000014c (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/pci-error-recovery.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.489 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000014f (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/pcieaer-howto.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.489 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:42:38.490 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.490 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:42:38.490 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:42:38.490 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.490 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.490 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:42:38.490 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.490 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:42:38.490 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.490 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001d0 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/NOTES) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.490 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001d2 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/README.FPE) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.490 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001d3 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/TODO) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.490 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001d5 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/pxa/mfp.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001d1 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/README) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000019b (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Assabet) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001a9 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/empeg) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001a4 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/PLEB) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001aa (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/nanoEngine) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001a2 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Itsy) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000019c (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Brutus) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000019d (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/CERF) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000019a (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/ADSBitsy) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001a6 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Tifon) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001a7 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Victor) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000019f (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/GraphicsClient) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001a1 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001a5 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Pangolin) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.491 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001a8 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Yopy) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.492 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001a0 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.492 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001ab (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/serial_UART) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.492 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000019e (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/FreeBird) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.492 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001a3 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/LART) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.492 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000195 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/OMAP/DSS) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.492 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000196 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/OMAP/omap_pm) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.492 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001b3 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SPEAr/overview.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.492 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x1000000018b (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Atmel/README) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.493 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001d8 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/stih407-overview.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.493 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001da (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/stih416-overview.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.493 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001d9 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/stih415-overview.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.493 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001db (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/stih418-overview.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.493 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001d7 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/overview.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.493 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001bf (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.494 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001b8 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.494 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001bb (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.494 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001bc (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.495 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001ba (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.495 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001b7 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.495 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001bd (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.496 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001b6 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.496 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001b5 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.496 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001b9 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.496 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001be (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.496 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001de (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sunxi/clocks.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.496 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001dd (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sunxi/README) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.496 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000192 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Marvell/README) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.496 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001c2 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung/Overview.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.496 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001c1 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung/GPIO.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001c3 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001c6 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/VFP/release-notes.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001ce (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/msm/gpiomux.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001b1 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001b0 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001ae (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/Makefile) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001ad (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x100000001af (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000175 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/apei/output_format.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: Scrub error on inode 0x10000000174 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/apei/einj.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:42:38.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:42:38.497 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.498 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:42:38.498 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.500 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:42:38.500 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.500 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:42:38.500 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.500 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: active paths [/] 2024-05-10T03:42:38.500 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:38 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.537 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:42:38.537 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:42:38.537 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.537 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:42:38.537 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.537 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:42:38.537 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.537 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:42:38.537 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.537 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001c4 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Setup) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.537 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001cf (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.537 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001d4 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/pxa) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.537 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001e1 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/uefi.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.538 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000197 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Porting) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.538 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000189 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/00-INDEX) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.538 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000199 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.538 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000193 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Netwinder) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.538 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000194 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/OMAP) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.538 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001ca (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/kernel_user_helpers.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.538 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001b2 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SPEAr) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.538 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000018a (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Atmel) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.538 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000190 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Makefile) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.538 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001e0 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/tcm.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.538 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001d6 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.538 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001e2 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/vlocks.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.539 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001c7 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.539 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001c8 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/firmware.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.539 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001b4 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.539 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000018e (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/IXP4xx) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.539 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001dc (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sunxi) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.539 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000018f (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Interrupts) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.539 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000018d (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/CCN.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.539 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000191 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Marvell) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.539 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001c0 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.539 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000198 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/README) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.539 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001c5 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/VFP) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.540 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001cd (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/msm) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.540 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001cc (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/memory.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.540 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001ac (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.540 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001c9 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/kernel_mode_neon.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.540 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001cb (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/mem_alignment) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.540 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000018c (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Booting) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.540 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001df (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/swp_emulation) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.540 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.540 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:42:38.540 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.541 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000016e (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/delay-accounting.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.541 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000016f (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/getdelays.c) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.541 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000016c (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/Makefile) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.541 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000171 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/taskstats.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.541 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000016d (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/cgroupstats.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.541 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000170 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/taskstats-struct.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.541 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000016b (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/.gitignore) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.541 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:42:38.541 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.541 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000017a (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/initrd_table_override.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.541 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000176 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/debug.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.541 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000177 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/dsdt-override.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.541 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000017f (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/video_extension.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.541 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000017d (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/namespace.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.542 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000017b (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/method-customizing.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.542 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000173 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/apei) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.542 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000017c (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/method-tracing.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.542 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000179 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/gpio-properties.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.542 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000017e (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/scan_handlers.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.542 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000183 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/status.sh) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.542 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000178 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/enumeration.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.542 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000182 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/autoload.sh) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.542 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000184 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/todo.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.542 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000181 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/aoe.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.542 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000185 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/udev-install.sh) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.542 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000186 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/udev.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.542 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000013b (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/800x600.S) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.542 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000013e (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/edid.S) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.543 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000013d (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/Makefile) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.543 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000013f (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/hex) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.543 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000136 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1024x768.S) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.543 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000013a (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1920x1080.S) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.543 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000013c (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/HOWTO.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.543 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000137 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1280x1024.S) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.543 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000138 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1600x1200.S) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.543 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000139 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1680x1050.S) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.543 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:42:38.543 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.543 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.543 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000015e (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rcuref.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.543 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000152 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/NMI-RCU.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.543 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000161 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/trace.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.544 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000158 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/lockdep-splat.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.544 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000159 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/lockdep.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.544 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000151 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/00-INDEX) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.544 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000160 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/torture.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.544 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000015c (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rcubarrier.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.544 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000153 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/RTFP.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.544 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000015b (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rcu_dereference.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.544 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000157 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/listRCU.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.544 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000154 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/UP.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.544 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000015f (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/stallwarn.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.544 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000156 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/checklist.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.544 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000162 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/whatisRCU.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.544 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000155 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/arrayRCU.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.544 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000015d (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rculist_nulls.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.545 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000015a (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rcu.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.545 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000014a (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.545 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000014b (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.545 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000014e (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/pci.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.545 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000149 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/00-INDEX) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.545 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000014d (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/pci-iov-howto.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.545 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000014c (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/pci-error-recovery.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.545 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000014f (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/pcieaer-howto.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.545 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:42:38.545 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.545 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:42:38.545 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:42:38.545 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.545 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.546 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:42:38.546 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.546 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:42:38.546 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.546 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001d0 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/NOTES) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.546 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001d2 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/README.FPE) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.546 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001d3 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/TODO) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.546 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001d5 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/pxa/mfp.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.546 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001d1 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/README) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.546 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000019b (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Assabet) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.546 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001a9 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/empeg) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.547 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001a4 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/PLEB) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.547 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001aa (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/nanoEngine) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.547 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001a2 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Itsy) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.547 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000019c (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Brutus) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.547 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000019d (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/CERF) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.547 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000019a (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/ADSBitsy) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.547 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001a6 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Tifon) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.547 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001a7 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Victor) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.547 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000019f (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/GraphicsClient) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.547 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001a1 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.547 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001a5 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Pangolin) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.547 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001a8 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Yopy) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.547 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001a0 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.547 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001ab (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/serial_UART) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.548 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000019e (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/FreeBird) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.548 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001a3 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/LART) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.548 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000195 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/OMAP/DSS) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.548 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000196 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/OMAP/omap_pm) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.548 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001b3 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SPEAr/overview.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.548 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x1000000018b (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Atmel/README) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.548 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001d8 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/stih407-overview.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.548 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001da (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/stih416-overview.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.548 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001d9 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/stih415-overview.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.548 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001db (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/stih418-overview.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.548 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001d7 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/overview.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.548 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001bf (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.548 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001b8 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.548 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001bb (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001bc (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001ba (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001b7 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001bd (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001b6 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001b5 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001b9 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001be (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001de (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sunxi/clocks.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001dd (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sunxi/README) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000192 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Marvell/README) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001c2 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung/Overview.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001c1 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung/GPIO.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001c3 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001c6 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/VFP/release-notes.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001ce (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/msm/gpiomux.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001b1 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001b0 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001ae (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/Makefile) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001ad (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x100000001af (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000175 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/apei/output_format.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: Scrub error on inode 0x10000000174 (/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/apei/einj.txt) see mds.i log and `damage ls` output for details 2024-05-10T03:42:38.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:42:38.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:42:38.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:42:38.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:42:38.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:42:38.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:38.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: active paths [/] 2024-05-10T03:42:38.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:38 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:39.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:39 smithi106 ceph-mon[46996]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:39.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:39 smithi106 ceph-mon[46996]: pgmap v356: 129 pgs: 129 active+clean; 89 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 7.0 MiB/s wr, 112 op/s 2024-05-10T03:42:39.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:39 smithi154 ceph-mon[46565]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:39.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:39 smithi154 ceph-mon[46565]: pgmap v356: 129 pgs: 129 active+clean; 89 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 7.0 MiB/s wr, 112 op/s 2024-05-10T03:42:39.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:39 smithi045 ceph-mon[42520]: scrub summary: idle+waiting paths [/] 2024-05-10T03:42:39.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:39 smithi045 ceph-mon[42520]: pgmap v356: 129 pgs: 129 active+clean; 89 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 7.0 MiB/s wr, 112 op/s 2024-05-10T03:42:40.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:40 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:42:40.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:40 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:42:40.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:40 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:42:40.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:40 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:42:40.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:40 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:42:40.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:40 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:42:40.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:40 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:42:40.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:40 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:42:40.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:40 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:42:40.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:40 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:42:40.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:40 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:42:40.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:40 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:42:41.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:41 smithi106 ceph-mon[46996]: pgmap v357: 129 pgs: 129 active+clean; 89 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 3.4 MiB/s wr, 166 op/s 2024-05-10T03:42:41.473 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:41 smithi154 ceph-mon[46565]: pgmap v357: 129 pgs: 129 active+clean; 89 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 3.4 MiB/s wr, 166 op/s 2024-05-10T03:42:41.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:41 smithi045 ceph-mon[42520]: pgmap v357: 129 pgs: 129 active+clean; 89 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 3.4 MiB/s wr, 166 op/s 2024-05-10T03:42:42.283 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:41 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mon-a[42496]: 2024-05-10T03:42:41.936+0000 7f4dd29c3700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-10T03:42:42.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:42 smithi045 ceph-mon[42520]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-10T03:42:42.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:42 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] up:active 2024-05-10T03:42:42.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:42 smithi045 ceph-mon[42520]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:42:42.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:42 smithi106 ceph-mon[46996]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-10T03:42:42.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:42 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] up:active 2024-05-10T03:42:42.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:42 smithi106 ceph-mon[46996]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:42:42.473 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:42 smithi154 ceph-mon[46565]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-10T03:42:42.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:42 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] up:active 2024-05-10T03:42:42.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:42 smithi154 ceph-mon[46565]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:42:43.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:43 smithi106 ceph-mon[46996]: pgmap v358: 129 pgs: 129 active+clean; 90 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 827 KiB/s wr, 179 op/s 2024-05-10T03:42:43.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:43 smithi154 ceph-mon[46565]: pgmap v358: 129 pgs: 129 active+clean; 90 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 827 KiB/s wr, 179 op/s 2024-05-10T03:42:43.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:43 smithi045 ceph-mon[42520]: pgmap v358: 129 pgs: 129 active+clean; 90 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 827 KiB/s wr, 179 op/s 2024-05-10T03:42:45.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:45 smithi106 ceph-mon[46996]: pgmap v359: 129 pgs: 129 active+clean; 90 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 877 KiB/s wr, 201 op/s 2024-05-10T03:42:45.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:45 smithi154 ceph-mon[46565]: pgmap v359: 129 pgs: 129 active+clean; 90 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 877 KiB/s wr, 201 op/s 2024-05-10T03:42:45.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:45 smithi045 ceph-mon[42520]: pgmap v359: 129 pgs: 129 active+clean; 90 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 877 KiB/s wr, 201 op/s 2024-05-10T03:42:47.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:47 smithi106 ceph-mon[46996]: pgmap v360: 129 pgs: 129 active+clean; 95 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 213 op/s 2024-05-10T03:42:47.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:47 smithi154 ceph-mon[46565]: pgmap v360: 129 pgs: 129 active+clean; 95 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 213 op/s 2024-05-10T03:42:47.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:47 smithi045 ceph-mon[42520]: pgmap v360: 129 pgs: 129 active+clean; 95 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 213 op/s 2024-05-10T03:42:48.567 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.562+0000 7f4cd790d700 1 -- 172.21.15.45:0/3621708487 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd0069300 msgr2=0x7f4cd0104740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:48.567 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.562+0000 7f4cd790d700 1 --2- 172.21.15.45:0/3621708487 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd0069300 0x7f4cd0104740 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc009990 tx=0x7f4ccc009ca0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.567 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.562+0000 7f4cd790d700 1 -- 172.21.15.45:0/3621708487 shutdown_connections 2024-05-10T03:42:48.567 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.562+0000 7f4cd790d700 1 --2- 172.21.15.45:0/3621708487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cd0107880 0x7f4cd0109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.567 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.562+0000 7f4cd790d700 1 --2- 172.21.15.45:0/3621708487 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd0069300 0x7f4cd0104740 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.568 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.562+0000 7f4cd790d700 1 --2- 172.21.15.45:0/3621708487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4cd0104d10 0x7f4cd01071f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.568 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.562+0000 7f4cd790d700 1 -- 172.21.15.45:0/3621708487 >> 172.21.15.45:0/3621708487 conn(0x7f4cd00fc0f0 msgr2=0x7f4cd00fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:48.568 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.562+0000 7f4cd790d700 1 -- 172.21.15.45:0/3621708487 shutdown_connections 2024-05-10T03:42:48.568 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.563+0000 7f4cd790d700 1 -- 172.21.15.45:0/3621708487 wait complete. 2024-05-10T03:42:48.568 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.563+0000 7f4cd790d700 1 Processor -- start 2024-05-10T03:42:48.568 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.563+0000 7f4cd790d700 1 -- start start 2024-05-10T03:42:48.568 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.563+0000 7f4cd790d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd0069300 0x7f4cd0101fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:48.568 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.564+0000 7f4cd790d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cd0104d10 0x7f4cd0100640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:48.568 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.564+0000 7f4cd790d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4cd0107880 0x7f4cd0100b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:48.568 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.564+0000 7f4cd790d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd01011e0 con 0x7f4cd0069300 2024-05-10T03:42:48.568 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.564+0000 7f4cd790d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd0101350 con 0x7f4cd0107880 2024-05-10T03:42:48.568 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.564+0000 7f4cd790d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd0101510 con 0x7f4cd0104d10 2024-05-10T03:42:48.568 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.564+0000 7f4cd56a9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd0069300 0x7f4cd0101fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:48.569 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.564+0000 7f4cd56a9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd0069300 0x7f4cd0101fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49612/0 (socket says 172.21.15.45:49612) 2024-05-10T03:42:48.569 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.564+0000 7f4cd56a9700 1 -- 172.21.15.45:0/4161802566 learned_addr learned my addr 172.21.15.45:0/4161802566 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:48.569 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.564+0000 7f4cd4ea8700 1 --2- 172.21.15.45:0/4161802566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cd0104d10 0x7f4cd0100640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:48.569 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.564+0000 7f4cd5eaa700 1 --2- 172.21.15.45:0/4161802566 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4cd0107880 0x7f4cd0100b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:48.569 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.564+0000 7f4cd56a9700 1 -- 172.21.15.45:0/4161802566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cd0104d10 msgr2=0x7f4cd0100640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:48.569 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.564+0000 7f4cd56a9700 1 --2- 172.21.15.45:0/4161802566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cd0104d10 0x7f4cd0100640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.569 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.564+0000 7f4cd56a9700 1 -- 172.21.15.45:0/4161802566 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4cd0107880 msgr2=0x7f4cd0100b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:48.569 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.564+0000 7f4cd56a9700 1 --2- 172.21.15.45:0/4161802566 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4cd0107880 0x7f4cd0100b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.569 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.564+0000 7f4cd56a9700 1 -- 172.21.15.45:0/4161802566 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ccc0095f0 con 0x7f4cd0069300 2024-05-10T03:42:48.569 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.564+0000 7f4cd5eaa700 1 --2- 172.21.15.45:0/4161802566 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4cd0107880 0x7f4cd0100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:42:48.569 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.564+0000 7f4cd56a9700 1 --2- 172.21.15.45:0/4161802566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd0069300 0x7f4cd0101fa0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc0098e0 tx=0x7f4ccc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:48.569 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.564+0000 7f4cc67fc700 1 -- 172.21.15.45:0/4161802566 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc01d070 con 0x7f4cd0069300 2024-05-10T03:42:48.569 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.565+0000 7f4cc67fc700 1 -- 172.21.15.45:0/4161802566 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4ccc00fe60 con 0x7f4cd0069300 2024-05-10T03:42:48.569 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.565+0000 7f4cd790d700 1 -- 172.21.15.45:0/4161802566 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd01a2290 con 0x7f4cd0069300 2024-05-10T03:42:48.570 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.565+0000 7f4cc67fc700 1 -- 172.21.15.45:0/4161802566 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc0173f0 con 0x7f4cd0069300 2024-05-10T03:42:48.570 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.565+0000 7f4cd790d700 1 -- 172.21.15.45:0/4161802566 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cd01a26b0 con 0x7f4cd0069300 2024-05-10T03:42:48.572 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.567+0000 7f4cc67fc700 1 -- 172.21.15.45:0/4161802566 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4ccc021410 con 0x7f4cd0069300 2024-05-10T03:42:48.572 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.568+0000 7f4cc67fc700 1 --2- 172.21.15.45:0/4161802566 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4cbc0a1120 0x7f4cbc0a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:48.572 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.568+0000 7f4cd4ea8700 1 --2- 172.21.15.45:0/4161802566 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4cbc0a1120 0x7f4cbc0a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:48.572 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.568+0000 7f4cc67fc700 1 -- 172.21.15.45:0/4161802566 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f4ccc0ce0c0 con 0x7f4cd0069300 2024-05-10T03:42:48.572 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.568+0000 7f4cd4ea8700 1 --2- 172.21.15.45:0/4161802566 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4cbc0a1120 0x7f4cbc0a3630 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0101940 tx=0x7f4cc0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:48.572 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.569+0000 7f4ce7c51b80 1 Processor -- start 2024-05-10T03:42:48.572 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.569+0000 7f4ce7c51b80 1 -- start start 2024-05-10T03:42:48.572 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.569+0000 7f4ce7c51b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbcbf95180 0x55bbcbf955b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.569+0000 7f4ce7c51b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbcbf96050 0x55bbcbf96460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.569+0000 7f4ce7c51b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbf969a0 0x55bbcbf9d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.569+0000 7f4ce7c51b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbcbebc0f0 con 0x55bbcbf969a0 2024-05-10T03:42:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.569+0000 7f4ce7c51b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbcbeb9ab0 con 0x55bbcbf96050 2024-05-10T03:42:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.569+0000 7f4ce7c51b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbcbeb53a0 con 0x55bbcbf95180 2024-05-10T03:42:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.569+0000 7f4cd56a9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbcbf95180 0x55bbcbf955b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.569+0000 7f4cd56a9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbcbf95180 0x55bbcbf955b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:56868/0 (socket says 172.21.15.45:56868) 2024-05-10T03:42:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.569+0000 7f4cd56a9700 1 -- 172.21.15.45:0/3476542726 learned_addr learned my addr 172.21.15.45:0/3476542726 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.569+0000 7f4cd5eaa700 1 --2- 172.21.15.45:0/3476542726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbf969a0 0x55bbcbf9d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.569+0000 7f4cd4ea8700 1 --2- 172.21.15.45:0/3476542726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbcbf96050 0x55bbcbf96460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.569+0000 7f4cd56a9700 1 -- 172.21.15.45:0/3476542726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbcbf96050 msgr2=0x55bbcbf96460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.569+0000 7f4cd56a9700 1 --2- 172.21.15.45:0/3476542726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbcbf96050 0x55bbcbf96460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.569+0000 7f4cd56a9700 1 -- 172.21.15.45:0/3476542726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbf969a0 msgr2=0x55bbcbf9d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:48.573 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.569+0000 7f4cd56a9700 1 --2- 172.21.15.45:0/3476542726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbf969a0 0x55bbcbf9d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.569+0000 7f4cd56a9700 1 -- 172.21.15.45:0/3476542726 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbcbd36350 con 0x55bbcbf95180 2024-05-10T03:42:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.569+0000 7f4cd4ea8700 1 --2- 172.21.15.45:0/3476542726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbcbf96050 0x55bbcbf96460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:42:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.570+0000 7f4cd56a9700 1 --2- 172.21.15.45:0/3476542726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbcbf95180 0x55bbcbf955b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00b2e0 tx=0x7f4ccc00b780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91202e276aedee53 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.570+0000 7f4cbb7fe700 1 -- 172.21.15.45:0/3476542726 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc09ab60 con 0x55bbcbf95180 2024-05-10T03:42:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.570+0000 7f4cbb7fe700 1 -- 172.21.15.45:0/3476542726 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4ccc09b900 con 0x55bbcbf95180 2024-05-10T03:42:48.574 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.570+0000 7f4cbb7fe700 1 -- 172.21.15.45:0/3476542726 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc0a1320 con 0x55bbcbf95180 2024-05-10T03:42:48.578 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.571+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/3476542726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbcbf95180 msgr2=0x55bbcbf955b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:48.578 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.571+0000 7f4ce7c51b80 1 --2- 172.21.15.45:0/3476542726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbcbf95180 0x55bbcbf955b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00b2e0 tx=0x7f4ccc00b780 comp rx=0 tx=0).stop 2024-05-10T03:42:48.578 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.571+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/3476542726 shutdown_connections 2024-05-10T03:42:48.578 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.571+0000 7f4ce7c51b80 1 --2- 172.21.15.45:0/3476542726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbcbf95180 0x55bbcbf955b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.579 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.571+0000 7f4ce7c51b80 1 --2- 172.21.15.45:0/3476542726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbf969a0 0x55bbcbf9d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.579 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.571+0000 7f4ce7c51b80 1 --2- 172.21.15.45:0/3476542726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbcbf96050 0x55bbcbf96460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.579 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.571+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/3476542726 >> 172.21.15.45:0/3476542726 conn(0x55bbcbef7a00 msgr2=0x55bbcbf8fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:48.579 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.571+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/3476542726 shutdown_connections 2024-05-10T03:42:48.579 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.571+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/3476542726 wait complete. 2024-05-10T03:42:48.579 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.571+0000 7f4ce7c51b80 1 -- start start 2024-05-10T03:42:48.579 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.571+0000 7f4ce7c51b80 1 Processor -- start 2024-05-10T03:42:48.579 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.572+0000 7f4ce7c51b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbcbf95180 0x55bbcbf9ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:48.579 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.572+0000 7f4ce7c51b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbcbf96050 0x55bbcbf9f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:48.579 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.572+0000 7f4ce7c51b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbf969a0 0x55bbcbfa6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:48.579 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.572+0000 7f4ce7c51b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbcbe51500 con 0x55bbcbf969a0 2024-05-10T03:42:48.579 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.572+0000 7f4ce7c51b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbcbe511a0 con 0x55bbcbf96050 2024-05-10T03:42:48.579 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.572+0000 7f4ce7c51b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbcbd38640 con 0x55bbcbf95180 2024-05-10T03:42:48.580 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.572+0000 7f4ce7c51b80 10 client.0 _ll_register_callbacks cb 0x55bbcbe5aad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:48.580 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.572+0000 7f4cd5eaa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbf969a0 0x55bbcbfa6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:48.580 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.572+0000 7f4cd56a9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbcbf95180 0x55bbcbf9ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:48.580 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.572+0000 7f4cd5eaa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbf969a0 0x55bbcbfa6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49622/0 (socket says 172.21.15.45:49622) 2024-05-10T03:42:48.580 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.572+0000 7f4cd5eaa700 1 -- 172.21.15.45:0/579711691 learned_addr learned my addr 172.21.15.45:0/579711691 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:48.580 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.572+0000 7f4cd4ea8700 1 --2- 172.21.15.45:0/579711691 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbcbf96050 0x55bbcbf9f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:48.580 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.572+0000 7f4cd5eaa700 1 -- 172.21.15.45:0/579711691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbcbf95180 msgr2=0x55bbcbf9ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:48.580 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.572+0000 7f4cd5eaa700 1 --2- 172.21.15.45:0/579711691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbcbf95180 0x55bbcbf9ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.580 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.572+0000 7f4cd5eaa700 1 -- 172.21.15.45:0/579711691 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbcbf96050 msgr2=0x55bbcbf9f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:48.580 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.572+0000 7f4cd5eaa700 1 --2- 172.21.15.45:0/579711691 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbcbf96050 0x55bbcbf9f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.580 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.572+0000 7f4cd5eaa700 1 -- 172.21.15.45:0/579711691 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cd01a26b0 con 0x55bbcbf969a0 2024-05-10T03:42:48.580 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.572+0000 7f4cd4ea8700 1 --2- 172.21.15.45:0/579711691 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbcbf96050 0x55bbcbf9f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:42:48.580 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.572+0000 7f4cd56a9700 1 --2- 172.21.15.45:0/579711691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbcbf95180 0x55bbcbf9ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:48.580 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.573+0000 7f4cd5eaa700 1 --2- 172.21.15.45:0/579711691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbf969a0 0x55bbcbfa6330 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8007f00 tx=0x7f4cc8007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46218884ee8ed3fb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:48.580 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.573+0000 7f4cb8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:42:48.581 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.573+0000 7f4cb8ff9700 1 -- 172.21.15.45:0/579711691 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc800e070 con 0x55bbcbf969a0 2024-05-10T03:42:48.581 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.573+0000 7f4cb8ff9700 1 -- 172.21.15.45:0/579711691 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f4cc80138d0 con 0x55bbcbf969a0 2024-05-10T03:42:48.581 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.573+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/579711691 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bbcbe0e210 con 0x55bbcbf969a0 2024-05-10T03:42:48.581 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.573+0000 7f4cb8ff9700 1 -- 172.21.15.45:0/579711691 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4cc8013a90 con 0x55bbcbf969a0 2024-05-10T03:42:48.581 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.573+0000 7f4ce7c51b80 10 client.16467 fetch_fsmap learned FSMap version 31 2024-05-10T03:42:48.581 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.573+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/579711691 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55bbcbce2b00 con 0x55bbcbf969a0 2024-05-10T03:42:48.581 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.573+0000 7f4cb8ff9700 1 -- 172.21.15.45:0/579711691 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55bbcbe0e210 con 0x55bbcbf969a0 2024-05-10T03:42:48.581 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.573+0000 7f4cb8ff9700 1 -- 172.21.15.45:0/579711691 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 31) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f4cc801f410 con 0x55bbcbf969a0 2024-05-10T03:42:48.581 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.573+0000 7f4ce7c51b80 10 client.16467 fetch_fsmap finished waiting for FSMap version 31 2024-05-10T03:42:48.581 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.573+0000 7f4ce7c51b80 10 client.16467 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:42:48.581 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.573+0000 7f4ce7c51b80 20 client.16467 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:48.581 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.573+0000 7f4ce7c51b80 1 --2- 172.21.15.45:0/579711691 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55bbcbfaabb0 0x55bbcbfad000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:48.581 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.573+0000 7f4ce7c51b80 4 client.16467 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:42:48.581 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.574+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/579711691 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bbcbf64720 con 0x55bbcbfaabb0 2024-05-10T03:42:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.574+0000 7f4cd56a9700 1 --2- 172.21.15.45:0/579711691 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55bbcbfaabb0 0x55bbcbfad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.574+0000 7f4cb8ff9700 10 client.16467 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.574+0000 7f4cd56a9700 1 --2- 172.21.15.45:0/579711691 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55bbcbfaabb0 0x55bbcbfad000 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=313d7f4033e53e4e server_cookie=6954784d2bfbe18b in_seq=0 out_seq=0 2024-05-10T03:42:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.575+0000 7f4cb8ff9700 1 -- 172.21.15.45:0/579711691 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bbcbf64720 con 0x55bbcbfaabb0 2024-05-10T03:42:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.575+0000 7f4cb8ff9700 10 client.16467 handle_command_reply: tid=0 2024-05-10T03:42:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.575+0000 7f4ce7c51b80 1 client.16467 shutdown 2024-05-10T03:42:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.575+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/579711691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbf969a0 msgr2=0x55bbcbfa6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.575+0000 7f4ce7c51b80 1 --2- 172.21.15.45:0/579711691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbf969a0 0x55bbcbfa6330 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8007f00 tx=0x7f4cc8007f30 comp rx=0 tx=0).stop 2024-05-10T03:42:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.575+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/579711691 shutdown_connections 2024-05-10T03:42:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.575+0000 7f4ce7c51b80 1 --2- 172.21.15.45:0/579711691 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55bbcbfaabb0 0x55bbcbfad000 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.575+0000 7f4ce7c51b80 1 --2- 172.21.15.45:0/579711691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbcbf95180 0x55bbcbf9ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.575+0000 7f4ce7c51b80 1 --2- 172.21.15.45:0/579711691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbf969a0 0x55bbcbfa6330 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.575+0000 7f4cb8ff9700 0 client.16467 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:48.582 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.575+0000 7f4ce7c51b80 1 --2- 172.21.15.45:0/579711691 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbcbf96050 0x55bbcbf9f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.583 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.575+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/579711691 >> 172.21.15.45:0/579711691 conn(0x55bbcbef7a00 msgr2=0x55bbcbf8fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:48.583 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.575+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/579711691 shutdown_connections 2024-05-10T03:42:48.583 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.575+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/579711691 wait complete. 2024-05-10T03:42:48.583 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.576+0000 7f4ce7c51b80 20 client.16467 trim_cache size 0 max 16384 2024-05-10T03:42:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.593+0000 7f4ce7c51b80 1 Processor -- start 2024-05-10T03:42:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.593+0000 7f4ce7c51b80 1 -- start start 2024-05-10T03:42:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.594+0000 7f4ce7c51b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbef7a00 0x55bbcbf9d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.594+0000 7f4ce7c51b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbcbf95180 0x55bbcbf9d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.594+0000 7f4ce7c51b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbcbf96050 0x55bbcbfa5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:48.597 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.594+0000 7f4ce7c51b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbcbf95ab0 con 0x55bbcbef7a00 2024-05-10T03:42:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.594+0000 7f4ce7c51b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbcbf8c920 con 0x55bbcbf96050 2024-05-10T03:42:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.594+0000 7f4ce7c51b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbcbfa7430 con 0x55bbcbf95180 2024-05-10T03:42:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.594+0000 7f4cd56a9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbef7a00 0x55bbcbf9d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.594+0000 7f4cd56a9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbef7a00 0x55bbcbf9d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49624/0 (socket says 172.21.15.45:49624) 2024-05-10T03:42:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.594+0000 7f4cd56a9700 1 -- 172.21.15.45:0/2653029993 learned_addr learned my addr 172.21.15.45:0/2653029993 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.594+0000 7f4cd4ea8700 1 --2- 172.21.15.45:0/2653029993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbcbf95180 0x55bbcbf9d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.594+0000 7f4cd5eaa700 1 --2- 172.21.15.45:0/2653029993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbcbf96050 0x55bbcbfa5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.594+0000 7f4cd56a9700 1 -- 172.21.15.45:0/2653029993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbcbf95180 msgr2=0x55bbcbf9d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.594+0000 7f4cd56a9700 1 --2- 172.21.15.45:0/2653029993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbcbf95180 0x55bbcbf9d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.594+0000 7f4cd56a9700 1 -- 172.21.15.45:0/2653029993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbcbf96050 msgr2=0x55bbcbfa5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.594+0000 7f4cd56a9700 1 --2- 172.21.15.45:0/2653029993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbcbf96050 0x55bbcbfa5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.594+0000 7f4cd56a9700 1 -- 172.21.15.45:0/2653029993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbcbe7b500 con 0x55bbcbef7a00 2024-05-10T03:42:48.598 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.594+0000 7f4cd5eaa700 1 --2- 172.21.15.45:0/2653029993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbcbf96050 0x55bbcbfa5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:42:48.599 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.594+0000 7f4cd56a9700 1 --2- 172.21.15.45:0/2653029993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbef7a00 0x55bbcbf9d440 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc09b190 tx=0x7f4ccc009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b6dba2774375ba server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:48.599 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.594+0000 7f4cbbfff700 1 -- 172.21.15.45:0/2653029993 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc0a35f0 con 0x55bbcbef7a00 2024-05-10T03:42:48.599 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.595+0000 7f4cbbfff700 1 -- 172.21.15.45:0/2653029993 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4ccc09f030 con 0x55bbcbef7a00 2024-05-10T03:42:48.599 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.595+0000 7f4cbbfff700 1 -- 172.21.15.45:0/2653029993 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc0a3160 con 0x55bbcbef7a00 2024-05-10T03:42:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.595+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/2653029993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbef7a00 msgr2=0x55bbcbf9d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.595+0000 7f4ce7c51b80 1 --2- 172.21.15.45:0/2653029993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbef7a00 0x55bbcbf9d440 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc09b190 tx=0x7f4ccc009ca0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.595+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/2653029993 shutdown_connections 2024-05-10T03:42:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.595+0000 7f4ce7c51b80 1 --2- 172.21.15.45:0/2653029993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbcbf96050 0x55bbcbfa5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.595+0000 7f4ce7c51b80 1 --2- 172.21.15.45:0/2653029993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbef7a00 0x55bbcbf9d440 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.595+0000 7f4ce7c51b80 1 --2- 172.21.15.45:0/2653029993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbcbf95180 0x55bbcbf9d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.595+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/2653029993 >> 172.21.15.45:0/2653029993 conn(0x55bbcbf8c040 msgr2=0x55bbcbf99d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.595+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/2653029993 shutdown_connections 2024-05-10T03:42:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.595+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/2653029993 wait complete. 2024-05-10T03:42:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.596+0000 7f4ce7c51b80 1 -- start start 2024-05-10T03:42:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.596+0000 7f4ce7c51b80 1 Processor -- start 2024-05-10T03:42:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.596+0000 7f4ce7c51b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbef7a00 0x55bbcbfa3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:48.603 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.596+0000 7f4ce7c51b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbcbf95180 0x55bbcbfa3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.596+0000 7f4ce7c51b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbcbf96050 0x55bbcbfff050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.596+0000 7f4ce7c51b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbcbfff590 con 0x55bbcbef7a00 2024-05-10T03:42:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.596+0000 7f4ce7c51b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbcbfff6d0 con 0x55bbcbf95180 2024-05-10T03:42:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.596+0000 7f4ce7c51b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbcbfff860 con 0x55bbcbf96050 2024-05-10T03:42:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.597+0000 7f4ce7c51b80 10 client.0 _ll_register_callbacks cb 0x55bbcbe5aad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:42:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.597+0000 7f4cd56a9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbef7a00 0x55bbcbfa3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.597+0000 7f4cd56a9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbef7a00 0x55bbcbfa3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49636/0 (socket says 172.21.15.45:49636) 2024-05-10T03:42:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.597+0000 7f4cd56a9700 1 -- 172.21.15.45:0/686704971 learned_addr learned my addr 172.21.15.45:0/686704971 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:42:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.597+0000 7f4cd5eaa700 1 --2- 172.21.15.45:0/686704971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbcbf96050 0x55bbcbfff050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.597+0000 7f4cd4ea8700 1 --2- 172.21.15.45:0/686704971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbcbf95180 0x55bbcbfa3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.597+0000 7f4cd56a9700 1 -- 172.21.15.45:0/686704971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbcbf96050 msgr2=0x55bbcbfff050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.597+0000 7f4cd56a9700 1 --2- 172.21.15.45:0/686704971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbcbf96050 0x55bbcbfff050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.604 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.597+0000 7f4cd56a9700 1 -- 172.21.15.45:0/686704971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbcbf95180 msgr2=0x55bbcbfa3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:42:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.597+0000 7f4cd56a9700 1 --2- 172.21.15.45:0/686704971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbcbf95180 0x55bbcbfa3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.597+0000 7f4cd56a9700 1 -- 172.21.15.45:0/686704971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bbcbd36350 con 0x55bbcbef7a00 2024-05-10T03:42:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.597+0000 7f4cd5eaa700 1 --2- 172.21.15.45:0/686704971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbcbf96050 0x55bbcbfff050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:42:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.597+0000 7f4cd56a9700 1 --2- 172.21.15.45:0/686704971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbef7a00 0x55bbcbfa3440 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc097c70 tx=0x7f4ccc0975f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4946bed2e21a73c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:42:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.597+0000 7f4cb8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:42:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.597+0000 7f4cb8ff9700 1 -- 172.21.15.45:0/686704971 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc09b200 con 0x55bbcbef7a00 2024-05-10T03:42:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.597+0000 7f4cb8ff9700 1 -- 172.21.15.45:0/686704971 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f4ccc0a35f0 con 0x55bbcbef7a00 2024-05-10T03:42:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.597+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/686704971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4ccc09b900 con 0x55bbcbef7a00 2024-05-10T03:42:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.598+0000 7f4cb8ff9700 1 -- 172.21.15.45:0/686704971 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ccc0a1120 con 0x55bbcbef7a00 2024-05-10T03:42:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.598+0000 7f4ce7c51b80 10 client.16473 fetch_fsmap learned FSMap version 31 2024-05-10T03:42:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.598+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/686704971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55bbcbd3ac70 con 0x55bbcbef7a00 2024-05-10T03:42:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.598+0000 7f4cb8ff9700 1 -- 172.21.15.45:0/686704971 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4ccc09b900 con 0x55bbcbef7a00 2024-05-10T03:42:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.598+0000 7f4cb8ff9700 1 -- 172.21.15.45:0/686704971 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 31) v1 ==== 7494+0+0 (secure 0 0 0) 0x7f4ccc0b3d20 con 0x55bbcbef7a00 2024-05-10T03:42:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.598+0000 7f4ce7c51b80 10 client.16473 fetch_fsmap finished waiting for FSMap version 31 2024-05-10T03:42:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.598+0000 7f4ce7c51b80 10 client.16473 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:42:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.598+0000 7f4ce7c51b80 20 client.16473 populate_metadata read hostname 'smithi045' 2024-05-10T03:42:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.598+0000 7f4ce7c51b80 1 --2- 172.21.15.45:0/686704971 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55bbcbf969a0 0x55bbcc002c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:42:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.598+0000 7f4ce7c51b80 4 client.16473 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T03:42:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.598+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/686704971 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bbcbeade60 con 0x55bbcbf969a0 2024-05-10T03:42:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.598+0000 7f4cd4ea8700 1 --2- 172.21.15.45:0/686704971 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55bbcbf969a0 0x55bbcc002c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:42:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.599+0000 7f4cb8ff9700 10 client.16473 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.599+0000 7f4cd4ea8700 1 --2- 172.21.15.45:0/686704971 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55bbcbf969a0 0x55bbcc002c80 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9a48dd8de29d757 server_cookie=a9da649a5a9edf94 in_seq=0 out_seq=0 2024-05-10T03:42:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.668+0000 7f4cb8ff9700 1 -- 172.21.15.45:0/686704971 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bbcbeade60 con 0x55bbcbf969a0 2024-05-10T03:42:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.668+0000 7f4cb8ff9700 10 client.16473 handle_command_reply: tid=0 2024-05-10T03:42:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.668+0000 7f4ce7c51b80 1 client.16473 shutdown 2024-05-10T03:42:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.668+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/686704971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbef7a00 msgr2=0x55bbcbfa3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.668+0000 7f4ce7c51b80 1 --2- 172.21.15.45:0/686704971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbef7a00 0x55bbcbfa3440 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc097c70 tx=0x7f4ccc0975f0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.668+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/686704971 shutdown_connections 2024-05-10T03:42:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.668+0000 7f4ce7c51b80 1 --2- 172.21.15.45:0/686704971 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55bbcbf969a0 0x55bbcc002c80 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.668+0000 7f4ce7c51b80 1 --2- 172.21.15.45:0/686704971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bbcbf96050 0x55bbcbfff050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.668+0000 7f4ce7c51b80 1 --2- 172.21.15.45:0/686704971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bbcbef7a00 0x55bbcbfa3440 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.668+0000 7f4ce7c51b80 1 --2- 172.21.15.45:0/686704971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbcbf95180 0x55bbcbfa3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.668+0000 7f4cb8ff9700 0 client.16473 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:42:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.668+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/686704971 >> 172.21.15.45:0/686704971 conn(0x55bbcbf8c040 msgr2=0x55bbcbf9d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.668+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/686704971 shutdown_connections 2024-05-10T03:42:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.668+0000 7f4ce7c51b80 1 -- 172.21.15.45:0/686704971 wait complete. 2024-05-10T03:42:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.669+0000 7f4ce7c51b80 20 client.16473 trim_cache size 0 max 16384 2024-05-10T03:42:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:{ 2024-05-10T03:42:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "message": "", 2024-05-10T03:42:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "return_code": 0 2024-05-10T03:42:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:} 2024-05-10T03:42:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.669+0000 7f4cd790d700 1 -- 172.21.15.45:0/4161802566 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4cbc0a1120 msgr2=0x7f4cbc0a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.669+0000 7f4cd790d700 1 --2- 172.21.15.45:0/4161802566 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4cbc0a1120 0x7f4cbc0a3630 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0101940 tx=0x7f4cc0009260 comp rx=0 tx=0).stop 2024-05-10T03:42:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.669+0000 7f4cd790d700 1 -- 172.21.15.45:0/4161802566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd0069300 msgr2=0x7f4cd0101fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:42:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.669+0000 7f4cd790d700 1 --2- 172.21.15.45:0/4161802566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd0069300 0x7f4cd0101fa0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc0098e0 tx=0x7f4ccc00f690 comp rx=0 tx=0).stop 2024-05-10T03:42:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.669+0000 7f4cd790d700 1 -- 172.21.15.45:0/4161802566 shutdown_connections 2024-05-10T03:42:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.669+0000 7f4cd790d700 1 --2- 172.21.15.45:0/4161802566 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4cbc0a1120 0x7f4cbc0a3630 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.669+0000 7f4cd790d700 1 --2- 172.21.15.45:0/4161802566 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4cd0107880 0x7f4cd0100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.669+0000 7f4cd790d700 1 --2- 172.21.15.45:0/4161802566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd0069300 0x7f4cd0101fa0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.669+0000 7f4cd790d700 1 --2- 172.21.15.45:0/4161802566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cd0104d10 0x7f4cd0100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:42:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.669+0000 7f4cd790d700 1 -- 172.21.15.45:0/4161802566 >> 172.21.15.45:0/4161802566 conn(0x7f4cd00fc0f0 msgr2=0x7f4cd0102f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:42:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.669+0000 7f4cd790d700 1 -- 172.21.15.45:0/4161802566 shutdown_connections 2024-05-10T03:42:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:42:48.669+0000 7f4cd790d700 1 -- 172.21.15.45:0/4161802566 wait complete. 2024-05-10T03:42:49.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:49 smithi106 ceph-mon[46996]: pgmap v361: 129 pgs: 129 active+clean; 96 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 211 op/s 2024-05-10T03:42:49.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:49 smithi154 ceph-mon[46565]: pgmap v361: 129 pgs: 129 active+clean; 96 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 211 op/s 2024-05-10T03:42:49.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:49 smithi045 ceph-mon[42520]: pgmap v361: 129 pgs: 129 active+clean; 96 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 211 op/s 2024-05-10T03:42:51.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:51 smithi106 ceph-mon[46996]: pgmap v362: 129 pgs: 129 active+clean; 100 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 1.0 MiB/s wr, 145 op/s 2024-05-10T03:42:51.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:51 smithi106 ceph-mon[46996]: scrub summary: idle 2024-05-10T03:42:51.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:51 smithi106 ceph-mon[46996]: scrub summary: idle 2024-05-10T03:42:51.477 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:51 smithi154 ceph-mon[46565]: pgmap v362: 129 pgs: 129 active+clean; 100 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 1.0 MiB/s wr, 145 op/s 2024-05-10T03:42:51.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:51 smithi154 ceph-mon[46565]: scrub summary: idle 2024-05-10T03:42:51.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:51 smithi154 ceph-mon[46565]: scrub summary: idle 2024-05-10T03:42:51.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:51 smithi045 ceph-mon[42520]: pgmap v362: 129 pgs: 129 active+clean; 100 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 1.0 MiB/s wr, 145 op/s 2024-05-10T03:42:51.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:51 smithi045 ceph-mon[42520]: scrub summary: idle 2024-05-10T03:42:51.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:51 smithi045 ceph-mon[42520]: scrub summary: idle 2024-05-10T03:42:52.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:52 smithi106 ceph-mon[46996]: scrub summary: idle 2024-05-10T03:42:52.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:52 smithi106 ceph-mon[46996]: scrub summary: idle 2024-05-10T03:42:52.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:52 smithi106 ceph-mon[46996]: scrub summary: idle 2024-05-10T03:42:52.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:52 smithi154 ceph-mon[46565]: scrub summary: idle 2024-05-10T03:42:52.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:52 smithi154 ceph-mon[46565]: scrub summary: idle 2024-05-10T03:42:52.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:52 smithi154 ceph-mon[46565]: scrub summary: idle 2024-05-10T03:42:52.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:52 smithi045 ceph-mon[42520]: scrub summary: idle 2024-05-10T03:42:52.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:52 smithi045 ceph-mon[42520]: scrub summary: idle 2024-05-10T03:42:52.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:52 smithi045 ceph-mon[42520]: scrub summary: idle 2024-05-10T03:42:53.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:53 smithi106 ceph-mon[46996]: pgmap v363: 129 pgs: 129 active+clean; 114 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 230 op/s 2024-05-10T03:42:53.473 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:53 smithi154 ceph-mon[46565]: pgmap v363: 129 pgs: 129 active+clean; 114 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 230 op/s 2024-05-10T03:42:53.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:53 smithi045 ceph-mon[42520]: pgmap v363: 129 pgs: 129 active+clean; 114 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 230 op/s 2024-05-10T03:42:55.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:55 smithi106 ceph-mon[46996]: pgmap v364: 129 pgs: 129 active+clean; 139 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.4 MiB/s wr, 390 op/s 2024-05-10T03:42:55.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:55 smithi154 ceph-mon[46565]: pgmap v364: 129 pgs: 129 active+clean; 139 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.4 MiB/s wr, 390 op/s 2024-05-10T03:42:55.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:55 smithi045 ceph-mon[42520]: pgmap v364: 129 pgs: 129 active+clean; 139 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.4 MiB/s wr, 390 op/s 2024-05-10T03:42:57.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:57 smithi106 ceph-mon[46996]: pgmap v365: 129 pgs: 129 active+clean; 145 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.0 MiB/s wr, 504 op/s 2024-05-10T03:42:57.473 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:57 smithi154 ceph-mon[46565]: pgmap v365: 129 pgs: 129 active+clean; 145 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.0 MiB/s wr, 504 op/s 2024-05-10T03:42:57.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:57 smithi045 ceph-mon[42520]: pgmap v365: 129 pgs: 129 active+clean; 145 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.0 MiB/s wr, 504 op/s 2024-05-10T03:42:59.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:42:59 smithi106 ceph-mon[46996]: pgmap v366: 129 pgs: 129 active+clean; 166 MiB data, 837 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.7 MiB/s wr, 715 op/s 2024-05-10T03:42:59.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:42:59 smithi154 ceph-mon[46565]: pgmap v366: 129 pgs: 129 active+clean; 166 MiB data, 837 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.7 MiB/s wr, 715 op/s 2024-05-10T03:42:59.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:42:59 smithi045 ceph-mon[42520]: pgmap v366: 129 pgs: 129 active+clean; 166 MiB data, 837 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.7 MiB/s wr, 715 op/s 2024-05-10T03:43:01.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:01 smithi106 ceph-mon[46996]: pgmap v367: 129 pgs: 129 active+clean; 169 MiB data, 838 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.2 MiB/s wr, 780 op/s 2024-05-10T03:43:01.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:01 smithi154 ceph-mon[46565]: pgmap v367: 129 pgs: 129 active+clean; 169 MiB data, 838 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.2 MiB/s wr, 780 op/s 2024-05-10T03:43:01.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:01 smithi045 ceph-mon[42520]: pgmap v367: 129 pgs: 129 active+clean; 169 MiB data, 838 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.2 MiB/s wr, 780 op/s 2024-05-10T03:43:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.809+0000 7fa83d8ed700 1 -- 172.21.15.45:0/1506723971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa838102d40 msgr2=0x7fa838103150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.809+0000 7fa83d8ed700 1 --2- 172.21.15.45:0/1506723971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa838102d40 0x7fa838103150 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa820009990 tx=0x7fa820009ca0 comp rx=0 tx=0).stop 2024-05-10T03:43:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.809+0000 7fa83d8ed700 1 -- 172.21.15.45:0/1506723971 shutdown_connections 2024-05-10T03:43:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.809+0000 7fa83d8ed700 1 --2- 172.21.15.45:0/1506723971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8381036e0 0x7fa838109f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.809+0000 7fa83d8ed700 1 --2- 172.21.15.45:0/1506723971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa838101c20 0x7fa838102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.809+0000 7fa83d8ed700 1 --2- 172.21.15.45:0/1506723971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa838102d40 0x7fa838103150 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.809+0000 7fa83d8ed700 1 -- 172.21.15.45:0/1506723971 >> 172.21.15.45:0/1506723971 conn(0x7fa8380fd230 msgr2=0x7fa8380ff6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.809+0000 7fa83d8ed700 1 -- 172.21.15.45:0/1506723971 shutdown_connections 2024-05-10T03:43:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.809+0000 7fa83d8ed700 1 -- 172.21.15.45:0/1506723971 wait complete. 2024-05-10T03:43:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.810+0000 7fa83d8ed700 1 Processor -- start 2024-05-10T03:43:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.811+0000 7fa83d8ed700 1 -- start start 2024-05-10T03:43:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.811+0000 7fa83d8ed700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa838101c20 0x7fa838198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.811+0000 7fa83d8ed700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa838102d40 0x7fa8381985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.811+0000 7fa83d8ed700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8381036e0 0x7fa83819f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.811+0000 7fa83d8ed700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83819fb20 con 0x7fa838101c20 2024-05-10T03:43:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.811+0000 7fa83d8ed700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83819fc60 con 0x7fa8381036e0 2024-05-10T03:43:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.811+0000 7fa83d8ed700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83819fdf0 con 0x7fa838102d40 2024-05-10T03:43:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.811+0000 7fa836ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa838101c20 0x7fa838198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.811+0000 7fa836ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa838101c20 0x7fa838198080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54116/0 (socket says 172.21.15.45:54116) 2024-05-10T03:43:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.811+0000 7fa836ffd700 1 -- 172.21.15.45:0/22294498 learned_addr learned my addr 172.21.15.45:0/22294498 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.811+0000 7fa8367fc700 1 --2- 172.21.15.45:0/22294498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa838102d40 0x7fa8381985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.811+0000 7fa8377fe700 1 --2- 172.21.15.45:0/22294498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8381036e0 0x7fa83819f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.811+0000 7fa836ffd700 1 -- 172.21.15.45:0/22294498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa838102d40 msgr2=0x7fa8381985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.811+0000 7fa836ffd700 1 --2- 172.21.15.45:0/22294498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa838102d40 0x7fa8381985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.811+0000 7fa836ffd700 1 -- 172.21.15.45:0/22294498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8381036e0 msgr2=0x7fa83819f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.811+0000 7fa836ffd700 1 --2- 172.21.15.45:0/22294498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8381036e0 0x7fa83819f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.811+0000 7fa836ffd700 1 -- 172.21.15.45:0/22294498 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8200095f0 con 0x7fa838101c20 2024-05-10T03:43:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.811+0000 7fa8377fe700 1 --2- 172.21.15.45:0/22294498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8381036e0 0x7fa83819f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:43:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.812+0000 7fa836ffd700 1 --2- 172.21.15.45:0/22294498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa838101c20 0x7fa838198080 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa82800d980 tx=0x7fa82800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.812+0000 7fa83c8eb700 1 -- 172.21.15.45:0/22294498 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa828004220 con 0x7fa838101c20 2024-05-10T03:43:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.812+0000 7fa83c8eb700 1 -- 172.21.15.45:0/22294498 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa828004380 con 0x7fa838101c20 2024-05-10T03:43:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.812+0000 7fa83d8ed700 1 -- 172.21.15.45:0/22294498 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8381a00d0 con 0x7fa838101c20 2024-05-10T03:43:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.812+0000 7fa83c8eb700 1 -- 172.21.15.45:0/22294498 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa828003cb0 con 0x7fa838101c20 2024-05-10T03:43:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.812+0000 7fa83d8ed700 1 -- 172.21.15.45:0/22294498 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8381a05e0 con 0x7fa838101c20 2024-05-10T03:43:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.814+0000 7fa83c8eb700 1 -- 172.21.15.45:0/22294498 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa828010460 con 0x7fa838101c20 2024-05-10T03:43:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.815+0000 7fa83c8eb700 1 --2- 172.21.15.45:0/22294498 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa8240a1120 0x7fa8240a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.815+0000 7fa83c8eb700 1 -- 172.21.15.45:0/22294498 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa8280cc860 con 0x7fa838101c20 2024-05-10T03:43:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.815+0000 7fa8367fc700 1 --2- 172.21.15.45:0/22294498 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa8240a1120 0x7fa8240a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.816+0000 7fa8367fc700 1 --2- 172.21.15.45:0/22294498 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa8240a1120 0x7fa8240a3630 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa82000b2e0 tx=0x7fa82001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.816+0000 7fa84dc31b80 1 Processor -- start 2024-05-10T03:43:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.816+0000 7fa84dc31b80 1 -- start start 2024-05-10T03:43:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.816+0000 7fa84dc31b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb46982650 0x55eb46982a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.816+0000 7fa84dc31b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46983430 0x55eb46983840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.816+0000 7fa84dc31b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb46983d80 0x55eb4698a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.816+0000 7fa84dc31b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb468a50f0 con 0x55eb46983430 2024-05-10T03:43:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.816+0000 7fa84dc31b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb468a2ab0 con 0x55eb46983d80 2024-05-10T03:43:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.816+0000 7fa84dc31b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb4689e3a0 con 0x55eb46982650 2024-05-10T03:43:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.816+0000 7fa8367fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46983430 0x55eb46983840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.816+0000 7fa8367fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46983430 0x55eb46983840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54120/0 (socket says 172.21.15.45:54120) 2024-05-10T03:43:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.816+0000 7fa8367fc700 1 -- 172.21.15.45:0/16462601 learned_addr learned my addr 172.21.15.45:0/16462601 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.817+0000 7fa836ffd700 1 --2- 172.21.15.45:0/16462601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb46982650 0x55eb46982a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.817+0000 7fa8377fe700 1 --2- 172.21.15.45:0/16462601 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb46983d80 0x55eb4698a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.817+0000 7fa8367fc700 1 -- 172.21.15.45:0/16462601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb46982650 msgr2=0x55eb46982a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.817+0000 7fa8367fc700 1 --2- 172.21.15.45:0/16462601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb46982650 0x55eb46982a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.817+0000 7fa8367fc700 1 -- 172.21.15.45:0/16462601 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb46983d80 msgr2=0x55eb4698a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.817+0000 7fa8367fc700 1 --2- 172.21.15.45:0/16462601 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb46983d80 0x55eb4698a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.817+0000 7fa8367fc700 1 -- 172.21.15.45:0/16462601 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb4671f350 con 0x55eb46983430 2024-05-10T03:43:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.817+0000 7fa8367fc700 1 --2- 172.21.15.45:0/16462601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46983430 0x55eb46983840 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa8200059d0 tx=0x7fa82001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b813b72d4e0a88 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.817+0000 7fa82dffb700 1 -- 172.21.15.45:0/16462601 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82002b070 con 0x55eb46983430 2024-05-10T03:43:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.817+0000 7fa82dffb700 1 -- 172.21.15.45:0/16462601 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa82001e040 con 0x55eb46983430 2024-05-10T03:43:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.817+0000 7fa82dffb700 1 -- 172.21.15.45:0/16462601 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8200249e0 con 0x55eb46983430 2024-05-10T03:43:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.818+0000 7fa84dc31b80 1 -- 172.21.15.45:0/16462601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46983430 msgr2=0x55eb46983840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.818+0000 7fa84dc31b80 1 --2- 172.21.15.45:0/16462601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46983430 0x55eb46983840 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa8200059d0 tx=0x7fa82001f000 comp rx=0 tx=0).stop 2024-05-10T03:43:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.818+0000 7fa84dc31b80 1 -- 172.21.15.45:0/16462601 shutdown_connections 2024-05-10T03:43:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.818+0000 7fa84dc31b80 1 --2- 172.21.15.45:0/16462601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb46982650 0x55eb46982a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.818+0000 7fa84dc31b80 1 --2- 172.21.15.45:0/16462601 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb46983d80 0x55eb4698a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.818+0000 7fa84dc31b80 1 --2- 172.21.15.45:0/16462601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46983430 0x55eb46983840 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.818+0000 7fa84dc31b80 1 -- 172.21.15.45:0/16462601 >> 172.21.15.45:0/16462601 conn(0x55eb468e0a00 msgr2=0x55eb46978a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.818+0000 7fa84dc31b80 1 -- 172.21.15.45:0/16462601 shutdown_connections 2024-05-10T03:43:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.818+0000 7fa84dc31b80 1 -- 172.21.15.45:0/16462601 wait complete. 2024-05-10T03:43:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.819+0000 7fa84dc31b80 1 -- start start 2024-05-10T03:43:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.819+0000 7fa84dc31b80 1 Processor -- start 2024-05-10T03:43:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.819+0000 7fa84dc31b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb46982650 0x55eb4698c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.819+0000 7fa84dc31b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb46983430 0x55eb4698ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.819+0000 7fa84dc31b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46983d80 0x55eb469939b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.819+0000 7fa84dc31b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb4683a500 con 0x55eb46983d80 2024-05-10T03:43:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.819+0000 7fa84dc31b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb4683a1a0 con 0x55eb46983430 2024-05-10T03:43:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.819+0000 7fa84dc31b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb46721640 con 0x55eb46982650 2024-05-10T03:43:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.819+0000 7fa84dc31b80 10 client.0 _ll_register_callbacks cb 0x55eb46843ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:43:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.819+0000 7fa8377fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46983d80 0x55eb469939b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.819+0000 7fa8377fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46983d80 0x55eb469939b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54124/0 (socket says 172.21.15.45:54124) 2024-05-10T03:43:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.819+0000 7fa8377fe700 1 -- 172.21.15.45:0/2383500893 learned_addr learned my addr 172.21.15.45:0/2383500893 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.819+0000 7fa836ffd700 1 --2- 172.21.15.45:0/2383500893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb46982650 0x55eb4698c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.820+0000 7fa8367fc700 1 --2- 172.21.15.45:0/2383500893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb46983430 0x55eb4698ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.820+0000 7fa8377fe700 1 -- 172.21.15.45:0/2383500893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb46982650 msgr2=0x55eb4698c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.820+0000 7fa8377fe700 1 --2- 172.21.15.45:0/2383500893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb46982650 0x55eb4698c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.820+0000 7fa8377fe700 1 -- 172.21.15.45:0/2383500893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb46983430 msgr2=0x55eb4698ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.820+0000 7fa8377fe700 1 --2- 172.21.15.45:0/2383500893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb46983430 0x55eb4698ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.820+0000 7fa8377fe700 1 -- 172.21.15.45:0/2383500893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83810aa20 con 0x55eb46983d80 2024-05-10T03:43:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.820+0000 7fa8367fc700 1 --2- 172.21.15.45:0/2383500893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb46983430 0x55eb4698ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:43:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.820+0000 7fa8377fe700 1 --2- 172.21.15.45:0/2383500893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46983d80 0x55eb469939b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa830007f00 tx=0x7fa830012520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5acde9ab1e19b1d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.820+0000 7fa816ffd700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:43:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.820+0000 7fa816ffd700 1 -- 172.21.15.45:0/2383500893 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa830012cb0 con 0x55eb46983d80 2024-05-10T03:43:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.820+0000 7fa816ffd700 1 -- 172.21.15.45:0/2383500893 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa830012e10 con 0x55eb46983d80 2024-05-10T03:43:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.820+0000 7fa84dc31b80 1 -- 172.21.15.45:0/2383500893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eb467f7210 con 0x55eb46983d80 2024-05-10T03:43:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.820+0000 7fa816ffd700 1 -- 172.21.15.45:0/2383500893 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa830016420 con 0x55eb46983d80 2024-05-10T03:43:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.820+0000 7fa84dc31b80 10 client.16485 fetch_fsmap learned FSMap version 31 2024-05-10T03:43:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.820+0000 7fa84dc31b80 1 -- 172.21.15.45:0/2383500893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55eb466cbb00 con 0x55eb46983d80 2024-05-10T03:43:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.821+0000 7fa816ffd700 1 -- 172.21.15.45:0/2383500893 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55eb467f7210 con 0x55eb46983d80 2024-05-10T03:43:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.821+0000 7fa816ffd700 1 -- 172.21.15.45:0/2383500893 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 31) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fa830014040 con 0x55eb46983d80 2024-05-10T03:43:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.821+0000 7fa84dc31b80 10 client.16485 fetch_fsmap finished waiting for FSMap version 31 2024-05-10T03:43:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.821+0000 7fa84dc31b80 10 client.16485 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:43:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.821+0000 7fa84dc31b80 20 client.16485 populate_metadata read hostname 'smithi045' 2024-05-10T03:43:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.821+0000 7fa84dc31b80 1 --2- 172.21.15.45:0/2383500893 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55eb469982c0 0x55eb4699a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.821+0000 7fa84dc31b80 4 client.16485 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:43:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.821+0000 7fa84dc31b80 1 -- 172.21.15.45:0/2383500893 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eb4694d720 con 0x55eb469982c0 2024-05-10T03:43:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.821+0000 7fa836ffd700 1 --2- 172.21.15.45:0/2383500893 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55eb469982c0 0x55eb4699a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.822+0000 7fa836ffd700 1 --2- 172.21.15.45:0/2383500893 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55eb469982c0 0x55eb4699a710 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=441f12db17a2d0c7 server_cookie=2a2aed8727f56c93 in_seq=0 out_seq=0 2024-05-10T03:43:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.822+0000 7fa816ffd700 10 client.16485 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:43:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.823+0000 7fa816ffd700 1 -- 172.21.15.45:0/2383500893 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55eb4694d720 con 0x55eb469982c0 2024-05-10T03:43:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.823+0000 7fa816ffd700 10 client.16485 handle_command_reply: tid=0 2024-05-10T03:43:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.823+0000 7fa84dc31b80 1 client.16485 shutdown 2024-05-10T03:43:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.823+0000 7fa84dc31b80 1 -- 172.21.15.45:0/2383500893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46983d80 msgr2=0x55eb469939b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.823+0000 7fa84dc31b80 1 --2- 172.21.15.45:0/2383500893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46983d80 0x55eb469939b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa830007f00 tx=0x7fa830012520 comp rx=0 tx=0).stop 2024-05-10T03:43:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.823+0000 7fa84dc31b80 1 -- 172.21.15.45:0/2383500893 shutdown_connections 2024-05-10T03:43:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.823+0000 7fa84dc31b80 1 --2- 172.21.15.45:0/2383500893 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55eb469982c0 0x55eb4699a710 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.823+0000 7fa84dc31b80 1 --2- 172.21.15.45:0/2383500893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb46982650 0x55eb4698c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.823+0000 7fa84dc31b80 1 --2- 172.21.15.45:0/2383500893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46983d80 0x55eb469939b0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.823+0000 7fa84dc31b80 1 --2- 172.21.15.45:0/2383500893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb46983430 0x55eb4698ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.823+0000 7fa816ffd700 0 client.16485 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:43:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.823+0000 7fa84dc31b80 1 -- 172.21.15.45:0/2383500893 >> 172.21.15.45:0/2383500893 conn(0x55eb468e0a00 msgr2=0x55eb46978a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.823+0000 7fa84dc31b80 1 -- 172.21.15.45:0/2383500893 shutdown_connections 2024-05-10T03:43:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.823+0000 7fa84dc31b80 1 -- 172.21.15.45:0/2383500893 wait complete. 2024-05-10T03:43:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.823+0000 7fa84dc31b80 20 client.16485 trim_cache size 0 max 16384 2024-05-10T03:43:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.839+0000 7fa84dc31b80 1 Processor -- start 2024-05-10T03:43:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.839+0000 7fa84dc31b80 1 -- start start 2024-05-10T03:43:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.839+0000 7fa84dc31b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb46982650 0x55eb4699a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.839+0000 7fa84dc31b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46983430 0x55eb46991850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.839+0000 7fa84dc31b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb46983d80 0x55eb46991d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.839+0000 7fa84dc31b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb4698a610 con 0x55eb46983430 2024-05-10T03:43:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.839+0000 7fa84dc31b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb46987ee0 con 0x55eb46983d80 2024-05-10T03:43:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.839+0000 7fa84dc31b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb4698d5b0 con 0x55eb46982650 2024-05-10T03:43:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.839+0000 7fa8367fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46983430 0x55eb46991850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:01.844 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.839+0000 7fa8367fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46983430 0x55eb46991850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54140/0 (socket says 172.21.15.45:54140) 2024-05-10T03:43:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.839+0000 7fa8367fc700 1 -- 172.21.15.45:0/1875471741 learned_addr learned my addr 172.21.15.45:0/1875471741 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.840+0000 7fa8377fe700 1 --2- 172.21.15.45:0/1875471741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb46983d80 0x55eb46991d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.840+0000 7fa836ffd700 1 --2- 172.21.15.45:0/1875471741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb46982650 0x55eb4699a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.840+0000 7fa8377fe700 1 -- 172.21.15.45:0/1875471741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb46982650 msgr2=0x55eb4699a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.840+0000 7fa8377fe700 1 --2- 172.21.15.45:0/1875471741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb46982650 0x55eb4699a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.840+0000 7fa8377fe700 1 -- 172.21.15.45:0/1875471741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46983430 msgr2=0x55eb46991850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.840+0000 7fa8377fe700 1 --2- 172.21.15.45:0/1875471741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46983430 0x55eb46991850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.840+0000 7fa8377fe700 1 -- 172.21.15.45:0/1875471741 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb46864500 con 0x55eb46983d80 2024-05-10T03:43:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.840+0000 7fa8367fc700 1 --2- 172.21.15.45:0/1875471741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46983430 0x55eb46991850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:43:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.840+0000 7fa8377fe700 1 --2- 172.21.15.45:0/1875471741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb46983d80 0x55eb46991d90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa830016610 tx=0x7fa83000afd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51cf36832ecc2561 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.840+0000 7fa82e7fc700 1 -- 172.21.15.45:0/1875471741 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa830004c70 con 0x55eb46983d80 2024-05-10T03:43:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.840+0000 7fa82e7fc700 1 -- 172.21.15.45:0/1875471741 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa83000f050 con 0x55eb46983d80 2024-05-10T03:43:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.840+0000 7fa82e7fc700 1 -- 172.21.15.45:0/1875471741 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa830016850 con 0x55eb46983d80 2024-05-10T03:43:01.845 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.841+0000 7fa84dc31b80 1 -- 172.21.15.45:0/1875471741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb46983d80 msgr2=0x55eb46991d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.841+0000 7fa84dc31b80 1 --2- 172.21.15.45:0/1875471741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb46983d80 0x55eb46991d90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa830016610 tx=0x7fa83000afd0 comp rx=0 tx=0).stop 2024-05-10T03:43:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.841+0000 7fa84dc31b80 1 -- 172.21.15.45:0/1875471741 shutdown_connections 2024-05-10T03:43:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.841+0000 7fa84dc31b80 1 --2- 172.21.15.45:0/1875471741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb46982650 0x55eb4699a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.841+0000 7fa84dc31b80 1 --2- 172.21.15.45:0/1875471741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb46983d80 0x55eb46991d90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.841+0000 7fa84dc31b80 1 --2- 172.21.15.45:0/1875471741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46983430 0x55eb46991850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.841+0000 7fa84dc31b80 1 -- 172.21.15.45:0/1875471741 >> 172.21.15.45:0/1875471741 conn(0x55eb468e0a00 msgr2=0x55eb4698ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.841+0000 7fa84dc31b80 1 -- 172.21.15.45:0/1875471741 shutdown_connections 2024-05-10T03:43:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.841+0000 7fa84dc31b80 1 -- 172.21.15.45:0/1875471741 wait complete. 2024-05-10T03:43:01.846 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.842+0000 7fa84dc31b80 1 -- start start 2024-05-10T03:43:01.849 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.842+0000 7fa84dc31b80 1 Processor -- start 2024-05-10T03:43:01.849 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.842+0000 7fa84dc31b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46982650 0x55eb46991220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:01.850 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.842+0000 7fa84dc31b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb46983430 0x55eb46991760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:01.850 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.842+0000 7fa84dc31b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb46983d80 0x55eb469ecb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:01.850 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.842+0000 7fa84dc31b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb469ed0a0 con 0x55eb46982650 2024-05-10T03:43:01.850 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.842+0000 7fa84dc31b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb469ed1e0 con 0x55eb46983d80 2024-05-10T03:43:01.850 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.842+0000 7fa84dc31b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb469ed3a0 con 0x55eb46983430 2024-05-10T03:43:01.850 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.843+0000 7fa84dc31b80 10 client.0 _ll_register_callbacks cb 0x55eb46843ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:43:01.850 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.843+0000 7fa836ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46982650 0x55eb46991220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:01.850 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.843+0000 7fa836ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46982650 0x55eb46991220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54146/0 (socket says 172.21.15.45:54146) 2024-05-10T03:43:01.850 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.843+0000 7fa836ffd700 1 -- 172.21.15.45:0/1845051254 learned_addr learned my addr 172.21.15.45:0/1845051254 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:01.850 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.843+0000 7fa8367fc700 1 --2- 172.21.15.45:0/1845051254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb46983430 0x55eb46991760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.843+0000 7fa8377fe700 1 --2- 172.21.15.45:0/1845051254 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb46983d80 0x55eb469ecb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.843+0000 7fa836ffd700 1 -- 172.21.15.45:0/1845051254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb46983430 msgr2=0x55eb46991760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.843+0000 7fa836ffd700 1 --2- 172.21.15.45:0/1845051254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb46983430 0x55eb46991760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.843+0000 7fa836ffd700 1 -- 172.21.15.45:0/1845051254 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb46983d80 msgr2=0x55eb469ecb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.843+0000 7fa836ffd700 1 --2- 172.21.15.45:0/1845051254 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb46983d80 0x55eb469ecb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.843+0000 7fa836ffd700 1 -- 172.21.15.45:0/1845051254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eb4671f350 con 0x55eb46982650 2024-05-10T03:43:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.843+0000 7fa836ffd700 1 --2- 172.21.15.45:0/1845051254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46982650 0x55eb46991220 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa828096d30 tx=0x7fa828003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc456fc9f450aae server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.843+0000 7fa816ffd700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:43:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.843+0000 7fa816ffd700 1 -- 172.21.15.45:0/1845051254 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8280a2cb0 con 0x55eb46982650 2024-05-10T03:43:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.843+0000 7fa84dc31b80 1 -- 172.21.15.45:0/1845051254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa82001e040 con 0x55eb46982650 2024-05-10T03:43:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.843+0000 7fa816ffd700 1 -- 172.21.15.45:0/1845051254 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa828098bd0 con 0x55eb46982650 2024-05-10T03:43:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.844+0000 7fa816ffd700 1 -- 172.21.15.45:0/1845051254 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8280b2170 con 0x55eb46982650 2024-05-10T03:43:01.851 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.844+0000 7fa84dc31b80 10 client.16491 fetch_fsmap learned FSMap version 31 2024-05-10T03:43:01.852 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.844+0000 7fa84dc31b80 1 -- 172.21.15.45:0/1845051254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55eb466cbb00 con 0x55eb46982650 2024-05-10T03:43:01.852 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.844+0000 7fa816ffd700 1 -- 172.21.15.45:0/1845051254 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa828066030 con 0x55eb46982650 2024-05-10T03:43:01.852 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.844+0000 7fa816ffd700 1 -- 172.21.15.45:0/1845051254 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 31) v1 ==== 7494+0+0 (secure 0 0 0) 0x7fa828099d20 con 0x55eb46982650 2024-05-10T03:43:01.852 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.844+0000 7fa84dc31b80 10 client.16491 fetch_fsmap finished waiting for FSMap version 31 2024-05-10T03:43:01.852 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.844+0000 7fa84dc31b80 10 client.16491 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:43:01.852 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.844+0000 7fa84dc31b80 20 client.16491 populate_metadata read hostname 'smithi045' 2024-05-10T03:43:01.852 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.844+0000 7fa84dc31b80 1 --2- 172.21.15.45:0/1845051254 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55eb469eed20 0x55eb469f1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:01.852 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.844+0000 7fa84dc31b80 4 client.16491 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T03:43:01.852 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.844+0000 7fa84dc31b80 1 -- 172.21.15.45:0/1845051254 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55eb46896e60 con 0x55eb469eed20 2024-05-10T03:43:01.852 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.844+0000 7fa8367fc700 1 --2- 172.21.15.45:0/1845051254 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55eb469eed20 0x55eb469f1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:01.852 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.845+0000 7fa8367fc700 1 --2- 172.21.15.45:0/1845051254 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55eb469eed20 0x55eb469f1140 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c39a0f6e608b411 server_cookie=20f6cbe7d1b2e55 in_seq=0 out_seq=0 2024-05-10T03:43:01.852 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:01.845+0000 7fa816ffd700 10 client.16491 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:43:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.049+0000 7fa816ffd700 1 -- 172.21.15.45:0/1845051254 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55eb46896e60 con 0x55eb469eed20 2024-05-10T03:43:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.049+0000 7fa816ffd700 10 client.16491 handle_command_reply: tid=0 2024-05-10T03:43:02.052 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.049+0000 7fa84dc31b80 1 client.16491 shutdown 2024-05-10T03:43:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.049+0000 7fa84dc31b80 1 -- 172.21.15.45:0/1845051254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46982650 msgr2=0x55eb46991220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.049+0000 7fa84dc31b80 1 --2- 172.21.15.45:0/1845051254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46982650 0x55eb46991220 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa828096d30 tx=0x7fa828003680 comp rx=0 tx=0).stop 2024-05-10T03:43:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.049+0000 7fa84dc31b80 1 -- 172.21.15.45:0/1845051254 shutdown_connections 2024-05-10T03:43:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.049+0000 7fa84dc31b80 1 --2- 172.21.15.45:0/1845051254 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55eb469eed20 0x55eb469f1140 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.049+0000 7fa84dc31b80 1 --2- 172.21.15.45:0/1845051254 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb46983d80 0x55eb469ecb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.049+0000 7fa84dc31b80 1 --2- 172.21.15.45:0/1845051254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55eb46982650 0x55eb46991220 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.049+0000 7fa84dc31b80 1 --2- 172.21.15.45:0/1845051254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb46983430 0x55eb46991760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.049+0000 7fa816ffd700 0 client.16491 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:43:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.049+0000 7fa84dc31b80 1 -- 172.21.15.45:0/1845051254 >> 172.21.15.45:0/1845051254 conn(0x55eb468e0a00 msgr2=0x55eb469872b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.049+0000 7fa84dc31b80 1 -- 172.21.15.45:0/1845051254 shutdown_connections 2024-05-10T03:43:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.049+0000 7fa84dc31b80 1 -- 172.21.15.45:0/1845051254 wait complete. 2024-05-10T03:43:02.053 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.050+0000 7fa84dc31b80 20 client.16491 trim_cache size 0 max 16384 2024-05-10T03:43:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:{ 2024-05-10T03:43:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "message": "", 2024-05-10T03:43:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "return_code": 0 2024-05-10T03:43:02.054 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:} 2024-05-10T03:43:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.050+0000 7fa83d8ed700 1 -- 172.21.15.45:0/22294498 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa8240a1120 msgr2=0x7fa8240a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.050+0000 7fa83d8ed700 1 --2- 172.21.15.45:0/22294498 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa8240a1120 0x7fa8240a3630 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa82000b2e0 tx=0x7fa82001a040 comp rx=0 tx=0).stop 2024-05-10T03:43:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.050+0000 7fa83d8ed700 1 -- 172.21.15.45:0/22294498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa838101c20 msgr2=0x7fa838198080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.050+0000 7fa83d8ed700 1 --2- 172.21.15.45:0/22294498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa838101c20 0x7fa838198080 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa82800d980 tx=0x7fa82800dc90 comp rx=0 tx=0).stop 2024-05-10T03:43:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.050+0000 7fa83d8ed700 1 -- 172.21.15.45:0/22294498 shutdown_connections 2024-05-10T03:43:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.050+0000 7fa83d8ed700 1 --2- 172.21.15.45:0/22294498 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa8240a1120 0x7fa8240a3630 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.050+0000 7fa83d8ed700 1 --2- 172.21.15.45:0/22294498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8381036e0 0x7fa83819f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.050+0000 7fa83d8ed700 1 --2- 172.21.15.45:0/22294498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa838101c20 0x7fa838198080 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.050+0000 7fa83d8ed700 1 --2- 172.21.15.45:0/22294498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa838102d40 0x7fa8381985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.050+0000 7fa83d8ed700 1 -- 172.21.15.45:0/22294498 >> 172.21.15.45:0/22294498 conn(0x7fa8380fd230 msgr2=0x7fa838105f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.050+0000 7fa83d8ed700 1 -- 172.21.15.45:0/22294498 shutdown_connections 2024-05-10T03:43:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:02.050+0000 7fa83d8ed700 1 -- 172.21.15.45:0/22294498 wait complete. 2024-05-10T03:43:03.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:03 smithi106 ceph-mon[46996]: pgmap v368: 129 pgs: 129 active+clean; 168 MiB data, 872 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.2 MiB/s wr, 887 op/s 2024-05-10T03:43:03.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:03 smithi154 ceph-mon[46565]: pgmap v368: 129 pgs: 129 active+clean; 168 MiB data, 872 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.2 MiB/s wr, 887 op/s 2024-05-10T03:43:03.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:03 smithi045 ceph-mon[42520]: pgmap v368: 129 pgs: 129 active+clean; 168 MiB data, 872 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.2 MiB/s wr, 887 op/s 2024-05-10T03:43:05.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:05 smithi106 ceph-mon[46996]: pgmap v369: 129 pgs: 129 active+clean; 173 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.6 MiB/s wr, 835 op/s 2024-05-10T03:43:05.473 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:05 smithi154 ceph-mon[46565]: pgmap v369: 129 pgs: 129 active+clean; 173 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.6 MiB/s wr, 835 op/s 2024-05-10T03:43:05.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:05 smithi045 ceph-mon[42520]: pgmap v369: 129 pgs: 129 active+clean; 173 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.6 MiB/s wr, 835 op/s 2024-05-10T03:43:06.930 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-10T03:43:07.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.091+0000 7fbd633f4700 1 -- 172.21.15.45:0/354061745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd5c102580 msgr2=0x7fbd5c108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:07.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.091+0000 7fbd633f4700 1 --2- 172.21.15.45:0/354061745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd5c102580 0x7fbd5c108e30 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400b0a0 tx=0x7fbd5400b3b0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.091+0000 7fbd633f4700 1 -- 172.21.15.45:0/354061745 shutdown_connections 2024-05-10T03:43:07.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.091+0000 7fbd633f4700 1 --2- 172.21.15.45:0/354061745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd5c100ac0 0x7fbd5c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.091+0000 7fbd633f4700 1 --2- 172.21.15.45:0/354061745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd5c102580 0x7fbd5c108e30 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.091+0000 7fbd633f4700 1 --2- 172.21.15.45:0/354061745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd5c101be0 0x7fbd5c101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.091+0000 7fbd633f4700 1 -- 172.21.15.45:0/354061745 >> 172.21.15.45:0/354061745 conn(0x7fbd5c0fc0d0 msgr2=0x7fbd5c0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:07.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.091+0000 7fbd633f4700 1 -- 172.21.15.45:0/354061745 shutdown_connections 2024-05-10T03:43:07.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.091+0000 7fbd633f4700 1 -- 172.21.15.45:0/354061745 wait complete. 2024-05-10T03:43:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.092+0000 7fbd633f4700 1 Processor -- start 2024-05-10T03:43:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.092+0000 7fbd633f4700 1 -- start start 2024-05-10T03:43:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.092+0000 7fbd633f4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd5c100ac0 0x7fbd5c1980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.092+0000 7fbd633f4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd5c101be0 0x7fbd5c1985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.092+0000 7fbd633f4700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd5c102580 0x7fbd5c19f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.092+0000 7fbd633f4700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c19fb90 con 0x7fbd5c101be0 2024-05-10T03:43:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.092+0000 7fbd633f4700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c19fd00 con 0x7fbd5c102580 2024-05-10T03:43:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.092+0000 7fbd633f4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c19fec0 con 0x7fbd5c100ac0 2024-05-10T03:43:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.093+0000 7fbd6098f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd5c101be0 0x7fbd5c1985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.093+0000 7fbd61190700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd5c100ac0 0x7fbd5c1980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.093+0000 7fbd6098f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd5c101be0 0x7fbd5c1985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54156/0 (socket says 172.21.15.45:54156) 2024-05-10T03:43:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.093+0000 7fbd6098f700 1 -- 172.21.15.45:0/2854405596 learned_addr learned my addr 172.21.15.45:0/2854405596 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:07.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.093+0000 7fbd61190700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd5c100ac0 0x7fbd5c1980b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:54212/0 (socket says 172.21.15.45:54212) 2024-05-10T03:43:07.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.093+0000 7fbd61991700 1 --2- 172.21.15.45:0/2854405596 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd5c102580 0x7fbd5c19f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.093+0000 7fbd61991700 1 -- 172.21.15.45:0/2854405596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd5c100ac0 msgr2=0x7fbd5c1980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:07.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.093+0000 7fbd61991700 1 --2- 172.21.15.45:0/2854405596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd5c100ac0 0x7fbd5c1980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.093+0000 7fbd61991700 1 -- 172.21.15.45:0/2854405596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd5c101be0 msgr2=0x7fbd5c1985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:07.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.093+0000 7fbd61991700 1 --2- 172.21.15.45:0/2854405596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd5c101be0 0x7fbd5c1985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.093+0000 7fbd61991700 1 -- 172.21.15.45:0/2854405596 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd54009d00 con 0x7fbd5c102580 2024-05-10T03:43:07.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.093+0000 7fbd6098f700 1 --2- 172.21.15.45:0/2854405596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd5c101be0 0x7fbd5c1985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:43:07.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.093+0000 7fbd61190700 1 --2- 172.21.15.45:0/2854405596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd5c100ac0 0x7fbd5c1980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:43:07.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.093+0000 7fbd61991700 1 --2- 172.21.15.45:0/2854405596 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd5c102580 0x7fbd5c19f580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbd54007c30 tx=0x7fbd54008f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:07.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.093+0000 7fbd4e7fc700 1 -- 172.21.15.45:0/2854405596 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5400e040 con 0x7fbd5c102580 2024-05-10T03:43:07.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.093+0000 7fbd4e7fc700 1 -- 172.21.15.45:0/2854405596 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbd5401d470 con 0x7fbd5c102580 2024-05-10T03:43:07.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.093+0000 7fbd633f4700 1 -- 172.21.15.45:0/2854405596 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd5c1a0140 con 0x7fbd5c102580 2024-05-10T03:43:07.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.094+0000 7fbd4e7fc700 1 -- 172.21.15.45:0/2854405596 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5401b6c0 con 0x7fbd5c102580 2024-05-10T03:43:07.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.094+0000 7fbd633f4700 1 -- 172.21.15.45:0/2854405596 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd5c1a0560 con 0x7fbd5c102580 2024-05-10T03:43:07.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.096+0000 7fbd4e7fc700 1 -- 172.21.15.45:0/2854405596 <== mon.2 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fbd5401d950 con 0x7fbd5c102580 2024-05-10T03:43:07.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.097+0000 7fbd4e7fc700 1 --2- 172.21.15.45:0/2854405596 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fbd480a11c0 0x7fbd480a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.097+0000 7fbd61190700 1 --2- 172.21.15.45:0/2854405596 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fbd480a11c0 0x7fbd480a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.097+0000 7fbd4e7fc700 1 -- 172.21.15.45:0/2854405596 <== mon.2 v2:172.21.15.106:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fbd540cd790 con 0x7fbd5c102580 2024-05-10T03:43:07.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.098+0000 7fbd61190700 1 --2- 172.21.15.45:0/2854405596 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fbd480a11c0 0x7fbd480a36d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c101ae0 tx=0x7fbd58009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:07.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.098+0000 7fbd73738b80 1 Processor -- start 2024-05-10T03:43:07.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.098+0000 7fbd73738b80 1 -- start start 2024-05-10T03:43:07.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.098+0000 7fbd73738b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7d4c94ab0 0x55f7d4c94f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.098+0000 7fbd73738b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7d4c95980 0x55f7d4c95d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.098+0000 7fbd73738b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4c962d0 0x55f7d4c9cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.098+0000 7fbd73738b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d4bb7150 con 0x55f7d4c95980 2024-05-10T03:43:07.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.098+0000 7fbd73738b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d4bb4b10 con 0x55f7d4c962d0 2024-05-10T03:43:07.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.098+0000 7fbd73738b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d4bb0400 con 0x55f7d4c94ab0 2024-05-10T03:43:07.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.099+0000 7fbd61190700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7d4c94ab0 0x55f7d4c94f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.099+0000 7fbd6098f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7d4c95980 0x55f7d4c95d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.099+0000 7fbd61190700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7d4c94ab0 0x55f7d4c94f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:54226/0 (socket says 172.21.15.45:54226) 2024-05-10T03:43:07.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.099+0000 7fbd61991700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4c962d0 0x55f7d4c9cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.099+0000 7fbd61190700 1 -- 172.21.15.45:0/2621547106 learned_addr learned my addr 172.21.15.45:0/2621547106 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:07.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.099+0000 7fbd61190700 1 -- 172.21.15.45:0/2621547106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4c962d0 msgr2=0x55f7d4c9cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:07.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.099+0000 7fbd61190700 1 --2- 172.21.15.45:0/2621547106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4c962d0 0x55f7d4c9cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.099+0000 7fbd61190700 1 -- 172.21.15.45:0/2621547106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7d4c95980 msgr2=0x55f7d4c95d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:07.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.099+0000 7fbd61190700 1 --2- 172.21.15.45:0/2621547106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7d4c95980 0x55f7d4c95d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.099+0000 7fbd61190700 1 -- 172.21.15.45:0/2621547106 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7d4a313b0 con 0x55f7d4c94ab0 2024-05-10T03:43:07.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.099+0000 7fbd61991700 1 --2- 172.21.15.45:0/2621547106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4c962d0 0x55f7d4c9cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:43:07.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.099+0000 7fbd61190700 1 --2- 172.21.15.45:0/2621547106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7d4c94ab0 0x55f7d4c94f00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbd580043d0 tx=0x7fbd58014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=771459295583c4e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:07.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.099+0000 7fbd477fe700 1 -- 172.21.15.45:0/2621547106 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd58003ce0 con 0x55f7d4c94ab0 2024-05-10T03:43:07.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.099+0000 7fbd477fe700 1 -- 172.21.15.45:0/2621547106 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbd58003e40 con 0x55f7d4c94ab0 2024-05-10T03:43:07.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.099+0000 7fbd477fe700 1 -- 172.21.15.45:0/2621547106 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd580269a0 con 0x55f7d4c94ab0 2024-05-10T03:43:07.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.100+0000 7fbd73738b80 1 -- 172.21.15.45:0/2621547106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7d4c94ab0 msgr2=0x55f7d4c94f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:07.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.100+0000 7fbd73738b80 1 --2- 172.21.15.45:0/2621547106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7d4c94ab0 0x55f7d4c94f00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbd580043d0 tx=0x7fbd58014000 comp rx=0 tx=0).stop 2024-05-10T03:43:07.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.101+0000 7fbd73738b80 1 -- 172.21.15.45:0/2621547106 shutdown_connections 2024-05-10T03:43:07.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.101+0000 7fbd73738b80 1 --2- 172.21.15.45:0/2621547106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7d4c94ab0 0x55f7d4c94f00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.101+0000 7fbd73738b80 1 --2- 172.21.15.45:0/2621547106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4c962d0 0x55f7d4c9cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.101+0000 7fbd73738b80 1 --2- 172.21.15.45:0/2621547106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7d4c95980 0x55f7d4c95d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.101+0000 7fbd73738b80 1 -- 172.21.15.45:0/2621547106 >> 172.21.15.45:0/2621547106 conn(0x55f7d4bf2a60 msgr2=0x55f7d4c8afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:07.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.101+0000 7fbd73738b80 1 -- 172.21.15.45:0/2621547106 shutdown_connections 2024-05-10T03:43:07.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.101+0000 7fbd73738b80 1 -- 172.21.15.45:0/2621547106 wait complete. 2024-05-10T03:43:07.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.101+0000 7fbd73738b80 1 -- start start 2024-05-10T03:43:07.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.101+0000 7fbd73738b80 1 Processor -- start 2024-05-10T03:43:07.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.102+0000 7fbd73738b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7d4c94ab0 0x55f7d4c9eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.102+0000 7fbd73738b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7d4c95980 0x55f7d4c9f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.102+0000 7fbd73738b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4c962d0 0x55f7d4ca5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.102+0000 7fbd73738b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d4b4c560 con 0x55f7d4c95980 2024-05-10T03:43:07.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.102+0000 7fbd73738b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d4b4c200 con 0x55f7d4c962d0 2024-05-10T03:43:07.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.102+0000 7fbd73738b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d4a336a0 con 0x55f7d4c94ab0 2024-05-10T03:43:07.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.102+0000 7fbd73738b80 10 client.0 _ll_register_callbacks cb 0x55f7d4b55b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:43:07.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.102+0000 7fbd6098f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7d4c95980 0x55f7d4c9f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.102+0000 7fbd61190700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7d4c94ab0 0x55f7d4c9eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.102+0000 7fbd6098f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7d4c95980 0x55f7d4c9f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54172/0 (socket says 172.21.15.45:54172) 2024-05-10T03:43:07.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.102+0000 7fbd6098f700 1 -- 172.21.15.45:0/787972706 learned_addr learned my addr 172.21.15.45:0/787972706 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:07.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.102+0000 7fbd61991700 1 --2- 172.21.15.45:0/787972706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4c962d0 0x55f7d4ca5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.102+0000 7fbd61190700 1 -- 172.21.15.45:0/787972706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4c962d0 msgr2=0x55f7d4ca5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:07.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.102+0000 7fbd61190700 1 --2- 172.21.15.45:0/787972706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4c962d0 0x55f7d4ca5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.102+0000 7fbd61190700 1 -- 172.21.15.45:0/787972706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7d4c95980 msgr2=0x55f7d4c9f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:07.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.102+0000 7fbd61190700 1 --2- 172.21.15.45:0/787972706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7d4c95980 0x55f7d4c9f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.102+0000 7fbd61190700 1 -- 172.21.15.45:0/787972706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd5c1a0560 con 0x55f7d4c94ab0 2024-05-10T03:43:07.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.103+0000 7fbd61190700 1 --2- 172.21.15.45:0/787972706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7d4c94ab0 0x55f7d4c9eb30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55f7d4c94790 tx=0x7fbd58005770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ceff65da86fb082 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:07.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.103+0000 7fbd44ff9700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-05-10T03:43:07.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.105+0000 7fbd44ff9700 1 -- 172.21.15.45:0/787972706 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5802a040 con 0x55f7d4c94ab0 2024-05-10T03:43:07.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.105+0000 7fbd44ff9700 1 -- 172.21.15.45:0/787972706 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fbd58027d30 con 0x55f7d4c94ab0 2024-05-10T03:43:07.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.105+0000 7fbd73738b80 1 -- 172.21.15.45:0/787972706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f7d4b09270 con 0x55f7d4c94ab0 2024-05-10T03:43:07.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.105+0000 7fbd44ff9700 1 -- 172.21.15.45:0/787972706 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd58027ef0 con 0x55f7d4c94ab0 2024-05-10T03:43:07.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.105+0000 7fbd73738b80 10 client.26359 fetch_fsmap learned FSMap version 32 2024-05-10T03:43:07.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.105+0000 7fbd73738b80 1 -- 172.21.15.45:0/787972706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7fbd58017070 con 0x55f7d4c94ab0 2024-05-10T03:43:07.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.106+0000 7fbd44ff9700 1 -- 172.21.15.45:0/787972706 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55f7d4b09270 con 0x55f7d4c94ab0 2024-05-10T03:43:07.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.106+0000 7fbd44ff9700 1 -- 172.21.15.45:0/787972706 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 32) v1 ==== 7498+0+0 (secure 0 0 0) 0x7fbd58024020 con 0x55f7d4c94ab0 2024-05-10T03:43:07.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.106+0000 7fbd73738b80 10 client.26359 fetch_fsmap finished waiting for FSMap version 32 2024-05-10T03:43:07.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.106+0000 7fbd73738b80 10 client.26359 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:43:07.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.106+0000 7fbd73738b80 20 client.26359 populate_metadata read hostname 'smithi045' 2024-05-10T03:43:07.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.106+0000 7fbd73738b80 1 --2- 172.21.15.45:0/787972706 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f7d4caa6a0 0x55f7d4cacaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.106+0000 7fbd73738b80 4 client.26359 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:43:07.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.106+0000 7fbd73738b80 1 -- 172.21.15.45:0/787972706 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f7d4c5f780 con 0x55f7d4caa6a0 2024-05-10T03:43:07.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.106+0000 7fbd6098f700 1 --2- 172.21.15.45:0/787972706 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f7d4caa6a0 0x55f7d4cacaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.107+0000 7fbd44ff9700 10 client.26359 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:43:07.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.107+0000 7fbd6098f700 1 --2- 172.21.15.45:0/787972706 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f7d4caa6a0 0x55f7d4cacaf0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4efaaa201984e4dc server_cookie=3a3b084a8a4f4410 in_seq=0 out_seq=0 2024-05-10T03:43:07.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.107+0000 7fbd44ff9700 1 -- 172.21.15.45:0/787972706 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f7d4c5f780 con 0x55f7d4caa6a0 2024-05-10T03:43:07.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.107+0000 7fbd44ff9700 10 client.26359 handle_command_reply: tid=0 2024-05-10T03:43:07.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.107+0000 7fbd73738b80 1 client.26359 shutdown 2024-05-10T03:43:07.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.107+0000 7fbd73738b80 1 -- 172.21.15.45:0/787972706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7d4c94ab0 msgr2=0x55f7d4c9eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:07.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.107+0000 7fbd73738b80 1 --2- 172.21.15.45:0/787972706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7d4c94ab0 0x55f7d4c9eb30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55f7d4c94790 tx=0x7fbd58005770 comp rx=0 tx=0).stop 2024-05-10T03:43:07.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.108+0000 7fbd73738b80 1 -- 172.21.15.45:0/787972706 shutdown_connections 2024-05-10T03:43:07.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.108+0000 7fbd73738b80 1 --2- 172.21.15.45:0/787972706 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f7d4caa6a0 0x55f7d4cacaf0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.108+0000 7fbd73738b80 1 --2- 172.21.15.45:0/787972706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7d4c94ab0 0x55f7d4c9eb30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.108+0000 7fbd44ff9700 0 client.26359 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:43:07.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.108+0000 7fbd73738b80 1 --2- 172.21.15.45:0/787972706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4c962d0 0x55f7d4ca5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.108+0000 7fbd73738b80 1 --2- 172.21.15.45:0/787972706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7d4c95980 0x55f7d4c9f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.108+0000 7fbd73738b80 1 -- 172.21.15.45:0/787972706 >> 172.21.15.45:0/787972706 conn(0x55f7d4bf2a60 msgr2=0x55f7d4c8afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:07.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.108+0000 7fbd73738b80 1 -- 172.21.15.45:0/787972706 shutdown_connections 2024-05-10T03:43:07.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.108+0000 7fbd73738b80 1 -- 172.21.15.45:0/787972706 wait complete. 2024-05-10T03:43:07.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.108+0000 7fbd73738b80 20 client.26359 trim_cache size 0 max 16384 2024-05-10T03:43:07.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.129+0000 7fbd73738b80 1 Processor -- start 2024-05-10T03:43:07.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.129+0000 7fbd73738b80 1 -- start start 2024-05-10T03:43:07.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.129+0000 7fbd73738b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7d4bf2a60 0x55f7d4ca3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.129+0000 7fbd73738b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4c94ab0 0x55f7d4ca44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.129+0000 7fbd73738b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7d4c95980 0x55f7d4c9ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.129+0000 7fbd73738b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d4ca7110 con 0x55f7d4bf2a60 2024-05-10T03:43:07.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.129+0000 7fbd73738b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d4ca6a60 con 0x55f7d4c94ab0 2024-05-10T03:43:07.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.129+0000 7fbd73738b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d4c8b5a0 con 0x55f7d4c95980 2024-05-10T03:43:07.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.129+0000 7fbd61190700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7d4bf2a60 0x55f7d4ca3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.129+0000 7fbd61190700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7d4bf2a60 0x55f7d4ca3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54178/0 (socket says 172.21.15.45:54178) 2024-05-10T03:43:07.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.129+0000 7fbd61190700 1 -- 172.21.15.45:0/3955598257 learned_addr learned my addr 172.21.15.45:0/3955598257 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:07.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.129+0000 7fbd6098f700 1 --2- 172.21.15.45:0/3955598257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4c94ab0 0x55f7d4ca44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.129+0000 7fbd61991700 1 --2- 172.21.15.45:0/3955598257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7d4c95980 0x55f7d4c9ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.130+0000 7fbd6098f700 1 -- 172.21.15.45:0/3955598257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7d4c95980 msgr2=0x55f7d4c9ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:07.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.130+0000 7fbd6098f700 1 --2- 172.21.15.45:0/3955598257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7d4c95980 0x55f7d4c9ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.130+0000 7fbd6098f700 1 -- 172.21.15.45:0/3955598257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7d4bf2a60 msgr2=0x55f7d4ca3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:07.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.130+0000 7fbd6098f700 1 --2- 172.21.15.45:0/3955598257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7d4bf2a60 0x55f7d4ca3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.130+0000 7fbd6098f700 1 -- 172.21.15.45:0/3955598257 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7d49ddb60 con 0x55f7d4c94ab0 2024-05-10T03:43:07.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.130+0000 7fbd61190700 1 --2- 172.21.15.45:0/3955598257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7d4bf2a60 0x55f7d4ca3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:43:07.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.130+0000 7fbd6098f700 1 --2- 172.21.15.45:0/3955598257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4c94ab0 0x55f7d4ca44c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55f7d4caaab0 tx=0x7fbd50009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6eccee82654b731f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:07.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.130+0000 7fbd47fff700 1 -- 172.21.15.45:0/3955598257 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50017070 con 0x55f7d4c94ab0 2024-05-10T03:43:07.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.130+0000 7fbd47fff700 1 -- 172.21.15.45:0/3955598257 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbd50018040 con 0x55f7d4c94ab0 2024-05-10T03:43:07.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.130+0000 7fbd47fff700 1 -- 172.21.15.45:0/3955598257 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50005650 con 0x55f7d4c94ab0 2024-05-10T03:43:07.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.131+0000 7fbd73738b80 1 -- 172.21.15.45:0/3955598257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4c94ab0 msgr2=0x55f7d4ca44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:07.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.131+0000 7fbd73738b80 1 --2- 172.21.15.45:0/3955598257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4c94ab0 0x55f7d4ca44c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55f7d4caaab0 tx=0x7fbd50009260 comp rx=0 tx=0).stop 2024-05-10T03:43:07.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.131+0000 7fbd73738b80 1 -- 172.21.15.45:0/3955598257 shutdown_connections 2024-05-10T03:43:07.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.131+0000 7fbd73738b80 1 --2- 172.21.15.45:0/3955598257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7d4c95980 0x55f7d4c9ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.131+0000 7fbd73738b80 1 --2- 172.21.15.45:0/3955598257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7d4bf2a60 0x55f7d4ca3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.131+0000 7fbd73738b80 1 --2- 172.21.15.45:0/3955598257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4c94ab0 0x55f7d4ca44c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.131+0000 7fbd73738b80 1 -- 172.21.15.45:0/3955598257 >> 172.21.15.45:0/3955598257 conn(0x55f7d4c87450 msgr2=0x55f7d4c98bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:07.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.131+0000 7fbd73738b80 1 -- 172.21.15.45:0/3955598257 shutdown_connections 2024-05-10T03:43:07.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.131+0000 7fbd73738b80 1 -- 172.21.15.45:0/3955598257 wait complete. 2024-05-10T03:43:07.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.131+0000 7fbd73738b80 1 -- start start 2024-05-10T03:43:07.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.132+0000 7fbd73738b80 1 Processor -- start 2024-05-10T03:43:07.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.132+0000 7fbd73738b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7d4bf2a60 0x55f7d4cf8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.132+0000 7fbd73738b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7d4c94ab0 0x55f7d4cf92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.132+0000 7fbd73738b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4c95980 0x55f7d4cffbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.132+0000 7fbd73738b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d4d00120 con 0x55f7d4bf2a60 2024-05-10T03:43:07.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.132+0000 7fbd73738b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d4d00260 con 0x55f7d4c95980 2024-05-10T03:43:07.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.132+0000 7fbd73738b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d4d003f0 con 0x55f7d4c94ab0 2024-05-10T03:43:07.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.132+0000 7fbd73738b80 10 client.0 _ll_register_callbacks cb 0x55f7d4b55b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:43:07.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.132+0000 7fbd61190700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7d4bf2a60 0x55f7d4cf8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.132+0000 7fbd61190700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7d4bf2a60 0x55f7d4cf8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54182/0 (socket says 172.21.15.45:54182) 2024-05-10T03:43:07.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.132+0000 7fbd61190700 1 -- 172.21.15.45:0/2931125550 learned_addr learned my addr 172.21.15.45:0/2931125550 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:07.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.132+0000 7fbd6098f700 1 --2- 172.21.15.45:0/2931125550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7d4c94ab0 0x55f7d4cf92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.133+0000 7fbd61991700 1 --2- 172.21.15.45:0/2931125550 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4c95980 0x55f7d4cffbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.133+0000 7fbd61190700 1 -- 172.21.15.45:0/2931125550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7d4c94ab0 msgr2=0x55f7d4cf92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:07.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.133+0000 7fbd61190700 1 --2- 172.21.15.45:0/2931125550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7d4c94ab0 0x55f7d4cf92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.133+0000 7fbd61190700 1 -- 172.21.15.45:0/2931125550 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4c95980 msgr2=0x55f7d4cffbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:07.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.133+0000 7fbd61190700 1 --2- 172.21.15.45:0/2931125550 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4c95980 0x55f7d4cffbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.133+0000 7fbd61190700 1 -- 172.21.15.45:0/2931125550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd58017070 con 0x55f7d4bf2a60 2024-05-10T03:43:07.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.133+0000 7fbd61190700 1 --2- 172.21.15.45:0/2931125550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7d4bf2a60 0x55f7d4cf8da0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800e5c0 tx=0x7fbd5800e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767a5c265c881867 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:07.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.133+0000 7fbd44ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:43:07.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.133+0000 7fbd44ff9700 1 -- 172.21.15.45:0/2931125550 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5802a040 con 0x55f7d4bf2a60 2024-05-10T03:43:07.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.133+0000 7fbd73738b80 1 -- 172.21.15.45:0/2931125550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbd58003e40 con 0x55f7d4bf2a60 2024-05-10T03:43:07.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.133+0000 7fbd44ff9700 1 -- 172.21.15.45:0/2931125550 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fbd5800ee20 con 0x55f7d4bf2a60 2024-05-10T03:43:07.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.133+0000 7fbd44ff9700 1 -- 172.21.15.45:0/2931125550 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd580277a0 con 0x55f7d4bf2a60 2024-05-10T03:43:07.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.133+0000 7fbd73738b80 10 client.16509 fetch_fsmap learned FSMap version 32 2024-05-10T03:43:07.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.133+0000 7fbd73738b80 1 -- 172.21.15.45:0/2931125550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7fbd50004040 con 0x55f7d4bf2a60 2024-05-10T03:43:07.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.134+0000 7fbd44ff9700 1 -- 172.21.15.45:0/2931125550 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbd58003e40 con 0x55f7d4bf2a60 2024-05-10T03:43:07.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.134+0000 7fbd44ff9700 1 -- 172.21.15.45:0/2931125550 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 32) v1 ==== 7498+0+0 (secure 0 0 0) 0x7fbd58038070 con 0x55f7d4bf2a60 2024-05-10T03:43:07.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.134+0000 7fbd73738b80 10 client.16509 fetch_fsmap finished waiting for FSMap version 32 2024-05-10T03:43:07.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.134+0000 7fbd73738b80 10 client.16509 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:43:07.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.134+0000 7fbd73738b80 20 client.16509 populate_metadata read hostname 'smithi045' 2024-05-10T03:43:07.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.134+0000 7fbd73738b80 1 --2- 172.21.15.45:0/2931125550 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f7d4c962d0 0x55f7d4d03980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.134+0000 7fbd73738b80 4 client.16509 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-10T03:43:07.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.134+0000 7fbd73738b80 1 -- 172.21.15.45:0/2931125550 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f7d4ba8ec0 con 0x55f7d4c962d0 2024-05-10T03:43:07.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.135+0000 7fbd6098f700 1 --2- 172.21.15.45:0/2931125550 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f7d4c962d0 0x55f7d4d03980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.135+0000 7fbd44ff9700 10 client.16509 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:43:07.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.135+0000 7fbd6098f700 1 --2- 172.21.15.45:0/2931125550 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f7d4c962d0 0x55f7d4d03980 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f22520b6fe7eb00 server_cookie=af95173b0bfea959 in_seq=0 out_seq=0 2024-05-10T03:43:07.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.136+0000 7fbd44ff9700 1 -- 172.21.15.45:0/2931125550 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55f7d4ba8ec0 con 0x55f7d4c962d0 2024-05-10T03:43:07.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.136+0000 7fbd44ff9700 10 client.16509 handle_command_reply: tid=0 2024-05-10T03:43:07.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.136+0000 7fbd73738b80 1 client.16509 shutdown 2024-05-10T03:43:07.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.136+0000 7fbd73738b80 1 -- 172.21.15.45:0/2931125550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7d4bf2a60 msgr2=0x55f7d4cf8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:07.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.136+0000 7fbd73738b80 1 --2- 172.21.15.45:0/2931125550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7d4bf2a60 0x55f7d4cf8da0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800e5c0 tx=0x7fbd5800e5f0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.136+0000 7fbd73738b80 1 -- 172.21.15.45:0/2931125550 shutdown_connections 2024-05-10T03:43:07.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.136+0000 7fbd73738b80 1 --2- 172.21.15.45:0/2931125550 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f7d4c962d0 0x55f7d4d03980 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.136+0000 7fbd73738b80 1 --2- 172.21.15.45:0/2931125550 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4c95980 0x55f7d4cffbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.136+0000 7fbd73738b80 1 --2- 172.21.15.45:0/2931125550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f7d4bf2a60 0x55f7d4cf8da0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.136+0000 7fbd73738b80 1 --2- 172.21.15.45:0/2931125550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f7d4c94ab0 0x55f7d4cf92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.136+0000 7fbd44ff9700 0 client.16509 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:43:07.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.136+0000 7fbd73738b80 1 -- 172.21.15.45:0/2931125550 >> 172.21.15.45:0/2931125550 conn(0x55f7d4c87450 msgr2=0x55f7d4c98bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:07.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.136+0000 7fbd73738b80 1 -- 172.21.15.45:0/2931125550 shutdown_connections 2024-05-10T03:43:07.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.136+0000 7fbd73738b80 1 -- 172.21.15.45:0/2931125550 wait complete. 2024-05-10T03:43:07.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.136+0000 7fbd73738b80 20 client.16509 trim_cache size 0 max 16384 2024-05-10T03:43:07.148 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:43:07.148 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-05-10T03:43:07.148 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-05-10T03:43:07.148 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:43:07.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.137+0000 7fbd633f4700 1 -- 172.21.15.45:0/2854405596 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fbd480a11c0 msgr2=0x7fbd480a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:07.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.137+0000 7fbd633f4700 1 --2- 172.21.15.45:0/2854405596 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fbd480a11c0 0x7fbd480a36d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c101ae0 tx=0x7fbd58009260 comp rx=0 tx=0).stop 2024-05-10T03:43:07.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.137+0000 7fbd633f4700 1 -- 172.21.15.45:0/2854405596 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd5c102580 msgr2=0x7fbd5c19f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:07.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.137+0000 7fbd633f4700 1 --2- 172.21.15.45:0/2854405596 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd5c102580 0x7fbd5c19f580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbd54007c30 tx=0x7fbd54008f90 comp rx=0 tx=0).stop 2024-05-10T03:43:07.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.137+0000 7fbd633f4700 1 -- 172.21.15.45:0/2854405596 shutdown_connections 2024-05-10T03:43:07.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.137+0000 7fbd633f4700 1 --2- 172.21.15.45:0/2854405596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd5c100ac0 0x7fbd5c1980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.137+0000 7fbd633f4700 1 --2- 172.21.15.45:0/2854405596 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fbd480a11c0 0x7fbd480a36d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.137+0000 7fbd633f4700 1 --2- 172.21.15.45:0/2854405596 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd5c102580 0x7fbd5c19f580 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.137+0000 7fbd633f4700 1 --2- 172.21.15.45:0/2854405596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd5c101be0 0x7fbd5c1985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.137+0000 7fbd633f4700 1 -- 172.21.15.45:0/2854405596 >> 172.21.15.45:0/2854405596 conn(0x7fbd5c0fc0d0 msgr2=0x7fbd5c0fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:07.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.138+0000 7fbd633f4700 1 -- 172.21.15.45:0/2854405596 shutdown_connections 2024-05-10T03:43:07.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.138+0000 7fbd633f4700 1 -- 172.21.15.45:0/2854405596 wait complete. 2024-05-10T03:43:07.154 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-10T03:43:07.155 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:43:07.283 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:07 smithi045 ceph-mon[42520]: pgmap v370: 129 pgs: 129 active+clean; 171 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.7 MiB/s wr, 720 op/s 2024-05-10T03:43:07.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.305+0000 7fc80c85f700 1 -- 172.21.15.45:0/741108910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc808069090 msgr2=0x7fc808104720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:07.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.305+0000 7fc80c85f700 1 --2- 172.21.15.45:0/741108910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc808069090 0x7fc808104720 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8009990 tx=0x7fc7f8009ca0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.305+0000 7fc80c85f700 1 -- 172.21.15.45:0/741108910 shutdown_connections 2024-05-10T03:43:07.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.305+0000 7fc80c85f700 1 --2- 172.21.15.45:0/741108910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc808107880 0x7fc808109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.305+0000 7fc80c85f700 1 --2- 172.21.15.45:0/741108910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc808069090 0x7fc808104720 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.305+0000 7fc80c85f700 1 --2- 172.21.15.45:0/741108910 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc808104d10 0x7fc8081071f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.305+0000 7fc80c85f700 1 -- 172.21.15.45:0/741108910 >> 172.21.15.45:0/741108910 conn(0x7fc8080fc0d0 msgr2=0x7fc8080fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:07.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.305+0000 7fc80c85f700 1 -- 172.21.15.45:0/741108910 shutdown_connections 2024-05-10T03:43:07.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.305+0000 7fc80c85f700 1 -- 172.21.15.45:0/741108910 wait complete. 2024-05-10T03:43:07.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.306+0000 7fc80c85f700 1 Processor -- start 2024-05-10T03:43:07.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.306+0000 7fc80c85f700 1 -- start start 2024-05-10T03:43:07.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.306+0000 7fc80c85f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc808069090 0x7fc808101f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.306+0000 7fc80c85f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc808104d10 0x7fc808100620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.306+0000 7fc80c85f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc808107880 0x7fc808100b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.306+0000 7fc80c85f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc808101240 con 0x7fc808104d10 2024-05-10T03:43:07.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.306+0000 7fc80c85f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8081013b0 con 0x7fc808107880 2024-05-10T03:43:07.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.306+0000 7fc80c85f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8081a2140 con 0x7fc808069090 2024-05-10T03:43:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.306+0000 7fc805d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc808104d10 0x7fc808100620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.306+0000 7fc805d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc808104d10 0x7fc808100620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45540/0 (socket says 172.21.15.45:45540) 2024-05-10T03:43:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.306+0000 7fc805d9b700 1 -- 172.21.15.45:0/2600493694 learned_addr learned my addr 172.21.15.45:0/2600493694 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.306+0000 7fc80659c700 1 --2- 172.21.15.45:0/2600493694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc808069090 0x7fc808101f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.306+0000 7fc806d9d700 1 --2- 172.21.15.45:0/2600493694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc808107880 0x7fc808100b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.306+0000 7fc805d9b700 1 -- 172.21.15.45:0/2600493694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc808069090 msgr2=0x7fc808101f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.306+0000 7fc805d9b700 1 --2- 172.21.15.45:0/2600493694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc808069090 0x7fc808101f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.306+0000 7fc805d9b700 1 -- 172.21.15.45:0/2600493694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc808107880 msgr2=0x7fc808100b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.306+0000 7fc805d9b700 1 --2- 172.21.15.45:0/2600493694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc808107880 0x7fc808100b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.307+0000 7fc805d9b700 1 -- 172.21.15.45:0/2600493694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f80095f0 con 0x7fc808104d10 2024-05-10T03:43:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.307+0000 7fc805d9b700 1 --2- 172.21.15.45:0/2600493694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc808104d10 0x7fc808100620 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc7f000e9a0 tx=0x7fc7f000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:07.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.307+0000 7fc7ff7fe700 1 -- 172.21.15.45:0/2600493694 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f0009790 con 0x7fc808104d10 2024-05-10T03:43:07.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.307+0000 7fc7ff7fe700 1 -- 172.21.15.45:0/2600493694 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc7f0010430 con 0x7fc808104d10 2024-05-10T03:43:07.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.307+0000 7fc7ff7fe700 1 -- 172.21.15.45:0/2600493694 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f0018680 con 0x7fc808104d10 2024-05-10T03:43:07.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.307+0000 7fc80c85f700 1 -- 172.21.15.45:0/2600493694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8081a23a0 con 0x7fc808104d10 2024-05-10T03:43:07.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.307+0000 7fc80c85f700 1 -- 172.21.15.45:0/2600493694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8081a2880 con 0x7fc808104d10 2024-05-10T03:43:07.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.308+0000 7fc80c85f700 1 -- 172.21.15.45:0/2600493694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8080fdc80 con 0x7fc808104d10 2024-05-10T03:43:07.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.310+0000 7fc7ff7fe700 1 -- 172.21.15.45:0/2600493694 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc7f0010910 con 0x7fc808104d10 2024-05-10T03:43:07.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.311+0000 7fc7ff7fe700 1 --2- 172.21.15.45:0/2600493694 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc7f40a11a0 0x7fc7f40a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.311+0000 7fc7ff7fe700 1 -- 172.21.15.45:0/2600493694 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fc7f0014070 con 0x7fc808104d10 2024-05-10T03:43:07.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.311+0000 7fc80659c700 1 --2- 172.21.15.45:0/2600493694 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc7f40a11a0 0x7fc7f40a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.312+0000 7fc80659c700 1 --2- 172.21.15.45:0/2600493694 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc7f40a11a0 0x7fc7f40a36b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8006010 tx=0x7fc7f801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:07.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.315+0000 7fc7ff7fe700 1 -- 172.21.15.45:0/2600493694 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc7f00966a0 con 0x7fc808104d10 2024-05-10T03:43:07.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:07 smithi106 ceph-mon[46996]: pgmap v370: 129 pgs: 129 active+clean; 171 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.7 MiB/s wr, 720 op/s 2024-05-10T03:43:07.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:07 smithi154 ceph-mon[46565]: pgmap v370: 129 pgs: 129 active+clean; 171 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.7 MiB/s wr, 720 op/s 2024-05-10T03:43:07.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.789+0000 7fc80c85f700 1 -- 172.21.15.45:0/2600493694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8080694d0 con 0x7fc808104d10 2024-05-10T03:43:07.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.789+0000 7fc7ff7fe700 1 -- 172.21.15.45:0/2600493694 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+10938 (secure 0 0 0) 0x7fc7f0026090 con 0x7fc808104d10 2024-05-10T03:43:07.792 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:43:07.792 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/378320264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":378320264},{"type":"v1","addr":"172.21.15.45:6835","nonce":378320264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3032381796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3032381796},{"type":"v1","addr":"172.21.15.45:6837","nonce":3032381796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T03:38:36.555290+0000","modified":"2024-05-10T03:43:07.095113+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24548,"mds_2":24547,"mds_3":24526,"mds_4":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14625":{"gid":14625,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6839/4007419304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":4007419304},{"type":"v1","addr":"172.21.15.45:6839","nonce":4007419304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14637":{"gid":14637,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6841/1355456195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1355456195},{"type":"v1","addr":"172.21.15.45:6841","nonce":1355456195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/4037121210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":4037121210},{"type":"v1","addr":"172.21.15.154:6835","nonce":4037121210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24521":{"gid":24521,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.106:6835/4162885659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4162885659},{"type":"v1","addr":"172.21.15.106:6835","nonce":4162885659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.154:6837/608167481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":608167481},{"type":"v1","addr":"172.21.15.154:6837","nonce":608167481}]},"join_fscid":-1,"export_targets":[2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":65,"addr":"172.21.15.154:6839/1506563336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1506563336},{"type":"v1","addr":"172.21.15.154:6839","nonce":1506563336}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.106:6837/3047487403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":3047487403},{"type":"v1","addr":"172.21.15.106:6837","nonce":3047487403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6839/3533867856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":3533867856},{"type":"v1","addr":"172.21.15.106:6839","nonce":3533867856}]},"join_fscid":-1,"export_targets":[2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T03:43:07.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.792+0000 7fc80c85f700 1 -- 172.21.15.45:0/2600493694 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc7f40a11a0 msgr2=0x7fc7f40a36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:07.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.792+0000 7fc80c85f700 1 --2- 172.21.15.45:0/2600493694 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc7f40a11a0 0x7fc7f40a36b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8006010 tx=0x7fc7f801a040 comp rx=0 tx=0).stop 2024-05-10T03:43:07.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.792+0000 7fc80c85f700 1 -- 172.21.15.45:0/2600493694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc808104d10 msgr2=0x7fc808100620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:07.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.792+0000 7fc80c85f700 1 --2- 172.21.15.45:0/2600493694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc808104d10 0x7fc808100620 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc7f000e9a0 tx=0x7fc7f000ecb0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.792+0000 7fc80c85f700 1 -- 172.21.15.45:0/2600493694 shutdown_connections 2024-05-10T03:43:07.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.792+0000 7fc80c85f700 1 --2- 172.21.15.45:0/2600493694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc808069090 0x7fc808101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.792+0000 7fc80c85f700 1 --2- 172.21.15.45:0/2600493694 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fc7f40a11a0 0x7fc7f40a36b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.792+0000 7fc80c85f700 1 --2- 172.21.15.45:0/2600493694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc808107880 0x7fc808100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.792+0000 7fc80c85f700 1 --2- 172.21.15.45:0/2600493694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc808104d10 0x7fc808100620 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.792+0000 7fc80c85f700 1 -- 172.21.15.45:0/2600493694 >> 172.21.15.45:0/2600493694 conn(0x7fc8080fc0d0 msgr2=0x7fc808102f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:07.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.792+0000 7fc80c85f700 1 -- 172.21.15.45:0/2600493694 shutdown_connections 2024-05-10T03:43:07.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.792+0000 7fc80c85f700 1 -- 172.21.15.45:0/2600493694 wait complete. 2024-05-10T03:43:07.796 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 32 2024-05-10T03:43:07.809 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-05-10T03:43:07.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.962+0000 7f32aa8d2700 1 -- 172.21.15.45:0/3365317970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32a4101a70 msgr2=0x7f32a4101f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:07.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.962+0000 7f32aa8d2700 1 --2- 172.21.15.45:0/3365317970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32a4101a70 0x7f32a4101f40 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f328c009990 tx=0x7f328c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.962+0000 7f32aa8d2700 1 -- 172.21.15.45:0/3365317970 shutdown_connections 2024-05-10T03:43:07.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.962+0000 7f32aa8d2700 1 --2- 172.21.15.45:0/3365317970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32a4101090 0x7f32a41014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.962+0000 7f32aa8d2700 1 --2- 172.21.15.45:0/3365317970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32a41025d0 0x7f32a4109050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.962+0000 7f32aa8d2700 1 --2- 172.21.15.45:0/3365317970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32a4101a70 0x7f32a4101f40 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.962+0000 7f32aa8d2700 1 -- 172.21.15.45:0/3365317970 >> 172.21.15.45:0/3365317970 conn(0x7f32a40fb8f0 msgr2=0x7f32a40fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:07.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.962+0000 7f32aa8d2700 1 -- 172.21.15.45:0/3365317970 shutdown_connections 2024-05-10T03:43:07.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.962+0000 7f32aa8d2700 1 -- 172.21.15.45:0/3365317970 wait complete. 2024-05-10T03:43:07.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.962+0000 7f32aa8d2700 1 Processor -- start 2024-05-10T03:43:07.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.963+0000 7f32aa8d2700 1 -- start start 2024-05-10T03:43:07.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.963+0000 7f32aa8d2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32a4101090 0x7f32a4198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.963+0000 7f32aa8d2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32a4101a70 0x7f32a4198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.963+0000 7f32aa8d2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32a41025d0 0x7f32a419f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.963+0000 7f32aa8d2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a419faf0 con 0x7f32a41025d0 2024-05-10T03:43:07.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.963+0000 7f32aa8d2700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a419fc60 con 0x7f32a4101a70 2024-05-10T03:43:07.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.963+0000 7f32aa8d2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a419fe20 con 0x7f32a4101090 2024-05-10T03:43:07.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.963+0000 7f32a8e6f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32a41025d0 0x7f32a419f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.963+0000 7f32a8e6f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32a41025d0 0x7f32a419f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45570/0 (socket says 172.21.15.45:45570) 2024-05-10T03:43:07.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.963+0000 7f32a8e6f700 1 -- 172.21.15.45:0/4173250715 learned_addr learned my addr 172.21.15.45:0/4173250715 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:07.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.963+0000 7f32a3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32a4101090 0x7f32a4198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.963+0000 7f32a37fe700 1 --2- 172.21.15.45:0/4173250715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32a4101a70 0x7f32a4198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.963+0000 7f32a8e6f700 1 -- 172.21.15.45:0/4173250715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32a4101090 msgr2=0x7f32a4198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:07.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.963+0000 7f32a8e6f700 1 --2- 172.21.15.45:0/4173250715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32a4101090 0x7f32a4198010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.963+0000 7f32a8e6f700 1 -- 172.21.15.45:0/4173250715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32a4101a70 msgr2=0x7f32a4198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:07.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.963+0000 7f32a8e6f700 1 --2- 172.21.15.45:0/4173250715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32a4101a70 0x7f32a4198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.964+0000 7f32a8e6f700 1 -- 172.21.15.45:0/4173250715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328c0095f0 con 0x7f32a41025d0 2024-05-10T03:43:07.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.964+0000 7f32a8e6f700 1 --2- 172.21.15.45:0/4173250715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32a41025d0 0x7f32a419f4e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f329c00ef30 tx=0x7f329c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:07.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.964+0000 7f32a17fa700 1 -- 172.21.15.45:0/4173250715 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c018070 con 0x7f32a41025d0 2024-05-10T03:43:07.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.964+0000 7f32a17fa700 1 -- 172.21.15.45:0/4173250715 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f329c00f040 con 0x7f32a41025d0 2024-05-10T03:43:07.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.964+0000 7f32aa8d2700 1 -- 172.21.15.45:0/4173250715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a41a00a0 con 0x7f32a41025d0 2024-05-10T03:43:07.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.964+0000 7f32a17fa700 1 -- 172.21.15.45:0/4173250715 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c00cd50 con 0x7f32a41025d0 2024-05-10T03:43:07.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.964+0000 7f32aa8d2700 1 -- 172.21.15.45:0/4173250715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a41a0560 con 0x7f32a41025d0 2024-05-10T03:43:07.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.967+0000 7f32a17fa700 1 -- 172.21.15.45:0/4173250715 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f329c004000 con 0x7f32a41025d0 2024-05-10T03:43:07.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.967+0000 7f32a17fa700 1 --2- 172.21.15.45:0/4173250715 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f32900a11c0 0x7f32900a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.968+0000 7f32a3fff700 1 --2- 172.21.15.45:0/4173250715 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f32900a11c0 0x7f32900a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.968+0000 7f32a17fa700 1 -- 172.21.15.45:0/4173250715 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f329c0cc750 con 0x7f32a41025d0 2024-05-10T03:43:07.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.968+0000 7f32bac16b80 1 Processor -- start 2024-05-10T03:43:07.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.968+0000 7f32bac16b80 1 -- start start 2024-05-10T03:43:07.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.968+0000 7f32a3fff700 1 --2- 172.21.15.45:0/4173250715 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f32900a11c0 0x7f32900a36d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f32a4068330 tx=0x7f3294009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:07.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.968+0000 7f32bac16b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fddbe9ab0 0x561fddbe9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.968+0000 7f32bac16b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fddbea980 0x561fddbead90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.968+0000 7f32bac16b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fddbeb2d0 0x561fddbf1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.968+0000 7f32bac16b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fddb0c150 con 0x561fddbe9ab0 2024-05-10T03:43:07.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.968+0000 7f32bac16b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fddb09b10 con 0x561fddbea980 2024-05-10T03:43:07.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.968+0000 7f32bac16b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fddb05400 con 0x561fddbeb2d0 2024-05-10T03:43:07.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.968+0000 7f32a3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fddbe9ab0 0x561fddbe9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.968+0000 7f32a3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fddbe9ab0 0x561fddbe9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45582/0 (socket says 172.21.15.45:45582) 2024-05-10T03:43:07.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.968+0000 7f32a3fff700 1 -- 172.21.15.45:0/4000077309 learned_addr learned my addr 172.21.15.45:0/4000077309 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:07.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.968+0000 7f32a8e6f700 1 --2- 172.21.15.45:0/4000077309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fddbeb2d0 0x561fddbf1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.968+0000 7f32a37fe700 1 --2- 172.21.15.45:0/4000077309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fddbea980 0x561fddbead90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.969+0000 7f32a3fff700 1 -- 172.21.15.45:0/4000077309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fddbeb2d0 msgr2=0x561fddbf1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:07.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.969+0000 7f32a3fff700 1 --2- 172.21.15.45:0/4000077309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fddbeb2d0 0x561fddbf1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.969+0000 7f32a3fff700 1 -- 172.21.15.45:0/4000077309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fddbea980 msgr2=0x561fddbead90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:07.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.969+0000 7f32a3fff700 1 --2- 172.21.15.45:0/4000077309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fddbea980 0x561fddbead90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.969+0000 7f32a3fff700 1 -- 172.21.15.45:0/4000077309 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fdd9863b0 con 0x561fddbe9ab0 2024-05-10T03:43:07.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.969+0000 7f32a3fff700 1 --2- 172.21.15.45:0/4000077309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fddbe9ab0 0x561fddbe9f00 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3294011d20 tx=0x7f3294014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbee06c5604877ac server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:07.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.969+0000 7f329a7fc700 1 -- 172.21.15.45:0/4000077309 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329400eb20 con 0x561fddbe9ab0 2024-05-10T03:43:07.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.969+0000 7f329a7fc700 1 -- 172.21.15.45:0/4000077309 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3294021070 con 0x561fddbe9ab0 2024-05-10T03:43:07.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.969+0000 7f329a7fc700 1 -- 172.21.15.45:0/4000077309 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329401d670 con 0x561fddbe9ab0 2024-05-10T03:43:07.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.970+0000 7f32bac16b80 1 -- 172.21.15.45:0/4000077309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fddbe9ab0 msgr2=0x561fddbe9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:07.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.970+0000 7f32bac16b80 1 --2- 172.21.15.45:0/4000077309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fddbe9ab0 0x561fddbe9f00 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3294011d20 tx=0x7f3294014000 comp rx=0 tx=0).stop 2024-05-10T03:43:07.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.970+0000 7f32bac16b80 1 -- 172.21.15.45:0/4000077309 shutdown_connections 2024-05-10T03:43:07.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.970+0000 7f32bac16b80 1 --2- 172.21.15.45:0/4000077309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fddbeb2d0 0x561fddbf1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.970+0000 7f32bac16b80 1 --2- 172.21.15.45:0/4000077309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fddbe9ab0 0x561fddbe9f00 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.970+0000 7f32bac16b80 1 --2- 172.21.15.45:0/4000077309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fddbea980 0x561fddbead90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.970+0000 7f32bac16b80 1 -- 172.21.15.45:0/4000077309 >> 172.21.15.45:0/4000077309 conn(0x561fddb47a60 msgr2=0x561fddbdffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:07.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.970+0000 7f32bac16b80 1 -- 172.21.15.45:0/4000077309 shutdown_connections 2024-05-10T03:43:07.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.970+0000 7f32bac16b80 1 -- 172.21.15.45:0/4000077309 wait complete. 2024-05-10T03:43:07.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.971+0000 7f32bac16b80 1 -- start start 2024-05-10T03:43:07.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.971+0000 7f32bac16b80 1 Processor -- start 2024-05-10T03:43:07.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.971+0000 7f32bac16b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fddbe9ab0 0x561fddbf3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.971+0000 7f32bac16b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fddbea980 0x561fddbf4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.971+0000 7f32bac16b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fddbeb2d0 0x561fddbfaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.971+0000 7f32bac16b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fddaa1560 con 0x561fddbe9ab0 2024-05-10T03:43:07.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.971+0000 7f32bac16b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fddaa1200 con 0x561fddbeb2d0 2024-05-10T03:43:07.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.971+0000 7f32bac16b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fdd9886a0 con 0x561fddbea980 2024-05-10T03:43:07.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.971+0000 7f32bac16b80 10 client.0 _ll_register_callbacks cb 0x561fddaaab30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:43:07.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.971+0000 7f32a3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fddbe9ab0 0x561fddbf3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.971+0000 7f32a3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fddbe9ab0 0x561fddbf3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45596/0 (socket says 172.21.15.45:45596) 2024-05-10T03:43:07.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.971+0000 7f32a3fff700 1 -- 172.21.15.45:0/1299593798 learned_addr learned my addr 172.21.15.45:0/1299593798 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:07.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.971+0000 7f32a37fe700 1 --2- 172.21.15.45:0/1299593798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fddbea980 0x561fddbf4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.971+0000 7f32a8e6f700 1 --2- 172.21.15.45:0/1299593798 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fddbeb2d0 0x561fddbfaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.972+0000 7f32a37fe700 1 -- 172.21.15.45:0/1299593798 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fddbeb2d0 msgr2=0x561fddbfaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:07.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.972+0000 7f32a37fe700 1 --2- 172.21.15.45:0/1299593798 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fddbeb2d0 0x561fddbfaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.972+0000 7f32a37fe700 1 -- 172.21.15.45:0/1299593798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fddbe9ab0 msgr2=0x561fddbf3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:07.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.972+0000 7f32a37fe700 1 --2- 172.21.15.45:0/1299593798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fddbe9ab0 0x561fddbf3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.972+0000 7f32a37fe700 1 -- 172.21.15.45:0/1299593798 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3294017070 con 0x561fddbea980 2024-05-10T03:43:07.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.972+0000 7f32a8e6f700 1 --2- 172.21.15.45:0/1299593798 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fddbeb2d0 0x561fddbfaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:43:07.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.972+0000 7f32a37fe700 1 --2- 172.21.15.45:0/1299593798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fddbea980 0x561fddbf4030 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f328c00b8b0 tx=0x7f328c005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ebe57ebaa054a89 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:07.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.972+0000 7f32837fe700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-05-10T03:43:07.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.972+0000 7f32837fe700 1 -- 172.21.15.45:0/1299593798 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c004910 con 0x561fddbea980 2024-05-10T03:43:07.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.972+0000 7f32837fe700 1 -- 172.21.15.45:0/1299593798 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f328c0056c0 con 0x561fddbea980 2024-05-10T03:43:07.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.972+0000 7f32bac16b80 1 -- 172.21.15.45:0/1299593798 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561fdda5e270 con 0x561fddbea980 2024-05-10T03:43:07.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.972+0000 7f32837fe700 1 -- 172.21.15.45:0/1299593798 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f328c00be70 con 0x561fddbea980 2024-05-10T03:43:07.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.972+0000 7f32bac16b80 10 client.26383 fetch_fsmap learned FSMap version 32 2024-05-10T03:43:07.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.972+0000 7f32bac16b80 1 -- 172.21.15.45:0/1299593798 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x561fdd932b60 con 0x561fddbea980 2024-05-10T03:43:07.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.973+0000 7f32837fe700 1 -- 172.21.15.45:0/1299593798 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x561fdda5e270 con 0x561fddbea980 2024-05-10T03:43:07.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.973+0000 7f32837fe700 1 -- 172.21.15.45:0/1299593798 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 32) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f328c024b50 con 0x561fddbea980 2024-05-10T03:43:07.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.973+0000 7f32bac16b80 10 client.26383 fetch_fsmap finished waiting for FSMap version 32 2024-05-10T03:43:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.973+0000 7f32bac16b80 10 client.26383 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2024-05-10T03:43:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.973+0000 7f32bac16b80 20 client.26383 populate_metadata read hostname 'smithi045' 2024-05-10T03:43:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.973+0000 7f32bac16b80 1 --2- 172.21.15.45:0/1299593798 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x561fddbff790 0x561fddc01be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.973+0000 7f32bac16b80 4 client.26383 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:43:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.973+0000 7f32bac16b80 1 -- 172.21.15.45:0/1299593798 --> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561fddbb4780 con 0x561fddbff790 2024-05-10T03:43:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.973+0000 7f32a3fff700 1 --2- 172.21.15.45:0/1299593798 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x561fddbff790 0x561fddc01be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.974+0000 7f32837fe700 10 client.26383 ms_handle_connect on v2:172.21.15.106:6834/4162885659 2024-05-10T03:43:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.974+0000 7f32a3fff700 1 --2- 172.21.15.45:0/1299593798 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x561fddbff790 0x561fddc01be0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=82a497bd7d3c26d4 server_cookie=2da0a44e64845c4b in_seq=0 out_seq=0 2024-05-10T03:43:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.974+0000 7f32837fe700 1 -- 172.21.15.45:0/1299593798 <== mds.4 v2:172.21.15.106:6834/4162885659 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561fddbb4780 con 0x561fddbff790 2024-05-10T03:43:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.974+0000 7f32837fe700 10 client.26383 handle_command_reply: tid=0 2024-05-10T03:43:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.974+0000 7f32bac16b80 1 client.26383 shutdown 2024-05-10T03:43:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.974+0000 7f32bac16b80 1 -- 172.21.15.45:0/1299593798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fddbea980 msgr2=0x561fddbf4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.974+0000 7f32bac16b80 1 --2- 172.21.15.45:0/1299593798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fddbea980 0x561fddbf4030 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f328c00b8b0 tx=0x7f328c005270 comp rx=0 tx=0).stop 2024-05-10T03:43:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.974+0000 7f32bac16b80 1 -- 172.21.15.45:0/1299593798 shutdown_connections 2024-05-10T03:43:07.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.974+0000 7f32bac16b80 1 --2- 172.21.15.45:0/1299593798 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x561fddbff790 0x561fddc01be0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.974+0000 7f32bac16b80 1 --2- 172.21.15.45:0/1299593798 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fddbeb2d0 0x561fddbfaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.974+0000 7f32bac16b80 1 --2- 172.21.15.45:0/1299593798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fddbe9ab0 0x561fddbf3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.974+0000 7f32bac16b80 1 --2- 172.21.15.45:0/1299593798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fddbea980 0x561fddbf4030 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.974+0000 7f32837fe700 0 client.26383 ms_handle_reset on v2:172.21.15.106:6834/4162885659 2024-05-10T03:43:07.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.974+0000 7f32bac16b80 1 -- 172.21.15.45:0/1299593798 >> 172.21.15.45:0/1299593798 conn(0x561fddb47a60 msgr2=0x561fddbdffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:07.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.975+0000 7f32bac16b80 1 -- 172.21.15.45:0/1299593798 shutdown_connections 2024-05-10T03:43:07.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.975+0000 7f32bac16b80 1 -- 172.21.15.45:0/1299593798 wait complete. 2024-05-10T03:43:07.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.975+0000 7f32bac16b80 20 client.26383 trim_cache size 0 max 16384 2024-05-10T03:43:07.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.989+0000 7f32bac16b80 1 Processor -- start 2024-05-10T03:43:07.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.989+0000 7f32bac16b80 1 -- start start 2024-05-10T03:43:07.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.989+0000 7f32bac16b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fddbe9ab0 0x561fddbea110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.989+0000 7f32bac16b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fddbea980 0x561fddbf3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.989+0000 7f32bac16b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fddbeb2d0 0x561fddbf8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.990+0000 7f32bac16b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fddbee2f0 con 0x561fddbea980 2024-05-10T03:43:07.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.990+0000 7f32bac16b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fddbfc0c0 con 0x561fddbe9ab0 2024-05-10T03:43:07.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.990+0000 7f32bac16b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fddbf49b0 con 0x561fddbeb2d0 2024-05-10T03:43:07.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.990+0000 7f32a37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fddbea980 0x561fddbf3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.990+0000 7f32a3fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fddbe9ab0 0x561fddbea110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.990+0000 7f32a3fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fddbe9ab0 0x561fddbea110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.45:37058/0 (socket says 172.21.15.45:37058) 2024-05-10T03:43:07.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.990+0000 7f32a8e6f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fddbeb2d0 0x561fddbf8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:07.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.990+0000 7f32a3fff700 1 -- 172.21.15.45:0/2515175111 learned_addr learned my addr 172.21.15.45:0/2515175111 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:07.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.990+0000 7f32a37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fddbea980 0x561fddbf3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45598/0 (socket says 172.21.15.45:45598) 2024-05-10T03:43:07.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.990+0000 7f32a3fff700 1 -- 172.21.15.45:0/2515175111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fddbeb2d0 msgr2=0x561fddbf8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:07.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.990+0000 7f32a3fff700 1 --2- 172.21.15.45:0/2515175111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fddbeb2d0 0x561fddbf8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.990+0000 7f32a3fff700 1 -- 172.21.15.45:0/2515175111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fddbea980 msgr2=0x561fddbf3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:07.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.990+0000 7f32a3fff700 1 --2- 172.21.15.45:0/2515175111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fddbea980 0x561fddbf3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.990+0000 7f32a3fff700 1 -- 172.21.15.45:0/2515175111 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fddacb560 con 0x561fddbe9ab0 2024-05-10T03:43:07.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.990+0000 7f32a3fff700 1 --2- 172.21.15.45:0/2515175111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fddbe9ab0 0x561fddbea110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x561fddc024a0 tx=0x7f329401cb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40f1e8fb9027546a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:07.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.990+0000 7f329affd700 1 -- 172.21.15.45:0/2515175111 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329401cc60 con 0x561fddbe9ab0 2024-05-10T03:43:07.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.990+0000 7f329affd700 1 -- 172.21.15.45:0/2515175111 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f329401c8f0 con 0x561fddbe9ab0 2024-05-10T03:43:07.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.990+0000 7f329affd700 1 -- 172.21.15.45:0/2515175111 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3294005660 con 0x561fddbe9ab0 2024-05-10T03:43:07.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.991+0000 7f32bac16b80 1 -- 172.21.15.45:0/2515175111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fddbe9ab0 msgr2=0x561fddbea110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:07.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.991+0000 7f32bac16b80 1 --2- 172.21.15.45:0/2515175111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fddbe9ab0 0x561fddbea110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x561fddc024a0 tx=0x7f329401cb50 comp rx=0 tx=0).stop 2024-05-10T03:43:07.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.991+0000 7f32bac16b80 1 -- 172.21.15.45:0/2515175111 shutdown_connections 2024-05-10T03:43:07.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.991+0000 7f32bac16b80 1 --2- 172.21.15.45:0/2515175111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fddbeb2d0 0x561fddbf8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.991+0000 7f32bac16b80 1 --2- 172.21.15.45:0/2515175111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fddbe9ab0 0x561fddbea110 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.991+0000 7f32bac16b80 1 --2- 172.21.15.45:0/2515175111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fddbea980 0x561fddbf3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:07.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.991+0000 7f32bac16b80 1 -- 172.21.15.45:0/2515175111 >> 172.21.15.45:0/2515175111 conn(0x561fddb47a60 msgr2=0x561fddbedbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:07.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.991+0000 7f32bac16b80 1 -- 172.21.15.45:0/2515175111 shutdown_connections 2024-05-10T03:43:07.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.991+0000 7f32bac16b80 1 -- 172.21.15.45:0/2515175111 wait complete. 2024-05-10T03:43:07.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.992+0000 7f32bac16b80 1 -- start start 2024-05-10T03:43:07.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.992+0000 7f32bac16b80 1 Processor -- start 2024-05-10T03:43:07.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.992+0000 7f32bac16b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fddbe9ab0 0x561fddbf8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.992+0000 7f32bac16b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fddbea980 0x561fddbf8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:07.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.992+0000 7f32bac16b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fddbeb2d0 0x561fddc54070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.992+0000 7f32bac16b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fddc545b0 con 0x561fddbea980 2024-05-10T03:43:08.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.992+0000 7f32bac16b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fddc546f0 con 0x561fddbe9ab0 2024-05-10T03:43:08.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.992+0000 7f32bac16b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fddc54880 con 0x561fddbeb2d0 2024-05-10T03:43:08.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.992+0000 7f32bac16b80 10 client.0 _ll_register_callbacks cb 0x561fddaaab30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:43:08.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.992+0000 7f32a37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fddbea980 0x561fddbf8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.992+0000 7f32a3fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fddbe9ab0 0x561fddbf8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.993+0000 7f32a3fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fddbe9ab0 0x561fddbf8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.45:37060/0 (socket says 172.21.15.45:37060) 2024-05-10T03:43:08.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.993+0000 7f32a3fff700 1 -- 172.21.15.45:0/2221353449 learned_addr learned my addr 172.21.15.45:0/2221353449 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:08.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.993+0000 7f32a8e6f700 1 --2- 172.21.15.45:0/2221353449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fddbeb2d0 0x561fddc54070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.993+0000 7f32a3fff700 1 -- 172.21.15.45:0/2221353449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fddbeb2d0 msgr2=0x561fddc54070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.993+0000 7f32a3fff700 1 --2- 172.21.15.45:0/2221353449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fddbeb2d0 0x561fddc54070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.993+0000 7f32a3fff700 1 -- 172.21.15.45:0/2221353449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fddbea980 msgr2=0x561fddbf8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.993+0000 7f32a3fff700 1 --2- 172.21.15.45:0/2221353449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fddbea980 0x561fddbf8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.993+0000 7f32a3fff700 1 -- 172.21.15.45:0/2221353449 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f329402a040 con 0x561fddbe9ab0 2024-05-10T03:43:08.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.993+0000 7f32a3fff700 1 --2- 172.21.15.45:0/2221353449 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fddbe9ab0 0x561fddbf8a30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f329400e970 tx=0x7f329400eac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e60128f5944f3587 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:08.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.993+0000 7f32837fe700 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-05-10T03:43:08.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.993+0000 7f32837fe700 1 -- 172.21.15.45:0/2221353449 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329400ee40 con 0x561fddbe9ab0 2024-05-10T03:43:08.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.993+0000 7f32837fe700 1 -- 172.21.15.45:0/2221353449 <== mon.2 v2:172.21.15.106:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f329401cbc0 con 0x561fddbe9ab0 2024-05-10T03:43:08.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.993+0000 7f32bac16b80 1 -- 172.21.15.45:0/2221353449 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561fddafdec0 con 0x561fddbe9ab0 2024-05-10T03:43:08.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.994+0000 7f32837fe700 1 -- 172.21.15.45:0/2221353449 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32940053e0 con 0x561fddbe9ab0 2024-05-10T03:43:08.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.994+0000 7f32bac16b80 10 client.26330 fetch_fsmap learned FSMap version 32 2024-05-10T03:43:08.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.994+0000 7f32bac16b80 1 -- 172.21.15.45:0/2221353449 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x561fdd98acd0 con 0x561fddbe9ab0 2024-05-10T03:43:08.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.994+0000 7f32837fe700 1 -- 172.21.15.45:0/2221353449 <== mon.2 v2:172.21.15.106:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x561fddafdec0 con 0x561fddbe9ab0 2024-05-10T03:43:08.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.994+0000 7f32837fe700 1 -- 172.21.15.45:0/2221353449 <== mon.2 v2:172.21.15.106:3300/0 5 ==== fsmap(e 32) v1 ==== 7498+0+0 (secure 0 0 0) 0x7f3294003ad0 con 0x561fddbe9ab0 2024-05-10T03:43:08.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.994+0000 7f32bac16b80 10 client.26330 fetch_fsmap finished waiting for FSMap version 32 2024-05-10T03:43:08.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.994+0000 7f32bac16b80 10 client.26330 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2024-05-10T03:43:08.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.994+0000 7f32bac16b80 20 client.26330 populate_metadata read hostname 'smithi045' 2024-05-10T03:43:08.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.994+0000 7f32bac16b80 1 --2- 172.21.15.45:0/2221353449 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x561fddc56080 0x561fddc584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.994+0000 7f32bac16b80 4 client.26330 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-10T03:43:08.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.994+0000 7f32bac16b80 1 -- 172.21.15.45:0/2221353449 --> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561fdd953cf0 con 0x561fddc56080 2024-05-10T03:43:08.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.994+0000 7f32a37fe700 1 --2- 172.21.15.45:0/2221353449 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x561fddc56080 0x561fddc584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.995+0000 7f32837fe700 10 client.26330 ms_handle_connect on v2:172.21.15.106:6834/4162885659 2024-05-10T03:43:08.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.995+0000 7f32a37fe700 1 --2- 172.21.15.45:0/2221353449 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x561fddc56080 0x561fddc584a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b0c9f9ac752833e5 server_cookie=c2df25e104e66e6b in_seq=0 out_seq=0 2024-05-10T03:43:08.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.995+0000 7f32837fe700 1 -- 172.21.15.45:0/2221353449 <== mds.4 v2:172.21.15.106:6834/4162885659 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561fdd953cf0 con 0x561fddc56080 2024-05-10T03:43:08.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.995+0000 7f32837fe700 10 client.26330 handle_command_reply: tid=0 2024-05-10T03:43:08.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.995+0000 7f32bac16b80 1 client.26330 shutdown 2024-05-10T03:43:08.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.995+0000 7f32bac16b80 1 -- 172.21.15.45:0/2221353449 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fddbe9ab0 msgr2=0x561fddbf8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.995+0000 7f32bac16b80 1 --2- 172.21.15.45:0/2221353449 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fddbe9ab0 0x561fddbf8a30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f329400e970 tx=0x7f329400eac0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.995+0000 7f32bac16b80 1 -- 172.21.15.45:0/2221353449 shutdown_connections 2024-05-10T03:43:08.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.995+0000 7f32bac16b80 1 --2- 172.21.15.45:0/2221353449 >> [v2:172.21.15.106:6834/4162885659,v1:172.21.15.106:6835/4162885659] conn(0x561fddc56080 0x561fddc584a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.995+0000 7f32bac16b80 1 --2- 172.21.15.45:0/2221353449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fddbeb2d0 0x561fddc54070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.995+0000 7f32837fe700 0 client.26330 ms_handle_reset on v2:172.21.15.106:6834/4162885659 2024-05-10T03:43:08.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.995+0000 7f32bac16b80 1 --2- 172.21.15.45:0/2221353449 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fddbe9ab0 0x561fddbf8a30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.003 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.995+0000 7f32bac16b80 1 --2- 172.21.15.45:0/2221353449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fddbea980 0x561fddbf8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.003 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.995+0000 7f32bac16b80 1 -- 172.21.15.45:0/2221353449 >> 172.21.15.45:0/2221353449 conn(0x561fddb47a60 msgr2=0x561fddbedbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.003 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.995+0000 7f32bac16b80 1 -- 172.21.15.45:0/2221353449 shutdown_connections 2024-05-10T03:43:08.003 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.995+0000 7f32bac16b80 1 -- 172.21.15.45:0/2221353449 wait complete. 2024-05-10T03:43:08.003 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.995+0000 7f32bac16b80 20 client.26330 trim_cache size 0 max 16384 2024-05-10T03:43:08.003 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-05-10T03:43:08.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.996+0000 7f32aa8d2700 1 -- 172.21.15.45:0/4173250715 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f32900a11c0 msgr2=0x7f32900a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.996+0000 7f32aa8d2700 1 --2- 172.21.15.45:0/4173250715 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f32900a11c0 0x7f32900a36d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f32a4068330 tx=0x7f3294009260 comp rx=0 tx=0).stop 2024-05-10T03:43:08.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.996+0000 7f32aa8d2700 1 -- 172.21.15.45:0/4173250715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32a41025d0 msgr2=0x7f32a419f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.996+0000 7f32aa8d2700 1 --2- 172.21.15.45:0/4173250715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32a41025d0 0x7f32a419f4e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f329c00ef30 tx=0x7f329c00c3a0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.996+0000 7f32aa8d2700 1 -- 172.21.15.45:0/4173250715 shutdown_connections 2024-05-10T03:43:08.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.996+0000 7f32aa8d2700 1 --2- 172.21.15.45:0/4173250715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32a4101090 0x7f32a4198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.996+0000 7f32aa8d2700 1 --2- 172.21.15.45:0/4173250715 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f32900a11c0 0x7f32900a36d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.996+0000 7f32aa8d2700 1 --2- 172.21.15.45:0/4173250715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32a41025d0 0x7f32a419f4e0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.996+0000 7f32aa8d2700 1 --2- 172.21.15.45:0/4173250715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32a4101a70 0x7f32a4198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.996+0000 7f32aa8d2700 1 -- 172.21.15.45:0/4173250715 >> 172.21.15.45:0/4173250715 conn(0x7f32a40fb8f0 msgr2=0x7f32a40fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.996+0000 7f32aa8d2700 1 -- 172.21.15.45:0/4173250715 shutdown_connections 2024-05-10T03:43:08.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:07.996+0000 7f32aa8d2700 1 -- 172.21.15.45:0/4173250715 wait complete. 2024-05-10T03:43:08.013 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-05-10T03:43:08.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.177+0000 7f562279a700 1 -- 172.21.15.45:0/2255867625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f561c1026b0 msgr2=0x7f561c104ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.177+0000 7f562279a700 1 --2- 172.21.15.45:0/2255867625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f561c1026b0 0x7f561c104ad0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f560c009990 tx=0x7f560c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.177+0000 7f562279a700 1 -- 172.21.15.45:0/2255867625 shutdown_connections 2024-05-10T03:43:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.177+0000 7f562279a700 1 --2- 172.21.15.45:0/2255867625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f561c1026b0 0x7f561c104ad0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.177+0000 7f562279a700 1 --2- 172.21.15.45:0/2255867625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f561c107970 0x7f561c109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.177+0000 7f562279a700 1 --2- 172.21.15.45:0/2255867625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f561c105010 0x7f561c107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.177+0000 7f562279a700 1 -- 172.21.15.45:0/2255867625 >> 172.21.15.45:0/2255867625 conn(0x7f561c0fc0d0 msgr2=0x7f561c0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.177+0000 7f562279a700 1 -- 172.21.15.45:0/2255867625 shutdown_connections 2024-05-10T03:43:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.178+0000 7f562279a700 1 -- 172.21.15.45:0/2255867625 wait complete. 2024-05-10T03:43:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.178+0000 7f562279a700 1 Processor -- start 2024-05-10T03:43:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.178+0000 7f562279a700 1 -- start start 2024-05-10T03:43:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.179+0000 7f562279a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f561c1026b0 0x7f561c197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.179+0000 7f562279a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f561c105010 0x7f561c198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.179+0000 7f562279a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f561c107970 0x7f561c19f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.179+0000 7f562279a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561c19faa0 con 0x7f561c105010 2024-05-10T03:43:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.179+0000 7f562279a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561c1004d0 con 0x7f561c107970 2024-05-10T03:43:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.179+0000 7f562279a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561c100690 con 0x7f561c1026b0 2024-05-10T03:43:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.179+0000 7f561b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f561c105010 0x7f561c198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.179+0000 7f561bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f561c1026b0 0x7f561c197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.179+0000 7f561b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f561c105010 0x7f561c198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45626/0 (socket says 172.21.15.45:45626) 2024-05-10T03:43:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.179+0000 7f561b7fe700 1 -- 172.21.15.45:0/656723806 learned_addr learned my addr 172.21.15.45:0/656723806 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.179+0000 7f5620d37700 1 --2- 172.21.15.45:0/656723806 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f561c107970 0x7f561c19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.179+0000 7f5620d37700 1 -- 172.21.15.45:0/656723806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f561c1026b0 msgr2=0x7f561c197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.179+0000 7f5620d37700 1 --2- 172.21.15.45:0/656723806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f561c1026b0 0x7f561c197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.179+0000 7f5620d37700 1 -- 172.21.15.45:0/656723806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f561c105010 msgr2=0x7f561c198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.179+0000 7f5620d37700 1 --2- 172.21.15.45:0/656723806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f561c105010 0x7f561c198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.179+0000 7f5620d37700 1 -- 172.21.15.45:0/656723806 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5610009520 con 0x7f561c107970 2024-05-10T03:43:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.179+0000 7f561b7fe700 1 --2- 172.21.15.45:0/656723806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f561c105010 0x7f561c198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:43:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.180+0000 7f5620d37700 1 --2- 172.21.15.45:0/656723806 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f561c107970 0x7f561c19f490 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f561c0694a0 tx=0x7f561400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.180+0000 7f56197fa700 1 -- 172.21.15.45:0/656723806 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5614003a00 con 0x7f561c107970 2024-05-10T03:43:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.180+0000 7f56197fa700 1 -- 172.21.15.45:0/656723806 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f561400f040 con 0x7f561c107970 2024-05-10T03:43:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.180+0000 7f562279a700 1 -- 172.21.15.45:0/656723806 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5614009c40 con 0x7f561c107970 2024-05-10T03:43:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.180+0000 7f56197fa700 1 -- 172.21.15.45:0/656723806 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56140045b0 con 0x7f561c107970 2024-05-10T03:43:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.180+0000 7f562279a700 1 -- 172.21.15.45:0/656723806 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560c0095f0 con 0x7f561c107970 2024-05-10T03:43:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.182+0000 7f56197fa700 1 -- 172.21.15.45:0/656723806 <== mon.2 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5614004730 con 0x7f561c107970 2024-05-10T03:43:08.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.183+0000 7f56197fa700 1 --2- 172.21.15.45:0/656723806 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f56040a1240 0x7f56040a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.184+0000 7f561bfff700 1 --2- 172.21.15.45:0/656723806 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f56040a1240 0x7f56040a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.184+0000 7f56197fa700 1 -- 172.21.15.45:0/656723806 <== mon.2 v2:172.21.15.106:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f56140cc730 con 0x7f561c107970 2024-05-10T03:43:08.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.184+0000 7f561bfff700 1 --2- 172.21.15.45:0/656723806 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f56040a1240 0x7f56040a3750 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f560c00b2e0 tx=0x7f560c022040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:08.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.184+0000 7f5632adeb80 1 Processor -- start 2024-05-10T03:43:08.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.185+0000 7f5632adeb80 1 -- start start 2024-05-10T03:43:08.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.185+0000 7f5632adeb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbc6a0 0x55f161bbcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.185+0000 7f5632adeb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f161bbd570 0x55f161bbd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.185+0000 7f5632adeb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f161bbdec0 0x55f161bc47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.185+0000 7f5632adeb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f161ae3150 con 0x55f161bbc6a0 2024-05-10T03:43:08.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.185+0000 7f5632adeb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f161ae0b10 con 0x55f161bbd570 2024-05-10T03:43:08.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.185+0000 7f5632adeb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f161adc400 con 0x55f161bbdec0 2024-05-10T03:43:08.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.185+0000 7f561bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbc6a0 0x55f161bbcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.185+0000 7f561bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbc6a0 0x55f161bbcaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45632/0 (socket says 172.21.15.45:45632) 2024-05-10T03:43:08.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.185+0000 7f561bfff700 1 -- 172.21.15.45:0/1861779108 learned_addr learned my addr 172.21.15.45:0/1861779108 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:08.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.185+0000 7f5620d37700 1 --2- 172.21.15.45:0/1861779108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f161bbdec0 0x55f161bc47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.185+0000 7f561b7fe700 1 --2- 172.21.15.45:0/1861779108 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f161bbd570 0x55f161bbd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.185+0000 7f561bfff700 1 -- 172.21.15.45:0/1861779108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f161bbdec0 msgr2=0x55f161bc47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.185+0000 7f561bfff700 1 --2- 172.21.15.45:0/1861779108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f161bbdec0 0x55f161bc47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.185+0000 7f561bfff700 1 -- 172.21.15.45:0/1861779108 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f161bbd570 msgr2=0x55f161bbd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.185+0000 7f561bfff700 1 --2- 172.21.15.45:0/1861779108 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f161bbd570 0x55f161bbd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.185+0000 7f561bfff700 1 -- 172.21.15.45:0/1861779108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f16195d3b0 con 0x55f161bbc6a0 2024-05-10T03:43:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.186+0000 7f561bfff700 1 --2- 172.21.15.45:0/1861779108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbc6a0 0x55f161bbcaf0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f560c009990 tx=0x7f560c027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76dbf068679ab9df server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.186+0000 7f56027fc700 1 -- 172.21.15.45:0/1861779108 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c00f660 con 0x55f161bbc6a0 2024-05-10T03:43:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.186+0000 7f56027fc700 1 -- 172.21.15.45:0/1861779108 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f560c032040 con 0x55f161bbc6a0 2024-05-10T03:43:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.186+0000 7f56027fc700 1 -- 172.21.15.45:0/1861779108 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c02cbe0 con 0x55f161bbc6a0 2024-05-10T03:43:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.187+0000 7f5632adeb80 1 -- 172.21.15.45:0/1861779108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbc6a0 msgr2=0x55f161bbcaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.187+0000 7f5632adeb80 1 --2- 172.21.15.45:0/1861779108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbc6a0 0x55f161bbcaf0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f560c009990 tx=0x7f560c027000 comp rx=0 tx=0).stop 2024-05-10T03:43:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.187+0000 7f5632adeb80 1 -- 172.21.15.45:0/1861779108 shutdown_connections 2024-05-10T03:43:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.187+0000 7f5632adeb80 1 --2- 172.21.15.45:0/1861779108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f161bbdec0 0x55f161bc47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.187+0000 7f5632adeb80 1 --2- 172.21.15.45:0/1861779108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbc6a0 0x55f161bbcaf0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.187+0000 7f5632adeb80 1 --2- 172.21.15.45:0/1861779108 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f161bbd570 0x55f161bbd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.187+0000 7f5632adeb80 1 -- 172.21.15.45:0/1861779108 >> 172.21.15.45:0/1861779108 conn(0x55f161b1ea60 msgr2=0x55f161bb6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.187+0000 7f5632adeb80 1 -- 172.21.15.45:0/1861779108 shutdown_connections 2024-05-10T03:43:08.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.187+0000 7f5632adeb80 1 -- 172.21.15.45:0/1861779108 wait complete. 2024-05-10T03:43:08.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.187+0000 7f5632adeb80 1 -- start start 2024-05-10T03:43:08.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.188+0000 7f5632adeb80 1 Processor -- start 2024-05-10T03:43:08.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.188+0000 7f5632adeb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f161bbc6a0 0x55f161bc6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.188+0000 7f5632adeb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f161bbd570 0x55f161bc6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.188+0000 7f5632adeb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbdec0 0x55f161bcdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.188+0000 7f5632adeb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f161a78560 con 0x55f161bbdec0 2024-05-10T03:43:08.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.188+0000 7f5632adeb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f161a78200 con 0x55f161bbd570 2024-05-10T03:43:08.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.188+0000 7f5632adeb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f16195f6a0 con 0x55f161bbc6a0 2024-05-10T03:43:08.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.188+0000 7f5632adeb80 10 client.0 _ll_register_callbacks cb 0x55f161a81b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:43:08.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.188+0000 7f5620d37700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbdec0 0x55f161bcdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.188+0000 7f561bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f161bbc6a0 0x55f161bc6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.188+0000 7f561b7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f161bbd570 0x55f161bc6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.188+0000 7f5620d37700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbdec0 0x55f161bcdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45638/0 (socket says 172.21.15.45:45638) 2024-05-10T03:43:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.188+0000 7f5620d37700 1 -- 172.21.15.45:0/526371701 learned_addr learned my addr 172.21.15.45:0/526371701 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.188+0000 7f561b7fe700 1 -- 172.21.15.45:0/526371701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f161bbc6a0 msgr2=0x55f161bc6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.188+0000 7f561b7fe700 1 --2- 172.21.15.45:0/526371701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f161bbc6a0 0x55f161bc6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.188+0000 7f561b7fe700 1 -- 172.21.15.45:0/526371701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbdec0 msgr2=0x55f161bcdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.188+0000 7f561b7fe700 1 --2- 172.21.15.45:0/526371701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbdec0 0x55f161bcdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.188+0000 7f561b7fe700 1 -- 172.21.15.45:0/526371701 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f561c10a9b0 con 0x55f161bbd570 2024-05-10T03:43:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.188+0000 7f561bfff700 1 --2- 172.21.15.45:0/526371701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f161bbc6a0 0x55f161bc6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:43:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.189+0000 7f561b7fe700 1 --2- 172.21.15.45:0/526371701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f161bbd570 0x55f161bc6b80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5610012d80 tx=0x7f561000f6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22b05f8247dbc875 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.189+0000 7f55fb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-05-10T03:43:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.189+0000 7f55fb7fe700 1 -- 172.21.15.45:0/526371701 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5610017070 con 0x55f161bbd570 2024-05-10T03:43:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.189+0000 7f55fb7fe700 1 -- 172.21.15.45:0/526371701 <== mon.2 v2:172.21.15.106:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f561000fb80 con 0x55f161bbd570 2024-05-10T03:43:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.189+0000 7f5632adeb80 1 -- 172.21.15.45:0/526371701 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f161a35270 con 0x55f161bbd570 2024-05-10T03:43:08.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.189+0000 7f55fb7fe700 1 -- 172.21.15.45:0/526371701 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f561000fd40 con 0x55f161bbd570 2024-05-10T03:43:08.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.189+0000 7f5632adeb80 10 client.26342 fetch_fsmap learned FSMap version 33 2024-05-10T03:43:08.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.189+0000 7f5632adeb80 1 -- 172.21.15.45:0/526371701 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55f161909b60 con 0x55f161bbd570 2024-05-10T03:43:08.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.189+0000 7f55fb7fe700 1 -- 172.21.15.45:0/526371701 <== mon.2 v2:172.21.15.106:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55f161a35270 con 0x55f161bbd570 2024-05-10T03:43:08.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.189+0000 7f55fb7fe700 1 -- 172.21.15.45:0/526371701 <== mon.2 v2:172.21.15.106:3300/0 5 ==== fsmap(e 33) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f5610010510 con 0x55f161bbd570 2024-05-10T03:43:08.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.190+0000 7f5632adeb80 10 client.26342 fetch_fsmap finished waiting for FSMap version 33 2024-05-10T03:43:08.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.190+0000 7f5632adeb80 10 client.26342 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-05-10T03:43:08.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.190+0000 7f5632adeb80 20 client.26342 populate_metadata read hostname 'smithi045' 2024-05-10T03:43:08.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.190+0000 7f5632adeb80 1 --2- 172.21.15.45:0/526371701 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x55f161bd2350 0x55f161bd47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.190+0000 7f5632adeb80 4 client.26342 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:43:08.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.190+0000 7f5632adeb80 1 -- 172.21.15.45:0/526371701 --> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f161b8b780 con 0x55f161bd2350 2024-05-10T03:43:08.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.190+0000 7f561bfff700 1 --2- 172.21.15.45:0/526371701 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x55f161bd2350 0x55f161bd47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.190+0000 7f55fb7fe700 10 client.26342 ms_handle_connect on v2:172.21.15.154:6836/608167481 2024-05-10T03:43:08.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.190+0000 7f561bfff700 1 --2- 172.21.15.45:0/526371701 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x55f161bd2350 0x55f161bd47a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=17176ba628dbaaf8 server_cookie=fb298b2a5c3ccd8d in_seq=0 out_seq=0 2024-05-10T03:43:08.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.191+0000 7f55fb7fe700 1 -- 172.21.15.45:0/526371701 <== mds.3 v2:172.21.15.154:6836/608167481 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f161b8b780 con 0x55f161bd2350 2024-05-10T03:43:08.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.191+0000 7f55fb7fe700 10 client.26342 handle_command_reply: tid=0 2024-05-10T03:43:08.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.191+0000 7f5632adeb80 1 client.26342 shutdown 2024-05-10T03:43:08.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.191+0000 7f5632adeb80 1 -- 172.21.15.45:0/526371701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f161bbd570 msgr2=0x55f161bc6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.191+0000 7f5632adeb80 1 --2- 172.21.15.45:0/526371701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f161bbd570 0x55f161bc6b80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5610012d80 tx=0x7f561000f6a0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.191+0000 7f5632adeb80 1 -- 172.21.15.45:0/526371701 shutdown_connections 2024-05-10T03:43:08.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.191+0000 7f5632adeb80 1 --2- 172.21.15.45:0/526371701 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x55f161bd2350 0x55f161bd47a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.191+0000 7f5632adeb80 1 --2- 172.21.15.45:0/526371701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f161bbc6a0 0x55f161bc6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.191+0000 7f5632adeb80 1 --2- 172.21.15.45:0/526371701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbdec0 0x55f161bcdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.191+0000 7f5632adeb80 1 --2- 172.21.15.45:0/526371701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f161bbd570 0x55f161bc6b80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.191+0000 7f55fb7fe700 0 client.26342 ms_handle_reset on v2:172.21.15.154:6836/608167481 2024-05-10T03:43:08.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.191+0000 7f5632adeb80 1 -- 172.21.15.45:0/526371701 >> 172.21.15.45:0/526371701 conn(0x55f161b1ea60 msgr2=0x55f161bb6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.191+0000 7f5632adeb80 1 -- 172.21.15.45:0/526371701 shutdown_connections 2024-05-10T03:43:08.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.191+0000 7f5632adeb80 1 -- 172.21.15.45:0/526371701 wait complete. 2024-05-10T03:43:08.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.191+0000 7f5632adeb80 20 client.26342 trim_cache size 0 max 16384 2024-05-10T03:43:08.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.206+0000 7f5632adeb80 1 Processor -- start 2024-05-10T03:43:08.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.206+0000 7f5632adeb80 1 -- start start 2024-05-10T03:43:08.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.206+0000 7f5632adeb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbc6a0 0x55f161bc6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.207+0000 7f5632adeb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f161bbd570 0x55f161bc6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.207+0000 7f5632adeb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f161bbdec0 0x55f161bcd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.207+0000 7f5632adeb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f161bcf7c0 con 0x55f161bbc6a0 2024-05-10T03:43:08.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.207+0000 7f5632adeb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f161bcde70 con 0x55f161bbdec0 2024-05-10T03:43:08.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.207+0000 7f5632adeb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f161bb8770 con 0x55f161bbd570 2024-05-10T03:43:08.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.207+0000 7f561bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbc6a0 0x55f161bc6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.207+0000 7f561bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbc6a0 0x55f161bc6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45654/0 (socket says 172.21.15.45:45654) 2024-05-10T03:43:08.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.207+0000 7f561bfff700 1 -- 172.21.15.45:0/2517708707 learned_addr learned my addr 172.21.15.45:0/2517708707 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:08.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.207+0000 7f561b7fe700 1 --2- 172.21.15.45:0/2517708707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f161bbd570 0x55f161bc6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.207+0000 7f5620d37700 1 --2- 172.21.15.45:0/2517708707 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f161bbdec0 0x55f161bcd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.207+0000 7f5620d37700 1 -- 172.21.15.45:0/2517708707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f161bbd570 msgr2=0x55f161bc6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.207+0000 7f5620d37700 1 --2- 172.21.15.45:0/2517708707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f161bbd570 0x55f161bc6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.207+0000 7f5620d37700 1 -- 172.21.15.45:0/2517708707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbc6a0 msgr2=0x55f161bc6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.207+0000 7f5620d37700 1 --2- 172.21.15.45:0/2517708707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbc6a0 0x55f161bc6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.207+0000 7f5620d37700 1 -- 172.21.15.45:0/2517708707 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f161aa2560 con 0x55f161bbdec0 2024-05-10T03:43:08.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.207+0000 7f561bfff700 1 --2- 172.21.15.45:0/2517708707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbc6a0 0x55f161bc6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:43:08.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.207+0000 7f5620d37700 1 --2- 172.21.15.45:0/2517708707 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f161bbdec0 0x55f161bcd930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f561400c6f0 tx=0x7f5614099170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab42b8432596493a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:08.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.207+0000 7f5602ffd700 1 -- 172.21.15.45:0/2517708707 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561409d640 con 0x55f161bbdec0 2024-05-10T03:43:08.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.207+0000 7f5602ffd700 1 -- 172.21.15.45:0/2517708707 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f56140a1c00 con 0x55f161bbdec0 2024-05-10T03:43:08.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.207+0000 7f5602ffd700 1 -- 172.21.15.45:0/2517708707 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56140b9070 con 0x55f161bbdec0 2024-05-10T03:43:08.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.208+0000 7f5632adeb80 1 -- 172.21.15.45:0/2517708707 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f161bbdec0 msgr2=0x55f161bcd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.208+0000 7f5632adeb80 1 --2- 172.21.15.45:0/2517708707 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f161bbdec0 0x55f161bcd930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f561400c6f0 tx=0x7f5614099170 comp rx=0 tx=0).stop 2024-05-10T03:43:08.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.208+0000 7f5632adeb80 1 -- 172.21.15.45:0/2517708707 shutdown_connections 2024-05-10T03:43:08.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.208+0000 7f5632adeb80 1 --2- 172.21.15.45:0/2517708707 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f161bbdec0 0x55f161bcd930 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.208+0000 7f5632adeb80 1 --2- 172.21.15.45:0/2517708707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbc6a0 0x55f161bc6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.208+0000 7f5632adeb80 1 --2- 172.21.15.45:0/2517708707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f161bbd570 0x55f161bc6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.208+0000 7f5632adeb80 1 -- 172.21.15.45:0/2517708707 >> 172.21.15.45:0/2517708707 conn(0x55f161b1ea60 msgr2=0x55f161bc5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.208+0000 7f5632adeb80 1 -- 172.21.15.45:0/2517708707 shutdown_connections 2024-05-10T03:43:08.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.208+0000 7f5632adeb80 1 -- 172.21.15.45:0/2517708707 wait complete. 2024-05-10T03:43:08.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.209+0000 7f5632adeb80 1 -- start start 2024-05-10T03:43:08.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.209+0000 7f5632adeb80 1 Processor -- start 2024-05-10T03:43:08.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.209+0000 7f5632adeb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbc6a0 0x55f161bcb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.209+0000 7f5632adeb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f161bbd570 0x55f161bcb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.209+0000 7f5632adeb80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f161bbdec0 0x55f161bcc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.209+0000 7f5632adeb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f161bcce00 con 0x55f161bbc6a0 2024-05-10T03:43:08.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.209+0000 7f5632adeb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f161bccf70 con 0x55f161bbd570 2024-05-10T03:43:08.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.209+0000 7f5632adeb80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f161bcd130 con 0x55f161bbdec0 2024-05-10T03:43:08.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.209+0000 7f5632adeb80 10 client.0 _ll_register_callbacks cb 0x55f161a81b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:43:08.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.209+0000 7f561bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbc6a0 0x55f161bcb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.210+0000 7f561b7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f161bbd570 0x55f161bcb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.210+0000 7f561bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbc6a0 0x55f161bcb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45660/0 (socket says 172.21.15.45:45660) 2024-05-10T03:43:08.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.210+0000 7f5620d37700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f161bbdec0 0x55f161bcc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.210+0000 7f561bfff700 1 -- 172.21.15.45:0/4248180653 learned_addr learned my addr 172.21.15.45:0/4248180653 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:08.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.210+0000 7f561b7fe700 1 -- 172.21.15.45:0/4248180653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f161bbdec0 msgr2=0x55f161bcc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.210+0000 7f561b7fe700 1 --2- 172.21.15.45:0/4248180653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f161bbdec0 0x55f161bcc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.210+0000 7f561b7fe700 1 -- 172.21.15.45:0/4248180653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbc6a0 msgr2=0x55f161bcb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.210+0000 7f561b7fe700 1 --2- 172.21.15.45:0/4248180653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbc6a0 0x55f161bcb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.210+0000 7f561b7fe700 1 -- 172.21.15.45:0/4248180653 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f16195d3b0 con 0x55f161bbd570 2024-05-10T03:43:08.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.210+0000 7f561b7fe700 1 --2- 172.21.15.45:0/4248180653 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f161bbd570 0x55f161bcb990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f56100108a0 tx=0x7f5610012950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f89b7411e9589459 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:08.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.210+0000 7f55fb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-05-10T03:43:08.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.210+0000 7f55fb7fe700 1 -- 172.21.15.45:0/4248180653 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5610017070 con 0x55f161bbd570 2024-05-10T03:43:08.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.210+0000 7f5632adeb80 1 -- 172.21.15.45:0/4248180653 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f560c032040 con 0x55f161bbd570 2024-05-10T03:43:08.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.210+0000 7f55fb7fe700 1 -- 172.21.15.45:0/4248180653 <== mon.2 v2:172.21.15.106:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f5610000e40 con 0x55f161bbd570 2024-05-10T03:43:08.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.210+0000 7f55fb7fe700 1 -- 172.21.15.45:0/4248180653 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f561000fb80 con 0x55f161bbd570 2024-05-10T03:43:08.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.210+0000 7f5632adeb80 10 client.26348 fetch_fsmap learned FSMap version 33 2024-05-10T03:43:08.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.210+0000 7f5632adeb80 1 -- 172.21.15.45:0/4248180653 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7f560c0095f0 con 0x55f161bbd570 2024-05-10T03:43:08.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.211+0000 7f55fb7fe700 1 -- 172.21.15.45:0/4248180653 <== mon.2 v2:172.21.15.106:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f560c032040 con 0x55f161bbd570 2024-05-10T03:43:08.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.211+0000 7f55fb7fe700 1 -- 172.21.15.45:0/4248180653 <== mon.2 v2:172.21.15.106:3300/0 5 ==== fsmap(e 33) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f5610003680 con 0x55f161bbd570 2024-05-10T03:43:08.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.211+0000 7f5632adeb80 10 client.26348 fetch_fsmap finished waiting for FSMap version 33 2024-05-10T03:43:08.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.211+0000 7f5632adeb80 10 client.26348 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-05-10T03:43:08.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.211+0000 7f5632adeb80 20 client.26348 populate_metadata read hostname 'smithi045' 2024-05-10T03:43:08.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.211+0000 7f5632adeb80 1 --2- 172.21.15.45:0/4248180653 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x55f161c29380 0x55f161c2b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.211+0000 7f5632adeb80 4 client.26348 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-10T03:43:08.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.211+0000 7f5632adeb80 1 -- 172.21.15.45:0/4248180653 --> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f161ad4ec0 con 0x55f161c29380 2024-05-10T03:43:08.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.211+0000 7f561bfff700 1 --2- 172.21.15.45:0/4248180653 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x55f161c29380 0x55f161c2b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.212+0000 7f561bfff700 1 --2- 172.21.15.45:0/4248180653 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x55f161c29380 0x55f161c2b7a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=db3bccd0791b5723 server_cookie=4cd2cca193a72095 in_seq=0 out_seq=0 2024-05-10T03:43:08.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.212+0000 7f55fb7fe700 10 client.26348 ms_handle_connect on v2:172.21.15.154:6836/608167481 2024-05-10T03:43:08.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.212+0000 7f55fb7fe700 1 -- 172.21.15.45:0/4248180653 <== mds.3 v2:172.21.15.154:6836/608167481 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f161ad4ec0 con 0x55f161c29380 2024-05-10T03:43:08.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.212+0000 7f55fb7fe700 10 client.26348 handle_command_reply: tid=0 2024-05-10T03:43:08.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.212+0000 7f5632adeb80 1 client.26348 shutdown 2024-05-10T03:43:08.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.212+0000 7f5632adeb80 1 -- 172.21.15.45:0/4248180653 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f161bbd570 msgr2=0x55f161bcb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.212+0000 7f5632adeb80 1 --2- 172.21.15.45:0/4248180653 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f161bbd570 0x55f161bcb990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f56100108a0 tx=0x7f5610012950 comp rx=0 tx=0).stop 2024-05-10T03:43:08.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.212+0000 7f5632adeb80 1 -- 172.21.15.45:0/4248180653 shutdown_connections 2024-05-10T03:43:08.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.212+0000 7f5632adeb80 1 --2- 172.21.15.45:0/4248180653 >> [v2:172.21.15.154:6836/608167481,v1:172.21.15.154:6837/608167481] conn(0x55f161c29380 0x55f161c2b7a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.212+0000 7f5632adeb80 1 --2- 172.21.15.45:0/4248180653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f161bbdec0 0x55f161bcc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.212+0000 7f5632adeb80 1 --2- 172.21.15.45:0/4248180653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f161bbc6a0 0x55f161bcb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.212+0000 7f55fb7fe700 0 client.26348 ms_handle_reset on v2:172.21.15.154:6836/608167481 2024-05-10T03:43:08.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.212+0000 7f5632adeb80 1 --2- 172.21.15.45:0/4248180653 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f161bbd570 0x55f161bcb990 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.212+0000 7f5632adeb80 1 -- 172.21.15.45:0/4248180653 >> 172.21.15.45:0/4248180653 conn(0x55f161b1ea60 msgr2=0x55f161bbb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.212+0000 7f5632adeb80 1 -- 172.21.15.45:0/4248180653 shutdown_connections 2024-05-10T03:43:08.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.212+0000 7f5632adeb80 1 -- 172.21.15.45:0/4248180653 wait complete. 2024-05-10T03:43:08.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.212+0000 7f5632adeb80 20 client.26348 trim_cache size 0 max 16384 2024-05-10T03:43:08.221 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-05-10T03:43:08.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.213+0000 7f562279a700 1 -- 172.21.15.45:0/656723806 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f56040a1240 msgr2=0x7f56040a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.213+0000 7f562279a700 1 --2- 172.21.15.45:0/656723806 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f56040a1240 0x7f56040a3750 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f560c00b2e0 tx=0x7f560c022040 comp rx=0 tx=0).stop 2024-05-10T03:43:08.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.213+0000 7f562279a700 1 -- 172.21.15.45:0/656723806 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f561c107970 msgr2=0x7f561c19f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.213+0000 7f562279a700 1 --2- 172.21.15.45:0/656723806 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f561c107970 0x7f561c19f490 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f561c0694a0 tx=0x7f561400c3a0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.213+0000 7f562279a700 1 -- 172.21.15.45:0/656723806 shutdown_connections 2024-05-10T03:43:08.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.213+0000 7f562279a700 1 --2- 172.21.15.45:0/656723806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f561c1026b0 0x7f561c197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.213+0000 7f562279a700 1 --2- 172.21.15.45:0/656723806 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f56040a1240 0x7f56040a3750 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.213+0000 7f562279a700 1 --2- 172.21.15.45:0/656723806 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f561c107970 0x7f561c19f490 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.213+0000 7f562279a700 1 --2- 172.21.15.45:0/656723806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f561c105010 0x7f561c198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.213+0000 7f562279a700 1 -- 172.21.15.45:0/656723806 >> 172.21.15.45:0/656723806 conn(0x7f561c0fc0d0 msgr2=0x7f561c1034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.213+0000 7f562279a700 1 -- 172.21.15.45:0/656723806 shutdown_connections 2024-05-10T03:43:08.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.213+0000 7f562279a700 1 -- 172.21.15.45:0/656723806 wait complete. 2024-05-10T03:43:08.230 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-10T03:43:08.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:08 smithi106 ceph-mon[46996]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:08.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:08 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2600493694' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:43:08.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.417+0000 7fb1ce34e700 1 -- 172.21.15.45:0/2055077634 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1c81026c0 msgr2=0x7fb1c8104ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.417+0000 7fb1ce34e700 1 --2- 172.21.15.45:0/2055077634 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1c81026c0 0x7fb1c8104ae0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8009990 tx=0x7fb1b8009ca0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.418+0000 7fb1ce34e700 1 -- 172.21.15.45:0/2055077634 shutdown_connections 2024-05-10T03:43:08.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.418+0000 7fb1ce34e700 1 --2- 172.21.15.45:0/2055077634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1c8107980 0x7fb1c8109da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.418+0000 7fb1ce34e700 1 --2- 172.21.15.45:0/2055077634 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1c81026c0 0x7fb1c8104ae0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.418+0000 7fb1ce34e700 1 --2- 172.21.15.45:0/2055077634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c8105020 0x7fb1c8107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.418+0000 7fb1ce34e700 1 -- 172.21.15.45:0/2055077634 >> 172.21.15.45:0/2055077634 conn(0x7fb1c80fc0e0 msgr2=0x7fb1c80fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.418+0000 7fb1ce34e700 1 -- 172.21.15.45:0/2055077634 shutdown_connections 2024-05-10T03:43:08.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.418+0000 7fb1ce34e700 1 -- 172.21.15.45:0/2055077634 wait complete. 2024-05-10T03:43:08.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.419+0000 7fb1ce34e700 1 Processor -- start 2024-05-10T03:43:08.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.419+0000 7fb1ce34e700 1 -- start start 2024-05-10T03:43:08.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.420+0000 7fb1ce34e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c81026c0 0x7fb1c8112900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.420+0000 7fb1ce34e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1c8105020 0x7fb1c8112e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.420+0000 7fb1ce34e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1c8107980 0x7fb1c8111120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.420+0000 7fb1ce34e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c8111820 con 0x7fb1c8105020 2024-05-10T03:43:08.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.420+0000 7fb1ce34e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c8111990 con 0x7fb1c8107980 2024-05-10T03:43:08.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.420+0000 7fb1ce34e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c8111b50 con 0x7fb1c81026c0 2024-05-10T03:43:08.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.420+0000 7fb1cc8eb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1c8107980 0x7fb1c8111120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.420+0000 7fb1cc8eb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1c8107980 0x7fb1c8111120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.45:37128/0 (socket says 172.21.15.45:37128) 2024-05-10T03:43:08.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.420+0000 7fb1cc8eb700 1 -- 172.21.15.45:0/1434911067 learned_addr learned my addr 172.21.15.45:0/1434911067 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:08.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.420+0000 7fb1c7fff700 1 --2- 172.21.15.45:0/1434911067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c81026c0 0x7fb1c8112900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.421+0000 7fb1c77fe700 1 --2- 172.21.15.45:0/1434911067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1c8105020 0x7fb1c8112e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.421+0000 7fb1cc8eb700 1 -- 172.21.15.45:0/1434911067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c81026c0 msgr2=0x7fb1c8112900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.421+0000 7fb1cc8eb700 1 --2- 172.21.15.45:0/1434911067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c81026c0 0x7fb1c8112900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.421+0000 7fb1cc8eb700 1 -- 172.21.15.45:0/1434911067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1c8105020 msgr2=0x7fb1c8112e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.421+0000 7fb1cc8eb700 1 --2- 172.21.15.45:0/1434911067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1c8105020 0x7fb1c8112e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.421+0000 7fb1cc8eb700 1 -- 172.21.15.45:0/1434911067 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b80095f0 con 0x7fb1c8107980 2024-05-10T03:43:08.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.421+0000 7fb1cc8eb700 1 --2- 172.21.15.45:0/1434911067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1c8107980 0x7fb1c8111120 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000b9e0 tx=0x7fb1c000bcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:08.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.422+0000 7fb1c57fa700 1 -- 172.21.15.45:0/1434911067 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c000c930 con 0x7fb1c8107980 2024-05-10T03:43:08.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.422+0000 7fb1c57fa700 1 -- 172.21.15.45:0/1434911067 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb1c0014440 con 0x7fb1c8107980 2024-05-10T03:43:08.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.422+0000 7fb1c57fa700 1 -- 172.21.15.45:0/1434911067 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c00125a0 con 0x7fb1c8107980 2024-05-10T03:43:08.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.422+0000 7fb1ce34e700 1 -- 172.21.15.45:0/1434911067 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c81af170 con 0x7fb1c8107980 2024-05-10T03:43:08.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.422+0000 7fb1ce34e700 1 -- 172.21.15.45:0/1434911067 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c81af560 con 0x7fb1c8107980 2024-05-10T03:43:08.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.425+0000 7fb1c57fa700 1 -- 172.21.15.45:0/1434911067 <== mon.2 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb1c0012700 con 0x7fb1c8107980 2024-05-10T03:43:08.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.427+0000 7fb1de692b80 1 Processor -- start 2024-05-10T03:43:08.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.428+0000 7fb1de692b80 1 -- start start 2024-05-10T03:43:08.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.428+0000 7fb1de692b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c050b16a0 0x555c050b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.428+0000 7fb1de692b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555c050b2570 0x555c050b2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.428+0000 7fb1de692b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c050b2ec0 0x555c050b97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.428+0000 7fb1de692b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c04fd8150 con 0x555c050b2ec0 2024-05-10T03:43:08.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.428+0000 7fb1de692b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c04fd5b10 con 0x555c050b2570 2024-05-10T03:43:08.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.428+0000 7fb1de692b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c04fd1400 con 0x555c050b16a0 2024-05-10T03:43:08.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.428+0000 7fb1c57fa700 1 --2- 172.21.15.45:0/1434911067 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb1b00a12c0 0x7fb1b00a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.429+0000 7fb1c57fa700 1 -- 172.21.15.45:0/1434911067 <== mon.2 v2:172.21.15.106:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb1c0006e40 con 0x7fb1c8107980 2024-05-10T03:43:08.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.429+0000 7fb1c77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c050b16a0 0x555c050b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.429+0000 7fb1c77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c050b16a0 0x555c050b1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:45548/0 (socket says 172.21.15.45:45548) 2024-05-10T03:43:08.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.429+0000 7fb1c77fe700 1 -- 172.21.15.45:0/2932613525 learned_addr learned my addr 172.21.15.45:0/2932613525 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:08.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.429+0000 7fb1cc8eb700 1 --2- 172.21.15.45:0/1434911067 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb1b00a12c0 0x7fb1b00a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.429+0000 7fb1c77fe700 1 --2- 172.21.15.45:0/2932613525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c050b2ec0 0x555c050b97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.429+0000 7fb1c77fe700 1 -- 172.21.15.45:0/2932613525 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555c050b2570 msgr2=0x555c050b2980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T03:43:08.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.429+0000 7fb1c77fe700 1 --2- 172.21.15.45:0/2932613525 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555c050b2570 0x555c050b2980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.429+0000 7fb1c77fe700 1 -- 172.21.15.45:0/2932613525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c050b2ec0 msgr2=0x555c050b97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.429+0000 7fb1c77fe700 1 --2- 172.21.15.45:0/2932613525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c050b2ec0 0x555c050b97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.429+0000 7fb1c77fe700 1 -- 172.21.15.45:0/2932613525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c04e523b0 con 0x555c050b16a0 2024-05-10T03:43:08.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.430+0000 7fb1cc8eb700 1 --2- 172.21.15.45:0/1434911067 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb1b00a12c0 0x7fb1b00a37d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0004c20 tx=0x7fb1c0085040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:08.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.430+0000 7fb1c77fe700 1 --2- 172.21.15.45:0/2932613525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c050b16a0 0x555c050b1af0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc016580 tx=0x7fb1bc00a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=315792b013612cc9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:08.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.430+0000 7fb1ae7fc700 1 -- 172.21.15.45:0/2932613525 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc016ba0 con 0x555c050b16a0 2024-05-10T03:43:08.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.430+0000 7fb1ae7fc700 1 -- 172.21.15.45:0/2932613525 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb1bc00c070 con 0x555c050b16a0 2024-05-10T03:43:08.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.430+0000 7fb1ae7fc700 1 -- 172.21.15.45:0/2932613525 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc012390 con 0x555c050b16a0 2024-05-10T03:43:08.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.432+0000 7fb1de692b80 1 -- 172.21.15.45:0/2932613525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c050b16a0 msgr2=0x555c050b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.432+0000 7fb1de692b80 1 --2- 172.21.15.45:0/2932613525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c050b16a0 0x555c050b1af0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc016580 tx=0x7fb1bc00a340 comp rx=0 tx=0).stop 2024-05-10T03:43:08.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.432+0000 7fb1de692b80 1 -- 172.21.15.45:0/2932613525 shutdown_connections 2024-05-10T03:43:08.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.432+0000 7fb1de692b80 1 --2- 172.21.15.45:0/2932613525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c050b16a0 0x555c050b1af0 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc016580 tx=0x7fb1bc00a340 comp rx=0 tx=0).stop 2024-05-10T03:43:08.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.432+0000 7fb1de692b80 1 --2- 172.21.15.45:0/2932613525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c050b2ec0 0x555c050b97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.432+0000 7fb1de692b80 1 --2- 172.21.15.45:0/2932613525 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555c050b2570 0x555c050b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.432+0000 7fb1de692b80 1 -- 172.21.15.45:0/2932613525 >> 172.21.15.45:0/2932613525 conn(0x555c05013a60 msgr2=0x555c050abfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.438+0000 7fb1de692b80 1 -- 172.21.15.45:0/2932613525 shutdown_connections 2024-05-10T03:43:08.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.438+0000 7fb1de692b80 1 -- 172.21.15.45:0/2932613525 wait complete. 2024-05-10T03:43:08.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.439+0000 7fb1de692b80 1 -- start start 2024-05-10T03:43:08.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.439+0000 7fb1de692b80 1 Processor -- start 2024-05-10T03:43:08.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.442+0000 7fb1de692b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555c050b2570 0x555c050bb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.442+0000 7fb1de692b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c050b2ec0 0x555c050bbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.442+0000 7fb1de692b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c050c0c30 0x555c050c3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.442+0000 7fb1de692b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c04f6d560 con 0x555c050c0c30 2024-05-10T03:43:08.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.442+0000 7fb1de692b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c04f6d200 con 0x555c050b2570 2024-05-10T03:43:08.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.442+0000 7fb1de692b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c04e546a0 con 0x555c050b2ec0 2024-05-10T03:43:08.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.442+0000 7fb1de692b80 10 client.0 _ll_register_callbacks cb 0x555c04f76b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:43:08.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.442+0000 7fb1c77fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555c050b2570 0x555c050bb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.442+0000 7fb1c77fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555c050b2570 0x555c050bb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.45:37136/0 (socket says 172.21.15.45:37136) 2024-05-10T03:43:08.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.442+0000 7fb1c77fe700 1 -- 172.21.15.45:0/2880746185 learned_addr learned my addr 172.21.15.45:0/2880746185 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:08.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.442+0000 7fb1c77fe700 1 --2- 172.21.15.45:0/2880746185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c050c0c30 0x555c050c3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.442+0000 7fb1c7fff700 1 --2- 172.21.15.45:0/2880746185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c050b2ec0 0x555c050bbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.444+0000 7fb1c7fff700 1 -- 172.21.15.45:0/2880746185 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555c050b2570 msgr2=0x555c050bb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.444+0000 7fb1c7fff700 1 --2- 172.21.15.45:0/2880746185 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555c050b2570 0x555c050bb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.444+0000 7fb1c7fff700 1 -- 172.21.15.45:0/2880746185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c050c0c30 msgr2=0x555c050c3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.444+0000 7fb1c7fff700 1 --2- 172.21.15.45:0/2880746185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c050c0c30 0x555c050c3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.444+0000 7fb1c7fff700 1 -- 172.21.15.45:0/2880746185 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1bc00e040 con 0x555c050b2ec0 2024-05-10T03:43:08.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.444+0000 7fb1c7fff700 1 --2- 172.21.15.45:0/2880746185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c050b2ec0 0x555c050bbda0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80098e0 tx=0x7fb1b8009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6acef722c87451c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:08.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.444+0000 7fb1a77fe700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-05-10T03:43:08.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.444+0000 7fb1a77fe700 1 -- 172.21.15.45:0/2880746185 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b800f870 con 0x555c050b2ec0 2024-05-10T03:43:08.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.444+0000 7fb1a77fe700 1 -- 172.21.15.45:0/2880746185 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb1b800f9d0 con 0x555c050b2ec0 2024-05-10T03:43:08.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.444+0000 7fb1de692b80 1 -- 172.21.15.45:0/2880746185 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555c04f2a270 con 0x555c050b2ec0 2024-05-10T03:43:08.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.446+0000 7fb1a77fe700 1 -- 172.21.15.45:0/2880746185 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1b800fb90 con 0x555c050b2ec0 2024-05-10T03:43:08.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.446+0000 7fb1de692b80 10 client.26416 fetch_fsmap learned FSMap version 33 2024-05-10T03:43:08.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.446+0000 7fb1de692b80 1 -- 172.21.15.45:0/2880746185 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x555c04dfeb60 con 0x555c050b2ec0 2024-05-10T03:43:08.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.448+0000 7fb1a77fe700 1 -- 172.21.15.45:0/2880746185 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x555c04f2a270 con 0x555c050b2ec0 2024-05-10T03:43:08.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.448+0000 7fb1a77fe700 1 -- 172.21.15.45:0/2880746185 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 33) v1 ==== 7502+0+0 (secure 0 0 0) 0x7fb1b8021070 con 0x555c050b2ec0 2024-05-10T03:43:08.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.449+0000 7fb1de692b80 10 client.26416 fetch_fsmap finished waiting for FSMap version 33 2024-05-10T03:43:08.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.449+0000 7fb1de692b80 10 client.26416 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-10T03:43:08.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.449+0000 7fb1de692b80 20 client.26416 populate_metadata read hostname 'smithi045' 2024-05-10T03:43:08.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.449+0000 7fb1de692b80 1 --2- 172.21.15.45:0/2880746185 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x555c050c7a40 0x555c050c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.449+0000 7fb1de692b80 4 client.26416 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:43:08.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.449+0000 7fb1de692b80 1 -- 172.21.15.45:0/2880746185 --> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555c05080780 con 0x555c050c7a40 2024-05-10T03:43:08.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.449+0000 7fb1c77fe700 1 --2- 172.21.15.45:0/2880746185 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x555c050c7a40 0x555c050c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.450+0000 7fb1c77fe700 1 --2- 172.21.15.45:0/2880746185 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x555c050c7a40 0x555c050c9e90 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b64920ca9cede234 server_cookie=9cda47060973062b in_seq=0 out_seq=0 2024-05-10T03:43:08.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.452+0000 7fb1a77fe700 10 client.26416 ms_handle_connect on v2:172.21.15.154:6838/1506563336 2024-05-10T03:43:08.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.452+0000 7fb1a77fe700 1 -- 172.21.15.45:0/2880746185 <== mds.2 v2:172.21.15.154:6838/1506563336 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555c05080780 con 0x555c050c7a40 2024-05-10T03:43:08.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.452+0000 7fb1a77fe700 10 client.26416 handle_command_reply: tid=0 2024-05-10T03:43:08.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.452+0000 7fb1de692b80 1 client.26416 shutdown 2024-05-10T03:43:08.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.454+0000 7fb1de692b80 1 -- 172.21.15.45:0/2880746185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c050b2ec0 msgr2=0x555c050bbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.454+0000 7fb1de692b80 1 --2- 172.21.15.45:0/2880746185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c050b2ec0 0x555c050bbda0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80098e0 tx=0x7fb1b8009f90 comp rx=0 tx=0).stop 2024-05-10T03:43:08.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.454+0000 7fb1de692b80 1 -- 172.21.15.45:0/2880746185 shutdown_connections 2024-05-10T03:43:08.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.454+0000 7fb1de692b80 1 --2- 172.21.15.45:0/2880746185 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x555c050c7a40 0x555c050c9e90 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.454+0000 7fb1de692b80 1 --2- 172.21.15.45:0/2880746185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c050c0c30 0x555c050c3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.454+0000 7fb1de692b80 1 --2- 172.21.15.45:0/2880746185 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555c050b2570 0x555c050bb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.454+0000 7fb1de692b80 1 --2- 172.21.15.45:0/2880746185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c050b2ec0 0x555c050bbda0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.454+0000 7fb1de692b80 1 -- 172.21.15.45:0/2880746185 >> 172.21.15.45:0/2880746185 conn(0x555c05013a60 msgr2=0x555c050abfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.455+0000 7fb1a77fe700 0 client.26416 ms_handle_reset on v2:172.21.15.154:6838/1506563336 2024-05-10T03:43:08.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.455+0000 7fb1de692b80 1 -- 172.21.15.45:0/2880746185 shutdown_connections 2024-05-10T03:43:08.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.455+0000 7fb1de692b80 1 -- 172.21.15.45:0/2880746185 wait complete. 2024-05-10T03:43:08.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.455+0000 7fb1de692b80 20 client.26416 trim_cache size 0 max 16384 2024-05-10T03:43:08.473 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:08 smithi154 ceph-mon[46565]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:08.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:08 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2600493694' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:43:08.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.474+0000 7fb1de692b80 1 Processor -- start 2024-05-10T03:43:08.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.474+0000 7fb1de692b80 1 -- start start 2024-05-10T03:43:08.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.474+0000 7fb1de692b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555c05013a60 0x555c050c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.474+0000 7fb1de692b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c050b2570 0x555c050d7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.474+0000 7fb1de692b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c050b2ec0 0x555c050d8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.474+0000 7fb1de692b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c050b7040 con 0x555c050b2570 2024-05-10T03:43:08.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.474+0000 7fb1de692b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c050bc3c0 con 0x555c05013a60 2024-05-10T03:43:08.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.474+0000 7fb1de692b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c050c7760 con 0x555c050b2ec0 2024-05-10T03:43:08.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.474+0000 7fb1c7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c050b2570 0x555c050d7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.475+0000 7fb1c7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c050b2570 0x555c050d7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45704/0 (socket says 172.21.15.45:45704) 2024-05-10T03:43:08.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.475+0000 7fb1c7fff700 1 -- 172.21.15.45:0/1121531556 learned_addr learned my addr 172.21.15.45:0/1121531556 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:08.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.475+0000 7fb1c77fe700 1 --2- 172.21.15.45:0/1121531556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c050b2ec0 0x555c050d8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.475+0000 7fb1c77fe700 1 --2- 172.21.15.45:0/1121531556 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555c05013a60 0x555c050c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.475+0000 7fb1c7fff700 1 -- 172.21.15.45:0/1121531556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c050b2ec0 msgr2=0x555c050d8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.475+0000 7fb1c7fff700 1 --2- 172.21.15.45:0/1121531556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c050b2ec0 0x555c050d8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.475+0000 7fb1c7fff700 1 -- 172.21.15.45:0/1121531556 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555c05013a60 msgr2=0x555c050c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.475+0000 7fb1c7fff700 1 --2- 172.21.15.45:0/1121531556 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555c05013a60 0x555c050c9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.475+0000 7fb1c7fff700 1 -- 172.21.15.45:0/1121531556 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c04f97560 con 0x555c050b2570 2024-05-10T03:43:08.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.475+0000 7fb1c77fe700 1 --2- 172.21.15.45:0/1121531556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c050b2ec0 0x555c050d8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:43:08.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.475+0000 7fb1c7fff700 1 --2- 172.21.15.45:0/1121531556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c050b2570 0x555c050d7d20 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8009990 tx=0x7fb1b8005ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db52c5d8c13afc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:08.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.475+0000 7fb1aeffd700 1 -- 172.21.15.45:0/1121531556 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b8017630 con 0x555c050b2570 2024-05-10T03:43:08.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.475+0000 7fb1aeffd700 1 -- 172.21.15.45:0/1121531556 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb1b801e040 con 0x555c050b2570 2024-05-10T03:43:08.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.475+0000 7fb1aeffd700 1 -- 172.21.15.45:0/1121531556 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b8017870 con 0x555c050b2570 2024-05-10T03:43:08.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.476+0000 7fb1de692b80 1 -- 172.21.15.45:0/1121531556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c050b2570 msgr2=0x555c050d7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.476+0000 7fb1de692b80 1 --2- 172.21.15.45:0/1121531556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c050b2570 0x555c050d7d20 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8009990 tx=0x7fb1b8005ee0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.476+0000 7fb1de692b80 1 -- 172.21.15.45:0/1121531556 shutdown_connections 2024-05-10T03:43:08.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.476+0000 7fb1de692b80 1 --2- 172.21.15.45:0/1121531556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c050b2ec0 0x555c050d8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.476+0000 7fb1de692b80 1 --2- 172.21.15.45:0/1121531556 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555c05013a60 0x555c050c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.476+0000 7fb1de692b80 1 --2- 172.21.15.45:0/1121531556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c050b2570 0x555c050d7d20 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.476+0000 7fb1de692b80 1 -- 172.21.15.45:0/1121531556 >> 172.21.15.45:0/1121531556 conn(0x555c050a8450 msgr2=0x555c050b57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.477+0000 7fb1de692b80 1 -- 172.21.15.45:0/1121531556 shutdown_connections 2024-05-10T03:43:08.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.477+0000 7fb1de692b80 1 -- 172.21.15.45:0/1121531556 wait complete. 2024-05-10T03:43:08.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.477+0000 7fb1de692b80 1 -- start start 2024-05-10T03:43:08.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.477+0000 7fb1de692b80 1 Processor -- start 2024-05-10T03:43:08.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.477+0000 7fb1de692b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555c05013a60 0x555c050d62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.477+0000 7fb1de692b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c050b2570 0x555c050d6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.478+0000 7fb1de692b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c050b2ec0 0x555c050d7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.478+0000 7fb1de692b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c050d7c70 con 0x555c050b2570 2024-05-10T03:43:08.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.478+0000 7fb1de692b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c050d7de0 con 0x555c05013a60 2024-05-10T03:43:08.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.478+0000 7fb1de692b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c050d7fa0 con 0x555c050b2ec0 2024-05-10T03:43:08.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.478+0000 7fb1de692b80 10 client.0 _ll_register_callbacks cb 0x555c04f76b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:43:08.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.478+0000 7fb1c7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c050b2570 0x555c050d6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.478+0000 7fb1c7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c050b2570 0x555c050d6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45706/0 (socket says 172.21.15.45:45706) 2024-05-10T03:43:08.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.478+0000 7fb1c77fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555c05013a60 0x555c050d62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.478+0000 7fb1c7fff700 1 -- 172.21.15.45:0/2795916856 learned_addr learned my addr 172.21.15.45:0/2795916856 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:08.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.478+0000 7fb1c77fe700 1 --2- 172.21.15.45:0/2795916856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c050b2ec0 0x555c050d7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.478+0000 7fb1c77fe700 1 -- 172.21.15.45:0/2795916856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c050b2ec0 msgr2=0x555c050d7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.478+0000 7fb1c77fe700 1 --2- 172.21.15.45:0/2795916856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c050b2ec0 0x555c050d7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.478+0000 7fb1c77fe700 1 -- 172.21.15.45:0/2795916856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c050b2570 msgr2=0x555c050d6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.478+0000 7fb1c77fe700 1 --2- 172.21.15.45:0/2795916856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c050b2570 0x555c050d6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.478+0000 7fb1c77fe700 1 -- 172.21.15.45:0/2795916856 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1bc052040 con 0x555c05013a60 2024-05-10T03:43:08.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.478+0000 7fb1c7fff700 1 --2- 172.21.15.45:0/2795916856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c050b2570 0x555c050d6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:43:08.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.478+0000 7fb1c77fe700 1 --2- 172.21.15.45:0/2795916856 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555c05013a60 0x555c050d62c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc00a0d0 tx=0x7fb1b8003860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72793da7219a04f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:08.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.478+0000 7fb1a77fe700 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-05-10T03:43:08.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.479+0000 7fb1a77fe700 1 -- 172.21.15.45:0/2795916856 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc016cd0 con 0x555c05013a60 2024-05-10T03:43:08.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.479+0000 7fb1a77fe700 1 -- 172.21.15.45:0/2795916856 <== mon.2 v2:172.21.15.106:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb1bc016e30 con 0x555c05013a60 2024-05-10T03:43:08.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.479+0000 7fb1de692b80 1 -- 172.21.15.45:0/2795916856 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb1bc00c070 con 0x555c05013a60 2024-05-10T03:43:08.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.479+0000 7fb1a77fe700 1 -- 172.21.15.45:0/2795916856 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1bc0393f0 con 0x555c05013a60 2024-05-10T03:43:08.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.479+0000 7fb1de692b80 10 client.26363 fetch_fsmap learned FSMap version 33 2024-05-10T03:43:08.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.479+0000 7fb1de692b80 1 -- 172.21.15.45:0/2795916856 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x555c04dfeb60 con 0x555c05013a60 2024-05-10T03:43:08.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.479+0000 7fb1a77fe700 1 -- 172.21.15.45:0/2795916856 <== mon.2 v2:172.21.15.106:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb1bc00c070 con 0x555c05013a60 2024-05-10T03:43:08.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.479+0000 7fb1a77fe700 1 -- 172.21.15.45:0/2795916856 <== mon.2 v2:172.21.15.106:3300/0 5 ==== fsmap(e 33) v1 ==== 7502+0+0 (secure 0 0 0) 0x7fb1bc012cf0 con 0x555c05013a60 2024-05-10T03:43:08.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.479+0000 7fb1de692b80 10 client.26363 fetch_fsmap finished waiting for FSMap version 33 2024-05-10T03:43:08.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.479+0000 7fb1de692b80 10 client.26363 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-10T03:43:08.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.479+0000 7fb1de692b80 20 client.26363 populate_metadata read hostname 'smithi045' 2024-05-10T03:43:08.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.479+0000 7fb1de692b80 1 --2- 172.21.15.45:0/2795916856 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x555c050c0c30 0x555c0511faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.479+0000 7fb1de692b80 4 client.26363 mds_command: new command op to 24547 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-10T03:43:08.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.479+0000 7fb1de692b80 1 -- 172.21.15.45:0/2795916856 --> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555c04fc9ec0 con 0x555c050c0c30 2024-05-10T03:43:08.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.479+0000 7fb1c7fff700 1 --2- 172.21.15.45:0/2795916856 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x555c050c0c30 0x555c0511faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.480+0000 7fb1c7fff700 1 --2- 172.21.15.45:0/2795916856 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x555c050c0c30 0x555c0511faf0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dd3081fdc28e00cc server_cookie=eb0fe22f135931d6 in_seq=0 out_seq=0 2024-05-10T03:43:08.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.480+0000 7fb1a77fe700 10 client.26363 ms_handle_connect on v2:172.21.15.154:6838/1506563336 2024-05-10T03:43:08.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.481+0000 7fb1a77fe700 1 -- 172.21.15.45:0/2795916856 <== mds.2 v2:172.21.15.154:6838/1506563336 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+37020 (crc 0 0 0) 0x555c04fc9ec0 con 0x555c050c0c30 2024-05-10T03:43:08.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.481+0000 7fb1a77fe700 10 client.26363 handle_command_reply: tid=0 2024-05-10T03:43:08.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.481+0000 7fb1de692b80 1 client.26363 shutdown 2024-05-10T03:43:08.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.482+0000 7fb1de692b80 1 -- 172.21.15.45:0/2795916856 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555c05013a60 msgr2=0x555c050d62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.482+0000 7fb1de692b80 1 --2- 172.21.15.45:0/2795916856 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555c05013a60 0x555c050d62c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc00a0d0 tx=0x7fb1b8003860 comp rx=0 tx=0).stop 2024-05-10T03:43:08.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.482+0000 7fb1de692b80 1 -- 172.21.15.45:0/2795916856 shutdown_connections 2024-05-10T03:43:08.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.482+0000 7fb1de692b80 1 --2- 172.21.15.45:0/2795916856 >> [v2:172.21.15.154:6838/1506563336,v1:172.21.15.154:6839/1506563336] conn(0x555c050c0c30 0x555c0511faf0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.482+0000 7fb1de692b80 1 --2- 172.21.15.45:0/2795916856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555c050b2ec0 0x555c050d7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.482+0000 7fb1de692b80 1 --2- 172.21.15.45:0/2795916856 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555c05013a60 0x555c050d62c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.482+0000 7fb1de692b80 1 --2- 172.21.15.45:0/2795916856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555c050b2570 0x555c050d6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.482+0000 7fb1a77fe700 0 client.26363 ms_handle_reset on v2:172.21.15.154:6838/1506563336 2024-05-10T03:43:08.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.482+0000 7fb1de692b80 1 -- 172.21.15.45:0/2795916856 >> 172.21.15.45:0/2795916856 conn(0x555c050a8450 msgr2=0x555c050c9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.482+0000 7fb1de692b80 1 -- 172.21.15.45:0/2795916856 shutdown_connections 2024-05-10T03:43:08.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.482+0000 7fb1de692b80 1 -- 172.21.15.45:0/2795916856 wait complete. 2024-05-10T03:43:08.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.482+0000 7fb1de692b80 20 client.26363 trim_cache size 0 max 16384 2024-05-10T03:43:08.489 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2024-05-10T03:43:08.489 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.489 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.489 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 24980774, 2024-05-10T03:43:08.489 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628245, 2024-05-10T03:43:08.489 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/pxa/mfp.txt" 2024-05-10T03:43:08.489 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.489 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.489 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.489 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 35863620, 2024-05-10T03:43:08.490 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628139, 2024-05-10T03:43:08.490 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/.gitignore" 2024-05-10T03:43:08.490 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.490 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.490 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.490 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 37629655, 2024-05-10T03:43:08.490 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628236, 2024-05-10T03:43:08.490 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/memory.txt" 2024-05-10T03:43:08.490 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.490 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.490 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.490 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 62985302, 2024-05-10T03:43:08.490 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628120, 2024-05-10T03:43:08.491 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/lockdep-splat.txt" 2024-05-10T03:43:08.491 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.491 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.491 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.491 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 68931233, 2024-05-10T03:43:08.491 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628182, 2024-05-10T03:43:08.491 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/OMAP/omap_pm" 2024-05-10T03:43:08.491 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.491 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.491 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.491 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 87937265, 2024-05-10T03:43:08.491 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628207, 2024-05-10T03:43:08.491 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c" 2024-05-10T03:43:08.492 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.492 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.492 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.492 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 110609765, 2024-05-10T03:43:08.492 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628239, 2024-05-10T03:43:08.492 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe" 2024-05-10T03:43:08.492 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.492 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.492 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.492 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 148449074, 2024-05-10T03:43:08.492 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628159, 2024-05-10T03:43:08.492 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/video_extension.txt" 2024-05-10T03:43:08.492 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.492 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.492 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.493 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 278038792, 2024-05-10T03:43:08.493 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628165, 2024-05-10T03:43:08.493 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/udev-install.sh" 2024-05-10T03:43:08.493 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.493 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.493 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.493 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 283475609, 2024-05-10T03:43:08.493 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628191, 2024-05-10T03:43:08.493 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/GraphicsClient" 2024-05-10T03:43:08.493 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.493 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.493 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.493 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 300426819, 2024-05-10T03:43:08.493 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628235, 2024-05-10T03:43:08.494 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/mem_alignment" 2024-05-10T03:43:08.494 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.494 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.494 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.494 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 333346263, 2024-05-10T03:43:08.494 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628162, 2024-05-10T03:43:08.494 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/autoload.sh" 2024-05-10T03:43:08.494 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.494 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.494 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.494 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 350435519, 2024-05-10T03:43:08.494 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628126, 2024-05-10T03:43:08.494 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rcuref.txt" 2024-05-10T03:43:08.495 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.495 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.495 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.495 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 378759839, 2024-05-10T03:43:08.495 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628115, 2024-05-10T03:43:08.495 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/RTFP.txt" 2024-05-10T03:43:08.495 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.495 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.495 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.495 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 444896589, 2024-05-10T03:43:08.495 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628221, 2024-05-10T03:43:08.495 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt" 2024-05-10T03:43:08.495 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.495 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.496 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.496 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 518353672, 2024-05-10T03:43:08.496 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628258, 2024-05-10T03:43:08.496 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/vlocks.txt" 2024-05-10T03:43:08.496 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.496 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.496 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.496 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 586132068, 2024-05-10T03:43:08.496 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628154, 2024-05-10T03:43:08.496 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/initrd_table_override.txt" 2024-05-10T03:43:08.496 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.496 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.496 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.496 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 689246517, 2024-05-10T03:43:08.496 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628227, 2024-05-10T03:43:08.497 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk" 2024-05-10T03:43:08.497 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.497 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.497 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.497 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 724594024, 2024-05-10T03:43:08.497 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628199, 2024-05-10T03:43:08.497 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Victor" 2024-05-10T03:43:08.497 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.497 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.497 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.497 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 744193314, 2024-05-10T03:43:08.497 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628213, 2024-05-10T03:43:08.497 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt" 2024-05-10T03:43:08.497 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.497 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.498 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.498 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 745525137, 2024-05-10T03:43:08.498 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628194, 2024-05-10T03:43:08.498 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Itsy" 2024-05-10T03:43:08.498 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.498 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.498 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.498 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 796728008, 2024-05-10T03:43:08.498 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628183, 2024-05-10T03:43:08.498 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Porting" 2024-05-10T03:43:08.498 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.498 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.498 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.498 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 850172828, 2024-05-10T03:43:08.499 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628109, 2024-05-10T03:43:08.499 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/pci-iov-howto.txt" 2024-05-10T03:43:08.499 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.499 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.499 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.499 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 862612266, 2024-05-10T03:43:08.499 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628172, 2024-05-10T03:43:08.499 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Booting" 2024-05-10T03:43:08.499 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.499 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.499 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.499 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 865090466, 2024-05-10T03:43:08.499 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628234, 2024-05-10T03:43:08.499 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/kernel_user_helpers.txt" 2024-05-10T03:43:08.499 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.500 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.500 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.500 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 867784721, 2024-05-10T03:43:08.500 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628143, 2024-05-10T03:43:08.500 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/getdelays.c" 2024-05-10T03:43:08.500 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.500 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.500 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.500 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 877199961, 2024-05-10T03:43:08.500 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628238, 2024-05-10T03:43:08.500 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/msm/gpiomux.txt" 2024-05-10T03:43:08.500 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.500 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.500 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.501 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 911310906, 2024-05-10T03:43:08.501 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628237, 2024-05-10T03:43:08.501 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/msm" 2024-05-10T03:43:08.501 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.501 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.501 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.501 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 918908886, 2024-05-10T03:43:08.501 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628218, 2024-05-10T03:43:08.501 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt" 2024-05-10T03:43:08.501 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.501 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.501 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.501 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 994497567, 2024-05-10T03:43:08.501 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628230, 2024-05-10T03:43:08.502 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/VFP/release-notes.txt" 2024-05-10T03:43:08.502 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.502 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.502 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.502 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 998574002, 2024-05-10T03:43:08.502 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628149, 2024-05-10T03:43:08.502 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/apei/output_format.txt" 2024-05-10T03:43:08.502 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.502 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.502 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.502 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 999484355, 2024-05-10T03:43:08.502 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628186, 2024-05-10T03:43:08.502 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/ADSBitsy" 2024-05-10T03:43:08.502 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.503 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.503 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.503 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1009165942, 2024-05-10T03:43:08.503 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628243, 2024-05-10T03:43:08.503 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/TODO" 2024-05-10T03:43:08.503 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.503 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.503 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.503 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1020261270, 2024-05-10T03:43:08.503 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628223, 2024-05-10T03:43:08.504 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt" 2024-05-10T03:43:08.504 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.504 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.504 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.504 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1020638005, 2024-05-10T03:43:08.504 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628175, 2024-05-10T03:43:08.504 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Interrupts" 2024-05-10T03:43:08.505 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.505 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.505 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.505 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1048732531, 2024-05-10T03:43:08.505 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628094, 2024-05-10T03:43:08.505 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/edid.S" 2024-05-10T03:43:08.505 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.505 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.505 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.505 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1052123746, 2024-05-10T03:43:08.505 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628106, 2024-05-10T03:43:08.505 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt" 2024-05-10T03:43:08.505 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.505 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.506 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.506 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1083307773, 2024-05-10T03:43:08.506 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628231, 2024-05-10T03:43:08.506 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt" 2024-05-10T03:43:08.506 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.506 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.506 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.506 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1120870193, 2024-05-10T03:43:08.506 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628196, 2024-05-10T03:43:08.506 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/PLEB" 2024-05-10T03:43:08.506 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.506 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.506 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.507 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1138570974, 2024-05-10T03:43:08.507 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628121, 2024-05-10T03:43:08.507 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/lockdep.txt" 2024-05-10T03:43:08.507 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.507 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.507 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.507 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1145210592, 2024-05-10T03:43:08.507 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628107, 2024-05-10T03:43:08.507 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt" 2024-05-10T03:43:08.507 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.507 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.507 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.507 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1149788082, 2024-05-10T03:43:08.507 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628224, 2024-05-10T03:43:08.507 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung" 2024-05-10T03:43:08.508 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.508 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.508 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.508 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1164646312, 2024-05-10T03:43:08.508 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628090, 2024-05-10T03:43:08.508 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1920x1080.S" 2024-05-10T03:43:08.508 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.508 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.508 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.508 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1165417442, 2024-05-10T03:43:08.509 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628116, 2024-05-10T03:43:08.509 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/UP.txt" 2024-05-10T03:43:08.509 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.509 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.509 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.509 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1201692310, 2024-05-10T03:43:08.509 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628110, 2024-05-10T03:43:08.509 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/pci.txt" 2024-05-10T03:43:08.509 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.509 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.509 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.510 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1219225578, 2024-05-10T03:43:08.510 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628171, 2024-05-10T03:43:08.510 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Atmel/README" 2024-05-10T03:43:08.510 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.510 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.510 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.510 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1235746795, 2024-05-10T03:43:08.510 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628185, 2024-05-10T03:43:08.511 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100" 2024-05-10T03:43:08.511 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.511 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.511 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.511 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1263184319, 2024-05-10T03:43:08.511 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628242, 2024-05-10T03:43:08.511 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/README.FPE" 2024-05-10T03:43:08.511 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.511 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.511 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.511 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1269290702, 2024-05-10T03:43:08.511 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628123, 2024-05-10T03:43:08.512 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rcu_dereference.txt" 2024-05-10T03:43:08.512 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.512 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.512 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.512 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1295325352, 2024-05-10T03:43:08.512 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628144, 2024-05-10T03:43:08.512 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/taskstats-struct.txt" 2024-05-10T03:43:08.512 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.512 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.512 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.512 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1296258216, 2024-05-10T03:43:08.512 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628189, 2024-05-10T03:43:08.512 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/CERF" 2024-05-10T03:43:08.513 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.513 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.513 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.513 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1301440760, 2024-05-10T03:43:08.513 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628217, 2024-05-10T03:43:08.513 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt" 2024-05-10T03:43:08.513 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.513 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.513 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.514 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1336212838, 2024-05-10T03:43:08.514 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628158, 2024-05-10T03:43:08.514 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/scan_handlers.txt" 2024-05-10T03:43:08.514 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.514 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.514 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.514 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1339058391, 2024-05-10T03:43:08.514 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628163, 2024-05-10T03:43:08.514 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/status.sh" 2024-05-10T03:43:08.514 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.515 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.515 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.515 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1345059959, 2024-05-10T03:43:08.515 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628255, 2024-05-10T03:43:08.515 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/swp_emulation" 2024-05-10T03:43:08.515 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.515 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.515 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.515 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1368093291, 2024-05-10T03:43:08.515 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628141, 2024-05-10T03:43:08.515 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/cgroupstats.txt" 2024-05-10T03:43:08.515 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.515 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.516 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.516 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1399917641, 2024-05-10T03:43:08.516 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628148, 2024-05-10T03:43:08.516 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/apei/einj.txt" 2024-05-10T03:43:08.516 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.516 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.516 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.516 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1494203506, 2024-05-10T03:43:08.516 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628214, 2024-05-10T03:43:08.516 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt" 2024-05-10T03:43:08.516 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.516 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.516 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.516 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1549890496, 2024-05-10T03:43:08.517 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628192, 2024-05-10T03:43:08.517 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster" 2024-05-10T03:43:08.517 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.517 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.517 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.517 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1563209283, 2024-05-10T03:43:08.517 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628153, 2024-05-10T03:43:08.517 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/gpio-properties.txt" 2024-05-10T03:43:08.517 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.517 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.517 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.517 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1569700585, 2024-05-10T03:43:08.517 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628161, 2024-05-10T03:43:08.517 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/aoe.txt" 2024-05-10T03:43:08.517 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.517 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.518 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.518 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1583027346, 2024-05-10T03:43:08.518 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628253, 2024-05-10T03:43:08.518 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sunxi/README" 2024-05-10T03:43:08.518 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.518 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.518 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.518 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1584702891, 2024-05-10T03:43:08.518 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628174, 2024-05-10T03:43:08.518 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/IXP4xx" 2024-05-10T03:43:08.518 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.518 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.518 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.519 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1620292935, 2024-05-10T03:43:08.519 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628176, 2024-05-10T03:43:08.519 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Makefile" 2024-05-10T03:43:08.519 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.519 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.519 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.519 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1633697063, 2024-05-10T03:43:08.519 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628209, 2024-05-10T03:43:08.519 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt" 2024-05-10T03:43:08.519 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.519 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.519 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.519 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1669935698, 2024-05-10T03:43:08.519 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628117, 2024-05-10T03:43:08.519 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/arrayRCU.txt" 2024-05-10T03:43:08.520 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.520 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.520 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.520 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1742655309, 2024-05-10T03:43:08.520 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628147, 2024-05-10T03:43:08.520 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/apei" 2024-05-10T03:43:08.520 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.520 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.520 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.520 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1750775453, 2024-05-10T03:43:08.520 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628170, 2024-05-10T03:43:08.520 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Atmel" 2024-05-10T03:43:08.520 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.520 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.521 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.521 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1788132360, 2024-05-10T03:43:08.521 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628157, 2024-05-10T03:43:08.521 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/namespace.txt" 2024-05-10T03:43:08.521 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.521 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.521 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.521 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1802796703, 2024-05-10T03:43:08.521 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628203, 2024-05-10T03:43:08.521 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/serial_UART" 2024-05-10T03:43:08.521 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.521 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.521 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.521 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1823676727, 2024-05-10T03:43:08.521 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628166, 2024-05-10T03:43:08.522 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/udev.txt" 2024-05-10T03:43:08.522 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.522 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.522 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.522 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1826427556, 2024-05-10T03:43:08.522 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628228, 2024-05-10T03:43:08.522 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Setup" 2024-05-10T03:43:08.522 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.522 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.522 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.522 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1840225227, 2024-05-10T03:43:08.522 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628124, 2024-05-10T03:43:08.522 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rcubarrier.txt" 2024-05-10T03:43:08.522 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.523 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.523 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.523 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1875334760, 2024-05-10T03:43:08.523 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628122, 2024-05-10T03:43:08.523 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rcu.txt" 2024-05-10T03:43:08.523 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.523 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.523 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.523 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1889168357, 2024-05-10T03:43:08.523 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628246, 2024-05-10T03:43:08.523 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti" 2024-05-10T03:43:08.523 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.523 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.523 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.524 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1924033109, 2024-05-10T03:43:08.524 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628188, 2024-05-10T03:43:08.524 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Brutus" 2024-05-10T03:43:08.524 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.524 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.524 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.524 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1952148767, 2024-05-10T03:43:08.524 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628151, 2024-05-10T03:43:08.524 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/dsdt-override.txt" 2024-05-10T03:43:08.524 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.525 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.525 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.525 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1952559125, 2024-05-10T03:43:08.525 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628248, 2024-05-10T03:43:08.525 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/stih407-overview.txt" 2024-05-10T03:43:08.525 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.525 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.525 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.525 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 1967175975, 2024-05-10T03:43:08.525 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628150, 2024-05-10T03:43:08.525 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/debug.txt" 2024-05-10T03:43:08.526 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.526 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.526 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.526 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2027783385, 2024-05-10T03:43:08.526 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628220, 2024-05-10T03:43:08.526 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt" 2024-05-10T03:43:08.526 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.526 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.526 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.526 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2030310107, 2024-05-10T03:43:08.526 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628256, 2024-05-10T03:43:08.526 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/tcm.txt" 2024-05-10T03:43:08.526 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.527 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.527 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.527 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2057549278, 2024-05-10T03:43:08.527 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628152, 2024-05-10T03:43:08.527 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/enumeration.txt" 2024-05-10T03:43:08.527 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.527 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.527 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.527 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2061131082, 2024-05-10T03:43:08.527 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628164, 2024-05-10T03:43:08.527 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/todo.txt" 2024-05-10T03:43:08.527 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.527 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.527 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.527 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2079270157, 2024-05-10T03:43:08.528 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628177, 2024-05-10T03:43:08.528 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Marvell" 2024-05-10T03:43:08.528 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.528 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.528 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.528 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2141870267, 2024-05-10T03:43:08.528 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628086, 2024-05-10T03:43:08.528 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1024x768.S" 2024-05-10T03:43:08.528 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.528 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.528 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.528 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2163073370, 2024-05-10T03:43:08.528 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628219, 2024-05-10T03:43:08.528 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt" 2024-05-10T03:43:08.529 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.529 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.529 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.529 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2169062630, 2024-05-10T03:43:08.529 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628095, 2024-05-10T03:43:08.529 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/hex" 2024-05-10T03:43:08.529 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.529 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.529 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.529 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2243642717, 2024-05-10T03:43:08.529 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628087, 2024-05-10T03:43:08.530 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1280x1024.S" 2024-05-10T03:43:08.530 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.530 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.530 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.530 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2258816956, 2024-05-10T03:43:08.530 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628118, 2024-05-10T03:43:08.530 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/checklist.txt" 2024-05-10T03:43:08.530 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.530 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.530 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.530 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2264175797, 2024-05-10T03:43:08.530 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628211, 2024-05-10T03:43:08.530 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SPEAr/overview.txt" 2024-05-10T03:43:08.531 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.531 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.531 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.531 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2266816406, 2024-05-10T03:43:08.531 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628169, 2024-05-10T03:43:08.531 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/00-INDEX" 2024-05-10T03:43:08.531 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.531 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.531 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.531 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2272974984, 2024-05-10T03:43:08.531 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628089, 2024-05-10T03:43:08.531 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1680x1050.S" 2024-05-10T03:43:08.531 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.531 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.532 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.532 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2287933635, 2024-05-10T03:43:08.532 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628129, 2024-05-10T03:43:08.532 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/trace.txt" 2024-05-10T03:43:08.532 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.532 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.532 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.532 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2357907461, 2024-05-10T03:43:08.532 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628173, 2024-05-10T03:43:08.532 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/CCN.txt" 2024-05-10T03:43:08.532 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.532 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.532 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.533 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2359975909, 2024-05-10T03:43:08.533 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628142, 2024-05-10T03:43:08.533 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/delay-accounting.txt" 2024-05-10T03:43:08.533 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.533 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.533 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.533 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2365021701, 2024-05-10T03:43:08.533 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628222, 2024-05-10T03:43:08.533 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt" 2024-05-10T03:43:08.533 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.533 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.533 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.533 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2365686904, 2024-05-10T03:43:08.533 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628092, 2024-05-10T03:43:08.534 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/HOWTO.txt" 2024-05-10T03:43:08.534 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.534 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.534 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.534 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2369565260, 2024-05-10T03:43:08.534 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628229, 2024-05-10T03:43:08.534 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/VFP" 2024-05-10T03:43:08.534 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.534 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.534 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.534 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2393073409, 2024-05-10T03:43:08.534 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628202, 2024-05-10T03:43:08.534 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/nanoEngine" 2024-05-10T03:43:08.535 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.535 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.535 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.535 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2406812815, 2024-05-10T03:43:08.535 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628195, 2024-05-10T03:43:08.535 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/LART" 2024-05-10T03:43:08.535 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.535 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.535 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.535 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2507928255, 2024-05-10T03:43:08.535 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628201, 2024-05-10T03:43:08.535 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/empeg" 2024-05-10T03:43:08.536 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.536 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.536 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.536 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2530985767, 2024-05-10T03:43:08.536 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628108, 2024-05-10T03:43:08.536 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/pci-error-recovery.txt" 2024-05-10T03:43:08.536 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.536 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.536 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.536 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2550352214, 2024-05-10T03:43:08.536 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628114, 2024-05-10T03:43:08.536 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/NMI-RCU.txt" 2024-05-10T03:43:08.536 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.536 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.537 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.537 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2550721440, 2024-05-10T03:43:08.537 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628125, 2024-05-10T03:43:08.537 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rculist_nulls.txt" 2024-05-10T03:43:08.537 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.537 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.537 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.537 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2633789402, 2024-05-10T03:43:08.537 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628145, 2024-05-10T03:43:08.537 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/taskstats.txt" 2024-05-10T03:43:08.537 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.537 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.537 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2680446037, 2024-05-10T03:43:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628215, 2024-05-10T03:43:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt" 2024-05-10T03:43:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2686168049, 2024-05-10T03:43:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628179, 2024-05-10T03:43:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Netwinder" 2024-05-10T03:43:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2729862405, 2024-05-10T03:43:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628184, 2024-05-10T03:43:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/README" 2024-05-10T03:43:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2743966242, 2024-05-10T03:43:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628252, 2024-05-10T03:43:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sunxi" 2024-05-10T03:43:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2927665469, 2024-05-10T03:43:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628244, 2024-05-10T03:43:08.540 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/pxa" 2024-05-10T03:43:08.540 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.540 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.540 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.540 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 2963866063, 2024-05-10T03:43:08.540 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628119, 2024-05-10T03:43:08.540 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/listRCU.txt" 2024-05-10T03:43:08.540 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.540 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.540 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.540 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3021026830, 2024-05-10T03:43:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628093, 2024-05-10T03:43:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/Makefile" 2024-05-10T03:43:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3055446480, 2024-05-10T03:43:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628181, 2024-05-10T03:43:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/OMAP/DSS" 2024-05-10T03:43:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3132745246, 2024-05-10T03:43:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628212, 2024-05-10T03:43:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX" 2024-05-10T03:43:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3156480733, 2024-05-10T03:43:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628105, 2024-05-10T03:43:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/00-INDEX" 2024-05-10T03:43:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3157352895, 2024-05-10T03:43:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628232, 2024-05-10T03:43:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/firmware.txt" 2024-05-10T03:43:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3160960522, 2024-05-10T03:43:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628198, 2024-05-10T03:43:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Tifon" 2024-05-10T03:43:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3168816645, 2024-05-10T03:43:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628130, 2024-05-10T03:43:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/whatisRCU.txt" 2024-05-10T03:43:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3192121138, 2024-05-10T03:43:08.544 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628251, 2024-05-10T03:43:08.544 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/stih418-overview.txt" 2024-05-10T03:43:08.544 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.544 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.544 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.544 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3225256925, 2024-05-10T03:43:08.544 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628257, 2024-05-10T03:43:08.544 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/uefi.txt" 2024-05-10T03:43:08.544 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.544 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.544 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.544 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3307077424, 2024-05-10T03:43:08.544 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628226, 2024-05-10T03:43:08.544 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung/Overview.txt" 2024-05-10T03:43:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3308275961, 2024-05-10T03:43:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628216, 2024-05-10T03:43:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt" 2024-05-10T03:43:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3377817286, 2024-05-10T03:43:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628210, 2024-05-10T03:43:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SPEAr" 2024-05-10T03:43:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3388430381, 2024-05-10T03:43:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628128, 2024-05-10T03:43:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/torture.txt" 2024-05-10T03:43:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3523547076, 2024-05-10T03:43:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628088, 2024-05-10T03:43:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1600x1200.S" 2024-05-10T03:43:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3549347743, 2024-05-10T03:43:08.547 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628250, 2024-05-10T03:43:08.547 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/stih416-overview.txt" 2024-05-10T03:43:08.547 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.547 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.547 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.547 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3593078709, 2024-05-10T03:43:08.547 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628155, 2024-05-10T03:43:08.547 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/method-customizing.txt" 2024-05-10T03:43:08.547 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.547 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.547 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.547 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3626313931, 2024-05-10T03:43:08.547 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628233, 2024-05-10T03:43:08.547 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/kernel_mode_neon.txt" 2024-05-10T03:43:08.548 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.548 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.548 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.548 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3691155502, 2024-05-10T03:43:08.548 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628204, 2024-05-10T03:43:08.548 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile" 2024-05-10T03:43:08.548 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.548 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.548 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.548 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3700552911, 2024-05-10T03:43:08.548 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628254, 2024-05-10T03:43:08.548 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sunxi/clocks.txt" 2024-05-10T03:43:08.548 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.548 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.549 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.549 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3711356053, 2024-05-10T03:43:08.549 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628249, 2024-05-10T03:43:08.549 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/stih415-overview.txt" 2024-05-10T03:43:08.549 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.549 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.549 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.549 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3719301697, 2024-05-10T03:43:08.549 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628193, 2024-05-10T03:43:08.549 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL" 2024-05-10T03:43:08.549 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.549 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.549 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.549 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3756593150, 2024-05-10T03:43:08.549 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628187, 2024-05-10T03:43:08.550 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Assabet" 2024-05-10T03:43:08.550 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.550 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.550 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.550 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3853712043, 2024-05-10T03:43:08.550 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628178, 2024-05-10T03:43:08.550 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Marvell/README" 2024-05-10T03:43:08.550 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.550 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.550 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.550 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3867540619, 2024-05-10T03:43:08.550 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628205, 2024-05-10T03:43:08.550 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore" 2024-05-10T03:43:08.551 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.551 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.551 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.551 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3938990816, 2024-05-10T03:43:08.551 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628225, 2024-05-10T03:43:08.551 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung/GPIO.txt" 2024-05-10T03:43:08.551 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.551 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.551 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.551 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3951434640, 2024-05-10T03:43:08.552 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628206, 2024-05-10T03:43:08.552 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/Makefile" 2024-05-10T03:43:08.552 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.552 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.552 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.552 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 3969028115, 2024-05-10T03:43:08.552 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628240, 2024-05-10T03:43:08.552 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/NOTES" 2024-05-10T03:43:08.552 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.552 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.552 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.552 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4028874083, 2024-05-10T03:43:08.552 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628111, 2024-05-10T03:43:08.552 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/pcieaer-howto.txt" 2024-05-10T03:43:08.552 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.553 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.553 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.553 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4043549232, 2024-05-10T03:43:08.553 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628091, 2024-05-10T03:43:08.553 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/800x600.S" 2024-05-10T03:43:08.553 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.553 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.553 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.553 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4054363826, 2024-05-10T03:43:08.553 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628113, 2024-05-10T03:43:08.553 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/00-INDEX" 2024-05-10T03:43:08.553 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.553 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.553 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.554 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4057889615, 2024-05-10T03:43:08.554 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628241, 2024-05-10T03:43:08.554 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/README" 2024-05-10T03:43:08.554 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.554 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.554 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.554 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4100532129, 2024-05-10T03:43:08.554 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628200, 2024-05-10T03:43:08.554 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Yopy" 2024-05-10T03:43:08.554 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.554 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.554 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.554 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4114472111, 2024-05-10T03:43:08.554 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628190, 2024-05-10T03:43:08.555 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/FreeBird" 2024-05-10T03:43:08.555 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.555 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.555 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.555 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4115249569, 2024-05-10T03:43:08.555 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628140, 2024-05-10T03:43:08.555 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/Makefile" 2024-05-10T03:43:08.555 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.555 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.555 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.555 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4130857150, 2024-05-10T03:43:08.555 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628197, 2024-05-10T03:43:08.555 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Pangolin" 2024-05-10T03:43:08.555 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.555 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.556 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.556 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4137238426, 2024-05-10T03:43:08.556 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628208, 2024-05-10T03:43:08.556 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt" 2024-05-10T03:43:08.556 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.556 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.556 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.556 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4208433693, 2024-05-10T03:43:08.556 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628180, 2024-05-10T03:43:08.556 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/OMAP" 2024-05-10T03:43:08.556 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.556 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.556 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.556 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4237723307, 2024-05-10T03:43:08.557 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628156, 2024-05-10T03:43:08.557 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/method-tracing.txt" 2024-05-10T03:43:08.557 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.557 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.557 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.557 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4244783458, 2024-05-10T03:43:08.557 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628247, 2024-05-10T03:43:08.557 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/overview.txt" 2024-05-10T03:43:08.557 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:08.557 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:08.557 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2024-05-10T03:43:08.557 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4247376778, 2024-05-10T03:43:08.557 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511628127, 2024-05-10T03:43:08.557 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/stallwarn.txt" 2024-05-10T03:43:08.557 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:08.558 INFO:teuthology.orchestra.run.smithi045.stdout:] 2024-05-10T03:43:08.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.482+0000 7fb1ce34e700 1 -- 172.21.15.45:0/1434911067 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb1b00a12c0 msgr2=0x7fb1b00a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.482+0000 7fb1ce34e700 1 --2- 172.21.15.45:0/1434911067 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb1b00a12c0 0x7fb1b00a37d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0004c20 tx=0x7fb1c0085040 comp rx=0 tx=0).stop 2024-05-10T03:43:08.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.482+0000 7fb1ce34e700 1 -- 172.21.15.45:0/1434911067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1c8107980 msgr2=0x7fb1c8111120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.482+0000 7fb1ce34e700 1 --2- 172.21.15.45:0/1434911067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1c8107980 0x7fb1c8111120 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000b9e0 tx=0x7fb1c000bcf0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.483+0000 7fb1ce34e700 1 -- 172.21.15.45:0/1434911067 shutdown_connections 2024-05-10T03:43:08.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.483+0000 7fb1ce34e700 1 --2- 172.21.15.45:0/1434911067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c81026c0 0x7fb1c8112900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.483+0000 7fb1ce34e700 1 --2- 172.21.15.45:0/1434911067 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb1b00a12c0 0x7fb1b00a37d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.483+0000 7fb1ce34e700 1 --2- 172.21.15.45:0/1434911067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1c8107980 0x7fb1c8111120 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.483+0000 7fb1ce34e700 1 --2- 172.21.15.45:0/1434911067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1c8105020 0x7fb1c8112e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.483+0000 7fb1ce34e700 1 -- 172.21.15.45:0/1434911067 >> 172.21.15.45:0/1434911067 conn(0x7fb1c80fc0e0 msgr2=0x7fb1c8103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.483+0000 7fb1ce34e700 1 -- 172.21.15.45:0/1434911067 shutdown_connections 2024-05-10T03:43:08.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.483+0000 7fb1ce34e700 1 -- 172.21.15.45:0/1434911067 wait complete. 2024-05-10T03:43:08.560 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:08 smithi045 ceph-mon[42520]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:08.560 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:08 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2600493694' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:43:08.561 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-10T03:43:08.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.720+0000 7fd9cf2a6700 1 -- 172.21.15.45:0/3386623180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c8109ab0 msgr2=0x7fd9c810bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.720+0000 7fd9cf2a6700 1 --2- 172.21.15.45:0/3386623180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c8109ab0 0x7fd9c810bf90 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fd9c000b0a0 tx=0x7fd9c000b3b0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.720+0000 7fd9cf2a6700 1 -- 172.21.15.45:0/3386623180 shutdown_connections 2024-05-10T03:43:08.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.720+0000 7fd9cf2a6700 1 --2- 172.21.15.45:0/3386623180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c8075140 0x7fd9c8073600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.720+0000 7fd9cf2a6700 1 --2- 172.21.15.45:0/3386623180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c8109ab0 0x7fd9c810bf90 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.720+0000 7fd9cf2a6700 1 --2- 172.21.15.45:0/3386623180 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9c8073b40 0x7fd9c8074010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.720+0000 7fd9cf2a6700 1 -- 172.21.15.45:0/3386623180 >> 172.21.15.45:0/3386623180 conn(0x7fd9c80fd1e0 msgr2=0x7fd9c80ff690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.720+0000 7fd9cf2a6700 1 -- 172.21.15.45:0/3386623180 shutdown_connections 2024-05-10T03:43:08.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.720+0000 7fd9cf2a6700 1 -- 172.21.15.45:0/3386623180 wait complete. 2024-05-10T03:43:08.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.721+0000 7fd9cf2a6700 1 Processor -- start 2024-05-10T03:43:08.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.721+0000 7fd9cf2a6700 1 -- start start 2024-05-10T03:43:08.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.721+0000 7fd9cf2a6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9c8073b40 0x7fd9c819a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.721+0000 7fd9cf2a6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c8075140 0x7fd9c819a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.721+0000 7fd9cf2a6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c8109ab0 0x7fd9c81a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.721+0000 7fd9cf2a6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c81a1d60 con 0x7fd9c8075140 2024-05-10T03:43:08.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.721+0000 7fd9cf2a6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c81a1ed0 con 0x7fd9c8073b40 2024-05-10T03:43:08.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.721+0000 7fd9cf2a6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c81a2090 con 0x7fd9c8109ab0 2024-05-10T03:43:08.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.721+0000 7fd9cd042700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9c8073b40 0x7fd9c819a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.721+0000 7fd9cc841700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c8075140 0x7fd9c819a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.722+0000 7fd9cd042700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9c8073b40 0x7fd9c819a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.45:37172/0 (socket says 172.21.15.45:37172) 2024-05-10T03:43:08.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.722+0000 7fd9cc841700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c8075140 0x7fd9c819a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45722/0 (socket says 172.21.15.45:45722) 2024-05-10T03:43:08.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.722+0000 7fd9cd042700 1 -- 172.21.15.45:0/3791187966 learned_addr learned my addr 172.21.15.45:0/3791187966 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:08.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.722+0000 7fd9cd843700 1 --2- 172.21.15.45:0/3791187966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c8109ab0 0x7fd9c81a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.722+0000 7fd9cd042700 1 -- 172.21.15.45:0/3791187966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c8109ab0 msgr2=0x7fd9c81a1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.722+0000 7fd9cd042700 1 --2- 172.21.15.45:0/3791187966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c8109ab0 0x7fd9c81a1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.722+0000 7fd9cd042700 1 -- 172.21.15.45:0/3791187966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c8075140 msgr2=0x7fd9c819a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.722+0000 7fd9cd042700 1 --2- 172.21.15.45:0/3791187966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c8075140 0x7fd9c819a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.722+0000 7fd9cd042700 1 -- 172.21.15.45:0/3791187966 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b8009520 con 0x7fd9c8073b40 2024-05-10T03:43:08.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.722+0000 7fd9cd042700 1 --2- 172.21.15.45:0/3791187966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9c8073b40 0x7fd9c819a280 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd9c400e970 tx=0x7fd9c400ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:08.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.722+0000 7fd9be7fc700 1 -- 172.21.15.45:0/3791187966 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4009790 con 0x7fd9c8073b40 2024-05-10T03:43:08.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.722+0000 7fd9be7fc700 1 -- 172.21.15.45:0/3791187966 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd9c400c7e0 con 0x7fd9c8073b40 2024-05-10T03:43:08.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.722+0000 7fd9cf2a6700 1 -- 172.21.15.45:0/3791187966 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c0009d00 con 0x7fd9c8073b40 2024-05-10T03:43:08.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.722+0000 7fd9be7fc700 1 -- 172.21.15.45:0/3791187966 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4005580 con 0x7fd9c8073b40 2024-05-10T03:43:08.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.722+0000 7fd9cf2a6700 1 -- 172.21.15.45:0/3791187966 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c81a26f0 con 0x7fd9c8073b40 2024-05-10T03:43:08.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.725+0000 7fd9be7fc700 1 -- 172.21.15.45:0/3791187966 <== mon.2 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd9c400cce0 con 0x7fd9c8073b40 2024-05-10T03:43:08.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.726+0000 7fd9be7fc700 1 --2- 172.21.15.45:0/3791187966 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd9b40a11c0 0x7fd9b40a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.726+0000 7fd9cc841700 1 --2- 172.21.15.45:0/3791187966 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd9b40a11c0 0x7fd9b40a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.726+0000 7fd9be7fc700 1 -- 172.21.15.45:0/3791187966 <== mon.2 v2:172.21.15.106:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd9c4014070 con 0x7fd9c8073b40 2024-05-10T03:43:08.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.726+0000 7fd9df5eab80 1 Processor -- start 2024-05-10T03:43:08.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.726+0000 7fd9df5eab80 1 -- start start 2024-05-10T03:43:08.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.727+0000 7fd9cc841700 1 --2- 172.21.15.45:0/3791187966 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd9b40a11c0 0x7fd9b40a36d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd9c819b320 tx=0x7fd9b8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:08.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.727+0000 7fd9df5eab80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e23f3e46a0 0x55e23f3e4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.727+0000 7fd9df5eab80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e23f3e5570 0x55e23f3e5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.727+0000 7fd9df5eab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e5ec0 0x55e23f3ec7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.727+0000 7fd9df5eab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e23f30b150 con 0x55e23f3e5ec0 2024-05-10T03:43:08.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.727+0000 7fd9df5eab80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e23f308b10 con 0x55e23f3e46a0 2024-05-10T03:43:08.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.727+0000 7fd9df5eab80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e23f304400 con 0x55e23f3e5570 2024-05-10T03:43:08.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.727+0000 7fd9cd042700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e23f3e46a0 0x55e23f3e4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.727+0000 7fd9cc841700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e23f3e5570 0x55e23f3e5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.727+0000 7fd9cd042700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e23f3e46a0 0x55e23f3e4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.45:37186/0 (socket says 172.21.15.45:37186) 2024-05-10T03:43:08.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.727+0000 7fd9cd042700 1 -- 172.21.15.45:0/1903758434 learned_addr learned my addr 172.21.15.45:0/1903758434 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:08.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.727+0000 7fd9cd843700 1 --2- 172.21.15.45:0/1903758434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e5ec0 0x55e23f3ec7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.727+0000 7fd9cd042700 1 -- 172.21.15.45:0/1903758434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e23f3e5570 msgr2=0x55e23f3e5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.727+0000 7fd9cd042700 1 --2- 172.21.15.45:0/1903758434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e23f3e5570 0x55e23f3e5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.727+0000 7fd9cd042700 1 -- 172.21.15.45:0/1903758434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e5ec0 msgr2=0x55e23f3ec7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.727+0000 7fd9cd042700 1 --2- 172.21.15.45:0/1903758434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e5ec0 0x55e23f3ec7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.727+0000 7fd9cd042700 1 -- 172.21.15.45:0/1903758434 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e23f1853b0 con 0x55e23f3e46a0 2024-05-10T03:43:08.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.727+0000 7fd9cd843700 1 --2- 172.21.15.45:0/1903758434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e5ec0 0x55e23f3ec7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:43:08.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.727+0000 7fd9cc841700 1 --2- 172.21.15.45:0/1903758434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e23f3e5570 0x55e23f3e5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:43:08.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.728+0000 7fd9cd042700 1 --2- 172.21.15.45:0/1903758434 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e23f3e46a0 0x55e23f3e4af0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40a1eb0 tx=0x7fd9c40057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a83e807a1dd24b08 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:08.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.728+0000 7fd9b37fe700 1 -- 172.21.15.45:0/1903758434 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c40b1070 con 0x55e23f3e46a0 2024-05-10T03:43:08.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.728+0000 7fd9b37fe700 1 -- 172.21.15.45:0/1903758434 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd9c409dd90 con 0x55e23f3e46a0 2024-05-10T03:43:08.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.728+0000 7fd9b37fe700 1 -- 172.21.15.45:0/1903758434 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4016330 con 0x55e23f3e46a0 2024-05-10T03:43:08.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.729+0000 7fd9df5eab80 1 -- 172.21.15.45:0/1903758434 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e23f3e46a0 msgr2=0x55e23f3e4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.729+0000 7fd9df5eab80 1 --2- 172.21.15.45:0/1903758434 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e23f3e46a0 0x55e23f3e4af0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40a1eb0 tx=0x7fd9c40057f0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.729+0000 7fd9df5eab80 1 -- 172.21.15.45:0/1903758434 shutdown_connections 2024-05-10T03:43:08.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.729+0000 7fd9df5eab80 1 --2- 172.21.15.45:0/1903758434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e5ec0 0x55e23f3ec7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.729+0000 7fd9df5eab80 1 --2- 172.21.15.45:0/1903758434 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e23f3e46a0 0x55e23f3e4af0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.729+0000 7fd9df5eab80 1 --2- 172.21.15.45:0/1903758434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e23f3e5570 0x55e23f3e5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.729+0000 7fd9df5eab80 1 -- 172.21.15.45:0/1903758434 >> 172.21.15.45:0/1903758434 conn(0x55e23f346a60 msgr2=0x55e23f3defe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.729+0000 7fd9df5eab80 1 -- 172.21.15.45:0/1903758434 shutdown_connections 2024-05-10T03:43:08.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.729+0000 7fd9df5eab80 1 -- 172.21.15.45:0/1903758434 wait complete. 2024-05-10T03:43:08.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.730+0000 7fd9df5eab80 1 -- start start 2024-05-10T03:43:08.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.730+0000 7fd9df5eab80 1 Processor -- start 2024-05-10T03:43:08.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.730+0000 7fd9df5eab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e46a0 0x55e23f3ee6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.730+0000 7fd9df5eab80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e23f3e5570 0x55e23f3eec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.730+0000 7fd9df5eab80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e23f3e5ec0 0x55e23f3f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.730+0000 7fd9df5eab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e23f2a0560 con 0x55e23f3e46a0 2024-05-10T03:43:08.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.730+0000 7fd9df5eab80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e23f2a0200 con 0x55e23f3e5570 2024-05-10T03:43:08.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.730+0000 7fd9df5eab80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e23f1876a0 con 0x55e23f3e5ec0 2024-05-10T03:43:08.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.730+0000 7fd9df5eab80 10 client.0 _ll_register_callbacks cb 0x55e23f2a9b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:43:08.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.731+0000 7fd9cd042700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e46a0 0x55e23f3ee6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.731+0000 7fd9cd042700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e46a0 0x55e23f3ee6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45746/0 (socket says 172.21.15.45:45746) 2024-05-10T03:43:08.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.731+0000 7fd9cd042700 1 -- 172.21.15.45:0/3419703121 learned_addr learned my addr 172.21.15.45:0/3419703121 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:08.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.731+0000 7fd9cd042700 1 -- 172.21.15.45:0/3419703121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e23f3e5ec0 msgr2=0x55e23f3f5b60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T03:43:08.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.731+0000 7fd9cc841700 1 --2- 172.21.15.45:0/3419703121 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e23f3e5570 0x55e23f3eec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.731+0000 7fd9cd042700 1 --2- 172.21.15.45:0/3419703121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e23f3e5ec0 0x55e23f3f5b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.731+0000 7fd9cd042700 1 -- 172.21.15.45:0/3419703121 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e23f3e5570 msgr2=0x55e23f3eec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.731+0000 7fd9cd042700 1 --2- 172.21.15.45:0/3419703121 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e23f3e5570 0x55e23f3eec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.731+0000 7fd9cd042700 1 -- 172.21.15.45:0/3419703121 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b8017070 con 0x55e23f3e46a0 2024-05-10T03:43:08.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.731+0000 7fd9cc841700 1 --2- 172.21.15.45:0/3419703121 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e23f3e5570 0x55e23f3eec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:43:08.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.731+0000 7fd9cd042700 1 --2- 172.21.15.45:0/3419703121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e46a0 0x55e23f3ee6c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40969d0 tx=0x7fd9c4096350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0a5d0a549ba0e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:08.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.731+0000 7fd9b0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:43:08.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.732+0000 7fd9b0ff9700 1 -- 172.21.15.45:0/3419703121 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c40b1030 con 0x55e23f3e46a0 2024-05-10T03:43:08.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.732+0000 7fd9b0ff9700 1 -- 172.21.15.45:0/3419703121 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd9c40b2070 con 0x55e23f3e46a0 2024-05-10T03:43:08.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.732+0000 7fd9df5eab80 1 -- 172.21.15.45:0/3419703121 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e23f25d270 con 0x55e23f3e46a0 2024-05-10T03:43:08.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.732+0000 7fd9b0ff9700 1 -- 172.21.15.45:0/3419703121 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9c40b82d0 con 0x55e23f3e46a0 2024-05-10T03:43:08.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.732+0000 7fd9df5eab80 10 client.16575 fetch_fsmap learned FSMap version 33 2024-05-10T03:43:08.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.732+0000 7fd9df5eab80 1 -- 172.21.15.45:0/3419703121 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7fd9c81a26f0 con 0x55e23f3e46a0 2024-05-10T03:43:08.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.733+0000 7fd9b0ff9700 1 -- 172.21.15.45:0/3419703121 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55e23f25d270 con 0x55e23f3e46a0 2024-05-10T03:43:08.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.733+0000 7fd9b0ff9700 1 -- 172.21.15.45:0/3419703121 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 33) v1 ==== 7502+0+0 (secure 0 0 0) 0x7fd9c4094b70 con 0x55e23f3e46a0 2024-05-10T03:43:08.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.733+0000 7fd9df5eab80 10 client.16575 fetch_fsmap finished waiting for FSMap version 33 2024-05-10T03:43:08.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.733+0000 7fd9df5eab80 10 client.16575 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-10T03:43:08.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.733+0000 7fd9df5eab80 20 client.16575 populate_metadata read hostname 'smithi045' 2024-05-10T03:43:08.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.733+0000 7fd9df5eab80 1 --2- 172.21.15.45:0/3419703121 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55e23f3fa080 0x55e23f3fc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.733+0000 7fd9df5eab80 4 client.16575 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:43:08.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.733+0000 7fd9df5eab80 1 -- 172.21.15.45:0/3419703121 --> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e23f3b3780 con 0x55e23f3fa080 2024-05-10T03:43:08.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.734+0000 7fd9cc841700 1 --2- 172.21.15.45:0/3419703121 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55e23f3fa080 0x55e23f3fc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.735+0000 7fd9cc841700 1 --2- 172.21.15.45:0/3419703121 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55e23f3fa080 0x55e23f3fc4d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=49201f45134aaa8d server_cookie=f56ff0793a6d7d84 in_seq=0 out_seq=0 2024-05-10T03:43:08.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.735+0000 7fd9b0ff9700 10 client.16575 ms_handle_connect on v2:172.21.15.106:6836/3047487403 2024-05-10T03:43:08.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.735+0000 7fd9b0ff9700 1 -- 172.21.15.45:0/3419703121 <== mds.1 v2:172.21.15.106:6836/3047487403 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e23f3b3780 con 0x55e23f3fa080 2024-05-10T03:43:08.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.735+0000 7fd9b0ff9700 10 client.16575 handle_command_reply: tid=0 2024-05-10T03:43:08.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.735+0000 7fd9df5eab80 1 client.16575 shutdown 2024-05-10T03:43:08.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.736+0000 7fd9df5eab80 1 -- 172.21.15.45:0/3419703121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e46a0 msgr2=0x55e23f3ee6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.736+0000 7fd9df5eab80 1 --2- 172.21.15.45:0/3419703121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e46a0 0x55e23f3ee6c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40969d0 tx=0x7fd9c4096350 comp rx=0 tx=0).stop 2024-05-10T03:43:08.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.736+0000 7fd9df5eab80 1 -- 172.21.15.45:0/3419703121 shutdown_connections 2024-05-10T03:43:08.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.736+0000 7fd9df5eab80 1 --2- 172.21.15.45:0/3419703121 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55e23f3fa080 0x55e23f3fc4d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.736+0000 7fd9df5eab80 1 --2- 172.21.15.45:0/3419703121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e23f3e5ec0 0x55e23f3f5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.736+0000 7fd9b0ff9700 0 client.16575 ms_handle_reset on v2:172.21.15.106:6836/3047487403 2024-05-10T03:43:08.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.736+0000 7fd9df5eab80 1 --2- 172.21.15.45:0/3419703121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e46a0 0x55e23f3ee6c0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.736+0000 7fd9df5eab80 1 --2- 172.21.15.45:0/3419703121 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e23f3e5570 0x55e23f3eec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.736+0000 7fd9df5eab80 1 -- 172.21.15.45:0/3419703121 >> 172.21.15.45:0/3419703121 conn(0x55e23f346a60 msgr2=0x55e23f3defb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.736+0000 7fd9df5eab80 1 -- 172.21.15.45:0/3419703121 shutdown_connections 2024-05-10T03:43:08.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.736+0000 7fd9df5eab80 1 -- 172.21.15.45:0/3419703121 wait complete. 2024-05-10T03:43:08.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.736+0000 7fd9df5eab80 20 client.16575 trim_cache size 0 max 16384 2024-05-10T03:43:08.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.757+0000 7fd9df5eab80 1 Processor -- start 2024-05-10T03:43:08.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.758+0000 7fd9df5eab80 1 -- start start 2024-05-10T03:43:08.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.758+0000 7fd9df5eab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e46a0 0x55e23f3e4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.758+0000 7fd9df5eab80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e23f3e5570 0x55e23f3f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.758+0000 7fd9df5eab80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e23f3e5ec0 0x55e23f3e87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.758+0000 7fd9df5eab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e23f3f68c0 con 0x55e23f3e46a0 2024-05-10T03:43:08.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.758+0000 7fd9df5eab80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e23f3f6a30 con 0x55e23f3e5570 2024-05-10T03:43:08.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.758+0000 7fd9df5eab80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e23f3f6170 con 0x55e23f3e5ec0 2024-05-10T03:43:08.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.758+0000 7fd9cd042700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e46a0 0x55e23f3e4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.758+0000 7fd9cd042700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e46a0 0x55e23f3e4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45760/0 (socket says 172.21.15.45:45760) 2024-05-10T03:43:08.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.758+0000 7fd9cd042700 1 -- 172.21.15.45:0/569788497 learned_addr learned my addr 172.21.15.45:0/569788497 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:08.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.758+0000 7fd9cd843700 1 --2- 172.21.15.45:0/569788497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e23f3e5ec0 0x55e23f3e87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.758+0000 7fd9cc841700 1 --2- 172.21.15.45:0/569788497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e23f3e5570 0x55e23f3f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.758+0000 7fd9cd042700 1 -- 172.21.15.45:0/569788497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e23f3e5ec0 msgr2=0x55e23f3e87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.758+0000 7fd9cd042700 1 --2- 172.21.15.45:0/569788497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e23f3e5ec0 0x55e23f3e87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.758+0000 7fd9cd042700 1 -- 172.21.15.45:0/569788497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e23f3e5570 msgr2=0x55e23f3f5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.758+0000 7fd9cd042700 1 --2- 172.21.15.45:0/569788497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e23f3e5570 0x55e23f3f5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.758+0000 7fd9cd042700 1 -- 172.21.15.45:0/569788497 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e23f131b60 con 0x55e23f3e46a0 2024-05-10T03:43:08.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.759+0000 7fd9cd042700 1 --2- 172.21.15.45:0/569788497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e46a0 0x55e23f3e4d00 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fd9c400c4e0 tx=0x7fd9c400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d349b7ea4c6f9281 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:08.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.759+0000 7fd9b3fff700 1 -- 172.21.15.45:0/569788497 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c40b1070 con 0x55e23f3e46a0 2024-05-10T03:43:08.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.759+0000 7fd9b3fff700 1 -- 172.21.15.45:0/569788497 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd9c4095da0 con 0x55e23f3e46a0 2024-05-10T03:43:08.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.759+0000 7fd9b3fff700 1 -- 172.21.15.45:0/569788497 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4095f90 con 0x55e23f3e46a0 2024-05-10T03:43:08.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.760+0000 7fd9df5eab80 1 -- 172.21.15.45:0/569788497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e46a0 msgr2=0x55e23f3e4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.760+0000 7fd9df5eab80 1 --2- 172.21.15.45:0/569788497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e46a0 0x55e23f3e4d00 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fd9c400c4e0 tx=0x7fd9c400c450 comp rx=0 tx=0).stop 2024-05-10T03:43:08.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.760+0000 7fd9df5eab80 1 -- 172.21.15.45:0/569788497 shutdown_connections 2024-05-10T03:43:08.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.760+0000 7fd9df5eab80 1 --2- 172.21.15.45:0/569788497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e23f3e5ec0 0x55e23f3e87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.760+0000 7fd9df5eab80 1 --2- 172.21.15.45:0/569788497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e46a0 0x55e23f3e4d00 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.760+0000 7fd9df5eab80 1 --2- 172.21.15.45:0/569788497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e23f3e5570 0x55e23f3f5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.760+0000 7fd9df5eab80 1 -- 172.21.15.45:0/569788497 >> 172.21.15.45:0/569788497 conn(0x55e23f346a60 msgr2=0x55e23f3def90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.760+0000 7fd9df5eab80 1 -- 172.21.15.45:0/569788497 shutdown_connections 2024-05-10T03:43:08.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.760+0000 7fd9df5eab80 1 -- 172.21.15.45:0/569788497 wait complete. 2024-05-10T03:43:08.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.760+0000 7fd9df5eab80 1 -- start start 2024-05-10T03:43:08.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.760+0000 7fd9df5eab80 1 Processor -- start 2024-05-10T03:43:08.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.761+0000 7fd9df5eab80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e23f3e46a0 0x55e23f3f2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.761+0000 7fd9df5eab80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e5570 0x55e23f3f33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.761+0000 7fd9df5eab80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e23f3e5ec0 0x55e23f3f4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.761+0000 7fd9df5eab80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e23f3f4850 con 0x55e23f3e5570 2024-05-10T03:43:08.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.761+0000 7fd9df5eab80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e23f3f49c0 con 0x55e23f3e5ec0 2024-05-10T03:43:08.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.761+0000 7fd9df5eab80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e23f3f4b80 con 0x55e23f3e46a0 2024-05-10T03:43:08.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.761+0000 7fd9df5eab80 10 client.0 _ll_register_callbacks cb 0x55e23f2a9b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:43:08.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.761+0000 7fd9cc841700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e5570 0x55e23f3f33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.761+0000 7fd9cc841700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e5570 0x55e23f3f33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45774/0 (socket says 172.21.15.45:45774) 2024-05-10T03:43:08.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.761+0000 7fd9cc841700 1 -- 172.21.15.45:0/2845580749 learned_addr learned my addr 172.21.15.45:0/2845580749 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:08.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.761+0000 7fd9cd042700 1 --2- 172.21.15.45:0/2845580749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e23f3e46a0 0x55e23f3f2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.761+0000 7fd9cd843700 1 --2- 172.21.15.45:0/2845580749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e23f3e5ec0 0x55e23f3f4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.761+0000 7fd9cc841700 1 -- 172.21.15.45:0/2845580749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e23f3e46a0 msgr2=0x55e23f3f2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.761+0000 7fd9cc841700 1 --2- 172.21.15.45:0/2845580749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e23f3e46a0 0x55e23f3f2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.761+0000 7fd9cc841700 1 -- 172.21.15.45:0/2845580749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e23f3e5ec0 msgr2=0x55e23f3f4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.761+0000 7fd9cc841700 1 --2- 172.21.15.45:0/2845580749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e23f3e5ec0 0x55e23f3f4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.761+0000 7fd9cc841700 1 -- 172.21.15.45:0/2845580749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c81a26f0 con 0x55e23f3e5570 2024-05-10T03:43:08.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.761+0000 7fd9cd843700 1 --2- 172.21.15.45:0/2845580749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e23f3e5ec0 0x55e23f3f4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:43:08.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.762+0000 7fd9cc841700 1 --2- 172.21.15.45:0/2845580749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e5570 0x55e23f3f33e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x55e23f3fcd70 tx=0x7fd9b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c9eed0cf95654b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:08.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.762+0000 7fd9b0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:43:08.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.762+0000 7fd9b0ff9700 1 -- 172.21.15.45:0/2845580749 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8023040 con 0x55e23f3e5570 2024-05-10T03:43:08.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.762+0000 7fd9b0ff9700 1 -- 172.21.15.45:0/2845580749 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd9b80285a0 con 0x55e23f3e5570 2024-05-10T03:43:08.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.762+0000 7fd9df5eab80 1 -- 172.21.15.45:0/2845580749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd9c409dd90 con 0x55e23f3e5570 2024-05-10T03:43:08.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.762+0000 7fd9b0ff9700 1 -- 172.21.15.45:0/2845580749 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9b8028760 con 0x55e23f3e5570 2024-05-10T03:43:08.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.762+0000 7fd9df5eab80 10 client.16581 fetch_fsmap learned FSMap version 33 2024-05-10T03:43:08.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.762+0000 7fd9df5eab80 1 -- 172.21.15.45:0/2845580749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55e23f2ca560 con 0x55e23f3e5570 2024-05-10T03:43:08.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.762+0000 7fd9b0ff9700 1 -- 172.21.15.45:0/2845580749 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd9c409dd90 con 0x55e23f3e5570 2024-05-10T03:43:08.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.762+0000 7fd9b0ff9700 1 -- 172.21.15.45:0/2845580749 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 33) v1 ==== 7502+0+0 (secure 0 0 0) 0x7fd9b8031420 con 0x55e23f3e5570 2024-05-10T03:43:08.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.762+0000 7fd9df5eab80 10 client.16581 fetch_fsmap finished waiting for FSMap version 33 2024-05-10T03:43:08.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.762+0000 7fd9df5eab80 10 client.16581 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-10T03:43:08.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.762+0000 7fd9df5eab80 20 client.16581 populate_metadata read hostname 'smithi045' 2024-05-10T03:43:08.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.763+0000 7fd9df5eab80 1 --2- 172.21.15.45:0/2845580749 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55e23f450ae0 0x55e23f452f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.763+0000 7fd9df5eab80 4 client.16581 mds_command: new command op to 24548 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-10T03:43:08.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.763+0000 7fd9df5eab80 1 -- 172.21.15.45:0/2845580749 --> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e23f2fcec0 con 0x55e23f450ae0 2024-05-10T03:43:08.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.763+0000 7fd9cd042700 1 --2- 172.21.15.45:0/2845580749 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55e23f450ae0 0x55e23f452f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.763+0000 7fd9b0ff9700 10 client.16581 ms_handle_connect on v2:172.21.15.106:6836/3047487403 2024-05-10T03:43:08.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.763+0000 7fd9cd042700 1 --2- 172.21.15.45:0/2845580749 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55e23f450ae0 0x55e23f452f00 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=81a16f0b147fcfb server_cookie=5b5557f712b3cdd in_seq=0 out_seq=0 2024-05-10T03:43:08.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.763+0000 7fd9b0ff9700 1 -- 172.21.15.45:0/2845580749 <== mds.1 v2:172.21.15.106:6836/3047487403 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e23f2fcec0 con 0x55e23f450ae0 2024-05-10T03:43:08.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.763+0000 7fd9b0ff9700 10 client.16581 handle_command_reply: tid=0 2024-05-10T03:43:08.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.763+0000 7fd9df5eab80 1 client.16581 shutdown 2024-05-10T03:43:08.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.764+0000 7fd9df5eab80 1 -- 172.21.15.45:0/2845580749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e5570 msgr2=0x55e23f3f33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.764+0000 7fd9df5eab80 1 --2- 172.21.15.45:0/2845580749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e5570 0x55e23f3f33e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x55e23f3fcd70 tx=0x7fd9b8004750 comp rx=0 tx=0).stop 2024-05-10T03:43:08.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.764+0000 7fd9df5eab80 1 -- 172.21.15.45:0/2845580749 shutdown_connections 2024-05-10T03:43:08.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.764+0000 7fd9df5eab80 1 --2- 172.21.15.45:0/2845580749 >> [v2:172.21.15.106:6836/3047487403,v1:172.21.15.106:6837/3047487403] conn(0x55e23f450ae0 0x55e23f452f00 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.764+0000 7fd9df5eab80 1 --2- 172.21.15.45:0/2845580749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e23f3e46a0 0x55e23f3f2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.764+0000 7fd9b0ff9700 0 client.16581 ms_handle_reset on v2:172.21.15.106:6836/3047487403 2024-05-10T03:43:08.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.764+0000 7fd9df5eab80 1 --2- 172.21.15.45:0/2845580749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e23f3e5ec0 0x55e23f3f4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.764+0000 7fd9df5eab80 1 --2- 172.21.15.45:0/2845580749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e23f3e5570 0x55e23f3f33e0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.764+0000 7fd9df5eab80 1 -- 172.21.15.45:0/2845580749 >> 172.21.15.45:0/2845580749 conn(0x55e23f346a60 msgr2=0x55e23f3e9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.764+0000 7fd9df5eab80 1 -- 172.21.15.45:0/2845580749 shutdown_connections 2024-05-10T03:43:08.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.764+0000 7fd9df5eab80 1 -- 172.21.15.45:0/2845580749 wait complete. 2024-05-10T03:43:08.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.764+0000 7fd9df5eab80 20 client.16581 trim_cache size 0 max 16384 2024-05-10T03:43:08.772 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-05-10T03:43:08.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.764+0000 7fd9cf2a6700 1 -- 172.21.15.45:0/3791187966 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd9b40a11c0 msgr2=0x7fd9b40a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.764+0000 7fd9cf2a6700 1 --2- 172.21.15.45:0/3791187966 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd9b40a11c0 0x7fd9b40a36d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd9c819b320 tx=0x7fd9b8009260 comp rx=0 tx=0).stop 2024-05-10T03:43:08.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.764+0000 7fd9cf2a6700 1 -- 172.21.15.45:0/3791187966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9c8073b40 msgr2=0x7fd9c819a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.764+0000 7fd9cf2a6700 1 --2- 172.21.15.45:0/3791187966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9c8073b40 0x7fd9c819a280 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd9c400e970 tx=0x7fd9c400ec80 comp rx=0 tx=0).stop 2024-05-10T03:43:08.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.765+0000 7fd9cf2a6700 1 -- 172.21.15.45:0/3791187966 shutdown_connections 2024-05-10T03:43:08.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.765+0000 7fd9cf2a6700 1 --2- 172.21.15.45:0/3791187966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c8109ab0 0x7fd9c81a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.765+0000 7fd9cf2a6700 1 --2- 172.21.15.45:0/3791187966 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd9b40a11c0 0x7fd9b40a36d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.765+0000 7fd9cf2a6700 1 --2- 172.21.15.45:0/3791187966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9c8073b40 0x7fd9c819a280 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.765+0000 7fd9cf2a6700 1 --2- 172.21.15.45:0/3791187966 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c8075140 0x7fd9c819a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.765+0000 7fd9cf2a6700 1 -- 172.21.15.45:0/3791187966 >> 172.21.15.45:0/3791187966 conn(0x7fd9c80fd1e0 msgr2=0x7fd9c80ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.765+0000 7fd9cf2a6700 1 -- 172.21.15.45:0/3791187966 shutdown_connections 2024-05-10T03:43:08.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.765+0000 7fd9cf2a6700 1 -- 172.21.15.45:0/3791187966 wait complete. 2024-05-10T03:43:08.781 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-10T03:43:08.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.934+0000 7f2c6b2fc700 1 -- 172.21.15.45:0/3088723353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c64100ac0 msgr2=0x7f2c64100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.934+0000 7f2c6b2fc700 1 --2- 172.21.15.45:0/3088723353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c64100ac0 0x7f2c64100ed0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009990 tx=0x7f2c60009ca0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.934+0000 7f2c6b2fc700 1 -- 172.21.15.45:0/3088723353 shutdown_connections 2024-05-10T03:43:08.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.934+0000 7f2c6b2fc700 1 --2- 172.21.15.45:0/3088723353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c64102580 0x7f2c64108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.934+0000 7f2c6b2fc700 1 --2- 172.21.15.45:0/3088723353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c64100ac0 0x7f2c64100ed0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.934+0000 7f2c6b2fc700 1 --2- 172.21.15.45:0/3088723353 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c64101be0 0x7f2c64101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.934+0000 7f2c6b2fc700 1 -- 172.21.15.45:0/3088723353 >> 172.21.15.45:0/3088723353 conn(0x7f2c640fc0d0 msgr2=0x7f2c640fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.934+0000 7f2c6b2fc700 1 -- 172.21.15.45:0/3088723353 shutdown_connections 2024-05-10T03:43:08.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.934+0000 7f2c6b2fc700 1 -- 172.21.15.45:0/3088723353 wait complete. 2024-05-10T03:43:08.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.935+0000 7f2c6b2fc700 1 Processor -- start 2024-05-10T03:43:08.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.935+0000 7f2c6b2fc700 1 -- start start 2024-05-10T03:43:08.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.935+0000 7f2c6b2fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c64100ac0 0x7f2c64196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.936+0000 7f2c6b2fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c64101be0 0x7f2c641973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.936+0000 7f2c6b2fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c64102580 0x7f2c6419e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.936+0000 7f2c6b2fc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6419e970 con 0x7f2c64100ac0 2024-05-10T03:43:08.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.936+0000 7f2c6b2fc700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6419eae0 con 0x7f2c64102580 2024-05-10T03:43:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.936+0000 7f2c6b2fc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6419eca0 con 0x7f2c64101be0 2024-05-10T03:43:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.936+0000 7f2c69098700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c64100ac0 0x7f2c64196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.936+0000 7f2c68897700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c64101be0 0x7f2c641973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.936+0000 7f2c69098700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c64100ac0 0x7f2c64196e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45788/0 (socket says 172.21.15.45:45788) 2024-05-10T03:43:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.936+0000 7f2c69098700 1 -- 172.21.15.45:0/579918892 learned_addr learned my addr 172.21.15.45:0/579918892 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.936+0000 7f2c69899700 1 --2- 172.21.15.45:0/579918892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c64102580 0x7f2c6419e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.936+0000 7f2c69098700 1 -- 172.21.15.45:0/579918892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c64101be0 msgr2=0x7f2c641973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.936+0000 7f2c69098700 1 --2- 172.21.15.45:0/579918892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c64101be0 0x7f2c641973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.936+0000 7f2c69098700 1 -- 172.21.15.45:0/579918892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c64102580 msgr2=0x7f2c6419e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.936+0000 7f2c69098700 1 --2- 172.21.15.45:0/579918892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c64102580 0x7f2c6419e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.936+0000 7f2c69098700 1 -- 172.21.15.45:0/579918892 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c54009520 con 0x7f2c64100ac0 2024-05-10T03:43:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.936+0000 7f2c69899700 1 --2- 172.21.15.45:0/579918892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c64102580 0x7f2c6419e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:43:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.936+0000 7f2c68897700 1 --2- 172.21.15.45:0/579918892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c64101be0 0x7f2c641973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:43:08.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.936+0000 7f2c69098700 1 --2- 172.21.15.45:0/579918892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c64100ac0 0x7f2c64196e90 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f2c600098e0 tx=0x7f2c60005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:08.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.936+0000 7f2c5a7fc700 1 -- 172.21.15.45:0/579918892 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6001d070 con 0x7f2c64100ac0 2024-05-10T03:43:08.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.937+0000 7f2c6b2fc700 1 -- 172.21.15.45:0/579918892 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c600095f0 con 0x7f2c64100ac0 2024-05-10T03:43:08.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.937+0000 7f2c5a7fc700 1 -- 172.21.15.45:0/579918892 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2c6000be70 con 0x7f2c64100ac0 2024-05-10T03:43:08.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.937+0000 7f2c5a7fc700 1 -- 172.21.15.45:0/579918892 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c600173f0 con 0x7f2c64100ac0 2024-05-10T03:43:08.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.937+0000 7f2c6b2fc700 1 -- 172.21.15.45:0/579918892 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6419f1b0 con 0x7f2c64100ac0 2024-05-10T03:43:08.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.940+0000 7f2c5a7fc700 1 -- 172.21.15.45:0/579918892 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2c60017550 con 0x7f2c64100ac0 2024-05-10T03:43:08.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.940+0000 7f2c5a7fc700 1 --2- 172.21.15.45:0/579918892 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2c500a11c0 0x7f2c500a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.941+0000 7f2c68897700 1 --2- 172.21.15.45:0/579918892 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2c500a11c0 0x7f2c500a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.941+0000 7f2c5a7fc700 1 -- 172.21.15.45:0/579918892 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f2c600cddc0 con 0x7f2c64100ac0 2024-05-10T03:43:08.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.941+0000 7f2c7b640b80 1 Processor -- start 2024-05-10T03:43:08.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.941+0000 7f2c7b640b80 1 -- start start 2024-05-10T03:43:08.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.941+0000 7f2c68897700 1 --2- 172.21.15.45:0/579918892 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2c500a11c0 0x7f2c500a36d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2c54009fd0 tx=0x7f2c54009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:08.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.942+0000 7f2c7b640b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cee8b0 0x562871ceed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.942+0000 7f2c7b640b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562871cef780 0x562871cefb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.942+0000 7f2c7b640b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562871cf00d0 0x562871cf69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.942+0000 7f2c7b640b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562871c13150 con 0x562871cee8b0 2024-05-10T03:43:08.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.942+0000 7f2c7b640b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x562871c10b10 con 0x562871cf00d0 2024-05-10T03:43:08.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.942+0000 7f2c7b640b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x562871c0c400 con 0x562871cef780 2024-05-10T03:43:08.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.942+0000 7f2c69098700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cee8b0 0x562871ceed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.942+0000 7f2c69098700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cee8b0 0x562871ceed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45796/0 (socket says 172.21.15.45:45796) 2024-05-10T03:43:08.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.942+0000 7f2c68897700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562871cef780 0x562871cefb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.942+0000 7f2c69098700 1 -- 172.21.15.45:0/282597234 learned_addr learned my addr 172.21.15.45:0/282597234 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:08.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.942+0000 7f2c69899700 1 --2- 172.21.15.45:0/282597234 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562871cf00d0 0x562871cf69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.942+0000 7f2c69098700 1 -- 172.21.15.45:0/282597234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562871cef780 msgr2=0x562871cefb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.942+0000 7f2c69098700 1 --2- 172.21.15.45:0/282597234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562871cef780 0x562871cefb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.942+0000 7f2c69098700 1 -- 172.21.15.45:0/282597234 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562871cf00d0 msgr2=0x562871cf69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.942+0000 7f2c69098700 1 --2- 172.21.15.45:0/282597234 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562871cf00d0 0x562871cf69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.942+0000 7f2c69098700 1 -- 172.21.15.45:0/282597234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562871a8d3b0 con 0x562871cee8b0 2024-05-10T03:43:08.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.943+0000 7f2c69098700 1 --2- 172.21.15.45:0/282597234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cee8b0 0x562871ceed00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2c6009ac00 tx=0x7f2c6000fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9165b7d9947dd20e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:08.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.943+0000 7f2c4f7fe700 1 -- 172.21.15.45:0/282597234 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6009af00 con 0x562871cee8b0 2024-05-10T03:43:08.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.943+0000 7f2c4f7fe700 1 -- 172.21.15.45:0/282597234 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2c6009ed30 con 0x562871cee8b0 2024-05-10T03:43:08.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.943+0000 7f2c4f7fe700 1 -- 172.21.15.45:0/282597234 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6009a650 con 0x562871cee8b0 2024-05-10T03:43:08.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.944+0000 7f2c7b640b80 1 -- 172.21.15.45:0/282597234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cee8b0 msgr2=0x562871ceed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.944+0000 7f2c7b640b80 1 --2- 172.21.15.45:0/282597234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cee8b0 0x562871ceed00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2c6009ac00 tx=0x7f2c6000fd40 comp rx=0 tx=0).stop 2024-05-10T03:43:08.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.944+0000 7f2c7b640b80 1 -- 172.21.15.45:0/282597234 shutdown_connections 2024-05-10T03:43:08.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.944+0000 7f2c7b640b80 1 --2- 172.21.15.45:0/282597234 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562871cf00d0 0x562871cf69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.944+0000 7f2c7b640b80 1 --2- 172.21.15.45:0/282597234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cee8b0 0x562871ceed00 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.944+0000 7f2c7b640b80 1 --2- 172.21.15.45:0/282597234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562871cef780 0x562871cefb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.944+0000 7f2c7b640b80 1 -- 172.21.15.45:0/282597234 >> 172.21.15.45:0/282597234 conn(0x562871c4ea60 msgr2=0x562871ce6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.944+0000 7f2c7b640b80 1 -- 172.21.15.45:0/282597234 shutdown_connections 2024-05-10T03:43:08.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.944+0000 7f2c7b640b80 1 -- 172.21.15.45:0/282597234 wait complete. 2024-05-10T03:43:08.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.944+0000 7f2c7b640b80 1 -- start start 2024-05-10T03:43:08.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.944+0000 7f2c7b640b80 1 Processor -- start 2024-05-10T03:43:08.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.945+0000 7f2c7b640b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562871cee8b0 0x562871cf85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.945+0000 7f2c7b640b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cef780 0x562871cf8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.945+0000 7f2c7b640b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562871cf00d0 0x562871cffa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.945+0000 7f2c7b640b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562871ba8560 con 0x562871cef780 2024-05-10T03:43:08.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.945+0000 7f2c7b640b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x562871ba8200 con 0x562871cf00d0 2024-05-10T03:43:08.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.945+0000 7f2c7b640b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x562871a8f6a0 con 0x562871cee8b0 2024-05-10T03:43:08.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.945+0000 7f2c7b640b80 10 client.0 _ll_register_callbacks cb 0x562871bb1b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:43:08.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.945+0000 7f2c69098700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562871cee8b0 0x562871cf85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.945+0000 7f2c69098700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562871cee8b0 0x562871cf85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:45666/0 (socket says 172.21.15.45:45666) 2024-05-10T03:43:08.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.945+0000 7f2c69098700 1 -- 172.21.15.45:0/1008288006 learned_addr learned my addr 172.21.15.45:0/1008288006 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:08.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.945+0000 7f2c68897700 1 --2- 172.21.15.45:0/1008288006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cef780 0x562871cf8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.945+0000 7f2c69899700 1 --2- 172.21.15.45:0/1008288006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562871cf00d0 0x562871cffa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.946+0000 7f2c69098700 1 -- 172.21.15.45:0/1008288006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562871cf00d0 msgr2=0x562871cffa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.946+0000 7f2c69098700 1 --2- 172.21.15.45:0/1008288006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562871cf00d0 0x562871cffa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.946+0000 7f2c69098700 1 -- 172.21.15.45:0/1008288006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cef780 msgr2=0x562871cf8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.946+0000 7f2c69098700 1 --2- 172.21.15.45:0/1008288006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cef780 0x562871cf8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.946+0000 7f2c69098700 1 -- 172.21.15.45:0/1008288006 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6419f1b0 con 0x562871cee8b0 2024-05-10T03:43:08.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.946+0000 7f2c69899700 1 --2- 172.21.15.45:0/1008288006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562871cf00d0 0x562871cffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:43:08.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.946+0000 7f2c69098700 1 --2- 172.21.15.45:0/1008288006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562871cee8b0 0x562871cf85c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2c6009b560 tx=0x7f2c60005940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afc8b51e84b5b7d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:08.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.946+0000 7f2c4cff9700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-05-10T03:43:08.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.946+0000 7f2c4cff9700 1 -- 172.21.15.45:0/1008288006 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c600a32f0 con 0x562871cee8b0 2024-05-10T03:43:08.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.946+0000 7f2c4cff9700 1 -- 172.21.15.45:0/1008288006 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f2c60099040 con 0x562871cee8b0 2024-05-10T03:43:08.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.946+0000 7f2c7b640b80 1 -- 172.21.15.45:0/1008288006 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562871b65270 con 0x562871cee8b0 2024-05-10T03:43:08.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.946+0000 7f2c4cff9700 1 -- 172.21.15.45:0/1008288006 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c6009af00 con 0x562871cee8b0 2024-05-10T03:43:08.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.946+0000 7f2c7b640b80 10 client.26449 fetch_fsmap learned FSMap version 33 2024-05-10T03:43:08.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.946+0000 7f2c7b640b80 1 -- 172.21.15.45:0/1008288006 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x562871a39b60 con 0x562871cee8b0 2024-05-10T03:43:08.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.947+0000 7f2c4cff9700 1 -- 172.21.15.45:0/1008288006 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x562871b65270 con 0x562871cee8b0 2024-05-10T03:43:08.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.947+0000 7f2c4cff9700 1 -- 172.21.15.45:0/1008288006 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 33) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f2c60099e60 con 0x562871cee8b0 2024-05-10T03:43:08.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.947+0000 7f2c7b640b80 10 client.26449 fetch_fsmap finished waiting for FSMap version 33 2024-05-10T03:43:08.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.947+0000 7f2c7b640b80 10 client.26449 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:43:08.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.947+0000 7f2c7b640b80 20 client.26449 populate_metadata read hostname 'smithi045' 2024-05-10T03:43:08.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.947+0000 7f2c7b640b80 1 --2- 172.21.15.45:0/1008288006 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x562871d03dc0 0x562871d06210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.947+0000 7f2c7b640b80 4 client.26449 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:43:08.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.947+0000 7f2c7b640b80 1 -- 172.21.15.45:0/1008288006 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562871cbb780 con 0x562871d03dc0 2024-05-10T03:43:08.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.947+0000 7f2c68897700 1 --2- 172.21.15.45:0/1008288006 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x562871d03dc0 0x562871d06210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.948+0000 7f2c4cff9700 10 client.26449 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:43:08.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.948+0000 7f2c68897700 1 --2- 172.21.15.45:0/1008288006 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x562871d03dc0 0x562871d06210 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c45914fad77f99cd server_cookie=3b3ce1814702063 in_seq=0 out_seq=0 2024-05-10T03:43:08.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.948+0000 7f2c4cff9700 1 -- 172.21.15.45:0/1008288006 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562871cbb780 con 0x562871d03dc0 2024-05-10T03:43:08.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.948+0000 7f2c4cff9700 10 client.26449 handle_command_reply: tid=0 2024-05-10T03:43:08.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.948+0000 7f2c7b640b80 1 client.26449 shutdown 2024-05-10T03:43:08.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.948+0000 7f2c7b640b80 1 -- 172.21.15.45:0/1008288006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562871cee8b0 msgr2=0x562871cf85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.948+0000 7f2c7b640b80 1 --2- 172.21.15.45:0/1008288006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562871cee8b0 0x562871cf85c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2c6009b560 tx=0x7f2c60005940 comp rx=0 tx=0).stop 2024-05-10T03:43:08.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.948+0000 7f2c7b640b80 1 -- 172.21.15.45:0/1008288006 shutdown_connections 2024-05-10T03:43:08.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.948+0000 7f2c7b640b80 1 --2- 172.21.15.45:0/1008288006 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x562871d03dc0 0x562871d06210 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.948+0000 7f2c7b640b80 1 --2- 172.21.15.45:0/1008288006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562871cee8b0 0x562871cf85c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.948+0000 7f2c7b640b80 1 --2- 172.21.15.45:0/1008288006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562871cf00d0 0x562871cffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.948+0000 7f2c7b640b80 1 --2- 172.21.15.45:0/1008288006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cef780 0x562871cf8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.949+0000 7f2c7b640b80 1 -- 172.21.15.45:0/1008288006 >> 172.21.15.45:0/1008288006 conn(0x562871c4ea60 msgr2=0x562871ce6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.949+0000 7f2c4cff9700 0 client.26449 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:43:08.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.949+0000 7f2c7b640b80 1 -- 172.21.15.45:0/1008288006 shutdown_connections 2024-05-10T03:43:08.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.949+0000 7f2c7b640b80 1 -- 172.21.15.45:0/1008288006 wait complete. 2024-05-10T03:43:08.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.949+0000 7f2c7b640b80 20 client.26449 trim_cache size 0 max 16384 2024-05-10T03:43:08.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.963+0000 7f2c7b640b80 1 Processor -- start 2024-05-10T03:43:08.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.963+0000 7f2c7b640b80 1 -- start start 2024-05-10T03:43:08.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.964+0000 7f2c7b640b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562871c4ea60 0x562871cf3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.964+0000 7f2c7b640b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cee8b0 0x562871cffa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.964+0000 7f2c7b640b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562871cef780 0x562871cf39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.964+0000 7f2c7b640b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562871b65270 con 0x562871cee8b0 2024-05-10T03:43:08.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.964+0000 7f2c7b640b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x562871ce3d30 con 0x562871cef780 2024-05-10T03:43:08.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.964+0000 7f2c7b640b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x562871d00b60 con 0x562871c4ea60 2024-05-10T03:43:08.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.964+0000 7f2c68897700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cee8b0 0x562871cffa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.964+0000 7f2c69098700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562871c4ea60 0x562871cf3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.964+0000 7f2c68897700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cee8b0 0x562871cffa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45822/0 (socket says 172.21.15.45:45822) 2024-05-10T03:43:08.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.964+0000 7f2c68897700 1 -- 172.21.15.45:0/2898631223 learned_addr learned my addr 172.21.15.45:0/2898631223 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:08.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.964+0000 7f2c69899700 1 --2- 172.21.15.45:0/2898631223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562871cef780 0x562871cf39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.964+0000 7f2c68897700 1 -- 172.21.15.45:0/2898631223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562871c4ea60 msgr2=0x562871cf3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.964+0000 7f2c68897700 1 --2- 172.21.15.45:0/2898631223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562871c4ea60 0x562871cf3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.964+0000 7f2c68897700 1 -- 172.21.15.45:0/2898631223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562871cef780 msgr2=0x562871cf39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.964+0000 7f2c68897700 1 --2- 172.21.15.45:0/2898631223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562871cef780 0x562871cf39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.964+0000 7f2c68897700 1 -- 172.21.15.45:0/2898631223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562871bd2560 con 0x562871cee8b0 2024-05-10T03:43:08.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.964+0000 7f2c69899700 1 --2- 172.21.15.45:0/2898631223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562871cef780 0x562871cf39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:43:08.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.964+0000 7f2c68897700 1 --2- 172.21.15.45:0/2898631223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cee8b0 0x562871cffa20 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f2c64197f30 tx=0x7f2c54014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc74faf4963f5c72 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:08.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.965+0000 7f2c4ffff700 1 -- 172.21.15.45:0/2898631223 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c54024040 con 0x562871cee8b0 2024-05-10T03:43:08.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.965+0000 7f2c4ffff700 1 -- 172.21.15.45:0/2898631223 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2c54003e30 con 0x562871cee8b0 2024-05-10T03:43:08.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.965+0000 7f2c4ffff700 1 -- 172.21.15.45:0/2898631223 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5401e400 con 0x562871cee8b0 2024-05-10T03:43:08.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.965+0000 7f2c7b640b80 1 -- 172.21.15.45:0/2898631223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cee8b0 msgr2=0x562871cffa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.965+0000 7f2c7b640b80 1 --2- 172.21.15.45:0/2898631223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cee8b0 0x562871cffa20 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f2c64197f30 tx=0x7f2c54014000 comp rx=0 tx=0).stop 2024-05-10T03:43:08.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.965+0000 7f2c7b640b80 1 -- 172.21.15.45:0/2898631223 shutdown_connections 2024-05-10T03:43:08.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.965+0000 7f2c7b640b80 1 --2- 172.21.15.45:0/2898631223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562871c4ea60 0x562871cf3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.965+0000 7f2c7b640b80 1 --2- 172.21.15.45:0/2898631223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562871cef780 0x562871cf39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.965+0000 7f2c7b640b80 1 --2- 172.21.15.45:0/2898631223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cee8b0 0x562871cffa20 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.965+0000 7f2c7b640b80 1 -- 172.21.15.45:0/2898631223 >> 172.21.15.45:0/2898631223 conn(0x562871ce3450 msgr2=0x562871ceecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.966+0000 7f2c7b640b80 1 -- 172.21.15.45:0/2898631223 shutdown_connections 2024-05-10T03:43:08.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.966+0000 7f2c7b640b80 1 -- 172.21.15.45:0/2898631223 wait complete. 2024-05-10T03:43:08.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.966+0000 7f2c7b640b80 1 -- start start 2024-05-10T03:43:08.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.966+0000 7f2c7b640b80 1 Processor -- start 2024-05-10T03:43:08.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.966+0000 7f2c7b640b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562871c4ea60 0x562871cfafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.966+0000 7f2c7b640b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562871cee8b0 0x562871cfb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.967+0000 7f2c7b640b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cef780 0x562871cfe410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.967+0000 7f2c7b640b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562871cfe950 con 0x562871cef780 2024-05-10T03:43:08.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.967+0000 7f2c7b640b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x562871cfeac0 con 0x562871cee8b0 2024-05-10T03:43:08.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.967+0000 7f2c7b640b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x562871cfec80 con 0x562871c4ea60 2024-05-10T03:43:08.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.967+0000 7f2c7b640b80 10 client.0 _ll_register_callbacks cb 0x562871bb1b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:43:08.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.967+0000 7f2c69899700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cef780 0x562871cfe410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.967+0000 7f2c69098700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562871c4ea60 0x562871cfafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.967+0000 7f2c69899700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cef780 0x562871cfe410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45838/0 (socket says 172.21.15.45:45838) 2024-05-10T03:43:08.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.967+0000 7f2c69899700 1 -- 172.21.15.45:0/3963005794 learned_addr learned my addr 172.21.15.45:0/3963005794 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:08.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.967+0000 7f2c68897700 1 --2- 172.21.15.45:0/3963005794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562871cee8b0 0x562871cfb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.967+0000 7f2c69098700 1 -- 172.21.15.45:0/3963005794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562871cee8b0 msgr2=0x562871cfb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.967+0000 7f2c69098700 1 --2- 172.21.15.45:0/3963005794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562871cee8b0 0x562871cfb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.967+0000 7f2c69098700 1 -- 172.21.15.45:0/3963005794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cef780 msgr2=0x562871cfe410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:08.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.967+0000 7f2c69098700 1 --2- 172.21.15.45:0/3963005794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cef780 0x562871cfe410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.967+0000 7f2c69098700 1 -- 172.21.15.45:0/3963005794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c54017050 con 0x562871c4ea60 2024-05-10T03:43:08.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.967+0000 7f2c68897700 1 --2- 172.21.15.45:0/3963005794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562871cee8b0 0x562871cfb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:43:08.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.967+0000 7f2c69899700 1 --2- 172.21.15.45:0/3963005794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cef780 0x562871cfe410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:43:08.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.967+0000 7f2c69098700 1 --2- 172.21.15.45:0/3963005794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562871c4ea60 0x562871cfafe0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2c6009ae90 tx=0x7f2c600a3070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58f10f2890717d09 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:08.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.967+0000 7f2c4cff9700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-05-10T03:43:08.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.968+0000 7f2c4cff9700 1 -- 172.21.15.45:0/3963005794 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c600cba80 con 0x562871c4ea60 2024-05-10T03:43:08.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.968+0000 7f2c4cff9700 1 -- 172.21.15.45:0/3963005794 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f2c600992a0 con 0x562871c4ea60 2024-05-10T03:43:08.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.968+0000 7f2c7b640b80 1 -- 172.21.15.45:0/3963005794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2c6009ed30 con 0x562871c4ea60 2024-05-10T03:43:08.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.968+0000 7f2c4cff9700 1 -- 172.21.15.45:0/3963005794 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c600a32f0 con 0x562871c4ea60 2024-05-10T03:43:08.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.968+0000 7f2c7b640b80 10 client.26455 fetch_fsmap learned FSMap version 33 2024-05-10T03:43:08.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.968+0000 7f2c7b640b80 1 -- 172.21.15.45:0/3963005794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x562871a91cd0 con 0x562871c4ea60 2024-05-10T03:43:08.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.968+0000 7f2c4cff9700 1 -- 172.21.15.45:0/3963005794 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2c6009ed30 con 0x562871c4ea60 2024-05-10T03:43:08.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.968+0000 7f2c4cff9700 1 -- 172.21.15.45:0/3963005794 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 33) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f2c60099e60 con 0x562871c4ea60 2024-05-10T03:43:08.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.968+0000 7f2c7b640b80 10 client.26455 fetch_fsmap finished waiting for FSMap version 33 2024-05-10T03:43:08.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.968+0000 7f2c7b640b80 10 client.26455 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-10T03:43:08.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.968+0000 7f2c7b640b80 20 client.26455 populate_metadata read hostname 'smithi045' 2024-05-10T03:43:08.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.968+0000 7f2c7b640b80 1 --2- 172.21.15.45:0/3963005794 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x562871cf00d0 0x562871d5a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:08.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.968+0000 7f2c7b640b80 4 client.26455 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-10T03:43:08.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.968+0000 7f2c7b640b80 1 -- 172.21.15.45:0/3963005794 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562871c04ec0 con 0x562871cf00d0 2024-05-10T03:43:08.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.968+0000 7f2c68897700 1 --2- 172.21.15.45:0/3963005794 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x562871cf00d0 0x562871d5a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:08.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.969+0000 7f2c4cff9700 10 client.26455 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:43:08.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.969+0000 7f2c68897700 1 --2- 172.21.15.45:0/3963005794 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x562871cf00d0 0x562871d5a230 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec2ee124c2c68673 server_cookie=3831d365bd950a6d in_seq=0 out_seq=0 2024-05-10T03:43:08.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.969+0000 7f2c4cff9700 1 -- 172.21.15.45:0/3963005794 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562871c04ec0 con 0x562871cf00d0 2024-05-10T03:43:08.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.969+0000 7f2c4cff9700 10 client.26455 handle_command_reply: tid=0 2024-05-10T03:43:08.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.969+0000 7f2c7b640b80 1 client.26455 shutdown 2024-05-10T03:43:08.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.969+0000 7f2c7b640b80 1 -- 172.21.15.45:0/3963005794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562871c4ea60 msgr2=0x562871cfafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.969+0000 7f2c7b640b80 1 --2- 172.21.15.45:0/3963005794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562871c4ea60 0x562871cfafe0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2c6009ae90 tx=0x7f2c600a3070 comp rx=0 tx=0).stop 2024-05-10T03:43:08.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.969+0000 7f2c7b640b80 1 -- 172.21.15.45:0/3963005794 shutdown_connections 2024-05-10T03:43:08.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.969+0000 7f2c7b640b80 1 --2- 172.21.15.45:0/3963005794 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x562871cf00d0 0x562871d5a230 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.969+0000 7f2c7b640b80 1 --2- 172.21.15.45:0/3963005794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562871c4ea60 0x562871cfafe0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.969+0000 7f2c7b640b80 1 --2- 172.21.15.45:0/3963005794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562871cef780 0x562871cfe410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.969+0000 7f2c4cff9700 0 client.26455 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:43:08.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.969+0000 7f2c7b640b80 1 --2- 172.21.15.45:0/3963005794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562871cee8b0 0x562871cfb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.969+0000 7f2c7b640b80 1 -- 172.21.15.45:0/3963005794 >> 172.21.15.45:0/3963005794 conn(0x562871ce3450 msgr2=0x562871ceecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.969+0000 7f2c7b640b80 1 -- 172.21.15.45:0/3963005794 shutdown_connections 2024-05-10T03:43:08.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.969+0000 7f2c7b640b80 1 -- 172.21.15.45:0/3963005794 wait complete. 2024-05-10T03:43:08.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.970+0000 7f2c7b640b80 20 client.26455 trim_cache size 0 max 16384 2024-05-10T03:43:08.979 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-05-10T03:43:08.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.970+0000 7f2c6b2fc700 1 -- 172.21.15.45:0/579918892 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2c500a11c0 msgr2=0x7f2c500a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.970+0000 7f2c6b2fc700 1 --2- 172.21.15.45:0/579918892 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2c500a11c0 0x7f2c500a36d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2c54009fd0 tx=0x7f2c54009260 comp rx=0 tx=0).stop 2024-05-10T03:43:08.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.970+0000 7f2c6b2fc700 1 -- 172.21.15.45:0/579918892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c64100ac0 msgr2=0x7f2c64196e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:08.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.970+0000 7f2c6b2fc700 1 --2- 172.21.15.45:0/579918892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c64100ac0 0x7f2c64196e90 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f2c600098e0 tx=0x7f2c60005b00 comp rx=0 tx=0).stop 2024-05-10T03:43:08.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.970+0000 7f2c6b2fc700 1 -- 172.21.15.45:0/579918892 shutdown_connections 2024-05-10T03:43:08.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.970+0000 7f2c6b2fc700 1 --2- 172.21.15.45:0/579918892 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f2c500a11c0 0x7f2c500a36d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.970+0000 7f2c6b2fc700 1 --2- 172.21.15.45:0/579918892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c64102580 0x7f2c6419e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.970+0000 7f2c6b2fc700 1 --2- 172.21.15.45:0/579918892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c64100ac0 0x7f2c64196e90 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.970+0000 7f2c6b2fc700 1 --2- 172.21.15.45:0/579918892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c64101be0 0x7f2c641973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:08.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.970+0000 7f2c6b2fc700 1 -- 172.21.15.45:0/579918892 >> 172.21.15.45:0/579918892 conn(0x7f2c640fc0d0 msgr2=0x7f2c64104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:08.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.970+0000 7f2c6b2fc700 1 -- 172.21.15.45:0/579918892 shutdown_connections 2024-05-10T03:43:08.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:08.970+0000 7f2c6b2fc700 1 -- 172.21.15.45:0/579918892 wait complete. 2024-05-10T03:43:08.987 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 24980774, 'ino': 1099511628245, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/pxa/mfp.txt'}, {'damage_type': 'backtrace', 'id': 35863620, 'ino': 1099511628139, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/.gitignore'}, {'damage_type': 'backtrace', 'id': 37629655, 'ino': 1099511628236, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/memory.txt'}, {'damage_type': 'backtrace', 'id': 62985302, 'ino': 1099511628120, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/lockdep-splat.txt'}, {'damage_type': 'backtrace', 'id': 68931233, 'ino': 1099511628182, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/OMAP/omap_pm'}, {'damage_type': 'backtrace', 'id': 87937265, 'ino': 1099511628207, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c'}, {'damage_type': 'backtrace', 'id': 110609765, 'ino': 1099511628239, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe'}, {'damage_type': 'backtrace', 'id': 148449074, 'ino': 1099511628159, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/video_extension.txt'}, {'damage_type': 'backtrace', 'id': 278038792, 'ino': 1099511628165, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/udev-install.sh'}, {'damage_type': 'backtrace', 'id': 283475609, 'ino': 1099511628191, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/GraphicsClient'}, {'damage_type': 'backtrace', 'id': 300426819, 'ino': 1099511628235, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/mem_alignment'}, {'damage_type': 'backtrace', 'id': 333346263, 'ino': 1099511628162, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/autoload.sh'}, {'damage_type': 'backtrace', 'id': 350435519, 'ino': 1099511628126, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rcuref.txt'}, {'damage_type': 'backtrace', 'id': 378759839, 'ino': 1099511628115, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/RTFP.txt'}, {'damage_type': 'backtrace', 'id': 444896589, 'ino': 1099511628221, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt'}, {'damage_type': 'backtrace', 'id': 518353672, 'ino': 1099511628258, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/vlocks.txt'}, {'damage_type': 'backtrace', 'id': 586132068, 'ino': 1099511628154, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/initrd_table_override.txt'}, {'damage_type': 'backtrace', 'id': 689246517, 'ino': 1099511628227, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk'}, {'damage_type': 'backtrace', 'id': 724594024, 'ino': 1099511628199, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Victor'}, {'damage_type': 'backtrace', 'id': 744193314, 'ino': 1099511628213, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt'}, {'damage_type': 'backtrace', 'id': 745525137, 'ino': 1099511628194, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Itsy'}, {'damage_type': 'backtrace', 'id': 796728008, 'ino': 1099511628183, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Porting'}, {'damage_type': 'backtrace', 'id': 850172828, 'ino': 1099511628109, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/pci-iov-howto.txt'}, {'damage_type': 'backtrace', 'id': 862612266, 'ino': 1099511628172, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Booting'}, {'damage_type': 'backtrace', 'id': 865090466, 'ino': 1099511628234, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/kernel_user_helpers.txt'}, {'damage_type': 'backtrace', 'id': 867784721, 'ino': 1099511628143, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/getdelays.c'}, {'damage_type': 'backtrace', 'id': 877199961, 'ino': 1099511628238, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/msm/gpiomux.txt'}, {'damage_type': 'backtrace', 'id': 911310906, 'ino': 1099511628237, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/msm'}, {'damage_type': 'backtrace', 'id': 918908886, 'ino': 1099511628218, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt'}, {'damage_type': 'backtrace', 'id': 994497567, 'ino': 1099511628230, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/VFP/release-notes.txt'}, {'damage_type': 'backtrace', 'id': 998574002, 'ino': 1099511628149, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/apei/output_format.txt'}, {'damage_type': 'backtrace', 'id': 999484355, 'ino': 1099511628186, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/ADSBitsy'}, {'damage_type': 'backtrace', 'id': 1009165942, 'ino': 1099511628243, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/TODO'}, {'damage_type': 'backtrace', 'id': 1020261270, 'ino': 1099511628223, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt'}, {'damage_type': 'backtrace', 'id': 1020638005, 'ino': 1099511628175, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Interrupts'}, {'damage_type': 'backtrace', 'id': 1048732531, 'ino': 1099511628094, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/edid.S'}, {'damage_type': 'backtrace', 'id': 1052123746, 'ino': 1099511628106, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt'}, {'damage_type': 'backtrace', 'id': 1083307773, 'ino': 1099511628231, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt'}, {'damage_type': 'backtrace', 'id': 1120870193, 'ino': 1099511628196, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/PLEB'}, {'damage_type': 'backtrace', 'id': 1138570974, 'ino': 1099511628121, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/lockdep.txt'}, {'damage_type': 'backtrace', 'id': 1145210592, 'ino': 1099511628107, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt'}, {'damage_type': 'backtrace', 'id': 1149788082, 'ino': 1099511628224, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung'}, {'damage_type': 'backtrace', 'id': 1164646312, 'ino': 1099511628090, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1920x1080.S'}, {'damage_type': 'backtrace', 'id': 1165417442, 'ino': 1099511628116, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/UP.txt'}, {'damage_type': 'backtrace', 'id': 1201692310, 'ino': 1099511628110, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/pci.txt'}, {'damage_type': 'backtrace', 'id': 1219225578, 'ino': 1099511628171, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Atmel/README'}, {'damage_type': 'backtrace', 'id': 1235746795, 'ino': 1099511628185, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100'}, {'damage_type': 'backtrace', 'id': 1263184319, 'ino': 1099511628242, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/README.FPE'}, {'damage_type': 'backtrace', 'id': 1269290702, 'ino': 1099511628123, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rcu_dereference.txt'}, {'damage_type': 'backtrace', 'id': 1295325352, 'ino': 1099511628144, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/taskstats-struct.txt'}, {'damage_type': 'backtrace', 'id': 1296258216, 'ino': 1099511628189, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/CERF'}, {'damage_type': 'backtrace', 'id': 1301440760, 'ino': 1099511628217, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt'}, {'damage_type': 'backtrace', 'id': 1336212838, 'ino': 1099511628158, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/scan_handlers.txt'}, {'damage_type': 'backtrace', 'id': 1339058391, 'ino': 1099511628163, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/status.sh'}, {'damage_type': 'backtrace', 'id': 1345059959, 'ino': 1099511628255, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/swp_emulation'}, {'damage_type': 'backtrace', 'id': 1368093291, 'ino': 1099511628141, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/cgroupstats.txt'}, {'damage_type': 'backtrace', 'id': 1399917641, 'ino': 1099511628148, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/apei/einj.txt'}, {'damage_type': 'backtrace', 'id': 1494203506, 'ino': 1099511628214, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt'}, {'damage_type': 'backtrace', 'id': 1549890496, 'ino': 1099511628192, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster'}, {'damage_type': 'backtrace', 'id': 1563209283, 'ino': 1099511628153, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/gpio-properties.txt'}, {'damage_type': 'backtrace', 'id': 1569700585, 'ino': 1099511628161, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/aoe.txt'}, {'damage_type': 'backtrace', 'id': 1583027346, 'ino': 1099511628253, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sunxi/README'}, {'damage_type': 'backtrace', 'id': 1584702891, 'ino': 1099511628174, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/IXP4xx'}, {'damage_type': 'backtrace', 'id': 1620292935, 'ino': 1099511628176, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Makefile'}, {'damage_type': 'backtrace', 'id': 1633697063, 'ino': 1099511628209, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt'}, {'damage_type': 'backtrace', 'id': 1669935698, 'ino': 1099511628117, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/arrayRCU.txt'}, {'damage_type': 'backtrace', 'id': 1742655309, 'ino': 1099511628147, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/apei'}, {'damage_type': 'backtrace', 'id': 1750775453, 'ino': 1099511628170, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Atmel'}, {'damage_type': 'backtrace', 'id': 1788132360, 'ino': 1099511628157, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/namespace.txt'}, {'damage_type': 'backtrace', 'id': 1802796703, 'ino': 1099511628203, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/serial_UART'}, {'damage_type': 'backtrace', 'id': 1823676727, 'ino': 1099511628166, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/udev.txt'}, {'damage_type': 'backtrace', 'id': 1826427556, 'ino': 1099511628228, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Setup'}, {'damage_type': 'backtrace', 'id': 1840225227, 'ino': 1099511628124, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rcubarrier.txt'}, {'damage_type': 'backtrace', 'id': 1875334760, 'ino': 1099511628122, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rcu.txt'}, {'damage_type': 'backtrace', 'id': 1889168357, 'ino': 1099511628246, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti'}, {'damage_type': 'backtrace', 'id': 1924033109, 'ino': 1099511628188, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Brutus'}, {'damage_type': 'backtrace', 'id': 1952148767, 'ino': 1099511628151, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/dsdt-override.txt'}, {'damage_type': 'backtrace', 'id': 1952559125, 'ino': 1099511628248, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/stih407-overview.txt'}, {'damage_type': 'backtrace', 'id': 1967175975, 'ino': 1099511628150, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/debug.txt'}, {'damage_type': 'backtrace', 'id': 2027783385, 'ino': 1099511628220, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt'}, {'damage_type': 'backtrace', 'id': 2030310107, 'ino': 1099511628256, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/tcm.txt'}, {'damage_type': 'backtrace', 'id': 2057549278, 'ino': 1099511628152, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/enumeration.txt'}, {'damage_type': 'backtrace', 'id': 2061131082, 'ino': 1099511628164, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/aoe/todo.txt'}, {'damage_type': 'backtrace', 'id': 2079270157, 'ino': 1099511628177, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Marvell'}, {'damage_type': 'backtrace', 'id': 2141870267, 'ino': 1099511628086, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1024x768.S'}, {'damage_type': 'backtrace', 'id': 2163073370, 'ino': 1099511628219, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt'}, {'damage_type': 'backtrace', 'id': 2169062630, 'ino': 1099511628095, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/hex'}, {'damage_type': 'backtrace', 'id': 2243642717, 'ino': 1099511628087, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1280x1024.S'}, {'damage_type': 'backtrace', 'id': 2258816956, 'ino': 1099511628118, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/checklist.txt'}, {'damage_type': 'backtrace', 'id': 2264175797, 'ino': 1099511628211, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SPEAr/overview.txt'}, {'damage_type': 'backtrace', 'id': 2266816406, 'ino': 1099511628169, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/00-INDEX'}, {'damage_type': 'backtrace', 'id': 2272974984, 'ino': 1099511628089, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1680x1050.S'}, {'damage_type': 'backtrace', 'id': 2287933635, 'ino': 1099511628129, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/trace.txt'}, {'damage_type': 'backtrace', 'id': 2357907461, 'ino': 1099511628173, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/CCN.txt'}, {'damage_type': 'backtrace', 'id': 2359975909, 'ino': 1099511628142, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/delay-accounting.txt'}, {'damage_type': 'backtrace', 'id': 2365021701, 'ino': 1099511628222, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt'}, {'damage_type': 'backtrace', 'id': 2365686904, 'ino': 1099511628092, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/HOWTO.txt'}, {'damage_type': 'backtrace', 'id': 2369565260, 'ino': 1099511628229, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/VFP'}, {'damage_type': 'backtrace', 'id': 2393073409, 'ino': 1099511628202, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/nanoEngine'}, {'damage_type': 'backtrace', 'id': 2406812815, 'ino': 1099511628195, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/LART'}, {'damage_type': 'backtrace', 'id': 2507928255, 'ino': 1099511628201, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/empeg'}, {'damage_type': 'backtrace', 'id': 2530985767, 'ino': 1099511628108, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/pci-error-recovery.txt'}, {'damage_type': 'backtrace', 'id': 2550352214, 'ino': 1099511628114, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/NMI-RCU.txt'}, {'damage_type': 'backtrace', 'id': 2550721440, 'ino': 1099511628125, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/rculist_nulls.txt'}, {'damage_type': 'backtrace', 'id': 2633789402, 'ino': 1099511628145, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/taskstats.txt'}, {'damage_type': 'backtrace', 'id': 2680446037, 'ino': 1099511628215, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt'}, {'damage_type': 'backtrace', 'id': 2686168049, 'ino': 1099511628179, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Netwinder'}, {'damage_type': 'backtrace', 'id': 2729862405, 'ino': 1099511628184, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/README'}, {'damage_type': 'backtrace', 'id': 2743966242, 'ino': 1099511628252, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sunxi'}, {'damage_type': 'backtrace', 'id': 2927665469, 'ino': 1099511628244, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/pxa'}, {'damage_type': 'backtrace', 'id': 2963866063, 'ino': 1099511628119, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/listRCU.txt'}, {'damage_type': 'backtrace', 'id': 3021026830, 'ino': 1099511628093, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/Makefile'}, {'damage_type': 'backtrace', 'id': 3055446480, 'ino': 1099511628181, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/OMAP/DSS'}, {'damage_type': 'backtrace', 'id': 3132745246, 'ino': 1099511628212, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX'}, {'damage_type': 'backtrace', 'id': 3156480733, 'ino': 1099511628105, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/00-INDEX'}, {'damage_type': 'backtrace', 'id': 3157352895, 'ino': 1099511628232, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/firmware.txt'}, {'damage_type': 'backtrace', 'id': 3160960522, 'ino': 1099511628198, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Tifon'}, {'damage_type': 'backtrace', 'id': 3168816645, 'ino': 1099511628130, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/whatisRCU.txt'}, {'damage_type': 'backtrace', 'id': 3192121138, 'ino': 1099511628251, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/stih418-overview.txt'}, {'damage_type': 'backtrace', 'id': 3225256925, 'ino': 1099511628257, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/uefi.txt'}, {'damage_type': 'backtrace', 'id': 3307077424, 'ino': 1099511628226, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung/Overview.txt'}, {'damage_type': 'backtrace', 'id': 3308275961, 'ino': 1099511628216, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt'}, {'damage_type': 'backtrace', 'id': 3377817286, 'ino': 1099511628210, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SPEAr'}, {'damage_type': 'backtrace', 'id': 3388430381, 'ino': 1099511628128, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/torture.txt'}, {'damage_type': 'backtrace', 'id': 3523547076, 'ino': 1099511628088, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/1600x1200.S'}, {'damage_type': 'backtrace', 'id': 3549347743, 'ino': 1099511628250, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/stih416-overview.txt'}, {'damage_type': 'backtrace', 'id': 3593078709, 'ino': 1099511628155, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/method-customizing.txt'}, {'damage_type': 'backtrace', 'id': 3626313931, 'ino': 1099511628233, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/kernel_mode_neon.txt'}, {'damage_type': 'backtrace', 'id': 3691155502, 'ino': 1099511628204, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile'}, {'damage_type': 'backtrace', 'id': 3700552911, 'ino': 1099511628254, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sunxi/clocks.txt'}, {'damage_type': 'backtrace', 'id': 3711356053, 'ino': 1099511628249, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/stih415-overview.txt'}, {'damage_type': 'backtrace', 'id': 3719301697, 'ino': 1099511628193, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL'}, {'damage_type': 'backtrace', 'id': 3756593150, 'ino': 1099511628187, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Assabet'}, {'damage_type': 'backtrace', 'id': 3853712043, 'ino': 1099511628178, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Marvell/README'}, {'damage_type': 'backtrace', 'id': 3867540619, 'ino': 1099511628205, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore'}, {'damage_type': 'backtrace', 'id': 3938990816, 'ino': 1099511628225, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Samsung/GPIO.txt'}, {'damage_type': 'backtrace', 'id': 3951434640, 'ino': 1099511628206, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/Makefile'}, {'damage_type': 'backtrace', 'id': 3969028115, 'ino': 1099511628240, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/NOTES'}, {'damage_type': 'backtrace', 'id': 4028874083, 'ino': 1099511628111, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/PCI/pcieaer-howto.txt'}, {'damage_type': 'backtrace', 'id': 4043549232, 'ino': 1099511628091, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/EDID/800x600.S'}, {'damage_type': 'backtrace', 'id': 4054363826, 'ino': 1099511628113, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/00-INDEX'}, {'damage_type': 'backtrace', 'id': 4057889615, 'ino': 1099511628241, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/nwfpe/README'}, {'damage_type': 'backtrace', 'id': 4100532129, 'ino': 1099511628200, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Yopy'}, {'damage_type': 'backtrace', 'id': 4114472111, 'ino': 1099511628190, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/FreeBird'}, {'damage_type': 'backtrace', 'id': 4115249569, 'ino': 1099511628140, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/accounting/Makefile'}, {'damage_type': 'backtrace', 'id': 4130857150, 'ino': 1099511628197, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SA1100/Pangolin'}, {'damage_type': 'backtrace', 'id': 4137238426, 'ino': 1099511628208, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt'}, {'damage_type': 'backtrace', 'id': 4208433693, 'ino': 1099511628180, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/OMAP'}, {'damage_type': 'backtrace', 'id': 4237723307, 'ino': 1099511628156, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/acpi/method-tracing.txt'}, {'damage_type': 'backtrace', 'id': 4244783458, 'ino': 1099511628247, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/sti/overview.txt'}, {'damage_type': 'backtrace', 'id': 4247376778, 'ino': 1099511628127, 'path': '/volumes/qa/sv_1/2a614eef-8518-4aff-a815-c846baf08bfb/client.0/tmp/untar_tar/linux-4.0.5/Documentation/RCU/stallwarn.txt'}] 2024-05-10T03:43:08.987 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_50174015a7e79f951b988949abe236791f52d4da/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_50174015a7e79f951b988949abe236791f52d4da/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_50174015a7e79f951b988949abe236791f52d4da/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph-c_50174015a7e79f951b988949abe236791f52d4da/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-05-10T03:43:09.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:09 smithi106 ceph-mon[46996]: pgmap v371: 129 pgs: 129 active+clean; 170 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.1 MiB/s wr, 639 op/s 2024-05-10T03:43:09.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:09 smithi106 ceph-mon[46996]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:09.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:09 smithi154 ceph-mon[46565]: pgmap v371: 129 pgs: 129 active+clean; 170 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.1 MiB/s wr, 639 op/s 2024-05-10T03:43:09.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:09 smithi154 ceph-mon[46565]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:09.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:09 smithi045 ceph-mon[42520]: pgmap v371: 129 pgs: 129 active+clean; 170 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.1 MiB/s wr, 639 op/s 2024-05-10T03:43:09.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:09 smithi045 ceph-mon[42520]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:10.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:10 smithi106 ceph-mon[46996]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:10.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:10 smithi154 ceph-mon[46565]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:10.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:10 smithi045 ceph-mon[42520]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:11.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:11 smithi106 ceph-mon[46996]: pgmap v372: 129 pgs: 129 active+clean; 175 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 477 op/s 2024-05-10T03:43:11.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:11 smithi154 ceph-mon[46565]: pgmap v372: 129 pgs: 129 active+clean; 175 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 477 op/s 2024-05-10T03:43:11.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:11 smithi045 ceph-mon[42520]: pgmap v372: 129 pgs: 129 active+clean; 175 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 477 op/s 2024-05-10T03:43:13.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:13 smithi106 ceph-mon[46996]: pgmap v373: 129 pgs: 129 active+clean; 177 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 490 op/s 2024-05-10T03:43:13.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:13 smithi154 ceph-mon[46565]: pgmap v373: 129 pgs: 129 active+clean; 177 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 490 op/s 2024-05-10T03:43:13.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:13 smithi045 ceph-mon[42520]: pgmap v373: 129 pgs: 129 active+clean; 177 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 490 op/s 2024-05-10T03:43:14.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:14 smithi106 ceph-mon[46996]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:14.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:14 smithi154 ceph-mon[46565]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:14.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:14 smithi045 ceph-mon[42520]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:15.216 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.214+0000 7fa399251700 1 -- 172.21.15.45:0/2375305533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa394108b60 msgr2=0x7fa39410fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:15.216 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.214+0000 7fa399251700 1 --2- 172.21.15.45:0/2375305533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa394108b60 0x7fa39410fde0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa3840099c0 tx=0x7fa384009cd0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.214+0000 7fa399251700 1 -- 172.21.15.45:0/2375305533 shutdown_connections 2024-05-10T03:43:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.214+0000 7fa399251700 1 --2- 172.21.15.45:0/2375305533 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa394110320 0x7fa394112740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.214+0000 7fa399251700 1 --2- 172.21.15.45:0/2375305533 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa394108210 0x7fa394108620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.214+0000 7fa399251700 1 --2- 172.21.15.45:0/2375305533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa394108b60 0x7fa39410fde0 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa3840099c0 tx=0x7fa384009cd0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.214+0000 7fa399251700 1 -- 172.21.15.45:0/2375305533 >> 172.21.15.45:0/2375305533 conn(0x7fa39406ea00 msgr2=0x7fa394070eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.215+0000 7fa399251700 1 -- 172.21.15.45:0/2375305533 shutdown_connections 2024-05-10T03:43:15.217 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.215+0000 7fa399251700 1 -- 172.21.15.45:0/2375305533 wait complete. 2024-05-10T03:43:15.219 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.217+0000 7fa399251700 1 Processor -- start 2024-05-10T03:43:15.219 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.217+0000 7fa399251700 1 -- start start 2024-05-10T03:43:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.217+0000 7fa399251700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa394108210 0x7fa3941a2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.217+0000 7fa399251700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa394110320 0x7fa3941a3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.217+0000 7fa399251700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3941a8100 0x7fa3941aa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.217+0000 7fa399251700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3941aab80 con 0x7fa394108210 2024-05-10T03:43:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.217+0000 7fa399251700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3941aacc0 con 0x7fa3941a8100 2024-05-10T03:43:15.220 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.217+0000 7fa399251700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3941aae80 con 0x7fa394110320 2024-05-10T03:43:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.218+0000 7fa39359e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3941a8100 0x7fa3941aa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.218+0000 7fa39359e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3941a8100 0x7fa3941aa520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.45:37258/0 (socket says 172.21.15.45:37258) 2024-05-10T03:43:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.218+0000 7fa39359e700 1 -- 172.21.15.45:0/515461143 learned_addr learned my addr 172.21.15.45:0/515461143 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.218+0000 7fa39259c700 1 --2- 172.21.15.45:0/515461143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa394110320 0x7fa3941a3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:15.221 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.218+0000 7fa392d9d700 1 --2- 172.21.15.45:0/515461143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa394108210 0x7fa3941a2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:15.222 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.219+0000 7fa392d9d700 1 -- 172.21.15.45:0/515461143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa394110320 msgr2=0x7fa3941a3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:15.222 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.219+0000 7fa392d9d700 1 --2- 172.21.15.45:0/515461143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa394110320 0x7fa3941a3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.222 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.219+0000 7fa392d9d700 1 -- 172.21.15.45:0/515461143 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3941a8100 msgr2=0x7fa3941aa520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:15.222 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.219+0000 7fa392d9d700 1 --2- 172.21.15.45:0/515461143 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3941a8100 0x7fa3941aa520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.223 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.219+0000 7fa392d9d700 1 -- 172.21.15.45:0/515461143 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3840095f0 con 0x7fa394108210 2024-05-10T03:43:15.223 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.219+0000 7fa39359e700 1 --2- 172.21.15.45:0/515461143 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3941a8100 0x7fa3941aa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:43:15.223 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.219+0000 7fa392d9d700 1 --2- 172.21.15.45:0/515461143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa394108210 0x7fa3941a2c80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fa394072dd0 tx=0x7fa38800b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:15.223 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.220+0000 7fa37bfff700 1 -- 172.21.15.45:0/515461143 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa388011830 con 0x7fa394108210 2024-05-10T03:43:15.223 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.220+0000 7fa37bfff700 1 -- 172.21.15.45:0/515461143 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa388011e70 con 0x7fa394108210 2024-05-10T03:43:15.223 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.220+0000 7fa37bfff700 1 -- 172.21.15.45:0/515461143 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa388010e70 con 0x7fa394108210 2024-05-10T03:43:15.224 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.221+0000 7fa399251700 1 -- 172.21.15.45:0/515461143 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3941ab160 con 0x7fa394108210 2024-05-10T03:43:15.224 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.221+0000 7fa399251700 1 -- 172.21.15.45:0/515461143 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3941ab620 con 0x7fa394108210 2024-05-10T03:43:15.226 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.224+0000 7fa37bfff700 1 -- 172.21.15.45:0/515461143 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa388010380 con 0x7fa394108210 2024-05-10T03:43:15.227 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.225+0000 7fa37bfff700 1 --2- 172.21.15.45:0/515461143 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa37c0a1120 0x7fa37c0a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:15.228 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.225+0000 7fa37bfff700 1 -- 172.21.15.45:0/515461143 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa3880cc110 con 0x7fa394108210 2024-05-10T03:43:15.228 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.226+0000 7fa39259c700 1 --2- 172.21.15.45:0/515461143 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa37c0a1120 0x7fa37c0a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:15.228 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.226+0000 7fa3a9595b80 1 Processor -- start 2024-05-10T03:43:15.229 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.226+0000 7fa39259c700 1 --2- 172.21.15.45:0/515461143 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa37c0a1120 0x7fa37c0a3630 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa384006010 tx=0x7fa38401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.227+0000 7fa3a9595b80 1 -- start start 2024-05-10T03:43:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.227+0000 7fa3a9595b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0028a1180 0x55f0028a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.227+0000 7fa3a9595b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0028a2050 0x55f0028a2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.227+0000 7fa3a9595b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f0028a29a0 0x55f0028a92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:15.230 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.227+0000 7fa3a9595b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0027c80f0 con 0x55f0028a29a0 2024-05-10T03:43:15.231 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.227+0000 7fa3a9595b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0027c5ab0 con 0x55f0028a1180 2024-05-10T03:43:15.231 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.227+0000 7fa3a9595b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0027c13a0 con 0x55f0028a2050 2024-05-10T03:43:15.231 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.227+0000 7fa39359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f0028a29a0 0x55f0028a92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:15.231 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.227+0000 7fa39359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f0028a29a0 0x55f0028a92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45858/0 (socket says 172.21.15.45:45858) 2024-05-10T03:43:15.231 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.227+0000 7fa39359e700 1 -- 172.21.15.45:0/3594695186 learned_addr learned my addr 172.21.15.45:0/3594695186 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:15.231 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.227+0000 7fa39259c700 1 --2- 172.21.15.45:0/3594695186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0028a2050 0x55f0028a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:15.231 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.227+0000 7fa392d9d700 1 --2- 172.21.15.45:0/3594695186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0028a1180 0x55f0028a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:15.231 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.228+0000 7fa39359e700 1 -- 172.21.15.45:0/3594695186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0028a2050 msgr2=0x55f0028a2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:15.231 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.228+0000 7fa39359e700 1 --2- 172.21.15.45:0/3594695186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0028a2050 0x55f0028a2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.231 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.228+0000 7fa39359e700 1 -- 172.21.15.45:0/3594695186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0028a1180 msgr2=0x55f0028a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:15.231 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.228+0000 7fa39359e700 1 --2- 172.21.15.45:0/3594695186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0028a1180 0x55f0028a15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.231 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.228+0000 7fa39359e700 1 -- 172.21.15.45:0/3594695186 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f002642350 con 0x55f0028a29a0 2024-05-10T03:43:15.231 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.228+0000 7fa39359e700 1 --2- 172.21.15.45:0/3594695186 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f0028a29a0 0x55f0028a92a0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0078d0 tx=0x7fa38c0091b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ff3da35652d70e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:15.232 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.228+0000 7fa3797fa700 1 -- 172.21.15.45:0/3594695186 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c015850 con 0x55f0028a29a0 2024-05-10T03:43:15.232 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.228+0000 7fa3797fa700 1 -- 172.21.15.45:0/3594695186 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa38c00f040 con 0x55f0028a29a0 2024-05-10T03:43:15.232 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.228+0000 7fa3797fa700 1 -- 172.21.15.45:0/3594695186 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c014dd0 con 0x55f0028a29a0 2024-05-10T03:43:15.232 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.229+0000 7fa3a9595b80 1 -- 172.21.15.45:0/3594695186 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f0028a29a0 msgr2=0x55f0028a92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:15.232 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.229+0000 7fa3a9595b80 1 --2- 172.21.15.45:0/3594695186 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f0028a29a0 0x55f0028a92a0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0078d0 tx=0x7fa38c0091b0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.232 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.230+0000 7fa3a9595b80 1 -- 172.21.15.45:0/3594695186 shutdown_connections 2024-05-10T03:43:15.233 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.230+0000 7fa3a9595b80 1 --2- 172.21.15.45:0/3594695186 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f0028a29a0 0x55f0028a92a0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.233 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.230+0000 7fa3a9595b80 1 --2- 172.21.15.45:0/3594695186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0028a1180 0x55f0028a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.233 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.230+0000 7fa3a9595b80 1 --2- 172.21.15.45:0/3594695186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0028a2050 0x55f0028a2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.233 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.230+0000 7fa3a9595b80 1 -- 172.21.15.45:0/3594695186 >> 172.21.15.45:0/3594695186 conn(0x55f002803a00 msgr2=0x55f00289ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:15.242 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.231+0000 7fa3a9595b80 1 -- 172.21.15.45:0/3594695186 shutdown_connections 2024-05-10T03:43:15.242 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.232+0000 7fa3a9595b80 1 -- 172.21.15.45:0/3594695186 wait complete. 2024-05-10T03:43:15.242 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.232+0000 7fa3a9595b80 1 -- start start 2024-05-10T03:43:15.242 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.232+0000 7fa3a9595b80 1 Processor -- start 2024-05-10T03:43:15.242 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.233+0000 7fa3a9595b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0028a1180 0x55f0028a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:15.242 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.233+0000 7fa3a9595b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0028a2050 0x55f0028aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:15.242 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.233+0000 7fa3a9595b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f0028a29a0 0x55f0028b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:15.242 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.233+0000 7fa3a9595b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f00275d500 con 0x55f0028a29a0 2024-05-10T03:43:15.242 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.233+0000 7fa3a9595b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f00275d1a0 con 0x55f0028a2050 2024-05-10T03:43:15.242 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.233+0000 7fa3a9595b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f002644640 con 0x55f0028a1180 2024-05-10T03:43:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.233+0000 7fa3a9595b80 10 client.0 _ll_register_callbacks cb 0x55f002766ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:43:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.233+0000 7fa39359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f0028a29a0 0x55f0028b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.233+0000 7fa39359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f0028a29a0 0x55f0028b12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45868/0 (socket says 172.21.15.45:45868) 2024-05-10T03:43:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.233+0000 7fa39359e700 1 -- 172.21.15.45:0/4029506243 learned_addr learned my addr 172.21.15.45:0/4029506243 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.233+0000 7fa392d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0028a1180 0x55f0028a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.234+0000 7fa39359e700 1 -- 172.21.15.45:0/4029506243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0028a1180 msgr2=0x55f0028a9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.234+0000 7fa39359e700 1 --2- 172.21.15.45:0/4029506243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0028a1180 0x55f0028a9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.234+0000 7fa39359e700 1 -- 172.21.15.45:0/4029506243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0028a2050 msgr2=0x55f0028aa370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T03:43:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.234+0000 7fa39359e700 1 --2- 172.21.15.45:0/4029506243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0028a2050 0x55f0028aa370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.234+0000 7fa39359e700 1 -- 172.21.15.45:0/4029506243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38c007500 con 0x55f0028a29a0 2024-05-10T03:43:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.234+0000 7fa39359e700 1 --2- 172.21.15.45:0/4029506243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f0028a29a0 0x55f0028b12d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0078a0 tx=0x7fa38c014ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4936fc4a4d001d16 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:15.243 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.234+0000 7fa376ff5700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:43:15.244 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.234+0000 7fa376ff5700 1 -- 172.21.15.45:0/4029506243 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c015650 con 0x55f0028a29a0 2024-05-10T03:43:15.244 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.235+0000 7fa376ff5700 1 -- 172.21.15.45:0/4029506243 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa38c0157b0 con 0x55f0028a29a0 2024-05-10T03:43:15.244 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.235+0000 7fa3a9595b80 1 -- 172.21.15.45:0/4029506243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f00271a210 con 0x55f0028a29a0 2024-05-10T03:43:15.244 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.235+0000 7fa376ff5700 1 -- 172.21.15.45:0/4029506243 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa38c015970 con 0x55f0028a29a0 2024-05-10T03:43:15.244 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.235+0000 7fa3a9595b80 10 client.16611 fetch_fsmap learned FSMap version 35 2024-05-10T03:43:15.244 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.235+0000 7fa3a9595b80 1 -- 172.21.15.45:0/4029506243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55f0025eeb00 con 0x55f0028a29a0 2024-05-10T03:43:15.244 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.235+0000 7fa376ff5700 1 -- 172.21.15.45:0/4029506243 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55f00271a210 con 0x55f0028a29a0 2024-05-10T03:43:15.244 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.235+0000 7fa376ff5700 1 -- 172.21.15.45:0/4029506243 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 35) v1 ==== 7514+0+0 (secure 0 0 0) 0x7fa38c005850 con 0x55f0028a29a0 2024-05-10T03:43:15.244 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.235+0000 7fa3a9595b80 10 client.16611 fetch_fsmap finished waiting for FSMap version 35 2024-05-10T03:43:15.244 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.235+0000 7fa3a9595b80 10 client.16611 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:43:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.236+0000 7fa3a9595b80 20 client.16611 populate_metadata read hostname 'smithi045' 2024-05-10T03:43:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.236+0000 7fa3a9595b80 1 --2- 172.21.15.45:0/4029506243 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f0028b66e0 0x55f0028b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.236+0000 7fa3a9595b80 4 client.16611 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:43:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.236+0000 7fa3a9595b80 1 -- 172.21.15.45:0/4029506243 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f002870720 con 0x55f0028b66e0 2024-05-10T03:43:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.236+0000 7fa392d9d700 1 --2- 172.21.15.45:0/4029506243 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f0028b66e0 0x55f0028b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.237+0000 7fa392d9d700 1 --2- 172.21.15.45:0/4029506243 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f0028b66e0 0x55f0028b8b30 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52b3a80956eccaad server_cookie=855c67f6d5eb8517 in_seq=0 out_seq=0 2024-05-10T03:43:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.239+0000 7fa376ff5700 10 client.16611 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:43:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.239+0000 7fa376ff5700 1 -- 172.21.15.45:0/4029506243 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f002870720 con 0x55f0028b66e0 2024-05-10T03:43:15.245 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.239+0000 7fa376ff5700 10 client.16611 handle_command_reply: tid=0 2024-05-10T03:43:15.246 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.239+0000 7fa3a9595b80 1 client.16611 shutdown 2024-05-10T03:43:15.246 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.239+0000 7fa3a9595b80 1 -- 172.21.15.45:0/4029506243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f0028a29a0 msgr2=0x55f0028b12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:15.246 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.239+0000 7fa3a9595b80 1 --2- 172.21.15.45:0/4029506243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f0028a29a0 0x55f0028b12d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0078a0 tx=0x7fa38c014ec0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.246 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.239+0000 7fa3a9595b80 1 -- 172.21.15.45:0/4029506243 shutdown_connections 2024-05-10T03:43:15.246 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.239+0000 7fa3a9595b80 1 --2- 172.21.15.45:0/4029506243 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f0028b66e0 0x55f0028b8b30 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.246 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.239+0000 7fa3a9595b80 1 --2- 172.21.15.45:0/4029506243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0028a1180 0x55f0028a9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.246 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.239+0000 7fa3a9595b80 1 --2- 172.21.15.45:0/4029506243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f0028a29a0 0x55f0028b12d0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.246 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.239+0000 7fa3a9595b80 1 --2- 172.21.15.45:0/4029506243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0028a2050 0x55f0028aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.246 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.239+0000 7fa376ff5700 0 client.16611 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:43:15.246 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.239+0000 7fa3a9595b80 1 -- 172.21.15.45:0/4029506243 >> 172.21.15.45:0/4029506243 conn(0x55f002803a00 msgr2=0x55f00289ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.241+0000 7fa3a9595b80 1 -- 172.21.15.45:0/4029506243 shutdown_connections 2024-05-10T03:43:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.241+0000 7fa3a9595b80 1 -- 172.21.15.45:0/4029506243 wait complete. 2024-05-10T03:43:15.247 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.241+0000 7fa3a9595b80 20 client.16611 trim_cache size 0 max 16384 2024-05-10T03:43:15.272 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.269+0000 7fa3a9595b80 1 Processor -- start 2024-05-10T03:43:15.272 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.269+0000 7fa3a9595b80 1 -- start start 2024-05-10T03:43:15.273 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.269+0000 7fa3a9595b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f0028a1180 0x55f0028a2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:15.273 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.269+0000 7fa3a9595b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0028a2050 0x55f0028af280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:15.273 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.269+0000 7fa3a9595b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0028a29a0 0x55f0028af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:15.273 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.269+0000 7fa3a9595b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f00289d230 con 0x55f0028a1180 2024-05-10T03:43:15.273 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.269+0000 7fa3a9595b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0028a2db0 con 0x55f0028a29a0 2024-05-10T03:43:15.273 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.269+0000 7fa3a9595b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0028bdcb0 con 0x55f0028a2050 2024-05-10T03:43:15.273 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.270+0000 7fa39359e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0028a29a0 0x55f0028af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:15.273 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.270+0000 7fa39359e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0028a29a0 0x55f0028af7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.45:37284/0 (socket says 172.21.15.45:37284) 2024-05-10T03:43:15.273 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.270+0000 7fa39359e700 1 -- 172.21.15.45:0/3735924912 learned_addr learned my addr 172.21.15.45:0/3735924912 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:15.274 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.270+0000 7fa39359e700 1 -- 172.21.15.45:0/3735924912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0028a2050 msgr2=0x55f0028af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:15.274 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.270+0000 7fa39359e700 1 --2- 172.21.15.45:0/3735924912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0028a2050 0x55f0028af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.274 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.270+0000 7fa39359e700 1 -- 172.21.15.45:0/3735924912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f0028a1180 msgr2=0x55f0028a2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:15.274 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.270+0000 7fa39359e700 1 --2- 172.21.15.45:0/3735924912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f0028a1180 0x55f0028a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.274 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.270+0000 7fa39359e700 1 -- 172.21.15.45:0/3735924912 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f002787500 con 0x55f0028a29a0 2024-05-10T03:43:15.274 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.270+0000 7fa39359e700 1 --2- 172.21.15.45:0/3735924912 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0028a29a0 0x55f0028af7c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa38c009710 tx=0x7fa38c004a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f9dc64440127a83 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:15.277 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.272+0000 7fa379ffb700 1 -- 172.21.15.45:0/3735924912 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c014980 con 0x55f0028a29a0 2024-05-10T03:43:15.277 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.272+0000 7fa379ffb700 1 -- 172.21.15.45:0/3735924912 <== mon.2 v2:172.21.15.106:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa38c023070 con 0x55f0028a29a0 2024-05-10T03:43:15.277 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.272+0000 7fa379ffb700 1 -- 172.21.15.45:0/3735924912 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c01fb40 con 0x55f0028a29a0 2024-05-10T03:43:15.277 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.273+0000 7fa3a9595b80 1 -- 172.21.15.45:0/3735924912 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0028a29a0 msgr2=0x55f0028af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:15.277 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.273+0000 7fa3a9595b80 1 --2- 172.21.15.45:0/3735924912 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0028a29a0 0x55f0028af7c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa38c009710 tx=0x7fa38c004a70 comp rx=0 tx=0).stop 2024-05-10T03:43:15.277 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.274+0000 7fa3a9595b80 1 -- 172.21.15.45:0/3735924912 shutdown_connections 2024-05-10T03:43:15.277 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.274+0000 7fa3a9595b80 1 --2- 172.21.15.45:0/3735924912 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0028a29a0 0x55f0028af7c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.277 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.274+0000 7fa3a9595b80 1 --2- 172.21.15.45:0/3735924912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f0028a1180 0x55f0028a2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.277 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.274+0000 7fa3a9595b80 1 --2- 172.21.15.45:0/3735924912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0028a2050 0x55f0028af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.277 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.274+0000 7fa3a9595b80 1 -- 172.21.15.45:0/3735924912 >> 172.21.15.45:0/3735924912 conn(0x55f002803a00 msgr2=0x55f0028a5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:15.279 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.277+0000 7fa3a9595b80 1 -- 172.21.15.45:0/3735924912 shutdown_connections 2024-05-10T03:43:15.280 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.277+0000 7fa3a9595b80 1 -- 172.21.15.45:0/3735924912 wait complete. 2024-05-10T03:43:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.278+0000 7fa3a9595b80 1 -- start start 2024-05-10T03:43:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.278+0000 7fa3a9595b80 1 Processor -- start 2024-05-10T03:43:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.278+0000 7fa3a9595b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f0028a1180 0x55f0028ac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.278+0000 7fa3a9595b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0028a2050 0x55f0028aca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.279+0000 7fa3a9595b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0028a29a0 0x55f00292cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.279+0000 7fa3a9595b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0028af960 con 0x55f0028a1180 2024-05-10T03:43:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.279+0000 7fa3a9595b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0028afad0 con 0x55f0028a2050 2024-05-10T03:43:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.279+0000 7fa3a9595b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f00292d470 con 0x55f0028a29a0 2024-05-10T03:43:15.281 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.279+0000 7fa3a9595b80 10 client.0 _ll_register_callbacks cb 0x55f002766ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:43:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.279+0000 7fa39259c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0028a2050 0x55f0028aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.279+0000 7fa39259c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0028a2050 0x55f0028aca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.45:37298/0 (socket says 172.21.15.45:37298) 2024-05-10T03:43:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.279+0000 7fa39259c700 1 -- 172.21.15.45:0/45667540 learned_addr learned my addr 172.21.15.45:0/45667540 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.279+0000 7fa39359e700 1 --2- 172.21.15.45:0/45667540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0028a29a0 0x55f00292cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.279+0000 7fa392d9d700 1 --2- 172.21.15.45:0/45667540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f0028a1180 0x55f0028ac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.279+0000 7fa39259c700 1 -- 172.21.15.45:0/45667540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0028a29a0 msgr2=0x55f00292cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.279+0000 7fa39259c700 1 --2- 172.21.15.45:0/45667540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0028a29a0 0x55f00292cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.279+0000 7fa39259c700 1 -- 172.21.15.45:0/45667540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f0028a1180 msgr2=0x55f0028ac4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.279+0000 7fa39259c700 1 --2- 172.21.15.45:0/45667540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f0028a1180 0x55f0028ac4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.279+0000 7fa39259c700 1 -- 172.21.15.45:0/45667540 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f0025eeb00 con 0x55f0028a2050 2024-05-10T03:43:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.279+0000 7fa392d9d700 1 --2- 172.21.15.45:0/45667540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f0028a1180 0x55f0028ac4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:43:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.280+0000 7fa39259c700 1 --2- 172.21.15.45:0/45667540 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0028a2050 0x55f0028aca20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa3840099c0 tx=0x7fa384009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d5abd528b1da9c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.280+0000 7fa376ff5700 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-05-10T03:43:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.280+0000 7fa376ff5700 1 -- 172.21.15.45:0/45667540 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38402b040 con 0x55f0028a2050 2024-05-10T03:43:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.280+0000 7fa376ff5700 1 -- 172.21.15.45:0/45667540 <== mon.2 v2:172.21.15.106:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa38400f660 con 0x55f0028a2050 2024-05-10T03:43:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.280+0000 7fa3a9595b80 1 -- 172.21.15.45:0/45667540 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa38c00f040 con 0x55f0028a2050 2024-05-10T03:43:15.284 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.280+0000 7fa376ff5700 1 -- 172.21.15.45:0/45667540 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa38401d040 con 0x55f0028a2050 2024-05-10T03:43:15.285 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.282+0000 7fa3a9595b80 10 client.26405 fetch_fsmap learned FSMap version 35 2024-05-10T03:43:15.285 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.282+0000 7fa3a9595b80 1 -- 172.21.15.45:0/45667540 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55f002646c70 con 0x55f0028a2050 2024-05-10T03:43:15.285 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.283+0000 7fa376ff5700 1 -- 172.21.15.45:0/45667540 <== mon.2 v2:172.21.15.106:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa38c00f040 con 0x55f0028a2050 2024-05-10T03:43:15.286 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.283+0000 7fa376ff5700 1 -- 172.21.15.45:0/45667540 <== mon.2 v2:172.21.15.106:3300/0 5 ==== fsmap(e 35) v1 ==== 7514+0+0 (secure 0 0 0) 0x7fa384037070 con 0x55f0028a2050 2024-05-10T03:43:15.286 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.283+0000 7fa3a9595b80 10 client.26405 fetch_fsmap finished waiting for FSMap version 35 2024-05-10T03:43:15.286 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.283+0000 7fa3a9595b80 10 client.26405 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:43:15.286 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.283+0000 7fa3a9595b80 20 client.26405 populate_metadata read hostname 'smithi045' 2024-05-10T03:43:15.286 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.283+0000 7fa3a9595b80 1 --2- 172.21.15.45:0/45667540 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f00292ee10 0x55f002931230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:15.286 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.283+0000 7fa3a9595b80 4 client.26405 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T03:43:15.286 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.283+0000 7fa3a9595b80 1 -- 172.21.15.45:0/45667540 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f0027b9e60 con 0x55f00292ee10 2024-05-10T03:43:15.286 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.283+0000 7fa392d9d700 1 --2- 172.21.15.45:0/45667540 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f00292ee10 0x55f002931230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:15.287 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.284+0000 7fa376ff5700 10 client.26405 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:43:15.287 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.284+0000 7fa392d9d700 1 --2- 172.21.15.45:0/45667540 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f00292ee10 0x55f002931230 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3de7164ea537a2a2 server_cookie=59aac7164f3f7294 in_seq=0 out_seq=0 2024-05-10T03:43:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.313+0000 7fa376ff5700 1 -- 172.21.15.45:0/45667540 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f0027b9e60 con 0x55f00292ee10 2024-05-10T03:43:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.313+0000 7fa376ff5700 10 client.26405 handle_command_reply: tid=0 2024-05-10T03:43:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.314+0000 7fa3a9595b80 1 client.26405 shutdown 2024-05-10T03:43:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.314+0000 7fa3a9595b80 1 -- 172.21.15.45:0/45667540 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0028a2050 msgr2=0x55f0028aca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.314+0000 7fa3a9595b80 1 --2- 172.21.15.45:0/45667540 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0028a2050 0x55f0028aca20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa3840099c0 tx=0x7fa384009310 comp rx=0 tx=0).stop 2024-05-10T03:43:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.314+0000 7fa3a9595b80 1 -- 172.21.15.45:0/45667540 shutdown_connections 2024-05-10T03:43:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.314+0000 7fa3a9595b80 1 --2- 172.21.15.45:0/45667540 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55f00292ee10 0x55f002931230 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.314+0000 7fa3a9595b80 1 --2- 172.21.15.45:0/45667540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f0028a29a0 0x55f00292cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.314+0000 7fa3a9595b80 1 --2- 172.21.15.45:0/45667540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f0028a1180 0x55f0028ac4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.314+0000 7fa3a9595b80 1 --2- 172.21.15.45:0/45667540 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0028a2050 0x55f0028aca20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.317 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.314+0000 7fa3a9595b80 1 -- 172.21.15.45:0/45667540 >> 172.21.15.45:0/45667540 conn(0x55f002803a00 msgr2=0x55f0028a9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.315+0000 7fa376ff5700 0 client.26405 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:43:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.315+0000 7fa3a9595b80 1 -- 172.21.15.45:0/45667540 shutdown_connections 2024-05-10T03:43:15.318 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.315+0000 7fa3a9595b80 1 -- 172.21.15.45:0/45667540 wait complete. 2024-05-10T03:43:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:{ 2024-05-10T03:43:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "message": "", 2024-05-10T03:43:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "return_code": 0 2024-05-10T03:43:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:} 2024-05-10T03:43:15.319 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.316+0000 7fa3a9595b80 20 client.26405 trim_cache size 0 max 16384 2024-05-10T03:43:15.321 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.318+0000 7fa399251700 1 -- 172.21.15.45:0/515461143 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa37c0a1120 msgr2=0x7fa37c0a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:15.321 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.318+0000 7fa399251700 1 --2- 172.21.15.45:0/515461143 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa37c0a1120 0x7fa37c0a3630 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa384006010 tx=0x7fa38401a040 comp rx=0 tx=0).stop 2024-05-10T03:43:15.321 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.318+0000 7fa399251700 1 -- 172.21.15.45:0/515461143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa394108210 msgr2=0x7fa3941a2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:15.321 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.318+0000 7fa399251700 1 --2- 172.21.15.45:0/515461143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa394108210 0x7fa3941a2c80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fa394072dd0 tx=0x7fa38800b750 comp rx=0 tx=0).stop 2024-05-10T03:43:15.322 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.319+0000 7fa399251700 1 -- 172.21.15.45:0/515461143 shutdown_connections 2024-05-10T03:43:15.322 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.319+0000 7fa399251700 1 --2- 172.21.15.45:0/515461143 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa37c0a1120 0x7fa37c0a3630 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.322 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.319+0000 7fa399251700 1 --2- 172.21.15.45:0/515461143 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3941a8100 0x7fa3941aa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.322 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.319+0000 7fa399251700 1 --2- 172.21.15.45:0/515461143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa394108210 0x7fa3941a2c80 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.322 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.319+0000 7fa399251700 1 --2- 172.21.15.45:0/515461143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa394110320 0x7fa3941a3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.319+0000 7fa399251700 1 -- 172.21.15.45:0/515461143 >> 172.21.15.45:0/515461143 conn(0x7fa39406ea00 msgr2=0x7fa39406f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:15.323 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.321+0000 7fa399251700 1 -- 172.21.15.45:0/515461143 shutdown_connections 2024-05-10T03:43:15.325 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:15.322+0000 7fa399251700 1 -- 172.21.15.45:0/515461143 wait complete. 2024-05-10T03:43:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:15 smithi106 ceph-mon[46996]: pgmap v374: 129 pgs: 129 active+clean; 179 MiB data, 850 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 425 op/s 2024-05-10T03:43:15.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:15 smithi154 ceph-mon[46565]: pgmap v374: 129 pgs: 129 active+clean; 179 MiB data, 850 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 425 op/s 2024-05-10T03:43:15.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:15 smithi045 ceph-mon[42520]: pgmap v374: 129 pgs: 129 active+clean; 179 MiB data, 850 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 425 op/s 2024-05-10T03:43:17.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:17 smithi106 ceph-mon[46996]: pgmap v375: 129 pgs: 129 active+clean; 178 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 366 op/s 2024-05-10T03:43:17.473 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:17 smithi154 ceph-mon[46565]: pgmap v375: 129 pgs: 129 active+clean; 178 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 366 op/s 2024-05-10T03:43:17.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:17 smithi045 ceph-mon[42520]: pgmap v375: 129 pgs: 129 active+clean; 178 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 366 op/s 2024-05-10T03:43:19.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:19 smithi106 ceph-mon[46996]: pgmap v376: 129 pgs: 129 active+clean; 171 MiB data, 852 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 401 op/s 2024-05-10T03:43:19.473 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:19 smithi154 ceph-mon[46565]: pgmap v376: 129 pgs: 129 active+clean; 171 MiB data, 852 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 401 op/s 2024-05-10T03:43:19.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:19 smithi045 ceph-mon[42520]: pgmap v376: 129 pgs: 129 active+clean; 171 MiB data, 852 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 401 op/s 2024-05-10T03:43:21.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:21 smithi106 ceph-mon[46996]: pgmap v377: 129 pgs: 129 active+clean; 173 MiB data, 856 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 421 op/s 2024-05-10T03:43:21.473 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:21 smithi154 ceph-mon[46565]: pgmap v377: 129 pgs: 129 active+clean; 173 MiB data, 856 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 421 op/s 2024-05-10T03:43:21.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:21 smithi045 ceph-mon[42520]: pgmap v377: 129 pgs: 129 active+clean; 173 MiB data, 856 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 421 op/s 2024-05-10T03:43:22.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:22 smithi154 ceph-mon[46565]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:22.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:22 smithi154 ceph-mon[46565]: pgmap v378: 129 pgs: 129 active+clean; 174 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 412 op/s 2024-05-10T03:43:22.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:22 smithi045 ceph-mon[42520]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:22.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:22 smithi045 ceph-mon[42520]: pgmap v378: 129 pgs: 129 active+clean; 174 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 412 op/s 2024-05-10T03:43:22.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:22 smithi106 ceph-mon[46996]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:22.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:22 smithi106 ceph-mon[46996]: pgmap v378: 129 pgs: 129 active+clean; 174 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 412 op/s 2024-05-10T03:43:25.410 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:25 smithi106 ceph-mon[46996]: pgmap v379: 129 pgs: 129 active+clean; 178 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 339 op/s 2024-05-10T03:43:25.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:25 smithi154 ceph-mon[46565]: pgmap v379: 129 pgs: 129 active+clean; 178 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 339 op/s 2024-05-10T03:43:25.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:25 smithi045 ceph-mon[42520]: pgmap v379: 129 pgs: 129 active+clean; 178 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 339 op/s 2024-05-10T03:43:27.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:27 smithi106 ceph-mon[46996]: pgmap v380: 129 pgs: 129 active+clean; 181 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 304 op/s 2024-05-10T03:43:27.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:27 smithi154 ceph-mon[46565]: pgmap v380: 129 pgs: 129 active+clean; 181 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 304 op/s 2024-05-10T03:43:27.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:27 smithi045 ceph-mon[42520]: pgmap v380: 129 pgs: 129 active+clean; 181 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 304 op/s 2024-05-10T03:43:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.471+0000 7f769b015700 1 -- 172.21.15.45:0/53655550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7694101be0 msgr2=0x7f7694101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.471+0000 7f769b015700 1 --2- 172.21.15.45:0/53655550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7694101be0 0x7f7694101ff0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f7680009990 tx=0x7f7680009ca0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.471+0000 7f769b015700 1 -- 172.21.15.45:0/53655550 shutdown_connections 2024-05-10T03:43:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.471+0000 7f769b015700 1 --2- 172.21.15.45:0/53655550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7694100ac0 0x7f7694100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.471+0000 7f769b015700 1 --2- 172.21.15.45:0/53655550 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7694102580 0x7f7694108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.471+0000 7f769b015700 1 --2- 172.21.15.45:0/53655550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7694101be0 0x7f7694101ff0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.471+0000 7f769b015700 1 -- 172.21.15.45:0/53655550 >> 172.21.15.45:0/53655550 conn(0x7f76940fc0f0 msgr2=0x7f76940fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.471+0000 7f769b015700 1 -- 172.21.15.45:0/53655550 shutdown_connections 2024-05-10T03:43:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.471+0000 7f769b015700 1 -- 172.21.15.45:0/53655550 wait complete. 2024-05-10T03:43:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.472+0000 7f769b015700 1 Processor -- start 2024-05-10T03:43:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.472+0000 7f769b015700 1 -- start start 2024-05-10T03:43:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.472+0000 7f769b015700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7694100ac0 0x7f76940690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.472+0000 7f769b015700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7694101be0 0x7f769419cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.472+0000 7f769b015700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7694102580 0x7f769419f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.472+0000 7f769b015700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769419fb30 con 0x7f7694100ac0 2024-05-10T03:43:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.472+0000 7f769b015700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769419fca0 con 0x7f7694102580 2024-05-10T03:43:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.472+0000 7f769b015700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769419fe60 con 0x7f7694101be0 2024-05-10T03:43:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.472+0000 7f7698db1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7694100ac0 0x7f76940690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.472+0000 7f7698db1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7694100ac0 0x7f76940690c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39756/0 (socket says 172.21.15.45:39756) 2024-05-10T03:43:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.472+0000 7f7698db1700 1 -- 172.21.15.45:0/2984350285 learned_addr learned my addr 172.21.15.45:0/2984350285 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.472+0000 7f7693fff700 1 --2- 172.21.15.45:0/2984350285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7694101be0 0x7f769419cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.472+0000 7f76995b2700 1 --2- 172.21.15.45:0/2984350285 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7694102580 0x7f769419f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.472+0000 7f7698db1700 1 -- 172.21.15.45:0/2984350285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7694101be0 msgr2=0x7f769419cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.472+0000 7f7698db1700 1 --2- 172.21.15.45:0/2984350285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7694101be0 0x7f769419cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.472+0000 7f7698db1700 1 -- 172.21.15.45:0/2984350285 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7694102580 msgr2=0x7f769419f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.472+0000 7f7698db1700 1 --2- 172.21.15.45:0/2984350285 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7694102580 0x7f769419f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.472+0000 7f7698db1700 1 -- 172.21.15.45:0/2984350285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76800095f0 con 0x7f7694100ac0 2024-05-10T03:43:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.472+0000 7f7693fff700 1 --2- 172.21.15.45:0/2984350285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7694101be0 0x7f769419cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:43:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.472+0000 7f76995b2700 1 --2- 172.21.15.45:0/2984350285 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7694102580 0x7f769419f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:43:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.473+0000 7f7698db1700 1 --2- 172.21.15.45:0/2984350285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7694100ac0 0x7f76940690c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f768800d950 tx=0x7f768800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.473+0000 7f7691ffb700 1 -- 172.21.15.45:0/2984350285 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768800bb60 con 0x7f7694100ac0 2024-05-10T03:43:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.473+0000 7f7691ffb700 1 -- 172.21.15.45:0/2984350285 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7688007620 con 0x7f7694100ac0 2024-05-10T03:43:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.473+0000 7f769b015700 1 -- 172.21.15.45:0/2984350285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76941a0140 con 0x7f7694100ac0 2024-05-10T03:43:28.480 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.473+0000 7f7691ffb700 1 -- 172.21.15.45:0/2984350285 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768800f620 con 0x7f7694100ac0 2024-05-10T03:43:28.481 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.473+0000 7f769b015700 1 -- 172.21.15.45:0/2984350285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76941a06a0 con 0x7f7694100ac0 2024-05-10T03:43:28.488 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.476+0000 7f7691ffb700 1 -- 172.21.15.45:0/2984350285 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7688010460 con 0x7f7694100ac0 2024-05-10T03:43:28.488 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.476+0000 7f7691ffb700 1 --2- 172.21.15.45:0/2984350285 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f76840a11a0 0x7f76840a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:28.488 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.476+0000 7f7691ffb700 1 -- 172.21.15.45:0/2984350285 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f76880ccbd0 con 0x7f7694100ac0 2024-05-10T03:43:28.488 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.476+0000 7f7693fff700 1 --2- 172.21.15.45:0/2984350285 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f76840a11a0 0x7f76840a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:28.488 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.477+0000 7f7693fff700 1 --2- 172.21.15.45:0/2984350285 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f76840a11a0 0x7f76840a36b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f768000b8e0 tx=0x7f7680005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:28.488 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.477+0000 7f76ab359b80 1 Processor -- start 2024-05-10T03:43:28.488 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.477+0000 7f76ab359b80 1 -- start start 2024-05-10T03:43:28.488 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.477+0000 7f76ab359b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557372087180 0x5573720875b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:28.489 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.477+0000 7f76ab359b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372088050 0x557372088460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:28.489 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.477+0000 7f76ab359b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573720889a0 0x55737208f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:28.489 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.477+0000 7f76ab359b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557371fae0f0 con 0x557372088050 2024-05-10T03:43:28.489 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.477+0000 7f76ab359b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x557371fabab0 con 0x5573720889a0 2024-05-10T03:43:28.489 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.477+0000 7f76ab359b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x557371fa73a0 con 0x557372087180 2024-05-10T03:43:28.489 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.478+0000 7f7693fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372088050 0x557372088460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:28.489 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.478+0000 7f7693fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372088050 0x557372088460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39758/0 (socket says 172.21.15.45:39758) 2024-05-10T03:43:28.489 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.478+0000 7f7693fff700 1 -- 172.21.15.45:0/724449026 learned_addr learned my addr 172.21.15.45:0/724449026 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:28.489 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.478+0000 7f7698db1700 1 --2- 172.21.15.45:0/724449026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557372087180 0x5573720875b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:28.489 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.478+0000 7f76995b2700 1 --2- 172.21.15.45:0/724449026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573720889a0 0x55737208f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:28.489 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.478+0000 7f7693fff700 1 -- 172.21.15.45:0/724449026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557372087180 msgr2=0x5573720875b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:28.489 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.478+0000 7f7693fff700 1 --2- 172.21.15.45:0/724449026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557372087180 0x5573720875b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.489 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.478+0000 7f7693fff700 1 -- 172.21.15.45:0/724449026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573720889a0 msgr2=0x55737208f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:28.489 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.478+0000 7f7693fff700 1 --2- 172.21.15.45:0/724449026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573720889a0 0x55737208f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.490 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.478+0000 7f7693fff700 1 -- 172.21.15.45:0/724449026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557371e28350 con 0x557372088050 2024-05-10T03:43:28.490 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.478+0000 7f7693fff700 1 --2- 172.21.15.45:0/724449026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372088050 0x557372088460 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f7680015000 tx=0x7f768001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6820244f0be09ee3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:28.490 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.478+0000 7f767effd700 1 -- 172.21.15.45:0/724449026 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680029070 con 0x557372088050 2024-05-10T03:43:28.490 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.478+0000 7f767effd700 1 -- 172.21.15.45:0/724449026 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f768002e940 con 0x557372088050 2024-05-10T03:43:28.490 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.478+0000 7f767effd700 1 -- 172.21.15.45:0/724449026 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768001d070 con 0x557372088050 2024-05-10T03:43:28.490 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.479+0000 7f76ab359b80 1 -- 172.21.15.45:0/724449026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372088050 msgr2=0x557372088460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:28.490 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.479+0000 7f76ab359b80 1 --2- 172.21.15.45:0/724449026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372088050 0x557372088460 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f7680015000 tx=0x7f768001d000 comp rx=0 tx=0).stop 2024-05-10T03:43:28.490 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.479+0000 7f76ab359b80 1 -- 172.21.15.45:0/724449026 shutdown_connections 2024-05-10T03:43:28.490 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.479+0000 7f76ab359b80 1 --2- 172.21.15.45:0/724449026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557372087180 0x5573720875b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.490 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.479+0000 7f76ab359b80 1 --2- 172.21.15.45:0/724449026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5573720889a0 0x55737208f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.490 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.479+0000 7f76ab359b80 1 --2- 172.21.15.45:0/724449026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372088050 0x557372088460 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.490 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.479+0000 7f76ab359b80 1 -- 172.21.15.45:0/724449026 >> 172.21.15.45:0/724449026 conn(0x557371fe9a00 msgr2=0x557372081a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:28.490 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.479+0000 7f76ab359b80 1 -- 172.21.15.45:0/724449026 shutdown_connections 2024-05-10T03:43:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.479+0000 7f76ab359b80 1 -- 172.21.15.45:0/724449026 wait complete. 2024-05-10T03:43:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.480+0000 7f76ab359b80 1 -- start start 2024-05-10T03:43:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.480+0000 7f76ab359b80 1 Processor -- start 2024-05-10T03:43:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.480+0000 7f76ab359b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372087180 0x5573720911b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.480+0000 7f76ab359b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557372088050 0x5573720916f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.480+0000 7f76ab359b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573720889a0 0x557372098650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.480+0000 7f76ab359b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557371f43500 con 0x557372087180 2024-05-10T03:43:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.480+0000 7f76ab359b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x557371f431a0 con 0x557372088050 2024-05-10T03:43:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.480+0000 7f76ab359b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x557371e2a640 con 0x5573720889a0 2024-05-10T03:43:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.481+0000 7f76ab359b80 10 client.0 _ll_register_callbacks cb 0x557371f4cad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:43:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.481+0000 7f7698db1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372087180 0x5573720911b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.481+0000 7f7698db1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372087180 0x5573720911b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39766/0 (socket says 172.21.15.45:39766) 2024-05-10T03:43:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.481+0000 7f7698db1700 1 -- 172.21.15.45:0/4041003345 learned_addr learned my addr 172.21.15.45:0/4041003345 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.481+0000 7f76995b2700 1 --2- 172.21.15.45:0/4041003345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573720889a0 0x557372098650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.481+0000 7f7693fff700 1 --2- 172.21.15.45:0/4041003345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557372088050 0x5573720916f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.481+0000 7f7698db1700 1 -- 172.21.15.45:0/4041003345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573720889a0 msgr2=0x557372098650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.481+0000 7f7698db1700 1 --2- 172.21.15.45:0/4041003345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573720889a0 0x557372098650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.481+0000 7f7698db1700 1 -- 172.21.15.45:0/4041003345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557372088050 msgr2=0x5573720916f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.481+0000 7f7698db1700 1 --2- 172.21.15.45:0/4041003345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557372088050 0x5573720916f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.481+0000 7f7698db1700 1 -- 172.21.15.45:0/4041003345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76941098c0 con 0x557372087180 2024-05-10T03:43:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.481+0000 7f7698db1700 1 --2- 172.21.15.45:0/4041003345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372087180 0x5573720911b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f768800b540 tx=0x7f768809a460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b90f5026548e137 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.481+0000 7f7673fff700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:43:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.481+0000 7f7673fff700 1 -- 172.21.15.45:0/4041003345 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7688010910 con 0x557372087180 2024-05-10T03:43:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.481+0000 7f7673fff700 1 -- 172.21.15.45:0/4041003345 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7688099e80 con 0x557372087180 2024-05-10T03:43:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.481+0000 7f76ab359b80 1 -- 172.21.15.45:0/4041003345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557371f00210 con 0x557372087180 2024-05-10T03:43:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.481+0000 7f7673fff700 1 -- 172.21.15.45:0/4041003345 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f768809a040 con 0x557372087180 2024-05-10T03:43:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.482+0000 7f76ab359b80 10 client.16623 fetch_fsmap learned FSMap version 36 2024-05-10T03:43:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.482+0000 7f76ab359b80 1 -- 172.21.15.45:0/4041003345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x557371dd4b00 con 0x557372087180 2024-05-10T03:43:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.482+0000 7f7673fff700 1 -- 172.21.15.45:0/4041003345 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x557371f00210 con 0x557372087180 2024-05-10T03:43:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.482+0000 7f7673fff700 1 -- 172.21.15.45:0/4041003345 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 36) v1 ==== 7522+0+0 (secure 0 0 0) 0x7f7688095a10 con 0x557372087180 2024-05-10T03:43:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.482+0000 7f76ab359b80 10 client.16623 fetch_fsmap finished waiting for FSMap version 36 2024-05-10T03:43:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.482+0000 7f76ab359b80 10 client.16623 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:43:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.482+0000 7f76ab359b80 20 client.16623 populate_metadata read hostname 'smithi045' 2024-05-10T03:43:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.482+0000 7f76ab359b80 1 --2- 172.21.15.45:0/4041003345 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55737209ced0 0x55737209f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.482+0000 7f76ab359b80 4 client.16623 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:43:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.482+0000 7f76ab359b80 1 -- 172.21.15.45:0/4041003345 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557372056720 con 0x55737209ced0 2024-05-10T03:43:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.482+0000 7f7693fff700 1 --2- 172.21.15.45:0/4041003345 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55737209ced0 0x55737209f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.483+0000 7f7693fff700 1 --2- 172.21.15.45:0/4041003345 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55737209ced0 0x55737209f320 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=709590df945ffad5 server_cookie=85cb7a514c6b2332 in_seq=0 out_seq=0 2024-05-10T03:43:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.483+0000 7f7673fff700 10 client.16623 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:43:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.484+0000 7f7673fff700 1 -- 172.21.15.45:0/4041003345 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557372056720 con 0x55737209ced0 2024-05-10T03:43:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.484+0000 7f7673fff700 10 client.16623 handle_command_reply: tid=0 2024-05-10T03:43:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.484+0000 7f76ab359b80 1 client.16623 shutdown 2024-05-10T03:43:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.484+0000 7f76ab359b80 1 -- 172.21.15.45:0/4041003345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372087180 msgr2=0x5573720911b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.484+0000 7f76ab359b80 1 --2- 172.21.15.45:0/4041003345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372087180 0x5573720911b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f768800b540 tx=0x7f768809a460 comp rx=0 tx=0).stop 2024-05-10T03:43:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.484+0000 7f76ab359b80 1 -- 172.21.15.45:0/4041003345 shutdown_connections 2024-05-10T03:43:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.484+0000 7f76ab359b80 1 --2- 172.21.15.45:0/4041003345 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x55737209ced0 0x55737209f320 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.484+0000 7f76ab359b80 1 --2- 172.21.15.45:0/4041003345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5573720889a0 0x557372098650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.484+0000 7f76ab359b80 1 --2- 172.21.15.45:0/4041003345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372087180 0x5573720911b0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.484+0000 7f76ab359b80 1 --2- 172.21.15.45:0/4041003345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557372088050 0x5573720916f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.484+0000 7f7673fff700 0 client.16623 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:43:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.484+0000 7f76ab359b80 1 -- 172.21.15.45:0/4041003345 >> 172.21.15.45:0/4041003345 conn(0x557371fe9a00 msgr2=0x557372081a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.484+0000 7f76ab359b80 1 -- 172.21.15.45:0/4041003345 shutdown_connections 2024-05-10T03:43:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.484+0000 7f76ab359b80 1 -- 172.21.15.45:0/4041003345 wait complete. 2024-05-10T03:43:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.484+0000 7f76ab359b80 20 client.16623 trim_cache size 0 max 16384 2024-05-10T03:43:28.505 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.500+0000 7f76ab359b80 1 Processor -- start 2024-05-10T03:43:28.505 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.500+0000 7f76ab359b80 1 -- start start 2024-05-10T03:43:28.505 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.501+0000 7f76ab359b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557371fe9a00 0x55737208f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:28.505 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.501+0000 7f76ab359b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557372087180 0x557372098610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:28.505 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.501+0000 7f76ab359b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372088050 0x55737208fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:28.505 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.501+0000 7f76ab359b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557372092440 con 0x557372088050 2024-05-10T03:43:28.505 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.501+0000 7f76ab359b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55737209a330 con 0x557372087180 2024-05-10T03:43:28.505 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.501+0000 7f76ab359b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55737208f280 con 0x557371fe9a00 2024-05-10T03:43:28.505 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.501+0000 7f76995b2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372088050 0x55737208fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:28.505 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.501+0000 7f76995b2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372088050 0x55737208fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39780/0 (socket says 172.21.15.45:39780) 2024-05-10T03:43:28.506 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.501+0000 7f76995b2700 1 -- 172.21.15.45:0/907672948 learned_addr learned my addr 172.21.15.45:0/907672948 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:28.506 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.501+0000 7f7698db1700 1 --2- 172.21.15.45:0/907672948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557371fe9a00 0x55737208f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:28.506 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.501+0000 7f7693fff700 1 --2- 172.21.15.45:0/907672948 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557372087180 0x557372098610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:28.506 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.501+0000 7f76995b2700 1 -- 172.21.15.45:0/907672948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557371fe9a00 msgr2=0x55737208f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:28.506 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.501+0000 7f76995b2700 1 --2- 172.21.15.45:0/907672948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557371fe9a00 0x55737208f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.506 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.501+0000 7f76995b2700 1 -- 172.21.15.45:0/907672948 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557372087180 msgr2=0x557372098610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:28.506 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.501+0000 7f76995b2700 1 --2- 172.21.15.45:0/907672948 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557372087180 0x557372098610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.506 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.501+0000 7f76995b2700 1 -- 172.21.15.45:0/907672948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557371f6d500 con 0x557372088050 2024-05-10T03:43:28.506 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.501+0000 7f76995b2700 1 --2- 172.21.15.45:0/907672948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372088050 0x55737208fb10 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f768c007630 tx=0x7f768c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b15b0abedae79bf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:28.506 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.502+0000 7f767f7fe700 1 -- 172.21.15.45:0/907672948 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c018870 con 0x557372088050 2024-05-10T03:43:28.506 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.502+0000 7f767f7fe700 1 -- 172.21.15.45:0/907672948 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f768c011040 con 0x557372088050 2024-05-10T03:43:28.506 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.502+0000 7f767f7fe700 1 -- 172.21.15.45:0/907672948 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c017cd0 con 0x557372088050 2024-05-10T03:43:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.502+0000 7f76ab359b80 1 -- 172.21.15.45:0/907672948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372088050 msgr2=0x55737208fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.502+0000 7f76ab359b80 1 --2- 172.21.15.45:0/907672948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372088050 0x55737208fb10 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f768c007630 tx=0x7f768c009040 comp rx=0 tx=0).stop 2024-05-10T03:43:28.511 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.502+0000 7f76ab359b80 1 -- 172.21.15.45:0/907672948 shutdown_connections 2024-05-10T03:43:28.511 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.502+0000 7f76ab359b80 1 --2- 172.21.15.45:0/907672948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557371fe9a00 0x55737208f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.511 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.502+0000 7f76ab359b80 1 --2- 172.21.15.45:0/907672948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372088050 0x55737208fb10 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.511 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.502+0000 7f76ab359b80 1 --2- 172.21.15.45:0/907672948 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557372087180 0x557372098610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.511 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.502+0000 7f76ab359b80 1 -- 172.21.15.45:0/907672948 >> 172.21.15.45:0/907672948 conn(0x55737207e040 msgr2=0x55737208bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:28.511 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.503+0000 7f76ab359b80 1 -- 172.21.15.45:0/907672948 shutdown_connections 2024-05-10T03:43:28.511 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.503+0000 7f76ab359b80 1 -- 172.21.15.45:0/907672948 wait complete. 2024-05-10T03:43:28.511 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.503+0000 7f76ab359b80 1 -- start start 2024-05-10T03:43:28.511 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.503+0000 7f76ab359b80 1 Processor -- start 2024-05-10T03:43:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.503+0000 7f76ab359b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557371fe9a00 0x5573720960e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.503+0000 7f76ab359b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372087180 0x557372096620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.503+0000 7f76ab359b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557372088050 0x557372097550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.503+0000 7f76ab359b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557372097a90 con 0x557372087180 2024-05-10T03:43:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.503+0000 7f76ab359b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x557372097c00 con 0x557372088050 2024-05-10T03:43:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.503+0000 7f76ab359b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x557372097dc0 con 0x557371fe9a00 2024-05-10T03:43:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.504+0000 7f76ab359b80 10 client.0 _ll_register_callbacks cb 0x557371f4cad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:43:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.504+0000 7f7693fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372087180 0x557372096620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.504+0000 7f7693fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372087180 0x557372096620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39786/0 (socket says 172.21.15.45:39786) 2024-05-10T03:43:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.504+0000 7f7693fff700 1 -- 172.21.15.45:0/3742593984 learned_addr learned my addr 172.21.15.45:0/3742593984 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.504+0000 7f76995b2700 1 --2- 172.21.15.45:0/3742593984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557372088050 0x557372097550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.504+0000 7f7698db1700 1 --2- 172.21.15.45:0/3742593984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557371fe9a00 0x5573720960e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:28.513 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.504+0000 7f7693fff700 1 -- 172.21.15.45:0/3742593984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557371fe9a00 msgr2=0x5573720960e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:28.513 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.504+0000 7f7693fff700 1 --2- 172.21.15.45:0/3742593984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557371fe9a00 0x5573720960e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.513 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.504+0000 7f7693fff700 1 -- 172.21.15.45:0/3742593984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557372088050 msgr2=0x557372097550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:28.513 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.504+0000 7f7693fff700 1 --2- 172.21.15.45:0/3742593984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557372088050 0x557372097550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.513 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.504+0000 7f7693fff700 1 -- 172.21.15.45:0/3742593984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768c0092e0 con 0x557372087180 2024-05-10T03:43:28.513 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.504+0000 7f7693fff700 1 --2- 172.21.15.45:0/3742593984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372087180 0x557372096620 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7680005b40 tx=0x7f768000ba00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bbecc00478ba82b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:28.513 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.504+0000 7f7673fff700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-05-10T03:43:28.513 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.504+0000 7f7673fff700 1 -- 172.21.15.45:0/3742593984 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680033040 con 0x557372087180 2024-05-10T03:43:28.513 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.504+0000 7f7673fff700 1 -- 172.21.15.45:0/3742593984 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7680035d70 con 0x557372087180 2024-05-10T03:43:28.513 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.504+0000 7f76ab359b80 1 -- 172.21.15.45:0/3742593984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f768002e940 con 0x557372087180 2024-05-10T03:43:28.514 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.505+0000 7f7673fff700 1 -- 172.21.15.45:0/3742593984 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f768001d040 con 0x557372087180 2024-05-10T03:43:28.514 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.505+0000 7f76ab359b80 10 client.16629 fetch_fsmap learned FSMap version 36 2024-05-10T03:43:28.514 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.505+0000 7f76ab359b80 1 -- 172.21.15.45:0/3742593984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x557371e2cc70 con 0x557372087180 2024-05-10T03:43:28.514 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.505+0000 7f7673fff700 1 -- 172.21.15.45:0/3742593984 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f768002e940 con 0x557372087180 2024-05-10T03:43:28.514 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.505+0000 7f7673fff700 1 -- 172.21.15.45:0/3742593984 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 36) v1 ==== 7522+0+0 (secure 0 0 0) 0x7f76800353b0 con 0x557372087180 2024-05-10T03:43:28.514 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.505+0000 7f76ab359b80 10 client.16629 fetch_fsmap finished waiting for FSMap version 36 2024-05-10T03:43:28.514 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.505+0000 7f76ab359b80 10 client.16629 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:43:28.514 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.505+0000 7f76ab359b80 20 client.16629 populate_metadata read hostname 'smithi045' 2024-05-10T03:43:28.514 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.505+0000 7f76ab359b80 1 --2- 172.21.15.45:0/3742593984 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5573720889a0 0x5573720f5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:28.514 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.505+0000 7f76ab359b80 4 client.16629 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T03:43:28.514 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.505+0000 7f76ab359b80 1 -- 172.21.15.45:0/3742593984 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557371f9fe60 con 0x5573720889a0 2024-05-10T03:43:28.515 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.505+0000 7f7698db1700 1 --2- 172.21.15.45:0/3742593984 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5573720889a0 0x5573720f5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:28.515 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.506+0000 7f7673fff700 10 client.16629 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:43:28.515 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.506+0000 7f7698db1700 1 --2- 172.21.15.45:0/3742593984 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5573720889a0 0x5573720f5b10 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=899b32bbb1d4f564 server_cookie=e72b90ee9dc5afb3 in_seq=0 out_seq=0 2024-05-10T03:43:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.884+0000 7f7673fff700 1 -- 172.21.15.45:0/3742593984 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557371f9fe60 con 0x5573720889a0 2024-05-10T03:43:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.884+0000 7f7673fff700 10 client.16629 handle_command_reply: tid=0 2024-05-10T03:43:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.884+0000 7f76ab359b80 1 client.16629 shutdown 2024-05-10T03:43:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.884+0000 7f76ab359b80 1 -- 172.21.15.45:0/3742593984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372087180 msgr2=0x557372096620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.884+0000 7f76ab359b80 1 --2- 172.21.15.45:0/3742593984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372087180 0x557372096620 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7680005b40 tx=0x7f768000ba00 comp rx=0 tx=0).stop 2024-05-10T03:43:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.884+0000 7f76ab359b80 1 -- 172.21.15.45:0/3742593984 shutdown_connections 2024-05-10T03:43:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.884+0000 7f76ab359b80 1 --2- 172.21.15.45:0/3742593984 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x5573720889a0 0x5573720f5b10 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.884+0000 7f76ab359b80 1 --2- 172.21.15.45:0/3742593984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557371fe9a00 0x5573720960e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.884+0000 7f76ab359b80 1 --2- 172.21.15.45:0/3742593984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557372088050 0x557372097550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.884+0000 7f7673fff700 0 client.16629 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:43:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.884+0000 7f76ab359b80 1 --2- 172.21.15.45:0/3742593984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557372087180 0x557372096620 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.884+0000 7f76ab359b80 1 -- 172.21.15.45:0/3742593984 >> 172.21.15.45:0/3742593984 conn(0x55737207e040 msgr2=0x55737208f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.884+0000 7f76ab359b80 1 -- 172.21.15.45:0/3742593984 shutdown_connections 2024-05-10T03:43:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.884+0000 7f76ab359b80 1 -- 172.21.15.45:0/3742593984 wait complete. 2024-05-10T03:43:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.884+0000 7f76ab359b80 20 client.16629 trim_cache size 0 max 16384 2024-05-10T03:43:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:{ 2024-05-10T03:43:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "message": "", 2024-05-10T03:43:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "return_code": 0 2024-05-10T03:43:28.890 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:} 2024-05-10T03:43:28.890 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.885+0000 7f769b015700 1 -- 172.21.15.45:0/2984350285 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f76840a11a0 msgr2=0x7f76840a36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.885+0000 7f769b015700 1 --2- 172.21.15.45:0/2984350285 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f76840a11a0 0x7f76840a36b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f768000b8e0 tx=0x7f7680005fb0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.885+0000 7f769b015700 1 -- 172.21.15.45:0/2984350285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7694100ac0 msgr2=0x7f76940690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.885+0000 7f769b015700 1 --2- 172.21.15.45:0/2984350285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7694100ac0 0x7f76940690c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f768800d950 tx=0x7f768800dd10 comp rx=0 tx=0).stop 2024-05-10T03:43:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.885+0000 7f769b015700 1 -- 172.21.15.45:0/2984350285 shutdown_connections 2024-05-10T03:43:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.885+0000 7f769b015700 1 --2- 172.21.15.45:0/2984350285 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f76840a11a0 0x7f76840a36b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.885+0000 7f769b015700 1 --2- 172.21.15.45:0/2984350285 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7694102580 0x7f769419f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.885+0000 7f769b015700 1 --2- 172.21.15.45:0/2984350285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7694100ac0 0x7f76940690c0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.885+0000 7f769b015700 1 --2- 172.21.15.45:0/2984350285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7694101be0 0x7f769419cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.885+0000 7f769b015700 1 -- 172.21.15.45:0/2984350285 >> 172.21.15.45:0/2984350285 conn(0x7f76940fc0f0 msgr2=0x7f7694104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.885+0000 7f769b015700 1 -- 172.21.15.45:0/2984350285 shutdown_connections 2024-05-10T03:43:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:28.885+0000 7f769b015700 1 -- 172.21.15.45:0/2984350285 wait complete. 2024-05-10T03:43:29.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:29 smithi106 ceph-mon[46996]: pgmap v381: 129 pgs: 129 active+clean; 193 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.6 MiB/s wr, 443 op/s 2024-05-10T03:43:29.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:29 smithi154 ceph-mon[46565]: pgmap v381: 129 pgs: 129 active+clean; 193 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.6 MiB/s wr, 443 op/s 2024-05-10T03:43:29.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:29 smithi045 ceph-mon[42520]: pgmap v381: 129 pgs: 129 active+clean; 193 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.6 MiB/s wr, 443 op/s 2024-05-10T03:43:31.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:31 smithi106 ceph-mon[46996]: pgmap v382: 129 pgs: 129 active+clean; 204 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.8 MiB/s wr, 511 op/s 2024-05-10T03:43:31.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:31 smithi154 ceph-mon[46565]: pgmap v382: 129 pgs: 129 active+clean; 204 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.8 MiB/s wr, 511 op/s 2024-05-10T03:43:31.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:31 smithi045 ceph-mon[42520]: pgmap v382: 129 pgs: 129 active+clean; 204 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.8 MiB/s wr, 511 op/s 2024-05-10T03:43:31.723 INFO:tasks.workunit.client.0.smithi045.stdout:Ok 2024-05-10T03:43:31.723 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-10T03:43:31.723 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-10T03:43:33.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:33 smithi106 ceph-mon[46996]: pgmap v383: 129 pgs: 129 active+clean; 202 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 533 op/s 2024-05-10T03:43:33.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:33 smithi154 ceph-mon[46565]: pgmap v383: 129 pgs: 129 active+clean; 202 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 533 op/s 2024-05-10T03:43:33.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:33 smithi045 ceph-mon[42520]: pgmap v383: 129 pgs: 129 active+clean; 202 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 533 op/s 2024-05-10T03:43:35.400 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:35 smithi106 ceph-mon[46996]: pgmap v384: 129 pgs: 129 active+clean; 175 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.3 MiB/s wr, 526 op/s 2024-05-10T03:43:35.473 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:35 smithi154 ceph-mon[46565]: pgmap v384: 129 pgs: 129 active+clean; 175 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.3 MiB/s wr, 526 op/s 2024-05-10T03:43:35.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:35 smithi045 ceph-mon[42520]: pgmap v384: 129 pgs: 129 active+clean; 175 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.3 MiB/s wr, 526 op/s 2024-05-10T03:43:37.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:37 smithi106 ceph-mon[46996]: pgmap v385: 129 pgs: 129 active+clean; 146 MiB data, 976 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 541 op/s 2024-05-10T03:43:37.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:37 smithi154 ceph-mon[46565]: pgmap v385: 129 pgs: 129 active+clean; 146 MiB data, 976 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 541 op/s 2024-05-10T03:43:37.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:37 smithi045 ceph-mon[42520]: pgmap v385: 129 pgs: 129 active+clean; 146 MiB data, 976 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 541 op/s 2024-05-10T03:43:38.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:38 smithi106 ceph-mon[46996]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:38.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:38 smithi154 ceph-mon[46565]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:38.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:38 smithi045 ceph-mon[42520]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:39.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:39 smithi106 ceph-mon[46996]: pgmap v386: 129 pgs: 129 active+clean; 103 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 600 op/s 2024-05-10T03:43:39.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:39 smithi106 ceph-mon[46996]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:39.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:39 smithi154 ceph-mon[46565]: pgmap v386: 129 pgs: 129 active+clean; 103 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 600 op/s 2024-05-10T03:43:39.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:39 smithi154 ceph-mon[46565]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:39.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:39 smithi045 ceph-mon[42520]: pgmap v386: 129 pgs: 129 active+clean; 103 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 600 op/s 2024-05-10T03:43:39.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:39 smithi045 ceph-mon[42520]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:40.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:40 smithi106 ceph-mon[46996]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:40.473 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:40 smithi154 ceph-mon[46565]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:40.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:40 smithi045 ceph-mon[42520]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:41.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:41 smithi106 ceph-mon[46996]: pgmap v387: 129 pgs: 129 active+clean; 103 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 480 op/s 2024-05-10T03:43:41.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:41 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:43:41.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:41 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:43:41.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:41 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:43:41.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:41 smithi154 ceph-mon[46565]: pgmap v387: 129 pgs: 129 active+clean; 103 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 480 op/s 2024-05-10T03:43:41.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:41 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:43:41.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:41 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:43:41.478 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:41 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:43:41.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:41 smithi045 ceph-mon[42520]: pgmap v387: 129 pgs: 129 active+clean; 103 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 480 op/s 2024-05-10T03:43:41.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:41 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T03:43:41.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:41 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:43:41.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:41 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:43:42.033 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.028+0000 7efc06d5c700 1 -- 172.21.15.45:0/1208071147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc00101be0 msgr2=0x7efc00101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:42.033 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.028+0000 7efc06d5c700 1 --2- 172.21.15.45:0/1208071147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc00101be0 0x7efc00101ff0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7efbec009990 tx=0x7efbec009ca0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.028+0000 7efc06d5c700 1 -- 172.21.15.45:0/1208071147 shutdown_connections 2024-05-10T03:43:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.028+0000 7efc06d5c700 1 --2- 172.21.15.45:0/1208071147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc00102580 0x7efc00108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.028+0000 7efc06d5c700 1 --2- 172.21.15.45:0/1208071147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc00100ac0 0x7efc00100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.028+0000 7efc06d5c700 1 --2- 172.21.15.45:0/1208071147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc00101be0 0x7efc00101ff0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.028+0000 7efc06d5c700 1 -- 172.21.15.45:0/1208071147 >> 172.21.15.45:0/1208071147 conn(0x7efc000fc0f0 msgr2=0x7efc000fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.028+0000 7efc06d5c700 1 -- 172.21.15.45:0/1208071147 shutdown_connections 2024-05-10T03:43:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.028+0000 7efc06d5c700 1 -- 172.21.15.45:0/1208071147 wait complete. 2024-05-10T03:43:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.028+0000 7efc06d5c700 1 Processor -- start 2024-05-10T03:43:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.028+0000 7efc06d5c700 1 -- start start 2024-05-10T03:43:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.029+0000 7efc06d5c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc00100ac0 0x7efc00196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.029+0000 7efc06d5c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc00101be0 0x7efc00197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.029+0000 7efc06d5c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc00102580 0x7efc0019e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.029+0000 7efc06d5c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0019ea60 con 0x7efc00102580 2024-05-10T03:43:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.029+0000 7efc06d5c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0019eba0 con 0x7efc00101be0 2024-05-10T03:43:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.029+0000 7efc06d5c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0019ed30 con 0x7efc00100ac0 2024-05-10T03:43:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.029+0000 7efc052f9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc00102580 0x7efc0019e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.029+0000 7efc052f9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc00102580 0x7efc0019e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44784/0 (socket says 172.21.15.45:44784) 2024-05-10T03:43:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.029+0000 7efc052f9700 1 -- 172.21.15.45:0/2140273219 learned_addr learned my addr 172.21.15.45:0/2140273219 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.029+0000 7efbfffff700 1 --2- 172.21.15.45:0/2140273219 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc00101be0 0x7efc00197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.029+0000 7efc04af8700 1 --2- 172.21.15.45:0/2140273219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc00100ac0 0x7efc00196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.029+0000 7efc052f9700 1 -- 172.21.15.45:0/2140273219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc00100ac0 msgr2=0x7efc00196fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.029+0000 7efc052f9700 1 --2- 172.21.15.45:0/2140273219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc00100ac0 0x7efc00196fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.029+0000 7efc052f9700 1 -- 172.21.15.45:0/2140273219 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc00101be0 msgr2=0x7efc00197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.029+0000 7efc052f9700 1 --2- 172.21.15.45:0/2140273219 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc00101be0 0x7efc00197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.029+0000 7efc052f9700 1 -- 172.21.15.45:0/2140273219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbec0095f0 con 0x7efc00102580 2024-05-10T03:43:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.029+0000 7efbfffff700 1 --2- 172.21.15.45:0/2140273219 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc00101be0 0x7efc00197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:43:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.030+0000 7efc052f9700 1 --2- 172.21.15.45:0/2140273219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc00102580 0x7efc0019e490 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7efbf8007f40 tx=0x7efbf800f5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.030+0000 7efbfdffb700 1 -- 172.21.15.45:0/2140273219 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf8003a00 con 0x7efc00102580 2024-05-10T03:43:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.030+0000 7efbfdffb700 1 -- 172.21.15.45:0/2140273219 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efbf8003b60 con 0x7efc00102580 2024-05-10T03:43:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.030+0000 7efc06d5c700 1 -- 172.21.15.45:0/2140273219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc000686b0 con 0x7efc00102580 2024-05-10T03:43:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.030+0000 7efbfdffb700 1 -- 172.21.15.45:0/2140273219 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf80126c0 con 0x7efc00102580 2024-05-10T03:43:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.030+0000 7efc06d5c700 1 -- 172.21.15.45:0/2140273219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc00068b70 con 0x7efc00102580 2024-05-10T03:43:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.033+0000 7efbfdffb700 1 -- 172.21.15.45:0/2140273219 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7efbf80128e0 con 0x7efc00102580 2024-05-10T03:43:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.033+0000 7efbfdffb700 1 --2- 172.21.15.45:0/2140273219 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efbf00a1120 0x7efbf00a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.033+0000 7efbfdffb700 1 -- 172.21.15.45:0/2140273219 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7efbf80cedd0 con 0x7efc00102580 2024-05-10T03:43:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.034+0000 7efc04af8700 1 --2- 172.21.15.45:0/2140273219 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efbf00a1120 0x7efbf00a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.034+0000 7efc170a0b80 1 Processor -- start 2024-05-10T03:43:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.034+0000 7efc04af8700 1 --2- 172.21.15.45:0/2140273219 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efbf00a1120 0x7efbf00a3630 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efc00101ae0 tx=0x7efbf4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.034+0000 7efc170a0b80 1 -- start start 2024-05-10T03:43:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.034+0000 7efc170a0b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a2a0ca180 0x557a2a0ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.034+0000 7efc170a0b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557a2a0cb050 0x557a2a0cb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.034+0000 7efc170a0b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557a2a0cb9a0 0x557a2a0d22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:42.040 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.034+0000 7efc170a0b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a29ff10f0 con 0x557a2a0cb9a0 2024-05-10T03:43:42.040 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.034+0000 7efc170a0b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a29feeab0 con 0x557a2a0cb050 2024-05-10T03:43:42.040 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.034+0000 7efc170a0b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a29fea3a0 con 0x557a2a0ca180 2024-05-10T03:43:42.040 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.035+0000 7efc04af8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a2a0ca180 0x557a2a0ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:42.040 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.035+0000 7efc04af8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a2a0ca180 0x557a2a0ca5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.45:55052/0 (socket says 172.21.15.45:55052) 2024-05-10T03:43:42.040 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.035+0000 7efc04af8700 1 -- 172.21.15.45:0/2170177823 learned_addr learned my addr 172.21.15.45:0/2170177823 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:42.040 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.035+0000 7efc052f9700 1 --2- 172.21.15.45:0/2170177823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557a2a0cb9a0 0x557a2a0d22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:42.040 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.035+0000 7efbfffff700 1 --2- 172.21.15.45:0/2170177823 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557a2a0cb050 0x557a2a0cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:42.040 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.035+0000 7efc04af8700 1 -- 172.21.15.45:0/2170177823 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557a2a0cb050 msgr2=0x557a2a0cb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:42.040 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.035+0000 7efc04af8700 1 --2- 172.21.15.45:0/2170177823 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557a2a0cb050 0x557a2a0cb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.040 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.035+0000 7efc04af8700 1 -- 172.21.15.45:0/2170177823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557a2a0cb9a0 msgr2=0x557a2a0d22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:42.040 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.035+0000 7efc04af8700 1 --2- 172.21.15.45:0/2170177823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557a2a0cb9a0 0x557a2a0d22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.040 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.035+0000 7efc04af8700 1 -- 172.21.15.45:0/2170177823 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a29e6b350 con 0x557a2a0ca180 2024-05-10T03:43:42.041 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.035+0000 7efc04af8700 1 --2- 172.21.15.45:0/2170177823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a2a0ca180 0x557a2a0ca5b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efbf4011d20 tx=0x7efbf4014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be1f76260e90aad7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:42.041 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.035+0000 7efbeaffd700 1 -- 172.21.15.45:0/2170177823 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf400ed20 con 0x557a2a0ca180 2024-05-10T03:43:42.041 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.035+0000 7efbeaffd700 1 -- 172.21.15.45:0/2170177823 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efbf4021070 con 0x557a2a0ca180 2024-05-10T03:43:42.041 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.035+0000 7efbeaffd700 1 -- 172.21.15.45:0/2170177823 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf401d670 con 0x557a2a0ca180 2024-05-10T03:43:42.046 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.036+0000 7efc170a0b80 1 -- 172.21.15.45:0/2170177823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a2a0ca180 msgr2=0x557a2a0ca5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:42.046 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.036+0000 7efc170a0b80 1 --2- 172.21.15.45:0/2170177823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a2a0ca180 0x557a2a0ca5b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efbf4011d20 tx=0x7efbf4014000 comp rx=0 tx=0).stop 2024-05-10T03:43:42.046 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.036+0000 7efc170a0b80 1 -- 172.21.15.45:0/2170177823 shutdown_connections 2024-05-10T03:43:42.046 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.036+0000 7efc170a0b80 1 --2- 172.21.15.45:0/2170177823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a2a0ca180 0x557a2a0ca5b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.046 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.036+0000 7efc170a0b80 1 --2- 172.21.15.45:0/2170177823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557a2a0cb9a0 0x557a2a0d22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.047 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.036+0000 7efc170a0b80 1 --2- 172.21.15.45:0/2170177823 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557a2a0cb050 0x557a2a0cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.047 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.036+0000 7efc170a0b80 1 -- 172.21.15.45:0/2170177823 >> 172.21.15.45:0/2170177823 conn(0x557a2a02ca00 msgr2=0x557a2a0c4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:42.047 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.036+0000 7efc170a0b80 1 -- 172.21.15.45:0/2170177823 shutdown_connections 2024-05-10T03:43:42.047 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.036+0000 7efc170a0b80 1 -- 172.21.15.45:0/2170177823 wait complete. 2024-05-10T03:43:42.047 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.037+0000 7efc170a0b80 1 -- start start 2024-05-10T03:43:42.048 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.037+0000 7efc170a0b80 1 Processor -- start 2024-05-10T03:43:42.048 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.037+0000 7efc170a0b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a2a0ca180 0x557a2a0d4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:42.048 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.037+0000 7efc170a0b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557a2a0cb050 0x557a2a0d46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:42.048 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.037+0000 7efc170a0b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557a2a0cb9a0 0x557a2a0db620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:42.048 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.037+0000 7efc170a0b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a29f86500 con 0x557a2a0cb9a0 2024-05-10T03:43:42.048 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.037+0000 7efc170a0b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a29f861a0 con 0x557a2a0cb050 2024-05-10T03:43:42.049 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.037+0000 7efc170a0b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a29e6d640 con 0x557a2a0ca180 2024-05-10T03:43:42.049 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.037+0000 7efc170a0b80 10 client.0 _ll_register_callbacks cb 0x557a29f8fad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:43:42.049 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.038+0000 7efbfffff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557a2a0cb050 0x557a2a0d46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:42.049 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.038+0000 7efc04af8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a2a0ca180 0x557a2a0d4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:42.049 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.038+0000 7efc052f9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557a2a0cb9a0 0x557a2a0db620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:42.049 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.038+0000 7efbfffff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557a2a0cb050 0x557a2a0d46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.45:55824/0 (socket says 172.21.15.45:55824) 2024-05-10T03:43:42.050 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.038+0000 7efbfffff700 1 -- 172.21.15.45:0/1272225034 learned_addr learned my addr 172.21.15.45:0/1272225034 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:42.050 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.038+0000 7efc04af8700 1 -- 172.21.15.45:0/1272225034 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557a2a0cb050 msgr2=0x557a2a0d46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:42.050 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.038+0000 7efc04af8700 1 --2- 172.21.15.45:0/1272225034 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557a2a0cb050 0x557a2a0d46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.050 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.038+0000 7efc04af8700 1 -- 172.21.15.45:0/1272225034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557a2a0cb9a0 msgr2=0x557a2a0db620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:42.050 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.038+0000 7efc04af8700 1 --2- 172.21.15.45:0/1272225034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557a2a0cb9a0 0x557a2a0db620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.050 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.038+0000 7efc04af8700 1 -- 172.21.15.45:0/1272225034 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf4017070 con 0x557a2a0ca180 2024-05-10T03:43:42.051 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.038+0000 7efbfffff700 1 --2- 172.21.15.45:0/1272225034 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557a2a0cb050 0x557a2a0d46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:43:42.051 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.038+0000 7efc04af8700 1 --2- 172.21.15.45:0/1272225034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a2a0ca180 0x557a2a0d4180 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x557a2a0c9f20 tx=0x7efbf400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67d4927aca68b9a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:42.051 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.038+0000 7efbdffff700 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-05-10T03:43:42.051 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.038+0000 7efbdffff700 1 -- 172.21.15.45:0/1272225034 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf4005250 con 0x557a2a0ca180 2024-05-10T03:43:42.051 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.038+0000 7efc170a0b80 1 -- 172.21.15.45:0/1272225034 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a29f43210 con 0x557a2a0ca180 2024-05-10T03:43:42.051 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.038+0000 7efbdffff700 1 -- 172.21.15.45:0/1272225034 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7efbf40053b0 con 0x557a2a0ca180 2024-05-10T03:43:42.051 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.038+0000 7efbdffff700 1 -- 172.21.15.45:0/1272225034 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7efbf4005570 con 0x557a2a0ca180 2024-05-10T03:43:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.039+0000 7efc170a0b80 10 client.26497 fetch_fsmap learned FSMap version 39 2024-05-10T03:43:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.039+0000 7efc170a0b80 1 -- 172.21.15.45:0/1272225034 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x557a29e17b00 con 0x557a2a0ca180 2024-05-10T03:43:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.039+0000 7efbdffff700 1 -- 172.21.15.45:0/1272225034 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x557a29f43210 con 0x557a2a0ca180 2024-05-10T03:43:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.039+0000 7efbdffff700 1 -- 172.21.15.45:0/1272225034 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 39) v1 ==== 7534+0+0 (secure 0 0 0) 0x7efbf401c750 con 0x557a2a0ca180 2024-05-10T03:43:42.053 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.039+0000 7efc170a0b80 10 client.26497 fetch_fsmap finished waiting for FSMap version 39 2024-05-10T03:43:42.053 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.039+0000 7efc170a0b80 10 client.26497 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:43:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.039+0000 7efc170a0b80 20 client.26497 populate_metadata read hostname 'smithi045' 2024-05-10T03:43:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.039+0000 7efc170a0b80 1 --2- 172.21.15.45:0/1272225034 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x557a2a0dfe70 0x557a2a0e22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.039+0000 7efc170a0b80 4 client.26497 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:43:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.039+0000 7efc170a0b80 1 -- 172.21.15.45:0/1272225034 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a2a099720 con 0x557a2a0dfe70 2024-05-10T03:43:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.039+0000 7efbfffff700 1 --2- 172.21.15.45:0/1272225034 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x557a2a0dfe70 0x557a2a0e22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.040+0000 7efbfffff700 1 --2- 172.21.15.45:0/1272225034 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x557a2a0dfe70 0x557a2a0e22c0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f81e80a954c1cbf server_cookie=66a33ffb34f0e96 in_seq=0 out_seq=0 2024-05-10T03:43:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.040+0000 7efbdffff700 10 client.26497 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:43:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.040+0000 7efbdffff700 1 -- 172.21.15.45:0/1272225034 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557a2a099720 con 0x557a2a0dfe70 2024-05-10T03:43:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.040+0000 7efbdffff700 10 client.26497 handle_command_reply: tid=0 2024-05-10T03:43:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.040+0000 7efc170a0b80 1 client.26497 shutdown 2024-05-10T03:43:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.041+0000 7efc170a0b80 1 -- 172.21.15.45:0/1272225034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a2a0ca180 msgr2=0x557a2a0d4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.041+0000 7efc170a0b80 1 --2- 172.21.15.45:0/1272225034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a2a0ca180 0x557a2a0d4180 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x557a2a0c9f20 tx=0x7efbf400ecd0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.041+0000 7efc170a0b80 1 -- 172.21.15.45:0/1272225034 shutdown_connections 2024-05-10T03:43:42.056 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.041+0000 7efc170a0b80 1 --2- 172.21.15.45:0/1272225034 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x557a2a0dfe70 0x557a2a0e22c0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.056 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.041+0000 7efc170a0b80 1 --2- 172.21.15.45:0/1272225034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a2a0ca180 0x557a2a0d4180 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.056 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.041+0000 7efc170a0b80 1 --2- 172.21.15.45:0/1272225034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557a2a0cb9a0 0x557a2a0db620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.056 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.041+0000 7efbdffff700 0 client.26497 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:43:42.056 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.041+0000 7efc170a0b80 1 --2- 172.21.15.45:0/1272225034 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557a2a0cb050 0x557a2a0d46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.056 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.041+0000 7efc170a0b80 1 -- 172.21.15.45:0/1272225034 >> 172.21.15.45:0/1272225034 conn(0x557a2a02ca00 msgr2=0x557a2a0c4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:42.057 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.041+0000 7efc170a0b80 1 -- 172.21.15.45:0/1272225034 shutdown_connections 2024-05-10T03:43:42.057 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.041+0000 7efc170a0b80 1 -- 172.21.15.45:0/1272225034 wait complete. 2024-05-10T03:43:42.057 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.041+0000 7efc170a0b80 20 client.26497 trim_cache size 0 max 16384 2024-05-10T03:43:42.069 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.057+0000 7efc170a0b80 1 Processor -- start 2024-05-10T03:43:42.070 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.057+0000 7efc170a0b80 1 -- start start 2024-05-10T03:43:42.070 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.057+0000 7efc170a0b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a2a0ca180 0x557a2a0d95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:42.070 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.057+0000 7efc170a0b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557a2a0cb050 0x557a2a0d9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:42.070 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.057+0000 7efc170a0b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557a2a0cb9a0 0x557a2a0d27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:42.070 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.057+0000 7efc170a0b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a2a0bf360 con 0x557a2a0cb9a0 2024-05-10T03:43:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.057+0000 7efc170a0b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a2a0d21b0 con 0x557a2a0cb050 2024-05-10T03:43:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.057+0000 7efc170a0b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a2a0cfa80 con 0x557a2a0ca180 2024-05-10T03:43:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.057+0000 7efc052f9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557a2a0cb9a0 0x557a2a0d27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.057+0000 7efc052f9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557a2a0cb9a0 0x557a2a0d27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44804/0 (socket says 172.21.15.45:44804) 2024-05-10T03:43:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.057+0000 7efc052f9700 1 -- 172.21.15.45:0/1926911136 learned_addr learned my addr 172.21.15.45:0/1926911136 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.057+0000 7efbfffff700 1 --2- 172.21.15.45:0/1926911136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557a2a0cb050 0x557a2a0d9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:42.071 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.057+0000 7efc04af8700 1 --2- 172.21.15.45:0/1926911136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a2a0ca180 0x557a2a0d95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:42.072 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.057+0000 7efc052f9700 1 -- 172.21.15.45:0/1926911136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a2a0ca180 msgr2=0x557a2a0d95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:42.072 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.057+0000 7efc052f9700 1 --2- 172.21.15.45:0/1926911136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a2a0ca180 0x557a2a0d95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.072 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.057+0000 7efc052f9700 1 -- 172.21.15.45:0/1926911136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557a2a0cb050 msgr2=0x557a2a0d9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:42.072 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.057+0000 7efc052f9700 1 --2- 172.21.15.45:0/1926911136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557a2a0cb050 0x557a2a0d9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.072 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.057+0000 7efc052f9700 1 -- 172.21.15.45:0/1926911136 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a29fb0500 con 0x557a2a0cb9a0 2024-05-10T03:43:42.073 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.057+0000 7efc052f9700 1 --2- 172.21.15.45:0/1926911136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557a2a0cb9a0 0x557a2a0d27e0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7efbf8098380 tx=0x7efbf80ce040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2768ab6673f7aada server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:42.073 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.058+0000 7efbeb7fe700 1 -- 172.21.15.45:0/1926911136 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf809dea0 con 0x557a2a0cb9a0 2024-05-10T03:43:42.073 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.058+0000 7efbeb7fe700 1 -- 172.21.15.45:0/1926911136 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efbf809be80 con 0x557a2a0cb9a0 2024-05-10T03:43:42.073 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.058+0000 7efbeb7fe700 1 -- 172.21.15.45:0/1926911136 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf809c0e0 con 0x557a2a0cb9a0 2024-05-10T03:43:42.073 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.058+0000 7efc170a0b80 1 -- 172.21.15.45:0/1926911136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557a2a0cb9a0 msgr2=0x557a2a0d27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:42.073 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.058+0000 7efc170a0b80 1 --2- 172.21.15.45:0/1926911136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557a2a0cb9a0 0x557a2a0d27e0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7efbf8098380 tx=0x7efbf80ce040 comp rx=0 tx=0).stop 2024-05-10T03:43:42.073 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.059+0000 7efc170a0b80 1 -- 172.21.15.45:0/1926911136 shutdown_connections 2024-05-10T03:43:42.073 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.059+0000 7efc170a0b80 1 --2- 172.21.15.45:0/1926911136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a2a0ca180 0x557a2a0d95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.059+0000 7efc170a0b80 1 --2- 172.21.15.45:0/1926911136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557a2a0cb9a0 0x557a2a0d27e0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.059+0000 7efc170a0b80 1 --2- 172.21.15.45:0/1926911136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557a2a0cb050 0x557a2a0d9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.059+0000 7efc170a0b80 1 -- 172.21.15.45:0/1926911136 >> 172.21.15.45:0/1926911136 conn(0x557a2a02ca00 msgr2=0x557a2a0cee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.059+0000 7efc170a0b80 1 -- 172.21.15.45:0/1926911136 shutdown_connections 2024-05-10T03:43:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.059+0000 7efc170a0b80 1 -- 172.21.15.45:0/1926911136 wait complete. 2024-05-10T03:43:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.059+0000 7efc170a0b80 1 -- start start 2024-05-10T03:43:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.059+0000 7efc170a0b80 1 Processor -- start 2024-05-10T03:43:42.074 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.059+0000 7efc170a0b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a2a0ca180 0x557a2a0d8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.060+0000 7efc170a0b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557a2a0cb050 0x557a2a0d9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.060+0000 7efc170a0b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557a2a0cb9a0 0x557a2a138a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.060+0000 7efc170a0b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a2a138f80 con 0x557a2a0cb9a0 2024-05-10T03:43:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.060+0000 7efc170a0b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a2a1390c0 con 0x557a2a0cb050 2024-05-10T03:43:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.060+0000 7efc170a0b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a2a139280 con 0x557a2a0ca180 2024-05-10T03:43:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.060+0000 7efc170a0b80 10 client.0 _ll_register_callbacks cb 0x557a29f8fad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:43:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.060+0000 7efbfffff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557a2a0cb050 0x557a2a0d9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.060+0000 7efbfffff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557a2a0cb050 0x557a2a0d9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.45:55844/0 (socket says 172.21.15.45:55844) 2024-05-10T03:43:42.075 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.060+0000 7efbfffff700 1 -- 172.21.15.45:0/911387040 learned_addr learned my addr 172.21.15.45:0/911387040 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.060+0000 7efc04af8700 1 --2- 172.21.15.45:0/911387040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a2a0ca180 0x557a2a0d8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.060+0000 7efc052f9700 1 --2- 172.21.15.45:0/911387040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557a2a0cb9a0 0x557a2a138a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.060+0000 7efbfffff700 1 -- 172.21.15.45:0/911387040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a2a0ca180 msgr2=0x557a2a0d8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.060+0000 7efbfffff700 1 --2- 172.21.15.45:0/911387040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a2a0ca180 0x557a2a0d8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.060+0000 7efbfffff700 1 -- 172.21.15.45:0/911387040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557a2a0cb9a0 msgr2=0x557a2a138a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:43:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.060+0000 7efbfffff700 1 --2- 172.21.15.45:0/911387040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557a2a0cb9a0 0x557a2a138a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.076 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.060+0000 7efbfffff700 1 -- 172.21.15.45:0/911387040 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc00068b70 con 0x557a2a0cb050 2024-05-10T03:43:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.060+0000 7efbfffff700 1 --2- 172.21.15.45:0/911387040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557a2a0cb050 0x557a2a0d9460 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efbec009990 tx=0x7efbec005550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bd1da30ad50e5d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.060+0000 7efbdffff700 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-05-10T03:43:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.060+0000 7efbdffff700 1 -- 172.21.15.45:0/911387040 <== mon.2 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec0294d0 con 0x557a2a0cb050 2024-05-10T03:43:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.061+0000 7efc170a0b80 1 -- 172.21.15.45:0/911387040 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efbf4021070 con 0x557a2a0cb050 2024-05-10T03:43:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.061+0000 7efbdffff700 1 -- 172.21.15.45:0/911387040 <== mon.2 v2:172.21.15.106:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7efbec0056c0 con 0x557a2a0cb050 2024-05-10T03:43:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.061+0000 7efbdffff700 1 -- 172.21.15.45:0/911387040 <== mon.2 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7efbec029630 con 0x557a2a0cb050 2024-05-10T03:43:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.061+0000 7efc170a0b80 10 client.26438 fetch_fsmap learned FSMap version 39 2024-05-10T03:43:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.061+0000 7efc170a0b80 1 -- 172.21.15.45:0/911387040 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x557a29e6fc70 con 0x557a2a0cb050 2024-05-10T03:43:42.077 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.061+0000 7efbdffff700 1 -- 172.21.15.45:0/911387040 <== mon.2 v2:172.21.15.106:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efbf4021070 con 0x557a2a0cb050 2024-05-10T03:43:42.078 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.061+0000 7efbdffff700 1 -- 172.21.15.45:0/911387040 <== mon.2 v2:172.21.15.106:3300/0 5 ==== fsmap(e 39) v1 ==== 7534+0+0 (secure 0 0 0) 0x7efbec004500 con 0x557a2a0cb050 2024-05-10T03:43:42.078 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.061+0000 7efc170a0b80 10 client.26438 fetch_fsmap finished waiting for FSMap version 39 2024-05-10T03:43:42.078 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.061+0000 7efc170a0b80 10 client.26438 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T03:43:42.078 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.061+0000 7efc170a0b80 20 client.26438 populate_metadata read hostname 'smithi045' 2024-05-10T03:43:42.078 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.061+0000 7efc170a0b80 1 --2- 172.21.15.45:0/911387040 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x557a2a13ad90 0x557a2a13d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:42.078 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.061+0000 7efc170a0b80 4 client.26438 mds_command: new command op to 24590 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T03:43:42.078 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.061+0000 7efc170a0b80 1 -- 172.21.15.45:0/911387040 --> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557a29fe2e60 con 0x557a2a13ad90 2024-05-10T03:43:42.078 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.061+0000 7efc04af8700 1 --2- 172.21.15.45:0/911387040 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x557a2a13ad90 0x557a2a13d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:42.078 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.062+0000 7efbdffff700 10 client.26438 ms_handle_connect on v2:172.21.15.106:6838/3533867856 2024-05-10T03:43:42.078 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.062+0000 7efc04af8700 1 --2- 172.21.15.45:0/911387040 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x557a2a13ad90 0x557a2a13d1b0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88c0e698bdc50966 server_cookie=7bceef7c2e5fb6bb in_seq=0 out_seq=0 2024-05-10T03:43:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.103+0000 7efbdffff700 1 -- 172.21.15.45:0/911387040 <== mds.0 v2:172.21.15.106:6838/3533867856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557a29fe2e60 con 0x557a2a13ad90 2024-05-10T03:43:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.103+0000 7efbdffff700 10 client.26438 handle_command_reply: tid=0 2024-05-10T03:43:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.103+0000 7efc170a0b80 1 client.26438 shutdown 2024-05-10T03:43:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.103+0000 7efc170a0b80 1 -- 172.21.15.45:0/911387040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557a2a0cb050 msgr2=0x557a2a0d9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.103+0000 7efc170a0b80 1 --2- 172.21.15.45:0/911387040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557a2a0cb050 0x557a2a0d9460 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efbec009990 tx=0x7efbec005550 comp rx=0 tx=0).stop 2024-05-10T03:43:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.103+0000 7efc170a0b80 1 -- 172.21.15.45:0/911387040 shutdown_connections 2024-05-10T03:43:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.103+0000 7efc170a0b80 1 --2- 172.21.15.45:0/911387040 >> [v2:172.21.15.106:6838/3533867856,v1:172.21.15.106:6839/3533867856] conn(0x557a2a13ad90 0x557a2a13d1b0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.103+0000 7efc170a0b80 1 --2- 172.21.15.45:0/911387040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557a2a0ca180 0x557a2a0d8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.103+0000 7efc170a0b80 1 --2- 172.21.15.45:0/911387040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557a2a0cb9a0 0x557a2a138a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.103+0000 7efc170a0b80 1 --2- 172.21.15.45:0/911387040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557a2a0cb050 0x557a2a0d9460 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.103+0000 7efbdffff700 0 client.26438 ms_handle_reset on v2:172.21.15.106:6838/3533867856 2024-05-10T03:43:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.103+0000 7efc170a0b80 1 -- 172.21.15.45:0/911387040 >> 172.21.15.45:0/911387040 conn(0x557a2a02ca00 msgr2=0x557a2a0d2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.104+0000 7efc170a0b80 1 -- 172.21.15.45:0/911387040 shutdown_connections 2024-05-10T03:43:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.104+0000 7efc170a0b80 1 -- 172.21.15.45:0/911387040 wait complete. 2024-05-10T03:43:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.104+0000 7efc170a0b80 20 client.26438 trim_cache size 0 max 16384 2024-05-10T03:43:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:{ 2024-05-10T03:43:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "message": "", 2024-05-10T03:43:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout: "return_code": 0 2024-05-10T03:43:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stdout:} 2024-05-10T03:43:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.104+0000 7efc06d5c700 1 -- 172.21.15.45:0/2140273219 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efbf00a1120 msgr2=0x7efbf00a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.104+0000 7efc06d5c700 1 --2- 172.21.15.45:0/2140273219 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efbf00a1120 0x7efbf00a3630 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efc00101ae0 tx=0x7efbf4009260 comp rx=0 tx=0).stop 2024-05-10T03:43:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.104+0000 7efc06d5c700 1 -- 172.21.15.45:0/2140273219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc00102580 msgr2=0x7efc0019e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:42.112 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.104+0000 7efc06d5c700 1 --2- 172.21.15.45:0/2140273219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc00102580 0x7efc0019e490 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7efbf8007f40 tx=0x7efbf800f5c0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.112 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.104+0000 7efc06d5c700 1 -- 172.21.15.45:0/2140273219 shutdown_connections 2024-05-10T03:43:42.112 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.104+0000 7efc06d5c700 1 --2- 172.21.15.45:0/2140273219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc00100ac0 0x7efc00196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.112 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.104+0000 7efc06d5c700 1 --2- 172.21.15.45:0/2140273219 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efbf00a1120 0x7efbf00a3630 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.112 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.104+0000 7efc06d5c700 1 --2- 172.21.15.45:0/2140273219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc00102580 0x7efc0019e490 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.112 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.104+0000 7efc06d5c700 1 --2- 172.21.15.45:0/2140273219 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc00101be0 0x7efc00197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.104+0000 7efc06d5c700 1 -- 172.21.15.45:0/2140273219 >> 172.21.15.45:0/2140273219 conn(0x7efc000fc0f0 msgr2=0x7efc00104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.105+0000 7efc06d5c700 1 -- 172.21.15.45:0/2140273219 shutdown_connections 2024-05-10T03:43:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi045.front.sepia.ceph.com.smithi045.stderr:2024-05-10T03:43:42.105+0000 7efc06d5c700 1 -- 172.21.15.45:0/2140273219 wait complete. 2024-05-10T03:43:42.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:42 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:43:42.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:42 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:43:42.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:42 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:43:42.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:42 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:43:42.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:42 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:43:42.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:42 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:43:42.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:42 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T03:43:42.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:42 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T03:43:42.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:42 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' 2024-05-10T03:43:43.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:43 smithi106 ceph-mon[46996]: pgmap v388: 129 pgs: 129 active+clean; 105 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 393 op/s 2024-05-10T03:43:43.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:43 smithi106 ceph-mon[46996]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:43.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:43 smithi154 ceph-mon[46565]: pgmap v388: 129 pgs: 129 active+clean; 105 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 393 op/s 2024-05-10T03:43:43.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:43 smithi154 ceph-mon[46565]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:43.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:43 smithi045 ceph-mon[42520]: pgmap v388: 129 pgs: 129 active+clean; 105 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 393 op/s 2024-05-10T03:43:43.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:43 smithi045 ceph-mon[42520]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:44.276 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-05-10T03:43:44.276 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-10T03:43:44.742 DEBUG:teuthology.parallel:result is None 2024-05-10T03:43:44.742 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-10T03:43:44.779 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-10T03:43:44.780 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-05-10T03:43:44.790 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi045.front.sepia.ceph.com 2024-05-10T03:43:44.829 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-05-10T03:43:44.839 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-05-10T03:43:44.839 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_50174015a7e79f951b988949abe236791f52d4da/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_50174015a7e79f951b988949abe236791f52d4da/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-05-10T03:43:44.840 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-05-10T03:43:44.850 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:43:45.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.024+0000 7f020091f700 1 -- 172.21.15.45:0/2155950561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01fc102580 msgr2=0x7f01fc108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:45.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.024+0000 7f020091f700 1 --2- 172.21.15.45:0/2155950561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01fc102580 0x7f01fc108e30 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f01f400b0a0 tx=0x7f01f400b3b0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.024+0000 7f020091f700 1 -- 172.21.15.45:0/2155950561 shutdown_connections 2024-05-10T03:43:45.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.024+0000 7f020091f700 1 --2- 172.21.15.45:0/2155950561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01fc100ac0 0x7f01fc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.024+0000 7f020091f700 1 --2- 172.21.15.45:0/2155950561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01fc102580 0x7f01fc108e30 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.024+0000 7f020091f700 1 --2- 172.21.15.45:0/2155950561 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01fc101be0 0x7f01fc101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.024+0000 7f020091f700 1 -- 172.21.15.45:0/2155950561 >> 172.21.15.45:0/2155950561 conn(0x7f01fc0fc0d0 msgr2=0x7f01fc0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:45.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.024+0000 7f020091f700 1 -- 172.21.15.45:0/2155950561 shutdown_connections 2024-05-10T03:43:45.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.024+0000 7f020091f700 1 -- 172.21.15.45:0/2155950561 wait complete. 2024-05-10T03:43:45.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.025+0000 7f020091f700 1 Processor -- start 2024-05-10T03:43:45.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.026+0000 7f020091f700 1 -- start start 2024-05-10T03:43:45.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.026+0000 7f020091f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01fc100ac0 0x7f01fc068e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:45.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.026+0000 7f020091f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01fc101be0 0x7f01fc19cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:45.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.026+0000 7f020091f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01fc102580 0x7f01fc19f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:45.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.026+0000 7f020091f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01fc19fc90 con 0x7f01fc100ac0 2024-05-10T03:43:45.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.026+0000 7f020091f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01fc19fe00 con 0x7f01fc101be0 2024-05-10T03:43:45.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.026+0000 7f020091f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01fc19ffc0 con 0x7f01fc102580 2024-05-10T03:43:45.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.026+0000 7f01fa59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01fc100ac0 0x7f01fc068e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:45.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.026+0000 7f01fa59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01fc100ac0 0x7f01fc068e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44850/0 (socket says 172.21.15.45:44850) 2024-05-10T03:43:45.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.026+0000 7f01fa59c700 1 -- 172.21.15.45:0/4180909731 learned_addr learned my addr 172.21.15.45:0/4180909731 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:45.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.026+0000 7f01fad9d700 1 --2- 172.21.15.45:0/4180909731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01fc102580 0x7f01fc19f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:45.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.026+0000 7f01f1d9b700 1 --2- 172.21.15.45:0/4180909731 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01fc101be0 0x7f01fc19cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:45.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.026+0000 7f01fa59c700 1 -- 172.21.15.45:0/4180909731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01fc102580 msgr2=0x7f01fc19f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:45.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.026+0000 7f01fa59c700 1 --2- 172.21.15.45:0/4180909731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01fc102580 0x7f01fc19f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.026+0000 7f01fa59c700 1 -- 172.21.15.45:0/4180909731 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01fc101be0 msgr2=0x7f01fc19cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:45.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.026+0000 7f01fa59c700 1 --2- 172.21.15.45:0/4180909731 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01fc101be0 0x7f01fc19cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.026+0000 7f01fa59c700 1 -- 172.21.15.45:0/4180909731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f4009d00 con 0x7f01fc100ac0 2024-05-10T03:43:45.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.027+0000 7f01fa59c700 1 --2- 172.21.15.45:0/4180909731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01fc100ac0 0x7f01fc068e50 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00d950 tx=0x7f01ec00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:45.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.027+0000 7f01f3fff700 1 -- 172.21.15.45:0/4180909731 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec004220 con 0x7f01fc100ac0 2024-05-10T03:43:45.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.027+0000 7f01f3fff700 1 -- 172.21.15.45:0/4180909731 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f01ec004380 con 0x7f01fc100ac0 2024-05-10T03:43:45.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.027+0000 7f020091f700 1 -- 172.21.15.45:0/4180909731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01fc1a0240 con 0x7f01fc100ac0 2024-05-10T03:43:45.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.027+0000 7f01f3fff700 1 -- 172.21.15.45:0/4180909731 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec003c50 con 0x7f01fc100ac0 2024-05-10T03:43:45.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.027+0000 7f020091f700 1 -- 172.21.15.45:0/4180909731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01fc1a0750 con 0x7f01fc100ac0 2024-05-10T03:43:45.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.028+0000 7f020091f700 1 -- 172.21.15.45:0/4180909731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01fc107cd0 con 0x7f01fc100ac0 2024-05-10T03:43:45.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.029+0000 7f01f3fff700 1 -- 172.21.15.45:0/4180909731 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f01ec00f690 con 0x7f01fc100ac0 2024-05-10T03:43:45.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.030+0000 7f01f3fff700 1 --2- 172.21.15.45:0/4180909731 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f01e80a1120 0x7f01e80a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:45.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.030+0000 7f01f3fff700 1 -- 172.21.15.45:0/4180909731 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f01ec0cc720 con 0x7f01fc100ac0 2024-05-10T03:43:45.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.030+0000 7f01f1d9b700 1 --2- 172.21.15.45:0/4180909731 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f01e80a1120 0x7f01e80a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:45.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.031+0000 7f01f1d9b700 1 --2- 172.21.15.45:0/4180909731 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f01e80a1120 0x7f01e80a3630 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0687f0 tx=0x7f01e4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:45.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.035+0000 7f01f3fff700 1 -- 172.21.15.45:0/4180909731 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f01ec095b10 con 0x7f01fc100ac0 2024-05-10T03:43:45.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.258+0000 7f020091f700 1 -- 172.21.15.45:0/4180909731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01fc069470 con 0x7f01fc100ac0 2024-05-10T03:43:45.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.260+0000 7f01f3fff700 1 -- 172.21.15.45:0/4180909731 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24743 (secure 0 0 0) 0x7f01fc069470 con 0x7f01fc100ac0 2024-05-10T03:43:45.264 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:43:45.264 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":90,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:40:27.092808+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:38:34.871801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:38:35.935386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T03:38:39.029903+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":5,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:43:45.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.262+0000 7f020091f700 1 -- 172.21.15.45:0/4180909731 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f01e80a1120 msgr2=0x7f01e80a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:45.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.262+0000 7f020091f700 1 --2- 172.21.15.45:0/4180909731 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f01e80a1120 0x7f01e80a3630 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0687f0 tx=0x7f01e4009260 comp rx=0 tx=0).stop 2024-05-10T03:43:45.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.262+0000 7f020091f700 1 -- 172.21.15.45:0/4180909731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01fc100ac0 msgr2=0x7f01fc068e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:45.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.262+0000 7f020091f700 1 --2- 172.21.15.45:0/4180909731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01fc100ac0 0x7f01fc068e50 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00d950 tx=0x7f01ec00dc60 comp rx=0 tx=0).stop 2024-05-10T03:43:45.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.262+0000 7f020091f700 1 -- 172.21.15.45:0/4180909731 shutdown_connections 2024-05-10T03:43:45.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.262+0000 7f020091f700 1 --2- 172.21.15.45:0/4180909731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01fc102580 0x7f01fc19f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.263+0000 7f020091f700 1 --2- 172.21.15.45:0/4180909731 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f01e80a1120 0x7f01e80a3630 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.263+0000 7f020091f700 1 --2- 172.21.15.45:0/4180909731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01fc100ac0 0x7f01fc068e50 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.263+0000 7f020091f700 1 --2- 172.21.15.45:0/4180909731 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01fc101be0 0x7f01fc19cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.263+0000 7f020091f700 1 -- 172.21.15.45:0/4180909731 >> 172.21.15.45:0/4180909731 conn(0x7f01fc0fc0d0 msgr2=0x7f01fc104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:45.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.263+0000 7f020091f700 1 -- 172.21.15.45:0/4180909731 shutdown_connections 2024-05-10T03:43:45.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.263+0000 7f020091f700 1 -- 172.21.15.45:0/4180909731 wait complete. 2024-05-10T03:43:45.281 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T03:35:20.339400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T03:38:34.871801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T03:38:35.935386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-10T03:38:39.029903+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-10T03:43:45.282 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T03:43:45.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:45 smithi106 ceph-mon[46996]: pgmap v389: 129 pgs: 129 active+clean; 103 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 350 op/s 2024-05-10T03:43:45.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:45 smithi106 ceph-mon[46996]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:45.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.431+0000 7f354d79a700 1 -- 172.21.15.45:0/880428521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3548109ac0 msgr2=0x7f354810bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:45.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.431+0000 7f354d79a700 1 --2- 172.21.15.45:0/880428521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3548109ac0 0x7f354810bfb0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f354000b0a0 tx=0x7f354000b3b0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.432+0000 7f354d79a700 1 -- 172.21.15.45:0/880428521 shutdown_connections 2024-05-10T03:43:45.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.432+0000 7f354d79a700 1 --2- 172.21.15.45:0/880428521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3548074110 0x7f3548106b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.432+0000 7f354d79a700 1 --2- 172.21.15.45:0/880428521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3548109ac0 0x7f354810bfb0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.432+0000 7f354d79a700 1 --2- 172.21.15.45:0/880428521 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3548107080 0x7f35481094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.432+0000 7f354d79a700 1 -- 172.21.15.45:0/880428521 >> 172.21.15.45:0/880428521 conn(0x7f35480fc110 msgr2=0x7f35480fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:45.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.432+0000 7f354d79a700 1 -- 172.21.15.45:0/880428521 shutdown_connections 2024-05-10T03:43:45.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.432+0000 7f354d79a700 1 -- 172.21.15.45:0/880428521 wait complete. 2024-05-10T03:43:45.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.433+0000 7f354d79a700 1 Processor -- start 2024-05-10T03:43:45.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.433+0000 7f354d79a700 1 -- start start 2024-05-10T03:43:45.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.433+0000 7f354d79a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3548074110 0x7f354819a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:45.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.433+0000 7f354d79a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3548107080 0x7f354819a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:45.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.433+0000 7f354d79a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3548109ac0 0x7f35481a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:45.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.433+0000 7f354d79a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35481a1df0 con 0x7f3548109ac0 2024-05-10T03:43:45.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.433+0000 7f354d79a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35481a1f60 con 0x7f3548107080 2024-05-10T03:43:45.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.433+0000 7f354d79a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35481a2120 con 0x7f3548074110 2024-05-10T03:43:45.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.433+0000 7f35477fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3548109ac0 0x7f35481a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:45.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.434+0000 7f35467fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3548107080 0x7f354819a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:45.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.434+0000 7f35477fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3548109ac0 0x7f35481a17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44880/0 (socket says 172.21.15.45:44880) 2024-05-10T03:43:45.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.434+0000 7f35477fe700 1 -- 172.21.15.45:0/306405877 learned_addr learned my addr 172.21.15.45:0/306405877 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:45.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.434+0000 7f3546ffd700 1 --2- 172.21.15.45:0/306405877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3548074110 0x7f354819a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:45.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.434+0000 7f35477fe700 1 -- 172.21.15.45:0/306405877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3548074110 msgr2=0x7f354819a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:45.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.434+0000 7f35477fe700 1 --2- 172.21.15.45:0/306405877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3548074110 0x7f354819a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.434+0000 7f35477fe700 1 -- 172.21.15.45:0/306405877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3548107080 msgr2=0x7f354819a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:45.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.434+0000 7f35477fe700 1 --2- 172.21.15.45:0/306405877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3548107080 0x7f354819a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.434+0000 7f35477fe700 1 -- 172.21.15.45:0/306405877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3540009d00 con 0x7f3548109ac0 2024-05-10T03:43:45.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.434+0000 7f35467fc700 1 --2- 172.21.15.45:0/306405877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3548107080 0x7f354819a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:43:45.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.434+0000 7f35477fe700 1 --2- 172.21.15.45:0/306405877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3548109ac0 0x7f35481a17e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f354000b070 tx=0x7f354000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:45.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.434+0000 7f352ffff700 1 -- 172.21.15.45:0/306405877 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354000e040 con 0x7f3548109ac0 2024-05-10T03:43:45.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.434+0000 7f354d79a700 1 -- 172.21.15.45:0/306405877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35481a23a0 con 0x7f3548109ac0 2024-05-10T03:43:45.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.434+0000 7f352ffff700 1 -- 172.21.15.45:0/306405877 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3540004d60 con 0x7f3548109ac0 2024-05-10T03:43:45.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.434+0000 7f354d79a700 1 -- 172.21.15.45:0/306405877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35481a2870 con 0x7f3548109ac0 2024-05-10T03:43:45.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.434+0000 7f352ffff700 1 -- 172.21.15.45:0/306405877 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3540004400 con 0x7f3548109ac0 2024-05-10T03:43:45.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.436+0000 7f354d79a700 1 -- 172.21.15.45:0/306405877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35480fdcc0 con 0x7f3548109ac0 2024-05-10T03:43:45.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.437+0000 7f352ffff700 1 -- 172.21.15.45:0/306405877 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3540004560 con 0x7f3548109ac0 2024-05-10T03:43:45.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.438+0000 7f352ffff700 1 --2- 172.21.15.45:0/306405877 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f35300a11c0 0x7f35300a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:45.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.438+0000 7f352ffff700 1 -- 172.21.15.45:0/306405877 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f35400cdc30 con 0x7f3548109ac0 2024-05-10T03:43:45.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.438+0000 7f3546ffd700 1 --2- 172.21.15.45:0/306405877 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f35300a11c0 0x7f35300a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:45.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.439+0000 7f3546ffd700 1 --2- 172.21.15.45:0/306405877 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f35300a11c0 0x7f35300a36d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3548074520 tx=0x7f3538009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:45.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.446+0000 7f352ffff700 1 -- 172.21.15.45:0/306405877 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f35400970b0 con 0x7f3548109ac0 2024-05-10T03:43:45.473 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:45 smithi154 ceph-mon[46565]: pgmap v389: 129 pgs: 129 active+clean; 103 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 350 op/s 2024-05-10T03:43:45.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:45 smithi154 ceph-mon[46565]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:45.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:45 smithi045 ceph-mon[42520]: pgmap v389: 129 pgs: 129 active+clean; 103 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 350 op/s 2024-05-10T03:43:45.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:45 smithi045 ceph-mon[42520]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T03:43:45.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.666+0000 7f354d79a700 1 -- 172.21.15.45:0/306405877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3548068730 con 0x7f3548109ac0 2024-05-10T03:43:45.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.667+0000 7f352ffff700 1 -- 172.21.15.45:0/306405877 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f354009a6d0 con 0x7f3548109ac0 2024-05-10T03:43:45.671 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-05-10T03:43:45.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.669+0000 7f354d79a700 1 -- 172.21.15.45:0/306405877 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f35300a11c0 msgr2=0x7f35300a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:45.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.669+0000 7f354d79a700 1 --2- 172.21.15.45:0/306405877 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f35300a11c0 0x7f35300a36d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3548074520 tx=0x7f3538009260 comp rx=0 tx=0).stop 2024-05-10T03:43:45.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.669+0000 7f354d79a700 1 -- 172.21.15.45:0/306405877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3548109ac0 msgr2=0x7f35481a17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:45.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.669+0000 7f354d79a700 1 --2- 172.21.15.45:0/306405877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3548109ac0 0x7f35481a17e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f354000b070 tx=0x7f354000bea0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.669+0000 7f354d79a700 1 -- 172.21.15.45:0/306405877 shutdown_connections 2024-05-10T03:43:45.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.669+0000 7f354d79a700 1 --2- 172.21.15.45:0/306405877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3548074110 0x7f354819a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.669+0000 7f354d79a700 1 --2- 172.21.15.45:0/306405877 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f35300a11c0 0x7f35300a36d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.669+0000 7f354d79a700 1 --2- 172.21.15.45:0/306405877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3548109ac0 0x7f35481a17e0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.669+0000 7f354d79a700 1 --2- 172.21.15.45:0/306405877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3548107080 0x7f354819a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.669+0000 7f354d79a700 1 -- 172.21.15.45:0/306405877 >> 172.21.15.45:0/306405877 conn(0x7f35480fc110 msgr2=0x7f3548107ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:45.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.670+0000 7f354d79a700 1 -- 172.21.15.45:0/306405877 shutdown_connections 2024-05-10T03:43:45.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.670+0000 7f354d79a700 1 -- 172.21.15.45:0/306405877 wait complete. 2024-05-10T03:43:45.688 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T03:43:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.837+0000 7fee094f5700 1 -- 172.21.15.45:0/82853464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee040ffbe0 msgr2=0x7fee040ffff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.837+0000 7fee094f5700 1 --2- 172.21.15.45:0/82853464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee040ffbe0 0x7fee040ffff0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fedec009990 tx=0x7fedec009ca0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.837+0000 7fee094f5700 1 -- 172.21.15.45:0/82853464 shutdown_connections 2024-05-10T03:43:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.837+0000 7fee094f5700 1 --2- 172.21.15.45:0/82853464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee041031a0 0x7fee041035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.837+0000 7fee094f5700 1 --2- 172.21.15.45:0/82853464 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee04100530 0x7fee0410a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.837+0000 7fee094f5700 1 --2- 172.21.15.45:0/82853464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee040ffbe0 0x7fee040ffff0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.837+0000 7fee094f5700 1 -- 172.21.15.45:0/82853464 >> 172.21.15.45:0/82853464 conn(0x7fee040fb8b0 msgr2=0x7fee040fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.837+0000 7fee094f5700 1 -- 172.21.15.45:0/82853464 shutdown_connections 2024-05-10T03:43:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.837+0000 7fee094f5700 1 -- 172.21.15.45:0/82853464 wait complete. 2024-05-10T03:43:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.838+0000 7fee094f5700 1 Processor -- start 2024-05-10T03:43:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.838+0000 7fee094f5700 1 -- start start 2024-05-10T03:43:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.838+0000 7fee094f5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee040ffbe0 0x7fee04198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.838+0000 7fee094f5700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee04100530 0x7fee04198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.838+0000 7fee094f5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee041031a0 0x7fee0419f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.838+0000 7fee094f5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0419fb20 con 0x7fee040ffbe0 2024-05-10T03:43:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.838+0000 7fee094f5700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0419fc90 con 0x7fee04100530 2024-05-10T03:43:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.838+0000 7fee094f5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0419fe50 con 0x7fee041031a0 2024-05-10T03:43:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.839+0000 7fee02ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee040ffbe0 0x7fee04198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.839+0000 7fee02ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee040ffbe0 0x7fee04198040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44894/0 (socket says 172.21.15.45:44894) 2024-05-10T03:43:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.839+0000 7fee02ffd700 1 -- 172.21.15.45:0/3827288471 learned_addr learned my addr 172.21.15.45:0/3827288471 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.839+0000 7fee027fc700 1 --2- 172.21.15.45:0/3827288471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee04100530 0x7fee04198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.839+0000 7fee037fe700 1 --2- 172.21.15.45:0/3827288471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee041031a0 0x7fee0419f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.839+0000 7fee02ffd700 1 -- 172.21.15.45:0/3827288471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee041031a0 msgr2=0x7fee0419f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.839+0000 7fee02ffd700 1 --2- 172.21.15.45:0/3827288471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee041031a0 0x7fee0419f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.839+0000 7fee02ffd700 1 -- 172.21.15.45:0/3827288471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee04100530 msgr2=0x7fee04198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.839+0000 7fee02ffd700 1 --2- 172.21.15.45:0/3827288471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee04100530 0x7fee04198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.839+0000 7fee02ffd700 1 -- 172.21.15.45:0/3827288471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec0095f0 con 0x7fee040ffbe0 2024-05-10T03:43:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.839+0000 7fee037fe700 1 --2- 172.21.15.45:0/3827288471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee041031a0 0x7fee0419f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:43:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.839+0000 7fee02ffd700 1 --2- 172.21.15.45:0/3827288471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee040ffbe0 0x7fee04198040 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fedf400d950 tx=0x7fedf400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.839+0000 7fedfbfff700 1 -- 172.21.15.45:0/3827288471 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf4004220 con 0x7fee040ffbe0 2024-05-10T03:43:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.839+0000 7fedfbfff700 1 -- 172.21.15.45:0/3827288471 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fedf4004380 con 0x7fee040ffbe0 2024-05-10T03:43:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.839+0000 7fee094f5700 1 -- 172.21.15.45:0/3827288471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee041a0130 con 0x7fee040ffbe0 2024-05-10T03:43:45.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.839+0000 7fedfbfff700 1 -- 172.21.15.45:0/3827288471 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf4003cb0 con 0x7fee040ffbe0 2024-05-10T03:43:45.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.839+0000 7fee094f5700 1 -- 172.21.15.45:0/3827288471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee041a0690 con 0x7fee040ffbe0 2024-05-10T03:43:45.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.841+0000 7fee094f5700 1 -- 172.21.15.45:0/3827288471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee04108ff0 con 0x7fee040ffbe0 2024-05-10T03:43:45.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.843+0000 7fedfbfff700 1 -- 172.21.15.45:0/3827288471 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fedf4009730 con 0x7fee040ffbe0 2024-05-10T03:43:45.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.843+0000 7fedfbfff700 1 --2- 172.21.15.45:0/3827288471 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fedf00a1240 0x7fedf00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:45.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.844+0000 7fee027fc700 1 --2- 172.21.15.45:0/3827288471 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fedf00a1240 0x7fedf00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:45.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.844+0000 7fedfbfff700 1 -- 172.21.15.45:0/3827288471 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fedf40ccee0 con 0x7fee040ffbe0 2024-05-10T03:43:45.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.844+0000 7fee027fc700 1 --2- 172.21.15.45:0/3827288471 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fedf00a1240 0x7fedf00a3750 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fee041990e0 tx=0x7fedec01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:45.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:45.847+0000 7fedfbfff700 1 -- 172.21.15.45:0/3827288471 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fedf40962f0 con 0x7fee040ffbe0 2024-05-10T03:43:46.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.067+0000 7fee094f5700 1 -- 172.21.15.45:0/3827288471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fee0410d590 con 0x7fee040ffbe0 2024-05-10T03:43:46.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.067+0000 7fedfbfff700 1 -- 172.21.15.45:0/3827288471 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7fedf4017020 con 0x7fee040ffbe0 2024-05-10T03:43:46.071 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-05-10T03:43:46.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.070+0000 7fee094f5700 1 -- 172.21.15.45:0/3827288471 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fedf00a1240 msgr2=0x7fedf00a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:46.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.070+0000 7fee094f5700 1 --2- 172.21.15.45:0/3827288471 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fedf00a1240 0x7fedf00a3750 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fee041990e0 tx=0x7fedec01a040 comp rx=0 tx=0).stop 2024-05-10T03:43:46.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.070+0000 7fee094f5700 1 -- 172.21.15.45:0/3827288471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee040ffbe0 msgr2=0x7fee04198040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:46.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.070+0000 7fee094f5700 1 --2- 172.21.15.45:0/3827288471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee040ffbe0 0x7fee04198040 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fedf400d950 tx=0x7fedf400dc60 comp rx=0 tx=0).stop 2024-05-10T03:43:46.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.070+0000 7fee094f5700 1 -- 172.21.15.45:0/3827288471 shutdown_connections 2024-05-10T03:43:46.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.070+0000 7fee094f5700 1 --2- 172.21.15.45:0/3827288471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee041031a0 0x7fee0419f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:46.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.070+0000 7fee094f5700 1 --2- 172.21.15.45:0/3827288471 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fedf00a1240 0x7fedf00a3750 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:46.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.070+0000 7fee094f5700 1 --2- 172.21.15.45:0/3827288471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee040ffbe0 0x7fee04198040 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:46.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.070+0000 7fee094f5700 1 --2- 172.21.15.45:0/3827288471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee04100530 0x7fee04198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:46.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.070+0000 7fee094f5700 1 -- 172.21.15.45:0/3827288471 >> 172.21.15.45:0/3827288471 conn(0x7fee040fb8b0 msgr2=0x7fee04106130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:46.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.070+0000 7fee094f5700 1 -- 172.21.15.45:0/3827288471 shutdown_connections 2024-05-10T03:43:46.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.070+0000 7fee094f5700 1 -- 172.21.15.45:0/3827288471 wait complete. 2024-05-10T03:43:46.088 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T03:43:46.242 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.238+0000 7efd96825700 1 -- 172.21.15.45:0/1521271971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd90102580 msgr2=0x7efd90108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:46.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.238+0000 7efd96825700 1 --2- 172.21.15.45:0/1521271971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd90102580 0x7efd90108e30 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7efd8800b0a0 tx=0x7efd8800b3b0 comp rx=0 tx=0).stop 2024-05-10T03:43:46.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.238+0000 7efd96825700 1 -- 172.21.15.45:0/1521271971 shutdown_connections 2024-05-10T03:43:46.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.238+0000 7efd96825700 1 --2- 172.21.15.45:0/1521271971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd90100ac0 0x7efd90100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:46.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.238+0000 7efd96825700 1 --2- 172.21.15.45:0/1521271971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd90102580 0x7efd90108e30 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:46.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.238+0000 7efd96825700 1 --2- 172.21.15.45:0/1521271971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd90101be0 0x7efd90101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:46.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.238+0000 7efd96825700 1 -- 172.21.15.45:0/1521271971 >> 172.21.15.45:0/1521271971 conn(0x7efd900fc0d0 msgr2=0x7efd900fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:46.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.238+0000 7efd96825700 1 -- 172.21.15.45:0/1521271971 shutdown_connections 2024-05-10T03:43:46.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.238+0000 7efd96825700 1 -- 172.21.15.45:0/1521271971 wait complete. 2024-05-10T03:43:46.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.239+0000 7efd96825700 1 Processor -- start 2024-05-10T03:43:46.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.239+0000 7efd96825700 1 -- start start 2024-05-10T03:43:46.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.240+0000 7efd96825700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd90100ac0 0x7efd90196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:46.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.240+0000 7efd96825700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd90101be0 0x7efd90197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:46.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.240+0000 7efd96825700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd90102580 0x7efd9019e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:46.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.240+0000 7efd96825700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9019eaa0 con 0x7efd90102580 2024-05-10T03:43:46.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.240+0000 7efd96825700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9019ec10 con 0x7efd90100ac0 2024-05-10T03:43:46.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.240+0000 7efd96825700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9019edd0 con 0x7efd90101be0 2024-05-10T03:43:46.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.240+0000 7efd94dc2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd90102580 0x7efd9019e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:46.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.240+0000 7efd94dc2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd90102580 0x7efd9019e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44916/0 (socket says 172.21.15.45:44916) 2024-05-10T03:43:46.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.240+0000 7efd94dc2700 1 -- 172.21.15.45:0/2657886882 learned_addr learned my addr 172.21.15.45:0/2657886882 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:46.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.240+0000 7efd8ffff700 1 --2- 172.21.15.45:0/2657886882 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd90100ac0 0x7efd90196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:46.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.240+0000 7efd8f7fe700 1 --2- 172.21.15.45:0/2657886882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd90101be0 0x7efd90197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:46.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.240+0000 7efd94dc2700 1 -- 172.21.15.45:0/2657886882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd90101be0 msgr2=0x7efd90197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:46.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.240+0000 7efd94dc2700 1 --2- 172.21.15.45:0/2657886882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd90101be0 0x7efd90197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:46.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.240+0000 7efd94dc2700 1 -- 172.21.15.45:0/2657886882 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd90100ac0 msgr2=0x7efd90196fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:46.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.240+0000 7efd94dc2700 1 --2- 172.21.15.45:0/2657886882 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd90100ac0 0x7efd90196fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:46.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.240+0000 7efd94dc2700 1 -- 172.21.15.45:0/2657886882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd88009d00 con 0x7efd90102580 2024-05-10T03:43:46.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.241+0000 7efd8ffff700 1 --2- 172.21.15.45:0/2657886882 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd90100ac0 0x7efd90196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:43:46.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.241+0000 7efd94dc2700 1 --2- 172.21.15.45:0/2657886882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd90102580 0x7efd9019e490 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7efd8800b070 tx=0x7efd88009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:46.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.241+0000 7efd8d7fa700 1 -- 172.21.15.45:0/2657886882 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8800e040 con 0x7efd90102580 2024-05-10T03:43:46.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.241+0000 7efd96825700 1 -- 172.21.15.45:0/2657886882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd9019f050 con 0x7efd90102580 2024-05-10T03:43:46.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.241+0000 7efd8d7fa700 1 -- 172.21.15.45:0/2657886882 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efd88003c00 con 0x7efd90102580 2024-05-10T03:43:46.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.241+0000 7efd8d7fa700 1 -- 172.21.15.45:0/2657886882 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8801b6c0 con 0x7efd90102580 2024-05-10T03:43:46.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.241+0000 7efd96825700 1 -- 172.21.15.45:0/2657886882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd9019f4d0 con 0x7efd90102580 2024-05-10T03:43:46.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.242+0000 7efd96825700 1 -- 172.21.15.45:0/2657886882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd90107cd0 con 0x7efd90102580 2024-05-10T03:43:46.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.244+0000 7efd8d7fa700 1 -- 172.21.15.45:0/2657886882 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7efd8801d470 con 0x7efd90102580 2024-05-10T03:43:46.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.245+0000 7efd8d7fa700 1 --2- 172.21.15.45:0/2657886882 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efd780a11c0 0x7efd780a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:46.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.245+0000 7efd8d7fa700 1 -- 172.21.15.45:0/2657886882 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7efd880cdf50 con 0x7efd90102580 2024-05-10T03:43:46.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.245+0000 7efd8ffff700 1 --2- 172.21.15.45:0/2657886882 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efd780a11c0 0x7efd780a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:46.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.246+0000 7efd8ffff700 1 --2- 172.21.15.45:0/2657886882 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efd780a11c0 0x7efd780a36d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efd90101ae0 tx=0x7efd80009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:46.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.249+0000 7efd8d7fa700 1 -- 172.21.15.45:0/2657886882 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7efd88097370 con 0x7efd90102580 2024-05-10T03:43:46.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:46 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/4180909731' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:43:46.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:46 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/306405877' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:43:46.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:46 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3827288471' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:43:46.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.466+0000 7efd96825700 1 -- 172.21.15.45:0/2657886882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efd9010c410 con 0x7efd90102580 2024-05-10T03:43:46.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.466+0000 7efd8d7fa700 1 -- 172.21.15.45:0/2657886882 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7efd8809a990 con 0x7efd90102580 2024-05-10T03:43:46.470 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2024-05-10T03:43:46.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.469+0000 7efd96825700 1 -- 172.21.15.45:0/2657886882 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efd780a11c0 msgr2=0x7efd780a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:46.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.469+0000 7efd96825700 1 --2- 172.21.15.45:0/2657886882 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efd780a11c0 0x7efd780a36d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efd90101ae0 tx=0x7efd80009260 comp rx=0 tx=0).stop 2024-05-10T03:43:46.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.469+0000 7efd96825700 1 -- 172.21.15.45:0/2657886882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd90102580 msgr2=0x7efd9019e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:46.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.469+0000 7efd96825700 1 --2- 172.21.15.45:0/2657886882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd90102580 0x7efd9019e490 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7efd8800b070 tx=0x7efd88009810 comp rx=0 tx=0).stop 2024-05-10T03:43:46.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.469+0000 7efd96825700 1 -- 172.21.15.45:0/2657886882 shutdown_connections 2024-05-10T03:43:46.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.469+0000 7efd96825700 1 --2- 172.21.15.45:0/2657886882 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7efd780a11c0 0x7efd780a36d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:46.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.469+0000 7efd96825700 1 --2- 172.21.15.45:0/2657886882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd90102580 0x7efd9019e490 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:46.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.469+0000 7efd96825700 1 --2- 172.21.15.45:0/2657886882 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd90100ac0 0x7efd90196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:46.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.469+0000 7efd96825700 1 --2- 172.21.15.45:0/2657886882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd90101be0 0x7efd90197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:46.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.469+0000 7efd96825700 1 -- 172.21.15.45:0/2657886882 >> 172.21.15.45:0/2657886882 conn(0x7efd900fc0d0 msgr2=0x7efd90104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:46.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.469+0000 7efd96825700 1 -- 172.21.15.45:0/2657886882 shutdown_connections 2024-05-10T03:43:46.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.469+0000 7efd96825700 1 -- 172.21.15.45:0/2657886882 wait complete. 2024-05-10T03:43:46.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:46 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/4180909731' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:43:46.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:46 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/306405877' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:43:46.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:46 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3827288471' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:43:46.486 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:46 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/4180909731' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:43:46.486 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:46 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/306405877' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:43:46.486 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:46 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3827288471' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:43:46.487 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-10T03:43:46.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.636+0000 7f5343a92700 1 -- 172.21.15.45:0/2346318841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f533c101bf0 msgr2=0x7f533c102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:46.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.636+0000 7f5343a92700 1 --2- 172.21.15.45:0/2346318841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f533c101bf0 0x7f533c102000 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f532c009990 tx=0x7f532c009ca0 comp rx=0 tx=0).stop 2024-05-10T03:43:46.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.636+0000 7f5343a92700 1 -- 172.21.15.45:0/2346318841 shutdown_connections 2024-05-10T03:43:46.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.636+0000 7f5343a92700 1 --2- 172.21.15.45:0/2346318841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f533c102590 0x7f533c108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:46.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.636+0000 7f5343a92700 1 --2- 172.21.15.45:0/2346318841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f533c100ad0 0x7f533c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:46.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.636+0000 7f5343a92700 1 --2- 172.21.15.45:0/2346318841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f533c101bf0 0x7f533c102000 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:46.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.636+0000 7f5343a92700 1 -- 172.21.15.45:0/2346318841 >> 172.21.15.45:0/2346318841 conn(0x7f533c0fc0c0 msgr2=0x7f533c0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:46.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.636+0000 7f5343a92700 1 -- 172.21.15.45:0/2346318841 shutdown_connections 2024-05-10T03:43:46.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.636+0000 7f5343a92700 1 -- 172.21.15.45:0/2346318841 wait complete. 2024-05-10T03:43:46.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.637+0000 7f5343a92700 1 Processor -- start 2024-05-10T03:43:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.637+0000 7f5343a92700 1 -- start start 2024-05-10T03:43:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.637+0000 7f5343a92700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f533c100ad0 0x7f533c198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.637+0000 7f5343a92700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f533c101bf0 0x7f533c198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.637+0000 7f5343a92700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f533c102590 0x7f533c19f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.637+0000 7f5343a92700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c19fae0 con 0x7f533c102590 2024-05-10T03:43:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.637+0000 7f5343a92700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c19fc50 con 0x7f533c101bf0 2024-05-10T03:43:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.637+0000 7f5343a92700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c19fe10 con 0x7f533c100ad0 2024-05-10T03:43:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.637+0000 7f534202f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f533c102590 0x7f533c19f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.637+0000 7f534202f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f533c102590 0x7f533c19f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44934/0 (socket says 172.21.15.45:44934) 2024-05-10T03:43:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.637+0000 7f534202f700 1 -- 172.21.15.45:0/3348498189 learned_addr learned my addr 172.21.15.45:0/3348498189 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.637+0000 7f534102d700 1 --2- 172.21.15.45:0/3348498189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f533c101bf0 0x7f533c198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.638+0000 7f534182e700 1 --2- 172.21.15.45:0/3348498189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f533c100ad0 0x7f533c198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.638+0000 7f534202f700 1 -- 172.21.15.45:0/3348498189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f533c100ad0 msgr2=0x7f533c198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.638+0000 7f534202f700 1 --2- 172.21.15.45:0/3348498189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f533c100ad0 0x7f533c198000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.638+0000 7f534202f700 1 -- 172.21.15.45:0/3348498189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f533c101bf0 msgr2=0x7f533c198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.638+0000 7f534202f700 1 --2- 172.21.15.45:0/3348498189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f533c101bf0 0x7f533c198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.638+0000 7f534202f700 1 -- 172.21.15.45:0/3348498189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532c0095f0 con 0x7f533c102590 2024-05-10T03:43:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.638+0000 7f534202f700 1 --2- 172.21.15.45:0/3348498189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f533c102590 0x7f533c19f4d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f5334007ee0 tx=0x7f533400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.638+0000 7f5332ffd700 1 -- 172.21.15.45:0/3348498189 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533400dd20 con 0x7f533c102590 2024-05-10T03:43:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.638+0000 7f5332ffd700 1 -- 172.21.15.45:0/3348498189 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f533400f040 con 0x7f533c102590 2024-05-10T03:43:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.638+0000 7f5343a92700 1 -- 172.21.15.45:0/3348498189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f533c1a00f0 con 0x7f533c102590 2024-05-10T03:43:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.638+0000 7f5332ffd700 1 -- 172.21.15.45:0/3348498189 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5334015400 con 0x7f533c102590 2024-05-10T03:43:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.638+0000 7f5343a92700 1 -- 172.21.15.45:0/3348498189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f533c1a05b0 con 0x7f533c102590 2024-05-10T03:43:46.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.639+0000 7f5343a92700 1 -- 172.21.15.45:0/3348498189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f533c0678b0 con 0x7f533c102590 2024-05-10T03:43:46.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.641+0000 7f5332ffd700 1 -- 172.21.15.45:0/3348498189 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5334003a00 con 0x7f533c102590 2024-05-10T03:43:46.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.641+0000 7f5332ffd700 1 --2- 172.21.15.45:0/3348498189 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f53280a11c0 0x7f53280a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:46.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.641+0000 7f5332ffd700 1 -- 172.21.15.45:0/3348498189 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f53340ccc30 con 0x7f533c102590 2024-05-10T03:43:46.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.641+0000 7f534182e700 1 --2- 172.21.15.45:0/3348498189 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f53280a11c0 0x7f53280a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:46.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.642+0000 7f534182e700 1 --2- 172.21.15.45:0/3348498189 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f53280a11c0 0x7f53280a36d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f533c101af0 tx=0x7f533800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:46.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.645+0000 7f5332ffd700 1 -- 172.21.15.45:0/3348498189 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5334096020 con 0x7f533c102590 2024-05-10T03:43:46.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.864+0000 7f5343a92700 1 -- 172.21.15.45:0/3348498189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f533c1a08d0 con 0x7f533c102590 2024-05-10T03:43:46.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.865+0000 7f5332ffd700 1 -- 172.21.15.45:0/3348498189 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) v1 ==== 103+0+11 (secure 0 0 0) 0x7f53340230a0 con 0x7f533c102590 2024-05-10T03:43:46.868 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-05-10T03:43:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.867+0000 7f5343a92700 1 -- 172.21.15.45:0/3348498189 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f53280a11c0 msgr2=0x7f53280a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.867+0000 7f5343a92700 1 --2- 172.21.15.45:0/3348498189 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f53280a11c0 0x7f53280a36d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f533c101af0 tx=0x7f533800b410 comp rx=0 tx=0).stop 2024-05-10T03:43:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.867+0000 7f5343a92700 1 -- 172.21.15.45:0/3348498189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f533c102590 msgr2=0x7f533c19f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.867+0000 7f5343a92700 1 --2- 172.21.15.45:0/3348498189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f533c102590 0x7f533c19f4d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f5334007ee0 tx=0x7f533400d3b0 comp rx=0 tx=0).stop 2024-05-10T03:43:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.867+0000 7f5343a92700 1 -- 172.21.15.45:0/3348498189 shutdown_connections 2024-05-10T03:43:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.867+0000 7f5343a92700 1 --2- 172.21.15.45:0/3348498189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f533c100ad0 0x7f533c198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.867+0000 7f5343a92700 1 --2- 172.21.15.45:0/3348498189 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f53280a11c0 0x7f53280a36d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.867+0000 7f5343a92700 1 --2- 172.21.15.45:0/3348498189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f533c102590 0x7f533c19f4d0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.867+0000 7f5343a92700 1 --2- 172.21.15.45:0/3348498189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f533c101bf0 0x7f533c198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.867+0000 7f5343a92700 1 -- 172.21.15.45:0/3348498189 >> 172.21.15.45:0/3348498189 conn(0x7f533c0fc0c0 msgr2=0x7f533c0fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.867+0000 7f5343a92700 1 -- 172.21.15.45:0/3348498189 shutdown_connections 2024-05-10T03:43:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:46.867+0000 7f5343a92700 1 -- 172.21.15.45:0/3348498189 wait complete. 2024-05-10T03:43:46.885 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-05-10T03:43:47.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.031+0000 7f0b3c515700 1 -- 172.21.15.45:0/2912161231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b341078a0 msgr2=0x7f0b34109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:47.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.031+0000 7f0b3c515700 1 --2- 172.21.15.45:0/2912161231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b341078a0 0x7f0b34109db0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c00b0a0 tx=0x7f0b2c00b3b0 comp rx=0 tx=0).stop 2024-05-10T03:43:47.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.032+0000 7f0b3c515700 1 -- 172.21.15.45:0/2912161231 shutdown_connections 2024-05-10T03:43:47.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.032+0000 7f0b3c515700 1 --2- 172.21.15.45:0/2912161231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b341078a0 0x7f0b34109db0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:47.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.032+0000 7f0b3c515700 1 --2- 172.21.15.45:0/2912161231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b3406a750 0x7f0b341047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:47.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.032+0000 7f0b3c515700 1 --2- 172.21.15.45:0/2912161231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b34104d70 0x7f0b34107210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:47.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.032+0000 7f0b3c515700 1 -- 172.21.15.45:0/2912161231 >> 172.21.15.45:0/2912161231 conn(0x7f0b340fc0f0 msgr2=0x7f0b340fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:47.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.032+0000 7f0b3c515700 1 -- 172.21.15.45:0/2912161231 shutdown_connections 2024-05-10T03:43:47.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.032+0000 7f0b3c515700 1 -- 172.21.15.45:0/2912161231 wait complete. 2024-05-10T03:43:47.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.032+0000 7f0b3c515700 1 Processor -- start 2024-05-10T03:43:47.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.033+0000 7f0b3c515700 1 -- start start 2024-05-10T03:43:47.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.033+0000 7f0b3c515700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b3406a750 0x7f0b341982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:47.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.033+0000 7f0b3c515700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b34104d70 0x7f0b341987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:47.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.033+0000 7f0b3c515700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b341078a0 0x7f0b3419f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:47.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.033+0000 7f0b3c515700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3419fd80 con 0x7f0b3406a750 2024-05-10T03:43:47.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.033+0000 7f0b3c515700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3419fef0 con 0x7f0b341078a0 2024-05-10T03:43:47.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.033+0000 7f0b3c515700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b341a00b0 con 0x7f0b34104d70 2024-05-10T03:43:47.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.033+0000 7f0b3a2b1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b3406a750 0x7f0b341982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:47.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.033+0000 7f0b3a2b1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b3406a750 0x7f0b341982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44948/0 (socket says 172.21.15.45:44948) 2024-05-10T03:43:47.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.033+0000 7f0b3a2b1700 1 -- 172.21.15.45:0/2443381476 learned_addr learned my addr 172.21.15.45:0/2443381476 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:43:47.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.033+0000 7f0b39ab0700 1 --2- 172.21.15.45:0/2443381476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b34104d70 0x7f0b341987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:47.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.033+0000 7f0b3aab2700 1 --2- 172.21.15.45:0/2443381476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b341078a0 0x7f0b3419f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:47.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.033+0000 7f0b3a2b1700 1 -- 172.21.15.45:0/2443381476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b34104d70 msgr2=0x7f0b341987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:47.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.033+0000 7f0b3a2b1700 1 --2- 172.21.15.45:0/2443381476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b34104d70 0x7f0b341987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:47.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.033+0000 7f0b3a2b1700 1 -- 172.21.15.45:0/2443381476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b341078a0 msgr2=0x7f0b3419f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:47.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.033+0000 7f0b3a2b1700 1 --2- 172.21.15.45:0/2443381476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b341078a0 0x7f0b3419f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:47.040 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.033+0000 7f0b3a2b1700 1 -- 172.21.15.45:0/2443381476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2c009d00 con 0x7f0b3406a750 2024-05-10T03:43:47.040 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.033+0000 7f0b39ab0700 1 --2- 172.21.15.45:0/2443381476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b34104d70 0x7f0b341987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:43:47.040 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.034+0000 7f0b3a2b1700 1 --2- 172.21.15.45:0/2443381476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b3406a750 0x7f0b341982a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000d980 tx=0x7f0b3000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:47.040 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.034+0000 7f0b2b7fe700 1 -- 172.21.15.45:0/2443381476 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b30009b40 con 0x7f0b3406a750 2024-05-10T03:43:47.040 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.034+0000 7f0b2b7fe700 1 -- 172.21.15.45:0/2443381476 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0b3000de60 con 0x7f0b3406a750 2024-05-10T03:43:47.040 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.034+0000 7f0b3c515700 1 -- 172.21.15.45:0/2443381476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b341a0390 con 0x7f0b3406a750 2024-05-10T03:43:47.040 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.034+0000 7f0b2b7fe700 1 -- 172.21.15.45:0/2443381476 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3000f6b0 con 0x7f0b3406a750 2024-05-10T03:43:47.040 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.034+0000 7f0b3c515700 1 -- 172.21.15.45:0/2443381476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b341a08a0 con 0x7f0b3406a750 2024-05-10T03:43:47.040 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.035+0000 7f0b3c515700 1 -- 172.21.15.45:0/2443381476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b340fdca0 con 0x7f0b3406a750 2024-05-10T03:43:47.041 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.036+0000 7f0b2b7fe700 1 -- 172.21.15.45:0/2443381476 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0b30009ca0 con 0x7f0b3406a750 2024-05-10T03:43:47.041 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.037+0000 7f0b2b7fe700 1 --2- 172.21.15.45:0/2443381476 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0b200a1120 0x7f0b200a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:43:47.041 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.038+0000 7f0b39ab0700 1 --2- 172.21.15.45:0/2443381476 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0b200a1120 0x7f0b200a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:43:47.041 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.038+0000 7f0b2b7fe700 1 -- 172.21.15.45:0/2443381476 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0b300cc850 con 0x7f0b3406a750 2024-05-10T03:43:47.041 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.038+0000 7f0b39ab0700 1 --2- 172.21.15.45:0/2443381476 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0b200a1120 0x7f0b200a3630 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0b24005950 tx=0x7f0b240058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:43:47.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.042+0000 7f0b2b7fe700 1 -- 172.21.15.45:0/2443381476 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0b30095c40 con 0x7f0b3406a750 2024-05-10T03:43:47.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.323+0000 7f0b3c515700 1 -- 172.21.15.45:0/2443381476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f0b34068730 con 0x7f0b3406a750 2024-05-10T03:43:47.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.332+0000 7f0b2b7fe700 1 -- 172.21.15.45:0/2443381476 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) v1 ==== 81+0+733406 (secure 0 0 0) 0x7f0b30020090 con 0x7f0b3406a750 2024-05-10T03:43:47.346 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:43:47.346 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:43:47.346 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 18, 2024-05-10T03:43:47.346 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.346 INFO:teuthology.orchestra.run.smithi045.stdout: "active_gid": 14152, 2024-05-10T03:43:47.346 INFO:teuthology.orchestra.run.smithi045.stdout: "active_name": "x", 2024-05-10T03:43:47.346 INFO:teuthology.orchestra.run.smithi045.stdout: "active_addrs": { 2024-05-10T03:43:47.346 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-05-10T03:43:47.346 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.346 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-05-10T03:43:47.347 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2024-05-10T03:43:47.347 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 596110596 2024-05-10T03:43:47.347 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.347 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.347 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-05-10T03:43:47.347 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2024-05-10T03:43:47.347 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 596110596 2024-05-10T03:43:47.347 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.347 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-05-10T03:43:47.347 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.347 INFO:teuthology.orchestra.run.smithi045.stdout: "active_addr": "172.21.15.45:6801/596110596", 2024-05-10T03:43:47.347 INFO:teuthology.orchestra.run.smithi045.stdout: "active_change": "2024-05-10T03:33:25.802159+0000", 2024-05-10T03:43:47.347 INFO:teuthology.orchestra.run.smithi045.stdout: "active_mgr_features": 4540138322906710015, 2024-05-10T03:43:47.347 INFO:teuthology.orchestra.run.smithi045.stdout: "available": true, 2024-05-10T03:43:47.347 INFO:teuthology.orchestra.run.smithi045.stdout: "standbys": [ 2024-05-10T03:43:47.348 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.348 INFO:teuthology.orchestra.run.smithi045.stdout: "gid": 24115, 2024-05-10T03:43:47.348 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "z", 2024-05-10T03:43:47.348 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_features": 4540138322906710015, 2024-05-10T03:43:47.348 INFO:teuthology.orchestra.run.smithi045.stdout: "available_modules": [ 2024-05-10T03:43:47.348 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.348 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "alerts", 2024-05-10T03:43:47.348 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.348 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.348 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.348 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-05-10T03:43:47.348 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-05-10T03:43:47.348 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.348 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.349 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.349 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-05-10T03:43:47.349 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.349 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.349 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.349 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "How frequently to reexamine health status", 2024-05-10T03:43:47.349 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.349 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.349 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.349 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.349 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.349 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.349 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.349 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.349 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.350 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.350 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.350 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.350 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.350 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.350 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.350 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.350 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.350 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.350 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.350 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.350 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.350 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.350 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.351 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.351 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.351 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.351 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.351 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.351 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.351 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.351 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.351 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.351 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.351 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.351 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.351 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.351 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.351 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.352 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.352 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.352 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.352 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.352 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.352 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.352 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.352 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.352 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.352 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.352 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.352 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.352 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.352 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.353 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.353 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.353 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.353 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.353 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.353 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.353 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.353 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.353 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.353 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.353 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.353 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.353 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.353 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.353 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.354 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.354 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.354 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.354 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.354 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.354 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.354 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.354 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_destination": { 2024-05-10T03:43:47.354 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_destination", 2024-05-10T03:43:47.354 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.354 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.354 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.354 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.354 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.355 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.355 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.355 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Email address to send alerts to", 2024-05-10T03:43:47.355 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.355 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.355 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.355 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.355 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_from_name": { 2024-05-10T03:43:47.355 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_from_name", 2024-05-10T03:43:47.355 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.355 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.355 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.355 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "Ceph", 2024-05-10T03:43:47.355 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.356 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.356 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.356 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Email From: name", 2024-05-10T03:43:47.356 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.356 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.356 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.356 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.356 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_host": { 2024-05-10T03:43:47.356 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_host", 2024-05-10T03:43:47.356 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.357 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.357 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.357 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.357 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.357 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.357 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.357 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "SMTP server", 2024-05-10T03:43:47.357 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.357 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.357 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.357 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.357 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_password": { 2024-05-10T03:43:47.357 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_password", 2024-05-10T03:43:47.357 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.357 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.358 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.358 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.358 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.358 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.358 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.358 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Password to authenticate with", 2024-05-10T03:43:47.358 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.358 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.358 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.358 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.358 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_port": { 2024-05-10T03:43:47.358 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_port", 2024-05-10T03:43:47.358 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.359 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.359 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.359 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "465", 2024-05-10T03:43:47.359 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.359 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.359 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.359 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "SMTP port", 2024-05-10T03:43:47.359 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.359 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.359 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.359 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.360 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_sender": { 2024-05-10T03:43:47.360 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_sender", 2024-05-10T03:43:47.360 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.360 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.360 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.360 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.360 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.360 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.360 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.360 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "SMTP envelope sender", 2024-05-10T03:43:47.360 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.360 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.360 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.361 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.361 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_ssl": { 2024-05-10T03:43:47.361 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_ssl", 2024-05-10T03:43:47.361 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.361 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.361 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.361 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.361 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.361 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.361 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.361 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-10T03:43:47.361 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.361 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.361 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.362 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.362 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_user": { 2024-05-10T03:43:47.362 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_user", 2024-05-10T03:43:47.362 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.362 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.362 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.362 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.362 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.362 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.362 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.362 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "User to authenticate as", 2024-05-10T03:43:47.362 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.362 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.362 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.363 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.363 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.363 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.363 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.363 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "balancer", 2024-05-10T03:43:47.363 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.363 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.363 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.363 INFO:teuthology.orchestra.run.smithi045.stdout: "active": { 2024-05-10T03:43:47.363 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "active", 2024-05-10T03:43:47.363 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.363 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.363 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.363 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.364 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.364 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.364 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.364 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "automatically balance PGs across cluster", 2024-05-10T03:43:47.364 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.364 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.364 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.364 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.364 INFO:teuthology.orchestra.run.smithi045.stdout: "begin_time": { 2024-05-10T03:43:47.364 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "begin_time", 2024-05-10T03:43:47.364 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.364 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.364 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.365 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0000", 2024-05-10T03:43:47.365 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.365 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.365 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.365 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "beginning time of day to automatically balance", 2024-05-10T03:43:47.365 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-10T03:43:47.365 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.365 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.365 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.365 INFO:teuthology.orchestra.run.smithi045.stdout: "begin_weekday": { 2024-05-10T03:43:47.365 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "begin_weekday", 2024-05-10T03:43:47.365 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-05-10T03:43:47.365 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.365 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.366 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-05-10T03:43:47.366 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "0", 2024-05-10T03:43:47.366 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "6", 2024-05-10T03:43:47.366 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.366 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-10T03:43:47.366 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-10T03:43:47.366 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.366 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.366 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.366 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_compat_max_iterations": { 2024-05-10T03:43:47.366 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crush_compat_max_iterations", 2024-05-10T03:43:47.366 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-05-10T03:43:47.366 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.366 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.367 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "25", 2024-05-10T03:43:47.367 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1", 2024-05-10T03:43:47.367 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "250", 2024-05-10T03:43:47.367 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.367 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-10T03:43:47.367 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.367 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.367 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.367 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.367 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_compat_metrics": { 2024-05-10T03:43:47.367 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crush_compat_metrics", 2024-05-10T03:43:47.367 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.367 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.367 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.368 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "pgs,objects,bytes", 2024-05-10T03:43:47.368 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.368 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.368 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.368 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-10T03:43:47.368 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-10T03:43:47.368 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.368 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.368 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.368 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_compat_step": { 2024-05-10T03:43:47.368 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crush_compat_step", 2024-05-10T03:43:47.368 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-05-10T03:43:47.368 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.368 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.369 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0.5", 2024-05-10T03:43:47.369 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "0.001", 2024-05-10T03:43:47.369 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "0.999", 2024-05-10T03:43:47.369 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.369 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "aggressiveness of optimization", 2024-05-10T03:43:47.369 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-10T03:43:47.369 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.369 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.369 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.369 INFO:teuthology.orchestra.run.smithi045.stdout: "end_time": { 2024-05-10T03:43:47.369 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "end_time", 2024-05-10T03:43:47.369 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.369 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.369 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.369 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "2359", 2024-05-10T03:43:47.370 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.370 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.370 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.370 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "ending time of day to automatically balance", 2024-05-10T03:43:47.370 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-10T03:43:47.370 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.370 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.370 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.370 INFO:teuthology.orchestra.run.smithi045.stdout: "end_weekday": { 2024-05-10T03:43:47.370 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "end_weekday", 2024-05-10T03:43:47.370 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-05-10T03:43:47.370 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.370 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.370 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-05-10T03:43:47.371 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "0", 2024-05-10T03:43:47.371 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "6", 2024-05-10T03:43:47.371 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.371 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-10T03:43:47.371 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-10T03:43:47.371 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.371 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.371 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.371 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.371 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.371 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.371 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.371 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.371 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.371 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.372 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.372 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.372 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.372 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.372 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.372 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.372 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.372 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.372 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.372 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.372 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.372 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.372 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.372 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.372 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.373 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.373 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.373 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.373 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.373 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.373 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.373 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.373 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.373 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.373 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.373 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.373 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.373 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.374 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.374 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.374 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.374 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.374 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.374 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.374 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.374 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.374 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.374 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.374 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.374 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.374 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.375 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.375 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.375 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.375 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.375 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.375 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.375 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.375 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.375 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.375 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.375 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.375 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.375 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.375 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.375 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.376 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.376 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.376 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.376 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.376 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.376 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.376 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.376 INFO:teuthology.orchestra.run.smithi045.stdout: "min_score": { 2024-05-10T03:43:47.376 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "min_score", 2024-05-10T03:43:47.376 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-05-10T03:43:47.376 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.376 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.376 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-05-10T03:43:47.376 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.376 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.377 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.377 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-10T03:43:47.377 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.377 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.377 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.377 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.377 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": { 2024-05-10T03:43:47.377 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mode", 2024-05-10T03:43:47.377 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.377 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.377 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.377 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "upmap", 2024-05-10T03:43:47.377 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.377 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.378 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.378 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-compat", 2024-05-10T03:43:47.378 INFO:teuthology.orchestra.run.smithi045.stdout: "none", 2024-05-10T03:43:47.378 INFO:teuthology.orchestra.run.smithi045.stdout: "upmap" 2024-05-10T03:43:47.378 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.378 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Balancer mode", 2024-05-10T03:43:47.378 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.378 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.378 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.378 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.378 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_ids": { 2024-05-10T03:43:47.378 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "pool_ids", 2024-05-10T03:43:47.378 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.378 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.379 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.379 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.379 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.379 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.379 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.379 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-10T03:43:47.379 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.379 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.379 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.379 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.379 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-05-10T03:43:47.379 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-05-10T03:43:47.379 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.379 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.380 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.380 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-05-10T03:43:47.380 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.380 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.380 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.380 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-10T03:43:47.380 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.380 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.380 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.380 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.380 INFO:teuthology.orchestra.run.smithi045.stdout: "upmap_max_deviation": { 2024-05-10T03:43:47.380 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "upmap_max_deviation", 2024-05-10T03:43:47.380 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.380 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.380 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.381 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-05-10T03:43:47.381 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1", 2024-05-10T03:43:47.381 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.381 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.381 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-10T03:43:47.381 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-10T03:43:47.381 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.381 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.381 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.381 INFO:teuthology.orchestra.run.smithi045.stdout: "upmap_max_optimizations": { 2024-05-10T03:43:47.381 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "upmap_max_optimizations", 2024-05-10T03:43:47.381 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-05-10T03:43:47.381 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.381 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.381 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-05-10T03:43:47.382 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.382 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.382 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.382 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-10T03:43:47.382 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.382 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.382 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.382 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.382 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.382 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.382 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.382 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cephadm", 2024-05-10T03:43:47.382 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.382 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.383 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.383 INFO:teuthology.orchestra.run.smithi045.stdout: "agent_down_multiplier": { 2024-05-10T03:43:47.383 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "agent_down_multiplier", 2024-05-10T03:43:47.383 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-05-10T03:43:47.383 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.383 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.383 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "3.0", 2024-05-10T03:43:47.383 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.383 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.383 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.383 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-10T03:43:47.383 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.383 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.383 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.384 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.384 INFO:teuthology.orchestra.run.smithi045.stdout: "agent_refresh_rate": { 2024-05-10T03:43:47.384 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "agent_refresh_rate", 2024-05-10T03:43:47.384 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.384 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.384 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.384 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "20", 2024-05-10T03:43:47.384 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.384 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.384 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.384 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-10T03:43:47.384 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.384 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.384 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.384 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.384 INFO:teuthology.orchestra.run.smithi045.stdout: "agent_starting_port": { 2024-05-10T03:43:47.385 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "agent_starting_port", 2024-05-10T03:43:47.385 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.385 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.385 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.385 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "4721", 2024-05-10T03:43:47.385 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.385 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.385 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.385 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-10T03:43:47.385 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.385 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.385 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.385 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.386 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_ptrace": { 2024-05-10T03:43:47.386 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "allow_ptrace", 2024-05-10T03:43:47.386 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.386 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.386 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.386 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.386 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.386 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.386 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.386 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-10T03:43:47.386 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-10T03:43:47.386 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.386 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.386 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.387 INFO:teuthology.orchestra.run.smithi045.stdout: "autotune_interval": { 2024-05-10T03:43:47.387 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "autotune_interval", 2024-05-10T03:43:47.387 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.387 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.387 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.387 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-05-10T03:43:47.387 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.387 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.387 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.387 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-10T03:43:47.387 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.387 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.387 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.387 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.387 INFO:teuthology.orchestra.run.smithi045.stdout: "autotune_memory_target_ratio": { 2024-05-10T03:43:47.388 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "autotune_memory_target_ratio", 2024-05-10T03:43:47.388 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-05-10T03:43:47.388 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.388 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.388 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0.7", 2024-05-10T03:43:47.388 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.388 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.388 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.388 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-10T03:43:47.388 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.388 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.388 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.388 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.388 INFO:teuthology.orchestra.run.smithi045.stdout: "cgroups_split": { 2024-05-10T03:43:47.388 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cgroups_split", 2024-05-10T03:43:47.389 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.389 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.389 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.389 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.389 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.389 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.389 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.389 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-10T03:43:47.389 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.389 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.389 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.389 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.389 INFO:teuthology.orchestra.run.smithi045.stdout: "config_checks_enabled": { 2024-05-10T03:43:47.389 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "config_checks_enabled", 2024-05-10T03:43:47.389 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.390 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.390 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.390 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.390 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.390 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.390 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.390 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-10T03:43:47.390 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.390 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.390 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.390 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.390 INFO:teuthology.orchestra.run.smithi045.stdout: "config_dashboard": { 2024-05-10T03:43:47.390 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "config_dashboard", 2024-05-10T03:43:47.390 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.391 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.391 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.391 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.391 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.391 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.391 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.391 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-10T03:43:47.391 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.391 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.391 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.391 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.391 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_alertmanager": { 2024-05-10T03:43:47.391 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_alertmanager", 2024-05-10T03:43:47.391 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.392 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.392 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.392 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-10T03:43:47.392 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.392 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.392 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.392 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Prometheus container image", 2024-05-10T03:43:47.392 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.392 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.392 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.392 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.392 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_base": { 2024-05-10T03:43:47.392 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_base", 2024-05-10T03:43:47.392 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.392 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.393 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.393 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-10T03:43:47.393 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.393 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.393 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.393 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Container image name, without the tag", 2024-05-10T03:43:47.393 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.393 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.393 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.393 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.393 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_elasticsearch": { 2024-05-10T03:43:47.393 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_elasticsearch", 2024-05-10T03:43:47.393 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.393 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.393 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.394 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-10T03:43:47.394 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.394 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.394 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.394 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "elasticsearch container image", 2024-05-10T03:43:47.394 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.394 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.394 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.394 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.394 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_grafana": { 2024-05-10T03:43:47.394 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_grafana", 2024-05-10T03:43:47.394 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.394 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.394 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.394 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-05-10T03:43:47.395 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.395 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.395 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.395 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Prometheus container image", 2024-05-10T03:43:47.395 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.395 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.395 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.395 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.395 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_haproxy": { 2024-05-10T03:43:47.395 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_haproxy", 2024-05-10T03:43:47.395 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.395 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.395 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.395 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-10T03:43:47.395 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.396 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.396 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.396 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "HAproxy container image", 2024-05-10T03:43:47.396 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.396 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.396 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.396 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.396 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_jaeger_agent": { 2024-05-10T03:43:47.396 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_jaeger_agent", 2024-05-10T03:43:47.396 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.396 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.396 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.396 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-10T03:43:47.396 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.396 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.397 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.397 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Jaeger agent container image", 2024-05-10T03:43:47.397 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.397 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.397 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.397 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.397 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_jaeger_collector": { 2024-05-10T03:43:47.397 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_jaeger_collector", 2024-05-10T03:43:47.397 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.397 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.397 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.397 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-10T03:43:47.397 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.398 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.398 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.398 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Jaeger collector container image", 2024-05-10T03:43:47.398 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.398 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.398 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.398 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.398 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_jaeger_query": { 2024-05-10T03:43:47.398 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_jaeger_query", 2024-05-10T03:43:47.398 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.398 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.398 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.398 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-10T03:43:47.398 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.398 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.399 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.399 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Jaeger query container image", 2024-05-10T03:43:47.399 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.399 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.399 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.399 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.399 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_keepalived": { 2024-05-10T03:43:47.399 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_keepalived", 2024-05-10T03:43:47.399 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.399 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.399 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.399 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-10T03:43:47.399 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.399 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.399 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.400 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Keepalived container image", 2024-05-10T03:43:47.401 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.401 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.401 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.401 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.401 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_loki": { 2024-05-10T03:43:47.401 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_loki", 2024-05-10T03:43:47.402 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.402 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.402 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.402 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-10T03:43:47.402 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.402 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.402 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.402 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Loki container image", 2024-05-10T03:43:47.402 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.402 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.402 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.402 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.402 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_node_exporter": { 2024-05-10T03:43:47.402 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_node_exporter", 2024-05-10T03:43:47.402 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.403 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.403 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.403 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-10T03:43:47.403 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.403 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.403 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.403 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Prometheus container image", 2024-05-10T03:43:47.403 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.403 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.403 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.403 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.403 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_nvmeof": { 2024-05-10T03:43:47.403 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_nvmeof", 2024-05-10T03:43:47.403 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.404 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.404 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.404 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-05-10T03:43:47.404 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.404 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.404 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.404 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Nvme-of container image", 2024-05-10T03:43:47.404 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.404 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.404 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.404 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.404 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_prometheus": { 2024-05-10T03:43:47.404 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_prometheus", 2024-05-10T03:43:47.404 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.404 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.405 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.405 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-10T03:43:47.405 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.405 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.405 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.405 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Prometheus container image", 2024-05-10T03:43:47.405 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.405 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.405 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.405 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.405 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_promtail": { 2024-05-10T03:43:47.405 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_promtail", 2024-05-10T03:43:47.405 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.405 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.405 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.406 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-10T03:43:47.406 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.406 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.406 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.406 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Promtail container image", 2024-05-10T03:43:47.406 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.406 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.406 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.406 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.406 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_snmp_gateway": { 2024-05-10T03:43:47.406 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_snmp_gateway", 2024-05-10T03:43:47.406 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.406 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.406 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.406 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-10T03:43:47.407 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.407 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.407 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.407 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "SNMP Gateway container image", 2024-05-10T03:43:47.407 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.407 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.407 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.407 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.407 INFO:teuthology.orchestra.run.smithi045.stdout: "container_init": { 2024-05-10T03:43:47.407 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_init", 2024-05-10T03:43:47.407 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.407 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.407 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.407 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.407 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.408 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.408 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.408 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Run podman/docker with `--init`", 2024-05-10T03:43:47.408 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.408 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.408 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.408 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.408 INFO:teuthology.orchestra.run.smithi045.stdout: "daemon_cache_timeout": { 2024-05-10T03:43:47.408 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "daemon_cache_timeout", 2024-05-10T03:43:47.408 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.408 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.408 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.408 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-05-10T03:43:47.408 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.409 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.409 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.409 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-10T03:43:47.409 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.409 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.409 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.409 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.409 INFO:teuthology.orchestra.run.smithi045.stdout: "default_cephadm_command_timeout": { 2024-05-10T03:43:47.409 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "default_cephadm_command_timeout", 2024-05-10T03:43:47.409 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.409 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.409 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.409 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "900", 2024-05-10T03:43:47.409 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.409 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.410 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.410 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-10T03:43:47.410 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.410 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.410 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.410 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.410 INFO:teuthology.orchestra.run.smithi045.stdout: "default_registry": { 2024-05-10T03:43:47.410 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "default_registry", 2024-05-10T03:43:47.410 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.410 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.410 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.410 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "docker.io", 2024-05-10T03:43:47.410 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.411 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.411 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.411 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-10T03:43:47.411 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.411 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.411 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.411 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.411 INFO:teuthology.orchestra.run.smithi045.stdout: "device_cache_timeout": { 2024-05-10T03:43:47.411 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "device_cache_timeout", 2024-05-10T03:43:47.411 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.411 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.411 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.411 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "1800", 2024-05-10T03:43:47.411 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.412 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.412 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.412 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "seconds to cache device inventory", 2024-05-10T03:43:47.412 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.412 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.412 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.412 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.412 INFO:teuthology.orchestra.run.smithi045.stdout: "device_enhanced_scan": { 2024-05-10T03:43:47.412 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "device_enhanced_scan", 2024-05-10T03:43:47.412 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.412 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.412 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.412 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.412 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.412 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.413 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.413 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-10T03:43:47.413 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.413 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.413 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.413 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.413 INFO:teuthology.orchestra.run.smithi045.stdout: "facts_cache_timeout": { 2024-05-10T03:43:47.413 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "facts_cache_timeout", 2024-05-10T03:43:47.413 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.413 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.413 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.413 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-05-10T03:43:47.413 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.413 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.414 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.414 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "seconds to cache host facts data", 2024-05-10T03:43:47.414 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.414 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.414 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.414 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.414 INFO:teuthology.orchestra.run.smithi045.stdout: "host_check_interval": { 2024-05-10T03:43:47.414 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "host_check_interval", 2024-05-10T03:43:47.414 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.414 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.414 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.414 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-05-10T03:43:47.414 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.414 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to perform a host check", 2024-05-10T03:43:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: "hw_monitoring": { 2024-05-10T03:43:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "hw_monitoring", 2024-05-10T03:43:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-10T03:43:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: "inventory_list_all": { 2024-05-10T03:43:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "inventory_list_all", 2024-05-10T03:43:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-10T03:43:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: "log_refresh_metadata": { 2024-05-10T03:43:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_refresh_metadata", 2024-05-10T03:43:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.419 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.419 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.419 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.419 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.419 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.419 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.419 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-10T03:43:47.419 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.419 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.419 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.419 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.419 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.419 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.419 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.419 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.420 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.420 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.420 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.420 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.420 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.420 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-10T03:43:47.420 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.420 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.420 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.420 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.420 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.420 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.420 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.420 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.420 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.421 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.421 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.421 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.421 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.421 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.421 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.421 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.421 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.421 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.421 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.421 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.421 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.421 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.421 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.421 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.422 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.422 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.422 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.422 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.422 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.422 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.422 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.422 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.422 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.422 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.422 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.422 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.423 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.423 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.423 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.423 INFO:teuthology.orchestra.run.smithi045.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-10T03:43:47.423 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-10T03:43:47.423 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.423 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.423 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.423 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.423 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.423 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.423 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.423 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-10T03:43:47.423 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.423 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.424 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.424 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.424 INFO:teuthology.orchestra.run.smithi045.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-10T03:43:47.424 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-10T03:43:47.424 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.424 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.424 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.424 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "*", 2024-05-10T03:43:47.424 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.424 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.424 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.424 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-10T03:43:47.424 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.424 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.425 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.425 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.425 INFO:teuthology.orchestra.run.smithi045.stdout: "max_count_per_host": { 2024-05-10T03:43:47.425 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_count_per_host", 2024-05-10T03:43:47.425 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.425 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.425 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.425 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-05-10T03:43:47.425 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.425 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.425 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.425 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "max number of daemons per service per host", 2024-05-10T03:43:47.425 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.425 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.425 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.426 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.426 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd_draining_count": { 2024-05-10T03:43:47.426 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_osd_draining_count", 2024-05-10T03:43:47.426 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.426 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.426 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.426 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-05-10T03:43:47.426 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.426 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.426 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.426 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-10T03:43:47.426 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.426 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.426 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.427 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.427 INFO:teuthology.orchestra.run.smithi045.stdout: "migration_current": { 2024-05-10T03:43:47.427 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "migration_current", 2024-05-10T03:43:47.427 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.427 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.427 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.427 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.427 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.427 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.427 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.427 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "internal - do not modify", 2024-05-10T03:43:47.427 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.427 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.427 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.427 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.428 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": { 2024-05-10T03:43:47.428 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mode", 2024-05-10T03:43:47.428 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.428 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.428 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.428 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "root", 2024-05-10T03:43:47.428 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.428 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.428 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.428 INFO:teuthology.orchestra.run.smithi045.stdout: "cephadm-package", 2024-05-10T03:43:47.428 INFO:teuthology.orchestra.run.smithi045.stdout: "root" 2024-05-10T03:43:47.428 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.428 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "mode for remote execution of cephadm", 2024-05-10T03:43:47.428 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.428 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: "oob_default_addr": { 2024-05-10T03:43:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "oob_default_addr", 2024-05-10T03:43:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "169.254.1.1", 2024-05-10T03:43:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-10T03:43:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.429 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: "prometheus_alerts_path": { 2024-05-10T03:43:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "prometheus_alerts_path", 2024-05-10T03:43:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-10T03:43:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-10T03:43:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.430 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: "registry_insecure": { 2024-05-10T03:43:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "registry_insecure", 2024-05-10T03:43:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-10T03:43:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.431 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: "registry_password": { 2024-05-10T03:43:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "registry_password", 2024-05-10T03:43:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-10T03:43:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.432 INFO:teuthology.orchestra.run.smithi045.stdout: "registry_url": { 2024-05-10T03:43:47.433 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "registry_url", 2024-05-10T03:43:47.433 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.433 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.433 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.433 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.433 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.433 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.433 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.433 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-10T03:43:47.433 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.433 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.433 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.433 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.433 INFO:teuthology.orchestra.run.smithi045.stdout: "registry_username": { 2024-05-10T03:43:47.433 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "registry_username", 2024-05-10T03:43:47.433 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.434 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.434 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.434 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.434 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.434 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.434 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.434 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-10T03:43:47.434 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.434 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.434 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.434 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.434 INFO:teuthology.orchestra.run.smithi045.stdout: "secure_monitoring_stack": { 2024-05-10T03:43:47.435 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "secure_monitoring_stack", 2024-05-10T03:43:47.435 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.435 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.435 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.435 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.435 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.435 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.435 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.435 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-10T03:43:47.435 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.435 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.435 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.435 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.435 INFO:teuthology.orchestra.run.smithi045.stdout: "service_discovery_port": { 2024-05-10T03:43:47.436 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "service_discovery_port", 2024-05-10T03:43:47.436 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.436 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.436 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.436 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8765", 2024-05-10T03:43:47.436 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.436 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.436 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.436 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "cephadm service discovery port", 2024-05-10T03:43:47.436 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.436 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.436 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.436 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.436 INFO:teuthology.orchestra.run.smithi045.stdout: "ssh_config_file": { 2024-05-10T03:43:47.436 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ssh_config_file", 2024-05-10T03:43:47.437 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.437 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.437 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.437 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.437 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.437 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.437 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.437 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-10T03:43:47.437 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.437 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.437 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.437 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.437 INFO:teuthology.orchestra.run.smithi045.stdout: "use_agent": { 2024-05-10T03:43:47.437 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "use_agent", 2024-05-10T03:43:47.437 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.438 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.438 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.438 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.438 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.438 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.438 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.438 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-10T03:43:47.438 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.438 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.438 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.438 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.438 INFO:teuthology.orchestra.run.smithi045.stdout: "use_repo_digest": { 2024-05-10T03:43:47.438 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "use_repo_digest", 2024-05-10T03:43:47.438 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.439 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.439 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.439 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.439 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.439 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.439 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.439 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-10T03:43:47.439 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.439 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.439 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.439 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.439 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_on_failed_host_check": { 2024-05-10T03:43:47.439 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_on_failed_host_check", 2024-05-10T03:43:47.439 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.439 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.440 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.440 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.440 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.440 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.440 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.440 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "raise a health warning if the host check fails", 2024-05-10T03:43:47.440 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.440 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.440 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.440 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.440 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_on_stray_daemons": { 2024-05-10T03:43:47.440 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_on_stray_daemons", 2024-05-10T03:43:47.440 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.440 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.441 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.441 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.441 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.441 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.441 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.441 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-10T03:43:47.441 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.441 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.441 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.441 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.441 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_on_stray_hosts": { 2024-05-10T03:43:47.441 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_on_stray_hosts", 2024-05-10T03:43:47.441 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.441 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.441 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.441 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.442 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.442 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.442 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.442 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-10T03:43:47.442 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.442 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.442 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.442 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.442 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.442 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.442 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.442 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crash", 2024-05-10T03:43:47.442 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.442 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.443 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.443 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.443 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.443 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.443 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.443 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.443 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.443 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.443 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.443 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.443 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.443 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.443 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.443 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.443 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.444 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.444 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.444 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.444 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.444 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.444 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.444 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.444 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.444 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.444 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.444 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.444 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.444 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.444 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.444 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.445 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.445 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.445 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.445 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.445 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.445 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.445 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.445 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.445 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.445 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.445 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.445 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.445 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.445 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.445 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.445 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.446 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.446 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.446 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.446 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.446 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.446 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.446 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.446 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.446 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.446 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.446 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.447 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.447 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.447 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.447 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.447 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.447 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.447 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.447 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.447 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.447 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.447 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.447 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.447 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.447 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.447 INFO:teuthology.orchestra.run.smithi045.stdout: "retain_interval": { 2024-05-10T03:43:47.448 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "retain_interval", 2024-05-10T03:43:47.448 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.448 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.448 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.448 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "31536000", 2024-05-10T03:43:47.448 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.448 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.448 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.448 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-10T03:43:47.448 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.448 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.448 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.448 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.448 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_recent_interval": { 2024-05-10T03:43:47.449 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_recent_interval", 2024-05-10T03:43:47.449 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.449 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.449 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.449 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "1209600", 2024-05-10T03:43:47.449 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.449 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.449 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.449 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-10T03:43:47.449 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.449 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.449 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.449 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.449 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.449 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.450 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.450 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "dashboard", 2024-05-10T03:43:47.450 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.450 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.450 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.450 INFO:teuthology.orchestra.run.smithi045.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-10T03:43:47.450 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-10T03:43:47.450 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.450 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.450 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.450 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-05-10T03:43:47.450 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.450 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.451 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.451 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.451 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.451 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.451 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.451 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.451 INFO:teuthology.orchestra.run.smithi045.stdout: "ALERTMANAGER_API_HOST": { 2024-05-10T03:43:47.451 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-10T03:43:47.451 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.451 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.451 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.451 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.451 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.451 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.451 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.452 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.452 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.452 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.452 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.452 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.452 INFO:teuthology.orchestra.run.smithi045.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-10T03:43:47.452 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-10T03:43:47.452 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.452 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.452 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.452 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.452 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.452 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.452 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: "AUDIT_API_ENABLED": { 2024-05-10T03:43:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "AUDIT_API_ENABLED", 2024-05-10T03:43:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.453 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.454 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.454 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.454 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.454 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.454 INFO:teuthology.orchestra.run.smithi045.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-10T03:43:47.454 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-10T03:43:47.454 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.454 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.454 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.454 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.454 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.454 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.454 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.454 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.454 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.455 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.455 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.455 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.455 INFO:teuthology.orchestra.run.smithi045.stdout: "ENABLE_BROWSABLE_API": { 2024-05-10T03:43:47.455 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-10T03:43:47.455 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.455 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.455 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.455 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.455 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.455 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.455 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.455 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.455 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.456 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.456 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.456 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.456 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-10T03:43:47.456 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-10T03:43:47.456 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.456 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.456 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.456 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.456 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.456 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.456 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.456 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.456 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.457 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.457 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.457 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.457 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-10T03:43:47.457 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-10T03:43:47.457 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.457 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.457 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.457 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.457 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.457 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.457 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.457 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.457 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.457 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.458 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.458 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.458 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-10T03:43:47.458 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-10T03:43:47.458 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.458 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.458 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.458 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.458 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.458 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.458 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.458 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.458 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.458 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.459 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.459 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.459 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-10T03:43:47.459 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-10T03:43:47.459 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.459 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.459 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.459 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.459 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.459 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.459 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.459 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-10T03:43:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-10T03:43:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.460 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-10T03:43:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-10T03:43:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-10T03:43:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-10T03:43:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.462 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.463 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.463 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.463 INFO:teuthology.orchestra.run.smithi045.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-10T03:43:47.463 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-10T03:43:47.463 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.463 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.463 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.463 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.463 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.463 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.463 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.463 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.463 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.463 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_API_PASSWORD": { 2024-05-10T03:43:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-10T03:43:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "admin", 2024-05-10T03:43:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.464 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.465 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.465 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.465 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-10T03:43:47.465 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-10T03:43:47.465 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.465 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.465 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.465 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.465 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.465 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.465 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.465 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.465 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.465 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.465 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.466 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.466 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_API_URL": { 2024-05-10T03:43:47.466 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_API_URL", 2024-05-10T03:43:47.466 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.466 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.466 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.466 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.466 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.466 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.466 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.466 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.466 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.466 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.466 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.467 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.467 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_API_USERNAME": { 2024-05-10T03:43:47.467 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-10T03:43:47.467 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.467 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.467 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.467 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "admin", 2024-05-10T03:43:47.467 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.467 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.467 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.467 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.467 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.467 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.467 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.468 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.468 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-10T03:43:47.468 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-10T03:43:47.468 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.468 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.468 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.468 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.468 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.468 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.468 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.468 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.468 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.468 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.468 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.468 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.469 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-10T03:43:47.469 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-10T03:43:47.469 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.469 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.469 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.469 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.469 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.469 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.469 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.469 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.469 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.469 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.469 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.469 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.470 INFO:teuthology.orchestra.run.smithi045.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-10T03:43:47.470 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-10T03:43:47.470 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.470 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.470 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.470 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.470 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.470 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.470 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.470 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.470 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.470 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.470 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.470 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.471 INFO:teuthology.orchestra.run.smithi045.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-10T03:43:47.471 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-10T03:43:47.471 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.471 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.471 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.471 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.471 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.471 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.471 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.471 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.471 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.471 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.471 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.471 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.471 INFO:teuthology.orchestra.run.smithi045.stdout: "PROMETHEUS_API_HOST": { 2024-05-10T03:43:47.472 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-10T03:43:47.472 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.472 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.472 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.472 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.472 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.472 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.472 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.472 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.472 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.472 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.472 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.472 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.473 INFO:teuthology.orchestra.run.smithi045.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-10T03:43:47.473 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-10T03:43:47.473 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.473 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.473 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.473 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.473 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.473 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.473 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.473 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.473 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.473 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.473 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.473 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.474 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-10T03:43:47.474 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-10T03:43:47.474 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.474 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.474 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.474 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.474 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.474 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.474 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.474 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.474 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.474 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.474 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.474 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.474 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-10T03:43:47.475 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-10T03:43:47.475 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.475 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.475 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.475 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.475 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.475 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.475 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.475 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.475 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.475 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.475 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.475 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.476 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-10T03:43:47.476 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-10T03:43:47.476 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.476 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.476 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.476 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.476 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.476 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.476 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.476 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.476 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.476 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.476 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.476 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.477 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-10T03:43:47.477 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-10T03:43:47.477 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.477 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.477 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.477 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.477 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.477 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.477 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.477 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.477 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.477 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.477 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.477 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-10T03:43:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-10T03:43:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-10T03:43:47.479 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-10T03:43:47.479 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.479 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.479 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.479 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.479 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.479 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.479 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.479 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.479 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.479 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.479 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.479 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.479 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-10T03:43:47.480 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-10T03:43:47.480 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.480 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.480 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.480 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.480 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.480 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.480 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.480 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.480 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.480 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.480 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.480 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.481 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_ENABLED": { 2024-05-10T03:43:47.481 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-10T03:43:47.481 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.481 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.481 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.481 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.481 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.481 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.481 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.481 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.481 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.481 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.481 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.481 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.482 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-10T03:43:47.482 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-10T03:43:47.482 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.482 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.482 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.482 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-10T03:43:47.482 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.482 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.482 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.482 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.482 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.482 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.482 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.482 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.482 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-10T03:43:47.483 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-10T03:43:47.483 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.483 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.483 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.483 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-05-10T03:43:47.483 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.483 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.483 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.483 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.483 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.483 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.483 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.483 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.483 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-10T03:43:47.483 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-10T03:43:47.484 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.484 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.484 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.484 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8", 2024-05-10T03:43:47.484 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.484 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.484 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.484 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.484 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.484 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.484 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.484 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.484 INFO:teuthology.orchestra.run.smithi045.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-10T03:43:47.484 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-10T03:43:47.485 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.485 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.485 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.485 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "45", 2024-05-10T03:43:47.485 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.485 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.485 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.485 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.485 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.485 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.485 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.485 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.485 INFO:teuthology.orchestra.run.smithi045.stdout: "RGW_API_ACCESS_KEY": { 2024-05-10T03:43:47.486 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-10T03:43:47.486 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.486 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.486 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.486 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.486 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.486 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.486 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.486 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.486 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.486 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.486 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.486 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.487 INFO:teuthology.orchestra.run.smithi045.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-10T03:43:47.487 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-10T03:43:47.487 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.487 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.487 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.487 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "admin", 2024-05-10T03:43:47.487 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.487 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.487 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.487 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.487 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.487 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.487 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.487 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.487 INFO:teuthology.orchestra.run.smithi045.stdout: "RGW_API_SECRET_KEY": { 2024-05-10T03:43:47.488 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-10T03:43:47.488 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.488 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.488 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.488 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.488 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.488 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.488 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.488 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.488 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.488 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.488 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.488 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.488 INFO:teuthology.orchestra.run.smithi045.stdout: "RGW_API_SSL_VERIFY": { 2024-05-10T03:43:47.489 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-10T03:43:47.489 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.489 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.489 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.489 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.489 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.489 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.489 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.489 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.489 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.489 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.489 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.489 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.489 INFO:teuthology.orchestra.run.smithi045.stdout: "UNSAFE_TLS_v1_2": { 2024-05-10T03:43:47.489 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-10T03:43:47.490 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.490 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.490 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.490 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.490 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.490 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.490 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.490 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.490 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.490 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.490 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.490 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.490 INFO:teuthology.orchestra.run.smithi045.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-10T03:43:47.490 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-10T03:43:47.491 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.491 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.491 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.491 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-05-10T03:43:47.491 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.491 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.491 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.491 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.491 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.491 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.491 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.491 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.491 INFO:teuthology.orchestra.run.smithi045.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-10T03:43:47.491 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-10T03:43:47.492 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.492 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.492 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.492 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-05-10T03:43:47.492 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.492 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.492 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.492 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.492 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.492 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.492 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.492 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.492 INFO:teuthology.orchestra.run.smithi045.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-10T03:43:47.492 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-10T03:43:47.492 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.493 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.493 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.493 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-05-10T03:43:47.493 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.493 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.493 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.493 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.493 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.493 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.493 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.493 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.493 INFO:teuthology.orchestra.run.smithi045.stdout: "cross_origin_url": { 2024-05-10T03:43:47.493 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cross_origin_url", 2024-05-10T03:43:47.493 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.493 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.494 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.494 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.494 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.494 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.494 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.494 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.494 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.494 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.494 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.494 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.494 INFO:teuthology.orchestra.run.smithi045.stdout: "crt_file": { 2024-05-10T03:43:47.494 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crt_file", 2024-05-10T03:43:47.494 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.494 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.495 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.495 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.495 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.495 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.495 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.495 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.495 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.495 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.495 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.495 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.495 INFO:teuthology.orchestra.run.smithi045.stdout: "debug": { 2024-05-10T03:43:47.495 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "debug", 2024-05-10T03:43:47.495 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.495 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.495 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.496 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.496 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.496 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.496 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.496 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Enable/disable debug options", 2024-05-10T03:43:47.496 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.496 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.496 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.496 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.496 INFO:teuthology.orchestra.run.smithi045.stdout: "jwt_token_ttl": { 2024-05-10T03:43:47.496 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "jwt_token_ttl", 2024-05-10T03:43:47.496 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.496 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.496 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.497 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "28800", 2024-05-10T03:43:47.497 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.497 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.497 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.497 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.497 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.497 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.497 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.497 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.497 INFO:teuthology.orchestra.run.smithi045.stdout: "key_file": { 2024-05-10T03:43:47.497 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "key_file", 2024-05-10T03:43:47.497 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.497 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.497 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.497 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.498 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.498 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.498 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.498 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.498 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.498 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.498 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.498 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.498 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.498 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.498 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.498 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.498 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.499 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.499 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.499 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.499 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.499 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.499 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.499 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.499 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.499 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.499 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.499 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.499 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.499 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.499 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.500 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.500 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.500 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.500 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.500 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.500 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.500 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.500 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.500 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.500 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.500 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.500 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.500 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.500 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.501 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.501 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.501 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.501 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.501 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.501 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.501 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.501 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.501 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.501 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.501 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.501 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.501 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.501 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.501 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.502 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.502 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.502 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.502 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.502 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.502 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.502 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.502 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.502 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.502 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.502 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.502 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.502 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.502 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.503 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.503 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.503 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.503 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.503 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.503 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.503 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.503 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.503 INFO:teuthology.orchestra.run.smithi045.stdout: "motd": { 2024-05-10T03:43:47.503 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "motd", 2024-05-10T03:43:47.503 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.503 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.503 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.503 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.503 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.504 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.504 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.504 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "The message of the day", 2024-05-10T03:43:47.504 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.504 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.504 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.504 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.504 INFO:teuthology.orchestra.run.smithi045.stdout: "redirect_resolve_ip_addr": { 2024-05-10T03:43:47.504 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "redirect_resolve_ip_addr", 2024-05-10T03:43:47.504 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.504 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.504 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.504 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.504 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.504 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.505 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.505 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.505 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.505 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.505 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.505 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.505 INFO:teuthology.orchestra.run.smithi045.stdout: "server_addr": { 2024-05-10T03:43:47.505 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_addr", 2024-05-10T03:43:47.505 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.505 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.505 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.505 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "::", 2024-05-10T03:43:47.505 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.505 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.505 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.506 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.506 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.506 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.506 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.506 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.506 INFO:teuthology.orchestra.run.smithi045.stdout: "server_port": { 2024-05-10T03:43:47.506 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_port", 2024-05-10T03:43:47.506 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.506 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.506 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.506 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8080", 2024-05-10T03:43:47.506 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.506 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.506 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.507 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.507 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.507 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.507 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.507 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.507 INFO:teuthology.orchestra.run.smithi045.stdout: "ssl": { 2024-05-10T03:43:47.507 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ssl", 2024-05-10T03:43:47.507 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.507 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.507 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.507 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.507 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.507 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.507 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.507 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.508 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.508 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.508 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.508 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.508 INFO:teuthology.orchestra.run.smithi045.stdout: "ssl_server_port": { 2024-05-10T03:43:47.508 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ssl_server_port", 2024-05-10T03:43:47.508 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.508 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.508 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.508 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8443", 2024-05-10T03:43:47.508 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.508 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.508 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.508 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.508 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.509 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.509 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.509 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.509 INFO:teuthology.orchestra.run.smithi045.stdout: "standby_behaviour": { 2024-05-10T03:43:47.509 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "standby_behaviour", 2024-05-10T03:43:47.509 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.509 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.509 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.509 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "redirect", 2024-05-10T03:43:47.509 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.509 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.509 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.509 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.509 INFO:teuthology.orchestra.run.smithi045.stdout: "redirect" 2024-05-10T03:43:47.509 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.510 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.510 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.510 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.510 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.510 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.510 INFO:teuthology.orchestra.run.smithi045.stdout: "standby_error_status_code": { 2024-05-10T03:43:47.510 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "standby_error_status_code", 2024-05-10T03:43:47.510 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.510 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.510 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.510 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "500", 2024-05-10T03:43:47.510 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "400", 2024-05-10T03:43:47.510 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "599", 2024-05-10T03:43:47.510 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.511 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.511 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.511 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.511 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.511 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.511 INFO:teuthology.orchestra.run.smithi045.stdout: "url_prefix": { 2024-05-10T03:43:47.511 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "url_prefix", 2024-05-10T03:43:47.511 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.511 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.511 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.511 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.511 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.511 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.511 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.512 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.512 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.512 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.512 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.512 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.512 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.512 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.512 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.512 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "devicehealth", 2024-05-10T03:43:47.512 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.512 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.512 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.512 INFO:teuthology.orchestra.run.smithi045.stdout: "enable_monitoring": { 2024-05-10T03:43:47.512 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "enable_monitoring", 2024-05-10T03:43:47.512 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.513 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.513 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.513 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.513 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.513 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.513 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.513 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "monitor device health metrics", 2024-05-10T03:43:47.513 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.513 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.513 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.513 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.513 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.513 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.513 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.514 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.514 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.514 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.514 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.514 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.514 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.514 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.514 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.514 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.514 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.514 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.514 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.514 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.514 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.515 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.515 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.515 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.515 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.515 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.515 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.515 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.515 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.515 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.515 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.515 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.515 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.515 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.515 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.516 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.516 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.516 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.516 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.516 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.516 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.516 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.516 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.516 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.516 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.516 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.516 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.516 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.516 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.516 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.517 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.517 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.517 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.517 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.517 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.517 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.517 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.517 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.517 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.517 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.517 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.517 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.517 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.517 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.518 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.518 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.518 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.518 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.518 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.518 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.518 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.518 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.518 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.518 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.518 INFO:teuthology.orchestra.run.smithi045.stdout: "mark_out_threshold": { 2024-05-10T03:43:47.518 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mark_out_threshold", 2024-05-10T03:43:47.518 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.518 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.518 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.519 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "2419200", 2024-05-10T03:43:47.519 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.519 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.519 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.519 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-10T03:43:47.519 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.519 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.519 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.519 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.519 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": { 2024-05-10T03:43:47.519 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "pool_name", 2024-05-10T03:43:47.519 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.519 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.519 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.519 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "device_health_metrics", 2024-05-10T03:43:47.520 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.520 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.520 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.520 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-10T03:43:47.520 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.520 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.520 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.520 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.520 INFO:teuthology.orchestra.run.smithi045.stdout: "retention_period": { 2024-05-10T03:43:47.520 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "retention_period", 2024-05-10T03:43:47.520 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.520 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.520 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.520 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "15552000", 2024-05-10T03:43:47.521 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.521 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.521 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.521 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how long to retain device health metrics", 2024-05-10T03:43:47.521 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.521 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.521 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.521 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.521 INFO:teuthology.orchestra.run.smithi045.stdout: "scrape_frequency": { 2024-05-10T03:43:47.521 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "scrape_frequency", 2024-05-10T03:43:47.521 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.521 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.521 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.521 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "86400", 2024-05-10T03:43:47.521 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.522 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.522 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.522 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-10T03:43:47.522 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.522 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.522 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.522 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.522 INFO:teuthology.orchestra.run.smithi045.stdout: "self_heal": { 2024-05-10T03:43:47.522 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "self_heal", 2024-05-10T03:43:47.522 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.522 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.522 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.522 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.522 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.522 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.523 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.523 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-10T03:43:47.523 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.523 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.523 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.523 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.523 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-05-10T03:43:47.523 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-05-10T03:43:47.523 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.523 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.523 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.523 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-05-10T03:43:47.523 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.523 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.523 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.524 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to wake up and check device health", 2024-05-10T03:43:47.524 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.524 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.524 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.524 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.524 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_threshold": { 2024-05-10T03:43:47.524 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_threshold", 2024-05-10T03:43:47.524 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.524 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.524 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.524 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "7257600", 2024-05-10T03:43:47.524 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.524 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.524 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.525 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-10T03:43:47.525 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.525 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.525 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.525 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.525 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.525 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.525 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.525 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "diskprediction_local", 2024-05-10T03:43:47.525 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.525 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.525 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.525 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.525 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.526 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.526 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.526 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.526 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.526 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.526 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.526 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.526 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.526 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.526 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.526 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.526 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.526 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.526 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.527 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.527 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.527 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.527 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.527 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.527 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.527 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.527 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.527 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.527 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.527 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.527 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.527 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.527 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.528 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.528 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.528 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.528 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.528 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.528 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.528 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.528 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.528 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.528 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.528 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.528 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.528 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.528 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.529 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.529 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.529 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.529 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.529 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.529 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.529 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.529 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.529 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.529 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.529 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.529 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.529 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.529 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.530 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.530 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.530 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.530 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.530 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.530 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.530 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.530 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.530 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.530 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.530 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.530 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.530 INFO:teuthology.orchestra.run.smithi045.stdout: "predict_interval": { 2024-05-10T03:43:47.530 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "predict_interval", 2024-05-10T03:43:47.530 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.531 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.531 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.531 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "86400", 2024-05-10T03:43:47.531 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.531 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.531 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.531 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.531 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.531 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.531 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.531 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.531 INFO:teuthology.orchestra.run.smithi045.stdout: "predictor_model": { 2024-05-10T03:43:47.531 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "predictor_model", 2024-05-10T03:43:47.531 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.531 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.532 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.532 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "prophetstor", 2024-05-10T03:43:47.532 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.532 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.532 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.532 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.532 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.532 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.532 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.532 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.532 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-05-10T03:43:47.532 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-05-10T03:43:47.532 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.532 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.533 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.533 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-05-10T03:43:47.533 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.533 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.533 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.533 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.533 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.533 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.533 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.533 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.533 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.533 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.533 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.533 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "influx", 2024-05-10T03:43:47.533 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": false, 2024-05-10T03:43:47.534 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "influxdb python module not found", 2024-05-10T03:43:47.534 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.534 INFO:teuthology.orchestra.run.smithi045.stdout: "batch_size": { 2024-05-10T03:43:47.534 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "batch_size", 2024-05-10T03:43:47.534 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.534 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.534 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.534 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5000", 2024-05-10T03:43:47.534 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.534 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.534 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.534 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-10T03:43:47.534 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.534 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.535 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.535 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.535 INFO:teuthology.orchestra.run.smithi045.stdout: "database": { 2024-05-10T03:43:47.535 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "database", 2024-05-10T03:43:47.535 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.535 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.535 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.535 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "ceph", 2024-05-10T03:43:47.535 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.535 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.535 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.535 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-10T03:43:47.535 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.536 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.536 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.536 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.536 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": { 2024-05-10T03:43:47.536 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "hostname", 2024-05-10T03:43:47.536 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.536 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.536 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.536 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.536 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.536 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.536 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.536 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "InfluxDB server hostname", 2024-05-10T03:43:47.536 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.536 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.537 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.537 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.537 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-05-10T03:43:47.537 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-05-10T03:43:47.537 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.537 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.537 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.537 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "30", 2024-05-10T03:43:47.537 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "5", 2024-05-10T03:43:47.537 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.537 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.537 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-10T03:43:47.537 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.538 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.538 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.538 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.538 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.538 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.538 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.538 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.538 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.538 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.538 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.538 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.538 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.538 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.538 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.539 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.539 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.539 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.539 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.539 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.539 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.539 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.539 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.539 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.539 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.539 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.539 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.539 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.539 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.540 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.540 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.540 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.540 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.540 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.540 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.540 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.540 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.540 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.540 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.540 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.540 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.540 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.540 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.540 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.541 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.541 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.541 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.541 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.541 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.541 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.541 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.541 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.541 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.541 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.541 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.541 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.541 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.541 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.541 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.542 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.542 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.542 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.542 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.542 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.542 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.542 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.542 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.542 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.542 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.542 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.542 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.542 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.542 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.543 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.543 INFO:teuthology.orchestra.run.smithi045.stdout: "password": { 2024-05-10T03:43:47.543 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "password", 2024-05-10T03:43:47.543 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.543 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.543 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.543 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.543 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.543 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.543 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.543 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "password of InfluxDB server user", 2024-05-10T03:43:47.543 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.543 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.543 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.544 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.544 INFO:teuthology.orchestra.run.smithi045.stdout: "port": { 2024-05-10T03:43:47.544 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "port", 2024-05-10T03:43:47.544 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.544 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.544 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.544 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8086", 2024-05-10T03:43:47.544 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.544 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.544 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.544 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "InfluxDB server port", 2024-05-10T03:43:47.544 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.544 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.544 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.544 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.545 INFO:teuthology.orchestra.run.smithi045.stdout: "ssl": { 2024-05-10T03:43:47.545 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ssl", 2024-05-10T03:43:47.545 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.545 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.545 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.545 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "false", 2024-05-10T03:43:47.545 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.545 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.545 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.545 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-10T03:43:47.545 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.545 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.545 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.545 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.546 INFO:teuthology.orchestra.run.smithi045.stdout: "threads": { 2024-05-10T03:43:47.546 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "threads", 2024-05-10T03:43:47.546 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.546 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.546 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.546 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-05-10T03:43:47.546 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1", 2024-05-10T03:43:47.546 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "32", 2024-05-10T03:43:47.546 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.546 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-10T03:43:47.546 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.546 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.546 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.546 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.547 INFO:teuthology.orchestra.run.smithi045.stdout: "username": { 2024-05-10T03:43:47.547 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "username", 2024-05-10T03:43:47.547 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.547 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.547 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.547 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.547 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.547 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.547 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.547 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "username of InfluxDB server user", 2024-05-10T03:43:47.547 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.547 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.547 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.547 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.548 INFO:teuthology.orchestra.run.smithi045.stdout: "verify_ssl": { 2024-05-10T03:43:47.548 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "verify_ssl", 2024-05-10T03:43:47.548 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.548 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.548 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.548 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "true", 2024-05-10T03:43:47.548 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.548 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.548 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.548 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-10T03:43:47.548 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.548 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.548 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.548 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.548 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.549 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.549 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.549 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "insights", 2024-05-10T03:43:47.549 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.549 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.549 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.549 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.549 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.549 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.549 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.549 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.549 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.549 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.549 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.549 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.550 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.550 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.550 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.550 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.550 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.550 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.550 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.550 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.550 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.550 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.550 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.550 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.550 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.551 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.551 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.551 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.551 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.551 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.551 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.551 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.551 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.551 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.551 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.551 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.551 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.551 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.551 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.552 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.552 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.552 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.552 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.552 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.552 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.552 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.552 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.552 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.552 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.552 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.552 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.552 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.552 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.553 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.553 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.553 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.553 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.553 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.553 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.553 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.553 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.553 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.553 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.553 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.553 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.553 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.553 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.553 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.554 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.554 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.554 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.554 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.554 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.554 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.554 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.554 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.554 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "iostat", 2024-05-10T03:43:47.554 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.554 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.554 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.554 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.554 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.555 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.555 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.555 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.555 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.555 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.555 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.555 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.555 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.555 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.555 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.555 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.555 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.555 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.555 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.555 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.556 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.556 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.556 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.556 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.556 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.556 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.556 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.556 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.556 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.556 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.556 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.556 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.556 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.556 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.557 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.557 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.557 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.557 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.557 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.557 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.557 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.557 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.557 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.557 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.557 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.557 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.557 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.557 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.557 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.558 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.558 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.558 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.558 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.558 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.558 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.558 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.558 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.558 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.558 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.558 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.558 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.558 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.558 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.559 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.559 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.559 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.559 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.559 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.559 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.559 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.559 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.559 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.559 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.559 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.559 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.559 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.559 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "k8sevents", 2024-05-10T03:43:47.559 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.560 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.560 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.560 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_event_retention_days": { 2024-05-10T03:43:47.560 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ceph_event_retention_days", 2024-05-10T03:43:47.560 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.560 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.560 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.560 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "7", 2024-05-10T03:43:47.560 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.560 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.560 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.560 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-10T03:43:47.560 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.560 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.561 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.561 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.561 INFO:teuthology.orchestra.run.smithi045.stdout: "config_check_secs": { 2024-05-10T03:43:47.561 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "config_check_secs", 2024-05-10T03:43:47.561 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.561 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.561 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.561 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-05-10T03:43:47.561 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "10", 2024-05-10T03:43:47.561 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.561 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.561 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-10T03:43:47.561 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.561 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.561 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.562 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.562 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.562 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.562 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.562 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.562 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.562 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.562 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.562 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.562 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.562 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.562 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.562 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.562 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.562 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.563 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.563 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.563 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.563 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.563 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.563 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.563 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.563 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.563 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.563 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.563 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.563 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.563 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.563 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.564 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.564 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.564 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.564 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.564 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.564 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.564 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.564 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.564 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.564 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.564 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.564 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.564 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.565 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.565 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.565 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.565 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.565 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.565 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.565 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.565 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.565 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.565 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.565 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.565 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.565 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.565 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.565 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.566 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.566 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.566 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.566 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.566 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.566 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.566 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.566 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.566 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.566 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.566 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.566 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.566 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.566 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.567 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.567 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.567 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.567 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "localpool", 2024-05-10T03:43:47.567 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.567 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.567 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.567 INFO:teuthology.orchestra.run.smithi045.stdout: "failure_domain": { 2024-05-10T03:43:47.567 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "failure_domain", 2024-05-10T03:43:47.567 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.567 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.567 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.567 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "host", 2024-05-10T03:43:47.567 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.567 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "failure domain for any created local pool", 2024-05-10T03:43:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-10T03:43:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.568 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.569 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.569 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.569 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.569 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.569 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.569 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.569 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.569 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.569 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.569 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.569 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.569 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.569 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.569 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.570 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.570 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.570 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.570 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.570 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.570 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.570 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.570 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.570 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.570 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.570 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.570 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.570 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.570 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.571 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.572 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.572 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.572 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.572 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.572 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.572 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.572 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.572 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.572 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.572 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.572 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.572 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.572 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.572 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.572 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": { 2024-05-10T03:43:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "min_size", 2024-05-10T03:43:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "default min_size for any created local pool", 2024-05-10T03:43:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-10T03:43:47.573 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.574 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.574 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.574 INFO:teuthology.orchestra.run.smithi045.stdout: "num_rep": { 2024-05-10T03:43:47.574 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "num_rep", 2024-05-10T03:43:47.574 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.574 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.574 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.574 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "3", 2024-05-10T03:43:47.574 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.574 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.574 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.574 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "default replica count for any created local pool", 2024-05-10T03:43:47.574 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.574 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": { 2024-05-10T03:43:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "pg_num", 2024-05-10T03:43:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "128", 2024-05-10T03:43:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "default pg_num for any created local pool", 2024-05-10T03:43:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.575 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: "prefix": { 2024-05-10T03:43:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "prefix", 2024-05-10T03:43:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "name prefix for any created local pool", 2024-05-10T03:43:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.576 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: "subtree": { 2024-05-10T03:43:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "subtree", 2024-05-10T03:43:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "rack", 2024-05-10T03:43:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-10T03:43:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-10T03:43:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.577 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.578 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.578 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.578 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mds_autoscaler", 2024-05-10T03:43:47.578 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.578 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.578 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.578 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.578 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.578 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.578 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.578 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.578 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.578 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.578 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.579 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.579 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.579 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.579 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.579 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.579 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.579 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.579 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.579 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.579 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.579 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.579 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.579 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.579 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.579 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.580 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.580 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.580 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.580 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.580 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.580 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.580 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.580 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.580 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.580 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.580 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.580 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.580 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.580 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.580 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.581 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.581 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.581 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.581 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.581 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.581 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.581 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.581 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.581 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.581 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.581 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.581 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.581 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.581 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.581 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.582 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.582 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.582 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.582 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.582 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.582 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.582 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.582 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.582 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.582 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.582 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.582 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.582 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.582 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.582 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.583 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.583 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.583 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.583 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.583 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.583 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mirroring", 2024-05-10T03:43:47.583 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.583 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.583 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.583 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.583 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.583 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.583 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.583 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.583 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.584 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.584 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.584 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.584 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.584 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.584 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.584 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.584 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.584 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.584 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.584 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.584 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.584 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.584 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.584 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.585 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.585 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.585 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.585 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.585 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.585 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.585 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.585 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.585 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.585 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.585 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.585 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.585 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.585 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.585 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.585 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.586 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.586 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.586 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.586 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.586 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.586 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.586 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.586 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.586 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.586 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.586 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.586 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.586 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.586 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.587 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.587 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.587 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.587 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.587 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.587 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.587 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.587 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.587 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.587 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.587 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.587 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.587 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.587 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.587 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.587 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.588 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.588 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.588 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.588 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.588 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.588 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.588 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "nfs", 2024-05-10T03:43:47.588 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.588 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.588 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.588 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.588 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.588 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.588 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.588 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.589 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.589 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.589 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.589 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.589 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.589 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.589 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.589 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.589 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.589 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.589 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.589 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.589 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.589 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.589 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.590 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.590 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.590 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.590 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.590 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.590 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.590 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.590 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.590 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.590 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.590 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.590 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.590 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.590 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.591 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.591 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.591 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.591 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.591 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.591 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.591 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.591 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.591 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.591 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.591 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.591 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.591 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.591 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.592 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.592 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.592 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.592 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.592 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.592 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.592 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.592 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.592 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.592 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.592 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.592 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.592 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.592 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.592 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.592 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.593 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.593 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.593 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.593 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.593 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.593 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.593 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.593 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.593 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.593 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "orchestrator", 2024-05-10T03:43:47.593 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.593 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.593 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.593 INFO:teuthology.orchestra.run.smithi045.stdout: "fail_fs": { 2024-05-10T03:43:47.593 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "fail_fs", 2024-05-10T03:43:47.594 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.594 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.594 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.594 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.594 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.594 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.594 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.594 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-10T03:43:47.594 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.594 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.594 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.594 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.594 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.594 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.595 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.595 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.595 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.595 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.595 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.595 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.595 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.595 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.595 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.595 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.595 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.595 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.595 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.595 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.595 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.596 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.596 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.596 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.596 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.596 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.596 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.596 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.596 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.596 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.596 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.596 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.596 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.596 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.596 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.596 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.597 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.597 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.597 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.597 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.597 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.597 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.597 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.597 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.597 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.597 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.597 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.597 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.597 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.597 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.597 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.597 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.598 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.598 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.598 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.598 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.598 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.598 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.598 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.598 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.598 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.598 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.598 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.598 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.598 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.598 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.598 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.599 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.599 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.599 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.599 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.599 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.599 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.599 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.599 INFO:teuthology.orchestra.run.smithi045.stdout: "orchestrator": { 2024-05-10T03:43:47.599 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "orchestrator", 2024-05-10T03:43:47.599 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.599 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.599 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.599 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.599 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.599 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.600 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.600 INFO:teuthology.orchestra.run.smithi045.stdout: "cephadm", 2024-05-10T03:43:47.600 INFO:teuthology.orchestra.run.smithi045.stdout: "rook", 2024-05-10T03:43:47.600 INFO:teuthology.orchestra.run.smithi045.stdout: "test_orchestrator" 2024-05-10T03:43:47.600 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.600 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Orchestrator backend", 2024-05-10T03:43:47.600 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.600 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.600 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.600 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.600 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.600 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.600 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.600 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "osd_perf_query", 2024-05-10T03:43:47.600 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.601 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.602 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.603 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.604 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.605 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.605 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.605 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.605 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.605 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.605 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.605 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.605 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.605 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.606 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.607 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.607 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.607 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.607 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.607 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.607 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.607 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "osd_support", 2024-05-10T03:43:47.607 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.607 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.607 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.607 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.607 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.607 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.607 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.608 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.608 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.608 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.608 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.608 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.608 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.608 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.608 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.608 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.608 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.608 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.608 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.608 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.608 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.608 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.609 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.609 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.609 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.609 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.609 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.609 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.609 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.609 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.609 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.609 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.609 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.609 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.609 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.609 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.610 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.610 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.610 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.610 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.610 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.610 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.610 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.610 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.610 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.610 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.610 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.610 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.610 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.610 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.610 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.611 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.611 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.611 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.611 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.611 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.611 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.611 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.611 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.611 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.611 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.611 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.611 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.611 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.611 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.612 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.612 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.612 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.612 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.612 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.612 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.612 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.612 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.612 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.612 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.612 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.612 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "pg_autoscaler", 2024-05-10T03:43:47.612 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.612 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.612 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.612 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.613 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.613 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.613 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.613 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.613 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.613 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.613 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.613 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.613 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.613 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.613 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.613 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.613 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.613 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.613 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.613 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.614 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.614 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.614 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.614 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.614 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.614 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.614 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.614 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.614 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.614 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.614 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.614 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.614 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.614 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.615 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.615 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.615 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.615 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.615 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.615 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.615 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.615 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.615 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.615 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.615 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.615 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.615 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.615 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.616 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.616 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.616 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.616 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.616 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.616 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.616 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.616 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.616 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.616 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.616 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.616 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.616 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.616 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-05-10T03:43:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-05-10T03:43:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.617 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.618 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.618 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-05-10T03:43:47.618 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.618 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.618 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.618 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.618 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.618 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.618 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.618 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.618 INFO:teuthology.orchestra.run.smithi045.stdout: "threshold": { 2024-05-10T03:43:47.618 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "threshold", 2024-05-10T03:43:47.619 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-05-10T03:43:47.619 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.619 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.619 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "3.0", 2024-05-10T03:43:47.619 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1.0", 2024-05-10T03:43:47.619 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.619 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.619 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "scaling threshold", 2024-05-10T03:43:47.619 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-10T03:43:47.619 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.619 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.619 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.619 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.619 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.620 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.620 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "progress", 2024-05-10T03:43:47.620 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.620 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.620 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.620 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_pg_recovery_event": { 2024-05-10T03:43:47.620 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "allow_pg_recovery_event", 2024-05-10T03:43:47.620 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.620 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.620 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.620 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.620 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.620 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.620 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.621 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-10T03:43:47.621 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.621 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.621 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.621 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.621 INFO:teuthology.orchestra.run.smithi045.stdout: "enabled": { 2024-05-10T03:43:47.621 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "enabled", 2024-05-10T03:43:47.621 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.621 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.621 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.621 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.621 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.621 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.621 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.622 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.622 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.622 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.622 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.622 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.622 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.622 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.622 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.622 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.622 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.622 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.622 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.622 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.622 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.622 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.623 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.623 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.623 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.623 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.623 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.623 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.623 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.623 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.623 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.623 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.623 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.623 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.623 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.624 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.625 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.626 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.626 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.626 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.626 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.626 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.626 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.626 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.626 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.626 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.626 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.626 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.626 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.626 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.626 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.626 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.627 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.627 INFO:teuthology.orchestra.run.smithi045.stdout: "max_completed_events": { 2024-05-10T03:43:47.627 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_completed_events", 2024-05-10T03:43:47.627 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.627 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.627 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.627 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "50", 2024-05-10T03:43:47.627 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.627 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.627 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.627 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "number of past completed events to remember", 2024-05-10T03:43:47.627 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.627 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.627 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.627 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.628 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-05-10T03:43:47.628 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-05-10T03:43:47.628 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.628 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.628 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.628 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-05-10T03:43:47.628 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.628 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.628 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.628 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how long the module is going to sleep", 2024-05-10T03:43:47.628 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.628 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.628 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.628 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.628 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.628 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.629 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.629 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "prometheus", 2024-05-10T03:43:47.629 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.629 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.629 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.629 INFO:teuthology.orchestra.run.smithi045.stdout: "cache": { 2024-05-10T03:43:47.629 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cache", 2024-05-10T03:43:47.629 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.629 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.629 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.629 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.629 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.629 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.629 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.630 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.630 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.630 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.630 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.630 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.630 INFO:teuthology.orchestra.run.smithi045.stdout: "exclude_perf_counters": { 2024-05-10T03:43:47.630 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "exclude_perf_counters", 2024-05-10T03:43:47.630 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.630 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.630 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.630 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.630 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.630 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.630 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.631 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-10T03:43:47.631 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-10T03:43:47.631 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.631 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.631 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.631 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.631 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.631 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.631 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.631 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.631 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.631 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.631 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.632 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.632 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.632 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.632 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.632 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.632 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.632 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.632 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.632 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.632 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.632 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.632 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.632 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.633 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.633 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.633 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.633 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.633 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.633 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.633 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.633 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.633 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.633 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.633 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.633 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.633 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.633 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.634 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.634 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.634 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.634 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.634 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.634 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.634 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.634 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.634 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.634 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.634 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.634 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.634 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.634 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.635 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.635 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.635 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.635 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.635 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.635 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.635 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.635 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.635 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.635 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.635 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.635 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.635 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.635 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.635 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.636 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.636 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.636 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.636 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.636 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.636 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.636 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_stats_pools": { 2024-05-10T03:43:47.636 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rbd_stats_pools", 2024-05-10T03:43:47.636 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.636 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.636 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.636 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.636 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.636 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.636 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.637 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.637 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.637 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.637 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.637 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.637 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-10T03:43:47.637 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-10T03:43:47.637 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.637 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.637 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.637 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "300", 2024-05-10T03:43:47.637 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.637 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.637 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.637 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.638 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.638 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.638 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.638 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.638 INFO:teuthology.orchestra.run.smithi045.stdout: "scrape_interval": { 2024-05-10T03:43:47.638 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "scrape_interval", 2024-05-10T03:43:47.638 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-05-10T03:43:47.638 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.638 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.638 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "15.0", 2024-05-10T03:43:47.638 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.638 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.638 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.638 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.639 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.639 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.639 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.639 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.639 INFO:teuthology.orchestra.run.smithi045.stdout: "server_addr": { 2024-05-10T03:43:47.639 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_addr", 2024-05-10T03:43:47.639 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.639 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.639 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.639 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "::", 2024-05-10T03:43:47.639 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.639 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.639 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.639 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-10T03:43:47.639 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.640 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.640 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.640 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.640 INFO:teuthology.orchestra.run.smithi045.stdout: "server_port": { 2024-05-10T03:43:47.640 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_port", 2024-05-10T03:43:47.640 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.640 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.640 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.640 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "9283", 2024-05-10T03:43:47.640 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.640 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.640 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.640 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-10T03:43:47.640 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.640 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.641 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.641 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.641 INFO:teuthology.orchestra.run.smithi045.stdout: "stale_cache_strategy": { 2024-05-10T03:43:47.641 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "stale_cache_strategy", 2024-05-10T03:43:47.641 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.641 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.641 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.641 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "log", 2024-05-10T03:43:47.641 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.641 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.641 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.641 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.641 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.641 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.641 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.642 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.642 INFO:teuthology.orchestra.run.smithi045.stdout: "standby_behaviour": { 2024-05-10T03:43:47.642 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "standby_behaviour", 2024-05-10T03:43:47.642 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.642 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.642 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.642 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "default", 2024-05-10T03:43:47.642 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.642 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.642 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.642 INFO:teuthology.orchestra.run.smithi045.stdout: "default", 2024-05-10T03:43:47.642 INFO:teuthology.orchestra.run.smithi045.stdout: "error" 2024-05-10T03:43:47.642 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.642 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.643 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.643 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.643 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.643 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.643 INFO:teuthology.orchestra.run.smithi045.stdout: "standby_error_status_code": { 2024-05-10T03:43:47.643 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "standby_error_status_code", 2024-05-10T03:43:47.643 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.643 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.643 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.643 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "500", 2024-05-10T03:43:47.643 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "400", 2024-05-10T03:43:47.643 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "599", 2024-05-10T03:43:47.643 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.643 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.644 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.644 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.644 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.644 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.644 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.644 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.644 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.644 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rbd_support", 2024-05-10T03:43:47.644 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.644 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.644 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.644 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.644 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.644 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.645 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.645 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.645 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.645 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.645 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.645 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.645 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.645 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.645 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.645 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.645 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.645 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.645 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.646 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.646 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.646 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.646 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.646 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.646 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.646 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.646 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.646 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.646 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.646 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.646 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.646 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.647 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.647 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.647 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.647 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.647 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.647 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.647 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.647 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.647 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.647 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.647 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.647 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.647 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.647 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.647 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.648 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.648 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.648 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.648 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.648 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.648 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.648 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.648 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.648 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.648 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.648 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.648 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.648 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.648 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.648 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.649 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.649 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.649 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.649 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.649 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.649 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.649 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.649 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.649 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.649 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.649 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.649 INFO:teuthology.orchestra.run.smithi045.stdout: "max_concurrent_snap_create": { 2024-05-10T03:43:47.649 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_concurrent_snap_create", 2024-05-10T03:43:47.649 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.650 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.650 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.650 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-05-10T03:43:47.650 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.650 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.650 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.650 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.650 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.650 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.650 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.650 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.650 INFO:teuthology.orchestra.run.smithi045.stdout: "mirror_snapshot_schedule": { 2024-05-10T03:43:47.650 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mirror_snapshot_schedule", 2024-05-10T03:43:47.650 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.651 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.651 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.651 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.651 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.651 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.651 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.651 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.651 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.651 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.651 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.651 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.651 INFO:teuthology.orchestra.run.smithi045.stdout: "trash_purge_schedule": { 2024-05-10T03:43:47.651 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "trash_purge_schedule", 2024-05-10T03:43:47.651 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.651 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.652 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.652 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.652 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.652 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.652 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.652 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.652 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.652 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.652 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.652 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.652 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.652 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.652 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.652 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "restful", 2024-05-10T03:43:47.652 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.653 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.653 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.653 INFO:teuthology.orchestra.run.smithi045.stdout: "enable_auth": { 2024-05-10T03:43:47.653 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "enable_auth", 2024-05-10T03:43:47.653 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.653 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.653 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.653 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.653 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.653 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.653 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.653 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.653 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.653 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.654 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.654 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.654 INFO:teuthology.orchestra.run.smithi045.stdout: "key_file": { 2024-05-10T03:43:47.654 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "key_file", 2024-05-10T03:43:47.654 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.654 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.654 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.654 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.654 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.654 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.654 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.654 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.654 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.654 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.655 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.655 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.655 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.655 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.655 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.655 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.655 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.655 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.655 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.655 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.655 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.655 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.655 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.655 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.655 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.656 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.656 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.656 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.656 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.656 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.656 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.656 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.656 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.656 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.656 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.656 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.656 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.656 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.656 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.656 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.656 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.657 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.657 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.657 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.657 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.657 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.657 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.657 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.657 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.657 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.657 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.660 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.660 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.660 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.660 INFO:teuthology.orchestra.run.smithi045.stdout: "server_addr": { 2024-05-10T03:43:47.660 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_addr", 2024-05-10T03:43:47.660 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.660 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.660 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.660 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.660 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.660 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.660 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.660 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.660 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.660 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: "server_port": { 2024-05-10T03:43:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_port", 2024-05-10T03:43:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.661 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.662 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.662 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.662 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.662 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.662 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rgw", 2024-05-10T03:43:47.662 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.662 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.662 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.662 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.662 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.662 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.662 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.662 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.663 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.663 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.663 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.663 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.663 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.663 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.663 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.663 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.663 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.663 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.663 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.663 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.663 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.663 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.663 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.664 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.664 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.664 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.664 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.664 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.664 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.664 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.664 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.664 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.664 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.664 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.664 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.664 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.664 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.664 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.665 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.665 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.665 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.665 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.665 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.665 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.665 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.665 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.665 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.665 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.665 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.665 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.665 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.665 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.665 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.666 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.666 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.666 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.666 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.666 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.666 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.666 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.666 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.666 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.666 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.666 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.666 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.666 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.666 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.667 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.667 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.667 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.667 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.667 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.667 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.667 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.667 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.667 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.667 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rook", 2024-05-10T03:43:47.667 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.667 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.667 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.667 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.667 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.668 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.668 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.668 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.668 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.668 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.668 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.668 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.668 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.668 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.668 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.668 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.668 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.668 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.668 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.669 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.669 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.669 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.669 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.669 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.669 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.669 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.669 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.669 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.669 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.669 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.669 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.669 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.669 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.669 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.670 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.670 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.670 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.670 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.670 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.670 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.670 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.670 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.670 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.670 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.670 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.670 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.670 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.670 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.670 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.671 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.671 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.671 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.671 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.671 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.671 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.671 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.671 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.671 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.671 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.671 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.671 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.671 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.672 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.672 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.672 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.672 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.672 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.672 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.672 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.672 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.672 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.672 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.672 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.672 INFO:teuthology.orchestra.run.smithi045.stdout: "storage_class": { 2024-05-10T03:43:47.672 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "storage_class", 2024-05-10T03:43:47.672 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.672 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.673 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.673 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "local", 2024-05-10T03:43:47.673 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.673 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.673 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.673 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-10T03:43:47.673 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.673 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.673 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.673 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.673 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.673 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.673 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.673 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "selftest", 2024-05-10T03:43:47.674 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.674 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.674 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.674 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.674 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.674 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.674 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.674 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.674 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.674 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.674 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.674 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.674 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.674 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.674 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.675 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.675 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.675 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.675 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.675 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.675 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.675 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.675 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.675 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.675 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.675 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.675 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.675 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.675 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.675 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.676 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.676 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.676 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.676 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.676 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.676 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.676 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.676 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.676 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.676 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.676 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.676 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.676 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.676 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.676 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.677 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.677 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.677 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.677 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.677 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.677 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.677 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.677 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.677 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.677 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.677 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.677 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.677 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.677 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.678 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.678 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.678 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.678 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.678 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.678 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.678 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.678 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.678 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.678 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.678 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.678 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.678 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.678 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.678 INFO:teuthology.orchestra.run.smithi045.stdout: "roption1": { 2024-05-10T03:43:47.679 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "roption1", 2024-05-10T03:43:47.679 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.679 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.679 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.679 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.679 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.679 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.679 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.679 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.679 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.679 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.679 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.679 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.679 INFO:teuthology.orchestra.run.smithi045.stdout: "roption2": { 2024-05-10T03:43:47.679 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "roption2", 2024-05-10T03:43:47.680 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.680 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.680 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.680 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "xyz", 2024-05-10T03:43:47.680 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.680 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.680 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.680 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.680 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.680 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.680 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.680 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.680 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption1": { 2024-05-10T03:43:47.680 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption1", 2024-05-10T03:43:47.680 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.681 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.681 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.681 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.681 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.681 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.681 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.681 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.681 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.681 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.681 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.681 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.681 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption2": { 2024-05-10T03:43:47.681 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption2", 2024-05-10T03:43:47.681 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.681 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.682 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.682 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.682 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.682 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.682 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.682 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.682 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.682 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.682 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.682 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.682 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption3": { 2024-05-10T03:43:47.682 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption3", 2024-05-10T03:43:47.682 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-05-10T03:43:47.682 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.683 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.683 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.683 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.683 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.683 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.683 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.683 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.683 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.683 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.683 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.683 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption4": { 2024-05-10T03:43:47.683 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption4", 2024-05-10T03:43:47.683 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.683 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.683 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.684 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.684 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.684 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.684 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.684 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.684 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.684 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.684 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.684 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.684 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption5": { 2024-05-10T03:43:47.684 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption5", 2024-05-10T03:43:47.684 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.684 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.684 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.685 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.685 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.685 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.685 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.685 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.685 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.685 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.685 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.685 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.685 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption6": { 2024-05-10T03:43:47.685 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption6", 2024-05-10T03:43:47.685 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.685 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.685 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.685 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.686 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.686 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.686 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.686 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.686 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.686 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.686 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.686 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.686 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption7": { 2024-05-10T03:43:47.686 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption7", 2024-05-10T03:43:47.686 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.686 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.686 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.686 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.687 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1", 2024-05-10T03:43:47.687 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "42", 2024-05-10T03:43:47.687 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.687 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.687 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.687 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.687 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.687 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.687 INFO:teuthology.orchestra.run.smithi045.stdout: "testkey": { 2024-05-10T03:43:47.687 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "testkey", 2024-05-10T03:43:47.687 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.687 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.687 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.687 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.688 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.688 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.688 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.688 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.688 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.688 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.688 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.688 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.688 INFO:teuthology.orchestra.run.smithi045.stdout: "testlkey": { 2024-05-10T03:43:47.688 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "testlkey", 2024-05-10T03:43:47.688 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.688 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.688 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.688 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.688 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.689 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.689 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.689 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.689 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.689 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.689 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.689 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.689 INFO:teuthology.orchestra.run.smithi045.stdout: "testnewline": { 2024-05-10T03:43:47.689 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "testnewline", 2024-05-10T03:43:47.689 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.689 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.689 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.689 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.689 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.690 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.690 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.690 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.690 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.690 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.690 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.690 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.690 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.690 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.690 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.690 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "snap_schedule", 2024-05-10T03:43:47.690 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.690 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.690 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.691 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_m_granularity": { 2024-05-10T03:43:47.691 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "allow_m_granularity", 2024-05-10T03:43:47.691 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.691 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.691 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.691 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.691 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.691 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.691 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.691 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "allow minute scheduled snapshots", 2024-05-10T03:43:47.691 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.691 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.691 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.691 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.691 INFO:teuthology.orchestra.run.smithi045.stdout: "dump_on_update": { 2024-05-10T03:43:47.692 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "dump_on_update", 2024-05-10T03:43:47.692 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.692 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.692 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.692 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.692 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.692 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.692 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.692 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "dump database to debug log on update", 2024-05-10T03:43:47.692 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.692 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.692 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.692 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.692 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.692 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.693 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.693 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.693 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.693 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.693 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.693 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.693 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.693 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.693 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.693 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.693 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.693 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.693 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.693 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.693 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.693 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.694 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.694 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.694 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.694 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.694 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.694 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.694 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.694 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.694 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.694 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.694 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.694 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.694 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.694 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.695 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.695 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.695 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.695 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.695 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.695 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.695 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.695 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.695 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.695 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.695 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.695 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.695 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.695 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.695 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.695 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.696 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.696 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.696 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.696 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.696 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.696 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.696 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.696 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.696 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.696 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.696 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.696 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.696 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.696 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.696 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.697 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.697 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.697 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.697 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.697 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.697 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.697 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.697 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.697 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.697 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.697 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "stats", 2024-05-10T03:43:47.697 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.697 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.697 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.697 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.698 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.698 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.698 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.698 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.698 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.698 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.698 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.698 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.698 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.698 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.698 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.698 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.698 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.698 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.699 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.699 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.699 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.699 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.699 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.699 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.699 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.699 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.699 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.699 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.699 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.699 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.699 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.699 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.699 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.700 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.700 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.700 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.700 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.700 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.700 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.700 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.700 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.700 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.700 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.700 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.700 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.700 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.700 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.700 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.701 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.701 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.701 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.701 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.701 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.701 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.701 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.701 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.701 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.701 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.701 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.701 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.701 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.701 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.701 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.702 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.702 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.702 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.702 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.702 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.702 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.702 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.702 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.702 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.702 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.702 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.702 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.702 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.702 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "status", 2024-05-10T03:43:47.702 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.703 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.703 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.703 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.703 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.703 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.703 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.703 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.703 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.703 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.703 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.703 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.703 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.703 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.703 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.704 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.704 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.704 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.704 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.704 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.704 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.704 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.704 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.704 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.704 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.704 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.704 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.704 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.704 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.704 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.705 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.705 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.705 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.705 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.705 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.705 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.705 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.705 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.705 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.705 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.705 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.705 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.705 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.705 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.705 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.705 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.706 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.706 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.706 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.706 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.706 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.706 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.706 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.706 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.706 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.706 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.706 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.706 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.706 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.706 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.707 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.707 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.707 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.707 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.707 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.707 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.707 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.707 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.707 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.707 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.707 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.707 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.707 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.707 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.707 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.708 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.708 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "telegraf", 2024-05-10T03:43:47.708 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.708 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.708 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.708 INFO:teuthology.orchestra.run.smithi045.stdout: "address": { 2024-05-10T03:43:47.708 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "address", 2024-05-10T03:43:47.708 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.708 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.708 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.708 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-10T03:43:47.708 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.708 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.708 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.708 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.708 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.709 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.709 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.709 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.709 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-05-10T03:43:47.709 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-05-10T03:43:47.709 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.709 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.709 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.709 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "15", 2024-05-10T03:43:47.709 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.709 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.709 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.709 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.709 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.709 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.710 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.710 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.710 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.710 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.710 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.710 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.710 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.710 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.710 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.710 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.710 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.710 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.710 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.710 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.710 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.711 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.711 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.711 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.711 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.711 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.711 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.711 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.711 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.711 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.711 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.711 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.711 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.711 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.711 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.712 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.712 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.712 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.712 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.712 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.712 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.712 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.712 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.712 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.712 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.712 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.712 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.712 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.712 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.713 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.713 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.713 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.713 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.713 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.713 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.713 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.713 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.713 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.713 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.713 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.713 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.713 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.713 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.713 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.714 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.714 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.714 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.714 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.714 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.714 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.714 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.714 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.714 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.714 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.714 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.714 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.714 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.714 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.714 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.715 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.715 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.715 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "telemetry", 2024-05-10T03:43:47.715 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.715 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.715 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.715 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_basic": { 2024-05-10T03:43:47.715 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_basic", 2024-05-10T03:43:47.715 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.715 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.715 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.715 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.715 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.715 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.716 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.716 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-10T03:43:47.716 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.716 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.716 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.716 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.716 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_crash": { 2024-05-10T03:43:47.716 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_crash", 2024-05-10T03:43:47.716 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.716 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.716 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.716 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.716 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.716 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.717 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.717 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-10T03:43:47.717 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.717 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.717 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.717 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.717 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_device": { 2024-05-10T03:43:47.717 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_device", 2024-05-10T03:43:47.717 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.717 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.717 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.717 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.717 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.717 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.717 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.718 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-10T03:43:47.718 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.718 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.718 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.718 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.718 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_ident": { 2024-05-10T03:43:47.718 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_ident", 2024-05-10T03:43:47.718 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.718 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.718 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.718 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.718 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.718 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.718 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.719 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-10T03:43:47.719 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.719 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.719 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.719 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.719 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_perf": { 2024-05-10T03:43:47.719 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_perf", 2024-05-10T03:43:47.719 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.719 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.719 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.719 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.719 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.719 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.719 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.719 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-10T03:43:47.720 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.720 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.720 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.720 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.720 INFO:teuthology.orchestra.run.smithi045.stdout: "contact": { 2024-05-10T03:43:47.720 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "contact", 2024-05-10T03:43:47.720 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.720 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.720 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.720 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.720 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.720 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.720 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.720 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.720 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.721 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.721 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.721 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.721 INFO:teuthology.orchestra.run.smithi045.stdout: "description": { 2024-05-10T03:43:47.721 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "description", 2024-05-10T03:43:47.721 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.721 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.721 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.721 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.721 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.721 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.721 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.721 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.721 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.722 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.722 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.722 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.722 INFO:teuthology.orchestra.run.smithi045.stdout: "device_url": { 2024-05-10T03:43:47.722 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "device_url", 2024-05-10T03:43:47.722 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.722 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.722 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.722 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-10T03:43:47.722 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.722 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.722 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.722 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.722 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.722 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.723 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.723 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.723 INFO:teuthology.orchestra.run.smithi045.stdout: "enabled": { 2024-05-10T03:43:47.723 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "enabled", 2024-05-10T03:43:47.723 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.723 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.723 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.723 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.723 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.723 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.723 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.723 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.723 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.724 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.724 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.724 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.724 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-05-10T03:43:47.724 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-05-10T03:43:47.724 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.724 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.724 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.724 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "24", 2024-05-10T03:43:47.724 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "8", 2024-05-10T03:43:47.724 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.724 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.724 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.724 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.725 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.725 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.725 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.725 INFO:teuthology.orchestra.run.smithi045.stdout: "last_opt_revision": { 2024-05-10T03:43:47.725 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "last_opt_revision", 2024-05-10T03:43:47.725 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.725 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.725 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.725 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "1", 2024-05-10T03:43:47.725 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.725 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.725 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.725 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.725 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.726 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.726 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.726 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.726 INFO:teuthology.orchestra.run.smithi045.stdout: "leaderboard": { 2024-05-10T03:43:47.726 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "leaderboard", 2024-05-10T03:43:47.726 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.726 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.726 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.726 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.726 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.726 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.726 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.727 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.727 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.727 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.727 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.727 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.727 INFO:teuthology.orchestra.run.smithi045.stdout: "leaderboard_description": { 2024-05-10T03:43:47.727 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "leaderboard_description", 2024-05-10T03:43:47.727 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.727 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.727 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.727 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.727 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.727 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.727 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.727 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.728 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.729 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.729 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.729 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.729 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.729 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.729 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.729 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.729 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.729 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.729 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.729 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.729 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.729 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.729 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.730 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.731 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.732 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.732 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.732 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.732 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.732 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.732 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.732 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.732 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.732 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.732 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.732 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.732 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.732 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.732 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.732 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.732 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.733 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.733 INFO:teuthology.orchestra.run.smithi045.stdout: "organization": { 2024-05-10T03:43:47.733 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "organization", 2024-05-10T03:43:47.733 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.733 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.733 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.733 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.733 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.733 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.733 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.733 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.733 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.733 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.733 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.733 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.734 INFO:teuthology.orchestra.run.smithi045.stdout: "proxy": { 2024-05-10T03:43:47.734 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "proxy", 2024-05-10T03:43:47.734 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.734 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.734 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.734 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.734 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.734 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.734 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.734 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.734 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.734 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.734 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.734 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.734 INFO:teuthology.orchestra.run.smithi045.stdout: "url": { 2024-05-10T03:43:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "url", 2024-05-10T03:43:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-10T03:43:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.735 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "test_orchestrator", 2024-05-10T03:43:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.736 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.737 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.738 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.738 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.738 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.738 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.738 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.738 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.738 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.738 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.738 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.738 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.738 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.738 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.738 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.738 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.739 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.739 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.739 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.739 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.739 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.739 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.739 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.739 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.739 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.739 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.739 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.739 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.739 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.739 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.739 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.740 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.740 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.740 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.740 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.740 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.740 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.740 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.740 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.740 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.740 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.740 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.740 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.740 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.740 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.740 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.741 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.741 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.741 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.741 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "volumes", 2024-05-10T03:43:47.741 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.741 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.741 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.741 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.741 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.741 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.741 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.741 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.741 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.741 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.741 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.742 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.742 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.742 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.742 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.742 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.742 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.742 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.742 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.742 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.742 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.742 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.742 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.742 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.743 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.743 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.743 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.743 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.743 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.743 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.743 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.743 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.743 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.743 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.743 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.743 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.743 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.743 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.743 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.744 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.744 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.744 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.744 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.744 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.744 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.744 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.744 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.744 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.744 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.744 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.744 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.744 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.744 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.745 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.745 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.745 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.745 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.745 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.745 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.745 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.745 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.745 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.745 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.745 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.745 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.745 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.745 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.745 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.746 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.746 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.746 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.746 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.746 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.746 INFO:teuthology.orchestra.run.smithi045.stdout: "max_concurrent_clones": { 2024-05-10T03:43:47.746 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_concurrent_clones", 2024-05-10T03:43:47.746 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.746 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.746 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.746 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "4", 2024-05-10T03:43:47.746 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.746 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.746 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.747 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-10T03:43:47.747 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.747 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.747 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.747 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.747 INFO:teuthology.orchestra.run.smithi045.stdout: "snapshot_clone_delay": { 2024-05-10T03:43:47.747 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "snapshot_clone_delay", 2024-05-10T03:43:47.747 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.747 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.747 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.747 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-05-10T03:43:47.747 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.747 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.747 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.747 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-10T03:43:47.748 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.748 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.748 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.748 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.748 INFO:teuthology.orchestra.run.smithi045.stdout: "snapshot_clone_no_wait": { 2024-05-10T03:43:47.748 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "snapshot_clone_no_wait", 2024-05-10T03:43:47.748 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.748 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.748 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.748 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.748 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.748 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.748 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.748 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-10T03:43:47.748 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.748 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.749 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.749 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.749 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.749 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.749 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.749 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "zabbix", 2024-05-10T03:43:47.749 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.749 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.749 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.749 INFO:teuthology.orchestra.run.smithi045.stdout: "discovery_interval": { 2024-05-10T03:43:47.749 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "discovery_interval", 2024-05-10T03:43:47.749 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-05-10T03:43:47.749 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.749 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.750 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "100", 2024-05-10T03:43:47.750 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.750 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.750 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.750 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.750 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.750 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.750 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.750 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.750 INFO:teuthology.orchestra.run.smithi045.stdout: "identifier": { 2024-05-10T03:43:47.750 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "identifier", 2024-05-10T03:43:47.750 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.750 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.751 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.751 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.751 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.751 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.751 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.751 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.751 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.751 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.751 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.751 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.751 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-05-10T03:43:47.751 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-05-10T03:43:47.751 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.751 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.751 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.752 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-05-10T03:43:47.752 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.752 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.752 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.752 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.752 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.752 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.752 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.752 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.752 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.752 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.752 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.752 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.752 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.753 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.753 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.753 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.753 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.753 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.753 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.753 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.753 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.753 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.753 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.753 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.753 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.753 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.753 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.753 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.754 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.754 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.754 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.754 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.754 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.754 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.754 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.754 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.754 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.754 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.754 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.754 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.754 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.754 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.755 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.755 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.755 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.755 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.755 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.755 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.755 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.755 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.755 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.755 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.755 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.755 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.755 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.755 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.755 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.756 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.756 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.756 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.756 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.756 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.756 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.756 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.756 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.756 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.756 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.756 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.756 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.756 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.756 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.757 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.757 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.757 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.757 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.757 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.757 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.757 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.757 INFO:teuthology.orchestra.run.smithi045.stdout: "zabbix_host": { 2024-05-10T03:43:47.757 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "zabbix_host", 2024-05-10T03:43:47.757 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.757 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.757 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.758 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.758 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.758 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.758 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.758 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.758 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.758 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.758 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.758 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.758 INFO:teuthology.orchestra.run.smithi045.stdout: "zabbix_port": { 2024-05-10T03:43:47.758 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "zabbix_port", 2024-05-10T03:43:47.758 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.758 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.759 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.759 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10051", 2024-05-10T03:43:47.759 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.759 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.759 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.759 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.759 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.759 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.759 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.759 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.759 INFO:teuthology.orchestra.run.smithi045.stdout: "zabbix_sender": { 2024-05-10T03:43:47.759 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "zabbix_sender", 2024-05-10T03:43:47.759 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.759 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.760 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.760 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-10T03:43:47.760 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.760 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.760 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.760 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.760 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.760 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.760 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.760 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.760 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.760 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.760 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-05-10T03:43:47.760 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.760 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.761 INFO:teuthology.orchestra.run.smithi045.stdout: "gid": 24119, 2024-05-10T03:43:47.761 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "y", 2024-05-10T03:43:47.761 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_features": 4540138322906710015, 2024-05-10T03:43:47.761 INFO:teuthology.orchestra.run.smithi045.stdout: "available_modules": [ 2024-05-10T03:43:47.761 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.761 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "alerts", 2024-05-10T03:43:47.761 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.761 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.761 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.761 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-05-10T03:43:47.761 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-05-10T03:43:47.761 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.761 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.761 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.762 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-05-10T03:43:47.762 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.762 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.762 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.762 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "How frequently to reexamine health status", 2024-05-10T03:43:47.762 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.762 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.762 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.762 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.762 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.762 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.762 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.762 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.762 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.763 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.763 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.763 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.763 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.763 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.763 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.763 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.763 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.763 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.763 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.763 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.763 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.763 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.763 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.764 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.764 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.764 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.764 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.764 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.764 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.764 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.764 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.764 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.764 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.764 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.764 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.764 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.764 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.764 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.765 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.765 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.765 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.765 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.765 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.765 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.765 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.765 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.765 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.765 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.765 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.765 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.765 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.765 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.765 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.766 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.766 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.766 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.766 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.766 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.766 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.766 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.766 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.766 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.766 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.766 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.766 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.766 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.767 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.767 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.767 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.767 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.767 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.767 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.767 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.767 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.767 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_destination": { 2024-05-10T03:43:47.767 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_destination", 2024-05-10T03:43:47.767 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.767 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.767 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.767 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.767 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.768 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.768 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.768 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Email address to send alerts to", 2024-05-10T03:43:47.768 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.768 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.768 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.768 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.768 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_from_name": { 2024-05-10T03:43:47.768 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_from_name", 2024-05-10T03:43:47.768 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.768 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.768 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.768 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "Ceph", 2024-05-10T03:43:47.768 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.769 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.769 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.769 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Email From: name", 2024-05-10T03:43:47.769 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.769 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.769 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.769 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.769 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_host": { 2024-05-10T03:43:47.769 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_host", 2024-05-10T03:43:47.769 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.769 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.769 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.769 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.769 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.770 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.770 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.770 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "SMTP server", 2024-05-10T03:43:47.770 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.770 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.770 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.770 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.770 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_password": { 2024-05-10T03:43:47.770 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_password", 2024-05-10T03:43:47.770 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.770 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.770 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.770 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.770 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.770 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.771 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.771 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Password to authenticate with", 2024-05-10T03:43:47.771 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.771 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.771 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.771 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.771 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_port": { 2024-05-10T03:43:47.771 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_port", 2024-05-10T03:43:47.771 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.771 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.771 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.771 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "465", 2024-05-10T03:43:47.771 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.771 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.772 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.772 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "SMTP port", 2024-05-10T03:43:47.772 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.772 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.772 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.772 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.772 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_sender": { 2024-05-10T03:43:47.772 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_sender", 2024-05-10T03:43:47.772 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.772 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.772 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.772 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.772 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.772 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.772 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.772 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "SMTP envelope sender", 2024-05-10T03:43:47.773 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.773 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.773 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.773 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.773 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_ssl": { 2024-05-10T03:43:47.773 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_ssl", 2024-05-10T03:43:47.773 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.773 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.773 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.773 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.773 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.773 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.773 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.773 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-10T03:43:47.773 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.774 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.774 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.774 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.774 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_user": { 2024-05-10T03:43:47.774 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_user", 2024-05-10T03:43:47.774 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.774 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.774 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.774 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.774 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.774 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.774 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.774 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "User to authenticate as", 2024-05-10T03:43:47.774 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.774 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.775 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.775 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.775 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.775 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.775 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.775 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "balancer", 2024-05-10T03:43:47.775 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.775 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.775 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.775 INFO:teuthology.orchestra.run.smithi045.stdout: "active": { 2024-05-10T03:43:47.775 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "active", 2024-05-10T03:43:47.775 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.775 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.775 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.775 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "automatically balance PGs across cluster", 2024-05-10T03:43:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: "begin_time": { 2024-05-10T03:43:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "begin_time", 2024-05-10T03:43:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0000", 2024-05-10T03:43:47.776 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "beginning time of day to automatically balance", 2024-05-10T03:43:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-10T03:43:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: "begin_weekday": { 2024-05-10T03:43:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "begin_weekday", 2024-05-10T03:43:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-05-10T03:43:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-05-10T03:43:47.777 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "0", 2024-05-10T03:43:47.778 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "6", 2024-05-10T03:43:47.778 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.778 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-10T03:43:47.778 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-10T03:43:47.778 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.778 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.778 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.778 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_compat_max_iterations": { 2024-05-10T03:43:47.778 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crush_compat_max_iterations", 2024-05-10T03:43:47.778 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-05-10T03:43:47.778 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.778 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.778 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "25", 2024-05-10T03:43:47.778 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1", 2024-05-10T03:43:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "250", 2024-05-10T03:43:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-10T03:43:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_compat_metrics": { 2024-05-10T03:43:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crush_compat_metrics", 2024-05-10T03:43:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "pgs,objects,bytes", 2024-05-10T03:43:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.779 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.780 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.780 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-10T03:43:47.780 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-10T03:43:47.780 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.780 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.780 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.780 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_compat_step": { 2024-05-10T03:43:47.780 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crush_compat_step", 2024-05-10T03:43:47.780 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-05-10T03:43:47.780 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.780 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.780 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0.5", 2024-05-10T03:43:47.780 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "0.001", 2024-05-10T03:43:47.780 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "0.999", 2024-05-10T03:43:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "aggressiveness of optimization", 2024-05-10T03:43:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-10T03:43:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: "end_time": { 2024-05-10T03:43:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "end_time", 2024-05-10T03:43:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "2359", 2024-05-10T03:43:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.781 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "ending time of day to automatically balance", 2024-05-10T03:43:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-10T03:43:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: "end_weekday": { 2024-05-10T03:43:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "end_weekday", 2024-05-10T03:43:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-05-10T03:43:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-05-10T03:43:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "0", 2024-05-10T03:43:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "6", 2024-05-10T03:43:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.782 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-10T03:43:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-10T03:43:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.783 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.784 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.784 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.784 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.784 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.784 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.784 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.784 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.784 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.784 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.784 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.784 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.784 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.784 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.784 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.784 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.784 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.785 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.785 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.785 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.785 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.785 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.785 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.785 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.785 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.785 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.785 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.785 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.785 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.785 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.786 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.786 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.786 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.786 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.786 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.786 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.786 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.786 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.786 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.786 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.786 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.786 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.786 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.786 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.787 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.787 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.787 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.787 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.787 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.787 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.787 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.787 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.787 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.787 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.787 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.787 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.787 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.787 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.787 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.788 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.788 INFO:teuthology.orchestra.run.smithi045.stdout: "min_score": { 2024-05-10T03:43:47.788 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "min_score", 2024-05-10T03:43:47.788 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-05-10T03:43:47.788 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.788 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.788 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-05-10T03:43:47.788 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.788 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.788 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.788 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-10T03:43:47.788 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.788 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.788 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.788 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.788 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": { 2024-05-10T03:43:47.788 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mode", 2024-05-10T03:43:47.789 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.789 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.789 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.789 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "upmap", 2024-05-10T03:43:47.789 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.789 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.789 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.789 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-compat", 2024-05-10T03:43:47.789 INFO:teuthology.orchestra.run.smithi045.stdout: "none", 2024-05-10T03:43:47.789 INFO:teuthology.orchestra.run.smithi045.stdout: "upmap" 2024-05-10T03:43:47.789 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.789 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Balancer mode", 2024-05-10T03:43:47.789 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.789 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.790 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.790 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.790 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_ids": { 2024-05-10T03:43:47.790 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "pool_ids", 2024-05-10T03:43:47.790 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.790 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.790 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.790 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.790 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.790 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.790 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.790 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-10T03:43:47.790 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.790 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.791 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.791 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.791 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-05-10T03:43:47.791 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-05-10T03:43:47.791 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.791 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.791 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.791 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-05-10T03:43:47.791 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.791 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.791 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.791 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-10T03:43:47.791 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.791 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.792 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.792 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.792 INFO:teuthology.orchestra.run.smithi045.stdout: "upmap_max_deviation": { 2024-05-10T03:43:47.792 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "upmap_max_deviation", 2024-05-10T03:43:47.792 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.792 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.792 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.792 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-05-10T03:43:47.792 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1", 2024-05-10T03:43:47.792 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.792 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.792 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-10T03:43:47.792 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-10T03:43:47.792 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.792 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.792 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.793 INFO:teuthology.orchestra.run.smithi045.stdout: "upmap_max_optimizations": { 2024-05-10T03:43:47.793 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "upmap_max_optimizations", 2024-05-10T03:43:47.793 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-05-10T03:43:47.793 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.793 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.793 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-05-10T03:43:47.793 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.793 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.793 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.793 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-10T03:43:47.793 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.793 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.793 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.793 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.794 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.794 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.794 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.794 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cephadm", 2024-05-10T03:43:47.794 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.794 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.794 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.794 INFO:teuthology.orchestra.run.smithi045.stdout: "agent_down_multiplier": { 2024-05-10T03:43:47.794 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "agent_down_multiplier", 2024-05-10T03:43:47.794 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-05-10T03:43:47.794 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.794 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.794 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "3.0", 2024-05-10T03:43:47.795 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.795 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.795 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.795 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-10T03:43:47.795 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.795 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.795 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.795 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.795 INFO:teuthology.orchestra.run.smithi045.stdout: "agent_refresh_rate": { 2024-05-10T03:43:47.795 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "agent_refresh_rate", 2024-05-10T03:43:47.795 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.795 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.795 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.795 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "20", 2024-05-10T03:43:47.796 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.796 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.796 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.796 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-10T03:43:47.796 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.796 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.796 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.796 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.796 INFO:teuthology.orchestra.run.smithi045.stdout: "agent_starting_port": { 2024-05-10T03:43:47.796 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "agent_starting_port", 2024-05-10T03:43:47.796 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.796 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.796 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.796 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "4721", 2024-05-10T03:43:47.796 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.797 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.797 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.797 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-10T03:43:47.797 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.797 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.797 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.797 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.797 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_ptrace": { 2024-05-10T03:43:47.797 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "allow_ptrace", 2024-05-10T03:43:47.797 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.797 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.797 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.797 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.797 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.797 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.798 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.798 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-10T03:43:47.798 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-10T03:43:47.798 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.798 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.798 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.798 INFO:teuthology.orchestra.run.smithi045.stdout: "autotune_interval": { 2024-05-10T03:43:47.798 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "autotune_interval", 2024-05-10T03:43:47.798 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.798 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.798 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.798 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-05-10T03:43:47.798 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.798 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.799 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.799 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-10T03:43:47.799 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.799 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.799 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.799 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.799 INFO:teuthology.orchestra.run.smithi045.stdout: "autotune_memory_target_ratio": { 2024-05-10T03:43:47.799 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "autotune_memory_target_ratio", 2024-05-10T03:43:47.799 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-05-10T03:43:47.799 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.799 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.799 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0.7", 2024-05-10T03:43:47.799 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.799 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.799 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.800 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-10T03:43:47.800 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.800 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.800 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.800 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.800 INFO:teuthology.orchestra.run.smithi045.stdout: "cgroups_split": { 2024-05-10T03:43:47.800 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cgroups_split", 2024-05-10T03:43:47.800 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.800 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.800 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.800 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.800 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.800 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.800 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.801 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-10T03:43:47.801 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.801 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.801 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.801 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.801 INFO:teuthology.orchestra.run.smithi045.stdout: "config_checks_enabled": { 2024-05-10T03:43:47.801 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "config_checks_enabled", 2024-05-10T03:43:47.801 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.801 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.801 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.801 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.801 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.801 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.801 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.801 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-10T03:43:47.802 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.802 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.802 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.802 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.802 INFO:teuthology.orchestra.run.smithi045.stdout: "config_dashboard": { 2024-05-10T03:43:47.802 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "config_dashboard", 2024-05-10T03:43:47.802 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.802 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.802 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.802 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.802 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.802 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.802 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.802 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-10T03:43:47.803 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.803 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.803 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.803 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.803 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_alertmanager": { 2024-05-10T03:43:47.803 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_alertmanager", 2024-05-10T03:43:47.803 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.803 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.803 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.803 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-10T03:43:47.803 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.803 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.803 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.803 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Prometheus container image", 2024-05-10T03:43:47.804 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.804 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.804 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.804 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.804 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_base": { 2024-05-10T03:43:47.804 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_base", 2024-05-10T03:43:47.804 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.804 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.804 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.804 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-10T03:43:47.804 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.804 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.804 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.804 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Container image name, without the tag", 2024-05-10T03:43:47.804 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.805 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.805 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.805 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.805 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_elasticsearch": { 2024-05-10T03:43:47.805 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_elasticsearch", 2024-05-10T03:43:47.805 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.805 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.805 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.805 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-10T03:43:47.805 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.805 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.805 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.805 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "elasticsearch container image", 2024-05-10T03:43:47.806 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.806 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.806 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.806 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.806 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_grafana": { 2024-05-10T03:43:47.806 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_grafana", 2024-05-10T03:43:47.806 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.806 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.806 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.806 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-05-10T03:43:47.806 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.806 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.806 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.806 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Prometheus container image", 2024-05-10T03:43:47.807 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.807 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.807 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.807 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.807 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_haproxy": { 2024-05-10T03:43:47.807 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_haproxy", 2024-05-10T03:43:47.807 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.807 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.807 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.807 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-10T03:43:47.807 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.807 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.807 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.807 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "HAproxy container image", 2024-05-10T03:43:47.808 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.808 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.808 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.808 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.808 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_jaeger_agent": { 2024-05-10T03:43:47.808 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_jaeger_agent", 2024-05-10T03:43:47.808 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.808 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.808 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.808 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-10T03:43:47.808 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.808 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.808 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.808 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Jaeger agent container image", 2024-05-10T03:43:47.809 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.809 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.809 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.809 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.809 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_jaeger_collector": { 2024-05-10T03:43:47.809 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_jaeger_collector", 2024-05-10T03:43:47.809 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.809 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.809 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.809 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-10T03:43:47.809 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.809 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.809 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.809 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Jaeger collector container image", 2024-05-10T03:43:47.809 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.810 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.810 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.810 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.810 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_jaeger_query": { 2024-05-10T03:43:47.810 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_jaeger_query", 2024-05-10T03:43:47.810 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.810 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.810 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.810 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-10T03:43:47.810 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.810 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.810 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.810 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Jaeger query container image", 2024-05-10T03:43:47.810 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.811 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.811 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.811 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.811 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_keepalived": { 2024-05-10T03:43:47.811 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_keepalived", 2024-05-10T03:43:47.811 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.811 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.811 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.811 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-10T03:43:47.811 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.811 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.811 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.811 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Keepalived container image", 2024-05-10T03:43:47.811 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.812 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.812 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.812 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.812 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_loki": { 2024-05-10T03:43:47.812 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_loki", 2024-05-10T03:43:47.812 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.812 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.812 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.812 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-10T03:43:47.812 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.812 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.812 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.812 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Loki container image", 2024-05-10T03:43:47.812 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.812 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.813 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.813 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.813 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_node_exporter": { 2024-05-10T03:43:47.813 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_node_exporter", 2024-05-10T03:43:47.813 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.813 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.813 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.813 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-10T03:43:47.813 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.813 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.813 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.813 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Prometheus container image", 2024-05-10T03:43:47.813 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.814 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.814 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.814 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.814 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_nvmeof": { 2024-05-10T03:43:47.814 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_nvmeof", 2024-05-10T03:43:47.814 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.814 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.814 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.814 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-05-10T03:43:47.814 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.814 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.814 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.814 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Nvme-of container image", 2024-05-10T03:43:47.815 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.815 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.815 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.815 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.815 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_prometheus": { 2024-05-10T03:43:47.815 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_prometheus", 2024-05-10T03:43:47.815 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.815 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.815 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.815 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-10T03:43:47.815 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.815 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.815 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.815 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Prometheus container image", 2024-05-10T03:43:47.816 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.816 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.816 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.816 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.816 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_promtail": { 2024-05-10T03:43:47.816 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_promtail", 2024-05-10T03:43:47.816 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.816 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.816 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.816 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-10T03:43:47.816 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.816 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.816 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.816 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Promtail container image", 2024-05-10T03:43:47.816 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.817 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.817 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.817 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.817 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_snmp_gateway": { 2024-05-10T03:43:47.817 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_snmp_gateway", 2024-05-10T03:43:47.817 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.817 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.817 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.817 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-10T03:43:47.817 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.817 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.817 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.817 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "SNMP Gateway container image", 2024-05-10T03:43:47.817 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.817 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.818 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.818 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.818 INFO:teuthology.orchestra.run.smithi045.stdout: "container_init": { 2024-05-10T03:43:47.818 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_init", 2024-05-10T03:43:47.818 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.818 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.818 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.818 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.818 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.818 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.818 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.818 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Run podman/docker with `--init`", 2024-05-10T03:43:47.818 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.818 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.819 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.819 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.819 INFO:teuthology.orchestra.run.smithi045.stdout: "daemon_cache_timeout": { 2024-05-10T03:43:47.819 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "daemon_cache_timeout", 2024-05-10T03:43:47.819 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.819 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.819 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.819 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-05-10T03:43:47.819 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.819 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.819 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.819 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-10T03:43:47.819 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.819 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.820 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.820 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.820 INFO:teuthology.orchestra.run.smithi045.stdout: "default_cephadm_command_timeout": { 2024-05-10T03:43:47.820 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "default_cephadm_command_timeout", 2024-05-10T03:43:47.820 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.820 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.820 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.820 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "900", 2024-05-10T03:43:47.820 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.820 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.820 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.820 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-10T03:43:47.820 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.820 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.821 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.821 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.821 INFO:teuthology.orchestra.run.smithi045.stdout: "default_registry": { 2024-05-10T03:43:47.821 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "default_registry", 2024-05-10T03:43:47.821 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.821 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.821 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.821 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "docker.io", 2024-05-10T03:43:47.821 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.821 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.821 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.821 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-10T03:43:47.821 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.821 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.822 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.822 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.822 INFO:teuthology.orchestra.run.smithi045.stdout: "device_cache_timeout": { 2024-05-10T03:43:47.822 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "device_cache_timeout", 2024-05-10T03:43:47.822 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.822 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.822 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.822 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "1800", 2024-05-10T03:43:47.822 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.822 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.822 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.822 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "seconds to cache device inventory", 2024-05-10T03:43:47.822 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.822 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.823 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.823 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.823 INFO:teuthology.orchestra.run.smithi045.stdout: "device_enhanced_scan": { 2024-05-10T03:43:47.823 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "device_enhanced_scan", 2024-05-10T03:43:47.823 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.823 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.823 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.823 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.823 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.823 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.823 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.823 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-10T03:43:47.823 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.823 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.824 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.824 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.824 INFO:teuthology.orchestra.run.smithi045.stdout: "facts_cache_timeout": { 2024-05-10T03:43:47.824 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "facts_cache_timeout", 2024-05-10T03:43:47.824 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.824 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.824 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.824 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-05-10T03:43:47.824 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.824 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.824 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.824 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "seconds to cache host facts data", 2024-05-10T03:43:47.824 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.824 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.824 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.825 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.825 INFO:teuthology.orchestra.run.smithi045.stdout: "host_check_interval": { 2024-05-10T03:43:47.825 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "host_check_interval", 2024-05-10T03:43:47.825 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.825 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.825 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.825 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-05-10T03:43:47.825 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.825 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.825 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.825 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to perform a host check", 2024-05-10T03:43:47.825 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.825 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.826 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.826 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.826 INFO:teuthology.orchestra.run.smithi045.stdout: "hw_monitoring": { 2024-05-10T03:43:47.826 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "hw_monitoring", 2024-05-10T03:43:47.826 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.826 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.826 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.826 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.826 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.826 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.827 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.827 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-10T03:43:47.827 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.827 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.827 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.827 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.827 INFO:teuthology.orchestra.run.smithi045.stdout: "inventory_list_all": { 2024-05-10T03:43:47.827 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "inventory_list_all", 2024-05-10T03:43:47.827 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.827 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.827 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.827 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.827 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.827 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.827 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.828 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-10T03:43:47.828 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.828 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.828 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.828 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.828 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.828 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.828 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.828 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.828 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.828 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.828 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.828 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.828 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.829 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.829 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.829 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.829 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.829 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.829 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.829 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.829 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.829 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.829 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.829 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.829 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.829 INFO:teuthology.orchestra.run.smithi045.stdout: "log_refresh_metadata": { 2024-05-10T03:43:47.829 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_refresh_metadata", 2024-05-10T03:43:47.829 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.830 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.830 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.830 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.830 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.830 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.830 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.830 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-10T03:43:47.830 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.830 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.830 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.830 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.830 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.830 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.831 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.831 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.831 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.831 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.831 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.831 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.831 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.831 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-10T03:43:47.831 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.831 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.831 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.831 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.831 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.831 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.832 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.832 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.832 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.832 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.832 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.832 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.832 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.832 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.832 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.832 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.832 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.832 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.832 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.832 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.833 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.833 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.833 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.833 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.833 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.833 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.833 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.833 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.833 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.833 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.833 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.833 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.833 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.833 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.834 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.834 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.834 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.834 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.834 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.834 INFO:teuthology.orchestra.run.smithi045.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-10T03:43:47.834 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-10T03:43:47.834 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.834 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.834 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.834 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.834 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.834 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.834 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.835 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-10T03:43:47.835 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.835 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.835 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.835 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.835 INFO:teuthology.orchestra.run.smithi045.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-10T03:43:47.835 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-10T03:43:47.835 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.835 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.835 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.835 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "*", 2024-05-10T03:43:47.835 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.835 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.835 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.835 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-10T03:43:47.836 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.836 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.836 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.836 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.836 INFO:teuthology.orchestra.run.smithi045.stdout: "max_count_per_host": { 2024-05-10T03:43:47.836 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_count_per_host", 2024-05-10T03:43:47.836 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.836 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.836 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.836 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-05-10T03:43:47.836 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.836 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.836 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.836 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "max number of daemons per service per host", 2024-05-10T03:43:47.837 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.837 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.837 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.837 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.837 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd_draining_count": { 2024-05-10T03:43:47.837 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_osd_draining_count", 2024-05-10T03:43:47.837 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.837 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.837 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.837 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-05-10T03:43:47.837 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.837 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.837 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.837 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-10T03:43:47.838 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.838 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.838 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.838 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.838 INFO:teuthology.orchestra.run.smithi045.stdout: "migration_current": { 2024-05-10T03:43:47.838 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "migration_current", 2024-05-10T03:43:47.838 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.838 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.838 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.838 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.838 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.838 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.838 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.838 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "internal - do not modify", 2024-05-10T03:43:47.839 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.839 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.839 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.839 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.839 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": { 2024-05-10T03:43:47.839 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mode", 2024-05-10T03:43:47.839 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.839 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.839 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.839 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "root", 2024-05-10T03:43:47.839 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.839 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.839 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.839 INFO:teuthology.orchestra.run.smithi045.stdout: "cephadm-package", 2024-05-10T03:43:47.840 INFO:teuthology.orchestra.run.smithi045.stdout: "root" 2024-05-10T03:43:47.840 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.840 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "mode for remote execution of cephadm", 2024-05-10T03:43:47.840 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.840 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.840 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.840 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.840 INFO:teuthology.orchestra.run.smithi045.stdout: "oob_default_addr": { 2024-05-10T03:43:47.840 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "oob_default_addr", 2024-05-10T03:43:47.840 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.840 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.840 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.840 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "169.254.1.1", 2024-05-10T03:43:47.841 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.841 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.841 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.841 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-10T03:43:47.841 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.841 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.841 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.841 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.841 INFO:teuthology.orchestra.run.smithi045.stdout: "prometheus_alerts_path": { 2024-05-10T03:43:47.841 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "prometheus_alerts_path", 2024-05-10T03:43:47.841 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.841 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.841 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.841 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-10T03:43:47.842 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.842 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.842 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.842 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-10T03:43:47.842 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.842 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.842 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.842 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.842 INFO:teuthology.orchestra.run.smithi045.stdout: "registry_insecure": { 2024-05-10T03:43:47.842 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "registry_insecure", 2024-05-10T03:43:47.842 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.842 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.842 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.842 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.843 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.843 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.843 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.843 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-10T03:43:47.843 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.843 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.843 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.843 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.843 INFO:teuthology.orchestra.run.smithi045.stdout: "registry_password": { 2024-05-10T03:43:47.843 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "registry_password", 2024-05-10T03:43:47.843 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.843 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.843 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.844 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.844 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.844 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.844 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.844 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-10T03:43:47.844 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.844 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.844 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.844 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.844 INFO:teuthology.orchestra.run.smithi045.stdout: "registry_url": { 2024-05-10T03:43:47.844 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "registry_url", 2024-05-10T03:43:47.844 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.844 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.844 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.845 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.845 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.845 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.845 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.845 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-10T03:43:47.845 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.845 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.845 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.845 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.845 INFO:teuthology.orchestra.run.smithi045.stdout: "registry_username": { 2024-05-10T03:43:47.845 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "registry_username", 2024-05-10T03:43:47.845 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.845 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.845 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.846 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.846 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.846 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.846 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.846 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-10T03:43:47.846 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.846 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.846 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.846 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.846 INFO:teuthology.orchestra.run.smithi045.stdout: "secure_monitoring_stack": { 2024-05-10T03:43:47.846 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "secure_monitoring_stack", 2024-05-10T03:43:47.846 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.846 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.846 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.847 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.847 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.847 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.847 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.847 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-10T03:43:47.847 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.847 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.847 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.847 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.847 INFO:teuthology.orchestra.run.smithi045.stdout: "service_discovery_port": { 2024-05-10T03:43:47.847 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "service_discovery_port", 2024-05-10T03:43:47.847 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.847 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.847 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.847 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8765", 2024-05-10T03:43:47.848 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.848 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.848 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.848 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "cephadm service discovery port", 2024-05-10T03:43:47.848 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.848 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.848 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.848 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.848 INFO:teuthology.orchestra.run.smithi045.stdout: "ssh_config_file": { 2024-05-10T03:43:47.848 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ssh_config_file", 2024-05-10T03:43:47.848 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.848 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.848 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.848 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.849 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.849 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.849 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.849 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-10T03:43:47.849 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.849 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.849 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.849 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.849 INFO:teuthology.orchestra.run.smithi045.stdout: "use_agent": { 2024-05-10T03:43:47.849 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "use_agent", 2024-05-10T03:43:47.849 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.849 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.849 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.849 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.849 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.850 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.850 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.850 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-10T03:43:47.850 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.850 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.850 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.850 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.850 INFO:teuthology.orchestra.run.smithi045.stdout: "use_repo_digest": { 2024-05-10T03:43:47.850 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "use_repo_digest", 2024-05-10T03:43:47.850 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.850 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.850 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.850 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.851 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.851 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.851 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.851 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-10T03:43:47.851 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.851 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.851 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.851 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.851 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_on_failed_host_check": { 2024-05-10T03:43:47.851 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_on_failed_host_check", 2024-05-10T03:43:47.851 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.851 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.851 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.851 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.851 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.852 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.852 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.852 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "raise a health warning if the host check fails", 2024-05-10T03:43:47.852 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.852 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.852 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.852 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.852 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_on_stray_daemons": { 2024-05-10T03:43:47.852 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_on_stray_daemons", 2024-05-10T03:43:47.852 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.852 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.852 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.852 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.852 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.852 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.853 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.853 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-10T03:43:47.853 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.853 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.853 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.853 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.853 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_on_stray_hosts": { 2024-05-10T03:43:47.853 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_on_stray_hosts", 2024-05-10T03:43:47.853 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.853 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.853 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.853 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.853 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.853 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.853 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.854 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-10T03:43:47.854 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.854 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.854 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.854 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.854 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.854 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.854 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.854 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crash", 2024-05-10T03:43:47.854 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.854 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.854 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.854 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.854 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.855 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.855 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.855 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.855 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.855 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.855 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.855 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.855 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.855 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.855 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.855 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.855 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.855 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.855 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.856 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.856 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.856 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.856 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.856 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.856 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.856 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.856 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.856 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.856 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.856 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.856 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.856 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.856 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.856 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.857 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.857 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.857 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.857 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.857 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.857 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.857 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.857 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.857 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.857 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.857 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.857 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.857 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.857 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.858 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.858 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.858 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.858 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.858 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.858 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.858 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.858 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.858 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.858 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.858 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.858 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.858 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.858 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.858 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.859 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.859 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.859 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.859 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.859 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.859 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.859 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.859 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.859 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.859 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.859 INFO:teuthology.orchestra.run.smithi045.stdout: "retain_interval": { 2024-05-10T03:43:47.859 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "retain_interval", 2024-05-10T03:43:47.859 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.859 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.859 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.860 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "31536000", 2024-05-10T03:43:47.860 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.860 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.860 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.860 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-10T03:43:47.860 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.860 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.860 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.860 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.860 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_recent_interval": { 2024-05-10T03:43:47.860 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_recent_interval", 2024-05-10T03:43:47.860 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.860 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.860 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.860 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "1209600", 2024-05-10T03:43:47.861 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.861 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.861 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.861 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-10T03:43:47.861 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.861 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.861 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.861 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.861 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.861 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.861 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.861 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "dashboard", 2024-05-10T03:43:47.861 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.861 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.861 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.862 INFO:teuthology.orchestra.run.smithi045.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-10T03:43:47.862 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-10T03:43:47.862 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.862 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.862 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.862 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-05-10T03:43:47.862 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.862 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.862 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.862 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.862 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.862 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.862 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.862 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.863 INFO:teuthology.orchestra.run.smithi045.stdout: "ALERTMANAGER_API_HOST": { 2024-05-10T03:43:47.863 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-10T03:43:47.863 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.863 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.863 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.863 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.863 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.863 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.863 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.863 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.863 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.863 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.863 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.864 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.864 INFO:teuthology.orchestra.run.smithi045.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-10T03:43:47.864 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-10T03:43:47.864 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.864 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.864 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.864 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.864 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.864 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.864 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.864 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.864 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.864 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.864 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.865 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.865 INFO:teuthology.orchestra.run.smithi045.stdout: "AUDIT_API_ENABLED": { 2024-05-10T03:43:47.865 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "AUDIT_API_ENABLED", 2024-05-10T03:43:47.865 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.865 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.865 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.865 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.865 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.865 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.865 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.865 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.865 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.865 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.865 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.866 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.866 INFO:teuthology.orchestra.run.smithi045.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-10T03:43:47.866 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-10T03:43:47.866 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.866 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.866 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.866 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.866 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.866 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.866 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.866 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.866 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.867 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.867 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.867 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.867 INFO:teuthology.orchestra.run.smithi045.stdout: "ENABLE_BROWSABLE_API": { 2024-05-10T03:43:47.867 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-10T03:43:47.867 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.867 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.867 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.867 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.867 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.867 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.867 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.867 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.867 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.867 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.868 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.868 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.868 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-10T03:43:47.868 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-10T03:43:47.868 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.868 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.868 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.868 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.868 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.868 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.868 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.868 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.868 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.868 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.869 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.869 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.869 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-10T03:43:47.869 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-10T03:43:47.869 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.869 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.869 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.869 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.869 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.869 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.869 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.869 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.869 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.869 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.869 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.870 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.870 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-10T03:43:47.870 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-10T03:43:47.870 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.870 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.870 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.870 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.870 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.870 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.870 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.870 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.870 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.870 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.870 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.871 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.871 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-10T03:43:47.871 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-10T03:43:47.871 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.871 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.871 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.871 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.871 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.871 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.871 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.871 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.871 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.871 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.871 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.872 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.872 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-10T03:43:47.872 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-10T03:43:47.872 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.872 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.872 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.872 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.872 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.872 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.872 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.872 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.872 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.872 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.872 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.873 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.873 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-10T03:43:47.873 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-10T03:43:47.873 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.873 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.873 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.873 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.873 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.873 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.873 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.873 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.873 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.873 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.873 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.874 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.874 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-10T03:43:47.874 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-10T03:43:47.874 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.874 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.874 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.874 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.874 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.874 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.874 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.874 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.874 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.874 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.874 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.874 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.875 INFO:teuthology.orchestra.run.smithi045.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-10T03:43:47.875 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-10T03:43:47.875 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.875 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.875 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.875 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.875 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.875 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.875 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.875 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.875 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.875 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.875 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.875 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.876 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_API_PASSWORD": { 2024-05-10T03:43:47.876 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-10T03:43:47.876 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.876 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.876 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.876 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "admin", 2024-05-10T03:43:47.876 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.876 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.876 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.876 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.876 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.876 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.876 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.876 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.877 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-10T03:43:47.877 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-10T03:43:47.877 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.877 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.877 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.877 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.877 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.877 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.877 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.877 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.877 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.877 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.877 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.877 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.877 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_API_URL": { 2024-05-10T03:43:47.878 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_API_URL", 2024-05-10T03:43:47.878 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.878 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.878 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.878 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.878 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.878 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.878 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.878 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.878 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.878 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.878 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.878 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.878 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_API_USERNAME": { 2024-05-10T03:43:47.879 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-10T03:43:47.879 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.879 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.879 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.879 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "admin", 2024-05-10T03:43:47.879 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.879 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.879 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.879 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.879 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.879 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.879 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.879 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.879 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-10T03:43:47.880 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-10T03:43:47.880 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.880 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.880 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.880 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.880 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.880 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.880 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.880 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.880 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.880 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.880 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.880 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.880 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-10T03:43:47.880 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-10T03:43:47.881 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.881 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.881 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.881 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.881 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.881 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.881 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.881 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.881 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.881 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.881 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.881 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.881 INFO:teuthology.orchestra.run.smithi045.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-10T03:43:47.881 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-10T03:43:47.882 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.882 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.882 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.882 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.882 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.882 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.882 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.882 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.882 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.882 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.882 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.882 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.882 INFO:teuthology.orchestra.run.smithi045.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-10T03:43:47.882 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-10T03:43:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: "PROMETHEUS_API_HOST": { 2024-05-10T03:43:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-10T03:43:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.883 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.884 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.884 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.884 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.884 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.884 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.884 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.884 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.884 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.884 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.884 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.884 INFO:teuthology.orchestra.run.smithi045.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-10T03:43:47.884 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-10T03:43:47.884 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.884 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.884 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-10T03:43:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-10T03:43:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.886 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.886 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.886 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.886 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.886 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.886 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.886 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.886 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.886 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-10T03:43:47.886 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-10T03:43:47.886 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.886 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.886 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.886 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.887 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.887 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.887 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.887 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.887 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.887 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.887 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.887 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.887 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-10T03:43:47.887 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-10T03:43:47.887 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.887 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.887 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.887 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.887 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.888 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.888 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.888 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.888 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.888 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.888 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.888 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.888 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-10T03:43:47.888 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-10T03:43:47.888 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.888 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.888 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.888 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.888 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.889 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.889 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.889 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.889 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.889 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.889 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.889 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.889 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-10T03:43:47.889 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-10T03:43:47.889 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.889 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.889 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.889 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.889 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.889 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.890 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.890 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.890 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.890 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.890 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.890 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.890 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-10T03:43:47.890 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-10T03:43:47.890 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.890 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.890 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.890 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.890 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.890 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.890 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.891 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.891 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.891 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.891 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.891 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.891 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-10T03:43:47.891 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-10T03:43:47.891 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.891 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.891 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.891 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.891 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.891 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.891 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.891 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_ENABLED": { 2024-05-10T03:43:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-10T03:43:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.892 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.893 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.893 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.893 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.893 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-10T03:43:47.893 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-10T03:43:47.893 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.893 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.893 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.893 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-10T03:43:47.893 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.893 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.893 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.893 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.893 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.894 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.894 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.894 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.894 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-10T03:43:47.894 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-10T03:43:47.894 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.894 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.894 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.894 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-05-10T03:43:47.894 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.894 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.894 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.894 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.894 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.894 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.895 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.895 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.895 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-10T03:43:47.895 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-10T03:43:47.895 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.895 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.895 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.895 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8", 2024-05-10T03:43:47.895 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.895 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.895 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.895 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.895 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.895 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-10T03:43:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-10T03:43:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "45", 2024-05-10T03:43:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.896 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: "RGW_API_ACCESS_KEY": { 2024-05-10T03:43:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-10T03:43:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.897 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-10T03:43:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-10T03:43:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "admin", 2024-05-10T03:43:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.898 INFO:teuthology.orchestra.run.smithi045.stdout: "RGW_API_SECRET_KEY": { 2024-05-10T03:43:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-10T03:43:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.899 INFO:teuthology.orchestra.run.smithi045.stdout: "RGW_API_SSL_VERIFY": { 2024-05-10T03:43:47.900 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-10T03:43:47.900 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.900 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.900 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.900 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.900 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.900 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.900 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.900 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.900 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.900 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.900 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.900 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.900 INFO:teuthology.orchestra.run.smithi045.stdout: "UNSAFE_TLS_v1_2": { 2024-05-10T03:43:47.900 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-10T03:43:47.901 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.901 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.901 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.901 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.901 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.901 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.901 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.901 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.901 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.901 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.901 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.901 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.901 INFO:teuthology.orchestra.run.smithi045.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-10T03:43:47.902 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-10T03:43:47.902 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.902 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.902 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.902 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-05-10T03:43:47.902 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.902 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.902 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.902 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.902 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.902 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.902 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.902 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.902 INFO:teuthology.orchestra.run.smithi045.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-10T03:43:47.903 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-10T03:43:47.903 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.903 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.903 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.903 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-05-10T03:43:47.903 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.903 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.903 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.903 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.903 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.903 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.903 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.903 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.903 INFO:teuthology.orchestra.run.smithi045.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-10T03:43:47.903 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-10T03:43:47.904 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.904 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.904 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.904 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-05-10T03:43:47.904 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.904 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.904 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.904 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.904 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.904 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.904 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.904 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.904 INFO:teuthology.orchestra.run.smithi045.stdout: "cross_origin_url": { 2024-05-10T03:43:47.904 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cross_origin_url", 2024-05-10T03:43:47.905 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.905 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.905 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.905 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.905 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.905 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.905 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.905 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.905 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.905 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.905 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.905 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.905 INFO:teuthology.orchestra.run.smithi045.stdout: "crt_file": { 2024-05-10T03:43:47.905 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crt_file", 2024-05-10T03:43:47.905 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.905 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.906 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.906 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.906 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.906 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.906 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.906 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.906 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.906 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.906 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.906 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.906 INFO:teuthology.orchestra.run.smithi045.stdout: "debug": { 2024-05-10T03:43:47.906 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "debug", 2024-05-10T03:43:47.906 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.906 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.907 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.907 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.907 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.907 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.907 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.907 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Enable/disable debug options", 2024-05-10T03:43:47.907 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.907 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.907 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.907 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.907 INFO:teuthology.orchestra.run.smithi045.stdout: "jwt_token_ttl": { 2024-05-10T03:43:47.907 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "jwt_token_ttl", 2024-05-10T03:43:47.907 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.907 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.907 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.908 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "28800", 2024-05-10T03:43:47.908 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.908 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.908 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.908 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.908 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.908 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.908 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.908 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.908 INFO:teuthology.orchestra.run.smithi045.stdout: "key_file": { 2024-05-10T03:43:47.908 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "key_file", 2024-05-10T03:43:47.908 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.908 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.908 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.908 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.908 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.909 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.909 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.909 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.909 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.909 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.909 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.909 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.909 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.909 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.909 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.909 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.909 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.909 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.910 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.910 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.910 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.910 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.910 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.910 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.910 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.910 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.910 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.910 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.910 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.910 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.910 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.910 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.911 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.911 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.911 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.911 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.911 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.911 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.911 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.911 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.911 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.911 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.911 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.911 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.911 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.911 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.911 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.912 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.912 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.912 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.912 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.912 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.912 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.912 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.912 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.912 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.912 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.912 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.912 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.912 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.912 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.912 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.913 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.913 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.913 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.913 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.913 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.913 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.913 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.913 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.913 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.913 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.913 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.913 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.913 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.913 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.914 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.914 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.914 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.914 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.914 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.914 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.914 INFO:teuthology.orchestra.run.smithi045.stdout: "motd": { 2024-05-10T03:43:47.914 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "motd", 2024-05-10T03:43:47.914 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.914 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.914 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.914 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.914 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.915 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.915 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.915 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "The message of the day", 2024-05-10T03:43:47.915 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.915 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.915 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.915 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.915 INFO:teuthology.orchestra.run.smithi045.stdout: "redirect_resolve_ip_addr": { 2024-05-10T03:43:47.915 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "redirect_resolve_ip_addr", 2024-05-10T03:43:47.915 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.915 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.915 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.915 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.915 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.915 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.916 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.916 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.916 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.916 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.916 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.916 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.916 INFO:teuthology.orchestra.run.smithi045.stdout: "server_addr": { 2024-05-10T03:43:47.916 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_addr", 2024-05-10T03:43:47.916 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.916 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.916 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.916 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "::", 2024-05-10T03:43:47.916 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.916 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.916 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.916 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.917 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.917 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.917 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.917 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.917 INFO:teuthology.orchestra.run.smithi045.stdout: "server_port": { 2024-05-10T03:43:47.917 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_port", 2024-05-10T03:43:47.917 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.917 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.917 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.917 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8080", 2024-05-10T03:43:47.917 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.917 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.917 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.917 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.917 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.917 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: "ssl": { 2024-05-10T03:43:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ssl", 2024-05-10T03:43:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: "ssl_server_port": { 2024-05-10T03:43:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ssl_server_port", 2024-05-10T03:43:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8443", 2024-05-10T03:43:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: "standby_behaviour": { 2024-05-10T03:43:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "standby_behaviour", 2024-05-10T03:43:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "redirect", 2024-05-10T03:43:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: "redirect" 2024-05-10T03:43:47.920 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: "standby_error_status_code": { 2024-05-10T03:43:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "standby_error_status_code", 2024-05-10T03:43:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "500", 2024-05-10T03:43:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "400", 2024-05-10T03:43:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "599", 2024-05-10T03:43:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.921 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.922 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.922 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.922 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.922 INFO:teuthology.orchestra.run.smithi045.stdout: "url_prefix": { 2024-05-10T03:43:47.922 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "url_prefix", 2024-05-10T03:43:47.922 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.922 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.922 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.922 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.922 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.922 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.922 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.922 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.922 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.923 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.923 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.923 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.923 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.923 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.923 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.923 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "devicehealth", 2024-05-10T03:43:47.923 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.923 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.923 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.923 INFO:teuthology.orchestra.run.smithi045.stdout: "enable_monitoring": { 2024-05-10T03:43:47.923 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "enable_monitoring", 2024-05-10T03:43:47.923 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.923 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.923 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.924 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.924 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.924 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.924 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.924 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "monitor device health metrics", 2024-05-10T03:43:47.924 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.924 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.924 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.924 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.924 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.924 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.924 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.924 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.924 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.924 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.925 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.925 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.925 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.925 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.925 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.925 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.925 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.925 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.925 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.925 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.925 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.925 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.925 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.926 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.926 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.926 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.926 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.926 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.926 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.926 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.926 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.926 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.926 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.926 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.926 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.926 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.926 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.927 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.927 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.927 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.927 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.927 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.927 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.927 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.927 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.927 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.927 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.927 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.927 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.927 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.927 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.928 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.928 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.928 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.928 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.928 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.928 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.928 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.928 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.928 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.928 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.928 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.928 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.928 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.928 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.928 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.929 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.929 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.929 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.929 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.929 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.929 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.929 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.929 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.929 INFO:teuthology.orchestra.run.smithi045.stdout: "mark_out_threshold": { 2024-05-10T03:43:47.929 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mark_out_threshold", 2024-05-10T03:43:47.929 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.929 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.929 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.929 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "2419200", 2024-05-10T03:43:47.930 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.930 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.930 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.930 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-10T03:43:47.930 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.930 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.930 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.930 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.930 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": { 2024-05-10T03:43:47.930 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "pool_name", 2024-05-10T03:43:47.930 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.930 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.930 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.930 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "device_health_metrics", 2024-05-10T03:43:47.931 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.931 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.931 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.931 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-10T03:43:47.931 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.931 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.931 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.931 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.931 INFO:teuthology.orchestra.run.smithi045.stdout: "retention_period": { 2024-05-10T03:43:47.931 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "retention_period", 2024-05-10T03:43:47.931 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.931 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.931 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.931 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "15552000", 2024-05-10T03:43:47.931 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.932 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.932 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.932 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how long to retain device health metrics", 2024-05-10T03:43:47.932 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.932 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.932 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.932 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.932 INFO:teuthology.orchestra.run.smithi045.stdout: "scrape_frequency": { 2024-05-10T03:43:47.932 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "scrape_frequency", 2024-05-10T03:43:47.932 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.932 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.932 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.932 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "86400", 2024-05-10T03:43:47.932 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.933 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.933 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.933 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-10T03:43:47.933 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.933 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.933 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.933 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.933 INFO:teuthology.orchestra.run.smithi045.stdout: "self_heal": { 2024-05-10T03:43:47.933 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "self_heal", 2024-05-10T03:43:47.933 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.933 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.933 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.933 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:47.933 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.934 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.934 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.934 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-10T03:43:47.934 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.934 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.934 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.934 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.934 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-05-10T03:43:47.934 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-05-10T03:43:47.934 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.934 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.934 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.934 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-05-10T03:43:47.934 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.935 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.935 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.935 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to wake up and check device health", 2024-05-10T03:43:47.935 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.935 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.935 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.935 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.935 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_threshold": { 2024-05-10T03:43:47.935 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_threshold", 2024-05-10T03:43:47.935 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.935 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.935 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.935 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "7257600", 2024-05-10T03:43:47.935 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.935 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.936 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.936 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-10T03:43:47.936 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.936 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.936 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.936 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.936 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.936 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.936 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.936 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "diskprediction_local", 2024-05-10T03:43:47.936 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.936 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.936 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.936 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.936 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.937 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.937 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.937 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.937 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.937 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.937 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.937 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.937 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.937 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.937 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.937 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.937 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.937 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.938 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.938 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.938 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.938 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.938 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.938 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.938 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.938 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.938 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.938 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.938 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.938 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.938 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.938 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.939 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.939 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.939 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.939 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.939 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.939 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.939 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.939 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.939 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.939 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.939 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.939 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.939 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.939 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.939 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.940 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.940 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.940 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.940 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.940 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.940 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.940 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.940 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.940 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.940 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.940 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.940 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.940 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.941 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.941 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.941 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.941 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.941 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.941 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.941 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.941 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.941 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.941 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.941 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.941 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.941 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.941 INFO:teuthology.orchestra.run.smithi045.stdout: "predict_interval": { 2024-05-10T03:43:47.942 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "predict_interval", 2024-05-10T03:43:47.942 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.942 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.942 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.942 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "86400", 2024-05-10T03:43:47.942 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.942 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.942 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.942 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.942 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.942 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.942 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.942 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.942 INFO:teuthology.orchestra.run.smithi045.stdout: "predictor_model": { 2024-05-10T03:43:47.943 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "predictor_model", 2024-05-10T03:43:47.943 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.943 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.943 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.943 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "prophetstor", 2024-05-10T03:43:47.943 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.943 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.943 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.943 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.943 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.943 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.943 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.943 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.943 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-05-10T03:43:47.943 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-05-10T03:43:47.944 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.944 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.944 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.944 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-05-10T03:43:47.944 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.944 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.944 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.944 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.944 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.944 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.944 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.944 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.944 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.944 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.944 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.945 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "influx", 2024-05-10T03:43:47.945 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": false, 2024-05-10T03:43:47.945 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "influxdb python module not found", 2024-05-10T03:43:47.945 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.945 INFO:teuthology.orchestra.run.smithi045.stdout: "batch_size": { 2024-05-10T03:43:47.945 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "batch_size", 2024-05-10T03:43:47.945 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.945 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.945 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.945 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5000", 2024-05-10T03:43:47.945 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.945 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.945 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.945 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-10T03:43:47.946 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.946 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.946 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.946 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.946 INFO:teuthology.orchestra.run.smithi045.stdout: "database": { 2024-05-10T03:43:47.946 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "database", 2024-05-10T03:43:47.946 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.946 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.946 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.946 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "ceph", 2024-05-10T03:43:47.946 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.946 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.946 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.946 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-10T03:43:47.947 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.947 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.947 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.947 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.947 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": { 2024-05-10T03:43:47.947 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "hostname", 2024-05-10T03:43:47.947 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.947 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.947 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.947 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.947 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.947 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.947 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.947 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "InfluxDB server hostname", 2024-05-10T03:43:47.947 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.947 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.948 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.948 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.948 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-05-10T03:43:47.948 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-05-10T03:43:47.948 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:47.948 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.948 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.948 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "30", 2024-05-10T03:43:47.948 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "5", 2024-05-10T03:43:47.948 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.948 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.948 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-10T03:43:47.948 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.949 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.949 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.949 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.949 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.949 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.949 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.949 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.949 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.949 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.949 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.949 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.949 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.949 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.949 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.950 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.950 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.950 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.950 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.950 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.950 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.950 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.950 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.950 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.950 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.950 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.950 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.950 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.950 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.950 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.951 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.951 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.951 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.951 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.951 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.951 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.951 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.951 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.951 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.951 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.951 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.951 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.951 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.951 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.951 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.952 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.952 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.952 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.952 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.952 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.952 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.952 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.952 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.952 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.952 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.952 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.952 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.952 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.952 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.953 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.953 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.953 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.953 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.953 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.953 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.953 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.953 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.953 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.953 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.953 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.953 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.953 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.953 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.953 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.953 INFO:teuthology.orchestra.run.smithi045.stdout: "password": { 2024-05-10T03:43:47.954 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "password", 2024-05-10T03:43:47.954 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.954 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.954 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.954 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.954 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.954 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.954 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.954 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "password of InfluxDB server user", 2024-05-10T03:43:47.954 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.954 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.954 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.954 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.955 INFO:teuthology.orchestra.run.smithi045.stdout: "port": { 2024-05-10T03:43:47.955 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "port", 2024-05-10T03:43:47.955 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.955 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.955 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.955 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8086", 2024-05-10T03:43:47.955 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.955 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.955 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.955 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "InfluxDB server port", 2024-05-10T03:43:47.955 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.955 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.955 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.955 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.955 INFO:teuthology.orchestra.run.smithi045.stdout: "ssl": { 2024-05-10T03:43:47.955 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ssl", 2024-05-10T03:43:47.956 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.956 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.956 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.956 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "false", 2024-05-10T03:43:47.956 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.956 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.956 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.956 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-10T03:43:47.956 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.956 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.956 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.956 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.956 INFO:teuthology.orchestra.run.smithi045.stdout: "threads": { 2024-05-10T03:43:47.956 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "threads", 2024-05-10T03:43:47.957 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.957 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.957 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.957 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-05-10T03:43:47.957 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1", 2024-05-10T03:43:47.957 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "32", 2024-05-10T03:43:47.957 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.957 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-10T03:43:47.957 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.957 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.957 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.957 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.957 INFO:teuthology.orchestra.run.smithi045.stdout: "username": { 2024-05-10T03:43:47.957 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "username", 2024-05-10T03:43:47.957 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.958 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.958 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.958 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.958 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.958 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.958 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.958 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "username of InfluxDB server user", 2024-05-10T03:43:47.958 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.958 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.958 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.958 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.958 INFO:teuthology.orchestra.run.smithi045.stdout: "verify_ssl": { 2024-05-10T03:43:47.958 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "verify_ssl", 2024-05-10T03:43:47.958 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.959 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.959 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.959 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "true", 2024-05-10T03:43:47.959 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.959 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.959 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.959 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-10T03:43:47.959 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.959 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.959 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.959 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.959 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.959 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.959 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.959 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "insights", 2024-05-10T03:43:47.959 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.960 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.960 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.960 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.960 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.960 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.960 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.960 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.960 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.960 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.960 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.960 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.960 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.960 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.960 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.961 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.961 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.961 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.961 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.961 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.961 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.961 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.961 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.961 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.961 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.961 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.961 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.961 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.961 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.962 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.962 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.962 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.962 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.962 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.962 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.962 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.962 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.962 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.962 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.962 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.962 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.962 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.962 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.963 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.963 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.963 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.963 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.963 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.963 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.963 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.963 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.963 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.963 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.963 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.963 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.963 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.963 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.963 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.964 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.964 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.964 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.964 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.964 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.964 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.964 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.964 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.964 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.964 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.964 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.964 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.964 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.964 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.964 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.965 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.965 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.965 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.965 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "iostat", 2024-05-10T03:43:47.965 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.965 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.965 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.965 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.965 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.965 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.965 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.965 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.965 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.965 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.966 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.966 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.966 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.966 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.966 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.966 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.966 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.966 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.966 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.966 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.966 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.966 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.966 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.966 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.967 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.967 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.967 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.967 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.967 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.967 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.967 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.967 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.967 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.967 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.967 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.967 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.967 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.967 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.967 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.968 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.968 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.968 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.968 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.968 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.968 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.968 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.968 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.968 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.968 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.968 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.968 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.968 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.968 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.969 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.969 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.969 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.969 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.969 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.969 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.969 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.969 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.969 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.969 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.969 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.969 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.969 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.969 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.970 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.970 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.970 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.970 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.970 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.970 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.970 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.970 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.970 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.970 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "k8sevents", 2024-05-10T03:43:47.970 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.970 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.970 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.970 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_event_retention_days": { 2024-05-10T03:43:47.970 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ceph_event_retention_days", 2024-05-10T03:43:47.971 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.971 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.971 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.971 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "7", 2024-05-10T03:43:47.971 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.971 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.971 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.971 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-10T03:43:47.971 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.971 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.971 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.971 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.971 INFO:teuthology.orchestra.run.smithi045.stdout: "config_check_secs": { 2024-05-10T03:43:47.971 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "config_check_secs", 2024-05-10T03:43:47.972 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.972 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.972 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:47.972 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-05-10T03:43:47.972 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "10", 2024-05-10T03:43:47.972 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.972 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.972 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-10T03:43:47.972 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.972 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.972 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.972 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.972 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.972 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.972 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.973 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.973 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.973 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.973 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.973 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.973 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.973 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.973 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.973 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.973 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.973 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.973 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.973 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.973 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.974 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.974 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.974 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.974 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.974 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.974 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.974 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.974 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.974 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.974 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.974 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.974 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.974 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.974 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.974 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.975 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.975 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.975 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.975 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.975 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.975 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.975 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.975 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.975 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.975 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.975 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.975 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.975 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.975 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.975 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.976 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.976 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.976 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.976 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.976 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.976 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.976 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.976 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.976 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.976 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.976 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.976 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.976 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.976 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.977 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.977 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.977 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.977 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.977 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.977 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.977 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.977 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.977 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.977 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.977 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.977 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.977 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "localpool", 2024-05-10T03:43:47.977 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.977 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.978 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.978 INFO:teuthology.orchestra.run.smithi045.stdout: "failure_domain": { 2024-05-10T03:43:47.978 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "failure_domain", 2024-05-10T03:43:47.978 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.978 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.978 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.978 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "host", 2024-05-10T03:43:47.978 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.978 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.978 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.978 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "failure domain for any created local pool", 2024-05-10T03:43:47.978 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-10T03:43:47.978 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.978 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.979 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.979 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.979 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.979 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.979 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.979 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.979 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.979 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.979 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.979 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.979 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.979 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.979 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.979 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.980 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.980 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.980 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.980 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.980 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.980 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.980 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.980 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.980 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.980 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.980 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.980 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.980 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.980 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.980 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.981 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.981 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.981 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.981 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.981 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.981 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.981 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.981 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.981 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.981 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.981 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.981 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.981 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.981 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.982 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.982 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.982 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.982 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.982 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.982 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.982 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.982 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.982 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.982 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.982 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.982 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.982 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.982 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.983 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.983 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.983 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.983 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.983 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.983 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.983 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.983 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.983 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.983 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.983 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.983 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.983 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.984 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.984 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": { 2024-05-10T03:43:47.984 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "min_size", 2024-05-10T03:43:47.984 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.984 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.984 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.984 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.984 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.984 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.984 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.984 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "default min_size for any created local pool", 2024-05-10T03:43:47.984 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-10T03:43:47.984 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.984 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.985 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.985 INFO:teuthology.orchestra.run.smithi045.stdout: "num_rep": { 2024-05-10T03:43:47.985 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "num_rep", 2024-05-10T03:43:47.985 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.985 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.985 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.985 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "3", 2024-05-10T03:43:47.985 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.985 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.985 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.985 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "default replica count for any created local pool", 2024-05-10T03:43:47.985 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.985 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.985 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.985 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.985 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": { 2024-05-10T03:43:47.986 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "pg_num", 2024-05-10T03:43:47.986 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:47.986 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.986 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.986 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "128", 2024-05-10T03:43:47.986 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.986 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.986 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.986 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "default pg_num for any created local pool", 2024-05-10T03:43:47.986 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.986 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.986 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.986 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.986 INFO:teuthology.orchestra.run.smithi045.stdout: "prefix": { 2024-05-10T03:43:47.986 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "prefix", 2024-05-10T03:43:47.987 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.987 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.987 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.987 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.987 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.987 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.987 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.987 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "name prefix for any created local pool", 2024-05-10T03:43:47.987 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.987 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.987 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.987 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.987 INFO:teuthology.orchestra.run.smithi045.stdout: "subtree": { 2024-05-10T03:43:47.987 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "subtree", 2024-05-10T03:43:47.987 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.987 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.988 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.988 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "rack", 2024-05-10T03:43:47.988 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.988 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.988 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.988 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-10T03:43:47.988 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-10T03:43:47.988 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.988 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.988 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.988 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.988 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.988 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.988 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mds_autoscaler", 2024-05-10T03:43:47.988 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.989 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.989 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.989 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.989 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.989 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.989 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.989 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.989 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.989 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.989 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.989 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.989 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.989 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.989 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.989 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.990 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.990 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.990 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.990 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.990 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.990 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.990 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.990 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.990 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.990 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.990 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.990 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.990 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.990 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.990 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.991 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.991 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.991 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.991 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.991 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.991 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.991 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.991 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.991 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.991 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.991 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.991 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.991 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.991 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.991 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.992 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.992 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.992 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.992 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.992 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.992 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.992 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.992 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.992 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.992 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.993 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.993 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.993 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.993 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.993 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.993 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.993 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.993 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.993 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.993 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.993 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.993 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.993 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.993 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.994 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.994 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.994 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.994 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.994 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.994 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.994 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mirroring", 2024-05-10T03:43:47.994 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.994 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:47.994 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:47.994 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:47.994 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:47.994 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.994 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.995 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.995 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:47.995 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.995 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.995 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.995 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.995 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.995 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.995 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.995 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.995 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.995 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.995 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.996 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.996 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.996 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.996 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.996 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:47.996 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:47.996 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.996 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.996 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.996 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.996 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.996 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.996 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.996 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.997 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.997 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.997 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.997 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.997 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:47.997 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:47.997 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:47.997 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.997 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.997 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:47.997 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.997 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.997 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:47.997 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:47.997 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:47.998 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:47.998 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:47.998 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:47.998 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:47.998 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:47.998 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.998 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.998 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.998 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.998 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.998 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:47.998 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:47.998 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:47.998 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:47.999 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:47.999 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:47.999 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:47.999 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:47.999 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:47.999 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:47.999 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:47.999 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:47.999 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:47.999 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.999 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:47.999 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:47.999 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:47.999 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "nfs", 2024-05-10T03:43:47.999 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:47.999 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.000 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.000 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.000 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.000 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.000 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.000 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.000 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.000 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.000 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.000 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.000 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.000 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.000 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.001 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.001 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.001 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.001 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.001 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.001 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.001 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.001 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.001 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.001 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.001 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.001 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.001 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.001 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.001 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.001 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.002 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.002 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.002 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.002 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.002 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.002 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.002 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.002 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.002 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.002 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.002 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.002 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.002 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.002 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.003 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.003 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.003 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.003 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.003 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.003 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.003 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.003 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.003 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.003 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.003 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.003 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.003 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.003 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.004 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.004 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.004 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.004 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.004 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.004 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.004 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.004 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.004 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.004 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.004 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.004 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.004 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.004 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.004 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.005 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.005 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.005 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "orchestrator", 2024-05-10T03:43:48.005 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.005 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.005 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.005 INFO:teuthology.orchestra.run.smithi045.stdout: "fail_fs": { 2024-05-10T03:43:48.005 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "fail_fs", 2024-05-10T03:43:48.005 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.005 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.005 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.005 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.005 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.005 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.005 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.006 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-10T03:43:48.006 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.006 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.006 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.006 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.006 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.006 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.006 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.006 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.006 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.006 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.006 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.006 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.007 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.007 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.007 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.007 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.007 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.007 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.007 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.007 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.007 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.007 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.007 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.007 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.007 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.007 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.007 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.008 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.008 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.008 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.008 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.008 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.008 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.008 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.008 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.008 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.008 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.008 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.008 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.008 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.008 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.009 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.009 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.009 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.009 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.009 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.009 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.009 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.009 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.009 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.009 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.009 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.009 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.009 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.009 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.009 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.010 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.010 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.010 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.010 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.010 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.010 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.010 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.010 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.010 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.010 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.010 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.010 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.010 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.010 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.011 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.011 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.011 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.011 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.011 INFO:teuthology.orchestra.run.smithi045.stdout: "orchestrator": { 2024-05-10T03:43:48.011 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "orchestrator", 2024-05-10T03:43:48.011 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.013 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.013 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.013 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.014 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.014 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.014 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.014 INFO:teuthology.orchestra.run.smithi045.stdout: "cephadm", 2024-05-10T03:43:48.014 INFO:teuthology.orchestra.run.smithi045.stdout: "rook", 2024-05-10T03:43:48.014 INFO:teuthology.orchestra.run.smithi045.stdout: "test_orchestrator" 2024-05-10T03:43:48.014 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.014 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Orchestrator backend", 2024-05-10T03:43:48.014 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.014 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.014 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.014 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.014 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.015 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.015 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.015 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "osd_perf_query", 2024-05-10T03:43:48.015 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.015 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.015 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.015 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.015 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.015 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.015 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.015 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.015 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.015 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.015 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.016 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.016 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.016 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.016 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.016 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.016 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.016 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.016 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.016 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.016 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.016 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.016 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.016 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.016 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.017 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.017 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.017 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.017 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.017 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.017 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.017 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.017 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.017 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.017 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.017 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.017 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.017 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.017 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.017 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.018 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.018 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.018 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.018 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.018 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.018 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.018 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.018 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.018 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.018 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.018 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.018 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.018 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.018 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.019 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.019 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.019 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.019 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.019 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.019 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.019 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.019 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.019 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.019 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.019 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.019 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.019 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.020 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.020 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.020 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.020 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.020 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.020 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.020 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.020 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.020 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.020 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "osd_support", 2024-05-10T03:43:48.020 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.020 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.020 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.020 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.020 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.021 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.021 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.021 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.021 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.021 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.021 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.021 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.021 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.021 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.021 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.021 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.021 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.021 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.021 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.022 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.022 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.022 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.022 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.022 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.022 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.022 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.022 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.022 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.022 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.022 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.022 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.022 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.023 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.023 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.023 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.023 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.023 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.023 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.023 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.023 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.023 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.023 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.023 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.023 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.023 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.023 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.024 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.024 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.024 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.024 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.024 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.024 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.024 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.024 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.024 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.024 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.024 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.024 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.024 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.024 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.024 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.025 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.025 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.025 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.025 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.025 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.025 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.025 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.025 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.025 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.025 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.025 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.025 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.025 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.025 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.026 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.026 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "pg_autoscaler", 2024-05-10T03:43:48.026 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.026 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.026 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.026 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.026 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.026 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.026 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.026 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.026 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.026 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.026 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.026 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.027 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.027 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.027 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.027 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.027 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.027 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.027 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.027 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.027 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.027 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.027 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.027 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.027 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.027 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.028 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.028 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.028 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.028 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.028 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.028 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.028 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.028 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.028 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.028 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.028 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.028 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.028 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.028 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.029 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.029 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.029 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.029 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.029 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.029 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.029 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.029 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.029 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.029 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.029 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.029 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.029 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.029 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.029 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.030 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.030 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.030 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.030 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.030 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.030 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.030 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.030 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.030 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.030 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.030 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.030 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.030 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.030 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.031 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.031 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.031 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.031 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.031 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-05-10T03:43:48.031 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-05-10T03:43:48.031 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:48.031 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.031 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.031 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-05-10T03:43:48.031 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.031 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.031 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.031 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.032 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.032 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.032 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.032 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.032 INFO:teuthology.orchestra.run.smithi045.stdout: "threshold": { 2024-05-10T03:43:48.032 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "threshold", 2024-05-10T03:43:48.032 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-05-10T03:43:48.032 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.032 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.032 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "3.0", 2024-05-10T03:43:48.032 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1.0", 2024-05-10T03:43:48.032 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.032 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.032 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "scaling threshold", 2024-05-10T03:43:48.033 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-10T03:43:48.033 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.033 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.033 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.033 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.033 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.033 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.033 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "progress", 2024-05-10T03:43:48.033 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.033 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.033 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.033 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_pg_recovery_event": { 2024-05-10T03:43:48.033 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "allow_pg_recovery_event", 2024-05-10T03:43:48.033 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.034 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.034 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.034 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.034 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.034 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.034 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.034 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-10T03:43:48.034 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.034 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.034 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.034 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.034 INFO:teuthology.orchestra.run.smithi045.stdout: "enabled": { 2024-05-10T03:43:48.034 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "enabled", 2024-05-10T03:43:48.034 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.035 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.035 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.035 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.035 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.035 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.035 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.035 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.035 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.035 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.035 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.035 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.035 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.035 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.035 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.035 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.036 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.036 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.036 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.036 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.036 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.036 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.036 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.036 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.036 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.036 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.036 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.036 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.036 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.036 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.037 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.037 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.037 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.037 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.037 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.037 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.037 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.037 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.037 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.037 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.037 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.037 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.037 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.037 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.037 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.038 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.038 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.038 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.038 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.038 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.038 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.038 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.038 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.038 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.038 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.038 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.038 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.038 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.038 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.039 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.039 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.039 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.039 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.039 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.039 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.039 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.039 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.039 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.039 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.039 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.039 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.039 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.039 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.039 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.040 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.040 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.040 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.040 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.040 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.040 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.040 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.040 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.040 INFO:teuthology.orchestra.run.smithi045.stdout: "max_completed_events": { 2024-05-10T03:43:48.040 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_completed_events", 2024-05-10T03:43:48.040 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.040 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.040 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.040 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "50", 2024-05-10T03:43:48.041 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.041 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.041 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.041 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "number of past completed events to remember", 2024-05-10T03:43:48.041 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.041 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.041 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.041 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.041 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-05-10T03:43:48.041 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-05-10T03:43:48.041 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:48.041 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.041 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.042 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-05-10T03:43:48.042 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.042 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.042 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.042 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how long the module is going to sleep", 2024-05-10T03:43:48.042 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.042 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.042 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.042 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.042 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.042 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.042 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.042 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "prometheus", 2024-05-10T03:43:48.042 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.042 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.043 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.043 INFO:teuthology.orchestra.run.smithi045.stdout: "cache": { 2024-05-10T03:43:48.043 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cache", 2024-05-10T03:43:48.043 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.043 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.043 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.043 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.043 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.043 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.043 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.043 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.043 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.043 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.043 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.044 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.044 INFO:teuthology.orchestra.run.smithi045.stdout: "exclude_perf_counters": { 2024-05-10T03:43:48.044 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "exclude_perf_counters", 2024-05-10T03:43:48.044 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.044 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.044 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.044 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.044 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.044 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.044 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.044 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-10T03:43:48.044 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-10T03:43:48.044 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.044 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.044 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.044 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.045 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.045 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.045 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.045 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.045 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.045 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.045 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.045 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.045 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.045 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.045 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.045 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.045 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.046 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.046 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.046 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.046 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.046 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.046 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.046 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.046 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.046 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.046 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.046 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.046 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.046 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.046 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.046 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.047 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.047 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.047 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.047 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.047 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.047 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.047 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.047 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.047 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.047 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.047 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.047 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.047 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.048 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.048 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.048 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.048 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.048 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.048 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.048 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.048 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.048 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.048 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.048 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.048 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.048 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.048 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.049 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.049 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.049 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.049 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.049 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.049 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.049 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.049 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.049 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.049 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.049 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.049 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.049 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.049 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.050 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_stats_pools": { 2024-05-10T03:43:48.050 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rbd_stats_pools", 2024-05-10T03:43:48.050 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.050 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.050 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.050 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.050 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.050 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.050 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.050 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.050 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.050 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.050 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.051 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.051 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-10T03:43:48.051 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-10T03:43:48.051 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.051 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.051 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.051 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "300", 2024-05-10T03:43:48.051 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.051 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.051 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.051 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.051 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.051 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.051 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.051 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.052 INFO:teuthology.orchestra.run.smithi045.stdout: "scrape_interval": { 2024-05-10T03:43:48.052 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "scrape_interval", 2024-05-10T03:43:48.052 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-05-10T03:43:48.052 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.052 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.052 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "15.0", 2024-05-10T03:43:48.052 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.052 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.052 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.052 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.052 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.052 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.052 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.052 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.052 INFO:teuthology.orchestra.run.smithi045.stdout: "server_addr": { 2024-05-10T03:43:48.053 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_addr", 2024-05-10T03:43:48.053 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.053 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.053 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.053 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "::", 2024-05-10T03:43:48.053 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.053 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.053 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.053 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-10T03:43:48.053 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.053 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.053 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.053 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.053 INFO:teuthology.orchestra.run.smithi045.stdout: "server_port": { 2024-05-10T03:43:48.053 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_port", 2024-05-10T03:43:48.054 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.054 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.054 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.054 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "9283", 2024-05-10T03:43:48.054 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.054 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.054 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.054 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-10T03:43:48.054 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.054 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.054 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.054 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.054 INFO:teuthology.orchestra.run.smithi045.stdout: "stale_cache_strategy": { 2024-05-10T03:43:48.054 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "stale_cache_strategy", 2024-05-10T03:43:48.055 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.055 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.055 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.055 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "log", 2024-05-10T03:43:48.055 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.055 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.055 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.055 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.055 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.055 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.055 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.055 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.055 INFO:teuthology.orchestra.run.smithi045.stdout: "standby_behaviour": { 2024-05-10T03:43:48.055 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "standby_behaviour", 2024-05-10T03:43:48.056 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.056 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.056 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.056 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "default", 2024-05-10T03:43:48.056 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.056 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.056 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.056 INFO:teuthology.orchestra.run.smithi045.stdout: "default", 2024-05-10T03:43:48.056 INFO:teuthology.orchestra.run.smithi045.stdout: "error" 2024-05-10T03:43:48.056 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.056 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.056 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.056 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.056 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.057 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.057 INFO:teuthology.orchestra.run.smithi045.stdout: "standby_error_status_code": { 2024-05-10T03:43:48.057 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "standby_error_status_code", 2024-05-10T03:43:48.057 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.057 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.057 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.057 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "500", 2024-05-10T03:43:48.057 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "400", 2024-05-10T03:43:48.057 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "599", 2024-05-10T03:43:48.057 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.057 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.057 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.057 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.057 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.057 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.058 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.058 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.058 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.058 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rbd_support", 2024-05-10T03:43:48.058 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.058 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.058 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.058 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.058 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.058 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.058 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.058 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.058 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.058 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.059 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.059 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.059 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.059 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.059 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.059 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.059 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.059 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.059 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.059 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.059 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.059 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.059 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.059 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.059 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.059 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.060 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.060 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.060 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.060 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.060 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.060 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.060 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.060 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.060 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.060 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.060 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.060 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.060 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.060 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.061 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.061 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.061 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.061 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.061 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.061 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.061 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.061 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.061 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.061 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.061 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.061 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.061 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.061 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.061 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.062 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.062 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.062 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.062 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.062 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.062 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.062 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.062 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.062 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.062 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.062 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.062 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.062 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.062 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.063 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.063 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.063 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.063 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.063 INFO:teuthology.orchestra.run.smithi045.stdout: "max_concurrent_snap_create": { 2024-05-10T03:43:48.063 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_concurrent_snap_create", 2024-05-10T03:43:48.063 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.063 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.063 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.063 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-05-10T03:43:48.063 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.063 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.063 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.063 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.064 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.064 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.064 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.064 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.064 INFO:teuthology.orchestra.run.smithi045.stdout: "mirror_snapshot_schedule": { 2024-05-10T03:43:48.064 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mirror_snapshot_schedule", 2024-05-10T03:43:48.064 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.064 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.064 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.064 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.064 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.064 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.064 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.064 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.064 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.065 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.065 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.065 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.065 INFO:teuthology.orchestra.run.smithi045.stdout: "trash_purge_schedule": { 2024-05-10T03:43:48.065 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "trash_purge_schedule", 2024-05-10T03:43:48.065 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.065 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.065 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.065 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.065 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.065 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.065 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.065 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.065 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.065 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.066 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.066 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.066 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.066 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.066 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.066 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "restful", 2024-05-10T03:43:48.066 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.066 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.066 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.066 INFO:teuthology.orchestra.run.smithi045.stdout: "enable_auth": { 2024-05-10T03:43:48.066 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "enable_auth", 2024-05-10T03:43:48.066 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.066 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.067 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.067 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.067 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.067 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.067 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.067 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.067 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.067 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.067 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.067 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.067 INFO:teuthology.orchestra.run.smithi045.stdout: "key_file": { 2024-05-10T03:43:48.067 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "key_file", 2024-05-10T03:43:48.067 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.067 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.067 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.068 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.068 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.068 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.068 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.068 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.068 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.068 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.068 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.068 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.068 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.068 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.068 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.068 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.068 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.068 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.069 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.069 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.069 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.069 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.069 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.069 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.069 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.069 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.069 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.069 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.069 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.069 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.069 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.069 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.069 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.069 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.070 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.070 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.070 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.070 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.070 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.070 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.070 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.070 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.070 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.070 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.070 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.070 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.070 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.070 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.071 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.071 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.071 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.071 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.071 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.071 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.071 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.071 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.071 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.071 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.071 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.071 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.071 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.071 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.072 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.072 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.072 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.072 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.072 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.072 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.072 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.072 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.072 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.072 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.072 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.072 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.072 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.072 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.072 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.073 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.073 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.073 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.073 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.073 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.073 INFO:teuthology.orchestra.run.smithi045.stdout: "server_addr": { 2024-05-10T03:43:48.073 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_addr", 2024-05-10T03:43:48.073 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.073 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.073 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.073 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.073 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.073 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.074 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.074 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.074 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.074 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.074 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.074 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.074 INFO:teuthology.orchestra.run.smithi045.stdout: "server_port": { 2024-05-10T03:43:48.074 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_port", 2024-05-10T03:43:48.074 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.074 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.074 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.074 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.074 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.074 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.075 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.075 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.075 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.075 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.075 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.075 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.075 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.075 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.075 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.075 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rgw", 2024-05-10T03:43:48.075 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.075 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.075 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.075 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.075 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.076 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.076 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.076 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.076 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.076 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.076 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.076 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.076 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.076 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.076 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.076 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.076 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.077 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.077 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.077 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.077 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.077 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.077 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.077 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.077 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.077 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.077 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.077 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.077 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.077 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.077 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.078 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.078 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.078 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.078 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.078 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.078 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.078 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.078 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.078 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.078 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.078 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.078 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.078 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.079 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.079 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.079 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.079 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.079 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.079 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.079 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.079 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.079 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.079 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.079 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.079 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.079 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.079 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.080 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.080 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.080 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.080 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.080 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.080 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.080 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.080 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.080 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.080 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.080 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.080 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.080 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.080 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.080 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.081 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.081 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.081 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.081 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rook", 2024-05-10T03:43:48.081 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.081 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.081 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.081 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.081 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.081 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.081 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.081 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.081 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.081 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.082 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.082 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.082 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.082 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.082 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.082 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.082 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.082 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.082 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.082 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.082 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.082 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.082 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.082 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.083 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.083 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.083 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.083 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.083 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.083 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.083 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.083 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.083 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.083 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.083 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.083 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.083 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.083 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.084 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.084 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.084 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.084 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.084 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.084 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.084 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.084 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.084 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.084 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.084 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.084 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.084 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.084 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.084 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.085 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.085 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.085 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.085 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.085 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.085 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.085 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.085 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.085 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.085 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.085 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.085 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.085 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.085 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.085 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.086 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.086 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.086 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.086 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.086 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.086 INFO:teuthology.orchestra.run.smithi045.stdout: "storage_class": { 2024-05-10T03:43:48.086 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "storage_class", 2024-05-10T03:43:48.086 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.086 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.086 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.086 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "local", 2024-05-10T03:43:48.086 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.086 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.086 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.087 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-10T03:43:48.087 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.087 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.087 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.087 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.087 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.087 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.087 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.087 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "selftest", 2024-05-10T03:43:48.087 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.087 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.087 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.087 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.087 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.088 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.088 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.088 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.088 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.088 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.088 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.088 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.088 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.088 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.088 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.088 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.088 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.088 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.088 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.088 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.089 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.089 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.089 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.089 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.089 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.089 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.089 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.089 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.089 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.089 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.089 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.089 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.089 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.089 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.089 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.090 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.090 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.090 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.090 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.090 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.090 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.090 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.090 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.090 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.090 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.090 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.090 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.090 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.091 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.091 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.091 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.091 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.091 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.091 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.091 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.091 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.091 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.091 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.091 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.091 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.091 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.091 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.092 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.092 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.092 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.092 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.092 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.092 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.092 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.092 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.092 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.092 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.092 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.092 INFO:teuthology.orchestra.run.smithi045.stdout: "roption1": { 2024-05-10T03:43:48.092 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "roption1", 2024-05-10T03:43:48.092 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.093 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.093 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.093 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.093 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.093 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.093 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.093 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.093 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.093 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.093 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.093 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.093 INFO:teuthology.orchestra.run.smithi045.stdout: "roption2": { 2024-05-10T03:43:48.093 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "roption2", 2024-05-10T03:43:48.093 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.093 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.094 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.094 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "xyz", 2024-05-10T03:43:48.094 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.094 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.094 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.094 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.094 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.094 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.094 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.094 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.094 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption1": { 2024-05-10T03:43:48.094 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption1", 2024-05-10T03:43:48.094 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.094 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.095 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.095 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.095 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.095 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.095 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.095 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.095 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.095 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.095 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.095 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.095 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption2": { 2024-05-10T03:43:48.095 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption2", 2024-05-10T03:43:48.095 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.095 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.095 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.096 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.096 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.096 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.096 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.096 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.096 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.096 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.096 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.096 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.096 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption3": { 2024-05-10T03:43:48.096 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption3", 2024-05-10T03:43:48.096 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-05-10T03:43:48.096 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.096 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.097 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.097 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.097 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.097 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.097 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.097 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.097 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.097 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.097 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.097 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption4": { 2024-05-10T03:43:48.097 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption4", 2024-05-10T03:43:48.097 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.097 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.097 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.097 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.097 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.098 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.098 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.098 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.098 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.098 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.098 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.098 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.098 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption5": { 2024-05-10T03:43:48.098 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption5", 2024-05-10T03:43:48.098 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.098 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.098 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.098 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.099 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.099 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.099 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.099 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.099 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.099 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.099 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.099 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.099 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption6": { 2024-05-10T03:43:48.099 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption6", 2024-05-10T03:43:48.099 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.099 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.099 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.099 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.099 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.100 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.100 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.100 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.100 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.100 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.100 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.100 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.100 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption7": { 2024-05-10T03:43:48.100 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption7", 2024-05-10T03:43:48.100 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.100 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.100 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.100 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.100 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1", 2024-05-10T03:43:48.100 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "42", 2024-05-10T03:43:48.101 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.101 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.101 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.101 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.101 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.101 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.101 INFO:teuthology.orchestra.run.smithi045.stdout: "testkey": { 2024-05-10T03:43:48.101 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "testkey", 2024-05-10T03:43:48.101 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.101 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.101 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.101 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.101 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.101 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.101 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.102 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.102 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.102 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.102 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.102 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.102 INFO:teuthology.orchestra.run.smithi045.stdout: "testlkey": { 2024-05-10T03:43:48.102 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "testlkey", 2024-05-10T03:43:48.102 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.102 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.102 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.102 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.102 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.102 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.102 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.103 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.103 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.103 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.103 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.103 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.103 INFO:teuthology.orchestra.run.smithi045.stdout: "testnewline": { 2024-05-10T03:43:48.103 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "testnewline", 2024-05-10T03:43:48.103 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.103 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.103 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.103 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.103 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.103 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.103 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.104 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.104 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.104 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.104 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.104 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.104 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.104 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.104 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.104 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "snap_schedule", 2024-05-10T03:43:48.104 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.104 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.104 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.104 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_m_granularity": { 2024-05-10T03:43:48.104 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "allow_m_granularity", 2024-05-10T03:43:48.105 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.105 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.105 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.105 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.105 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.105 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.105 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.105 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "allow minute scheduled snapshots", 2024-05-10T03:43:48.105 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.105 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.105 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.105 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.105 INFO:teuthology.orchestra.run.smithi045.stdout: "dump_on_update": { 2024-05-10T03:43:48.105 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "dump_on_update", 2024-05-10T03:43:48.106 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.106 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.106 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.106 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.106 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.106 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.106 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.106 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "dump database to debug log on update", 2024-05-10T03:43:48.106 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.106 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.106 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.106 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.106 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.107 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.107 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.107 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.107 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.107 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.107 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.107 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.107 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.107 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.107 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.107 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.107 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.107 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.107 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.107 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.108 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.108 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.108 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.108 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.108 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.108 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.108 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.108 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.108 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.108 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.108 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.108 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.108 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.108 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.109 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.109 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.109 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.109 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.109 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.109 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.109 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.109 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.109 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.109 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.109 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.109 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.109 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.109 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.109 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.110 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.110 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.110 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.110 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.110 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.110 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.110 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.110 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.110 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.110 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.110 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.110 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.110 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.111 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.111 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.111 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.111 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.111 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.111 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.111 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.111 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.111 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.111 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.111 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.111 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.111 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.111 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.111 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.112 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "stats", 2024-05-10T03:43:48.112 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.112 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.112 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.112 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.112 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.112 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.112 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.112 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.112 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.112 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.112 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.112 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.112 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.113 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.113 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.113 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.113 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.113 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.113 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.113 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.113 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.113 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.113 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.113 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.113 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.113 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.113 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.113 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.113 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.114 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.114 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.114 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.114 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.114 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.114 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.114 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.114 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.114 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.114 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.114 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.114 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.114 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.115 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.115 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.115 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.115 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.115 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.115 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.115 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.115 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.115 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.115 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.115 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.115 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.115 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.115 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.115 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.116 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.116 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.116 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.116 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.116 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.116 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.116 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.116 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.116 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.116 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.116 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.116 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.116 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.116 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.116 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.116 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.117 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.117 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.117 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.117 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "status", 2024-05-10T03:43:48.117 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.117 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.117 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.117 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.117 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.117 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.117 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.117 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.117 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.117 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.118 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.118 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.118 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.118 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.118 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.118 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.118 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.118 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.118 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.118 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.118 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.118 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.118 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.118 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.119 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.119 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.119 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.119 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.119 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.119 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.119 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.119 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.119 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.119 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.119 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.119 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.119 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.119 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.120 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.120 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.120 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.120 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.120 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.120 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.120 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.120 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.120 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.120 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.120 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.120 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.120 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.120 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.121 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.121 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.121 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.121 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.121 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.121 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.121 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.121 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.121 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.121 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.121 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.121 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.122 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.122 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.122 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.122 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.122 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.122 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.122 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.122 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.122 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.122 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.123 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.123 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.123 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "telegraf", 2024-05-10T03:43:48.123 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.123 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.123 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.123 INFO:teuthology.orchestra.run.smithi045.stdout: "address": { 2024-05-10T03:43:48.123 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "address", 2024-05-10T03:43:48.123 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.123 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.123 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.123 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-10T03:43:48.123 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.123 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.124 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.124 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.124 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.124 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.124 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.124 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.124 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-05-10T03:43:48.124 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-05-10T03:43:48.124 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:48.124 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.124 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.124 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "15", 2024-05-10T03:43:48.124 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.124 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.125 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.125 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.125 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.125 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.125 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.125 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.125 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.125 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.125 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.125 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.125 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.125 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.125 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.125 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.125 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.126 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.126 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.126 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.126 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.126 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.126 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.126 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.126 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.126 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.126 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.126 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.126 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.126 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.126 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.126 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.127 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.127 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.127 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.127 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.127 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.127 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.127 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.127 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.127 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.127 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.127 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.127 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.127 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.127 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.128 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.128 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.128 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.128 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.128 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.128 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.128 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.128 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.128 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.128 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.128 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.128 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.128 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.128 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.128 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.129 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.129 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.129 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.129 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.129 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.129 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.129 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.129 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.129 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.129 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.129 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.129 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.129 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.129 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.129 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.130 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.130 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.130 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.130 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.130 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.130 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "telemetry", 2024-05-10T03:43:48.130 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.130 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.130 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.130 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_basic": { 2024-05-10T03:43:48.130 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_basic", 2024-05-10T03:43:48.130 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.130 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.130 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.131 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.131 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.131 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.131 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.131 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-10T03:43:48.131 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.131 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.131 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.131 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.131 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_crash": { 2024-05-10T03:43:48.131 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_crash", 2024-05-10T03:43:48.131 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.131 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.131 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.132 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.132 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.132 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.132 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.132 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-10T03:43:48.132 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.132 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.132 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.132 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.132 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_device": { 2024-05-10T03:43:48.132 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_device", 2024-05-10T03:43:48.132 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.132 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.132 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.132 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.133 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.133 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.133 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.133 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-10T03:43:48.133 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.133 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.133 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.133 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.133 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_ident": { 2024-05-10T03:43:48.133 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_ident", 2024-05-10T03:43:48.133 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.133 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.133 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.133 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.134 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.134 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.134 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.134 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-10T03:43:48.134 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.134 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.134 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.134 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.134 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_perf": { 2024-05-10T03:43:48.134 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_perf", 2024-05-10T03:43:48.134 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.134 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.134 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.134 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.135 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.135 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.135 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.135 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-10T03:43:48.135 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.135 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.135 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.135 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.135 INFO:teuthology.orchestra.run.smithi045.stdout: "contact": { 2024-05-10T03:43:48.135 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "contact", 2024-05-10T03:43:48.135 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.135 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.135 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.135 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.136 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.136 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.136 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.136 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.136 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.136 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.136 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.136 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.136 INFO:teuthology.orchestra.run.smithi045.stdout: "description": { 2024-05-10T03:43:48.136 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "description", 2024-05-10T03:43:48.136 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.136 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.136 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.136 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.137 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.137 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.137 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.137 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.137 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.137 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.137 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.137 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.137 INFO:teuthology.orchestra.run.smithi045.stdout: "device_url": { 2024-05-10T03:43:48.137 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "device_url", 2024-05-10T03:43:48.137 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.137 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.137 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.137 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-10T03:43:48.137 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.138 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.138 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.138 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.138 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.138 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.138 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.138 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.138 INFO:teuthology.orchestra.run.smithi045.stdout: "enabled": { 2024-05-10T03:43:48.138 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "enabled", 2024-05-10T03:43:48.138 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.138 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.138 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.138 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.138 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.138 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.139 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.139 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.139 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.139 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.139 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.139 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.139 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-05-10T03:43:48.139 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-05-10T03:43:48.139 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.139 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.139 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.139 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "24", 2024-05-10T03:43:48.139 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "8", 2024-05-10T03:43:48.139 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.139 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.140 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.140 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.140 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.140 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.140 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.140 INFO:teuthology.orchestra.run.smithi045.stdout: "last_opt_revision": { 2024-05-10T03:43:48.140 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "last_opt_revision", 2024-05-10T03:43:48.140 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.140 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.140 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.140 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "1", 2024-05-10T03:43:48.140 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.140 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.140 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.140 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.141 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.141 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.141 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.141 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.141 INFO:teuthology.orchestra.run.smithi045.stdout: "leaderboard": { 2024-05-10T03:43:48.141 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "leaderboard", 2024-05-10T03:43:48.141 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.141 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.141 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.141 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.141 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.141 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.141 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.141 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.141 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.142 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.142 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.142 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.142 INFO:teuthology.orchestra.run.smithi045.stdout: "leaderboard_description": { 2024-05-10T03:43:48.142 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "leaderboard_description", 2024-05-10T03:43:48.142 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.142 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.142 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.142 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.142 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.142 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.142 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.142 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.142 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.142 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.143 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.143 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.143 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.143 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.143 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.143 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.143 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.143 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.143 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.143 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.143 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.143 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.143 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.143 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.144 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.144 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.144 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.144 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.144 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.144 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.144 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.144 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.144 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.144 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.144 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.144 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.144 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.144 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.145 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.145 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.145 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.145 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.145 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.145 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.145 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.145 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.145 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.145 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.145 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.145 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.145 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.145 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.145 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.146 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.146 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.146 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.146 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.146 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.146 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.146 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.146 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.146 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.146 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.146 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.146 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.146 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.146 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.147 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.147 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.147 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.147 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.147 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.147 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.147 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.147 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.147 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.147 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.147 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.147 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.147 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.147 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.148 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.148 INFO:teuthology.orchestra.run.smithi045.stdout: "organization": { 2024-05-10T03:43:48.148 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "organization", 2024-05-10T03:43:48.148 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.148 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.148 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.148 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.148 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.148 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.148 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.148 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.148 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.148 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.148 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.149 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.149 INFO:teuthology.orchestra.run.smithi045.stdout: "proxy": { 2024-05-10T03:43:48.149 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "proxy", 2024-05-10T03:43:48.149 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.149 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.149 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.149 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.149 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.149 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.149 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.149 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.149 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.149 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.149 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.149 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.150 INFO:teuthology.orchestra.run.smithi045.stdout: "url": { 2024-05-10T03:43:48.150 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "url", 2024-05-10T03:43:48.150 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.150 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.150 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.150 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-10T03:43:48.150 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.150 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.150 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.150 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.150 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.150 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.150 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.150 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.151 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.151 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.151 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.151 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "test_orchestrator", 2024-05-10T03:43:48.151 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.151 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.151 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.151 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.151 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.151 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.151 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.151 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.151 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.151 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.152 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.152 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.152 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.152 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.152 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.152 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.152 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.152 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.152 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.152 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.152 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.152 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.152 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.152 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.152 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.152 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.153 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.153 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.153 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.153 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.153 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.153 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.153 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.153 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.153 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.153 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.153 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.153 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.153 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.153 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.154 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.154 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.154 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.154 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.154 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.154 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.154 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.154 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.154 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.154 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.154 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.154 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.154 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.154 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.154 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.155 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.155 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.155 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.155 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.155 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.155 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.155 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.155 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.155 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.155 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.155 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.155 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.155 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.155 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.156 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.156 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.156 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.156 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.156 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.156 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.156 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.156 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "volumes", 2024-05-10T03:43:48.156 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.156 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.156 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.156 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.156 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.156 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.157 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.157 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.157 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.157 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.157 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.157 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.157 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.157 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.157 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.157 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.157 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.157 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.157 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.157 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.158 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.158 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.158 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.158 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.158 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.158 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.158 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.158 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.158 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.158 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.158 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.158 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.158 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.158 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.159 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.159 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.159 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.159 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.159 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.159 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.159 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.159 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.159 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.159 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.159 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.159 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.159 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.159 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.160 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.160 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.160 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.160 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.160 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.160 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.160 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.160 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.160 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.160 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.160 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.160 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.160 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.160 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.160 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.161 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.161 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.161 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.161 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.161 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.161 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.161 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.161 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.161 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.161 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.161 INFO:teuthology.orchestra.run.smithi045.stdout: "max_concurrent_clones": { 2024-05-10T03:43:48.161 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_concurrent_clones", 2024-05-10T03:43:48.161 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.161 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.162 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.162 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "4", 2024-05-10T03:43:48.162 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.162 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.162 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.162 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-10T03:43:48.162 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.162 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.162 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.162 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.162 INFO:teuthology.orchestra.run.smithi045.stdout: "snapshot_clone_delay": { 2024-05-10T03:43:48.162 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "snapshot_clone_delay", 2024-05-10T03:43:48.162 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.162 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.162 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.163 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-05-10T03:43:48.163 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.163 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.163 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.163 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-10T03:43:48.163 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.163 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.163 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.163 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.163 INFO:teuthology.orchestra.run.smithi045.stdout: "snapshot_clone_no_wait": { 2024-05-10T03:43:48.163 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "snapshot_clone_no_wait", 2024-05-10T03:43:48.163 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.163 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.163 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.163 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.164 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.164 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.164 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.164 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-10T03:43:48.164 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.164 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.164 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.164 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.164 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.164 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.164 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.164 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "zabbix", 2024-05-10T03:43:48.164 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.164 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.164 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.165 INFO:teuthology.orchestra.run.smithi045.stdout: "discovery_interval": { 2024-05-10T03:43:48.165 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "discovery_interval", 2024-05-10T03:43:48.165 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-05-10T03:43:48.165 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.165 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.165 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "100", 2024-05-10T03:43:48.165 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.165 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.165 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.165 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.165 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.165 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.165 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.165 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.165 INFO:teuthology.orchestra.run.smithi045.stdout: "identifier": { 2024-05-10T03:43:48.165 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "identifier", 2024-05-10T03:43:48.166 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.166 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.166 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.166 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.166 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.166 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.166 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.166 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.166 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.166 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.166 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.166 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.166 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-05-10T03:43:48.166 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-05-10T03:43:48.167 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:48.167 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.167 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.167 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-05-10T03:43:48.167 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.167 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.167 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.167 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.167 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.167 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.167 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.167 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.167 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.167 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.167 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.168 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.168 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.168 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.168 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.168 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.168 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.168 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.168 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.168 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.168 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.168 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.168 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.168 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.168 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.168 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.168 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.169 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.169 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.169 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.169 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.169 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.169 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.169 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.169 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.169 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.169 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.169 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.169 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.169 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.169 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.169 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.170 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.170 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.170 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.170 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.170 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.170 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.170 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.170 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.170 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.170 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.170 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.170 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.170 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.170 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.171 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.171 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.171 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.171 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.171 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.171 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.171 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.171 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.171 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.171 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.171 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.171 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.171 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.171 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.172 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.172 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.172 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.172 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.172 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.172 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.172 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.172 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.172 INFO:teuthology.orchestra.run.smithi045.stdout: "zabbix_host": { 2024-05-10T03:43:48.172 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "zabbix_host", 2024-05-10T03:43:48.172 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.172 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.172 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.172 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.172 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.172 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.173 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.173 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.173 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.173 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.173 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.173 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.173 INFO:teuthology.orchestra.run.smithi045.stdout: "zabbix_port": { 2024-05-10T03:43:48.173 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "zabbix_port", 2024-05-10T03:43:48.173 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.173 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.173 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.173 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10051", 2024-05-10T03:43:48.173 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.173 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.174 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.174 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.174 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.174 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.174 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.174 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.174 INFO:teuthology.orchestra.run.smithi045.stdout: "zabbix_sender": { 2024-05-10T03:43:48.174 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "zabbix_sender", 2024-05-10T03:43:48.174 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.174 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.174 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.174 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-10T03:43:48.174 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.174 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.175 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.175 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.175 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.175 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.175 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.175 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.175 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.175 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.175 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-05-10T03:43:48.175 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.175 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.175 INFO:teuthology.orchestra.run.smithi045.stdout: "modules": [ 2024-05-10T03:43:48.175 INFO:teuthology.orchestra.run.smithi045.stdout: "cephadm", 2024-05-10T03:43:48.175 INFO:teuthology.orchestra.run.smithi045.stdout: "dashboard", 2024-05-10T03:43:48.176 INFO:teuthology.orchestra.run.smithi045.stdout: "iostat", 2024-05-10T03:43:48.176 INFO:teuthology.orchestra.run.smithi045.stdout: "nfs", 2024-05-10T03:43:48.176 INFO:teuthology.orchestra.run.smithi045.stdout: "restful" 2024-05-10T03:43:48.176 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.176 INFO:teuthology.orchestra.run.smithi045.stdout: "available_modules": [ 2024-05-10T03:43:48.176 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.176 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "alerts", 2024-05-10T03:43:48.176 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.176 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.176 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.176 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-05-10T03:43:48.176 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-05-10T03:43:48.176 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:48.176 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.176 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.177 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-05-10T03:43:48.177 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.177 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.177 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.177 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "How frequently to reexamine health status", 2024-05-10T03:43:48.177 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.177 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.177 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.177 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.177 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.177 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.177 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.177 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.177 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.177 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.178 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.178 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.178 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.178 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.178 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.178 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.178 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.178 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.178 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.178 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.178 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.178 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.178 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.178 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.179 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.179 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.179 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.179 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.179 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.179 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.179 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.179 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.179 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.179 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.179 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.179 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.179 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.179 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.179 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.180 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.180 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.180 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.180 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.180 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.180 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.180 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.180 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.180 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.180 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.180 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.180 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.180 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.180 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.181 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.181 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.181 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.181 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.181 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.181 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.181 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.181 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.181 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.181 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.181 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.181 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.181 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.181 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.181 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.182 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.182 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.182 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.182 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.182 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.182 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.182 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_destination": { 2024-05-10T03:43:48.182 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_destination", 2024-05-10T03:43:48.182 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.182 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.182 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.182 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.182 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.183 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.183 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.183 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Email address to send alerts to", 2024-05-10T03:43:48.183 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.183 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.183 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.183 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.183 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_from_name": { 2024-05-10T03:43:48.183 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_from_name", 2024-05-10T03:43:48.183 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.183 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.183 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.183 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "Ceph", 2024-05-10T03:43:48.183 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.183 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.183 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.184 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Email From: name", 2024-05-10T03:43:48.184 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.184 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.184 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.184 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.184 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_host": { 2024-05-10T03:43:48.184 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_host", 2024-05-10T03:43:48.184 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.184 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.184 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.184 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.184 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.184 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.184 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.184 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "SMTP server", 2024-05-10T03:43:48.185 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.185 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.185 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.185 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.185 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_password": { 2024-05-10T03:43:48.185 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_password", 2024-05-10T03:43:48.185 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.185 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.185 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.185 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.185 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.185 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.185 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.185 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Password to authenticate with", 2024-05-10T03:43:48.186 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.186 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.186 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.186 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.186 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_port": { 2024-05-10T03:43:48.186 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_port", 2024-05-10T03:43:48.186 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.186 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.186 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.186 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "465", 2024-05-10T03:43:48.186 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.186 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.186 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.186 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "SMTP port", 2024-05-10T03:43:48.187 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.187 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.187 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.187 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.187 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_sender": { 2024-05-10T03:43:48.187 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_sender", 2024-05-10T03:43:48.187 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.187 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.187 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.187 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.187 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.187 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.187 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.187 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "SMTP envelope sender", 2024-05-10T03:43:48.187 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.188 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.188 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.188 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.188 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_ssl": { 2024-05-10T03:43:48.188 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_ssl", 2024-05-10T03:43:48.188 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.188 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.188 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.188 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.188 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.188 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.188 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.188 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-10T03:43:48.188 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.188 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.189 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.189 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.189 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_user": { 2024-05-10T03:43:48.189 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_user", 2024-05-10T03:43:48.189 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.189 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.189 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.189 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.189 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.189 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.189 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.189 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "User to authenticate as", 2024-05-10T03:43:48.189 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.189 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.189 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.190 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.190 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.190 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.190 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.190 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "balancer", 2024-05-10T03:43:48.190 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.190 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.190 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.190 INFO:teuthology.orchestra.run.smithi045.stdout: "active": { 2024-05-10T03:43:48.190 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "active", 2024-05-10T03:43:48.190 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.190 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.190 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.190 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.191 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.191 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.191 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.191 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "automatically balance PGs across cluster", 2024-05-10T03:43:48.191 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.191 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.191 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.191 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.191 INFO:teuthology.orchestra.run.smithi045.stdout: "begin_time": { 2024-05-10T03:43:48.191 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "begin_time", 2024-05-10T03:43:48.191 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.191 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.191 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.191 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0000", 2024-05-10T03:43:48.191 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.192 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.192 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.192 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "beginning time of day to automatically balance", 2024-05-10T03:43:48.192 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-10T03:43:48.192 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.192 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.192 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.192 INFO:teuthology.orchestra.run.smithi045.stdout: "begin_weekday": { 2024-05-10T03:43:48.192 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "begin_weekday", 2024-05-10T03:43:48.192 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-05-10T03:43:48.192 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.192 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.192 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-05-10T03:43:48.192 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "0", 2024-05-10T03:43:48.193 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "6", 2024-05-10T03:43:48.193 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.193 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-10T03:43:48.193 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-10T03:43:48.193 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.193 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.193 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.193 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_compat_max_iterations": { 2024-05-10T03:43:48.193 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crush_compat_max_iterations", 2024-05-10T03:43:48.193 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-05-10T03:43:48.193 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.193 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.193 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "25", 2024-05-10T03:43:48.193 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1", 2024-05-10T03:43:48.193 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "250", 2024-05-10T03:43:48.193 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.194 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-10T03:43:48.194 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.194 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.194 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.194 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.194 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_compat_metrics": { 2024-05-10T03:43:48.194 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crush_compat_metrics", 2024-05-10T03:43:48.194 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.194 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.194 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.194 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "pgs,objects,bytes", 2024-05-10T03:43:48.194 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.194 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.194 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.195 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-10T03:43:48.195 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-10T03:43:48.195 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.195 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.195 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.195 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_compat_step": { 2024-05-10T03:43:48.195 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crush_compat_step", 2024-05-10T03:43:48.195 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-05-10T03:43:48.195 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.195 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.195 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0.5", 2024-05-10T03:43:48.195 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "0.001", 2024-05-10T03:43:48.195 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "0.999", 2024-05-10T03:43:48.195 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.195 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "aggressiveness of optimization", 2024-05-10T03:43:48.196 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-10T03:43:48.196 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.196 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.196 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.196 INFO:teuthology.orchestra.run.smithi045.stdout: "end_time": { 2024-05-10T03:43:48.196 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "end_time", 2024-05-10T03:43:48.196 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.196 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.196 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.196 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "2359", 2024-05-10T03:43:48.196 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.196 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.196 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.196 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "ending time of day to automatically balance", 2024-05-10T03:43:48.196 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-10T03:43:48.197 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.197 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.197 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.197 INFO:teuthology.orchestra.run.smithi045.stdout: "end_weekday": { 2024-05-10T03:43:48.197 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "end_weekday", 2024-05-10T03:43:48.197 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-05-10T03:43:48.197 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.197 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.197 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-05-10T03:43:48.197 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "0", 2024-05-10T03:43:48.197 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "6", 2024-05-10T03:43:48.197 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.197 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-10T03:43:48.197 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-10T03:43:48.197 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.198 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.198 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.198 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.198 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.198 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.198 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.198 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.198 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.198 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.198 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.198 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.198 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.198 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.198 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.198 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.199 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.200 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.200 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.200 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.200 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.200 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.200 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.200 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.200 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.200 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.200 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.200 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.200 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.200 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.200 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.201 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.201 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.201 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.201 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.201 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.201 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.201 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.201 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.201 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.201 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.201 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.201 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.201 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.201 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.201 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.202 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.202 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.202 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.202 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.202 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.202 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.202 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.202 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.202 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.202 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.202 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.202 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.202 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.202 INFO:teuthology.orchestra.run.smithi045.stdout: "min_score": { 2024-05-10T03:43:48.203 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "min_score", 2024-05-10T03:43:48.203 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-05-10T03:43:48.203 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.203 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.203 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-05-10T03:43:48.203 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.203 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.203 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.203 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-10T03:43:48.203 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.203 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.203 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.203 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.203 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": { 2024-05-10T03:43:48.203 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mode", 2024-05-10T03:43:48.204 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.204 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.204 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.204 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "upmap", 2024-05-10T03:43:48.204 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.204 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.204 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.204 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-compat", 2024-05-10T03:43:48.204 INFO:teuthology.orchestra.run.smithi045.stdout: "none", 2024-05-10T03:43:48.204 INFO:teuthology.orchestra.run.smithi045.stdout: "upmap" 2024-05-10T03:43:48.204 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.204 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Balancer mode", 2024-05-10T03:43:48.204 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.204 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.204 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_ids": { 2024-05-10T03:43:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "pool_ids", 2024-05-10T03:43:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-10T03:43:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.205 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.206 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-05-10T03:43:48.206 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-05-10T03:43:48.206 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:48.206 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.206 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.206 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-05-10T03:43:48.206 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.206 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.206 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.206 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-10T03:43:48.206 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.206 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.206 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.206 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.207 INFO:teuthology.orchestra.run.smithi045.stdout: "upmap_max_deviation": { 2024-05-10T03:43:48.207 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "upmap_max_deviation", 2024-05-10T03:43:48.207 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.207 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.207 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.207 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-05-10T03:43:48.207 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1", 2024-05-10T03:43:48.207 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.207 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.207 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-10T03:43:48.207 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-10T03:43:48.207 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.207 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.207 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: "upmap_max_optimizations": { 2024-05-10T03:43:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "upmap_max_optimizations", 2024-05-10T03:43:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-05-10T03:43:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-05-10T03:43:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-10T03:43:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.208 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cephadm", 2024-05-10T03:43:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: "agent_down_multiplier": { 2024-05-10T03:43:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "agent_down_multiplier", 2024-05-10T03:43:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-05-10T03:43:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "3.0", 2024-05-10T03:43:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.209 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.210 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-10T03:43:48.210 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.210 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.210 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.210 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.210 INFO:teuthology.orchestra.run.smithi045.stdout: "agent_refresh_rate": { 2024-05-10T03:43:48.210 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "agent_refresh_rate", 2024-05-10T03:43:48.210 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:48.210 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.210 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.210 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "20", 2024-05-10T03:43:48.210 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.210 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.210 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.211 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-10T03:43:48.211 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.211 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.211 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.211 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.211 INFO:teuthology.orchestra.run.smithi045.stdout: "agent_starting_port": { 2024-05-10T03:43:48.211 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "agent_starting_port", 2024-05-10T03:43:48.211 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.211 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.211 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.211 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "4721", 2024-05-10T03:43:48.211 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.211 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.211 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.211 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-10T03:43:48.212 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.212 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.212 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.212 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.212 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_ptrace": { 2024-05-10T03:43:48.212 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "allow_ptrace", 2024-05-10T03:43:48.212 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.212 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.212 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.212 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.212 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.212 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.212 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.212 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-10T03:43:48.212 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-10T03:43:48.213 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.213 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.213 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.213 INFO:teuthology.orchestra.run.smithi045.stdout: "autotune_interval": { 2024-05-10T03:43:48.213 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "autotune_interval", 2024-05-10T03:43:48.213 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:48.213 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.213 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.213 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-05-10T03:43:48.213 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.213 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.213 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.213 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-10T03:43:48.213 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.213 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.214 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.214 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.214 INFO:teuthology.orchestra.run.smithi045.stdout: "autotune_memory_target_ratio": { 2024-05-10T03:43:48.214 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "autotune_memory_target_ratio", 2024-05-10T03:43:48.214 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-05-10T03:43:48.214 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.214 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.214 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0.7", 2024-05-10T03:43:48.214 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.214 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.214 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.214 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-10T03:43:48.214 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.214 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.215 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.215 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.215 INFO:teuthology.orchestra.run.smithi045.stdout: "cgroups_split": { 2024-05-10T03:43:48.215 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cgroups_split", 2024-05-10T03:43:48.215 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.215 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.215 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.215 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.215 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.215 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.215 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.215 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-10T03:43:48.217 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.217 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.217 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.217 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.217 INFO:teuthology.orchestra.run.smithi045.stdout: "config_checks_enabled": { 2024-05-10T03:43:48.217 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "config_checks_enabled", 2024-05-10T03:43:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-10T03:43:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: "config_dashboard": { 2024-05-10T03:43:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "config_dashboard", 2024-05-10T03:43:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-10T03:43:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_alertmanager": { 2024-05-10T03:43:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_alertmanager", 2024-05-10T03:43:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-10T03:43:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Prometheus container image", 2024-05-10T03:43:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_base": { 2024-05-10T03:43:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_base", 2024-05-10T03:43:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-10T03:43:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Container image name, without the tag", 2024-05-10T03:43:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_elasticsearch": { 2024-05-10T03:43:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_elasticsearch", 2024-05-10T03:43:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-10T03:43:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "elasticsearch container image", 2024-05-10T03:43:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_grafana": { 2024-05-10T03:43:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_grafana", 2024-05-10T03:43:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.223 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.223 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-05-10T03:43:48.223 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.223 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.223 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.223 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Prometheus container image", 2024-05-10T03:43:48.223 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.223 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.223 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.223 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.223 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_haproxy": { 2024-05-10T03:43:48.223 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_haproxy", 2024-05-10T03:43:48.223 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.223 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.223 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-10T03:43:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "HAproxy container image", 2024-05-10T03:43:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_jaeger_agent": { 2024-05-10T03:43:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_jaeger_agent", 2024-05-10T03:43:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-10T03:43:48.225 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.225 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.225 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.225 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Jaeger agent container image", 2024-05-10T03:43:48.225 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.225 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.225 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.225 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.225 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_jaeger_collector": { 2024-05-10T03:43:48.225 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_jaeger_collector", 2024-05-10T03:43:48.225 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.225 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.225 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.225 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-10T03:43:48.225 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Jaeger collector container image", 2024-05-10T03:43:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_jaeger_query": { 2024-05-10T03:43:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_jaeger_query", 2024-05-10T03:43:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-10T03:43:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Jaeger query container image", 2024-05-10T03:43:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_keepalived": { 2024-05-10T03:43:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_keepalived", 2024-05-10T03:43:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-10T03:43:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.228 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.228 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Keepalived container image", 2024-05-10T03:43:48.228 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.228 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.228 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.228 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.228 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_loki": { 2024-05-10T03:43:48.228 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_loki", 2024-05-10T03:43:48.228 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.228 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.228 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.228 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-10T03:43:48.228 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.228 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.229 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.229 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Loki container image", 2024-05-10T03:43:48.229 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.229 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.229 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.229 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.229 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_node_exporter": { 2024-05-10T03:43:48.229 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_node_exporter", 2024-05-10T03:43:48.229 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.229 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.229 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.229 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-10T03:43:48.229 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.229 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.229 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.230 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Prometheus container image", 2024-05-10T03:43:48.230 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.230 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.230 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.230 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.230 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_nvmeof": { 2024-05-10T03:43:48.230 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_nvmeof", 2024-05-10T03:43:48.230 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.230 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.230 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.230 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-05-10T03:43:48.230 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.230 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Nvme-of container image", 2024-05-10T03:43:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_prometheus": { 2024-05-10T03:43:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_prometheus", 2024-05-10T03:43:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-10T03:43:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.231 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.232 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Prometheus container image", 2024-05-10T03:43:48.232 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.232 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.232 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.232 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.232 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_promtail": { 2024-05-10T03:43:48.232 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_promtail", 2024-05-10T03:43:48.232 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.232 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.232 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.232 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-10T03:43:48.232 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.232 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.232 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.233 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Promtail container image", 2024-05-10T03:43:48.233 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.233 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.233 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.233 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.233 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_snmp_gateway": { 2024-05-10T03:43:48.233 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_snmp_gateway", 2024-05-10T03:43:48.233 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.233 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.233 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.233 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-10T03:43:48.233 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.233 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.233 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.233 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "SNMP Gateway container image", 2024-05-10T03:43:48.234 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.234 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.234 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.234 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.234 INFO:teuthology.orchestra.run.smithi045.stdout: "container_init": { 2024-05-10T03:43:48.234 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_init", 2024-05-10T03:43:48.234 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.234 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.234 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.234 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.234 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.234 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.234 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.234 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Run podman/docker with `--init`", 2024-05-10T03:43:48.235 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.235 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.235 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.235 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.235 INFO:teuthology.orchestra.run.smithi045.stdout: "daemon_cache_timeout": { 2024-05-10T03:43:48.235 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "daemon_cache_timeout", 2024-05-10T03:43:48.235 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:48.235 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.235 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.235 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-05-10T03:43:48.235 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.235 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.235 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.235 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-10T03:43:48.236 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.236 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.236 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.236 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.236 INFO:teuthology.orchestra.run.smithi045.stdout: "default_cephadm_command_timeout": { 2024-05-10T03:43:48.236 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "default_cephadm_command_timeout", 2024-05-10T03:43:48.236 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.236 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.236 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.236 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "900", 2024-05-10T03:43:48.236 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.236 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.236 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.236 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-10T03:43:48.236 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.237 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.237 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.237 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.237 INFO:teuthology.orchestra.run.smithi045.stdout: "default_registry": { 2024-05-10T03:43:48.237 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "default_registry", 2024-05-10T03:43:48.237 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.237 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.237 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.237 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "docker.io", 2024-05-10T03:43:48.237 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.237 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.237 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.237 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-10T03:43:48.237 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.237 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: "device_cache_timeout": { 2024-05-10T03:43:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "device_cache_timeout", 2024-05-10T03:43:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "1800", 2024-05-10T03:43:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "seconds to cache device inventory", 2024-05-10T03:43:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.238 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: "device_enhanced_scan": { 2024-05-10T03:43:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "device_enhanced_scan", 2024-05-10T03:43:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-10T03:43:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.239 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: "facts_cache_timeout": { 2024-05-10T03:43:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "facts_cache_timeout", 2024-05-10T03:43:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-05-10T03:43:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "seconds to cache host facts data", 2024-05-10T03:43:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.240 INFO:teuthology.orchestra.run.smithi045.stdout: "host_check_interval": { 2024-05-10T03:43:48.241 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "host_check_interval", 2024-05-10T03:43:48.241 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:48.241 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.241 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.241 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-05-10T03:43:48.241 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.241 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.241 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.241 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to perform a host check", 2024-05-10T03:43:48.241 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.241 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.241 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.241 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.241 INFO:teuthology.orchestra.run.smithi045.stdout: "hw_monitoring": { 2024-05-10T03:43:48.241 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "hw_monitoring", 2024-05-10T03:43:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-10T03:43:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: "inventory_list_all": { 2024-05-10T03:43:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "inventory_list_all", 2024-05-10T03:43:48.242 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.243 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.243 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.243 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.243 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.243 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.243 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.243 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-10T03:43:48.243 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.243 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.243 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.243 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.243 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.243 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.243 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.244 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.244 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.244 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.244 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.244 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.244 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.244 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.244 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.244 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.244 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.244 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.244 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.244 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.244 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.245 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.245 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.245 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.245 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.245 INFO:teuthology.orchestra.run.smithi045.stdout: "log_refresh_metadata": { 2024-05-10T03:43:48.245 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_refresh_metadata", 2024-05-10T03:43:48.245 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.245 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.245 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.245 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.245 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.245 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.245 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.246 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-10T03:43:48.246 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.246 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.246 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.246 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.246 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.246 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.246 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.246 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.246 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.246 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.246 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.246 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.246 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.247 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-10T03:43:48.247 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.247 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.247 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.247 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.247 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.247 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.247 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.247 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.247 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.247 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.247 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.247 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.247 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.248 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.248 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.248 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.248 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.248 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.248 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.248 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.248 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.248 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.248 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.248 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.248 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.248 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.248 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.248 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.249 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.249 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.249 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.249 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.249 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.249 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.249 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.249 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.249 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.249 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.249 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.249 INFO:teuthology.orchestra.run.smithi045.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-10T03:43:48.249 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-10T03:43:48.249 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.249 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.250 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.250 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.250 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.250 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.250 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.250 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-10T03:43:48.250 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.250 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.250 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.250 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.250 INFO:teuthology.orchestra.run.smithi045.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-10T03:43:48.250 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-10T03:43:48.250 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.250 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.251 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.251 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "*", 2024-05-10T03:43:48.251 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.251 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.251 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.251 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-10T03:43:48.251 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.251 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.251 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.251 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.251 INFO:teuthology.orchestra.run.smithi045.stdout: "max_count_per_host": { 2024-05-10T03:43:48.251 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_count_per_host", 2024-05-10T03:43:48.251 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.251 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.251 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.252 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-05-10T03:43:48.252 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.252 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.252 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.252 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "max number of daemons per service per host", 2024-05-10T03:43:48.252 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.252 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.252 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.252 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.252 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd_draining_count": { 2024-05-10T03:43:48.252 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_osd_draining_count", 2024-05-10T03:43:48.252 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.252 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.252 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.252 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-05-10T03:43:48.253 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.253 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.253 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.253 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-10T03:43:48.253 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.253 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.253 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.253 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.253 INFO:teuthology.orchestra.run.smithi045.stdout: "migration_current": { 2024-05-10T03:43:48.253 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "migration_current", 2024-05-10T03:43:48.253 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.253 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.253 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.253 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.253 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.254 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.254 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.254 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "internal - do not modify", 2024-05-10T03:43:48.254 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.254 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.254 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.254 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.254 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": { 2024-05-10T03:43:48.254 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mode", 2024-05-10T03:43:48.254 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.254 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.254 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.254 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "root", 2024-05-10T03:43:48.254 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.255 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.255 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.255 INFO:teuthology.orchestra.run.smithi045.stdout: "cephadm-package", 2024-05-10T03:43:48.255 INFO:teuthology.orchestra.run.smithi045.stdout: "root" 2024-05-10T03:43:48.255 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.255 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "mode for remote execution of cephadm", 2024-05-10T03:43:48.255 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.255 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.255 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.255 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.255 INFO:teuthology.orchestra.run.smithi045.stdout: "oob_default_addr": { 2024-05-10T03:43:48.255 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "oob_default_addr", 2024-05-10T03:43:48.255 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.255 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.255 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.256 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "169.254.1.1", 2024-05-10T03:43:48.256 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.256 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.256 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.256 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-10T03:43:48.256 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.256 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.256 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.256 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.256 INFO:teuthology.orchestra.run.smithi045.stdout: "prometheus_alerts_path": { 2024-05-10T03:43:48.256 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "prometheus_alerts_path", 2024-05-10T03:43:48.256 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.256 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.256 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.256 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-10T03:43:48.257 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.257 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.257 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.257 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-10T03:43:48.257 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.257 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.257 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.257 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.257 INFO:teuthology.orchestra.run.smithi045.stdout: "registry_insecure": { 2024-05-10T03:43:48.257 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "registry_insecure", 2024-05-10T03:43:48.257 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.257 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.257 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.257 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.257 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.257 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.258 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.258 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-10T03:43:48.258 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.258 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.258 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.258 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.258 INFO:teuthology.orchestra.run.smithi045.stdout: "registry_password": { 2024-05-10T03:43:48.258 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "registry_password", 2024-05-10T03:43:48.258 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.258 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.258 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.258 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.258 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.258 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.259 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.259 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-10T03:43:48.259 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.259 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.259 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.259 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.259 INFO:teuthology.orchestra.run.smithi045.stdout: "registry_url": { 2024-05-10T03:43:48.259 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "registry_url", 2024-05-10T03:43:48.259 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.259 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.259 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.259 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.259 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.259 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.260 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.260 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-10T03:43:48.260 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.260 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.260 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.260 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.260 INFO:teuthology.orchestra.run.smithi045.stdout: "registry_username": { 2024-05-10T03:43:48.260 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "registry_username", 2024-05-10T03:43:48.260 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.260 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.260 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.260 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.260 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.260 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.261 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.261 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-10T03:43:48.261 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.261 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.261 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.261 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.261 INFO:teuthology.orchestra.run.smithi045.stdout: "secure_monitoring_stack": { 2024-05-10T03:43:48.261 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "secure_monitoring_stack", 2024-05-10T03:43:48.261 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.261 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.261 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.261 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.261 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.261 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.261 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.262 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-10T03:43:48.262 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.262 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.262 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.262 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.262 INFO:teuthology.orchestra.run.smithi045.stdout: "service_discovery_port": { 2024-05-10T03:43:48.262 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "service_discovery_port", 2024-05-10T03:43:48.262 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.262 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.262 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.262 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8765", 2024-05-10T03:43:48.262 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.262 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.262 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.263 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "cephadm service discovery port", 2024-05-10T03:43:48.263 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.263 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.263 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.263 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.263 INFO:teuthology.orchestra.run.smithi045.stdout: "ssh_config_file": { 2024-05-10T03:43:48.263 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ssh_config_file", 2024-05-10T03:43:48.263 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.263 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.263 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.263 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.263 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.263 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.263 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.263 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-10T03:43:48.264 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.264 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.264 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.264 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.264 INFO:teuthology.orchestra.run.smithi045.stdout: "use_agent": { 2024-05-10T03:43:48.264 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "use_agent", 2024-05-10T03:43:48.264 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.264 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.264 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.264 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.264 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.264 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.264 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.264 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-10T03:43:48.264 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.265 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.265 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.265 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.265 INFO:teuthology.orchestra.run.smithi045.stdout: "use_repo_digest": { 2024-05-10T03:43:48.265 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "use_repo_digest", 2024-05-10T03:43:48.265 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.265 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.265 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.265 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.265 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.265 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.265 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.265 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-10T03:43:48.265 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.265 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.266 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.266 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.266 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_on_failed_host_check": { 2024-05-10T03:43:48.266 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_on_failed_host_check", 2024-05-10T03:43:48.266 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.266 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.266 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.266 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.266 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.266 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.266 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.266 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "raise a health warning if the host check fails", 2024-05-10T03:43:48.266 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.266 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.267 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.267 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.267 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_on_stray_daemons": { 2024-05-10T03:43:48.267 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_on_stray_daemons", 2024-05-10T03:43:48.267 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.267 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.267 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.267 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.267 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.267 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.267 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.267 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-10T03:43:48.267 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.267 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.267 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.268 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.268 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_on_stray_hosts": { 2024-05-10T03:43:48.268 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_on_stray_hosts", 2024-05-10T03:43:48.268 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.268 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.268 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.268 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.268 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.268 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.268 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.268 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-10T03:43:48.268 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.268 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.268 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.268 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.269 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.269 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.269 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.269 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crash", 2024-05-10T03:43:48.269 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.269 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.269 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.269 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.269 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.269 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.269 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.269 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.269 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.269 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.269 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.270 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.270 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.270 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.270 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.270 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.270 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.270 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.270 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.270 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.270 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.270 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.270 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.270 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.270 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.271 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.271 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.271 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.271 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.271 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.271 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.271 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.271 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.271 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.271 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.271 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.271 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.271 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.271 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.271 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.272 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.272 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.272 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.272 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.272 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.272 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.272 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.272 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.272 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.272 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.272 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.272 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.272 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.272 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.272 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.272 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.273 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.273 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.273 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.273 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.273 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.273 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.273 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.273 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.273 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.273 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.273 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.273 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.273 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.273 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.274 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.274 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.274 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.274 INFO:teuthology.orchestra.run.smithi045.stdout: "retain_interval": { 2024-05-10T03:43:48.274 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "retain_interval", 2024-05-10T03:43:48.274 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:48.274 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.274 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.274 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "31536000", 2024-05-10T03:43:48.274 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.274 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.274 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.274 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-10T03:43:48.274 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.275 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.275 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.275 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.275 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_recent_interval": { 2024-05-10T03:43:48.275 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_recent_interval", 2024-05-10T03:43:48.275 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:48.275 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.275 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.275 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "1209600", 2024-05-10T03:43:48.275 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.275 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.275 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.275 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-10T03:43:48.275 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.275 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.276 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.276 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.276 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.276 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.276 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.276 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "dashboard", 2024-05-10T03:43:48.276 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.276 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.276 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.276 INFO:teuthology.orchestra.run.smithi045.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-10T03:43:48.276 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-10T03:43:48.276 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.276 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.276 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.277 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-05-10T03:43:48.277 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.277 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.277 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.277 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.277 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.277 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.277 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.277 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.277 INFO:teuthology.orchestra.run.smithi045.stdout: "ALERTMANAGER_API_HOST": { 2024-05-10T03:43:48.277 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-10T03:43:48.277 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.277 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.277 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.278 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.278 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.278 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.278 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.278 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.278 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.278 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.278 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.278 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.278 INFO:teuthology.orchestra.run.smithi045.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-10T03:43:48.278 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-10T03:43:48.278 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.278 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.278 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.279 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.279 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.279 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.279 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.279 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.279 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.279 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.279 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.279 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.279 INFO:teuthology.orchestra.run.smithi045.stdout: "AUDIT_API_ENABLED": { 2024-05-10T03:43:48.279 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "AUDIT_API_ENABLED", 2024-05-10T03:43:48.279 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.279 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.279 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.279 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.280 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.280 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.280 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.280 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.280 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.280 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.280 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.280 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.280 INFO:teuthology.orchestra.run.smithi045.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-10T03:43:48.280 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-10T03:43:48.280 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.280 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.280 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.280 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.280 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.281 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.281 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.281 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.281 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.281 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.281 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.281 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.281 INFO:teuthology.orchestra.run.smithi045.stdout: "ENABLE_BROWSABLE_API": { 2024-05-10T03:43:48.281 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-10T03:43:48.281 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.281 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.281 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.281 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.281 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.282 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.282 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.282 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.282 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.282 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.282 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.282 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.282 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-10T03:43:48.282 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-10T03:43:48.282 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.282 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.282 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.282 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.282 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.282 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.283 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.283 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.283 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.283 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.283 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.283 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.283 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-10T03:43:48.283 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-10T03:43:48.283 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.283 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.283 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.283 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.283 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.283 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.283 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.284 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.284 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.284 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.284 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.284 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.284 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-10T03:43:48.284 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-10T03:43:48.284 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.284 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.284 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.284 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.284 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.284 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.284 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.284 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.285 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.285 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.285 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.285 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.285 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-10T03:43:48.285 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-10T03:43:48.285 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.285 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.285 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.285 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.285 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.285 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.285 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.285 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.285 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.286 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.286 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.286 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.286 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-10T03:43:48.286 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-10T03:43:48.286 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.286 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.286 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.286 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.286 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.286 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.286 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.286 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.286 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.286 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.287 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.287 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.287 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-10T03:43:48.287 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-10T03:43:48.287 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.287 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.287 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.287 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.287 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.287 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.287 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.287 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.287 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.287 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.287 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.288 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.288 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-10T03:43:48.288 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-10T03:43:48.288 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.288 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.288 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.288 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.288 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.288 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.288 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.288 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.288 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.288 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.288 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.288 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.289 INFO:teuthology.orchestra.run.smithi045.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-10T03:43:48.289 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-10T03:43:48.289 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.289 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.289 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.289 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.289 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.289 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.289 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.289 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.289 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.289 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.289 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.289 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.289 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_API_PASSWORD": { 2024-05-10T03:43:48.290 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-10T03:43:48.290 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.290 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.290 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.290 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "admin", 2024-05-10T03:43:48.290 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.290 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.290 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.290 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.290 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.290 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.290 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.290 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.290 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-10T03:43:48.291 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-10T03:43:48.291 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.291 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.291 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.291 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.291 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.291 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.291 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.291 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.291 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.291 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.291 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.291 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.291 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_API_URL": { 2024-05-10T03:43:48.291 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_API_URL", 2024-05-10T03:43:48.292 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.292 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.292 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.292 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.292 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.292 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.292 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.292 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.292 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.292 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.292 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.292 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.292 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_API_USERNAME": { 2024-05-10T03:43:48.292 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-10T03:43:48.292 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.293 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.293 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.293 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "admin", 2024-05-10T03:43:48.293 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.293 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.293 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.293 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.293 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.293 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.293 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.293 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.293 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-10T03:43:48.293 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-10T03:43:48.293 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.293 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.294 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.294 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.294 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.294 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.294 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.294 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.294 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.294 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.294 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.294 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.294 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-10T03:43:48.294 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-10T03:43:48.294 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.294 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.295 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.295 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.295 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.295 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.295 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.295 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.295 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.295 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.295 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.295 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.295 INFO:teuthology.orchestra.run.smithi045.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-10T03:43:48.295 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-10T03:43:48.295 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.295 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.296 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.296 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.296 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.296 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.296 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.296 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.296 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.296 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.296 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.296 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.296 INFO:teuthology.orchestra.run.smithi045.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-10T03:43:48.296 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-10T03:43:48.296 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.296 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.296 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.297 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.297 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.297 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.297 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.297 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.297 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.297 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.297 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.297 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.297 INFO:teuthology.orchestra.run.smithi045.stdout: "PROMETHEUS_API_HOST": { 2024-05-10T03:43:48.297 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-10T03:43:48.297 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.297 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.297 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.297 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.298 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.298 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.298 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.298 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.298 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.298 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.298 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.298 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.298 INFO:teuthology.orchestra.run.smithi045.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-10T03:43:48.298 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-10T03:43:48.298 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.298 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.298 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.298 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.299 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.299 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.299 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.299 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.299 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.299 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.299 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.299 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.299 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-10T03:43:48.299 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-10T03:43:48.299 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.299 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.299 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.299 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.299 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.300 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.300 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.300 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.300 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.300 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.300 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.300 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.300 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-10T03:43:48.300 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-10T03:43:48.300 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.300 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.300 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.300 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.300 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.300 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.301 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.301 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.301 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.301 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.301 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.301 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.301 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-10T03:43:48.301 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-10T03:43:48.301 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.301 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.301 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.301 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.301 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.301 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.301 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.302 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.302 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.302 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.302 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.302 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.302 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-10T03:43:48.302 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-10T03:43:48.302 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.302 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.302 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.302 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.302 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.302 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.302 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.303 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.303 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.303 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.303 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.303 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.303 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-10T03:43:48.303 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-10T03:43:48.303 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.303 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.303 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.303 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.303 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.303 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.303 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.303 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.303 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.304 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.304 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.304 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.304 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-10T03:43:48.304 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-10T03:43:48.304 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.304 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.304 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.304 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.304 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.304 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.304 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.304 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.304 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.305 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.305 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.305 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.305 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-10T03:43:48.305 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-10T03:43:48.305 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.305 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.305 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.305 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.305 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.305 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.305 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.305 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.305 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.306 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.306 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.306 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.306 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_ENABLED": { 2024-05-10T03:43:48.306 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-10T03:43:48.306 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.306 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.306 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.306 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.306 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.306 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.306 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.306 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.306 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.307 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.307 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.307 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.307 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-10T03:43:48.307 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-10T03:43:48.307 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.307 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.307 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.307 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-10T03:43:48.307 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.307 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.307 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.308 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.308 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.308 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.308 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.308 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.308 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-10T03:43:48.308 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-10T03:43:48.308 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.308 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.309 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.309 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-05-10T03:43:48.309 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.309 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.309 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.309 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.309 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.309 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.310 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.310 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.310 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-10T03:43:48.310 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-10T03:43:48.310 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.310 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.310 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.311 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8", 2024-05-10T03:43:48.311 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.311 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.311 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.311 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.311 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.311 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.311 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.311 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.311 INFO:teuthology.orchestra.run.smithi045.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-10T03:43:48.311 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-10T03:43:48.312 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.312 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.312 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.312 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "45", 2024-05-10T03:43:48.312 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.312 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.312 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.312 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.312 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.312 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.312 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.312 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.312 INFO:teuthology.orchestra.run.smithi045.stdout: "RGW_API_ACCESS_KEY": { 2024-05-10T03:43:48.312 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-10T03:43:48.312 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.313 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.313 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.313 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.313 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.313 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.313 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.313 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.313 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.313 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.313 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.313 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.313 INFO:teuthology.orchestra.run.smithi045.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-10T03:43:48.313 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-10T03:43:48.313 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.314 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.314 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.314 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "admin", 2024-05-10T03:43:48.314 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.314 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.314 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.314 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.314 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.314 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.314 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.314 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.314 INFO:teuthology.orchestra.run.smithi045.stdout: "RGW_API_SECRET_KEY": { 2024-05-10T03:43:48.314 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-10T03:43:48.314 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.314 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.315 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.315 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.315 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.315 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.315 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.315 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.315 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.315 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.315 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.315 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.315 INFO:teuthology.orchestra.run.smithi045.stdout: "RGW_API_SSL_VERIFY": { 2024-05-10T03:43:48.315 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-10T03:43:48.315 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.315 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.315 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.316 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.316 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.316 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.316 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.316 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.316 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.316 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.316 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.316 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.316 INFO:teuthology.orchestra.run.smithi045.stdout: "UNSAFE_TLS_v1_2": { 2024-05-10T03:43:48.316 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-10T03:43:48.316 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.316 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.316 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.317 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.317 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.317 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.317 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.317 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.317 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.317 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.317 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.317 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.317 INFO:teuthology.orchestra.run.smithi045.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-10T03:43:48.317 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-10T03:43:48.317 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.317 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.317 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.317 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-05-10T03:43:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-10T03:43:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-10T03:43:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-05-10T03:43:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-10T03:43:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-10T03:43:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-05-10T03:43:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: "cross_origin_url": { 2024-05-10T03:43:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cross_origin_url", 2024-05-10T03:43:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: "crt_file": { 2024-05-10T03:43:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crt_file", 2024-05-10T03:43:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: "debug": { 2024-05-10T03:43:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "debug", 2024-05-10T03:43:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Enable/disable debug options", 2024-05-10T03:43:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: "jwt_token_ttl": { 2024-05-10T03:43:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "jwt_token_ttl", 2024-05-10T03:43:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "28800", 2024-05-10T03:43:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: "key_file": { 2024-05-10T03:43:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "key_file", 2024-05-10T03:43:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: "motd": { 2024-05-10T03:43:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "motd", 2024-05-10T03:43:48.330 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.330 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.330 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.330 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.330 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.330 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.330 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.330 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "The message of the day", 2024-05-10T03:43:48.330 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.330 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.330 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.330 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.330 INFO:teuthology.orchestra.run.smithi045.stdout: "redirect_resolve_ip_addr": { 2024-05-10T03:43:48.330 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "redirect_resolve_ip_addr", 2024-05-10T03:43:48.331 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.331 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.331 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.331 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.331 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.331 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.331 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.331 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.331 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.331 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.331 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.331 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.331 INFO:teuthology.orchestra.run.smithi045.stdout: "server_addr": { 2024-05-10T03:43:48.331 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_addr", 2024-05-10T03:43:48.331 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.332 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.332 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.332 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "::", 2024-05-10T03:43:48.332 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.332 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.332 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.332 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.332 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.332 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.332 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.332 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.332 INFO:teuthology.orchestra.run.smithi045.stdout: "server_port": { 2024-05-10T03:43:48.332 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_port", 2024-05-10T03:43:48.332 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.332 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.333 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.333 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8080", 2024-05-10T03:43:48.333 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.333 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.333 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.333 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.333 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.333 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.333 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.333 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.333 INFO:teuthology.orchestra.run.smithi045.stdout: "ssl": { 2024-05-10T03:43:48.333 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ssl", 2024-05-10T03:43:48.333 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.333 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.333 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.333 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.334 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.334 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.334 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.334 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.334 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.334 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.334 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.334 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.334 INFO:teuthology.orchestra.run.smithi045.stdout: "ssl_server_port": { 2024-05-10T03:43:48.334 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ssl_server_port", 2024-05-10T03:43:48.334 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.334 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.334 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.334 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8443", 2024-05-10T03:43:48.335 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.335 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.335 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.335 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.335 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.335 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.335 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.335 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.335 INFO:teuthology.orchestra.run.smithi045.stdout: "standby_behaviour": { 2024-05-10T03:43:48.335 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "standby_behaviour", 2024-05-10T03:43:48.335 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.335 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.335 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.335 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "redirect", 2024-05-10T03:43:48.335 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.336 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.336 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.336 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.336 INFO:teuthology.orchestra.run.smithi045.stdout: "redirect" 2024-05-10T03:43:48.336 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.336 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.336 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.336 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.336 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.336 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.336 INFO:teuthology.orchestra.run.smithi045.stdout: "standby_error_status_code": { 2024-05-10T03:43:48.336 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "standby_error_status_code", 2024-05-10T03:43:48.336 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.336 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.336 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.337 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "500", 2024-05-10T03:43:48.337 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "400", 2024-05-10T03:43:48.337 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "599", 2024-05-10T03:43:48.337 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.337 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.337 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.337 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.337 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.337 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.337 INFO:teuthology.orchestra.run.smithi045.stdout: "url_prefix": { 2024-05-10T03:43:48.337 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "url_prefix", 2024-05-10T03:43:48.337 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.337 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.338 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.338 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.338 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.338 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.338 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.338 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.338 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.338 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.338 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.338 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.338 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.338 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.338 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.338 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "devicehealth", 2024-05-10T03:43:48.339 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.339 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.339 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.339 INFO:teuthology.orchestra.run.smithi045.stdout: "enable_monitoring": { 2024-05-10T03:43:48.339 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "enable_monitoring", 2024-05-10T03:43:48.339 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.339 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.339 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.339 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.339 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.339 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.339 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.339 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "monitor device health metrics", 2024-05-10T03:43:48.339 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.340 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.340 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.340 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.340 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.340 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.340 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.340 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.340 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.340 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.340 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.340 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.340 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.340 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.340 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.341 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.341 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.341 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.341 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.341 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.341 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.341 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.341 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.341 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.341 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.341 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.341 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.341 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.341 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.341 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.342 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.342 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.342 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.342 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.342 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.342 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.342 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.342 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.342 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.342 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.342 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.342 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.342 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.342 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.342 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.343 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.343 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.343 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.343 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.343 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.343 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.343 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.343 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.343 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.343 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.343 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.343 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.343 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.343 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.344 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.344 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.344 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.344 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.344 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.344 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.344 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.344 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.344 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.344 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.344 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.344 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.344 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.344 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.344 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.345 INFO:teuthology.orchestra.run.smithi045.stdout: "mark_out_threshold": { 2024-05-10T03:43:48.345 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mark_out_threshold", 2024-05-10T03:43:48.345 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:48.345 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.345 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.345 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "2419200", 2024-05-10T03:43:48.345 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.345 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.345 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.345 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-10T03:43:48.345 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.345 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.345 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.345 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.345 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": { 2024-05-10T03:43:48.346 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "pool_name", 2024-05-10T03:43:48.346 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.346 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.346 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.346 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "device_health_metrics", 2024-05-10T03:43:48.346 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.346 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.346 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.346 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-10T03:43:48.346 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.346 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.346 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.346 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.346 INFO:teuthology.orchestra.run.smithi045.stdout: "retention_period": { 2024-05-10T03:43:48.346 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "retention_period", 2024-05-10T03:43:48.347 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:48.347 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.347 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.347 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "15552000", 2024-05-10T03:43:48.347 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.347 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.347 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.347 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how long to retain device health metrics", 2024-05-10T03:43:48.347 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.347 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.347 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.347 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.347 INFO:teuthology.orchestra.run.smithi045.stdout: "scrape_frequency": { 2024-05-10T03:43:48.347 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "scrape_frequency", 2024-05-10T03:43:48.347 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:48.348 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.348 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.348 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "86400", 2024-05-10T03:43:48.348 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.348 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.348 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.348 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-10T03:43:48.348 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.348 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.348 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.348 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.348 INFO:teuthology.orchestra.run.smithi045.stdout: "self_heal": { 2024-05-10T03:43:48.348 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "self_heal", 2024-05-10T03:43:48.348 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.348 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.349 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.349 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.349 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.349 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.349 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.349 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-10T03:43:48.349 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.349 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.349 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.349 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.349 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-05-10T03:43:48.349 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-05-10T03:43:48.349 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:48.349 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.349 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.350 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-05-10T03:43:48.350 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.350 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.350 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.350 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to wake up and check device health", 2024-05-10T03:43:48.350 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.350 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.350 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.350 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.350 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_threshold": { 2024-05-10T03:43:48.350 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_threshold", 2024-05-10T03:43:48.350 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:48.350 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.350 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.351 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "7257600", 2024-05-10T03:43:48.351 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.351 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.351 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.351 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-10T03:43:48.351 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.351 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.351 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.351 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.351 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.351 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.351 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.351 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "diskprediction_local", 2024-05-10T03:43:48.351 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.351 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.352 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.353 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.353 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.353 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.353 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.353 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.353 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.353 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.353 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.353 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.353 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.353 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.353 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.353 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.353 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.354 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.354 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.354 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.354 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.354 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.354 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.354 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.354 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.354 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.354 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.354 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.354 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.354 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.355 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.355 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.355 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.355 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.355 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.355 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.355 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.355 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.355 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.355 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.355 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.355 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.355 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.355 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.355 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.356 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.356 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.356 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.356 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.356 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.356 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.356 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.356 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.356 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.356 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.356 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.356 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.356 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.356 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.356 INFO:teuthology.orchestra.run.smithi045.stdout: "predict_interval": { 2024-05-10T03:43:48.357 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "predict_interval", 2024-05-10T03:43:48.357 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.357 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.357 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.357 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "86400", 2024-05-10T03:43:48.357 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.357 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.357 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.357 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.357 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.357 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.357 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.357 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.357 INFO:teuthology.orchestra.run.smithi045.stdout: "predictor_model": { 2024-05-10T03:43:48.358 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "predictor_model", 2024-05-10T03:43:48.358 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.358 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.358 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.358 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "prophetstor", 2024-05-10T03:43:48.358 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.358 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.358 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.358 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.358 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.358 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.358 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.358 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.359 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-05-10T03:43:48.359 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-05-10T03:43:48.359 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.359 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.359 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.359 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-05-10T03:43:48.359 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.359 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.359 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.359 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.359 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.359 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.359 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.359 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.359 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.360 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.360 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.360 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "influx", 2024-05-10T03:43:48.360 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": false, 2024-05-10T03:43:48.360 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "influxdb python module not found", 2024-05-10T03:43:48.360 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.360 INFO:teuthology.orchestra.run.smithi045.stdout: "batch_size": { 2024-05-10T03:43:48.360 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "batch_size", 2024-05-10T03:43:48.360 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.360 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.360 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.360 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5000", 2024-05-10T03:43:48.360 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.360 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-10T03:43:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: "database": { 2024-05-10T03:43:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "database", 2024-05-10T03:43:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "ceph", 2024-05-10T03:43:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.361 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.362 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-10T03:43:48.362 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.362 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.362 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.362 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.362 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": { 2024-05-10T03:43:48.362 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "hostname", 2024-05-10T03:43:48.362 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.362 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.362 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.362 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.362 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.362 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.362 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.363 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "InfluxDB server hostname", 2024-05-10T03:43:48.363 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.363 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.363 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.363 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.363 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-05-10T03:43:48.363 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-05-10T03:43:48.363 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:48.363 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.363 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.363 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "30", 2024-05-10T03:43:48.363 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "5", 2024-05-10T03:43:48.363 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.363 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.363 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-10T03:43:48.363 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.364 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.364 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.364 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.364 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.364 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.364 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.364 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.364 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.364 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.364 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.364 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.364 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.364 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.364 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.364 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.364 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.364 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.365 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.365 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.365 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.365 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.365 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.365 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.365 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.365 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.365 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.365 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.365 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.365 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.365 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.365 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.365 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.365 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.365 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.366 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.366 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.366 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.366 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.366 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.366 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.366 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.366 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.366 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.366 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.366 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.366 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.366 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.367 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.367 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.367 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.367 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.367 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.367 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.367 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.367 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.367 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.367 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.367 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.367 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.367 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.367 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.367 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.367 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.368 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.368 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.368 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.368 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.368 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.368 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.368 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.368 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.368 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.368 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.368 INFO:teuthology.orchestra.run.smithi045.stdout: "password": { 2024-05-10T03:43:48.368 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "password", 2024-05-10T03:43:48.369 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.369 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.369 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.369 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.369 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.369 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.369 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.369 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "password of InfluxDB server user", 2024-05-10T03:43:48.369 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.369 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.369 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.369 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.369 INFO:teuthology.orchestra.run.smithi045.stdout: "port": { 2024-05-10T03:43:48.370 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "port", 2024-05-10T03:43:48.370 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.370 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.370 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.370 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8086", 2024-05-10T03:43:48.370 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.370 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.370 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.370 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "InfluxDB server port", 2024-05-10T03:43:48.370 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.370 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.370 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.370 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.370 INFO:teuthology.orchestra.run.smithi045.stdout: "ssl": { 2024-05-10T03:43:48.370 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ssl", 2024-05-10T03:43:48.371 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.371 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.371 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.371 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "false", 2024-05-10T03:43:48.371 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.371 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.371 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.371 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-10T03:43:48.371 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.371 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.371 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.371 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.371 INFO:teuthology.orchestra.run.smithi045.stdout: "threads": { 2024-05-10T03:43:48.371 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "threads", 2024-05-10T03:43:48.371 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.372 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.372 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.372 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-05-10T03:43:48.372 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1", 2024-05-10T03:43:48.372 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "32", 2024-05-10T03:43:48.372 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.372 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-10T03:43:48.372 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.372 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.372 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.372 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.372 INFO:teuthology.orchestra.run.smithi045.stdout: "username": { 2024-05-10T03:43:48.372 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "username", 2024-05-10T03:43:48.372 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.372 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.372 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.373 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.373 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.373 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.373 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.373 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "username of InfluxDB server user", 2024-05-10T03:43:48.373 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.373 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.373 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.373 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.373 INFO:teuthology.orchestra.run.smithi045.stdout: "verify_ssl": { 2024-05-10T03:43:48.373 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "verify_ssl", 2024-05-10T03:43:48.373 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.373 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.373 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.373 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "true", 2024-05-10T03:43:48.374 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.374 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.374 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.374 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-10T03:43:48.374 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.374 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.374 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.374 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.374 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.374 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.374 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.374 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "insights", 2024-05-10T03:43:48.374 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.374 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.375 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.375 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.375 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.375 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.375 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.375 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.375 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.375 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.375 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.375 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.375 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.375 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.375 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.375 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.375 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.376 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.376 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.376 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.376 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.376 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.376 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.376 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.376 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.376 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.376 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.376 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.376 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.376 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.376 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.376 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.377 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.377 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.377 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.377 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.377 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.377 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.377 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.377 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.377 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.377 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.377 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.377 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.377 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.377 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.377 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.378 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.378 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.378 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.378 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.378 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.378 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.378 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.378 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.378 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.378 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.378 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.378 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.378 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.378 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.379 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.379 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.379 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.379 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.379 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.379 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.379 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.379 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.379 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.379 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.379 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.379 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.379 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.379 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.380 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.380 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "iostat", 2024-05-10T03:43:48.380 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.380 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.380 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.380 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.380 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.380 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.380 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.380 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.380 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.380 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.380 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.380 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.381 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.381 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.381 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.381 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.381 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.381 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.381 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.381 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.381 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.381 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.381 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.381 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.381 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.381 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.381 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.381 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.382 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.383 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.384 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.384 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.384 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.384 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.384 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.384 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.384 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.384 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.384 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.384 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.384 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.384 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.384 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.384 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.384 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "k8sevents", 2024-05-10T03:43:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_event_retention_days": { 2024-05-10T03:43:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ceph_event_retention_days", 2024-05-10T03:43:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.385 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "7", 2024-05-10T03:43:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-10T03:43:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: "config_check_secs": { 2024-05-10T03:43:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "config_check_secs", 2024-05-10T03:43:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.386 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-05-10T03:43:48.387 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "10", 2024-05-10T03:43:48.387 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.387 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.387 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-10T03:43:48.387 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.387 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.387 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.387 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.387 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.387 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.387 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.387 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.387 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.387 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.388 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.389 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.390 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.390 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.390 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.390 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.390 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.390 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.390 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.390 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.390 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.390 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.390 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.390 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.390 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.390 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.391 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.391 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.391 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.391 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.391 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.391 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.391 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.391 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.391 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.391 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.391 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.391 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.391 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.391 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.391 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.392 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.392 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.392 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.392 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.392 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.392 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.392 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.392 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "localpool", 2024-05-10T03:43:48.392 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.392 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.392 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.392 INFO:teuthology.orchestra.run.smithi045.stdout: "failure_domain": { 2024-05-10T03:43:48.392 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "failure_domain", 2024-05-10T03:43:48.392 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.392 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.393 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.393 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "host", 2024-05-10T03:43:48.393 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.393 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.393 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.393 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "failure domain for any created local pool", 2024-05-10T03:43:48.393 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-10T03:43:48.393 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.393 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.393 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.393 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.393 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.393 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.393 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.393 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.394 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.394 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.394 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.394 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.394 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.394 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.394 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.394 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.394 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.394 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.394 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.394 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.394 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.394 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.394 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.395 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.396 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.396 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.396 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.396 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.396 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.396 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.396 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.396 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.396 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.396 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.396 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.396 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.396 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.396 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.396 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.397 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.398 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.398 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.398 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.398 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.398 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.398 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.398 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": { 2024-05-10T03:43:48.398 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "min_size", 2024-05-10T03:43:48.398 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.398 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.398 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.398 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.398 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.398 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.399 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.399 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "default min_size for any created local pool", 2024-05-10T03:43:48.399 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-10T03:43:48.399 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.399 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.399 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.399 INFO:teuthology.orchestra.run.smithi045.stdout: "num_rep": { 2024-05-10T03:43:48.399 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "num_rep", 2024-05-10T03:43:48.399 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.399 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.399 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.399 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "3", 2024-05-10T03:43:48.399 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.399 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.399 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.400 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "default replica count for any created local pool", 2024-05-10T03:43:48.400 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.400 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.400 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.400 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.400 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": { 2024-05-10T03:43:48.400 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "pg_num", 2024-05-10T03:43:48.400 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.400 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.400 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.400 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "128", 2024-05-10T03:43:48.400 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.400 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.400 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.401 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "default pg_num for any created local pool", 2024-05-10T03:43:48.401 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.401 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.401 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.401 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.401 INFO:teuthology.orchestra.run.smithi045.stdout: "prefix": { 2024-05-10T03:43:48.401 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "prefix", 2024-05-10T03:43:48.401 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.401 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.401 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.401 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.401 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.401 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.401 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.401 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "name prefix for any created local pool", 2024-05-10T03:43:48.402 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.402 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.402 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.402 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.402 INFO:teuthology.orchestra.run.smithi045.stdout: "subtree": { 2024-05-10T03:43:48.402 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "subtree", 2024-05-10T03:43:48.402 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.402 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.402 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.402 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "rack", 2024-05-10T03:43:48.402 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.402 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.402 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.402 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-10T03:43:48.403 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-10T03:43:48.403 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.403 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.403 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.403 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.403 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.403 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.403 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mds_autoscaler", 2024-05-10T03:43:48.403 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.403 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.403 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.403 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.403 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.403 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.403 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.404 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.404 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.404 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.404 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.404 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.404 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.404 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.404 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.404 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.404 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.404 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.404 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.404 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.404 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.404 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.405 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.405 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.405 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.405 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.405 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.405 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.405 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.405 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.405 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.405 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.405 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.405 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.405 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.405 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.406 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.406 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.406 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.406 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.406 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.406 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.406 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.406 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.406 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.406 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.406 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.406 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.406 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.406 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.406 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.407 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.407 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.407 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.407 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.407 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.407 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.407 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.407 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.407 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.407 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.407 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.407 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.407 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.407 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.407 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.408 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.408 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.408 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.408 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.408 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.408 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.408 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.408 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.408 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.408 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.408 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mirroring", 2024-05-10T03:43:48.408 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.408 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.408 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.408 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.409 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.410 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.411 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.412 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.413 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "nfs", 2024-05-10T03:43:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.414 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.415 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.417 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.418 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "orchestrator", 2024-05-10T03:43:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "fail_fs": { 2024-05-10T03:43:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "fail_fs", 2024-05-10T03:43:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.419 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.420 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.420 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.420 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-10T03:43:48.420 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.421 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.421 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.421 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.421 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.421 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.422 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.422 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.422 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.422 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.422 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.422 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.422 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.422 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.422 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.422 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.422 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.422 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.422 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.422 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.423 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.423 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.423 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.423 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.423 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.423 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.423 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.423 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.423 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.423 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.423 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.423 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.423 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.423 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.423 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.423 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.424 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.424 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.424 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.424 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.424 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.424 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.424 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.424 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.424 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.424 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.424 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.424 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.424 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.424 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.424 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.425 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.425 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.425 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.425 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.425 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.425 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.425 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.425 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.425 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.425 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.425 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.425 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.425 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.425 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.425 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.426 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.426 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.426 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.426 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.426 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.426 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.426 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.426 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.426 INFO:teuthology.orchestra.run.smithi045.stdout: "orchestrator": { 2024-05-10T03:43:48.426 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "orchestrator", 2024-05-10T03:43:48.426 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.426 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.426 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.427 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.427 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.427 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.427 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.427 INFO:teuthology.orchestra.run.smithi045.stdout: "cephadm", 2024-05-10T03:43:48.427 INFO:teuthology.orchestra.run.smithi045.stdout: "rook", 2024-05-10T03:43:48.427 INFO:teuthology.orchestra.run.smithi045.stdout: "test_orchestrator" 2024-05-10T03:43:48.427 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.427 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Orchestrator backend", 2024-05-10T03:43:48.427 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.427 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.427 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.427 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.427 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.428 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.428 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.428 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "osd_perf_query", 2024-05-10T03:43:48.428 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.428 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.428 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.428 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.428 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.428 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.428 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.428 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.428 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.428 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.428 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.428 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.429 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.429 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.429 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.429 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.429 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.429 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.429 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.429 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.429 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.429 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.429 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.429 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.429 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.429 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.430 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.430 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.430 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.430 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.430 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.430 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.430 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.430 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.430 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.430 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.430 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.430 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.430 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.430 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.430 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.431 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.431 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.431 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.431 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.431 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.431 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.431 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.431 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.431 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.431 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.431 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.431 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.431 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.431 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.431 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.432 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.432 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.432 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.432 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.432 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.432 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.432 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.432 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.432 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.432 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.432 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.432 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.432 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.432 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.432 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.433 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.433 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.433 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.433 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.433 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.433 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "osd_support", 2024-05-10T03:43:48.433 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.433 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.433 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.433 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.433 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.433 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.433 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.433 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.433 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.434 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.434 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.434 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.434 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.434 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.434 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.434 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.434 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.434 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.434 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.434 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.434 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.434 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.434 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.434 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.435 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.435 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.435 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.435 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.435 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.435 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.435 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.435 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.435 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.435 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.435 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.435 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.435 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.436 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.436 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.436 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.436 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.436 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.436 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.436 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.436 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.436 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.436 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.436 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.436 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.436 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.436 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.437 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.437 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.437 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.437 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.437 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.437 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.437 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.437 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.437 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.437 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.437 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.437 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.437 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.437 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.437 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.438 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.438 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.438 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.438 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.438 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.438 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.438 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.438 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.438 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.438 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.438 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "pg_autoscaler", 2024-05-10T03:43:48.438 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.438 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.438 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.439 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.439 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.439 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.439 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.439 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.439 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.439 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.439 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.439 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.439 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.439 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.439 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.439 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.439 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.440 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.440 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.440 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.440 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.440 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.440 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.440 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.440 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.440 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.440 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.440 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.440 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.440 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.440 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.441 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.441 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.441 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.441 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.441 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.441 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.441 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.441 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.441 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.441 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.441 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.441 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.441 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.441 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.441 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.442 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.442 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.442 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.442 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.442 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.442 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.442 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.442 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.442 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.442 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.442 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.442 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.442 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.442 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.443 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.443 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.443 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.443 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.443 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.443 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.443 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.443 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.443 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.443 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.443 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.443 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.443 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.443 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-05-10T03:43:48.443 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-05-10T03:43:48.444 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:48.444 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.444 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.444 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-05-10T03:43:48.444 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.444 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.444 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.444 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.444 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.444 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.444 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.444 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.444 INFO:teuthology.orchestra.run.smithi045.stdout: "threshold": { 2024-05-10T03:43:48.444 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "threshold", 2024-05-10T03:43:48.444 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-05-10T03:43:48.445 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.445 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.445 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "3.0", 2024-05-10T03:43:48.445 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1.0", 2024-05-10T03:43:48.445 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.445 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.445 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "scaling threshold", 2024-05-10T03:43:48.445 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-10T03:43:48.445 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.445 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.445 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.445 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.445 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.445 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.445 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "progress", 2024-05-10T03:43:48.446 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.446 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.446 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.446 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_pg_recovery_event": { 2024-05-10T03:43:48.446 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "allow_pg_recovery_event", 2024-05-10T03:43:48.446 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.446 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.446 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.446 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.446 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.446 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.446 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.446 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-10T03:43:48.446 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.447 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.447 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.447 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.447 INFO:teuthology.orchestra.run.smithi045.stdout: "enabled": { 2024-05-10T03:43:48.447 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "enabled", 2024-05-10T03:43:48.447 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.447 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.447 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.447 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.447 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.447 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.447 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.447 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.447 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.447 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.447 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.448 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.448 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.448 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.448 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.448 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.448 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.448 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.448 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.448 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.448 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.448 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.448 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.448 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.448 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.448 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.449 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.449 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.449 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.449 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.449 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.449 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.449 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.449 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.449 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.449 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.449 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.449 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.449 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.449 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.450 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.450 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.450 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.450 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.450 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.450 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.450 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.450 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.450 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.450 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.450 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.450 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.450 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.450 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.450 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.451 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.451 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.451 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.451 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.451 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.451 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.451 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.451 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.451 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.451 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.451 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.451 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.451 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.451 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.452 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.452 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.452 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.452 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.452 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.452 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.452 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.452 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.452 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.452 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.452 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.452 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.452 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.453 INFO:teuthology.orchestra.run.smithi045.stdout: "max_completed_events": { 2024-05-10T03:43:48.453 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_completed_events", 2024-05-10T03:43:48.453 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.453 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.453 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.453 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "50", 2024-05-10T03:43:48.453 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.453 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.453 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.453 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "number of past completed events to remember", 2024-05-10T03:43:48.453 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.453 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.453 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.453 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.453 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-05-10T03:43:48.454 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-05-10T03:43:48.454 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:48.454 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.454 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.454 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-05-10T03:43:48.454 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.454 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.454 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.454 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how long the module is going to sleep", 2024-05-10T03:43:48.454 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.454 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.454 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.454 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.454 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.454 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.455 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.455 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "prometheus", 2024-05-10T03:43:48.455 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.455 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.455 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.455 INFO:teuthology.orchestra.run.smithi045.stdout: "cache": { 2024-05-10T03:43:48.455 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cache", 2024-05-10T03:43:48.455 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.455 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.455 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.455 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.455 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.455 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.455 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.455 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.456 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.456 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.456 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.456 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.456 INFO:teuthology.orchestra.run.smithi045.stdout: "exclude_perf_counters": { 2024-05-10T03:43:48.456 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "exclude_perf_counters", 2024-05-10T03:43:48.456 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.456 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.456 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.456 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.456 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.456 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.456 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.456 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-10T03:43:48.457 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-10T03:43:48.457 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.457 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.457 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.457 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.457 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.457 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.457 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.457 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.457 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.457 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.457 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.457 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.457 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.457 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.458 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.458 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.458 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.458 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.458 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.458 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.458 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.458 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.458 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.458 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.458 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.458 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.458 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.458 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.459 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.459 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.459 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.459 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.459 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.459 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.459 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.459 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.459 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.459 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.459 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.459 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.459 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.459 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.459 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.459 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.460 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.460 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.460 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.460 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.460 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.460 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.460 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.460 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.460 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.460 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.460 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.460 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.460 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.460 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.460 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.461 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.461 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.461 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.461 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.461 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.461 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.461 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.461 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.461 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.461 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.461 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.461 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.461 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.461 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.461 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_stats_pools": { 2024-05-10T03:43:48.462 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rbd_stats_pools", 2024-05-10T03:43:48.462 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.462 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.462 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.462 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.462 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.462 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.462 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.462 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.462 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.462 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.462 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.462 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.462 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-10T03:43:48.463 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-10T03:43:48.463 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.463 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.463 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.463 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "300", 2024-05-10T03:43:48.463 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.463 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.463 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.463 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.463 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.463 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.463 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.463 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.463 INFO:teuthology.orchestra.run.smithi045.stdout: "scrape_interval": { 2024-05-10T03:43:48.463 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "scrape_interval", 2024-05-10T03:43:48.464 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-05-10T03:43:48.464 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.464 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.464 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "15.0", 2024-05-10T03:43:48.464 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.464 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.464 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.464 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.464 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.464 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.464 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.464 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.464 INFO:teuthology.orchestra.run.smithi045.stdout: "server_addr": { 2024-05-10T03:43:48.464 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_addr", 2024-05-10T03:43:48.464 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.465 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.465 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.465 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "::", 2024-05-10T03:43:48.465 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.465 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.465 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.465 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-10T03:43:48.465 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.465 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.465 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.465 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.465 INFO:teuthology.orchestra.run.smithi045.stdout: "server_port": { 2024-05-10T03:43:48.465 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_port", 2024-05-10T03:43:48.465 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.465 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.466 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.466 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "9283", 2024-05-10T03:43:48.466 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.466 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.466 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.466 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-10T03:43:48.466 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.466 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.466 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.466 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.466 INFO:teuthology.orchestra.run.smithi045.stdout: "stale_cache_strategy": { 2024-05-10T03:43:48.466 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "stale_cache_strategy", 2024-05-10T03:43:48.466 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.466 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.466 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.467 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "log", 2024-05-10T03:43:48.467 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.467 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.467 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.467 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.467 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.467 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.467 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.467 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.467 INFO:teuthology.orchestra.run.smithi045.stdout: "standby_behaviour": { 2024-05-10T03:43:48.467 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "standby_behaviour", 2024-05-10T03:43:48.467 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.467 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.467 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.468 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "default", 2024-05-10T03:43:48.468 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.468 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.468 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.468 INFO:teuthology.orchestra.run.smithi045.stdout: "default", 2024-05-10T03:43:48.468 INFO:teuthology.orchestra.run.smithi045.stdout: "error" 2024-05-10T03:43:48.468 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.468 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.468 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.468 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.468 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.468 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.468 INFO:teuthology.orchestra.run.smithi045.stdout: "standby_error_status_code": { 2024-05-10T03:43:48.468 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "standby_error_status_code", 2024-05-10T03:43:48.468 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.469 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.469 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.469 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "500", 2024-05-10T03:43:48.469 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "400", 2024-05-10T03:43:48.469 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "599", 2024-05-10T03:43:48.469 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.469 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.469 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.469 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.469 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.469 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.469 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.469 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.469 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.469 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rbd_support", 2024-05-10T03:43:48.470 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.470 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.470 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.470 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.470 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.470 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.470 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.470 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.470 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.470 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.470 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.470 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.470 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.470 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.471 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.471 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.471 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.471 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.471 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.471 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.471 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.471 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.471 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.471 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.471 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.471 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.471 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.471 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.472 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.472 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.472 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.472 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.472 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.472 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.472 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.472 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.472 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.472 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.472 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.472 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.472 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.472 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.472 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.473 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.473 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.473 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.473 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.473 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.473 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.473 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.473 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.473 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.473 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.473 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.473 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.473 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.473 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.474 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.474 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.474 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.474 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.474 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.474 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.474 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.474 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.474 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.474 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.474 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.474 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.474 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.474 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.474 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.475 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.475 INFO:teuthology.orchestra.run.smithi045.stdout: "max_concurrent_snap_create": { 2024-05-10T03:43:48.475 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_concurrent_snap_create", 2024-05-10T03:43:48.475 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.475 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.475 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.475 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-05-10T03:43:48.475 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.475 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.475 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.475 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.475 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.475 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.475 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.475 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.476 INFO:teuthology.orchestra.run.smithi045.stdout: "mirror_snapshot_schedule": { 2024-05-10T03:43:48.476 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mirror_snapshot_schedule", 2024-05-10T03:43:48.476 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.476 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.476 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.476 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.476 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.476 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.476 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.476 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.476 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.476 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.476 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.476 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.476 INFO:teuthology.orchestra.run.smithi045.stdout: "trash_purge_schedule": { 2024-05-10T03:43:48.477 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "trash_purge_schedule", 2024-05-10T03:43:48.477 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.477 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.477 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.477 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.477 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.477 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.477 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.477 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.477 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.477 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.477 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.477 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.477 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.477 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.478 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.478 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "restful", 2024-05-10T03:43:48.478 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.478 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.478 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.478 INFO:teuthology.orchestra.run.smithi045.stdout: "enable_auth": { 2024-05-10T03:43:48.478 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "enable_auth", 2024-05-10T03:43:48.478 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.478 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.478 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.478 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.478 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.478 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.478 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.478 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.479 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.479 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.479 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.479 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.479 INFO:teuthology.orchestra.run.smithi045.stdout: "key_file": { 2024-05-10T03:43:48.479 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "key_file", 2024-05-10T03:43:48.479 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.479 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.479 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.479 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.479 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.479 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.479 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.479 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.479 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.480 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.480 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.480 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.480 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.480 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.480 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.480 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.480 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.480 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.480 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.480 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.480 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.480 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.481 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.481 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.481 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.481 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.481 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.481 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.481 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.481 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.481 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.481 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.481 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.481 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.481 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.481 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.481 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.482 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.482 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.482 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.482 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.482 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.482 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.482 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.482 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.482 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.482 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.482 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.482 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.482 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.482 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.483 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.483 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.483 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.483 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.483 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.483 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.483 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.483 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.483 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.483 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.483 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.483 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.483 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.483 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.484 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.484 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.484 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.484 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.484 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.484 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.484 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.484 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.484 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.484 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.484 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.484 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.484 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.484 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.484 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.485 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.485 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.485 INFO:teuthology.orchestra.run.smithi045.stdout: "server_addr": { 2024-05-10T03:43:48.485 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_addr", 2024-05-10T03:43:48.485 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.485 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.485 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.485 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.485 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.485 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.485 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.485 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.485 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.485 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.485 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.486 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.486 INFO:teuthology.orchestra.run.smithi045.stdout: "server_port": { 2024-05-10T03:43:48.486 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_port", 2024-05-10T03:43:48.486 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.486 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.486 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.486 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.486 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.486 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.486 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.486 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.486 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.486 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.487 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.487 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.487 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.487 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.487 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.487 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rgw", 2024-05-10T03:43:48.487 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.487 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.487 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.487 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.487 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.487 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.487 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.487 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.487 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.488 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.488 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.488 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.488 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.488 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.488 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.488 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.488 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.488 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.488 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.488 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.488 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.488 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.488 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.488 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.489 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.489 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.489 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.489 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.489 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.489 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.489 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.489 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.489 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.489 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.489 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.489 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.489 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.489 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.490 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.490 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.490 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.490 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.490 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.490 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.490 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.490 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.490 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.490 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.490 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.490 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.490 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.490 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.491 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.491 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.491 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.491 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.491 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.491 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.491 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.491 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.491 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.491 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.491 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.491 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.491 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.491 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.491 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.491 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.492 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.492 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.492 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.492 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.492 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.492 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.492 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.492 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.492 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rook", 2024-05-10T03:43:48.492 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.492 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.492 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.492 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.492 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.493 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.493 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.493 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.493 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.493 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.493 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.493 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.493 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.493 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.493 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.493 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.493 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.493 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.493 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.493 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.494 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.494 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.494 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.494 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.494 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.494 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.494 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.494 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.494 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.494 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.494 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.494 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.494 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.494 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.494 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.495 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.495 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.495 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.495 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.495 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.495 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.495 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.495 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.495 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.495 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.495 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.495 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.495 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.495 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.495 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.496 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.496 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.496 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.496 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.496 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.496 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.496 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.496 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.496 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.496 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.496 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.496 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.496 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.496 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.496 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.497 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.497 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.497 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.497 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.497 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.497 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.497 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.497 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.497 INFO:teuthology.orchestra.run.smithi045.stdout: "storage_class": { 2024-05-10T03:43:48.497 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "storage_class", 2024-05-10T03:43:48.497 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.497 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.497 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.497 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "local", 2024-05-10T03:43:48.497 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.498 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.498 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.498 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-10T03:43:48.498 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.498 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.498 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.498 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.498 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.498 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.498 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.498 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "selftest", 2024-05-10T03:43:48.498 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.498 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.498 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.498 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.499 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.499 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.499 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.499 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.499 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.499 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.499 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.499 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.499 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.499 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.499 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.499 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.499 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.499 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.500 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.500 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.500 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.500 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.500 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.500 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.500 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.500 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.500 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.500 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.500 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.500 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.500 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.500 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.501 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.501 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.501 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.501 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.501 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.501 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.501 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.501 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.501 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.501 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.501 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.501 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.501 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.501 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.501 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.502 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.502 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.502 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.502 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.502 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.502 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.502 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.502 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.502 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.502 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.502 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.502 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.502 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.502 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: "roption1": { 2024-05-10T03:43:48.503 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "roption1", 2024-05-10T03:43:48.504 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.504 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.504 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.504 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.504 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.504 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.504 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.504 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.504 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.504 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.504 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.504 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.504 INFO:teuthology.orchestra.run.smithi045.stdout: "roption2": { 2024-05-10T03:43:48.504 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "roption2", 2024-05-10T03:43:48.505 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.505 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.505 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.505 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "xyz", 2024-05-10T03:43:48.505 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.505 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.505 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.505 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.505 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.505 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.505 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.505 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.505 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption1": { 2024-05-10T03:43:48.505 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption1", 2024-05-10T03:43:48.505 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.506 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.506 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.506 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.506 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.506 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.506 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.506 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.506 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.506 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.506 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.506 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.506 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption2": { 2024-05-10T03:43:48.506 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption2", 2024-05-10T03:43:48.506 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.507 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.507 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.507 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.507 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.507 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.507 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.507 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.507 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.507 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.507 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.507 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.507 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption3": { 2024-05-10T03:43:48.507 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption3", 2024-05-10T03:43:48.507 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-05-10T03:43:48.507 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.508 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.508 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.508 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.508 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.508 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.508 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.508 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.508 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.508 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.508 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.508 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption4": { 2024-05-10T03:43:48.508 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption4", 2024-05-10T03:43:48.508 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.508 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.508 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption5": { 2024-05-10T03:43:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption5", 2024-05-10T03:43:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.509 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.510 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.510 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.510 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.510 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.510 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.510 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.510 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.510 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.510 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption6": { 2024-05-10T03:43:48.510 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption6", 2024-05-10T03:43:48.510 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.510 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.510 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.510 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.510 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption7": { 2024-05-10T03:43:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption7", 2024-05-10T03:43:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1", 2024-05-10T03:43:48.511 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "42", 2024-05-10T03:43:48.512 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.512 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.512 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.512 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.512 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.512 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.512 INFO:teuthology.orchestra.run.smithi045.stdout: "testkey": { 2024-05-10T03:43:48.512 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "testkey", 2024-05-10T03:43:48.512 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.512 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.512 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.512 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.512 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.512 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: "testlkey": { 2024-05-10T03:43:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "testlkey", 2024-05-10T03:43:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.513 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: "testnewline": { 2024-05-10T03:43:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "testnewline", 2024-05-10T03:43:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.514 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "snap_schedule", 2024-05-10T03:43:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_m_granularity": { 2024-05-10T03:43:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "allow_m_granularity", 2024-05-10T03:43:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.515 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "allow minute scheduled snapshots", 2024-05-10T03:43:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: "dump_on_update": { 2024-05-10T03:43:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "dump_on_update", 2024-05-10T03:43:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "dump database to debug log on update", 2024-05-10T03:43:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "stats", 2024-05-10T03:43:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "status", 2024-05-10T03:43:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.528 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.528 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.528 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.528 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.528 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.528 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.528 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.528 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.528 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.528 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.528 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.528 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.528 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.528 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.528 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.529 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.529 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.529 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.529 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.529 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.529 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.529 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.529 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.529 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.529 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.529 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.529 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.529 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.529 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.529 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.530 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.530 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.530 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.530 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.530 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.530 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.530 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.530 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.530 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.530 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.530 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.530 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.530 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.530 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.530 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.531 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.531 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.531 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.531 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.531 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.531 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.531 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.531 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.531 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.531 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.531 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.531 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.531 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.531 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.531 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.532 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.532 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.532 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.532 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.532 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.532 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.532 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.532 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.532 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.532 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.532 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.532 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.532 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.532 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "telegraf", 2024-05-10T03:43:48.532 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.533 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.533 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.533 INFO:teuthology.orchestra.run.smithi045.stdout: "address": { 2024-05-10T03:43:48.533 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "address", 2024-05-10T03:43:48.533 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.533 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.533 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.533 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-10T03:43:48.533 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.533 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.533 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.533 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.533 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.533 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.534 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.534 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.534 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-05-10T03:43:48.534 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-05-10T03:43:48.534 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:48.534 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.534 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.534 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "15", 2024-05-10T03:43:48.534 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.534 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.534 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.534 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.534 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.534 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.535 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.535 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.535 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.535 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.535 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.535 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.535 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.535 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.535 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.535 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.535 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.535 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.535 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.535 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.535 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.536 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.537 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.537 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.537 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.537 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.537 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.537 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.537 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.537 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.537 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.537 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.537 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.537 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.537 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.537 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.537 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.538 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.538 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.538 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.538 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.538 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.538 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.538 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.538 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.538 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.538 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.538 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.538 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.538 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.538 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.539 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.539 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.539 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.539 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.539 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.539 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.539 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.539 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.539 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.539 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.539 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.539 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.539 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.539 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.539 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.540 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.540 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.540 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "telemetry", 2024-05-10T03:43:48.540 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.540 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.540 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.540 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_basic": { 2024-05-10T03:43:48.540 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_basic", 2024-05-10T03:43:48.540 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.540 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.540 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.540 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.540 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.540 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.540 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.541 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-10T03:43:48.541 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.541 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.541 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.541 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.541 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_crash": { 2024-05-10T03:43:48.541 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_crash", 2024-05-10T03:43:48.541 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.541 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.541 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.541 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.541 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.541 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.541 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.542 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-10T03:43:48.542 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.542 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.542 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.542 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.542 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_device": { 2024-05-10T03:43:48.542 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_device", 2024-05-10T03:43:48.542 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.542 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.542 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.542 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.542 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.542 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.542 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.543 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-10T03:43:48.543 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.543 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.543 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.543 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.543 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_ident": { 2024-05-10T03:43:48.543 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_ident", 2024-05-10T03:43:48.543 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.543 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.543 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.543 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.543 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.543 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.543 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.543 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-10T03:43:48.544 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.544 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.544 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.544 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.544 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_perf": { 2024-05-10T03:43:48.544 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_perf", 2024-05-10T03:43:48.544 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.544 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.544 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.544 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.544 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.544 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.544 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.544 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-10T03:43:48.544 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.545 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.545 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.545 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.545 INFO:teuthology.orchestra.run.smithi045.stdout: "contact": { 2024-05-10T03:43:48.545 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "contact", 2024-05-10T03:43:48.545 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.545 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.545 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.545 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.545 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.545 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.545 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.545 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.545 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.545 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: "description": { 2024-05-10T03:43:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "description", 2024-05-10T03:43:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.546 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: "device_url": { 2024-05-10T03:43:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "device_url", 2024-05-10T03:43:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-10T03:43:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.547 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.548 INFO:teuthology.orchestra.run.smithi045.stdout: "enabled": { 2024-05-10T03:43:48.548 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "enabled", 2024-05-10T03:43:48.548 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.548 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.548 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.548 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.548 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.548 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.548 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.548 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.548 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.548 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.548 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.548 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.548 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-05-10T03:43:48.549 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-05-10T03:43:48.549 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.549 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.549 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.549 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "24", 2024-05-10T03:43:48.549 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "8", 2024-05-10T03:43:48.549 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.549 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.549 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.549 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.549 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.549 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.549 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.549 INFO:teuthology.orchestra.run.smithi045.stdout: "last_opt_revision": { 2024-05-10T03:43:48.550 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "last_opt_revision", 2024-05-10T03:43:48.550 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.550 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.550 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.550 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "1", 2024-05-10T03:43:48.550 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.550 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.550 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.550 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.550 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.550 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.550 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.550 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.550 INFO:teuthology.orchestra.run.smithi045.stdout: "leaderboard": { 2024-05-10T03:43:48.551 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "leaderboard", 2024-05-10T03:43:48.551 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.551 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.551 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.551 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.551 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.551 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.551 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.551 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.551 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.551 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.551 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.551 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.551 INFO:teuthology.orchestra.run.smithi045.stdout: "leaderboard_description": { 2024-05-10T03:43:48.551 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "leaderboard_description", 2024-05-10T03:43:48.552 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.552 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.552 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.552 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.552 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.552 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.552 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.552 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.552 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.552 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.552 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.552 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.552 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.552 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.552 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.553 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.553 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.553 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.553 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.553 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.553 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.553 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.553 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.553 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.553 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.553 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.553 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.553 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.553 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.554 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.554 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.554 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.554 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.554 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.554 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.554 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.554 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.554 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.554 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.554 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.554 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.554 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.554 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.554 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.555 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.555 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.555 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.555 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.555 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.555 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.555 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.555 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.555 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.555 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.555 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.555 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.555 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.555 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.556 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.556 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.556 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.556 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.556 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.556 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.556 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.556 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.556 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.556 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.556 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.556 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.556 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.556 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.556 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.557 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.557 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.557 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.557 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.557 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.557 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.557 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.557 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.557 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.557 INFO:teuthology.orchestra.run.smithi045.stdout: "organization": { 2024-05-10T03:43:48.557 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "organization", 2024-05-10T03:43:48.557 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.557 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.557 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.557 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.557 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.558 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.558 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.558 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.558 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.558 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.558 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.558 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.558 INFO:teuthology.orchestra.run.smithi045.stdout: "proxy": { 2024-05-10T03:43:48.558 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "proxy", 2024-05-10T03:43:48.558 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.558 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.558 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.558 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.558 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.559 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.559 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.559 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.559 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.559 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.559 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.559 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.559 INFO:teuthology.orchestra.run.smithi045.stdout: "url": { 2024-05-10T03:43:48.559 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "url", 2024-05-10T03:43:48.559 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.559 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.559 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.559 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-10T03:43:48.559 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.559 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.560 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.560 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.560 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.560 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.560 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.560 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.560 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.560 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.560 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.560 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "test_orchestrator", 2024-05-10T03:43:48.560 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.560 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.560 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.560 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.560 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.561 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.561 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.561 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.561 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.561 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.561 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.561 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.561 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.561 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.561 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.561 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.561 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.561 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.561 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.561 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.561 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.562 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.562 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.562 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.562 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.562 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.562 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.562 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.562 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.562 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.562 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.562 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.562 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.562 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.563 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.563 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.563 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.563 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.563 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.563 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.563 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.563 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.563 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.563 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.563 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.563 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.563 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.563 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.563 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.564 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.564 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.564 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.564 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.564 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.564 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.564 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.564 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.564 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.564 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.564 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.564 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.564 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.565 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.565 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.565 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.565 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.565 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.565 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.565 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.565 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.565 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.565 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.565 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.565 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.565 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.565 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.565 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "volumes", 2024-05-10T03:43:48.566 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.566 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.566 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.566 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.566 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.566 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.566 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.566 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.566 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.566 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.566 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.566 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.566 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.566 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.567 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.567 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.567 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.567 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.567 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.567 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.567 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.567 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.567 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.567 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.567 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.567 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.567 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.567 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.567 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.568 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.568 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.568 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.568 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.568 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.568 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.568 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.568 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.568 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.568 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.568 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.568 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.568 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.568 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.568 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.569 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.569 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.569 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.569 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.569 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.569 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.569 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.569 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.569 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.569 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.569 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.569 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.569 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.569 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.569 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.570 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.570 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.570 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.570 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.570 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.570 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.570 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.570 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.570 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.570 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.570 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.570 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.570 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.570 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.571 INFO:teuthology.orchestra.run.smithi045.stdout: "max_concurrent_clones": { 2024-05-10T03:43:48.571 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_concurrent_clones", 2024-05-10T03:43:48.571 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.571 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.571 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.571 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "4", 2024-05-10T03:43:48.571 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.571 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.571 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.571 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-10T03:43:48.571 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.571 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.571 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.571 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.572 INFO:teuthology.orchestra.run.smithi045.stdout: "snapshot_clone_delay": { 2024-05-10T03:43:48.572 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "snapshot_clone_delay", 2024-05-10T03:43:48.572 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.572 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.572 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.572 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-05-10T03:43:48.572 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.572 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.572 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.572 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-10T03:43:48.572 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.572 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.572 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.572 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.572 INFO:teuthology.orchestra.run.smithi045.stdout: "snapshot_clone_no_wait": { 2024-05-10T03:43:48.573 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "snapshot_clone_no_wait", 2024-05-10T03:43:48.573 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.573 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.573 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.573 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-05-10T03:43:48.573 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.573 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.573 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.573 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-10T03:43:48.573 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.573 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.573 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.573 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.573 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.573 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.574 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.574 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "zabbix", 2024-05-10T03:43:48.574 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-05-10T03:43:48.574 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-05-10T03:43:48.574 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-05-10T03:43:48.574 INFO:teuthology.orchestra.run.smithi045.stdout: "discovery_interval": { 2024-05-10T03:43:48.574 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "discovery_interval", 2024-05-10T03:43:48.574 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-05-10T03:43:48.574 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.574 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.574 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "100", 2024-05-10T03:43:48.574 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.574 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.574 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.574 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.575 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.575 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.575 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.575 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.575 INFO:teuthology.orchestra.run.smithi045.stdout: "identifier": { 2024-05-10T03:43:48.575 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "identifier", 2024-05-10T03:43:48.575 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.575 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.575 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.575 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.575 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.575 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.575 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.575 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.575 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.576 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.576 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.576 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.576 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-05-10T03:43:48.576 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-05-10T03:43:48.576 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-05-10T03:43:48.576 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.576 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.576 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-05-10T03:43:48.576 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.576 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.576 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.576 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.576 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.576 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.577 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.577 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.577 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-05-10T03:43:48.577 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-05-10T03:43:48.577 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.577 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.577 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.577 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.577 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.577 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.577 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.577 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.577 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.577 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.577 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.578 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.578 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.578 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.578 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.578 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.578 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.578 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.578 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.578 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-05-10T03:43:48.578 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-05-10T03:43:48.578 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.578 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.578 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.578 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.579 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.579 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.579 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.579 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.579 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.579 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.579 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.579 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.579 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-05-10T03:43:48.579 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-05-10T03:43:48.579 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.579 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.579 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.579 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-05-10T03:43:48.579 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.579 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.580 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-05-10T03:43:48.580 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-05-10T03:43:48.580 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-05-10T03:43:48.580 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-05-10T03:43:48.580 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-05-10T03:43:48.580 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-05-10T03:43:48.580 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-05-10T03:43:48.580 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.580 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.580 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.580 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.580 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.580 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.580 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-05-10T03:43:48.581 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-05-10T03:43:48.581 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-05-10T03:43:48.581 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.581 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-05-10T03:43:48.581 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-05-10T03:43:48.581 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.581 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.581 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.581 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.581 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.581 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.581 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.581 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.581 INFO:teuthology.orchestra.run.smithi045.stdout: "zabbix_host": { 2024-05-10T03:43:48.581 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "zabbix_host", 2024-05-10T03:43:48.581 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.582 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.582 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.582 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-05-10T03:43:48.582 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.582 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.582 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.582 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.582 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.582 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.582 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.582 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.582 INFO:teuthology.orchestra.run.smithi045.stdout: "zabbix_port": { 2024-05-10T03:43:48.582 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "zabbix_port", 2024-05-10T03:43:48.582 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-05-10T03:43:48.583 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.583 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.583 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10051", 2024-05-10T03:43:48.583 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.583 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.583 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.583 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.583 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.583 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.583 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.583 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.583 INFO:teuthology.orchestra.run.smithi045.stdout: "zabbix_sender": { 2024-05-10T03:43:48.583 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "zabbix_sender", 2024-05-10T03:43:48.583 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-05-10T03:43:48.583 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-05-10T03:43:48.584 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-05-10T03:43:48.584 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-10T03:43:48.584 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-05-10T03:43:48.584 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-05-10T03:43:48.584 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-05-10T03:43:48.584 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-05-10T03:43:48.584 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-05-10T03:43:48.584 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-05-10T03:43:48.584 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-05-10T03:43:48.584 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.584 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.584 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.584 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.584 INFO:teuthology.orchestra.run.smithi045.stdout: "services": { 2024-05-10T03:43:48.584 INFO:teuthology.orchestra.run.smithi045.stdout: "dashboard": "https://172.21.15.45:8443/" 2024-05-10T03:43:48.585 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.585 INFO:teuthology.orchestra.run.smithi045.stdout: "always_on_modules": { 2024-05-10T03:43:48.585 INFO:teuthology.orchestra.run.smithi045.stdout: "octopus": [ 2024-05-10T03:43:48.585 INFO:teuthology.orchestra.run.smithi045.stdout: "balancer", 2024-05-10T03:43:48.585 INFO:teuthology.orchestra.run.smithi045.stdout: "crash", 2024-05-10T03:43:48.585 INFO:teuthology.orchestra.run.smithi045.stdout: "devicehealth", 2024-05-10T03:43:48.585 INFO:teuthology.orchestra.run.smithi045.stdout: "orchestrator", 2024-05-10T03:43:48.585 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscaler", 2024-05-10T03:43:48.585 INFO:teuthology.orchestra.run.smithi045.stdout: "progress", 2024-05-10T03:43:48.585 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_support", 2024-05-10T03:43:48.585 INFO:teuthology.orchestra.run.smithi045.stdout: "status", 2024-05-10T03:43:48.585 INFO:teuthology.orchestra.run.smithi045.stdout: "telemetry", 2024-05-10T03:43:48.585 INFO:teuthology.orchestra.run.smithi045.stdout: "volumes" 2024-05-10T03:43:48.585 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.585 INFO:teuthology.orchestra.run.smithi045.stdout: "pacific": [ 2024-05-10T03:43:48.586 INFO:teuthology.orchestra.run.smithi045.stdout: "balancer", 2024-05-10T03:43:48.586 INFO:teuthology.orchestra.run.smithi045.stdout: "crash", 2024-05-10T03:43:48.586 INFO:teuthology.orchestra.run.smithi045.stdout: "devicehealth", 2024-05-10T03:43:48.586 INFO:teuthology.orchestra.run.smithi045.stdout: "orchestrator", 2024-05-10T03:43:48.586 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscaler", 2024-05-10T03:43:48.586 INFO:teuthology.orchestra.run.smithi045.stdout: "progress", 2024-05-10T03:43:48.586 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_support", 2024-05-10T03:43:48.586 INFO:teuthology.orchestra.run.smithi045.stdout: "status", 2024-05-10T03:43:48.586 INFO:teuthology.orchestra.run.smithi045.stdout: "telemetry", 2024-05-10T03:43:48.586 INFO:teuthology.orchestra.run.smithi045.stdout: "volumes" 2024-05-10T03:43:48.586 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.586 INFO:teuthology.orchestra.run.smithi045.stdout: "quincy": [ 2024-05-10T03:43:48.586 INFO:teuthology.orchestra.run.smithi045.stdout: "balancer", 2024-05-10T03:43:48.586 INFO:teuthology.orchestra.run.smithi045.stdout: "crash", 2024-05-10T03:43:48.586 INFO:teuthology.orchestra.run.smithi045.stdout: "devicehealth", 2024-05-10T03:43:48.587 INFO:teuthology.orchestra.run.smithi045.stdout: "orchestrator", 2024-05-10T03:43:48.587 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscaler", 2024-05-10T03:43:48.587 INFO:teuthology.orchestra.run.smithi045.stdout: "progress", 2024-05-10T03:43:48.587 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_support", 2024-05-10T03:43:48.587 INFO:teuthology.orchestra.run.smithi045.stdout: "status", 2024-05-10T03:43:48.587 INFO:teuthology.orchestra.run.smithi045.stdout: "telemetry", 2024-05-10T03:43:48.587 INFO:teuthology.orchestra.run.smithi045.stdout: "volumes" 2024-05-10T03:43:48.587 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-05-10T03:43:48.587 INFO:teuthology.orchestra.run.smithi045.stdout: "reef": [ 2024-05-10T03:43:48.587 INFO:teuthology.orchestra.run.smithi045.stdout: "balancer", 2024-05-10T03:43:48.587 INFO:teuthology.orchestra.run.smithi045.stdout: "crash", 2024-05-10T03:43:48.587 INFO:teuthology.orchestra.run.smithi045.stdout: "devicehealth", 2024-05-10T03:43:48.587 INFO:teuthology.orchestra.run.smithi045.stdout: "orchestrator", 2024-05-10T03:43:48.587 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscaler", 2024-05-10T03:43:48.587 INFO:teuthology.orchestra.run.smithi045.stdout: "progress", 2024-05-10T03:43:48.588 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_support", 2024-05-10T03:43:48.588 INFO:teuthology.orchestra.run.smithi045.stdout: "status", 2024-05-10T03:43:48.588 INFO:teuthology.orchestra.run.smithi045.stdout: "telemetry", 2024-05-10T03:43:48.588 INFO:teuthology.orchestra.run.smithi045.stdout: "volumes" 2024-05-10T03:43:48.588 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-05-10T03:43:48.588 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.588 INFO:teuthology.orchestra.run.smithi045.stdout: "last_failure_osd_epoch": 3, 2024-05-10T03:43:48.588 INFO:teuthology.orchestra.run.smithi045.stdout: "active_clients": [ 2024-05-10T03:43:48.588 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.588 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "devicehealth", 2024-05-10T03:43:48.588 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-05-10T03:43:48.588 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.588 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-05-10T03:43:48.588 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:0", 2024-05-10T03:43:48.588 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4243113437 2024-05-10T03:43:48.589 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.589 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-05-10T03:43:48.589 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.589 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.589 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "libcephsqlite", 2024-05-10T03:43:48.589 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-05-10T03:43:48.589 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.589 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-05-10T03:43:48.589 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:0", 2024-05-10T03:43:48.589 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3487072396 2024-05-10T03:43:48.589 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.589 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-05-10T03:43:48.589 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.589 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.589 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rbd_support", 2024-05-10T03:43:48.590 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-05-10T03:43:48.590 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.590 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-05-10T03:43:48.590 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:0", 2024-05-10T03:43:48.590 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 186301517 2024-05-10T03:43:48.590 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.590 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-05-10T03:43:48.590 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:48.590 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.590 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "volumes", 2024-05-10T03:43:48.590 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-05-10T03:43:48.590 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-05-10T03:43:48.590 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-05-10T03:43:48.590 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:0", 2024-05-10T03:43:48.591 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1957385379 2024-05-10T03:43:48.591 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.591 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-05-10T03:43:48.591 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:48.591 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-05-10T03:43:48.591 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:43:48.593 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:47 smithi154 ceph-mon[46565]: pgmap v390: 129 pgs: 129 active+clean; 101 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 357 op/s 2024-05-10T03:43:48.593 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:47 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2657886882' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:43:48.593 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:47 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3348498189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:43:48.593 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:48 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2443381476' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-10T03:43:48.593 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:47 smithi106 ceph-mon[46996]: pgmap v390: 129 pgs: 129 active+clean; 101 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 357 op/s 2024-05-10T03:43:48.593 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:47 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2657886882' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:43:48.593 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:47 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3348498189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:43:48.593 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:48 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2443381476' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-10T03:43:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.338+0000 7f0b3c515700 1 -- 172.21.15.45:0/2443381476 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0b200a1120 msgr2=0x7f0b200a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.338+0000 7f0b3c515700 1 --2- 172.21.15.45:0/2443381476 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0b200a1120 0x7f0b200a3630 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0b24005950 tx=0x7f0b240058e0 comp rx=0 tx=0).stop 2024-05-10T03:43:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.338+0000 7f0b3c515700 1 -- 172.21.15.45:0/2443381476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b3406a750 msgr2=0x7f0b341982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:43:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.338+0000 7f0b3c515700 1 --2- 172.21.15.45:0/2443381476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b3406a750 0x7f0b341982a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000d980 tx=0x7f0b3000dd40 comp rx=0 tx=0).stop 2024-05-10T03:43:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.338+0000 7f0b3c515700 1 -- 172.21.15.45:0/2443381476 shutdown_connections 2024-05-10T03:43:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.338+0000 7f0b3c515700 1 --2- 172.21.15.45:0/2443381476 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f0b200a1120 0x7f0b200a3630 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.338+0000 7f0b3c515700 1 --2- 172.21.15.45:0/2443381476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b341078a0 0x7f0b3419f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.338+0000 7f0b3c515700 1 --2- 172.21.15.45:0/2443381476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b3406a750 0x7f0b341982a0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.338+0000 7f0b3c515700 1 --2- 172.21.15.45:0/2443381476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b34104d70 0x7f0b341987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:43:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.338+0000 7f0b3c515700 1 -- 172.21.15.45:0/2443381476 >> 172.21.15.45:0/2443381476 conn(0x7f0b340fc0f0 msgr2=0x7f0b34103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:43:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.338+0000 7f0b3c515700 1 -- 172.21.15.45:0/2443381476 shutdown_connections 2024-05-10T03:43:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:43:47.338+0000 7f0b3c515700 1 -- 172.21.15.45:0/2443381476 wait complete. 2024-05-10T03:43:48.600 DEBUG:tasks.check_counter:Getting stats from a 2024-05-10T03:43:48.600 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph daemon mds.a perf dump 2024-05-10T03:43:48.601 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:47 smithi045 ceph-mon[42520]: pgmap v390: 129 pgs: 129 active+clean; 101 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 357 op/s 2024-05-10T03:43:48.601 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:47 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2657886882' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:43:48.601 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:47 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3348498189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:43:48.601 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:48 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2443381476' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-10T03:43:48.860 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:43:49.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:49 smithi045 ceph-mon[42520]: pgmap v391: 129 pgs: 129 active+clean; 99 MiB data, 870 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 430 op/s 2024-05-10T03:43:49.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:49 smithi106 ceph-mon[46996]: pgmap v391: 129 pgs: 129 active+clean; 99 MiB data, 870 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 430 op/s 2024-05-10T03:43:49.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:49 smithi154 ceph-mon[46565]: pgmap v391: 129 pgs: 129 active+clean; 99 MiB data, 870 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 430 op/s 2024-05-10T03:43:49.978 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:43:49.979 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-0": { 2024-05-10T03:43:49.979 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 617, 2024-05-10T03:43:49.979 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 619, 2024-05-10T03:43:49.979 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 1688239, 2024-05-10T03:43:49.979 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 191888, 2024-05-10T03:43:49.979 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 6, 2024-05-10T03:43:49.979 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 2, 2024-05-10T03:43:49.979 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.061869257, 2024-05-10T03:43:49.979 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.017307511, 2024-05-10T03:43:49.979 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.018517583, 2024-05-10T03:43:49.979 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.019233608, 2024-05-10T03:43:49.979 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:43:49.979 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 617, 2024-05-10T03:43:49.980 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.023749227, 2024-05-10T03:43:49.980 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000038491 2024-05-10T03:43:49.980 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.980 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:43:49.980 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:49.980 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:49.980 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:49.980 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.980 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-10T03:43:49.980 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 0 2024-05-10T03:43:49.980 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.980 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-1": { 2024-05-10T03:43:49.980 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 339, 2024-05-10T03:43:49.980 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 320, 2024-05-10T03:43:49.981 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 596068, 2024-05-10T03:43:49.981 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 120504, 2024-05-10T03:43:49.981 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 4, 2024-05-10T03:43:49.981 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 3, 2024-05-10T03:43:49.981 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.043040660, 2024-05-10T03:43:49.981 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.011916841, 2024-05-10T03:43:49.981 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.021287036, 2024-05-10T03:43:49.981 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.011480684, 2024-05-10T03:43:49.981 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:43:49.981 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 320, 2024-05-10T03:43:49.981 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.019606193, 2024-05-10T03:43:49.981 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000061269 2024-05-10T03:43:49.981 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.981 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:43:49.982 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:49.982 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:49.982 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:49.982 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.982 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 541296, 2024-05-10T03:43:49.982 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 52016 2024-05-10T03:43:49.982 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.982 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-2": { 2024-05-10T03:43:49.982 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 2, 2024-05-10T03:43:49.982 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 69, 2024-05-10T03:43:49.982 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 428, 2024-05-10T03:43:49.982 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 188343, 2024-05-10T03:43:49.982 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 4, 2024-05-10T03:43:49.982 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 3, 2024-05-10T03:43:49.983 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.007310354, 2024-05-10T03:43:49.983 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.004412451, 2024-05-10T03:43:49.983 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.002070257, 2024-05-10T03:43:49.983 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.000025896, 2024-05-10T03:43:49.983 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:43:49.983 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 67, 2024-05-10T03:43:49.983 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.003925592, 2024-05-10T03:43:49.983 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000058590 2024-05-10T03:43:49.983 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.983 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:43:49.983 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:49.983 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:49.984 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:49.984 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.984 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-10T03:43:49.984 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 188032 2024-05-10T03:43:49.984 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.984 INFO:teuthology.orchestra.run.smithi045.stdout: "cct": { 2024-05-10T03:43:49.984 INFO:teuthology.orchestra.run.smithi045.stdout: "total_workers": 1, 2024-05-10T03:43:49.984 INFO:teuthology.orchestra.run.smithi045.stdout: "unhealthy_workers": 0 2024-05-10T03:43:49.984 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.984 INFO:teuthology.orchestra.run.smithi045.stdout: "finisher-MDSRank": { 2024-05-10T03:43:49.984 INFO:teuthology.orchestra.run.smithi045.stdout: "queue_len": 0, 2024-05-10T03:43:49.984 INFO:teuthology.orchestra.run.smithi045.stdout: "complete_latency": { 2024-05-10T03:43:49.984 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 1386, 2024-05-10T03:43:49.984 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.042744251, 2024-05-10T03:43:49.985 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000030840 2024-05-10T03:43:49.985 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:49.985 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.985 INFO:teuthology.orchestra.run.smithi045.stdout: "finisher-PurgeQueue": { 2024-05-10T03:43:49.985 INFO:teuthology.orchestra.run.smithi045.stdout: "queue_len": 0, 2024-05-10T03:43:49.985 INFO:teuthology.orchestra.run.smithi045.stdout: "complete_latency": { 2024-05-10T03:43:49.985 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:49.985 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:49.985 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:49.985 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:49.985 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.985 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-05-10T03:43:49.985 INFO:teuthology.orchestra.run.smithi045.stdout: "request": 0, 2024-05-10T03:43:49.986 INFO:teuthology.orchestra.run.smithi045.stdout: "reply": 0, 2024-05-10T03:43:49.986 INFO:teuthology.orchestra.run.smithi045.stdout: "reply_latency": { 2024-05-10T03:43:49.986 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:49.986 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:49.986 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:49.986 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.986 INFO:teuthology.orchestra.run.smithi045.stdout: "slow_reply": 0, 2024-05-10T03:43:49.986 INFO:teuthology.orchestra.run.smithi045.stdout: "forward": 0, 2024-05-10T03:43:49.987 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_fetch_complete": 0, 2024-05-10T03:43:49.987 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_fetch_keys": 0, 2024-05-10T03:43:49.987 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_commit": 0, 2024-05-10T03:43:49.987 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_split": 0, 2024-05-10T03:43:49.987 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_merge": 0, 2024-05-10T03:43:49.987 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes": 196, 2024-05-10T03:43:49.987 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_top": 0, 2024-05-10T03:43:49.987 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_bottom": 196, 2024-05-10T03:43:49.987 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_pin_tail": 0, 2024-05-10T03:43:49.987 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_pinned": 196, 2024-05-10T03:43:49.987 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_expired": 0, 2024-05-10T03:43:49.987 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_with_caps": 0, 2024-05-10T03:43:49.987 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": 0, 2024-05-10T03:43:49.988 INFO:teuthology.orchestra.run.smithi045.stdout: "subtrees": 1, 2024-05-10T03:43:49.988 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse": 0, 2024-05-10T03:43:49.988 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_hit": 0, 2024-05-10T03:43:49.988 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_forward": 0, 2024-05-10T03:43:49.988 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_discover": 0, 2024-05-10T03:43:49.988 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_dir_fetch": 0, 2024-05-10T03:43:49.988 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_remote_ino": 0, 2024-05-10T03:43:49.988 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_lock": 0, 2024-05-10T03:43:49.988 INFO:teuthology.orchestra.run.smithi045.stdout: "load_cent": 0, 2024-05-10T03:43:49.988 INFO:teuthology.orchestra.run.smithi045.stdout: "q": 0, 2024-05-10T03:43:49.988 INFO:teuthology.orchestra.run.smithi045.stdout: "exported": 0, 2024-05-10T03:43:49.989 INFO:teuthology.orchestra.run.smithi045.stdout: "exported_inodes": 0, 2024-05-10T03:43:49.989 INFO:teuthology.orchestra.run.smithi045.stdout: "imported": 0, 2024-05-10T03:43:49.989 INFO:teuthology.orchestra.run.smithi045.stdout: "imported_inodes": 0, 2024-05-10T03:43:49.989 INFO:teuthology.orchestra.run.smithi045.stdout: "openino_dir_fetch": 0, 2024-05-10T03:43:49.989 INFO:teuthology.orchestra.run.smithi045.stdout: "openino_backtrace_fetch": 0, 2024-05-10T03:43:49.989 INFO:teuthology.orchestra.run.smithi045.stdout: "openino_peer_discover": 0, 2024-05-10T03:43:49.989 INFO:teuthology.orchestra.run.smithi045.stdout: "root_rfiles": 0, 2024-05-10T03:43:49.989 INFO:teuthology.orchestra.run.smithi045.stdout: "root_rbytes": 0, 2024-05-10T03:43:49.989 INFO:teuthology.orchestra.run.smithi045.stdout: "root_rsnaps": 0, 2024-05-10T03:43:49.989 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_backtrace_fetch": 0, 2024-05-10T03:43:49.989 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_set_tag": 0, 2024-05-10T03:43:49.989 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_backtrace_repaired": 0, 2024-05-10T03:43:49.989 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_inotable_repaired": 0, 2024-05-10T03:43:49.989 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_dir_inodes": 0, 2024-05-10T03:43:49.990 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_dir_base_inodes": 0, 2024-05-10T03:43:49.990 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_dirfrag_rstats": 0, 2024-05-10T03:43:49.990 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_file_inodes": 0, 2024-05-10T03:43:49.990 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_inode_file_caps": 0, 2024-05-10T03:43:49.990 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_revoke": 0, 2024-05-10T03:43:49.990 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_grant": 0, 2024-05-10T03:43:49.990 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_trunc": 0, 2024-05-10T03:43:49.990 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-10T03:43:49.990 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-10T03:43:49.990 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_caps": 0, 2024-05-10T03:43:49.991 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_caps_dirty": 0, 2024-05-10T03:43:49.991 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_cap_release": 0, 2024-05-10T03:43:49.991 INFO:teuthology.orchestra.run.smithi045.stdout: "process_request_cap_release": 0 2024-05-10T03:43:49.991 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.991 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_cache": { 2024-05-10T03:43:49.991 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_update": 0, 2024-05-10T03:43:49.991 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_update_receipt": 0, 2024-05-10T03:43:49.991 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_try_discover": 0, 2024-05-10T03:43:49.991 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_send_discover": 0, 2024-05-10T03:43:49.991 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_handle_discover": 0, 2024-05-10T03:43:49.992 INFO:teuthology.orchestra.run.smithi045.stdout: "num_strays": 0, 2024-05-10T03:43:49.992 INFO:teuthology.orchestra.run.smithi045.stdout: "num_strays_delayed": 0, 2024-05-10T03:43:49.992 INFO:teuthology.orchestra.run.smithi045.stdout: "num_strays_enqueuing": 0, 2024-05-10T03:43:49.992 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_created": 0, 2024-05-10T03:43:49.992 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_enqueued": 0, 2024-05-10T03:43:49.992 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_reintegrated": 0, 2024-05-10T03:43:49.992 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_migrated": 0, 2024-05-10T03:43:49.992 INFO:teuthology.orchestra.run.smithi045.stdout: "num_recovering_processing": 0, 2024-05-10T03:43:49.992 INFO:teuthology.orchestra.run.smithi045.stdout: "num_recovering_enqueued": 0, 2024-05-10T03:43:49.992 INFO:teuthology.orchestra.run.smithi045.stdout: "num_recovering_prioritized": 0, 2024-05-10T03:43:49.992 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_started": 0, 2024-05-10T03:43:49.992 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_completed": 0, 2024-05-10T03:43:49.992 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_enqueue_scrub": 0, 2024-05-10T03:43:49.992 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_exportdir": 0, 2024-05-10T03:43:49.993 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_flush": 0, 2024-05-10T03:43:49.993 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_fragmentdir": 0, 2024-05-10T03:43:49.993 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_fragstats": 0, 2024-05-10T03:43:49.993 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_inodestats": 0 2024-05-10T03:43:49.993 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.993 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_log": { 2024-05-10T03:43:49.993 INFO:teuthology.orchestra.run.smithi045.stdout: "evadd": 0, 2024-05-10T03:43:49.993 INFO:teuthology.orchestra.run.smithi045.stdout: "evex": 0, 2024-05-10T03:43:49.993 INFO:teuthology.orchestra.run.smithi045.stdout: "evtrm": 0, 2024-05-10T03:43:49.993 INFO:teuthology.orchestra.run.smithi045.stdout: "ev": 884, 2024-05-10T03:43:49.993 INFO:teuthology.orchestra.run.smithi045.stdout: "evexg": 0, 2024-05-10T03:43:49.993 INFO:teuthology.orchestra.run.smithi045.stdout: "evexd": 0, 2024-05-10T03:43:49.993 INFO:teuthology.orchestra.run.smithi045.stdout: "segadd": 0, 2024-05-10T03:43:49.993 INFO:teuthology.orchestra.run.smithi045.stdout: "segex": 0, 2024-05-10T03:43:49.993 INFO:teuthology.orchestra.run.smithi045.stdout: "segtrm": 0, 2024-05-10T03:43:49.994 INFO:teuthology.orchestra.run.smithi045.stdout: "seg": 1, 2024-05-10T03:43:49.994 INFO:teuthology.orchestra.run.smithi045.stdout: "segexg": 0, 2024-05-10T03:43:49.994 INFO:teuthology.orchestra.run.smithi045.stdout: "segexd": 0, 2024-05-10T03:43:49.994 INFO:teuthology.orchestra.run.smithi045.stdout: "expos": 4194304, 2024-05-10T03:43:49.994 INFO:teuthology.orchestra.run.smithi045.stdout: "wrpos": 5699986, 2024-05-10T03:43:49.994 INFO:teuthology.orchestra.run.smithi045.stdout: "rdpos": 5698848, 2024-05-10T03:43:49.994 INFO:teuthology.orchestra.run.smithi045.stdout: "jlat": { 2024-05-10T03:43:49.994 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:49.994 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:49.994 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:49.994 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.994 INFO:teuthology.orchestra.run.smithi045.stdout: "replayed": 884 2024-05-10T03:43:49.994 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.995 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_mem": { 2024-05-10T03:43:49.995 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 4, 2024-05-10T03:43:49.995 INFO:teuthology.orchestra.run.smithi045.stdout: "ino+": 261, 2024-05-10T03:43:49.995 INFO:teuthology.orchestra.run.smithi045.stdout: "ino-": 257, 2024-05-10T03:43:49.995 INFO:teuthology.orchestra.run.smithi045.stdout: "dir": 2, 2024-05-10T03:43:49.995 INFO:teuthology.orchestra.run.smithi045.stdout: "dir+": 75, 2024-05-10T03:43:49.995 INFO:teuthology.orchestra.run.smithi045.stdout: "dir-": 73, 2024-05-10T03:43:49.995 INFO:teuthology.orchestra.run.smithi045.stdout: "dn": 196, 2024-05-10T03:43:49.995 INFO:teuthology.orchestra.run.smithi045.stdout: "dn+": 376, 2024-05-10T03:43:49.995 INFO:teuthology.orchestra.run.smithi045.stdout: "dn-": 180, 2024-05-10T03:43:49.995 INFO:teuthology.orchestra.run.smithi045.stdout: "cap": 0, 2024-05-10T03:43:49.995 INFO:teuthology.orchestra.run.smithi045.stdout: "cap+": 0, 2024-05-10T03:43:49.995 INFO:teuthology.orchestra.run.smithi045.stdout: "cap-": 0, 2024-05-10T03:43:49.995 INFO:teuthology.orchestra.run.smithi045.stdout: "rss": 117368, 2024-05-10T03:43:49.996 INFO:teuthology.orchestra.run.smithi045.stdout: "heap": 207252 2024-05-10T03:43:49.996 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.996 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_server": { 2024-05-10T03:43:49.996 INFO:teuthology.orchestra.run.smithi045.stdout: "dispatch_client_request": 0, 2024-05-10T03:43:49.996 INFO:teuthology.orchestra.run.smithi045.stdout: "dispatch_server_request": 0, 2024-05-10T03:43:49.996 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_request": 0, 2024-05-10T03:43:49.996 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_session": 0, 2024-05-10T03:43:49.996 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_peer_request": 0, 2024-05-10T03:43:49.996 INFO:teuthology.orchestra.run.smithi045.stdout: "req_create_latency": { 2024-05-10T03:43:49.996 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:49.996 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:49.996 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:49.996 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.996 INFO:teuthology.orchestra.run.smithi045.stdout: "req_getattr_latency": { 2024-05-10T03:43:49.997 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:49.997 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:49.997 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:49.997 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.997 INFO:teuthology.orchestra.run.smithi045.stdout: "req_getfilelock_latency": { 2024-05-10T03:43:49.997 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:49.997 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:49.997 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:49.997 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.998 INFO:teuthology.orchestra.run.smithi045.stdout: "req_link_latency": { 2024-05-10T03:43:49.998 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:49.998 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:49.998 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:49.998 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.998 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookup_latency": { 2024-05-10T03:43:49.998 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:49.998 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:49.998 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:49.998 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.998 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookuphash_latency": { 2024-05-10T03:43:49.998 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:49.998 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:49.999 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:49.999 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.999 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupino_latency": { 2024-05-10T03:43:49.999 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:49.999 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:49.999 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:49.999 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.999 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupname_latency": { 2024-05-10T03:43:49.999 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:49.999 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:49.999 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:49.999 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:49.999 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupparent_latency": { 2024-05-10T03:43:49.999 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:49.999 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.000 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.000 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.000 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupsnap_latency": { 2024-05-10T03:43:50.000 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.000 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.000 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.000 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.000 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lssnap_latency": { 2024-05-10T03:43:50.000 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.000 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.000 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.000 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.000 INFO:teuthology.orchestra.run.smithi045.stdout: "req_mkdir_latency": { 2024-05-10T03:43:50.000 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.001 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.001 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.001 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.001 INFO:teuthology.orchestra.run.smithi045.stdout: "req_mknod_latency": { 2024-05-10T03:43:50.001 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.001 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.001 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.001 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.001 INFO:teuthology.orchestra.run.smithi045.stdout: "req_mksnap_latency": { 2024-05-10T03:43:50.001 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.001 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.001 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.001 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.001 INFO:teuthology.orchestra.run.smithi045.stdout: "req_open_latency": { 2024-05-10T03:43:50.002 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.002 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.002 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.002 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.002 INFO:teuthology.orchestra.run.smithi045.stdout: "req_readdir_latency": { 2024-05-10T03:43:50.002 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.002 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.002 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.002 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.002 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rename_latency": { 2024-05-10T03:43:50.002 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.002 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.002 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.003 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.003 INFO:teuthology.orchestra.run.smithi045.stdout: "req_renamesnap_latency": { 2024-05-10T03:43:50.003 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.003 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.003 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.003 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.003 INFO:teuthology.orchestra.run.smithi045.stdout: "req_snapdiff_latency": { 2024-05-10T03:43:50.003 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.003 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.003 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.003 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.003 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rmdir_latency": { 2024-05-10T03:43:50.004 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.004 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.004 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.004 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.004 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rmsnap_latency": { 2024-05-10T03:43:50.004 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.004 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.004 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.004 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.005 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rmxattr_latency": { 2024-05-10T03:43:50.005 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.005 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.005 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.005 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.005 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setattr_latency": { 2024-05-10T03:43:50.005 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.005 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.005 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.005 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.005 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setdirlayout_latency": { 2024-05-10T03:43:50.006 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.006 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.006 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.006 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.006 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setfilelock_latency": { 2024-05-10T03:43:50.006 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.006 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.006 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.006 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.006 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setlayout_latency": { 2024-05-10T03:43:50.007 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.007 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.007 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.007 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.007 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setxattr_latency": { 2024-05-10T03:43:50.007 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.007 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.007 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.008 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.008 INFO:teuthology.orchestra.run.smithi045.stdout: "req_symlink_latency": { 2024-05-10T03:43:50.008 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.008 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.008 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.008 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.008 INFO:teuthology.orchestra.run.smithi045.stdout: "req_unlink_latency": { 2024-05-10T03:43:50.008 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.008 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.009 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.009 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.009 INFO:teuthology.orchestra.run.smithi045.stdout: "cap_revoke_eviction": 0, 2024-05-10T03:43:50.009 INFO:teuthology.orchestra.run.smithi045.stdout: "cap_acquisition_throttle": 0, 2024-05-10T03:43:50.009 INFO:teuthology.orchestra.run.smithi045.stdout: "req_getvxattr_latency": { 2024-05-10T03:43:50.009 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.009 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.009 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.009 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:50.009 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.009 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_sessions": { 2024-05-10T03:43:50.009 INFO:teuthology.orchestra.run.smithi045.stdout: "session_count": 1, 2024-05-10T03:43:50.009 INFO:teuthology.orchestra.run.smithi045.stdout: "session_add": 1, 2024-05-10T03:43:50.010 INFO:teuthology.orchestra.run.smithi045.stdout: "session_remove": 0, 2024-05-10T03:43:50.010 INFO:teuthology.orchestra.run.smithi045.stdout: "sessions_open": 1, 2024-05-10T03:43:50.010 INFO:teuthology.orchestra.run.smithi045.stdout: "sessions_stale": 0, 2024-05-10T03:43:50.010 INFO:teuthology.orchestra.run.smithi045.stdout: "total_load": 0, 2024-05-10T03:43:50.010 INFO:teuthology.orchestra.run.smithi045.stdout: "average_load": 0, 2024-05-10T03:43:50.010 INFO:teuthology.orchestra.run.smithi045.stdout: "avg_session_uptime": 1724, 2024-05-10T03:43:50.010 INFO:teuthology.orchestra.run.smithi045.stdout: "mdthresh_evicted": 0 2024-05-10T03:43:50.010 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.010 INFO:teuthology.orchestra.run.smithi045.stdout: "mempool": { 2024-05-10T03:43:50.010 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_bytes": 0, 2024-05-10T03:43:50.010 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_items": 0, 2024-05-10T03:43:50.010 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_bytes": 0, 2024-05-10T03:43:50.010 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_items": 0, 2024-05-10T03:43:50.011 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_bytes": 0, 2024-05-10T03:43:50.011 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_items": 0, 2024-05-10T03:43:50.011 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-10T03:43:50.011 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_items": 0, 2024-05-10T03:43:50.011 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-10T03:43:50.011 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_items": 0, 2024-05-10T03:43:50.011 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_bytes": 0, 2024-05-10T03:43:50.011 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_items": 0, 2024-05-10T03:43:50.011 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-10T03:43:50.011 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_items": 0, 2024-05-10T03:43:50.011 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_bytes": 0, 2024-05-10T03:43:50.011 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_items": 0, 2024-05-10T03:43:50.011 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_bytes": 0, 2024-05-10T03:43:50.011 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_items": 0, 2024-05-10T03:43:50.012 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-10T03:43:50.012 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_items": 0, 2024-05-10T03:43:50.012 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-10T03:43:50.012 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_items": 0, 2024-05-10T03:43:50.012 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_bytes": 0, 2024-05-10T03:43:50.012 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_items": 0, 2024-05-10T03:43:50.012 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_bytes": 0, 2024-05-10T03:43:50.012 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_items": 0, 2024-05-10T03:43:50.012 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-10T03:43:50.012 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_items": 0, 2024-05-10T03:43:50.012 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_bytes": 0, 2024-05-10T03:43:50.012 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_items": 0, 2024-05-10T03:43:50.012 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_bytes": 0, 2024-05-10T03:43:50.012 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_items": 0, 2024-05-10T03:43:50.013 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_bytes": 0, 2024-05-10T03:43:50.013 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_items": 0, 2024-05-10T03:43:50.013 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_bytes": 0, 2024-05-10T03:43:50.013 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_items": 0, 2024-05-10T03:43:50.013 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_bytes": 189256, 2024-05-10T03:43:50.013 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_items": 49, 2024-05-10T03:43:50.013 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_bytes": 0, 2024-05-10T03:43:50.013 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_items": 0, 2024-05-10T03:43:50.013 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_bytes": 0, 2024-05-10T03:43:50.013 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_items": 0, 2024-05-10T03:43:50.013 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_bytes": 0, 2024-05-10T03:43:50.013 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_items": 0, 2024-05-10T03:43:50.013 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_bytes": 0, 2024-05-10T03:43:50.013 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_items": 0, 2024-05-10T03:43:50.013 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_bytes": 9176, 2024-05-10T03:43:50.013 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_items": 176, 2024-05-10T03:43:50.014 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_bytes": 0, 2024-05-10T03:43:50.014 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_items": 0, 2024-05-10T03:43:50.014 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_bytes": 0, 2024-05-10T03:43:50.014 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_items": 0, 2024-05-10T03:43:50.014 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_bytes": 149784, 2024-05-10T03:43:50.014 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_items": 813, 2024-05-10T03:43:50.014 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_bytes": 0, 2024-05-10T03:43:50.014 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_items": 0, 2024-05-10T03:43:50.014 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_bytes": 0, 2024-05-10T03:43:50.014 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_items": 0 2024-05-10T03:43:50.015 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.015 INFO:teuthology.orchestra.run.smithi045.stdout: "objecter": { 2024-05-10T03:43:50.016 INFO:teuthology.orchestra.run.smithi045.stdout: "op_active": 0, 2024-05-10T03:43:50.016 INFO:teuthology.orchestra.run.smithi045.stdout: "op_laggy": 0, 2024-05-10T03:43:50.016 INFO:teuthology.orchestra.run.smithi045.stdout: "op_send": 838, 2024-05-10T03:43:50.016 INFO:teuthology.orchestra.run.smithi045.stdout: "op_send_bytes": 21, 2024-05-10T03:43:50.016 INFO:teuthology.orchestra.run.smithi045.stdout: "op_resend": 3, 2024-05-10T03:43:50.016 INFO:teuthology.orchestra.run.smithi045.stdout: "op_reply": 838, 2024-05-10T03:43:50.016 INFO:teuthology.orchestra.run.smithi045.stdout: "op_latency": { 2024-05-10T03:43:50.016 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 838, 2024-05-10T03:43:50.016 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.835986939, 2024-05-10T03:43:50.016 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000997597 2024-05-10T03:43:50.016 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.016 INFO:teuthology.orchestra.run.smithi045.stdout: "op_inflight": 0, 2024-05-10T03:43:50.016 INFO:teuthology.orchestra.run.smithi045.stdout: "oplen_avg": { 2024-05-10T03:43:50.016 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 838, 2024-05-10T03:43:50.017 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 839 2024-05-10T03:43:50.017 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.017 INFO:teuthology.orchestra.run.smithi045.stdout: "op": 838, 2024-05-10T03:43:50.017 INFO:teuthology.orchestra.run.smithi045.stdout: "op_r": 838, 2024-05-10T03:43:50.017 INFO:teuthology.orchestra.run.smithi045.stdout: "op_w": 0, 2024-05-10T03:43:50.017 INFO:teuthology.orchestra.run.smithi045.stdout: "op_rmw": 0, 2024-05-10T03:43:50.017 INFO:teuthology.orchestra.run.smithi045.stdout: "op_pg": 0, 2024-05-10T03:43:50.017 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_stat": 507, 2024-05-10T03:43:50.017 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_create": 0, 2024-05-10T03:43:50.017 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_read": 329, 2024-05-10T03:43:50.017 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_write": 0, 2024-05-10T03:43:50.017 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_writefull": 0, 2024-05-10T03:43:50.017 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_writesame": 0, 2024-05-10T03:43:50.017 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_append": 0, 2024-05-10T03:43:50.018 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_zero": 0, 2024-05-10T03:43:50.018 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_truncate": 0, 2024-05-10T03:43:50.018 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_delete": 0, 2024-05-10T03:43:50.018 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_mapext": 0, 2024-05-10T03:43:50.018 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_sparse_read": 0, 2024-05-10T03:43:50.018 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_clonerange": 0, 2024-05-10T03:43:50.018 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_getxattr": 1, 2024-05-10T03:43:50.018 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_setxattr": 0, 2024-05-10T03:43:50.018 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_cmpxattr": 0, 2024-05-10T03:43:50.018 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_rmxattr": 0, 2024-05-10T03:43:50.018 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_resetxattrs": 0, 2024-05-10T03:43:50.018 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_call": 0, 2024-05-10T03:43:50.019 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_watch": 0, 2024-05-10T03:43:50.019 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_notify": 0, 2024-05-10T03:43:50.019 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_src_cmpxattr": 0, 2024-05-10T03:43:50.019 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_pgls": 0, 2024-05-10T03:43:50.019 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_pgls_filter": 0, 2024-05-10T03:43:50.019 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_other": 0, 2024-05-10T03:43:50.019 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_active": 0, 2024-05-10T03:43:50.019 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_send": 0, 2024-05-10T03:43:50.019 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_resend": 0, 2024-05-10T03:43:50.019 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_ping": 0, 2024-05-10T03:43:50.019 INFO:teuthology.orchestra.run.smithi045.stdout: "poolop_active": 0, 2024-05-10T03:43:50.019 INFO:teuthology.orchestra.run.smithi045.stdout: "poolop_send": 0, 2024-05-10T03:43:50.019 INFO:teuthology.orchestra.run.smithi045.stdout: "poolop_resend": 0, 2024-05-10T03:43:50.019 INFO:teuthology.orchestra.run.smithi045.stdout: "poolstat_active": 0, 2024-05-10T03:43:50.020 INFO:teuthology.orchestra.run.smithi045.stdout: "poolstat_send": 0, 2024-05-10T03:43:50.020 INFO:teuthology.orchestra.run.smithi045.stdout: "poolstat_resend": 0, 2024-05-10T03:43:50.020 INFO:teuthology.orchestra.run.smithi045.stdout: "statfs_active": 0, 2024-05-10T03:43:50.020 INFO:teuthology.orchestra.run.smithi045.stdout: "statfs_send": 0, 2024-05-10T03:43:50.020 INFO:teuthology.orchestra.run.smithi045.stdout: "statfs_resend": 0, 2024-05-10T03:43:50.020 INFO:teuthology.orchestra.run.smithi045.stdout: "command_active": 0, 2024-05-10T03:43:50.020 INFO:teuthology.orchestra.run.smithi045.stdout: "command_send": 0, 2024-05-10T03:43:50.020 INFO:teuthology.orchestra.run.smithi045.stdout: "command_resend": 0, 2024-05-10T03:43:50.020 INFO:teuthology.orchestra.run.smithi045.stdout: "map_epoch": 90, 2024-05-10T03:43:50.020 INFO:teuthology.orchestra.run.smithi045.stdout: "map_full": 0, 2024-05-10T03:43:50.020 INFO:teuthology.orchestra.run.smithi045.stdout: "map_inc": 4, 2024-05-10T03:43:50.020 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_sessions": 5, 2024-05-10T03:43:50.020 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_session_open": 5, 2024-05-10T03:43:50.020 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_session_close": 0, 2024-05-10T03:43:50.021 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_laggy": 0, 2024-05-10T03:43:50.021 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_wr": 0, 2024-05-10T03:43:50.021 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_rd": 2, 2024-05-10T03:43:50.021 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_del": 0 2024-05-10T03:43:50.021 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.021 INFO:teuthology.orchestra.run.smithi045.stdout: "oft": { 2024-05-10T03:43:50.021 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_objs": 0, 2024-05-10T03:43:50.022 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_kv_pairs": 0, 2024-05-10T03:43:50.022 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_updates": 0, 2024-05-10T03:43:50.022 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_removes": 0 2024-05-10T03:43:50.022 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.022 INFO:teuthology.orchestra.run.smithi045.stdout: "osd-slow-ops": { 2024-05-10T03:43:50.022 INFO:teuthology.orchestra.run.smithi045.stdout: "slow_ops_count": 0 2024-05-10T03:43:50.022 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.022 INFO:teuthology.orchestra.run.smithi045.stdout: "purge_queue": { 2024-05-10T03:43:50.022 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing_ops": 0, 2024-05-10T03:43:50.022 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing_ops_high_water": 0, 2024-05-10T03:43:50.022 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing": 0, 2024-05-10T03:43:50.023 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing_high_water": 0, 2024-05-10T03:43:50.023 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executed": 0, 2024-05-10T03:43:50.023 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_item_in_journal": 0 2024-05-10T03:43:50.023 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.023 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-10T03:43:50.023 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-05-10T03:43:50.023 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 104857600, 2024-05-10T03:43:50.023 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-05-10T03:43:50.023 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 954, 2024-05-10T03:43:50.023 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 2189978, 2024-05-10T03:43:50.023 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:50.023 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 954, 2024-05-10T03:43:50.023 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2024-05-10T03:43:50.023 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2024-05-10T03:43:50.024 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 954, 2024-05-10T03:43:50.024 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 2189978, 2024-05-10T03:43:50.024 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-05-10T03:43:50.024 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.024 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.024 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.024 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:50.024 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.024 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-objecter_bytes": { 2024-05-10T03:43:50.024 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-05-10T03:43:50.024 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 104857600, 2024-05-10T03:43:50.024 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-05-10T03:43:50.024 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 0, 2024-05-10T03:43:50.024 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 0, 2024-05-10T03:43:50.025 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:50.025 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 0, 2024-05-10T03:43:50.025 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 838, 2024-05-10T03:43:50.025 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 1505687, 2024-05-10T03:43:50.025 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 838, 2024-05-10T03:43:50.025 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 1505687, 2024-05-10T03:43:50.025 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-05-10T03:43:50.025 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.025 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.025 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.025 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:50.025 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.025 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-objecter_ops": { 2024-05-10T03:43:50.025 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-05-10T03:43:50.026 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 1024, 2024-05-10T03:43:50.026 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-05-10T03:43:50.026 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 0, 2024-05-10T03:43:50.026 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 0, 2024-05-10T03:43:50.026 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:50.026 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 0, 2024-05-10T03:43:50.026 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 838, 2024-05-10T03:43:50.026 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 838, 2024-05-10T03:43:50.026 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 838, 2024-05-10T03:43:50.026 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 838, 2024-05-10T03:43:50.026 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-05-10T03:43:50.026 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.026 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.026 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.026 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:50.027 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.027 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-write_buf_throttle": { 2024-05-10T03:43:50.027 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-05-10T03:43:50.027 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 3758096384, 2024-05-10T03:43:50.027 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-05-10T03:43:50.027 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 0, 2024-05-10T03:43:50.027 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 0, 2024-05-10T03:43:50.027 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:50.027 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 0, 2024-05-10T03:43:50.027 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2024-05-10T03:43:50.027 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2024-05-10T03:43:50.027 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 0, 2024-05-10T03:43:50.027 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 0, 2024-05-10T03:43:50.027 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-05-10T03:43:50.028 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.028 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.028 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.028 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:50.028 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:50.028 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-write_buf_throttle-0x5637c81664e0": { 2024-05-10T03:43:50.028 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-05-10T03:43:50.028 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 3758096384, 2024-05-10T03:43:50.028 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-05-10T03:43:50.028 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 0, 2024-05-10T03:43:50.028 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 0, 2024-05-10T03:43:50.028 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:50.028 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 0, 2024-05-10T03:43:50.028 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2024-05-10T03:43:50.029 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2024-05-10T03:43:50.029 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 0, 2024-05-10T03:43:50.029 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 0, 2024-05-10T03:43:50.029 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-05-10T03:43:50.029 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:50.029 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:50.029 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:50.029 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:50.029 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:50.029 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:43:50.373 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-05-10T03:43:50.373 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-05-10T03:43:50.373 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-05-10T03:43:50.373 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-05-10T03:43:50.373 DEBUG:tasks.check_counter:Getting stats from d 2024-05-10T03:43:50.373 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph daemon mds.d perf dump 2024-05-10T03:43:50.632 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:43:51.419 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:51 smithi045 ceph-mon[42520]: pgmap v392: 129 pgs: 129 active+clean; 98 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 374 op/s 2024-05-10T03:43:51.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:51 smithi154 ceph-mon[46565]: pgmap v392: 129 pgs: 129 active+clean; 98 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 374 op/s 2024-05-10T03:43:51.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:51 smithi106 ceph-mon[46996]: pgmap v392: 129 pgs: 129 active+clean; 98 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 374 op/s 2024-05-10T03:43:51.665 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:43:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-0": { 2024-05-10T03:43:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 4, 2024-05-10T03:43:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 4, 2024-05-10T03:43:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 3040, 2024-05-10T03:43:51.665 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 448, 2024-05-10T03:43:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 4, 2024-05-10T03:43:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 0, 2024-05-10T03:43:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.002491137, 2024-05-10T03:43:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.000033710, 2024-05-10T03:43:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.000982101, 2024-05-10T03:43:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-10T03:43:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:43:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 3, 2024-05-10T03:43:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.001323529, 2024-05-10T03:43:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000441176 2024-05-10T03:43:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:43:51.666 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-05-10T03:43:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 448 2024-05-10T03:43:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-1": { 2024-05-10T03:43:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 95, 2024-05-10T03:43:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 92, 2024-05-10T03:43:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 436464, 2024-05-10T03:43:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 51808, 2024-05-10T03:43:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 2, 2024-05-10T03:43:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 1, 2024-05-10T03:43:51.667 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.017820595, 2024-05-10T03:43:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.005427262, 2024-05-10T03:43:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.013045209, 2024-05-10T03:43:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.002058286, 2024-05-10T03:43:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:43:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 91, 2024-05-10T03:43:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.005245499, 2024-05-10T03:43:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000057642 2024-05-10T03:43:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:43:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:51.668 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 436464, 2024-05-10T03:43:51.669 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 51808 2024-05-10T03:43:51.669 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:51.669 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-2": { 2024-05-10T03:43:51.669 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 1, 2024-05-10T03:43:51.669 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 70, 2024-05-10T03:43:51.669 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 160, 2024-05-10T03:43:51.669 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 88496, 2024-05-10T03:43:51.669 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 3, 2024-05-10T03:43:51.669 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 2, 2024-05-10T03:43:51.669 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.007470830, 2024-05-10T03:43:51.669 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.004417876, 2024-05-10T03:43:51.669 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.002080626, 2024-05-10T03:43:51.669 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-10T03:43:51.669 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:43:51.670 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 68, 2024-05-10T03:43:51.670 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.003502715, 2024-05-10T03:43:51.670 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000051510 2024-05-10T03:43:51.670 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:51.670 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:43:51.670 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:51.670 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:51.670 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:51.670 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:51.670 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-10T03:43:51.670 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 88496 2024-05-10T03:43:51.670 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:51.670 INFO:teuthology.orchestra.run.smithi045.stdout: "cct": { 2024-05-10T03:43:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: "total_workers": 0, 2024-05-10T03:43:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: "unhealthy_workers": 0 2024-05-10T03:43:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: "mempool": { 2024-05-10T03:43:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_bytes": 0, 2024-05-10T03:43:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_items": 0, 2024-05-10T03:43:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_bytes": 0, 2024-05-10T03:43:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_items": 0, 2024-05-10T03:43:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_bytes": 0, 2024-05-10T03:43:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_items": 0, 2024-05-10T03:43:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-10T03:43:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_items": 0, 2024-05-10T03:43:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-10T03:43:51.671 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_items": 0, 2024-05-10T03:43:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_bytes": 0, 2024-05-10T03:43:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_items": 0, 2024-05-10T03:43:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-10T03:43:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_items": 0, 2024-05-10T03:43:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_bytes": 0, 2024-05-10T03:43:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_items": 0, 2024-05-10T03:43:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_bytes": 0, 2024-05-10T03:43:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_items": 0, 2024-05-10T03:43:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-10T03:43:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_items": 0, 2024-05-10T03:43:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-10T03:43:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_items": 0, 2024-05-10T03:43:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_bytes": 0, 2024-05-10T03:43:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_items": 0, 2024-05-10T03:43:51.672 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_bytes": 0, 2024-05-10T03:43:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_items": 0, 2024-05-10T03:43:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-10T03:43:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_items": 0, 2024-05-10T03:43:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_bytes": 0, 2024-05-10T03:43:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_items": 0, 2024-05-10T03:43:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_bytes": 0, 2024-05-10T03:43:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_items": 0, 2024-05-10T03:43:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_bytes": 0, 2024-05-10T03:43:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_items": 0, 2024-05-10T03:43:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_bytes": 0, 2024-05-10T03:43:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_items": 0, 2024-05-10T03:43:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_bytes": 148863, 2024-05-10T03:43:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_items": 28, 2024-05-10T03:43:51.673 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_bytes": 0, 2024-05-10T03:43:51.674 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_items": 0, 2024-05-10T03:43:51.674 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_bytes": 0, 2024-05-10T03:43:51.674 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_items": 0, 2024-05-10T03:43:51.674 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_bytes": 0, 2024-05-10T03:43:51.674 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_items": 0, 2024-05-10T03:43:51.674 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_bytes": 0, 2024-05-10T03:43:51.674 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_items": 0, 2024-05-10T03:43:51.674 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_bytes": 0, 2024-05-10T03:43:51.674 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_items": 0, 2024-05-10T03:43:51.674 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_bytes": 0, 2024-05-10T03:43:51.674 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_items": 0, 2024-05-10T03:43:51.674 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_bytes": 0, 2024-05-10T03:43:51.674 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_items": 0, 2024-05-10T03:43:51.674 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_bytes": 928, 2024-05-10T03:43:51.675 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_items": 2, 2024-05-10T03:43:51.675 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_bytes": 0, 2024-05-10T03:43:51.675 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_items": 0, 2024-05-10T03:43:51.675 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_bytes": 0, 2024-05-10T03:43:51.675 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_items": 0 2024-05-10T03:43:51.675 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:51.675 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-10T03:43:51.675 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-05-10T03:43:51.675 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 104857600, 2024-05-10T03:43:51.675 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-05-10T03:43:51.675 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 96, 2024-05-10T03:43:51.675 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 423053, 2024-05-10T03:43:51.675 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:51.675 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 96, 2024-05-10T03:43:51.676 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2024-05-10T03:43:51.676 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2024-05-10T03:43:51.676 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 96, 2024-05-10T03:43:51.676 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 423053, 2024-05-10T03:43:51.676 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-05-10T03:43:51.676 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:51.676 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:51.676 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:51.676 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:51.676 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:51.676 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:43:52.056 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-05-10T03:43:52.056 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-05-10T03:43:52.056 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-05-10T03:43:52.056 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-05-10T03:43:52.056 DEBUG:tasks.check_counter:Getting stats from g 2024-05-10T03:43:52.057 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph daemon mds.g perf dump 2024-05-10T03:43:52.316 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:43:53.349 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:43:53.349 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-0": { 2024-05-10T03:43:53.349 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 319, 2024-05-10T03:43:53.350 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 321, 2024-05-10T03:43:53.350 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 8493553, 2024-05-10T03:43:53.350 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 99210, 2024-05-10T03:43:53.350 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 7, 2024-05-10T03:43:53.350 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 3, 2024-05-10T03:43:53.350 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.047400860, 2024-05-10T03:43:53.350 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.014588840, 2024-05-10T03:43:53.350 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.016060308, 2024-05-10T03:43:53.350 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.011034603, 2024-05-10T03:43:53.350 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:43:53.351 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 319, 2024-05-10T03:43:53.351 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.019743486, 2024-05-10T03:43:53.351 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000061891 2024-05-10T03:43:53.351 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.351 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:43:53.351 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.351 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.351 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.351 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.352 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-10T03:43:53.352 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 0 2024-05-10T03:43:53.352 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.352 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-1": { 2024-05-10T03:43:53.352 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 521, 2024-05-10T03:43:53.352 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 502, 2024-05-10T03:43:53.352 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 19339590, 2024-05-10T03:43:53.352 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 177376, 2024-05-10T03:43:53.352 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 5, 2024-05-10T03:43:53.352 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 4, 2024-05-10T03:43:53.352 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.068581578, 2024-05-10T03:43:53.353 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.015507025, 2024-05-10T03:43:53.353 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.039490172, 2024-05-10T03:43:53.353 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.013523395, 2024-05-10T03:43:53.353 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:43:53.353 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 502, 2024-05-10T03:43:53.353 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.026297126, 2024-05-10T03:43:53.353 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000052384 2024-05-10T03:43:53.353 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.353 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:43:53.353 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.353 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.354 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.354 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.354 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 541568, 2024-05-10T03:43:53.354 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 52608 2024-05-10T03:43:53.354 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.354 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-2": { 2024-05-10T03:43:53.354 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 10, 2024-05-10T03:43:53.354 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 78, 2024-05-10T03:43:53.354 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 4197336, 2024-05-10T03:43:53.355 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 192586, 2024-05-10T03:43:53.355 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 5, 2024-05-10T03:43:53.355 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 4, 2024-05-10T03:43:53.355 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.010891551, 2024-05-10T03:43:53.355 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.004545978, 2024-05-10T03:43:53.355 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.005076043, 2024-05-10T03:43:53.355 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.000270965, 2024-05-10T03:43:53.355 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:43:53.355 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 76, 2024-05-10T03:43:53.355 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.005890669, 2024-05-10T03:43:53.355 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000077508 2024-05-10T03:43:53.356 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.356 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:43:53.356 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.356 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.356 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.356 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.356 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-10T03:43:53.356 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 189776 2024-05-10T03:43:53.356 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.356 INFO:teuthology.orchestra.run.smithi045.stdout: "cct": { 2024-05-10T03:43:53.356 INFO:teuthology.orchestra.run.smithi045.stdout: "total_workers": 1, 2024-05-10T03:43:53.357 INFO:teuthology.orchestra.run.smithi045.stdout: "unhealthy_workers": 0 2024-05-10T03:43:53.357 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.357 INFO:teuthology.orchestra.run.smithi045.stdout: "finisher-MDSRank": { 2024-05-10T03:43:53.357 INFO:teuthology.orchestra.run.smithi045.stdout: "queue_len": 0, 2024-05-10T03:43:53.357 INFO:teuthology.orchestra.run.smithi045.stdout: "complete_latency": { 2024-05-10T03:43:53.357 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 1342, 2024-05-10T03:43:53.357 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.040555250, 2024-05-10T03:43:53.357 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000030220 2024-05-10T03:43:53.357 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:53.357 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.357 INFO:teuthology.orchestra.run.smithi045.stdout: "finisher-PurgeQueue": { 2024-05-10T03:43:53.358 INFO:teuthology.orchestra.run.smithi045.stdout: "queue_len": 0, 2024-05-10T03:43:53.358 INFO:teuthology.orchestra.run.smithi045.stdout: "complete_latency": { 2024-05-10T03:43:53.358 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.358 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.358 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.358 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:53.358 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.358 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": { 2024-05-10T03:43:53.358 INFO:teuthology.orchestra.run.smithi045.stdout: "request": 0, 2024-05-10T03:43:53.358 INFO:teuthology.orchestra.run.smithi045.stdout: "reply": 0, 2024-05-10T03:43:53.358 INFO:teuthology.orchestra.run.smithi045.stdout: "reply_latency": { 2024-05-10T03:43:53.359 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.359 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.359 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.359 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.359 INFO:teuthology.orchestra.run.smithi045.stdout: "slow_reply": 0, 2024-05-10T03:43:53.359 INFO:teuthology.orchestra.run.smithi045.stdout: "forward": 0, 2024-05-10T03:43:53.359 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_fetch_complete": 0, 2024-05-10T03:43:53.359 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_fetch_keys": 0, 2024-05-10T03:43:53.359 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_commit": 0, 2024-05-10T03:43:53.359 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_split": 0, 2024-05-10T03:43:53.360 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_merge": 0, 2024-05-10T03:43:53.360 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes": 4334, 2024-05-10T03:43:53.360 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_top": 0, 2024-05-10T03:43:53.360 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_bottom": 4334, 2024-05-10T03:43:53.360 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_pin_tail": 0, 2024-05-10T03:43:53.360 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_pinned": 4334, 2024-05-10T03:43:53.360 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_expired": 0, 2024-05-10T03:43:53.360 INFO:teuthology.orchestra.run.smithi045.stdout: "inodes_with_caps": 0, 2024-05-10T03:43:53.360 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": 0, 2024-05-10T03:43:53.360 INFO:teuthology.orchestra.run.smithi045.stdout: "subtrees": 1, 2024-05-10T03:43:53.360 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse": 0, 2024-05-10T03:43:53.361 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_hit": 0, 2024-05-10T03:43:53.361 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_forward": 0, 2024-05-10T03:43:53.361 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_discover": 0, 2024-05-10T03:43:53.361 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_dir_fetch": 0, 2024-05-10T03:43:53.361 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_remote_ino": 0, 2024-05-10T03:43:53.361 INFO:teuthology.orchestra.run.smithi045.stdout: "traverse_lock": 0, 2024-05-10T03:43:53.361 INFO:teuthology.orchestra.run.smithi045.stdout: "load_cent": 0, 2024-05-10T03:43:53.361 INFO:teuthology.orchestra.run.smithi045.stdout: "q": 0, 2024-05-10T03:43:53.361 INFO:teuthology.orchestra.run.smithi045.stdout: "exported": 0, 2024-05-10T03:43:53.361 INFO:teuthology.orchestra.run.smithi045.stdout: "exported_inodes": 0, 2024-05-10T03:43:53.362 INFO:teuthology.orchestra.run.smithi045.stdout: "imported": 0, 2024-05-10T03:43:53.362 INFO:teuthology.orchestra.run.smithi045.stdout: "imported_inodes": 0, 2024-05-10T03:43:53.362 INFO:teuthology.orchestra.run.smithi045.stdout: "openino_dir_fetch": 0, 2024-05-10T03:43:53.362 INFO:teuthology.orchestra.run.smithi045.stdout: "openino_backtrace_fetch": 0, 2024-05-10T03:43:53.362 INFO:teuthology.orchestra.run.smithi045.stdout: "openino_peer_discover": 0, 2024-05-10T03:43:53.362 INFO:teuthology.orchestra.run.smithi045.stdout: "root_rfiles": 0, 2024-05-10T03:43:53.362 INFO:teuthology.orchestra.run.smithi045.stdout: "root_rbytes": 0, 2024-05-10T03:43:53.362 INFO:teuthology.orchestra.run.smithi045.stdout: "root_rsnaps": 0, 2024-05-10T03:43:53.362 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_backtrace_fetch": 0, 2024-05-10T03:43:53.363 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_set_tag": 0, 2024-05-10T03:43:53.363 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_backtrace_repaired": 0, 2024-05-10T03:43:53.363 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_inotable_repaired": 0, 2024-05-10T03:43:53.363 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_dir_inodes": 0, 2024-05-10T03:43:53.363 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_dir_base_inodes": 0, 2024-05-10T03:43:53.363 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_dirfrag_rstats": 0, 2024-05-10T03:43:53.363 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_file_inodes": 0, 2024-05-10T03:43:53.363 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_inode_file_caps": 0, 2024-05-10T03:43:53.363 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_revoke": 0, 2024-05-10T03:43:53.363 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_grant": 0, 2024-05-10T03:43:53.364 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_trunc": 0, 2024-05-10T03:43:53.364 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-10T03:43:53.364 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-10T03:43:53.364 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_caps": 0, 2024-05-10T03:43:53.364 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_caps_dirty": 0, 2024-05-10T03:43:53.364 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_cap_release": 0, 2024-05-10T03:43:53.364 INFO:teuthology.orchestra.run.smithi045.stdout: "process_request_cap_release": 0 2024-05-10T03:43:53.364 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.364 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_cache": { 2024-05-10T03:43:53.364 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_update": 0, 2024-05-10T03:43:53.365 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_update_receipt": 0, 2024-05-10T03:43:53.365 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_try_discover": 0, 2024-05-10T03:43:53.365 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_send_discover": 0, 2024-05-10T03:43:53.365 INFO:teuthology.orchestra.run.smithi045.stdout: "dir_handle_discover": 0, 2024-05-10T03:43:53.365 INFO:teuthology.orchestra.run.smithi045.stdout: "num_strays": 0, 2024-05-10T03:43:53.365 INFO:teuthology.orchestra.run.smithi045.stdout: "num_strays_delayed": 0, 2024-05-10T03:43:53.365 INFO:teuthology.orchestra.run.smithi045.stdout: "num_strays_enqueuing": 0, 2024-05-10T03:43:53.365 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_created": 0, 2024-05-10T03:43:53.365 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_enqueued": 0, 2024-05-10T03:43:53.365 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_reintegrated": 0, 2024-05-10T03:43:53.365 INFO:teuthology.orchestra.run.smithi045.stdout: "strays_migrated": 0, 2024-05-10T03:43:53.366 INFO:teuthology.orchestra.run.smithi045.stdout: "num_recovering_processing": 0, 2024-05-10T03:43:53.366 INFO:teuthology.orchestra.run.smithi045.stdout: "num_recovering_enqueued": 0, 2024-05-10T03:43:53.366 INFO:teuthology.orchestra.run.smithi045.stdout: "num_recovering_prioritized": 0, 2024-05-10T03:43:53.366 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_started": 0, 2024-05-10T03:43:53.366 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_completed": 0, 2024-05-10T03:43:53.366 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_enqueue_scrub": 0, 2024-05-10T03:43:53.366 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_exportdir": 0, 2024-05-10T03:43:53.366 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_flush": 0, 2024-05-10T03:43:53.366 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_fragmentdir": 0, 2024-05-10T03:43:53.366 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_fragstats": 0, 2024-05-10T03:43:53.366 INFO:teuthology.orchestra.run.smithi045.stdout: "ireq_inodestats": 0 2024-05-10T03:43:53.367 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.367 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_log": { 2024-05-10T03:43:53.367 INFO:teuthology.orchestra.run.smithi045.stdout: "evadd": 0, 2024-05-10T03:43:53.367 INFO:teuthology.orchestra.run.smithi045.stdout: "evex": 0, 2024-05-10T03:43:53.367 INFO:teuthology.orchestra.run.smithi045.stdout: "evtrm": 0, 2024-05-10T03:43:53.367 INFO:teuthology.orchestra.run.smithi045.stdout: "ev": 15139, 2024-05-10T03:43:53.367 INFO:teuthology.orchestra.run.smithi045.stdout: "evexg": 0, 2024-05-10T03:43:53.367 INFO:teuthology.orchestra.run.smithi045.stdout: "evexd": 0, 2024-05-10T03:43:53.367 INFO:teuthology.orchestra.run.smithi045.stdout: "segadd": 0, 2024-05-10T03:43:53.367 INFO:teuthology.orchestra.run.smithi045.stdout: "segex": 0, 2024-05-10T03:43:53.367 INFO:teuthology.orchestra.run.smithi045.stdout: "segtrm": 0, 2024-05-10T03:43:53.367 INFO:teuthology.orchestra.run.smithi045.stdout: "seg": 20, 2024-05-10T03:43:53.367 INFO:teuthology.orchestra.run.smithi045.stdout: "segexg": 0, 2024-05-10T03:43:53.368 INFO:teuthology.orchestra.run.smithi045.stdout: "segexd": 0, 2024-05-10T03:43:53.368 INFO:teuthology.orchestra.run.smithi045.stdout: "expos": 4194304, 2024-05-10T03:43:53.368 INFO:teuthology.orchestra.run.smithi045.stdout: "wrpos": 35471536, 2024-05-10T03:43:53.368 INFO:teuthology.orchestra.run.smithi045.stdout: "rdpos": 35470398, 2024-05-10T03:43:53.368 INFO:teuthology.orchestra.run.smithi045.stdout: "jlat": { 2024-05-10T03:43:53.368 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.368 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.368 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.368 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.368 INFO:teuthology.orchestra.run.smithi045.stdout: "replayed": 15139 2024-05-10T03:43:53.368 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.369 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_mem": { 2024-05-10T03:43:53.369 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 17, 2024-05-10T03:43:53.369 INFO:teuthology.orchestra.run.smithi045.stdout: "ino+": 4304, 2024-05-10T03:43:53.369 INFO:teuthology.orchestra.run.smithi045.stdout: "ino-": 4287, 2024-05-10T03:43:53.369 INFO:teuthology.orchestra.run.smithi045.stdout: "dir": 15, 2024-05-10T03:43:53.369 INFO:teuthology.orchestra.run.smithi045.stdout: "dir+": 414, 2024-05-10T03:43:53.369 INFO:teuthology.orchestra.run.smithi045.stdout: "dir-": 399, 2024-05-10T03:43:53.369 INFO:teuthology.orchestra.run.smithi045.stdout: "dn": 4334, 2024-05-10T03:43:53.369 INFO:teuthology.orchestra.run.smithi045.stdout: "dn+": 8343, 2024-05-10T03:43:53.369 INFO:teuthology.orchestra.run.smithi045.stdout: "dn-": 4009, 2024-05-10T03:43:53.369 INFO:teuthology.orchestra.run.smithi045.stdout: "cap": 0, 2024-05-10T03:43:53.369 INFO:teuthology.orchestra.run.smithi045.stdout: "cap+": 0, 2024-05-10T03:43:53.370 INFO:teuthology.orchestra.run.smithi045.stdout: "cap-": 0, 2024-05-10T03:43:53.370 INFO:teuthology.orchestra.run.smithi045.stdout: "rss": 124920, 2024-05-10T03:43:53.370 INFO:teuthology.orchestra.run.smithi045.stdout: "heap": 207252 2024-05-10T03:43:53.370 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.370 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_server": { 2024-05-10T03:43:53.370 INFO:teuthology.orchestra.run.smithi045.stdout: "dispatch_client_request": 0, 2024-05-10T03:43:53.370 INFO:teuthology.orchestra.run.smithi045.stdout: "dispatch_server_request": 0, 2024-05-10T03:43:53.370 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_request": 0, 2024-05-10T03:43:53.370 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_client_session": 0, 2024-05-10T03:43:53.371 INFO:teuthology.orchestra.run.smithi045.stdout: "handle_peer_request": 0, 2024-05-10T03:43:53.371 INFO:teuthology.orchestra.run.smithi045.stdout: "req_create_latency": { 2024-05-10T03:43:53.371 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.371 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.371 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.371 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.371 INFO:teuthology.orchestra.run.smithi045.stdout: "req_getattr_latency": { 2024-05-10T03:43:53.371 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.371 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.371 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.371 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.371 INFO:teuthology.orchestra.run.smithi045.stdout: "req_getfilelock_latency": { 2024-05-10T03:43:53.372 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.372 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.372 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.372 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.372 INFO:teuthology.orchestra.run.smithi045.stdout: "req_link_latency": { 2024-05-10T03:43:53.373 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.373 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.373 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.373 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.373 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookup_latency": { 2024-05-10T03:43:53.373 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.373 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.373 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.373 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.373 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookuphash_latency": { 2024-05-10T03:43:53.373 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.374 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.374 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.374 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.374 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupino_latency": { 2024-05-10T03:43:53.374 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.374 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.374 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.374 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.374 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupname_latency": { 2024-05-10T03:43:53.374 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.375 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.375 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.375 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.375 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupparent_latency": { 2024-05-10T03:43:53.375 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.375 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.375 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.375 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.375 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lookupsnap_latency": { 2024-05-10T03:43:53.375 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.375 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.375 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.375 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.375 INFO:teuthology.orchestra.run.smithi045.stdout: "req_lssnap_latency": { 2024-05-10T03:43:53.376 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.376 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.376 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.376 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.376 INFO:teuthology.orchestra.run.smithi045.stdout: "req_mkdir_latency": { 2024-05-10T03:43:53.376 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.376 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.376 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.376 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.376 INFO:teuthology.orchestra.run.smithi045.stdout: "req_mknod_latency": { 2024-05-10T03:43:53.376 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.376 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.376 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.376 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.377 INFO:teuthology.orchestra.run.smithi045.stdout: "req_mksnap_latency": { 2024-05-10T03:43:53.377 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.377 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.377 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.377 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.377 INFO:teuthology.orchestra.run.smithi045.stdout: "req_open_latency": { 2024-05-10T03:43:53.377 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.377 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.377 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.377 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.377 INFO:teuthology.orchestra.run.smithi045.stdout: "req_readdir_latency": { 2024-05-10T03:43:53.377 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.377 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.377 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.377 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.378 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rename_latency": { 2024-05-10T03:43:53.378 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.378 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.378 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.378 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.378 INFO:teuthology.orchestra.run.smithi045.stdout: "req_renamesnap_latency": { 2024-05-10T03:43:53.378 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.379 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.379 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.379 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.379 INFO:teuthology.orchestra.run.smithi045.stdout: "req_snapdiff_latency": { 2024-05-10T03:43:53.379 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.379 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.379 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.379 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.379 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rmdir_latency": { 2024-05-10T03:43:53.379 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.379 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.379 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.380 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.380 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rmsnap_latency": { 2024-05-10T03:43:53.380 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.380 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.380 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.380 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.380 INFO:teuthology.orchestra.run.smithi045.stdout: "req_rmxattr_latency": { 2024-05-10T03:43:53.380 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.380 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.380 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.380 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.380 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setattr_latency": { 2024-05-10T03:43:53.380 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.381 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.381 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.381 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.381 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setdirlayout_latency": { 2024-05-10T03:43:53.381 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.381 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.381 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.381 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.381 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setfilelock_latency": { 2024-05-10T03:43:53.381 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.381 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.381 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.381 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.381 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setlayout_latency": { 2024-05-10T03:43:53.382 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.382 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.382 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.382 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.382 INFO:teuthology.orchestra.run.smithi045.stdout: "req_setxattr_latency": { 2024-05-10T03:43:53.382 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.382 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.382 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.382 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.382 INFO:teuthology.orchestra.run.smithi045.stdout: "req_symlink_latency": { 2024-05-10T03:43:53.382 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.382 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.382 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.382 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.383 INFO:teuthology.orchestra.run.smithi045.stdout: "req_unlink_latency": { 2024-05-10T03:43:53.383 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.383 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.383 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.383 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.383 INFO:teuthology.orchestra.run.smithi045.stdout: "cap_revoke_eviction": 0, 2024-05-10T03:43:53.383 INFO:teuthology.orchestra.run.smithi045.stdout: "cap_acquisition_throttle": 0, 2024-05-10T03:43:53.383 INFO:teuthology.orchestra.run.smithi045.stdout: "req_getvxattr_latency": { 2024-05-10T03:43:53.383 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.383 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.383 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.383 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:53.383 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.383 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_sessions": { 2024-05-10T03:43:53.383 INFO:teuthology.orchestra.run.smithi045.stdout: "session_count": 1, 2024-05-10T03:43:53.384 INFO:teuthology.orchestra.run.smithi045.stdout: "session_add": 1, 2024-05-10T03:43:53.384 INFO:teuthology.orchestra.run.smithi045.stdout: "session_remove": 0, 2024-05-10T03:43:53.384 INFO:teuthology.orchestra.run.smithi045.stdout: "sessions_open": 1, 2024-05-10T03:43:53.384 INFO:teuthology.orchestra.run.smithi045.stdout: "sessions_stale": 0, 2024-05-10T03:43:53.384 INFO:teuthology.orchestra.run.smithi045.stdout: "total_load": 0, 2024-05-10T03:43:53.384 INFO:teuthology.orchestra.run.smithi045.stdout: "average_load": 0, 2024-05-10T03:43:53.384 INFO:teuthology.orchestra.run.smithi045.stdout: "avg_session_uptime": 1727, 2024-05-10T03:43:53.384 INFO:teuthology.orchestra.run.smithi045.stdout: "mdthresh_evicted": 0 2024-05-10T03:43:53.384 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.384 INFO:teuthology.orchestra.run.smithi045.stdout: "mempool": { 2024-05-10T03:43:53.384 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_bytes": 0, 2024-05-10T03:43:53.384 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_items": 0, 2024-05-10T03:43:53.384 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_bytes": 0, 2024-05-10T03:43:53.384 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_items": 0, 2024-05-10T03:43:53.385 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_bytes": 0, 2024-05-10T03:43:53.385 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_items": 0, 2024-05-10T03:43:53.385 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-10T03:43:53.385 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_items": 0, 2024-05-10T03:43:53.385 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-10T03:43:53.385 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_items": 0, 2024-05-10T03:43:53.385 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_bytes": 0, 2024-05-10T03:43:53.385 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_items": 0, 2024-05-10T03:43:53.385 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-10T03:43:53.385 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_items": 0, 2024-05-10T03:43:53.385 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_bytes": 0, 2024-05-10T03:43:53.385 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_items": 0, 2024-05-10T03:43:53.386 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_bytes": 0, 2024-05-10T03:43:53.386 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_items": 0, 2024-05-10T03:43:53.386 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-10T03:43:53.386 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_items": 0, 2024-05-10T03:43:53.386 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-10T03:43:53.386 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_items": 0, 2024-05-10T03:43:53.386 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_bytes": 0, 2024-05-10T03:43:53.386 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_items": 0, 2024-05-10T03:43:53.386 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_bytes": 0, 2024-05-10T03:43:53.386 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_items": 0, 2024-05-10T03:43:53.386 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-10T03:43:53.386 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_items": 0, 2024-05-10T03:43:53.386 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_bytes": 0, 2024-05-10T03:43:53.386 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_items": 0, 2024-05-10T03:43:53.387 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_bytes": 0, 2024-05-10T03:43:53.387 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_items": 0, 2024-05-10T03:43:53.387 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_bytes": 0, 2024-05-10T03:43:53.387 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_items": 0, 2024-05-10T03:43:53.387 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_bytes": 0, 2024-05-10T03:43:53.387 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_items": 0, 2024-05-10T03:43:53.387 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_bytes": 213615, 2024-05-10T03:43:53.387 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_items": 64, 2024-05-10T03:43:53.387 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_bytes": 0, 2024-05-10T03:43:53.387 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_items": 0, 2024-05-10T03:43:53.387 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_bytes": 0, 2024-05-10T03:43:53.387 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_items": 0, 2024-05-10T03:43:53.387 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_bytes": 0, 2024-05-10T03:43:53.387 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_items": 0, 2024-05-10T03:43:53.387 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_bytes": 0, 2024-05-10T03:43:53.388 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_items": 0, 2024-05-10T03:43:53.388 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_bytes": 9176, 2024-05-10T03:43:53.388 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_items": 176, 2024-05-10T03:43:53.388 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_bytes": 0, 2024-05-10T03:43:53.388 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_items": 0, 2024-05-10T03:43:53.388 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_bytes": 0, 2024-05-10T03:43:53.388 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_items": 0, 2024-05-10T03:43:53.388 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_bytes": 3108732, 2024-05-10T03:43:53.388 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_items": 18314, 2024-05-10T03:43:53.388 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_bytes": 0, 2024-05-10T03:43:53.388 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_items": 0, 2024-05-10T03:43:53.388 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_bytes": 0, 2024-05-10T03:43:53.388 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_items": 0 2024-05-10T03:43:53.388 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.389 INFO:teuthology.orchestra.run.smithi045.stdout: "objecter": { 2024-05-10T03:43:53.389 INFO:teuthology.orchestra.run.smithi045.stdout: "op_active": 0, 2024-05-10T03:43:53.389 INFO:teuthology.orchestra.run.smithi045.stdout: "op_laggy": 0, 2024-05-10T03:43:53.389 INFO:teuthology.orchestra.run.smithi045.stdout: "op_send": 729, 2024-05-10T03:43:53.389 INFO:teuthology.orchestra.run.smithi045.stdout: "op_send_bytes": 21, 2024-05-10T03:43:53.389 INFO:teuthology.orchestra.run.smithi045.stdout: "op_resend": 3, 2024-05-10T03:43:53.389 INFO:teuthology.orchestra.run.smithi045.stdout: "op_reply": 729, 2024-05-10T03:43:53.389 INFO:teuthology.orchestra.run.smithi045.stdout: "op_latency": { 2024-05-10T03:43:53.389 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 729, 2024-05-10T03:43:53.389 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 1.540975981, 2024-05-10T03:43:53.389 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.002113821 2024-05-10T03:43:53.389 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.389 INFO:teuthology.orchestra.run.smithi045.stdout: "op_inflight": 0, 2024-05-10T03:43:53.389 INFO:teuthology.orchestra.run.smithi045.stdout: "oplen_avg": { 2024-05-10T03:43:53.390 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 729, 2024-05-10T03:43:53.390 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 730 2024-05-10T03:43:53.390 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.390 INFO:teuthology.orchestra.run.smithi045.stdout: "op": 729, 2024-05-10T03:43:53.390 INFO:teuthology.orchestra.run.smithi045.stdout: "op_r": 729, 2024-05-10T03:43:53.390 INFO:teuthology.orchestra.run.smithi045.stdout: "op_w": 0, 2024-05-10T03:43:53.390 INFO:teuthology.orchestra.run.smithi045.stdout: "op_rmw": 0, 2024-05-10T03:43:53.390 INFO:teuthology.orchestra.run.smithi045.stdout: "op_pg": 0, 2024-05-10T03:43:53.390 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_stat": 382, 2024-05-10T03:43:53.390 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_create": 0, 2024-05-10T03:43:53.390 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_read": 345, 2024-05-10T03:43:53.390 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_write": 0, 2024-05-10T03:43:53.390 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_writefull": 0, 2024-05-10T03:43:53.390 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_writesame": 0, 2024-05-10T03:43:53.390 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_append": 0, 2024-05-10T03:43:53.391 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_zero": 0, 2024-05-10T03:43:53.391 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_truncate": 0, 2024-05-10T03:43:53.391 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_delete": 0, 2024-05-10T03:43:53.391 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_mapext": 0, 2024-05-10T03:43:53.391 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_sparse_read": 0, 2024-05-10T03:43:53.391 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_clonerange": 0, 2024-05-10T03:43:53.391 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_getxattr": 1, 2024-05-10T03:43:53.391 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_setxattr": 0, 2024-05-10T03:43:53.391 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_cmpxattr": 0, 2024-05-10T03:43:53.391 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_rmxattr": 0, 2024-05-10T03:43:53.391 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_resetxattrs": 0, 2024-05-10T03:43:53.391 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_call": 0, 2024-05-10T03:43:53.391 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_watch": 0, 2024-05-10T03:43:53.391 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_notify": 0, 2024-05-10T03:43:53.392 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_src_cmpxattr": 0, 2024-05-10T03:43:53.392 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_pgls": 0, 2024-05-10T03:43:53.392 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_pgls_filter": 0, 2024-05-10T03:43:53.392 INFO:teuthology.orchestra.run.smithi045.stdout: "osdop_other": 0, 2024-05-10T03:43:53.392 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_active": 0, 2024-05-10T03:43:53.392 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_send": 0, 2024-05-10T03:43:53.392 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_resend": 0, 2024-05-10T03:43:53.392 INFO:teuthology.orchestra.run.smithi045.stdout: "linger_ping": 0, 2024-05-10T03:43:53.392 INFO:teuthology.orchestra.run.smithi045.stdout: "poolop_active": 0, 2024-05-10T03:43:53.392 INFO:teuthology.orchestra.run.smithi045.stdout: "poolop_send": 0, 2024-05-10T03:43:53.392 INFO:teuthology.orchestra.run.smithi045.stdout: "poolop_resend": 0, 2024-05-10T03:43:53.392 INFO:teuthology.orchestra.run.smithi045.stdout: "poolstat_active": 0, 2024-05-10T03:43:53.392 INFO:teuthology.orchestra.run.smithi045.stdout: "poolstat_send": 0, 2024-05-10T03:43:53.392 INFO:teuthology.orchestra.run.smithi045.stdout: "poolstat_resend": 0, 2024-05-10T03:43:53.392 INFO:teuthology.orchestra.run.smithi045.stdout: "statfs_active": 0, 2024-05-10T03:43:53.393 INFO:teuthology.orchestra.run.smithi045.stdout: "statfs_send": 0, 2024-05-10T03:43:53.393 INFO:teuthology.orchestra.run.smithi045.stdout: "statfs_resend": 0, 2024-05-10T03:43:53.393 INFO:teuthology.orchestra.run.smithi045.stdout: "command_active": 0, 2024-05-10T03:43:53.393 INFO:teuthology.orchestra.run.smithi045.stdout: "command_send": 0, 2024-05-10T03:43:53.393 INFO:teuthology.orchestra.run.smithi045.stdout: "command_resend": 0, 2024-05-10T03:43:53.393 INFO:teuthology.orchestra.run.smithi045.stdout: "map_epoch": 90, 2024-05-10T03:43:53.393 INFO:teuthology.orchestra.run.smithi045.stdout: "map_full": 0, 2024-05-10T03:43:53.393 INFO:teuthology.orchestra.run.smithi045.stdout: "map_inc": 4, 2024-05-10T03:43:53.393 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_sessions": 8, 2024-05-10T03:43:53.393 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_session_open": 8, 2024-05-10T03:43:53.393 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_session_close": 0, 2024-05-10T03:43:53.393 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_laggy": 0, 2024-05-10T03:43:53.393 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_wr": 0, 2024-05-10T03:43:53.393 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_rd": 2, 2024-05-10T03:43:53.394 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_del": 0 2024-05-10T03:43:53.394 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.394 INFO:teuthology.orchestra.run.smithi045.stdout: "oft": { 2024-05-10T03:43:53.394 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_objs": 0, 2024-05-10T03:43:53.394 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_kv_pairs": 0, 2024-05-10T03:43:53.394 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_updates": 0, 2024-05-10T03:43:53.394 INFO:teuthology.orchestra.run.smithi045.stdout: "omap_total_removes": 0 2024-05-10T03:43:53.394 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.394 INFO:teuthology.orchestra.run.smithi045.stdout: "osd-slow-ops": { 2024-05-10T03:43:53.394 INFO:teuthology.orchestra.run.smithi045.stdout: "slow_ops_count": 0 2024-05-10T03:43:53.394 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.394 INFO:teuthology.orchestra.run.smithi045.stdout: "purge_queue": { 2024-05-10T03:43:53.394 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing_ops": 0, 2024-05-10T03:43:53.394 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing_ops_high_water": 0, 2024-05-10T03:43:53.394 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing": 0, 2024-05-10T03:43:53.395 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executing_high_water": 0, 2024-05-10T03:43:53.395 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_executed": 0, 2024-05-10T03:43:53.395 INFO:teuthology.orchestra.run.smithi045.stdout: "pq_item_in_journal": 0 2024-05-10T03:43:53.395 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.395 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-10T03:43:53.395 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-05-10T03:43:53.395 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 104857600, 2024-05-10T03:43:53.395 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-05-10T03:43:53.395 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 846, 2024-05-10T03:43:53.395 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 31945390, 2024-05-10T03:43:53.396 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:53.396 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 846, 2024-05-10T03:43:53.396 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2024-05-10T03:43:53.396 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2024-05-10T03:43:53.396 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 846, 2024-05-10T03:43:53.396 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 31945390, 2024-05-10T03:43:53.396 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-05-10T03:43:53.396 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.396 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.396 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.396 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:53.397 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.397 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-objecter_bytes": { 2024-05-10T03:43:53.397 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-05-10T03:43:53.397 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 104857600, 2024-05-10T03:43:53.397 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-05-10T03:43:53.397 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 0, 2024-05-10T03:43:53.397 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 0, 2024-05-10T03:43:53.397 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:53.397 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 0, 2024-05-10T03:43:53.398 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 729, 2024-05-10T03:43:53.398 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 31277237, 2024-05-10T03:43:53.398 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 729, 2024-05-10T03:43:53.398 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 31277237, 2024-05-10T03:43:53.398 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-05-10T03:43:53.398 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.398 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.398 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.398 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:53.398 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.398 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-objecter_ops": { 2024-05-10T03:43:53.398 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-05-10T03:43:53.399 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 1024, 2024-05-10T03:43:53.399 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-05-10T03:43:53.399 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 0, 2024-05-10T03:43:53.399 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 0, 2024-05-10T03:43:53.399 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:53.399 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 0, 2024-05-10T03:43:53.399 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 729, 2024-05-10T03:43:53.399 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 729, 2024-05-10T03:43:53.399 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 729, 2024-05-10T03:43:53.399 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 729, 2024-05-10T03:43:53.400 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-05-10T03:43:53.400 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.400 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.400 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.400 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:53.400 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.400 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-write_buf_throttle": { 2024-05-10T03:43:53.400 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-05-10T03:43:53.400 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 3758096384, 2024-05-10T03:43:53.400 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-05-10T03:43:53.400 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 0, 2024-05-10T03:43:53.401 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 0, 2024-05-10T03:43:53.401 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:53.401 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 0, 2024-05-10T03:43:53.401 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2024-05-10T03:43:53.401 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2024-05-10T03:43:53.401 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 0, 2024-05-10T03:43:53.401 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 0, 2024-05-10T03:43:53.401 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-05-10T03:43:53.401 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.401 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.401 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.401 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:53.402 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:53.402 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-write_buf_throttle-0x5604c036a4e0": { 2024-05-10T03:43:53.402 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-05-10T03:43:53.402 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 3758096384, 2024-05-10T03:43:53.402 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-05-10T03:43:53.402 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 0, 2024-05-10T03:43:53.402 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 0, 2024-05-10T03:43:53.402 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:53.402 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 0, 2024-05-10T03:43:53.402 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2024-05-10T03:43:53.403 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2024-05-10T03:43:53.403 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 0, 2024-05-10T03:43:53.403 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 0, 2024-05-10T03:43:53.403 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-05-10T03:43:53.403 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:53.403 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:53.403 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:53.403 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:53.404 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:53.404 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:43:53.404 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:53 smithi045 ceph-mon[42520]: pgmap v393: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1007 KiB/s wr, 313 op/s 2024-05-10T03:43:53.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:53 smithi154 ceph-mon[46565]: pgmap v393: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1007 KiB/s wr, 313 op/s 2024-05-10T03:43:53.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:53 smithi106 ceph-mon[46996]: pgmap v393: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1007 KiB/s wr, 313 op/s 2024-05-10T03:43:53.739 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-05-10T03:43:53.739 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-05-10T03:43:53.739 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-05-10T03:43:53.739 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-05-10T03:43:53.739 DEBUG:tasks.check_counter:Getting stats from j 2024-05-10T03:43:53.740 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph daemon mds.j perf dump 2024-05-10T03:43:53.996 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T03:43:54.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:54 smithi154 ceph-mon[46565]: pgmap v394: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 519 KiB/s wr, 231 op/s 2024-05-10T03:43:54.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:54 smithi045 ceph-mon[42520]: pgmap v394: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 519 KiB/s wr, 231 op/s 2024-05-10T03:43:54.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:54 smithi106 ceph-mon[46996]: pgmap v394: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 519 KiB/s wr, 231 op/s 2024-05-10T03:43:55.164 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-10T03:43:55.164 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-0": { 2024-05-10T03:43:55.164 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 97, 2024-05-10T03:43:55.164 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 94, 2024-05-10T03:43:55.164 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 437008, 2024-05-10T03:43:55.164 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 52992, 2024-05-10T03:43:55.164 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 4, 2024-05-10T03:43:55.164 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 0, 2024-05-10T03:43:55.164 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.020639194, 2024-05-10T03:43:55.165 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.005828107, 2024-05-10T03:43:55.165 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.014790350, 2024-05-10T03:43:55.165 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.002069492, 2024-05-10T03:43:55.165 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:43:55.165 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 93, 2024-05-10T03:43:55.165 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.005249086, 2024-05-10T03:43:55.165 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000056441 2024-05-10T03:43:55.165 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:55.165 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:43:55.165 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:55.165 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:55.166 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:55.166 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:55.166 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 437008, 2024-05-10T03:43:55.166 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 52992 2024-05-10T03:43:55.166 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:55.166 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-1": { 2024-05-10T03:43:55.166 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 5, 2024-05-10T03:43:55.166 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 74, 2024-05-10T03:43:55.166 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 3200, 2024-05-10T03:43:55.166 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 89296, 2024-05-10T03:43:55.166 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 3, 2024-05-10T03:43:55.166 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 2, 2024-05-10T03:43:55.166 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.007767761, 2024-05-10T03:43:55.166 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.004520127, 2024-05-10T03:43:55.166 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.002480008, 2024-05-10T03:43:55.167 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-10T03:43:55.167 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:43:55.167 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 73, 2024-05-10T03:43:55.167 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.005064084, 2024-05-10T03:43:55.167 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000069371 2024-05-10T03:43:55.167 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:55.167 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:43:55.167 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:55.167 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:55.167 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:55.167 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:55.167 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-05-10T03:43:55.167 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 89296 2024-05-10T03:43:55.167 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:55.168 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-2": { 2024-05-10T03:43:55.168 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 0, 2024-05-10T03:43:55.168 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 2, 2024-05-10T03:43:55.168 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 0, 2024-05-10T03:43:55.168 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 0, 2024-05-10T03:43:55.168 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 2, 2024-05-10T03:43:55.168 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 1, 2024-05-10T03:43:55.168 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.001093980, 2024-05-10T03:43:55.168 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.000000000, 2024-05-10T03:43:55.168 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.000981983, 2024-05-10T03:43:55.169 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-10T03:43:55.169 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:43:55.169 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:55.169 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:55.169 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:55.169 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:55.169 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:43:55.169 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:55.169 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:55.169 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:55.169 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:55.169 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-10T03:43:55.169 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 0 2024-05-10T03:43:55.169 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:55.170 INFO:teuthology.orchestra.run.smithi045.stdout: "cct": { 2024-05-10T03:43:55.170 INFO:teuthology.orchestra.run.smithi045.stdout: "total_workers": 0, 2024-05-10T03:43:55.170 INFO:teuthology.orchestra.run.smithi045.stdout: "unhealthy_workers": 0 2024-05-10T03:43:55.170 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:55.170 INFO:teuthology.orchestra.run.smithi045.stdout: "mempool": { 2024-05-10T03:43:55.170 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_bytes": 0, 2024-05-10T03:43:55.170 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_items": 0, 2024-05-10T03:43:55.170 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_bytes": 0, 2024-05-10T03:43:55.170 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_items": 0, 2024-05-10T03:43:55.170 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_bytes": 0, 2024-05-10T03:43:55.170 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_items": 0, 2024-05-10T03:43:55.170 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-10T03:43:55.170 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_items": 0, 2024-05-10T03:43:55.170 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-10T03:43:55.171 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_items": 0, 2024-05-10T03:43:55.171 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_bytes": 0, 2024-05-10T03:43:55.171 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_items": 0, 2024-05-10T03:43:55.171 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-10T03:43:55.171 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_items": 0, 2024-05-10T03:43:55.171 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_bytes": 0, 2024-05-10T03:43:55.171 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_items": 0, 2024-05-10T03:43:55.171 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_bytes": 0, 2024-05-10T03:43:55.171 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_items": 0, 2024-05-10T03:43:55.172 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-10T03:43:55.172 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_items": 0, 2024-05-10T03:43:55.172 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-10T03:43:55.172 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_items": 0, 2024-05-10T03:43:55.172 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_bytes": 0, 2024-05-10T03:43:55.172 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_items": 0, 2024-05-10T03:43:55.172 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_bytes": 0, 2024-05-10T03:43:55.172 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_items": 0, 2024-05-10T03:43:55.172 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-10T03:43:55.172 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_items": 0, 2024-05-10T03:43:55.172 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_bytes": 0, 2024-05-10T03:43:55.172 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_items": 0, 2024-05-10T03:43:55.172 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_bytes": 0, 2024-05-10T03:43:55.172 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_items": 0, 2024-05-10T03:43:55.172 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_bytes": 0, 2024-05-10T03:43:55.173 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_items": 0, 2024-05-10T03:43:55.173 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_bytes": 0, 2024-05-10T03:43:55.173 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_items": 0, 2024-05-10T03:43:55.173 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_bytes": 148840, 2024-05-10T03:43:55.173 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_items": 28, 2024-05-10T03:43:55.173 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_bytes": 0, 2024-05-10T03:43:55.173 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_items": 0, 2024-05-10T03:43:55.173 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_bytes": 0, 2024-05-10T03:43:55.173 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_items": 0, 2024-05-10T03:43:55.173 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_bytes": 0, 2024-05-10T03:43:55.173 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_items": 0, 2024-05-10T03:43:55.174 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_bytes": 0, 2024-05-10T03:43:55.174 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_items": 0, 2024-05-10T03:43:55.174 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_bytes": 0, 2024-05-10T03:43:55.174 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_items": 0, 2024-05-10T03:43:55.174 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_bytes": 0, 2024-05-10T03:43:55.174 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_items": 0, 2024-05-10T03:43:55.174 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_bytes": 0, 2024-05-10T03:43:55.174 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_items": 0, 2024-05-10T03:43:55.174 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_bytes": 928, 2024-05-10T03:43:55.174 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_items": 2, 2024-05-10T03:43:55.174 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_bytes": 0, 2024-05-10T03:43:55.174 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_items": 0, 2024-05-10T03:43:55.174 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_bytes": 0, 2024-05-10T03:43:55.174 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_items": 0 2024-05-10T03:43:55.175 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-05-10T03:43:55.175 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-10T03:43:55.175 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-05-10T03:43:55.175 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 104857600, 2024-05-10T03:43:55.175 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-05-10T03:43:55.175 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 98, 2024-05-10T03:43:55.175 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 423313, 2024-05-10T03:43:55.175 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:55.175 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 98, 2024-05-10T03:43:55.176 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2024-05-10T03:43:55.176 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2024-05-10T03:43:55.176 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 98, 2024-05-10T03:43:55.176 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 423313, 2024-05-10T03:43:55.176 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-05-10T03:43:55.176 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-05-10T03:43:55.176 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-05-10T03:43:55.176 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-05-10T03:43:55.176 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:55.176 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-05-10T03:43:55.176 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-10T03:43:55.597 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-05-10T03:43:55.597 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-05-10T03:43:55.597 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-05-10T03:43:55.597 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-05-10T03:43:55.597 DEBUG:tasks.check_counter:Getting stats from b 2024-05-10T03:43:55.597 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph daemon mds.b perf dump 2024-05-10T03:43:55.842 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.b/config 2024-05-10T03:43:56.888 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-10T03:43:56.888 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-0": { 2024-05-10T03:43:56.888 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 3027, 2024-05-10T03:43:56.888 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 3096, 2024-05-10T03:43:56.889 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 990490, 2024-05-10T03:43:56.889 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 14533742, 2024-05-10T03:43:56.889 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 80, 2024-05-10T03:43:56.889 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 7, 2024-05-10T03:43:56.889 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 0.249689548, 2024-05-10T03:43:56.889 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.079439369, 2024-05-10T03:43:56.889 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.091256268, 2024-05-10T03:43:56.889 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.066281257, 2024-05-10T03:43:56.889 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:43:56.889 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 3094, 2024-05-10T03:43:56.889 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 2.127429296, 2024-05-10T03:43:56.889 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000687598 2024-05-10T03:43:56.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.889 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:43:56.890 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 1660, 2024-05-10T03:43:56.890 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000387942, 2024-05-10T03:43:56.890 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000233 2024-05-10T03:43:56.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.890 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 87712, 2024-05-10T03:43:56.890 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 35024 2024-05-10T03:43:56.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.890 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-1": { 2024-05-10T03:43:56.890 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 17957, 2024-05-10T03:43:56.890 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 10772, 2024-05-10T03:43:56.890 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 7108626, 2024-05-10T03:43:56.890 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 12365839, 2024-05-10T03:43:56.890 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 9, 2024-05-10T03:43:56.891 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 5, 2024-05-10T03:43:56.891 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 0.874785411, 2024-05-10T03:43:56.891 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.339302368, 2024-05-10T03:43:56.891 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.656368630, 2024-05-10T03:43:56.891 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.046412569, 2024-05-10T03:43:56.891 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:43:56.891 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 10775, 2024-05-10T03:43:56.891 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 4.219434813, 2024-05-10T03:43:56.891 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000391594 2024-05-10T03:43:56.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.891 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:43:56.891 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 24665, 2024-05-10T03:43:56.891 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.004108114, 2024-05-10T03:43:56.891 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000166 2024-05-10T03:43:56.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.892 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-05-10T03:43:56.892 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 200384 2024-05-10T03:43:56.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.892 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-2": { 2024-05-10T03:43:56.892 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 12204, 2024-05-10T03:43:56.892 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 27851, 2024-05-10T03:43:56.892 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 4919703, 2024-05-10T03:43:56.892 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 18176288, 2024-05-10T03:43:56.892 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 19, 2024-05-10T03:43:56.892 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 9, 2024-05-10T03:43:56.892 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 1.021175411, 2024-05-10T03:43:56.892 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.456789168, 2024-05-10T03:43:56.892 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.627499677, 2024-05-10T03:43:56.893 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.070512299, 2024-05-10T03:43:56.893 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:43:56.893 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 27846, 2024-05-10T03:43:56.893 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 3.486929044, 2024-05-10T03:43:56.893 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000125221 2024-05-10T03:43:56.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.893 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:43:56.893 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 32266, 2024-05-10T03:43:56.893 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.005505729, 2024-05-10T03:43:56.893 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000170 2024-05-10T03:43:56.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.893 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 3978448, 2024-05-10T03:43:56.893 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 12234160 2024-05-10T03:43:56.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.894 INFO:teuthology.orchestra.run.smithi106.stdout: "cct": { 2024-05-10T03:43:56.894 INFO:teuthology.orchestra.run.smithi106.stdout: "total_workers": 1, 2024-05-10T03:43:56.894 INFO:teuthology.orchestra.run.smithi106.stdout: "unhealthy_workers": 0 2024-05-10T03:43:56.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.894 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-MDSRank": { 2024-05-10T03:43:56.894 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2024-05-10T03:43:56.894 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2024-05-10T03:43:56.894 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 1314, 2024-05-10T03:43:56.894 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 4.719861070, 2024-05-10T03:43:56.894 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.003591979 2024-05-10T03:43:56.894 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:56.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.894 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-PurgeQueue": { 2024-05-10T03:43:56.894 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2024-05-10T03:43:56.895 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2024-05-10T03:43:56.895 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 1303, 2024-05-10T03:43:56.895 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.158451316, 2024-05-10T03:43:56.895 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000121605 2024-05-10T03:43:56.895 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:56.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.895 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": { 2024-05-10T03:43:56.895 INFO:teuthology.orchestra.run.smithi106.stdout: "request": 6087, 2024-05-10T03:43:56.895 INFO:teuthology.orchestra.run.smithi106.stdout: "reply": 6019, 2024-05-10T03:43:56.895 INFO:teuthology.orchestra.run.smithi106.stdout: "reply_latency": { 2024-05-10T03:43:56.895 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 6019, 2024-05-10T03:43:56.895 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 18.382667100, 2024-05-10T03:43:56.895 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.003054106 2024-05-10T03:43:56.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.896 INFO:teuthology.orchestra.run.smithi106.stdout: "slow_reply": 0, 2024-05-10T03:43:56.896 INFO:teuthology.orchestra.run.smithi106.stdout: "forward": 68, 2024-05-10T03:43:56.896 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_fetch_complete": 4, 2024-05-10T03:43:56.896 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_fetch_keys": 1, 2024-05-10T03:43:56.896 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_commit": 257, 2024-05-10T03:43:56.896 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_split": 6, 2024-05-10T03:43:56.896 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_merge": 0, 2024-05-10T03:43:56.896 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes": 247, 2024-05-10T03:43:56.896 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_top": 13, 2024-05-10T03:43:56.896 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_bottom": 224, 2024-05-10T03:43:56.896 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_pin_tail": 10, 2024-05-10T03:43:56.896 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_pinned": 228, 2024-05-10T03:43:56.896 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_expired": 5602, 2024-05-10T03:43:56.896 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_with_caps": 1, 2024-05-10T03:43:56.896 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": 1, 2024-05-10T03:43:56.897 INFO:teuthology.orchestra.run.smithi106.stdout: "subtrees": 5, 2024-05-10T03:43:56.897 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse": 7641, 2024-05-10T03:43:56.897 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_hit": 6881, 2024-05-10T03:43:56.897 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_forward": 51, 2024-05-10T03:43:56.897 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_discover": 549, 2024-05-10T03:43:56.897 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_dir_fetch": 0, 2024-05-10T03:43:56.897 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_remote_ino": 0, 2024-05-10T03:43:56.897 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_lock": 0, 2024-05-10T03:43:56.897 INFO:teuthology.orchestra.run.smithi106.stdout: "load_cent": 0, 2024-05-10T03:43:56.897 INFO:teuthology.orchestra.run.smithi106.stdout: "q": 0, 2024-05-10T03:43:56.897 INFO:teuthology.orchestra.run.smithi106.stdout: "exported": 195, 2024-05-10T03:43:56.897 INFO:teuthology.orchestra.run.smithi106.stdout: "exported_inodes": 4437, 2024-05-10T03:43:56.897 INFO:teuthology.orchestra.run.smithi106.stdout: "imported": 24, 2024-05-10T03:43:56.897 INFO:teuthology.orchestra.run.smithi106.stdout: "imported_inodes": 292, 2024-05-10T03:43:56.898 INFO:teuthology.orchestra.run.smithi106.stdout: "openino_dir_fetch": 0, 2024-05-10T03:43:56.898 INFO:teuthology.orchestra.run.smithi106.stdout: "openino_backtrace_fetch": 370, 2024-05-10T03:43:56.898 INFO:teuthology.orchestra.run.smithi106.stdout: "openino_peer_discover": 0, 2024-05-10T03:43:56.898 INFO:teuthology.orchestra.run.smithi106.stdout: "root_rfiles": 4, 2024-05-10T03:43:56.898 INFO:teuthology.orchestra.run.smithi106.stdout: "root_rbytes": 234, 2024-05-10T03:43:56.898 INFO:teuthology.orchestra.run.smithi106.stdout: "root_rsnaps": 0, 2024-05-10T03:43:56.898 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_backtrace_fetch": 370, 2024-05-10T03:43:56.898 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_set_tag": 0, 2024-05-10T03:43:56.898 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_backtrace_repaired": 0, 2024-05-10T03:43:56.898 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_inotable_repaired": 0, 2024-05-10T03:43:56.898 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_dir_inodes": 49, 2024-05-10T03:43:56.898 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_dir_base_inodes": 5, 2024-05-10T03:43:56.898 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_dirfrag_rstats": 44, 2024-05-10T03:43:56.898 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_file_inodes": 321, 2024-05-10T03:43:56.899 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_inode_file_caps": 12, 2024-05-10T03:43:56.899 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_revoke": 590, 2024-05-10T03:43:56.899 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_grant": 5408, 2024-05-10T03:43:56.899 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_trunc": 0, 2024-05-10T03:43:56.899 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-10T03:43:56.899 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-10T03:43:56.899 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_caps": 2585, 2024-05-10T03:43:56.899 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_caps_dirty": 2161, 2024-05-10T03:43:56.899 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_cap_release": 30, 2024-05-10T03:43:56.899 INFO:teuthology.orchestra.run.smithi106.stdout: "process_request_cap_release": 1195 2024-05-10T03:43:56.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.899 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_cache": { 2024-05-10T03:43:56.899 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_update": 112, 2024-05-10T03:43:56.899 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_update_receipt": 1693, 2024-05-10T03:43:56.900 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_try_discover": 1118, 2024-05-10T03:43:56.900 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_send_discover": 1151, 2024-05-10T03:43:56.900 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_handle_discover": 443, 2024-05-10T03:43:56.900 INFO:teuthology.orchestra.run.smithi106.stdout: "num_strays": 4, 2024-05-10T03:43:56.900 INFO:teuthology.orchestra.run.smithi106.stdout: "num_strays_delayed": 0, 2024-05-10T03:43:56.900 INFO:teuthology.orchestra.run.smithi106.stdout: "num_strays_enqueuing": 0, 2024-05-10T03:43:56.900 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_created": 642, 2024-05-10T03:43:56.900 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_enqueued": 638, 2024-05-10T03:43:56.900 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_reintegrated": 0, 2024-05-10T03:43:56.900 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_migrated": 0, 2024-05-10T03:43:56.900 INFO:teuthology.orchestra.run.smithi106.stdout: "num_recovering_processing": 0, 2024-05-10T03:43:56.900 INFO:teuthology.orchestra.run.smithi106.stdout: "num_recovering_enqueued": 0, 2024-05-10T03:43:56.900 INFO:teuthology.orchestra.run.smithi106.stdout: "num_recovering_prioritized": 0, 2024-05-10T03:43:56.900 INFO:teuthology.orchestra.run.smithi106.stdout: "recovery_started": 0, 2024-05-10T03:43:56.901 INFO:teuthology.orchestra.run.smithi106.stdout: "recovery_completed": 0, 2024-05-10T03:43:56.901 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_enqueue_scrub": 5, 2024-05-10T03:43:56.901 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_exportdir": 195, 2024-05-10T03:43:56.901 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_flush": 0, 2024-05-10T03:43:56.901 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_fragmentdir": 6, 2024-05-10T03:43:56.901 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_fragstats": 0, 2024-05-10T03:43:56.901 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_inodestats": 0 2024-05-10T03:43:56.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.901 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_log": { 2024-05-10T03:43:56.901 INFO:teuthology.orchestra.run.smithi106.stdout: "evadd": 8886, 2024-05-10T03:43:56.901 INFO:teuthology.orchestra.run.smithi106.stdout: "evex": 8863, 2024-05-10T03:43:56.901 INFO:teuthology.orchestra.run.smithi106.stdout: "evtrm": 8863, 2024-05-10T03:43:56.901 INFO:teuthology.orchestra.run.smithi106.stdout: "ev": 23, 2024-05-10T03:43:56.901 INFO:teuthology.orchestra.run.smithi106.stdout: "evexg": 0, 2024-05-10T03:43:56.901 INFO:teuthology.orchestra.run.smithi106.stdout: "evexd": 112, 2024-05-10T03:43:56.902 INFO:teuthology.orchestra.run.smithi106.stdout: "segadd": 24, 2024-05-10T03:43:56.902 INFO:teuthology.orchestra.run.smithi106.stdout: "segex": 23, 2024-05-10T03:43:56.902 INFO:teuthology.orchestra.run.smithi106.stdout: "segtrm": 23, 2024-05-10T03:43:56.902 INFO:teuthology.orchestra.run.smithi106.stdout: "seg": 2, 2024-05-10T03:43:56.902 INFO:teuthology.orchestra.run.smithi106.stdout: "segexg": 0, 2024-05-10T03:43:56.902 INFO:teuthology.orchestra.run.smithi106.stdout: "segexd": 1, 2024-05-10T03:43:56.902 INFO:teuthology.orchestra.run.smithi106.stdout: "expos": 24446218, 2024-05-10T03:43:56.902 INFO:teuthology.orchestra.run.smithi106.stdout: "wrpos": 24518079, 2024-05-10T03:43:56.902 INFO:teuthology.orchestra.run.smithi106.stdout: "rdpos": 0, 2024-05-10T03:43:56.902 INFO:teuthology.orchestra.run.smithi106.stdout: "jlat": { 2024-05-10T03:43:56.902 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 676, 2024-05-10T03:43:56.902 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 28.549831109, 2024-05-10T03:43:56.902 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.042233477 2024-05-10T03:43:56.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.903 INFO:teuthology.orchestra.run.smithi106.stdout: "replayed": 0 2024-05-10T03:43:56.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.903 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_mem": { 2024-05-10T03:43:56.903 INFO:teuthology.orchestra.run.smithi106.stdout: "ino": 38, 2024-05-10T03:43:56.903 INFO:teuthology.orchestra.run.smithi106.stdout: "ino+": 5650, 2024-05-10T03:43:56.903 INFO:teuthology.orchestra.run.smithi106.stdout: "ino-": 5612, 2024-05-10T03:43:56.903 INFO:teuthology.orchestra.run.smithi106.stdout: "dir": 43, 2024-05-10T03:43:56.903 INFO:teuthology.orchestra.run.smithi106.stdout: "dir+": 1071, 2024-05-10T03:43:56.903 INFO:teuthology.orchestra.run.smithi106.stdout: "dir-": 1028, 2024-05-10T03:43:56.903 INFO:teuthology.orchestra.run.smithi106.stdout: "dn": 247, 2024-05-10T03:43:56.903 INFO:teuthology.orchestra.run.smithi106.stdout: "dn+": 6828, 2024-05-10T03:43:56.903 INFO:teuthology.orchestra.run.smithi106.stdout: "dn-": 6581, 2024-05-10T03:43:56.903 INFO:teuthology.orchestra.run.smithi106.stdout: "cap": 1, 2024-05-10T03:43:56.903 INFO:teuthology.orchestra.run.smithi106.stdout: "cap+": 5098, 2024-05-10T03:43:56.903 INFO:teuthology.orchestra.run.smithi106.stdout: "cap-": 5097, 2024-05-10T03:43:56.904 INFO:teuthology.orchestra.run.smithi106.stdout: "rss": 151424, 2024-05-10T03:43:56.904 INFO:teuthology.orchestra.run.smithi106.stdout: "heap": 207252 2024-05-10T03:43:56.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.904 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_server": { 2024-05-10T03:43:56.904 INFO:teuthology.orchestra.run.smithi106.stdout: "dispatch_client_request": 6286, 2024-05-10T03:43:56.904 INFO:teuthology.orchestra.run.smithi106.stdout: "dispatch_server_request": 70, 2024-05-10T03:43:56.904 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_request": 6087, 2024-05-10T03:43:56.904 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_session": 199, 2024-05-10T03:43:56.904 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_peer_request": 198, 2024-05-10T03:43:56.904 INFO:teuthology.orchestra.run.smithi106.stdout: "req_create_latency": { 2024-05-10T03:43:56.904 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 4675, 2024-05-10T03:43:56.904 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 11.284140234, 2024-05-10T03:43:56.904 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.002413719 2024-05-10T03:43:56.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.905 INFO:teuthology.orchestra.run.smithi106.stdout: "req_getattr_latency": { 2024-05-10T03:43:56.905 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 202, 2024-05-10T03:43:56.905 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.066827004, 2024-05-10T03:43:56.905 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000330826 2024-05-10T03:43:56.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.905 INFO:teuthology.orchestra.run.smithi106.stdout: "req_getfilelock_latency": { 2024-05-10T03:43:56.905 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:56.905 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:56.905 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:56.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.905 INFO:teuthology.orchestra.run.smithi106.stdout: "req_link_latency": { 2024-05-10T03:43:56.905 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:56.905 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:56.905 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:56.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.906 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookup_latency": { 2024-05-10T03:43:56.906 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 90, 2024-05-10T03:43:56.906 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 4.863727704, 2024-05-10T03:43:56.906 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.054041418 2024-05-10T03:43:56.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.906 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookuphash_latency": { 2024-05-10T03:43:56.906 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:56.906 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:56.906 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:56.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.906 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupino_latency": { 2024-05-10T03:43:56.906 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:56.906 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:56.907 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:56.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.907 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupname_latency": { 2024-05-10T03:43:56.907 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:56.907 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:56.907 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:56.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.907 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupparent_latency": { 2024-05-10T03:43:56.907 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:56.907 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:56.907 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:56.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.907 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupsnap_latency": { 2024-05-10T03:43:56.907 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:56.908 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:56.908 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:56.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.908 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lssnap_latency": { 2024-05-10T03:43:56.908 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:56.908 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:56.908 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:56.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.908 INFO:teuthology.orchestra.run.smithi106.stdout: "req_mkdir_latency": { 2024-05-10T03:43:56.908 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 349, 2024-05-10T03:43:56.908 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.290192938, 2024-05-10T03:43:56.908 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000831498 2024-05-10T03:43:56.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.909 INFO:teuthology.orchestra.run.smithi106.stdout: "req_mknod_latency": { 2024-05-10T03:43:56.909 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:56.909 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:56.909 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:56.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.909 INFO:teuthology.orchestra.run.smithi106.stdout: "req_mksnap_latency": { 2024-05-10T03:43:56.909 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:56.909 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:56.909 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:56.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.909 INFO:teuthology.orchestra.run.smithi106.stdout: "req_open_latency": { 2024-05-10T03:43:56.909 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:56.909 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:56.909 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:56.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.910 INFO:teuthology.orchestra.run.smithi106.stdout: "req_readdir_latency": { 2024-05-10T03:43:56.910 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 45, 2024-05-10T03:43:56.910 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.056176862, 2024-05-10T03:43:56.910 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.001248374 2024-05-10T03:43:56.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.910 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rename_latency": { 2024-05-10T03:43:56.910 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 2, 2024-05-10T03:43:56.910 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.002528416, 2024-05-10T03:43:56.910 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.001264208 2024-05-10T03:43:56.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.910 INFO:teuthology.orchestra.run.smithi106.stdout: "req_renamesnap_latency": { 2024-05-10T03:43:56.910 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:56.910 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:56.911 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:56.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.911 INFO:teuthology.orchestra.run.smithi106.stdout: "req_snapdiff_latency": { 2024-05-10T03:43:56.911 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:56.911 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:56.911 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:56.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.911 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rmdir_latency": { 2024-05-10T03:43:56.911 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 12, 2024-05-10T03:43:56.911 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.366031455, 2024-05-10T03:43:56.911 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.030502621 2024-05-10T03:43:56.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.911 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rmsnap_latency": { 2024-05-10T03:43:56.911 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:56.911 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:56.912 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:56.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.912 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rmxattr_latency": { 2024-05-10T03:43:56.912 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:56.912 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:56.912 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:56.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.912 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setattr_latency": { 2024-05-10T03:43:56.912 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 5, 2024-05-10T03:43:56.912 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.539217352, 2024-05-10T03:43:56.912 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.107843470 2024-05-10T03:43:56.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.912 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setdirlayout_latency": { 2024-05-10T03:43:56.912 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:56.913 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:56.913 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:56.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.913 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setfilelock_latency": { 2024-05-10T03:43:56.913 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:56.913 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:56.913 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:56.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.913 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setlayout_latency": { 2024-05-10T03:43:56.913 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:56.913 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:56.913 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:56.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.913 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setxattr_latency": { 2024-05-10T03:43:56.914 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 9, 2024-05-10T03:43:56.914 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.025537440, 2024-05-10T03:43:56.914 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.002837493 2024-05-10T03:43:56.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.914 INFO:teuthology.orchestra.run.smithi106.stdout: "req_symlink_latency": { 2024-05-10T03:43:56.914 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:56.914 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:56.914 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:56.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.914 INFO:teuthology.orchestra.run.smithi106.stdout: "req_unlink_latency": { 2024-05-10T03:43:56.914 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 630, 2024-05-10T03:43:56.914 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.888287695, 2024-05-10T03:43:56.914 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.001409980 2024-05-10T03:43:56.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.915 INFO:teuthology.orchestra.run.smithi106.stdout: "cap_revoke_eviction": 0, 2024-05-10T03:43:56.915 INFO:teuthology.orchestra.run.smithi106.stdout: "cap_acquisition_throttle": 0, 2024-05-10T03:43:56.915 INFO:teuthology.orchestra.run.smithi106.stdout: "req_getvxattr_latency": { 2024-05-10T03:43:56.915 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:56.915 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:56.915 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:56.915 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:56.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.915 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_sessions": { 2024-05-10T03:43:56.915 INFO:teuthology.orchestra.run.smithi106.stdout: "session_count": 1, 2024-05-10T03:43:56.915 INFO:teuthology.orchestra.run.smithi106.stdout: "session_add": 3, 2024-05-10T03:43:56.915 INFO:teuthology.orchestra.run.smithi106.stdout: "session_remove": 2, 2024-05-10T03:43:56.915 INFO:teuthology.orchestra.run.smithi106.stdout: "sessions_open": 1, 2024-05-10T03:43:56.915 INFO:teuthology.orchestra.run.smithi106.stdout: "sessions_stale": 0, 2024-05-10T03:43:56.916 INFO:teuthology.orchestra.run.smithi106.stdout: "total_load": 4001, 2024-05-10T03:43:56.916 INFO:teuthology.orchestra.run.smithi106.stdout: "average_load": 4001, 2024-05-10T03:43:56.916 INFO:teuthology.orchestra.run.smithi106.stdout: "avg_session_uptime": 222, 2024-05-10T03:43:56.916 INFO:teuthology.orchestra.run.smithi106.stdout: "mdthresh_evicted": 0 2024-05-10T03:43:56.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.916 INFO:teuthology.orchestra.run.smithi106.stdout: "mempool": { 2024-05-10T03:43:56.916 INFO:teuthology.orchestra.run.smithi106.stdout: "bloom_filter_bytes": 360, 2024-05-10T03:43:56.916 INFO:teuthology.orchestra.run.smithi106.stdout: "bloom_filter_items": 360, 2024-05-10T03:43:56.916 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_alloc_bytes": 0, 2024-05-10T03:43:56.916 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_alloc_items": 0, 2024-05-10T03:43:56.916 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_data_bytes": 0, 2024-05-10T03:43:56.916 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_data_items": 0, 2024-05-10T03:43:56.916 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-10T03:43:56.916 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_onode_items": 0, 2024-05-10T03:43:56.917 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-10T03:43:56.917 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_meta_items": 0, 2024-05-10T03:43:56.917 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_other_bytes": 0, 2024-05-10T03:43:56.917 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_other_items": 0, 2024-05-10T03:43:56.917 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-10T03:43:56.917 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_buffer_items": 0, 2024-05-10T03:43:56.917 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_extent_bytes": 0, 2024-05-10T03:43:56.917 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_extent_items": 0, 2024-05-10T03:43:56.917 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_blob_bytes": 0, 2024-05-10T03:43:56.917 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_blob_items": 0, 2024-05-10T03:43:56.917 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-10T03:43:56.917 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_shared_blob_items": 0, 2024-05-10T03:43:56.917 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-10T03:43:56.917 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_inline_bl_items": 0, 2024-05-10T03:43:56.917 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_bytes": 0, 2024-05-10T03:43:56.918 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_items": 0, 2024-05-10T03:43:56.918 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_txc_bytes": 0, 2024-05-10T03:43:56.918 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_txc_items": 0, 2024-05-10T03:43:56.918 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-10T03:43:56.918 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_deferred_items": 0, 2024-05-10T03:43:56.918 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_bytes": 0, 2024-05-10T03:43:56.918 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_items": 0, 2024-05-10T03:43:56.918 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_bytes": 0, 2024-05-10T03:43:56.918 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_items": 0, 2024-05-10T03:43:56.918 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_reader_bytes": 0, 2024-05-10T03:43:56.918 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_reader_items": 0, 2024-05-10T03:43:56.918 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_writer_bytes": 0, 2024-05-10T03:43:56.918 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_writer_items": 0, 2024-05-10T03:43:56.919 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_anon_bytes": 299999, 2024-05-10T03:43:56.919 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_anon_items": 147, 2024-05-10T03:43:56.919 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_meta_bytes": 1760, 2024-05-10T03:43:56.919 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_meta_items": 20, 2024-05-10T03:43:56.919 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_bytes": 0, 2024-05-10T03:43:56.919 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_items": 0, 2024-05-10T03:43:56.919 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mapbl_bytes": 0, 2024-05-10T03:43:56.919 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mapbl_items": 0, 2024-05-10T03:43:56.919 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pglog_bytes": 0, 2024-05-10T03:43:56.919 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pglog_items": 0, 2024-05-10T03:43:56.919 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_bytes": 9176, 2024-05-10T03:43:56.919 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_items": 176, 2024-05-10T03:43:56.919 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_mapping_bytes": 0, 2024-05-10T03:43:56.919 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_mapping_items": 0, 2024-05-10T03:43:56.920 INFO:teuthology.orchestra.run.smithi106.stdout: "pgmap_bytes": 0, 2024-05-10T03:43:56.920 INFO:teuthology.orchestra.run.smithi106.stdout: "pgmap_items": 0, 2024-05-10T03:43:56.920 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_co_bytes": 329457, 2024-05-10T03:43:56.920 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_co_items": 3357, 2024-05-10T03:43:56.920 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_1_bytes": 0, 2024-05-10T03:43:56.920 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_1_items": 0, 2024-05-10T03:43:56.920 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_2_bytes": 0, 2024-05-10T03:43:56.920 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_2_items": 0 2024-05-10T03:43:56.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.920 INFO:teuthology.orchestra.run.smithi106.stdout: "objecter": { 2024-05-10T03:43:56.920 INFO:teuthology.orchestra.run.smithi106.stdout: "op_active": 0, 2024-05-10T03:43:56.920 INFO:teuthology.orchestra.run.smithi106.stdout: "op_laggy": 0, 2024-05-10T03:43:56.920 INFO:teuthology.orchestra.run.smithi106.stdout: "op_send": 6206, 2024-05-10T03:43:56.920 INFO:teuthology.orchestra.run.smithi106.stdout: "op_send_bytes": 23934510, 2024-05-10T03:43:56.921 INFO:teuthology.orchestra.run.smithi106.stdout: "op_resend": 37, 2024-05-10T03:43:56.921 INFO:teuthology.orchestra.run.smithi106.stdout: "op_reply": 6206, 2024-05-10T03:43:56.921 INFO:teuthology.orchestra.run.smithi106.stdout: "op_latency": { 2024-05-10T03:43:56.921 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 6206, 2024-05-10T03:43:56.921 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 344.117332649, 2024-05-10T03:43:56.921 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.055449135 2024-05-10T03:43:56.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.921 INFO:teuthology.orchestra.run.smithi106.stdout: "op_inflight": 0, 2024-05-10T03:43:56.921 INFO:teuthology.orchestra.run.smithi106.stdout: "oplen_avg": { 2024-05-10T03:43:56.921 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 6206, 2024-05-10T03:43:56.921 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 10938 2024-05-10T03:43:56.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.921 INFO:teuthology.orchestra.run.smithi106.stdout: "op": 6206, 2024-05-10T03:43:56.921 INFO:teuthology.orchestra.run.smithi106.stdout: "op_r": 416, 2024-05-10T03:43:56.922 INFO:teuthology.orchestra.run.smithi106.stdout: "op_w": 5790, 2024-05-10T03:43:56.922 INFO:teuthology.orchestra.run.smithi106.stdout: "op_rmw": 0, 2024-05-10T03:43:56.922 INFO:teuthology.orchestra.run.smithi106.stdout: "op_pg": 0, 2024-05-10T03:43:56.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_stat": 114, 2024-05-10T03:43:56.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_create": 2844, 2024-05-10T03:43:56.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_read": 36, 2024-05-10T03:43:56.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_write": 707, 2024-05-10T03:43:56.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_writefull": 76, 2024-05-10T03:43:56.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_writesame": 0, 2024-05-10T03:43:56.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_append": 0, 2024-05-10T03:43:56.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_zero": 0, 2024-05-10T03:43:56.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_truncate": 6, 2024-05-10T03:43:56.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_delete": 1854, 2024-05-10T03:43:56.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_mapext": 0, 2024-05-10T03:43:56.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_sparse_read": 0, 2024-05-10T03:43:56.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_clonerange": 0, 2024-05-10T03:43:56.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_getxattr": 380, 2024-05-10T03:43:56.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_setxattr": 4322, 2024-05-10T03:43:56.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_cmpxattr": 0, 2024-05-10T03:43:56.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_rmxattr": 0, 2024-05-10T03:43:56.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_resetxattrs": 0, 2024-05-10T03:43:56.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_call": 0, 2024-05-10T03:43:56.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_watch": 0, 2024-05-10T03:43:56.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_notify": 0, 2024-05-10T03:43:56.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_src_cmpxattr": 0, 2024-05-10T03:43:56.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_pgls": 0, 2024-05-10T03:43:56.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_pgls_filter": 0, 2024-05-10T03:43:56.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_other": 0, 2024-05-10T03:43:56.923 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_active": 0, 2024-05-10T03:43:56.924 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_send": 0, 2024-05-10T03:43:56.924 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_resend": 0, 2024-05-10T03:43:56.924 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_ping": 0, 2024-05-10T03:43:56.924 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_active": 0, 2024-05-10T03:43:56.924 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_send": 0, 2024-05-10T03:43:56.924 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_resend": 0, 2024-05-10T03:43:56.924 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_active": 0, 2024-05-10T03:43:56.924 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_send": 0, 2024-05-10T03:43:56.924 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_resend": 0, 2024-05-10T03:43:56.924 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_active": 0, 2024-05-10T03:43:56.924 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_send": 0, 2024-05-10T03:43:56.924 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_resend": 0, 2024-05-10T03:43:56.924 INFO:teuthology.orchestra.run.smithi106.stdout: "command_active": 0, 2024-05-10T03:43:56.924 INFO:teuthology.orchestra.run.smithi106.stdout: "command_send": 0, 2024-05-10T03:43:56.924 INFO:teuthology.orchestra.run.smithi106.stdout: "command_resend": 0, 2024-05-10T03:43:56.925 INFO:teuthology.orchestra.run.smithi106.stdout: "map_epoch": 90, 2024-05-10T03:43:56.925 INFO:teuthology.orchestra.run.smithi106.stdout: "map_full": 0, 2024-05-10T03:43:56.925 INFO:teuthology.orchestra.run.smithi106.stdout: "map_inc": 10, 2024-05-10T03:43:56.925 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_sessions": 12, 2024-05-10T03:43:56.925 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_session_open": 12, 2024-05-10T03:43:56.925 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_session_close": 0, 2024-05-10T03:43:56.925 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_laggy": 0, 2024-05-10T03:43:56.925 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_wr": 552, 2024-05-10T03:43:56.925 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_rd": 10, 2024-05-10T03:43:56.925 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_del": 37 2024-05-10T03:43:56.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.925 INFO:teuthology.orchestra.run.smithi106.stdout: "oft": { 2024-05-10T03:43:56.925 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_objs": 1, 2024-05-10T03:43:56.925 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_kv_pairs": 0, 2024-05-10T03:43:56.926 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_updates": 0, 2024-05-10T03:43:56.926 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_removes": 0 2024-05-10T03:43:56.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.926 INFO:teuthology.orchestra.run.smithi106.stdout: "osd-slow-ops": { 2024-05-10T03:43:56.926 INFO:teuthology.orchestra.run.smithi106.stdout: "slow_ops_count": 0 2024-05-10T03:43:56.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.926 INFO:teuthology.orchestra.run.smithi106.stdout: "purge_queue": { 2024-05-10T03:43:56.926 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing_ops": 0, 2024-05-10T03:43:56.926 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing_ops_high_water": 41, 2024-05-10T03:43:56.926 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing": 0, 2024-05-10T03:43:56.926 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing_high_water": 5, 2024-05-10T03:43:56.926 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executed": 638, 2024-05-10T03:43:56.926 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_item_in_journal": 0 2024-05-10T03:43:56.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.927 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-10T03:43:56.927 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-05-10T03:43:56.927 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2024-05-10T03:43:56.927 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-05-10T03:43:56.927 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 33184, 2024-05-10T03:43:56.927 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 9595599, 2024-05-10T03:43:56.927 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:56.927 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 33184, 2024-05-10T03:43:56.927 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2024-05-10T03:43:56.927 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2024-05-10T03:43:56.927 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 33184, 2024-05-10T03:43:56.927 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 9595599, 2024-05-10T03:43:56.927 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-05-10T03:43:56.928 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:56.928 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:56.928 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:56.928 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:56.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.928 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-objecter_bytes": { 2024-05-10T03:43:56.928 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-05-10T03:43:56.928 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2024-05-10T03:43:56.928 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-05-10T03:43:56.928 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2024-05-10T03:43:56.928 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2024-05-10T03:43:56.928 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:56.928 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2024-05-10T03:43:56.928 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 6206, 2024-05-10T03:43:56.929 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 24003936, 2024-05-10T03:43:56.929 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 6206, 2024-05-10T03:43:56.929 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 24003936, 2024-05-10T03:43:56.929 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-05-10T03:43:56.929 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:56.929 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:56.929 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:56.929 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:56.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.929 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-objecter_ops": { 2024-05-10T03:43:56.929 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-05-10T03:43:56.929 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 1024, 2024-05-10T03:43:56.929 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-05-10T03:43:56.929 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2024-05-10T03:43:56.930 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2024-05-10T03:43:56.930 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:56.930 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2024-05-10T03:43:56.930 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 6206, 2024-05-10T03:43:56.930 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 6206, 2024-05-10T03:43:56.930 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 6206, 2024-05-10T03:43:56.930 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 6206, 2024-05-10T03:43:56.930 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-05-10T03:43:56.930 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:56.930 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:56.930 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:56.930 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:56.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.930 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-write_buf_throttle": { 2024-05-10T03:43:56.931 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-05-10T03:43:56.931 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 3758096384, 2024-05-10T03:43:56.931 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-05-10T03:43:56.931 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 638, 2024-05-10T03:43:56.931 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 69494, 2024-05-10T03:43:56.931 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:56.931 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 638, 2024-05-10T03:43:56.931 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2024-05-10T03:43:56.931 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2024-05-10T03:43:56.931 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 31, 2024-05-10T03:43:56.931 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 69494, 2024-05-10T03:43:56.931 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-05-10T03:43:56.931 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:56.931 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:56.931 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:56.932 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:56.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:56.932 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-write_buf_throttle-0x558b9db4e4e0": { 2024-05-10T03:43:56.932 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-05-10T03:43:56.932 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 3758096384, 2024-05-10T03:43:56.932 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-05-10T03:43:56.932 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 8886, 2024-05-10T03:43:56.932 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 20323775, 2024-05-10T03:43:56.932 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:56.932 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 8886, 2024-05-10T03:43:56.932 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2024-05-10T03:43:56.932 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2024-05-10T03:43:56.932 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 676, 2024-05-10T03:43:56.932 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 20323775, 2024-05-10T03:43:56.932 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-05-10T03:43:56.933 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:56.933 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:56.933 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:56.933 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:56.933 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:56.933 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-10T03:43:57.257 INFO:tasks.check_counter:Daemon mds.b mds.exported=195 2024-05-10T03:43:57.257 INFO:tasks.check_counter:Daemon mds.b mds.imported=24 2024-05-10T03:43:57.257 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=112 2024-05-10T03:43:57.257 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=1693 2024-05-10T03:43:57.257 DEBUG:tasks.check_counter:Getting stats from e 2024-05-10T03:43:57.257 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph daemon mds.e perf dump 2024-05-10T03:43:57.286 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:57 smithi106 ceph-mon[46996]: pgmap v395: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 298 KiB/s wr, 178 op/s 2024-05-10T03:43:57.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:57 smithi154 ceph-mon[46565]: pgmap v395: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 298 KiB/s wr, 178 op/s 2024-05-10T03:43:57.479 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.b/config 2024-05-10T03:43:57.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:57 smithi045 ceph-mon[42520]: pgmap v395: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 298 KiB/s wr, 178 op/s 2024-05-10T03:43:58.430 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-10T03:43:58.430 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-0": { 2024-05-10T03:43:58.430 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 9934, 2024-05-10T03:43:58.430 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 16475, 2024-05-10T03:43:58.430 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 6514752, 2024-05-10T03:43:58.430 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 19052068, 2024-05-10T03:43:58.430 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 10, 2024-05-10T03:43:58.430 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 5, 2024-05-10T03:43:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 0.795220121, 2024-05-10T03:43:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.319918404, 2024-05-10T03:43:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.372761272, 2024-05-10T03:43:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.137088615, 2024-05-10T03:43:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:43:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 16473, 2024-05-10T03:43:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.904408173, 2024-05-10T03:43:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000054902 2024-05-10T03:43:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:43:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 20749, 2024-05-10T03:43:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.003599150, 2024-05-10T03:43:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000173 2024-05-10T03:43:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-10T03:43:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 0 2024-05-10T03:43:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-1": { 2024-05-10T03:43:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 16503, 2024-05-10T03:43:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 19233, 2024-05-10T03:43:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 5557788, 2024-05-10T03:43:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 13033677, 2024-05-10T03:43:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 22, 2024-05-10T03:43:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 6, 2024-05-10T03:43:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 0.978547021, 2024-05-10T03:43:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.337853808, 2024-05-10T03:43:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.564939144, 2024-05-10T03:43:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.157189001, 2024-05-10T03:43:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:43:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 19232, 2024-05-10T03:43:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 1.025120110, 2024-05-10T03:43:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000053302 2024-05-10T03:43:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:43:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 27580, 2024-05-10T03:43:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.004742479, 2024-05-10T03:43:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000171 2024-05-10T03:43:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-05-10T03:43:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 192464 2024-05-10T03:43:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-2": { 2024-05-10T03:43:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 12543, 2024-05-10T03:43:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 26146, 2024-05-10T03:43:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 4735408, 2024-05-10T03:43:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 26069850, 2024-05-10T03:43:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 9, 2024-05-10T03:43:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 8, 2024-05-10T03:43:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 1.030856950, 2024-05-10T03:43:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.440500763, 2024-05-10T03:43:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.839337688, 2024-05-10T03:43:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.152996611, 2024-05-10T03:43:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:43:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 26145, 2024-05-10T03:43:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 1.641685233, 2024-05-10T03:43:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000062791 2024-05-10T03:43:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:43:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 25290, 2024-05-10T03:43:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.004133248, 2024-05-10T03:43:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000163 2024-05-10T03:43:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 3918272, 2024-05-10T03:43:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 12083104 2024-05-10T03:43:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: "cct": { 2024-05-10T03:43:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: "total_workers": 1, 2024-05-10T03:43:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: "unhealthy_workers": 0 2024-05-10T03:43:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-MDSRank": { 2024-05-10T03:43:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2024-05-10T03:43:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2024-05-10T03:43:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 1343, 2024-05-10T03:43:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 5.712258489, 2024-05-10T03:43:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.004253357 2024-05-10T03:43:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-PurgeQueue": { 2024-05-10T03:43:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2024-05-10T03:43:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2024-05-10T03:43:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 7786, 2024-05-10T03:43:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 1.163007696, 2024-05-10T03:43:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000149371 2024-05-10T03:43:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": { 2024-05-10T03:43:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: "request": 5297, 2024-05-10T03:43:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: "reply": 5279, 2024-05-10T03:43:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: "reply_latency": { 2024-05-10T03:43:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 5279, 2024-05-10T03:43:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 11.545035282, 2024-05-10T03:43:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.002186973 2024-05-10T03:43:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: "slow_reply": 0, 2024-05-10T03:43:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: "forward": 18, 2024-05-10T03:43:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_fetch_complete": 0, 2024-05-10T03:43:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_fetch_keys": 0, 2024-05-10T03:43:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_commit": 29, 2024-05-10T03:43:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_split": 2, 2024-05-10T03:43:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_merge": 0, 2024-05-10T03:43:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes": 21, 2024-05-10T03:43:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_top": 4, 2024-05-10T03:43:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_bottom": 2, 2024-05-10T03:43:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_pin_tail": 15, 2024-05-10T03:43:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_pinned": 15, 2024-05-10T03:43:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_expired": 744, 2024-05-10T03:43:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_with_caps": 0, 2024-05-10T03:43:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": 0, 2024-05-10T03:43:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: "subtrees": 2, 2024-05-10T03:43:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse": 7037, 2024-05-10T03:43:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_hit": 6150, 2024-05-10T03:43:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_forward": 0, 2024-05-10T03:43:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_discover": 493, 2024-05-10T03:43:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_dir_fetch": 0, 2024-05-10T03:43:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_remote_ino": 0, 2024-05-10T03:43:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_lock": 0, 2024-05-10T03:43:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: "load_cent": 0, 2024-05-10T03:43:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: "q": 0, 2024-05-10T03:43:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: "exported": 23, 2024-05-10T03:43:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: "exported_inodes": 236, 2024-05-10T03:43:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: "imported": 181, 2024-05-10T03:43:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: "imported_inodes": 4041, 2024-05-10T03:43:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: "openino_dir_fetch": 0, 2024-05-10T03:43:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: "openino_backtrace_fetch": 185, 2024-05-10T03:43:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: "openino_peer_discover": 0, 2024-05-10T03:43:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: "root_rfiles": 434, 2024-05-10T03:43:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: "root_rbytes": 82823115, 2024-05-10T03:43:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: "root_rsnaps": 0, 2024-05-10T03:43:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_backtrace_fetch": 185, 2024-05-10T03:43:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_set_tag": 0, 2024-05-10T03:43:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_backtrace_repaired": 0, 2024-05-10T03:43:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_inotable_repaired": 0, 2024-05-10T03:43:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_dir_inodes": 2, 2024-05-10T03:43:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_dir_base_inodes": 0, 2024-05-10T03:43:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_dirfrag_rstats": 2, 2024-05-10T03:43:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_file_inodes": 183, 2024-05-10T03:43:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_inode_file_caps": 36, 2024-05-10T03:43:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_revoke": 606, 2024-05-10T03:43:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_grant": 5223, 2024-05-10T03:43:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_trunc": 0, 2024-05-10T03:43:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-10T03:43:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-10T03:43:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_caps": 3617, 2024-05-10T03:43:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_caps_dirty": 2987, 2024-05-10T03:43:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_cap_release": 54, 2024-05-10T03:43:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: "process_request_cap_release": 5277 2024-05-10T03:43:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_cache": { 2024-05-10T03:43:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_update": 1309, 2024-05-10T03:43:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_update_receipt": 1016, 2024-05-10T03:43:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_try_discover": 656, 2024-05-10T03:43:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_send_discover": 894, 2024-05-10T03:43:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_handle_discover": 2492, 2024-05-10T03:43:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: "num_strays": 4, 2024-05-10T03:43:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: "num_strays_delayed": 0, 2024-05-10T03:43:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: "num_strays_enqueuing": 0, 2024-05-10T03:43:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_created": 4244, 2024-05-10T03:43:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_enqueued": 4240, 2024-05-10T03:43:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_reintegrated": 0, 2024-05-10T03:43:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_migrated": 0, 2024-05-10T03:43:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: "num_recovering_processing": 0, 2024-05-10T03:43:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: "num_recovering_enqueued": 0, 2024-05-10T03:43:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: "num_recovering_prioritized": 0, 2024-05-10T03:43:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: "recovery_started": 0, 2024-05-10T03:43:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: "recovery_completed": 0, 2024-05-10T03:43:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_enqueue_scrub": 0, 2024-05-10T03:43:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_exportdir": 23, 2024-05-10T03:43:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_flush": 0, 2024-05-10T03:43:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_fragmentdir": 2, 2024-05-10T03:43:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_fragstats": 0, 2024-05-10T03:43:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_inodestats": 0 2024-05-10T03:43:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_log": { 2024-05-10T03:43:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "evadd": 15139, 2024-05-10T03:43:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "evex": 0, 2024-05-10T03:43:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "evtrm": 0, 2024-05-10T03:43:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "ev": 15139, 2024-05-10T03:43:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "evexg": 0, 2024-05-10T03:43:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "evexd": 0, 2024-05-10T03:43:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "segadd": 20, 2024-05-10T03:43:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "segex": 0, 2024-05-10T03:43:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "segtrm": 0, 2024-05-10T03:43:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "seg": 20, 2024-05-10T03:43:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "segexg": 0, 2024-05-10T03:43:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "segexd": 0, 2024-05-10T03:43:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "expos": 4194304, 2024-05-10T03:43:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "wrpos": 35471536, 2024-05-10T03:43:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "rdpos": 0, 2024-05-10T03:43:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "jlat": { 2024-05-10T03:43:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 653, 2024-05-10T03:43:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 4.319947516, 2024-05-10T03:43:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.006615539 2024-05-10T03:43:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: "replayed": 0 2024-05-10T03:43:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_mem": { 2024-05-10T03:43:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: "ino": 23, 2024-05-10T03:43:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: "ino+": 4595, 2024-05-10T03:43:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: "ino-": 4572, 2024-05-10T03:43:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: "dir": 25, 2024-05-10T03:43:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: "dir+": 784, 2024-05-10T03:43:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: "dir-": 759, 2024-05-10T03:43:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: "dn": 231, 2024-05-10T03:43:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: "dn+": 8937, 2024-05-10T03:43:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: "dn-": 8706, 2024-05-10T03:43:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: "cap": 0, 2024-05-10T03:43:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: "cap+": 4269, 2024-05-10T03:43:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: "cap-": 4269, 2024-05-10T03:43:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: "rss": 148040, 2024-05-10T03:43:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: "heap": 199060 2024-05-10T03:43:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_server": { 2024-05-10T03:43:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: "dispatch_client_request": 7377, 2024-05-10T03:43:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: "dispatch_server_request": 69, 2024-05-10T03:43:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_request": 5297, 2024-05-10T03:43:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_session": 3, 2024-05-10T03:43:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_peer_request": 355, 2024-05-10T03:43:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: "req_create_latency": { 2024-05-10T03:43:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 210, 2024-05-10T03:43:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.139389493, 2024-05-10T03:43:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000663759 2024-05-10T03:43:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: "req_getattr_latency": { 2024-05-10T03:43:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 15, 2024-05-10T03:43:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.028264350, 2024-05-10T03:43:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.001884290 2024-05-10T03:43:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: "req_getfilelock_latency": { 2024-05-10T03:43:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: "req_link_latency": { 2024-05-10T03:43:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookup_latency": { 2024-05-10T03:43:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 445, 2024-05-10T03:43:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.238790857, 2024-05-10T03:43:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000536608 2024-05-10T03:43:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookuphash_latency": { 2024-05-10T03:43:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupino_latency": { 2024-05-10T03:43:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupname_latency": { 2024-05-10T03:43:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupparent_latency": { 2024-05-10T03:43:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupsnap_latency": { 2024-05-10T03:43:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lssnap_latency": { 2024-05-10T03:43:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: "req_mkdir_latency": { 2024-05-10T03:43:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: "req_mknod_latency": { 2024-05-10T03:43:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: "req_mksnap_latency": { 2024-05-10T03:43:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: "req_open_latency": { 2024-05-10T03:43:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: "req_readdir_latency": { 2024-05-10T03:43:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 365, 2024-05-10T03:43:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.340622800, 2024-05-10T03:43:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000933213 2024-05-10T03:43:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rename_latency": { 2024-05-10T03:43:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: "req_renamesnap_latency": { 2024-05-10T03:43:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: "req_snapdiff_latency": { 2024-05-10T03:43:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rmdir_latency": { 2024-05-10T03:43:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 302, 2024-05-10T03:43:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 5.575893297, 2024-05-10T03:43:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.018463222 2024-05-10T03:43:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rmsnap_latency": { 2024-05-10T03:43:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rmxattr_latency": { 2024-05-10T03:43:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setattr_latency": { 2024-05-10T03:43:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setdirlayout_latency": { 2024-05-10T03:43:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setfilelock_latency": { 2024-05-10T03:43:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setlayout_latency": { 2024-05-10T03:43:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setxattr_latency": { 2024-05-10T03:43:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: "req_symlink_latency": { 2024-05-10T03:43:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: "req_unlink_latency": { 2024-05-10T03:43:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 3942, 2024-05-10T03:43:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 5.222074485, 2024-05-10T03:43:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.001324727 2024-05-10T03:43:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: "cap_revoke_eviction": 0, 2024-05-10T03:43:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: "cap_acquisition_throttle": 0, 2024-05-10T03:43:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: "req_getvxattr_latency": { 2024-05-10T03:43:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_sessions": { 2024-05-10T03:43:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: "session_count": 1, 2024-05-10T03:43:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: "session_add": 1, 2024-05-10T03:43:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: "session_remove": 0, 2024-05-10T03:43:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: "sessions_open": 1, 2024-05-10T03:43:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: "sessions_stale": 0, 2024-05-10T03:43:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: "total_load": 4604, 2024-05-10T03:43:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: "average_load": 4604, 2024-05-10T03:43:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: "avg_session_uptime": 1715, 2024-05-10T03:43:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: "mdthresh_evicted": 0 2024-05-10T03:43:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: "mempool": { 2024-05-10T03:43:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: "bloom_filter_bytes": 0, 2024-05-10T03:43:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: "bloom_filter_items": 0, 2024-05-10T03:43:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_alloc_bytes": 0, 2024-05-10T03:43:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_alloc_items": 0, 2024-05-10T03:43:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_data_bytes": 0, 2024-05-10T03:43:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_data_items": 0, 2024-05-10T03:43:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-10T03:43:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_onode_items": 0, 2024-05-10T03:43:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-10T03:43:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_meta_items": 0, 2024-05-10T03:43:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_other_bytes": 0, 2024-05-10T03:43:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_other_items": 0, 2024-05-10T03:43:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-10T03:43:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_buffer_items": 0, 2024-05-10T03:43:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_extent_bytes": 0, 2024-05-10T03:43:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_extent_items": 0, 2024-05-10T03:43:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_blob_bytes": 0, 2024-05-10T03:43:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_blob_items": 0, 2024-05-10T03:43:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-10T03:43:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_shared_blob_items": 0, 2024-05-10T03:43:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-10T03:43:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_inline_bl_items": 0, 2024-05-10T03:43:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_bytes": 0, 2024-05-10T03:43:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_items": 0, 2024-05-10T03:43:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_txc_bytes": 0, 2024-05-10T03:43:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_txc_items": 0, 2024-05-10T03:43:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-10T03:43:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_deferred_items": 0, 2024-05-10T03:43:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_bytes": 0, 2024-05-10T03:43:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_items": 0, 2024-05-10T03:43:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_bytes": 0, 2024-05-10T03:43:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_items": 0, 2024-05-10T03:43:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_reader_bytes": 0, 2024-05-10T03:43:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_reader_items": 0, 2024-05-10T03:43:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_writer_bytes": 0, 2024-05-10T03:43:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_writer_items": 0, 2024-05-10T03:43:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_anon_bytes": 284385, 2024-05-10T03:43:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_anon_items": 134, 2024-05-10T03:43:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_meta_bytes": 792, 2024-05-10T03:43:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_meta_items": 9, 2024-05-10T03:43:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_bytes": 0, 2024-05-10T03:43:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_items": 0, 2024-05-10T03:43:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mapbl_bytes": 0, 2024-05-10T03:43:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mapbl_items": 0, 2024-05-10T03:43:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pglog_bytes": 0, 2024-05-10T03:43:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pglog_items": 0, 2024-05-10T03:43:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_bytes": 9176, 2024-05-10T03:43:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_items": 176, 2024-05-10T03:43:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_mapping_bytes": 0, 2024-05-10T03:43:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_mapping_items": 0, 2024-05-10T03:43:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: "pgmap_bytes": 0, 2024-05-10T03:43:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: "pgmap_items": 0, 2024-05-10T03:43:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_co_bytes": 277246, 2024-05-10T03:43:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_co_items": 4711, 2024-05-10T03:43:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_1_bytes": 0, 2024-05-10T03:43:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_1_items": 0, 2024-05-10T03:43:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_2_bytes": 0, 2024-05-10T03:43:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_2_items": 0 2024-05-10T03:43:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "objecter": { 2024-05-10T03:43:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "op_active": 0, 2024-05-10T03:43:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "op_laggy": 0, 2024-05-10T03:43:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "op_send": 9497, 2024-05-10T03:43:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "op_send_bytes": 32435666, 2024-05-10T03:43:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "op_resend": 27, 2024-05-10T03:43:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "op_reply": 9497, 2024-05-10T03:43:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "op_latency": { 2024-05-10T03:43:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 9497, 2024-05-10T03:43:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 36.183823596, 2024-05-10T03:43:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.003810026 2024-05-10T03:43:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "op_inflight": 0, 2024-05-10T03:43:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "oplen_avg": { 2024-05-10T03:43:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 9497, 2024-05-10T03:43:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 9565 2024-05-10T03:43:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "op": 9497, 2024-05-10T03:43:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "op_r": 330, 2024-05-10T03:43:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "op_w": 9167, 2024-05-10T03:43:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "op_rmw": 0, 2024-05-10T03:43:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "op_pg": 0, 2024-05-10T03:43:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_stat": 0, 2024-05-10T03:43:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_create": 10, 2024-05-10T03:43:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_read": 145, 2024-05-10T03:43:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_write": 798, 2024-05-10T03:43:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_writefull": 69, 2024-05-10T03:43:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_writesame": 0, 2024-05-10T03:43:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_append": 0, 2024-05-10T03:43:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_zero": 0, 2024-05-10T03:43:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_truncate": 2, 2024-05-10T03:43:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_delete": 8241, 2024-05-10T03:43:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_mapext": 0, 2024-05-10T03:43:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_sparse_read": 0, 2024-05-10T03:43:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_clonerange": 0, 2024-05-10T03:43:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_getxattr": 185, 2024-05-10T03:43:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_setxattr": 20, 2024-05-10T03:43:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_cmpxattr": 0, 2024-05-10T03:43:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_rmxattr": 0, 2024-05-10T03:43:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_resetxattrs": 0, 2024-05-10T03:43:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_call": 0, 2024-05-10T03:43:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_watch": 0, 2024-05-10T03:43:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_notify": 0, 2024-05-10T03:43:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_src_cmpxattr": 0, 2024-05-10T03:43:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_pgls": 0, 2024-05-10T03:43:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_pgls_filter": 0, 2024-05-10T03:43:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_other": 0, 2024-05-10T03:43:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_active": 0, 2024-05-10T03:43:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_send": 0, 2024-05-10T03:43:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_resend": 0, 2024-05-10T03:43:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_ping": 0, 2024-05-10T03:43:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_active": 0, 2024-05-10T03:43:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_send": 0, 2024-05-10T03:43:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_resend": 0, 2024-05-10T03:43:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_active": 0, 2024-05-10T03:43:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_send": 0, 2024-05-10T03:43:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_resend": 0, 2024-05-10T03:43:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_active": 0, 2024-05-10T03:43:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_send": 0, 2024-05-10T03:43:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_resend": 0, 2024-05-10T03:43:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "command_active": 0, 2024-05-10T03:43:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "command_send": 0, 2024-05-10T03:43:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "command_resend": 0, 2024-05-10T03:43:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "map_epoch": 90, 2024-05-10T03:43:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "map_full": 0, 2024-05-10T03:43:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "map_inc": 4, 2024-05-10T03:43:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_sessions": 12, 2024-05-10T03:43:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_session_open": 12, 2024-05-10T03:43:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_session_close": 0, 2024-05-10T03:43:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_laggy": 0, 2024-05-10T03:43:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_wr": 80, 2024-05-10T03:43:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_rd": 0, 2024-05-10T03:43:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_del": 15 2024-05-10T03:43:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "oft": { 2024-05-10T03:43:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_objs": 1, 2024-05-10T03:43:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_kv_pairs": 0, 2024-05-10T03:43:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_updates": 0, 2024-05-10T03:43:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_removes": 0 2024-05-10T03:43:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "osd-slow-ops": { 2024-05-10T03:43:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "slow_ops_count": 0 2024-05-10T03:43:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "purge_queue": { 2024-05-10T03:43:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing_ops": 0, 2024-05-10T03:43:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing_ops_high_water": 16, 2024-05-10T03:43:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing": 0, 2024-05-10T03:43:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing_high_water": 9, 2024-05-10T03:43:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executed": 4240, 2024-05-10T03:43:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_item_in_journal": 0 2024-05-10T03:43:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-10T03:43:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-05-10T03:43:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2024-05-10T03:43:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-05-10T03:43:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 38976, 2024-05-10T03:43:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 12882193, 2024-05-10T03:43:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 38976, 2024-05-10T03:43:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2024-05-10T03:43:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2024-05-10T03:43:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 38976, 2024-05-10T03:43:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 12882193, 2024-05-10T03:43:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-05-10T03:43:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-objecter_bytes": { 2024-05-10T03:43:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-05-10T03:43:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2024-05-10T03:43:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-05-10T03:43:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2024-05-10T03:43:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2024-05-10T03:43:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2024-05-10T03:43:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 9497, 2024-05-10T03:43:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 32895482, 2024-05-10T03:43:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 9497, 2024-05-10T03:43:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 32895482, 2024-05-10T03:43:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-05-10T03:43:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-objecter_ops": { 2024-05-10T03:43:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-05-10T03:43:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 1024, 2024-05-10T03:43:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-05-10T03:43:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2024-05-10T03:43:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2024-05-10T03:43:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2024-05-10T03:43:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 9497, 2024-05-10T03:43:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 9497, 2024-05-10T03:43:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 9497, 2024-05-10T03:43:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 9497, 2024-05-10T03:43:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-05-10T03:43:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-write_buf_throttle": { 2024-05-10T03:43:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-05-10T03:43:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 3758096384, 2024-05-10T03:43:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-05-10T03:43:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 4240, 2024-05-10T03:43:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 459816, 2024-05-10T03:43:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 4240, 2024-05-10T03:43:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2024-05-10T03:43:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2024-05-10T03:43:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 145, 2024-05-10T03:43:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 459816, 2024-05-10T03:43:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-05-10T03:43:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-write_buf_throttle-0x55db53dee4e0": { 2024-05-10T03:43:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-05-10T03:43:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 3758096384, 2024-05-10T03:43:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-05-10T03:43:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 15139, 2024-05-10T03:43:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 31277232, 2024-05-10T03:43:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 15139, 2024-05-10T03:43:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2024-05-10T03:43:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2024-05-10T03:43:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 653, 2024-05-10T03:43:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 31277232, 2024-05-10T03:43:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-05-10T03:43:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:58.473 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-10T03:43:58.752 INFO:tasks.check_counter:Daemon mds.e mds.exported=23 2024-05-10T03:43:58.752 INFO:tasks.check_counter:Daemon mds.e mds.imported=181 2024-05-10T03:43:58.752 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=1309 2024-05-10T03:43:58.753 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=1016 2024-05-10T03:43:58.753 DEBUG:tasks.check_counter:Getting stats from h 2024-05-10T03:43:58.753 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph daemon mds.h perf dump 2024-05-10T03:43:59.012 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.b/config 2024-05-10T03:43:59.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:43:59 smithi106 ceph-mon[46996]: pgmap v396: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 279 KiB/s wr, 128 op/s 2024-05-10T03:43:59.473 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:43:59 smithi154 ceph-mon[46565]: pgmap v396: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 279 KiB/s wr, 128 op/s 2024-05-10T03:43:59.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:43:59 smithi045 ceph-mon[42520]: pgmap v396: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 279 KiB/s wr, 128 op/s 2024-05-10T03:43:59.954 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-10T03:43:59.955 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-0": { 2024-05-10T03:43:59.955 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 7490, 2024-05-10T03:43:59.955 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 3707, 2024-05-10T03:43:59.955 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 3086083, 2024-05-10T03:43:59.955 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 2072518, 2024-05-10T03:43:59.955 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 18, 2024-05-10T03:43:59.955 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 7, 2024-05-10T03:43:59.955 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 0.352678367, 2024-05-10T03:43:59.955 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.124132232, 2024-05-10T03:43:59.955 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.309191217, 2024-05-10T03:43:59.955 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.005424846, 2024-05-10T03:43:59.955 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:43:59.956 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 3703, 2024-05-10T03:43:59.956 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.094891432, 2024-05-10T03:43:59.956 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000025625 2024-05-10T03:43:59.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.956 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:43:59.956 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 10651, 2024-05-10T03:43:59.956 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.001766438, 2024-05-10T03:43:59.956 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000165 2024-05-10T03:43:59.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.956 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 2096, 2024-05-10T03:43:59.956 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 1744 2024-05-10T03:43:59.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.956 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-1": { 2024-05-10T03:43:59.957 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 7002, 2024-05-10T03:43:59.957 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 3653, 2024-05-10T03:43:59.957 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 2995092, 2024-05-10T03:43:59.957 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 1037335, 2024-05-10T03:43:59.957 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 9, 2024-05-10T03:43:59.957 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 6, 2024-05-10T03:43:59.957 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 0.349835993, 2024-05-10T03:43:59.957 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.143793409, 2024-05-10T03:43:59.957 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.271371446, 2024-05-10T03:43:59.957 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.003961192, 2024-05-10T03:43:59.957 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:43:59.957 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 3654, 2024-05-10T03:43:59.957 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.141452871, 2024-05-10T03:43:59.958 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000038711 2024-05-10T03:43:59.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.958 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:43:59.958 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 10247, 2024-05-10T03:43:59.958 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.001704319, 2024-05-10T03:43:59.958 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000166 2024-05-10T03:43:59.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.958 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-05-10T03:43:59.958 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 193856 2024-05-10T03:43:59.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.958 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-2": { 2024-05-10T03:43:59.958 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 915, 2024-05-10T03:43:59.958 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 1358, 2024-05-10T03:43:59.959 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 840127, 2024-05-10T03:43:59.959 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 802019, 2024-05-10T03:43:59.959 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 15, 2024-05-10T03:43:59.959 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 8, 2024-05-10T03:43:59.959 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 0.081646530, 2024-05-10T03:43:59.959 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.029041948, 2024-05-10T03:43:59.959 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.068920631, 2024-05-10T03:43:59.959 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.007052359, 2024-05-10T03:43:59.959 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:43:59.959 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 1357, 2024-05-10T03:43:59.959 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.147559989, 2024-05-10T03:43:59.959 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000108739 2024-05-10T03:43:59.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.960 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:43:59.960 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 1326, 2024-05-10T03:43:59.960 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000227281, 2024-05-10T03:43:59.960 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000171 2024-05-10T03:43:59.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.960 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 773376, 2024-05-10T03:43:59.960 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 619440 2024-05-10T03:43:59.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.960 INFO:teuthology.orchestra.run.smithi106.stdout: "cct": { 2024-05-10T03:43:59.960 INFO:teuthology.orchestra.run.smithi106.stdout: "total_workers": 1, 2024-05-10T03:43:59.960 INFO:teuthology.orchestra.run.smithi106.stdout: "unhealthy_workers": 0 2024-05-10T03:43:59.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.960 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-MDSRank": { 2024-05-10T03:43:59.961 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2024-05-10T03:43:59.961 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2024-05-10T03:43:59.961 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 245, 2024-05-10T03:43:59.961 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.164635790, 2024-05-10T03:43:59.961 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000671982 2024-05-10T03:43:59.961 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:59.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.961 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-PurgeQueue": { 2024-05-10T03:43:59.961 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2024-05-10T03:43:59.961 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2024-05-10T03:43:59.961 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 328, 2024-05-10T03:43:59.961 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.020401290, 2024-05-10T03:43:59.961 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000062199 2024-05-10T03:43:59.961 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:59.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.962 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": { 2024-05-10T03:43:59.962 INFO:teuthology.orchestra.run.smithi106.stdout: "request": 301, 2024-05-10T03:43:59.962 INFO:teuthology.orchestra.run.smithi106.stdout: "reply": 299, 2024-05-10T03:43:59.962 INFO:teuthology.orchestra.run.smithi106.stdout: "reply_latency": { 2024-05-10T03:43:59.962 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 299, 2024-05-10T03:43:59.962 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.288764261, 2024-05-10T03:43:59.962 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000965766 2024-05-10T03:43:59.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.962 INFO:teuthology.orchestra.run.smithi106.stdout: "slow_reply": 0, 2024-05-10T03:43:59.962 INFO:teuthology.orchestra.run.smithi106.stdout: "forward": 2, 2024-05-10T03:43:59.962 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_fetch_complete": 0, 2024-05-10T03:43:59.962 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_fetch_keys": 0, 2024-05-10T03:43:59.962 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_commit": 11, 2024-05-10T03:43:59.963 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_split": 0, 2024-05-10T03:43:59.963 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_merge": 0, 2024-05-10T03:43:59.963 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes": 34, 2024-05-10T03:43:59.963 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_top": 13, 2024-05-10T03:43:59.963 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_bottom": 11, 2024-05-10T03:43:59.963 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_pin_tail": 10, 2024-05-10T03:43:59.963 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_pinned": 13, 2024-05-10T03:43:59.963 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_expired": 1233, 2024-05-10T03:43:59.963 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_with_caps": 0, 2024-05-10T03:43:59.963 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": 0, 2024-05-10T03:43:59.963 INFO:teuthology.orchestra.run.smithi106.stdout: "subtrees": 6, 2024-05-10T03:43:59.963 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse": 1957, 2024-05-10T03:43:59.963 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_hit": 1176, 2024-05-10T03:43:59.963 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_forward": 0, 2024-05-10T03:43:59.963 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_discover": 735, 2024-05-10T03:43:59.964 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_dir_fetch": 0, 2024-05-10T03:43:59.964 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_remote_ino": 0, 2024-05-10T03:43:59.964 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_lock": 0, 2024-05-10T03:43:59.964 INFO:teuthology.orchestra.run.smithi106.stdout: "load_cent": 0, 2024-05-10T03:43:59.964 INFO:teuthology.orchestra.run.smithi106.stdout: "q": 0, 2024-05-10T03:43:59.964 INFO:teuthology.orchestra.run.smithi106.stdout: "exported": 10, 2024-05-10T03:43:59.964 INFO:teuthology.orchestra.run.smithi106.stdout: "exported_inodes": 2, 2024-05-10T03:43:59.964 INFO:teuthology.orchestra.run.smithi106.stdout: "imported": 10, 2024-05-10T03:43:59.964 INFO:teuthology.orchestra.run.smithi106.stdout: "imported_inodes": 107, 2024-05-10T03:43:59.964 INFO:teuthology.orchestra.run.smithi106.stdout: "openino_dir_fetch": 0, 2024-05-10T03:43:59.964 INFO:teuthology.orchestra.run.smithi106.stdout: "openino_backtrace_fetch": 41, 2024-05-10T03:43:59.964 INFO:teuthology.orchestra.run.smithi106.stdout: "openino_peer_discover": 0, 2024-05-10T03:43:59.964 INFO:teuthology.orchestra.run.smithi106.stdout: "root_rfiles": 434, 2024-05-10T03:43:59.964 INFO:teuthology.orchestra.run.smithi106.stdout: "root_rbytes": 82823115, 2024-05-10T03:43:59.964 INFO:teuthology.orchestra.run.smithi106.stdout: "root_rsnaps": 0, 2024-05-10T03:43:59.965 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_backtrace_fetch": 41, 2024-05-10T03:43:59.965 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_set_tag": 0, 2024-05-10T03:43:59.965 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_backtrace_repaired": 0, 2024-05-10T03:43:59.965 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_inotable_repaired": 0, 2024-05-10T03:43:59.965 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_dir_inodes": 0, 2024-05-10T03:43:59.965 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_dir_base_inodes": 0, 2024-05-10T03:43:59.965 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_dirfrag_rstats": 0, 2024-05-10T03:43:59.965 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_file_inodes": 41, 2024-05-10T03:43:59.965 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_inode_file_caps": 0, 2024-05-10T03:43:59.965 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_revoke": 23, 2024-05-10T03:43:59.965 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_grant": 210, 2024-05-10T03:43:59.965 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_trunc": 0, 2024-05-10T03:43:59.965 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-10T03:43:59.965 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-10T03:43:59.965 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_caps": 204, 2024-05-10T03:43:59.965 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_caps_dirty": 148, 2024-05-10T03:43:59.965 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_cap_release": 8, 2024-05-10T03:43:59.966 INFO:teuthology.orchestra.run.smithi106.stdout: "process_request_cap_release": 298 2024-05-10T03:43:59.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.966 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_cache": { 2024-05-10T03:43:59.966 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_update": 68, 2024-05-10T03:43:59.966 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_update_receipt": 2177, 2024-05-10T03:43:59.966 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_try_discover": 1448, 2024-05-10T03:43:59.966 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_send_discover": 1434, 2024-05-10T03:43:59.966 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_handle_discover": 82, 2024-05-10T03:43:59.966 INFO:teuthology.orchestra.run.smithi106.stdout: "num_strays": 0, 2024-05-10T03:43:59.966 INFO:teuthology.orchestra.run.smithi106.stdout: "num_strays_delayed": 0, 2024-05-10T03:43:59.966 INFO:teuthology.orchestra.run.smithi106.stdout: "num_strays_enqueuing": 0, 2024-05-10T03:43:59.966 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_created": 148, 2024-05-10T03:43:59.966 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_enqueued": 148, 2024-05-10T03:43:59.966 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_reintegrated": 0, 2024-05-10T03:43:59.967 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_migrated": 0, 2024-05-10T03:43:59.967 INFO:teuthology.orchestra.run.smithi106.stdout: "num_recovering_processing": 0, 2024-05-10T03:43:59.967 INFO:teuthology.orchestra.run.smithi106.stdout: "num_recovering_enqueued": 0, 2024-05-10T03:43:59.967 INFO:teuthology.orchestra.run.smithi106.stdout: "num_recovering_prioritized": 0, 2024-05-10T03:43:59.967 INFO:teuthology.orchestra.run.smithi106.stdout: "recovery_started": 0, 2024-05-10T03:43:59.967 INFO:teuthology.orchestra.run.smithi106.stdout: "recovery_completed": 0, 2024-05-10T03:43:59.967 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_enqueue_scrub": 0, 2024-05-10T03:43:59.967 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_exportdir": 10, 2024-05-10T03:43:59.967 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_flush": 0, 2024-05-10T03:43:59.967 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_fragmentdir": 0, 2024-05-10T03:43:59.967 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_fragstats": 0, 2024-05-10T03:43:59.967 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_inodestats": 0 2024-05-10T03:43:59.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.967 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_log": { 2024-05-10T03:43:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "evadd": 714, 2024-05-10T03:43:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "evex": 0, 2024-05-10T03:43:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "evtrm": 0, 2024-05-10T03:43:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "ev": 714, 2024-05-10T03:43:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "evexg": 0, 2024-05-10T03:43:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "evexd": 0, 2024-05-10T03:43:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "segadd": 1, 2024-05-10T03:43:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "segex": 0, 2024-05-10T03:43:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "segtrm": 0, 2024-05-10T03:43:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "seg": 1, 2024-05-10T03:43:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "segexg": 0, 2024-05-10T03:43:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "segexd": 0, 2024-05-10T03:43:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "expos": 4194304, 2024-05-10T03:43:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "wrpos": 5385506, 2024-05-10T03:43:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "rdpos": 0, 2024-05-10T03:43:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "jlat": { 2024-05-10T03:43:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 76, 2024-05-10T03:43:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.156886350, 2024-05-10T03:43:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.002064294 2024-05-10T03:43:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: "replayed": 0 2024-05-10T03:43:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_mem": { 2024-05-10T03:43:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: "ino": 41, 2024-05-10T03:43:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: "ino+": 806, 2024-05-10T03:43:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: "ino-": 765, 2024-05-10T03:43:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: "dir": 54, 2024-05-10T03:43:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: "dir+": 813, 2024-05-10T03:43:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: "dir-": 759, 2024-05-10T03:43:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: "dn": 34, 2024-05-10T03:43:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: "dn+": 1520, 2024-05-10T03:43:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: "dn-": 1486, 2024-05-10T03:43:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "cap": 0, 2024-05-10T03:43:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "cap+": 160, 2024-05-10T03:43:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "cap-": 160, 2024-05-10T03:43:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "rss": 125444, 2024-05-10T03:43:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "heap": 199060 2024-05-10T03:43:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_server": { 2024-05-10T03:43:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "dispatch_client_request": 358, 2024-05-10T03:43:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "dispatch_server_request": 56, 2024-05-10T03:43:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_request": 301, 2024-05-10T03:43:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_session": 7, 2024-05-10T03:43:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_peer_request": 136, 2024-05-10T03:43:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "req_create_latency": { 2024-05-10T03:43:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 41, 2024-05-10T03:43:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.030055456, 2024-05-10T03:43:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000733059 2024-05-10T03:43:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "req_getattr_latency": { 2024-05-10T03:43:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 1, 2024-05-10T03:43:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000209373, 2024-05-10T03:43:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000209373 2024-05-10T03:43:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "req_getfilelock_latency": { 2024-05-10T03:43:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "req_link_latency": { 2024-05-10T03:43:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookup_latency": { 2024-05-10T03:43:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 93, 2024-05-10T03:43:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.029561706, 2024-05-10T03:43:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000317867 2024-05-10T03:43:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookuphash_latency": { 2024-05-10T03:43:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupino_latency": { 2024-05-10T03:43:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupname_latency": { 2024-05-10T03:43:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupparent_latency": { 2024-05-10T03:43:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupsnap_latency": { 2024-05-10T03:43:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lssnap_latency": { 2024-05-10T03:43:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: "req_mkdir_latency": { 2024-05-10T03:43:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "req_mknod_latency": { 2024-05-10T03:43:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "req_mksnap_latency": { 2024-05-10T03:43:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "req_open_latency": { 2024-05-10T03:43:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "req_readdir_latency": { 2024-05-10T03:43:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 16, 2024-05-10T03:43:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.009543551, 2024-05-10T03:43:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000596471 2024-05-10T03:43:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rename_latency": { 2024-05-10T03:43:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: "req_renamesnap_latency": { 2024-05-10T03:43:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: "req_snapdiff_latency": { 2024-05-10T03:43:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rmdir_latency": { 2024-05-10T03:43:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 2, 2024-05-10T03:43:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.023424015, 2024-05-10T03:43:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.011712007 2024-05-10T03:43:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rmsnap_latency": { 2024-05-10T03:43:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rmxattr_latency": { 2024-05-10T03:43:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setattr_latency": { 2024-05-10T03:43:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setdirlayout_latency": { 2024-05-10T03:43:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setfilelock_latency": { 2024-05-10T03:43:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setlayout_latency": { 2024-05-10T03:43:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setxattr_latency": { 2024-05-10T03:43:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: "req_symlink_latency": { 2024-05-10T03:43:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: "req_unlink_latency": { 2024-05-10T03:43:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 146, 2024-05-10T03:43:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.195970160, 2024-05-10T03:43:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.001342261 2024-05-10T03:43:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: "cap_revoke_eviction": 0, 2024-05-10T03:43:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: "cap_acquisition_throttle": 0, 2024-05-10T03:43:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: "req_getvxattr_latency": { 2024-05-10T03:43:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_sessions": { 2024-05-10T03:43:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: "session_count": 1, 2024-05-10T03:43:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: "session_add": 2, 2024-05-10T03:43:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "session_remove": 1, 2024-05-10T03:43:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "sessions_open": 1, 2024-05-10T03:43:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "sessions_stale": 0, 2024-05-10T03:43:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "total_load": 220, 2024-05-10T03:43:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "average_load": 220, 2024-05-10T03:43:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "avg_session_uptime": 1715, 2024-05-10T03:43:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "mdthresh_evicted": 0 2024-05-10T03:43:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "mempool": { 2024-05-10T03:43:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "bloom_filter_bytes": 0, 2024-05-10T03:43:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "bloom_filter_items": 0, 2024-05-10T03:43:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_alloc_bytes": 0, 2024-05-10T03:43:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_alloc_items": 0, 2024-05-10T03:43:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_data_bytes": 0, 2024-05-10T03:43:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_data_items": 0, 2024-05-10T03:43:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-10T03:43:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_onode_items": 0, 2024-05-10T03:43:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-10T03:43:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_meta_items": 0, 2024-05-10T03:43:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_other_bytes": 0, 2024-05-10T03:43:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_other_items": 0, 2024-05-10T03:43:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-10T03:43:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_buffer_items": 0, 2024-05-10T03:43:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_extent_bytes": 0, 2024-05-10T03:43:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_extent_items": 0, 2024-05-10T03:43:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_blob_bytes": 0, 2024-05-10T03:43:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_blob_items": 0, 2024-05-10T03:43:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-10T03:43:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_shared_blob_items": 0, 2024-05-10T03:43:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-10T03:43:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_inline_bl_items": 0, 2024-05-10T03:43:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_bytes": 0, 2024-05-10T03:43:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_items": 0, 2024-05-10T03:43:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_txc_bytes": 0, 2024-05-10T03:43:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_txc_items": 0, 2024-05-10T03:43:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-10T03:43:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_deferred_items": 0, 2024-05-10T03:43:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_bytes": 0, 2024-05-10T03:43:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_items": 0, 2024-05-10T03:43:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_bytes": 0, 2024-05-10T03:43:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_items": 0, 2024-05-10T03:43:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_reader_bytes": 0, 2024-05-10T03:43:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_reader_items": 0, 2024-05-10T03:43:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_writer_bytes": 0, 2024-05-10T03:43:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_writer_items": 0, 2024-05-10T03:43:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_anon_bytes": 298375, 2024-05-10T03:43:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_anon_items": 122, 2024-05-10T03:43:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_meta_bytes": 528, 2024-05-10T03:43:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_meta_items": 6, 2024-05-10T03:43:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_bytes": 0, 2024-05-10T03:43:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_items": 0, 2024-05-10T03:43:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mapbl_bytes": 0, 2024-05-10T03:43:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mapbl_items": 0, 2024-05-10T03:43:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pglog_bytes": 0, 2024-05-10T03:43:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pglog_items": 0, 2024-05-10T03:43:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_bytes": 9176, 2024-05-10T03:43:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_items": 176, 2024-05-10T03:43:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_mapping_bytes": 0, 2024-05-10T03:43:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_mapping_items": 0, 2024-05-10T03:43:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "pgmap_bytes": 0, 2024-05-10T03:43:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "pgmap_items": 0, 2024-05-10T03:43:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_co_bytes": 184477, 2024-05-10T03:43:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_co_items": 643, 2024-05-10T03:43:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_1_bytes": 0, 2024-05-10T03:43:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_1_items": 0, 2024-05-10T03:43:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_2_bytes": 0, 2024-05-10T03:43:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_2_items": 0 2024-05-10T03:43:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: "objecter": { 2024-05-10T03:43:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: "op_active": 0, 2024-05-10T03:43:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: "op_laggy": 0, 2024-05-10T03:43:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: "op_send": 511, 2024-05-10T03:43:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: "op_send_bytes": 1239690, 2024-05-10T03:43:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: "op_resend": 33, 2024-05-10T03:43:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: "op_reply": 511, 2024-05-10T03:43:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: "op_latency": { 2024-05-10T03:43:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 511, 2024-05-10T03:43:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 1.727991674, 2024-05-10T03:43:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.003381588 2024-05-10T03:43:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: "op_inflight": 0, 2024-05-10T03:43:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: "oplen_avg": { 2024-05-10T03:43:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 511, 2024-05-10T03:43:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 547 2024-05-10T03:43:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: "op": 511, 2024-05-10T03:43:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: "op_r": 56, 2024-05-10T03:43:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "op_w": 455, 2024-05-10T03:43:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "op_rmw": 0, 2024-05-10T03:43:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "op_pg": 0, 2024-05-10T03:43:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_stat": 0, 2024-05-10T03:43:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_create": 10, 2024-05-10T03:43:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_read": 15, 2024-05-10T03:43:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_write": 91, 2024-05-10T03:43:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_writefull": 23, 2024-05-10T03:43:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_writesame": 0, 2024-05-10T03:43:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_append": 0, 2024-05-10T03:43:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_zero": 0, 2024-05-10T03:43:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_truncate": 0, 2024-05-10T03:43:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_delete": 306, 2024-05-10T03:43:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_mapext": 0, 2024-05-10T03:43:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_sparse_read": 0, 2024-05-10T03:43:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_clonerange": 0, 2024-05-10T03:43:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_getxattr": 41, 2024-05-10T03:43:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_setxattr": 20, 2024-05-10T03:43:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_cmpxattr": 0, 2024-05-10T03:43:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_rmxattr": 0, 2024-05-10T03:43:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_resetxattrs": 0, 2024-05-10T03:43:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_call": 0, 2024-05-10T03:43:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_watch": 0, 2024-05-10T03:43:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_notify": 0, 2024-05-10T03:43:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_src_cmpxattr": 0, 2024-05-10T03:43:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_pgls": 0, 2024-05-10T03:43:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_pgls_filter": 0, 2024-05-10T03:43:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_other": 0, 2024-05-10T03:43:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_active": 0, 2024-05-10T03:43:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_send": 0, 2024-05-10T03:43:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_resend": 0, 2024-05-10T03:43:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_ping": 0, 2024-05-10T03:43:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_active": 0, 2024-05-10T03:43:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_send": 0, 2024-05-10T03:43:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_resend": 0, 2024-05-10T03:43:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_active": 0, 2024-05-10T03:43:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_send": 0, 2024-05-10T03:43:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_resend": 0, 2024-05-10T03:43:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_active": 0, 2024-05-10T03:43:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_send": 0, 2024-05-10T03:43:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_resend": 0, 2024-05-10T03:43:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "command_active": 0, 2024-05-10T03:43:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "command_send": 0, 2024-05-10T03:43:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "command_resend": 0, 2024-05-10T03:43:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "map_epoch": 90, 2024-05-10T03:43:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: "map_full": 0, 2024-05-10T03:43:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: "map_inc": 4, 2024-05-10T03:43:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_sessions": 12, 2024-05-10T03:43:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_session_open": 12, 2024-05-10T03:43:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_session_close": 0, 2024-05-10T03:43:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_laggy": 0, 2024-05-10T03:43:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_wr": 33, 2024-05-10T03:43:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_rd": 0, 2024-05-10T03:43:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_del": 8 2024-05-10T03:43:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: "oft": { 2024-05-10T03:43:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_objs": 1, 2024-05-10T03:43:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_kv_pairs": 0, 2024-05-10T03:43:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_updates": 0, 2024-05-10T03:43:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_removes": 0 2024-05-10T03:43:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: "osd-slow-ops": { 2024-05-10T03:43:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: "slow_ops_count": 0 2024-05-10T03:43:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: "purge_queue": { 2024-05-10T03:43:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing_ops": 0, 2024-05-10T03:43:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing_ops_high_water": 10, 2024-05-10T03:43:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing": 0, 2024-05-10T03:43:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing_high_water": 5, 2024-05-10T03:43:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executed": 148, 2024-05-10T03:43:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_item_in_journal": 0 2024-05-10T03:43:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.994 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-10T03:43:59.994 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-05-10T03:43:59.994 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2024-05-10T03:43:59.994 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-05-10T03:43:59.994 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 15403, 2024-05-10T03:43:59.994 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 5499139, 2024-05-10T03:43:59.994 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:59.994 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 15403, 2024-05-10T03:43:59.994 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2024-05-10T03:43:59.994 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2024-05-10T03:43:59.994 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 15403, 2024-05-10T03:43:59.994 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 5499139, 2024-05-10T03:43:59.994 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-05-10T03:43:59.995 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.995 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.995 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.995 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:59.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.995 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-objecter_bytes": { 2024-05-10T03:43:59.995 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-05-10T03:43:59.995 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2024-05-10T03:43:59.995 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-05-10T03:43:59.995 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2024-05-10T03:43:59.995 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2024-05-10T03:43:59.995 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:59.995 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2024-05-10T03:43:59.995 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 511, 2024-05-10T03:43:59.996 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 1255806, 2024-05-10T03:43:59.996 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 511, 2024-05-10T03:43:59.996 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 1255806, 2024-05-10T03:43:59.996 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-05-10T03:43:59.996 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.996 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.996 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.996 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:59.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.996 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-objecter_ops": { 2024-05-10T03:43:59.996 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-05-10T03:43:59.996 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 1024, 2024-05-10T03:43:59.996 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-05-10T03:43:59.996 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2024-05-10T03:43:59.996 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2024-05-10T03:43:59.996 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2024-05-10T03:43:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 511, 2024-05-10T03:43:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 511, 2024-05-10T03:43:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 511, 2024-05-10T03:43:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 511, 2024-05-10T03:43:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-05-10T03:43:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-write_buf_throttle": { 2024-05-10T03:43:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-05-10T03:43:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 3758096384, 2024-05-10T03:43:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-05-10T03:43:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 148, 2024-05-10T03:43:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 16116, 2024-05-10T03:43:59.998 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:59.998 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 148, 2024-05-10T03:43:59.998 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2024-05-10T03:43:59.998 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2024-05-10T03:43:59.998 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 15, 2024-05-10T03:43:59.998 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 16116, 2024-05-10T03:43:59.998 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-05-10T03:43:59.998 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.998 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.998 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.998 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:59.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:43:59.998 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-write_buf_throttle-0x5561ac2b44e0": { 2024-05-10T03:43:59.998 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-05-10T03:43:59.998 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 3758096384, 2024-05-10T03:43:59.998 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-05-10T03:43:59.999 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 714, 2024-05-10T03:43:59.999 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 1191202, 2024-05-10T03:43:59.999 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-05-10T03:43:59.999 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 714, 2024-05-10T03:43:59.999 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2024-05-10T03:43:59.999 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2024-05-10T03:43:59.999 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 76, 2024-05-10T03:43:59.999 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 1191202, 2024-05-10T03:43:59.999 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-05-10T03:43:59.999 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:43:59.999 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:43:59.999 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:43:59.999 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:59.999 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:43:59.999 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-10T03:44:00.315 INFO:tasks.check_counter:Daemon mds.h mds.exported=10 2024-05-10T03:44:00.316 INFO:tasks.check_counter:Daemon mds.h mds.imported=10 2024-05-10T03:44:00.316 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=68 2024-05-10T03:44:00.316 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=2177 2024-05-10T03:44:00.316 DEBUG:tasks.check_counter:Getting stats from k 2024-05-10T03:44:00.316 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph daemon mds.k perf dump 2024-05-10T03:44:00.538 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.b/config 2024-05-10T03:44:01.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:01 smithi106 ceph-mon[46996]: pgmap v397: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.0 KiB/s wr, 35 op/s 2024-05-10T03:44:01.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:01 smithi154 ceph-mon[46565]: pgmap v397: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.0 KiB/s wr, 35 op/s 2024-05-10T03:44:01.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:01 smithi045 ceph-mon[42520]: pgmap v397: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.0 KiB/s wr, 35 op/s 2024-05-10T03:44:02.113 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-10T03:44:02.113 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-0": { 2024-05-10T03:44:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 428, 2024-05-10T03:44:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 409, 2024-05-10T03:44:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 644672, 2024-05-10T03:44:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 150098, 2024-05-10T03:44:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 5, 2024-05-10T03:44:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 1, 2024-05-10T03:44:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 0.054343151, 2024-05-10T03:44:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.018894071, 2024-05-10T03:44:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.022288073, 2024-05-10T03:44:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.012043809, 2024-05-10T03:44:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:44:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 409, 2024-05-10T03:44:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.022105560, 2024-05-10T03:44:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000054047 2024-05-10T03:44:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:44:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 543200, 2024-05-10T03:44:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 56176 2024-05-10T03:44:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-1": { 2024-05-10T03:44:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 3, 2024-05-10T03:44:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 75, 2024-05-10T03:44:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 716, 2024-05-10T03:44:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 192732, 2024-05-10T03:44:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 4, 2024-05-10T03:44:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 3, 2024-05-10T03:44:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 0.005460093, 2024-05-10T03:44:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.002757667, 2024-05-10T03:44:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.001834071, 2024-05-10T03:44:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.000056328, 2024-05-10T03:44:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:44:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 73, 2024-05-10T03:44:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.005171609, 2024-05-10T03:44:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000070843 2024-05-10T03:44:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:44:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-10T03:44:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 192048 2024-05-10T03:44:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-2": { 2024-05-10T03:44:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 492, 2024-05-10T03:44:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 494, 2024-05-10T03:44:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 1317711, 2024-05-10T03:44:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 153019, 2024-05-10T03:44:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 4, 2024-05-10T03:44:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 3, 2024-05-10T03:44:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 0.035525078, 2024-05-10T03:44:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.008322916, 2024-05-10T03:44:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.011353678, 2024-05-10T03:44:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.013153291, 2024-05-10T03:44:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:44:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 492, 2024-05-10T03:44:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.017049697, 2024-05-10T03:44:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000034653 2024-05-10T03:44:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:44:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-10T03:44:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 0 2024-05-10T03:44:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: "cct": { 2024-05-10T03:44:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: "total_workers": 1, 2024-05-10T03:44:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: "unhealthy_workers": 0 2024-05-10T03:44:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-MDSRank": { 2024-05-10T03:44:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2024-05-10T03:44:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2024-05-10T03:44:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 1425, 2024-05-10T03:44:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.037092674, 2024-05-10T03:44:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000026029 2024-05-10T03:44:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:44:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-PurgeQueue": { 2024-05-10T03:44:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2024-05-10T03:44:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2024-05-10T03:44:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:44:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": { 2024-05-10T03:44:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: "request": 0, 2024-05-10T03:44:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: "reply": 0, 2024-05-10T03:44:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: "reply_latency": { 2024-05-10T03:44:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: "slow_reply": 0, 2024-05-10T03:44:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: "forward": 0, 2024-05-10T03:44:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_fetch_complete": 0, 2024-05-10T03:44:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_fetch_keys": 0, 2024-05-10T03:44:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_commit": 0, 2024-05-10T03:44:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_split": 0, 2024-05-10T03:44:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_merge": 0, 2024-05-10T03:44:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes": 149, 2024-05-10T03:44:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_top": 0, 2024-05-10T03:44:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_bottom": 149, 2024-05-10T03:44:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_pin_tail": 0, 2024-05-10T03:44:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_pinned": 149, 2024-05-10T03:44:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_expired": 0, 2024-05-10T03:44:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_with_caps": 0, 2024-05-10T03:44:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": 0, 2024-05-10T03:44:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: "subtrees": 1, 2024-05-10T03:44:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse": 0, 2024-05-10T03:44:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_hit": 0, 2024-05-10T03:44:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_forward": 0, 2024-05-10T03:44:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_discover": 0, 2024-05-10T03:44:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_dir_fetch": 0, 2024-05-10T03:44:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_remote_ino": 0, 2024-05-10T03:44:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_lock": 0, 2024-05-10T03:44:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "load_cent": 0, 2024-05-10T03:44:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "q": 0, 2024-05-10T03:44:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "exported": 0, 2024-05-10T03:44:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "exported_inodes": 0, 2024-05-10T03:44:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "imported": 0, 2024-05-10T03:44:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "imported_inodes": 0, 2024-05-10T03:44:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "openino_dir_fetch": 0, 2024-05-10T03:44:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "openino_backtrace_fetch": 0, 2024-05-10T03:44:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "openino_peer_discover": 0, 2024-05-10T03:44:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "root_rfiles": 0, 2024-05-10T03:44:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "root_rbytes": 0, 2024-05-10T03:44:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "root_rsnaps": 0, 2024-05-10T03:44:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_backtrace_fetch": 0, 2024-05-10T03:44:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_set_tag": 0, 2024-05-10T03:44:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_backtrace_repaired": 0, 2024-05-10T03:44:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_inotable_repaired": 0, 2024-05-10T03:44:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_dir_inodes": 0, 2024-05-10T03:44:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_dir_base_inodes": 0, 2024-05-10T03:44:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_dirfrag_rstats": 0, 2024-05-10T03:44:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_file_inodes": 0, 2024-05-10T03:44:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_inode_file_caps": 0, 2024-05-10T03:44:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_revoke": 0, 2024-05-10T03:44:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_grant": 0, 2024-05-10T03:44:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_trunc": 0, 2024-05-10T03:44:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-10T03:44:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-10T03:44:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_caps": 0, 2024-05-10T03:44:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_caps_dirty": 0, 2024-05-10T03:44:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_cap_release": 0, 2024-05-10T03:44:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: "process_request_cap_release": 0 2024-05-10T03:44:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_cache": { 2024-05-10T03:44:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_update": 0, 2024-05-10T03:44:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_update_receipt": 0, 2024-05-10T03:44:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_try_discover": 0, 2024-05-10T03:44:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_send_discover": 0, 2024-05-10T03:44:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_handle_discover": 0, 2024-05-10T03:44:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: "num_strays": 0, 2024-05-10T03:44:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: "num_strays_delayed": 0, 2024-05-10T03:44:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: "num_strays_enqueuing": 0, 2024-05-10T03:44:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_created": 0, 2024-05-10T03:44:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_enqueued": 0, 2024-05-10T03:44:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_reintegrated": 0, 2024-05-10T03:44:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_migrated": 0, 2024-05-10T03:44:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: "num_recovering_processing": 0, 2024-05-10T03:44:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: "num_recovering_enqueued": 0, 2024-05-10T03:44:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: "num_recovering_prioritized": 0, 2024-05-10T03:44:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: "recovery_started": 0, 2024-05-10T03:44:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: "recovery_completed": 0, 2024-05-10T03:44:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_enqueue_scrub": 0, 2024-05-10T03:44:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_exportdir": 0, 2024-05-10T03:44:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_flush": 0, 2024-05-10T03:44:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_fragmentdir": 0, 2024-05-10T03:44:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_fragstats": 0, 2024-05-10T03:44:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_inodestats": 0 2024-05-10T03:44:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_log": { 2024-05-10T03:44:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: "evadd": 0, 2024-05-10T03:44:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: "evex": 0, 2024-05-10T03:44:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: "evtrm": 0, 2024-05-10T03:44:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: "ev": 714, 2024-05-10T03:44:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: "evexg": 0, 2024-05-10T03:44:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: "evexd": 0, 2024-05-10T03:44:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: "segadd": 0, 2024-05-10T03:44:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: "segex": 0, 2024-05-10T03:44:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: "segtrm": 0, 2024-05-10T03:44:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: "seg": 1, 2024-05-10T03:44:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: "segexg": 0, 2024-05-10T03:44:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: "segexd": 0, 2024-05-10T03:44:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: "expos": 4194304, 2024-05-10T03:44:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: "wrpos": 5385506, 2024-05-10T03:44:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: "rdpos": 5384368, 2024-05-10T03:44:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: "jlat": { 2024-05-10T03:44:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: "replayed": 714 2024-05-10T03:44:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_mem": { 2024-05-10T03:44:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: "ino": 4, 2024-05-10T03:44:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: "ino+": 202, 2024-05-10T03:44:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: "ino-": 198, 2024-05-10T03:44:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: "dir": 2, 2024-05-10T03:44:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: "dir+": 58, 2024-05-10T03:44:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: "dir-": 56, 2024-05-10T03:44:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: "dn": 149, 2024-05-10T03:44:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: "dn+": 311, 2024-05-10T03:44:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: "dn-": 162, 2024-05-10T03:44:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: "cap": 0, 2024-05-10T03:44:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: "cap+": 0, 2024-05-10T03:44:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: "cap-": 0, 2024-05-10T03:44:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: "rss": 118448, 2024-05-10T03:44:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: "heap": 207252 2024-05-10T03:44:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_server": { 2024-05-10T03:44:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: "dispatch_client_request": 0, 2024-05-10T03:44:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: "dispatch_server_request": 0, 2024-05-10T03:44:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_request": 0, 2024-05-10T03:44:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_session": 0, 2024-05-10T03:44:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_peer_request": 0, 2024-05-10T03:44:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: "req_create_latency": { 2024-05-10T03:44:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: "req_getattr_latency": { 2024-05-10T03:44:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: "req_getfilelock_latency": { 2024-05-10T03:44:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: "req_link_latency": { 2024-05-10T03:44:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookup_latency": { 2024-05-10T03:44:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookuphash_latency": { 2024-05-10T03:44:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupino_latency": { 2024-05-10T03:44:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupname_latency": { 2024-05-10T03:44:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupparent_latency": { 2024-05-10T03:44:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupsnap_latency": { 2024-05-10T03:44:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lssnap_latency": { 2024-05-10T03:44:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: "req_mkdir_latency": { 2024-05-10T03:44:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: "req_mknod_latency": { 2024-05-10T03:44:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: "req_mksnap_latency": { 2024-05-10T03:44:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: "req_open_latency": { 2024-05-10T03:44:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: "req_readdir_latency": { 2024-05-10T03:44:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rename_latency": { 2024-05-10T03:44:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: "req_renamesnap_latency": { 2024-05-10T03:44:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: "req_snapdiff_latency": { 2024-05-10T03:44:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rmdir_latency": { 2024-05-10T03:44:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rmsnap_latency": { 2024-05-10T03:44:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rmxattr_latency": { 2024-05-10T03:44:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setattr_latency": { 2024-05-10T03:44:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setdirlayout_latency": { 2024-05-10T03:44:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setfilelock_latency": { 2024-05-10T03:44:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setlayout_latency": { 2024-05-10T03:44:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setxattr_latency": { 2024-05-10T03:44:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: "req_symlink_latency": { 2024-05-10T03:44:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: "req_unlink_latency": { 2024-05-10T03:44:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: "cap_revoke_eviction": 0, 2024-05-10T03:44:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: "cap_acquisition_throttle": 0, 2024-05-10T03:44:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: "req_getvxattr_latency": { 2024-05-10T03:44:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:44:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_sessions": { 2024-05-10T03:44:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: "session_count": 1, 2024-05-10T03:44:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: "session_add": 2, 2024-05-10T03:44:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: "session_remove": 1, 2024-05-10T03:44:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: "sessions_open": 1, 2024-05-10T03:44:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: "sessions_stale": 0, 2024-05-10T03:44:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: "total_load": 0, 2024-05-10T03:44:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: "average_load": 0, 2024-05-10T03:44:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: "avg_session_uptime": 1714, 2024-05-10T03:44:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: "mdthresh_evicted": 0 2024-05-10T03:44:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: "mempool": { 2024-05-10T03:44:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: "bloom_filter_bytes": 0, 2024-05-10T03:44:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: "bloom_filter_items": 0, 2024-05-10T03:44:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_alloc_bytes": 0, 2024-05-10T03:44:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_alloc_items": 0, 2024-05-10T03:44:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_data_bytes": 0, 2024-05-10T03:44:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_data_items": 0, 2024-05-10T03:44:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-10T03:44:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_onode_items": 0, 2024-05-10T03:44:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-10T03:44:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_meta_items": 0, 2024-05-10T03:44:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_other_bytes": 0, 2024-05-10T03:44:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_other_items": 0, 2024-05-10T03:44:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-10T03:44:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_buffer_items": 0, 2024-05-10T03:44:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_extent_bytes": 0, 2024-05-10T03:44:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_extent_items": 0, 2024-05-10T03:44:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_blob_bytes": 0, 2024-05-10T03:44:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_blob_items": 0, 2024-05-10T03:44:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-10T03:44:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_shared_blob_items": 0, 2024-05-10T03:44:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-10T03:44:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_inline_bl_items": 0, 2024-05-10T03:44:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_bytes": 0, 2024-05-10T03:44:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_items": 0, 2024-05-10T03:44:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_txc_bytes": 0, 2024-05-10T03:44:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_txc_items": 0, 2024-05-10T03:44:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-10T03:44:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_deferred_items": 0, 2024-05-10T03:44:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_bytes": 0, 2024-05-10T03:44:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_items": 0, 2024-05-10T03:44:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_bytes": 0, 2024-05-10T03:44:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_items": 0, 2024-05-10T03:44:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_reader_bytes": 0, 2024-05-10T03:44:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_reader_items": 0, 2024-05-10T03:44:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_writer_bytes": 0, 2024-05-10T03:44:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_writer_items": 0, 2024-05-10T03:44:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_anon_bytes": 181159, 2024-05-10T03:44:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_anon_items": 44, 2024-05-10T03:44:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_meta_bytes": 0, 2024-05-10T03:44:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_meta_items": 0, 2024-05-10T03:44:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_bytes": 0, 2024-05-10T03:44:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_items": 0, 2024-05-10T03:44:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mapbl_bytes": 0, 2024-05-10T03:44:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mapbl_items": 0, 2024-05-10T03:44:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pglog_bytes": 0, 2024-05-10T03:44:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pglog_items": 0, 2024-05-10T03:44:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_bytes": 9176, 2024-05-10T03:44:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_items": 176, 2024-05-10T03:44:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_mapping_bytes": 0, 2024-05-10T03:44:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_mapping_items": 0, 2024-05-10T03:44:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: "pgmap_bytes": 0, 2024-05-10T03:44:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: "pgmap_items": 0, 2024-05-10T03:44:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_co_bytes": 116696, 2024-05-10T03:44:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_co_items": 625, 2024-05-10T03:44:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_1_bytes": 0, 2024-05-10T03:44:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_1_items": 0, 2024-05-10T03:44:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_2_bytes": 0, 2024-05-10T03:44:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_2_items": 0 2024-05-10T03:44:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: "objecter": { 2024-05-10T03:44:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: "op_active": 0, 2024-05-10T03:44:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: "op_laggy": 0, 2024-05-10T03:44:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: "op_send": 796, 2024-05-10T03:44:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: "op_send_bytes": 21, 2024-05-10T03:44:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: "op_resend": 3, 2024-05-10T03:44:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: "op_reply": 796, 2024-05-10T03:44:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: "op_latency": { 2024-05-10T03:44:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 796, 2024-05-10T03:44:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 1.389993351, 2024-05-10T03:44:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.001746222 2024-05-10T03:44:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: "op_inflight": 0, 2024-05-10T03:44:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: "oplen_avg": { 2024-05-10T03:44:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 796, 2024-05-10T03:44:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 797 2024-05-10T03:44:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: "op": 796, 2024-05-10T03:44:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: "op_r": 796, 2024-05-10T03:44:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: "op_w": 0, 2024-05-10T03:44:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: "op_rmw": 0, 2024-05-10T03:44:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: "op_pg": 0, 2024-05-10T03:44:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_stat": 458, 2024-05-10T03:44:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_create": 0, 2024-05-10T03:44:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_read": 336, 2024-05-10T03:44:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_write": 0, 2024-05-10T03:44:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_writefull": 0, 2024-05-10T03:44:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_writesame": 0, 2024-05-10T03:44:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_append": 0, 2024-05-10T03:44:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_zero": 0, 2024-05-10T03:44:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_truncate": 0, 2024-05-10T03:44:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_delete": 0, 2024-05-10T03:44:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_mapext": 0, 2024-05-10T03:44:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_sparse_read": 0, 2024-05-10T03:44:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_clonerange": 0, 2024-05-10T03:44:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_getxattr": 1, 2024-05-10T03:44:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_setxattr": 0, 2024-05-10T03:44:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_cmpxattr": 0, 2024-05-10T03:44:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_rmxattr": 0, 2024-05-10T03:44:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_resetxattrs": 0, 2024-05-10T03:44:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_call": 0, 2024-05-10T03:44:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_watch": 0, 2024-05-10T03:44:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_notify": 0, 2024-05-10T03:44:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_src_cmpxattr": 0, 2024-05-10T03:44:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_pgls": 0, 2024-05-10T03:44:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_pgls_filter": 0, 2024-05-10T03:44:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_other": 0, 2024-05-10T03:44:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_active": 0, 2024-05-10T03:44:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_send": 0, 2024-05-10T03:44:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_resend": 0, 2024-05-10T03:44:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_ping": 0, 2024-05-10T03:44:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_active": 0, 2024-05-10T03:44:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_send": 0, 2024-05-10T03:44:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_resend": 0, 2024-05-10T03:44:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_active": 0, 2024-05-10T03:44:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_send": 0, 2024-05-10T03:44:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_resend": 0, 2024-05-10T03:44:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_active": 0, 2024-05-10T03:44:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_send": 0, 2024-05-10T03:44:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_resend": 0, 2024-05-10T03:44:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: "command_active": 0, 2024-05-10T03:44:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: "command_send": 0, 2024-05-10T03:44:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: "command_resend": 0, 2024-05-10T03:44:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: "map_epoch": 90, 2024-05-10T03:44:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: "map_full": 0, 2024-05-10T03:44:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: "map_inc": 4, 2024-05-10T03:44:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_sessions": 4, 2024-05-10T03:44:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_session_open": 4, 2024-05-10T03:44:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_session_close": 0, 2024-05-10T03:44:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_laggy": 0, 2024-05-10T03:44:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_wr": 0, 2024-05-10T03:44:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_rd": 2, 2024-05-10T03:44:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_del": 0 2024-05-10T03:44:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: "oft": { 2024-05-10T03:44:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_objs": 0, 2024-05-10T03:44:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_kv_pairs": 0, 2024-05-10T03:44:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_updates": 0, 2024-05-10T03:44:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_removes": 0 2024-05-10T03:44:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: "osd-slow-ops": { 2024-05-10T03:44:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: "slow_ops_count": 0 2024-05-10T03:44:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: "purge_queue": { 2024-05-10T03:44:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing_ops": 0, 2024-05-10T03:44:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing_ops_high_water": 0, 2024-05-10T03:44:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing": 0, 2024-05-10T03:44:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing_high_water": 0, 2024-05-10T03:44:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executed": 0, 2024-05-10T03:44:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_item_in_journal": 0 2024-05-10T03:44:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-10T03:44:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-05-10T03:44:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2024-05-10T03:44:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-05-10T03:44:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 919, 2024-05-10T03:44:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 1871128, 2024-05-10T03:44:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-05-10T03:44:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 919, 2024-05-10T03:44:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2024-05-10T03:44:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2024-05-10T03:44:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 919, 2024-05-10T03:44:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 1871128, 2024-05-10T03:44:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-05-10T03:44:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:44:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-objecter_bytes": { 2024-05-10T03:44:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-05-10T03:44:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2024-05-10T03:44:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-05-10T03:44:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2024-05-10T03:44:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2024-05-10T03:44:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-05-10T03:44:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2024-05-10T03:44:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 796, 2024-05-10T03:44:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 1191207, 2024-05-10T03:44:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 796, 2024-05-10T03:44:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 1191207, 2024-05-10T03:44:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-05-10T03:44:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:44:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-objecter_ops": { 2024-05-10T03:44:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-05-10T03:44:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 1024, 2024-05-10T03:44:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-05-10T03:44:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2024-05-10T03:44:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2024-05-10T03:44:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-05-10T03:44:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2024-05-10T03:44:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 796, 2024-05-10T03:44:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 796, 2024-05-10T03:44:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 796, 2024-05-10T03:44:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 796, 2024-05-10T03:44:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-05-10T03:44:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:44:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-write_buf_throttle": { 2024-05-10T03:44:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-05-10T03:44:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 3758096384, 2024-05-10T03:44:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-05-10T03:44:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2024-05-10T03:44:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2024-05-10T03:44:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-05-10T03:44:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2024-05-10T03:44:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2024-05-10T03:44:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2024-05-10T03:44:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 0, 2024-05-10T03:44:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 0, 2024-05-10T03:44:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-05-10T03:44:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:44:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-10T03:44:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-write_buf_throttle-0x555841fb48f0": { 2024-05-10T03:44:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-05-10T03:44:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 3758096384, 2024-05-10T03:44:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-05-10T03:44:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2024-05-10T03:44:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2024-05-10T03:44:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-05-10T03:44:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2024-05-10T03:44:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2024-05-10T03:44:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2024-05-10T03:44:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 0, 2024-05-10T03:44:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 0, 2024-05-10T03:44:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-05-10T03:44:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-05-10T03:44:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-05-10T03:44:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-05-10T03:44:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:44:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-10T03:44:02.158 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-10T03:44:02.527 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-05-10T03:44:02.528 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-05-10T03:44:02.528 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-05-10T03:44:02.528 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-05-10T03:44:02.528 DEBUG:tasks.check_counter:Getting stats from c 2024-05-10T03:44:02.528 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph daemon mds.c perf dump 2024-05-10T03:44:02.776 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T03:44:03.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:03 smithi154 ceph-mon[46565]: pgmap v398: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.4 KiB/s wr, 11 op/s 2024-05-10T03:44:03.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:03 smithi106 ceph-mon[46996]: pgmap v398: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.4 KiB/s wr, 11 op/s 2024-05-10T03:44:03.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:03 smithi045 ceph-mon[42520]: pgmap v398: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.4 KiB/s wr, 11 op/s 2024-05-10T03:44:03.916 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-05-10T03:44:03.917 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-05-10T03:44:03.917 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 1388, 2024-05-10T03:44:03.917 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 2026, 2024-05-10T03:44:03.917 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 1042027, 2024-05-10T03:44:03.917 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 2606647, 2024-05-10T03:44:03.917 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 14, 2024-05-10T03:44:03.917 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 4, 2024-05-10T03:44:03.917 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.113057517, 2024-05-10T03:44:03.917 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.043691361, 2024-05-10T03:44:03.917 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.073558899, 2024-05-10T03:44:03.917 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.010574525, 2024-05-10T03:44:03.917 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:44:03.918 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2025, 2024-05-10T03:44:03.918 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.191322684, 2024-05-10T03:44:03.918 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000094480 2024-05-10T03:44:03.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.918 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:44:03.918 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2100, 2024-05-10T03:44:03.918 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000330004, 2024-05-10T03:44:03.918 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000157 2024-05-10T03:44:03.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.918 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 840816, 2024-05-10T03:44:03.918 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 810928 2024-05-10T03:44:03.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.918 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-05-10T03:44:03.919 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 13437, 2024-05-10T03:44:03.919 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 6554, 2024-05-10T03:44:03.919 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 5575264, 2024-05-10T03:44:03.919 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 1575241, 2024-05-10T03:44:03.919 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 17, 2024-05-10T03:44:03.919 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 7, 2024-05-10T03:44:03.919 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.582770004, 2024-05-10T03:44:03.919 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.225442482, 2024-05-10T03:44:03.919 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.489759175, 2024-05-10T03:44:03.919 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.004203840, 2024-05-10T03:44:03.919 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:44:03.919 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 6552, 2024-05-10T03:44:03.919 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.166562374, 2024-05-10T03:44:03.920 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000025421 2024-05-10T03:44:03.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.920 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:44:03.920 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 19389, 2024-05-10T03:44:03.920 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.002849555, 2024-05-10T03:44:03.920 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000146 2024-05-10T03:44:03.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.920 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-10T03:44:03.920 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 193584 2024-05-10T03:44:03.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.920 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-05-10T03:44:03.920 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 1027, 2024-05-10T03:44:03.920 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 827, 2024-05-10T03:44:03.920 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 446336, 2024-05-10T03:44:03.921 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 334220, 2024-05-10T03:44:03.921 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 10, 2024-05-10T03:44:03.921 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 8, 2024-05-10T03:44:03.921 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.069169804, 2024-05-10T03:44:03.921 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.023407016, 2024-05-10T03:44:03.921 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.044925079, 2024-05-10T03:44:03.921 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.007449596, 2024-05-10T03:44:03.921 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:44:03.921 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 826, 2024-05-10T03:44:03.921 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.044714492, 2024-05-10T03:44:03.921 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000054133 2024-05-10T03:44:03.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.922 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:44:03.922 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1362, 2024-05-10T03:44:03.922 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000287546, 2024-05-10T03:44:03.922 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000211 2024-05-10T03:44:03.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.922 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-05-10T03:44:03.922 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 448 2024-05-10T03:44:03.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.922 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-05-10T03:44:03.923 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-05-10T03:44:03.923 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-05-10T03:44:03.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.923 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-05-10T03:44:03.923 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-05-10T03:44:03.923 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-05-10T03:44:03.923 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 314, 2024-05-10T03:44:03.923 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.268723808, 2024-05-10T03:44:03.923 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000855808 2024-05-10T03:44:03.923 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:03.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.923 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-05-10T03:44:03.923 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-05-10T03:44:03.924 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-05-10T03:44:03.924 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 452, 2024-05-10T03:44:03.924 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.029059574, 2024-05-10T03:44:03.924 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000064291 2024-05-10T03:44:03.924 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:03.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.924 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-05-10T03:44:03.924 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 398, 2024-05-10T03:44:03.924 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 396, 2024-05-10T03:44:03.924 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-05-10T03:44:03.925 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 396, 2024-05-10T03:44:03.925 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.423084061, 2024-05-10T03:44:03.925 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001068394 2024-05-10T03:44:03.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.925 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-05-10T03:44:03.926 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 2, 2024-05-10T03:44:03.926 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-05-10T03:44:03.926 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-05-10T03:44:03.926 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 11, 2024-05-10T03:44:03.926 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-05-10T03:44:03.926 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-05-10T03:44:03.927 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 35, 2024-05-10T03:44:03.927 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 14, 2024-05-10T03:44:03.927 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 11, 2024-05-10T03:44:03.927 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 10, 2024-05-10T03:44:03.927 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 13, 2024-05-10T03:44:03.927 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 1231, 2024-05-10T03:44:03.928 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 2, 2024-05-10T03:44:03.928 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 2, 2024-05-10T03:44:03.928 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 6, 2024-05-10T03:44:03.928 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 2069, 2024-05-10T03:44:03.928 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 1258, 2024-05-10T03:44:03.928 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 2, 2024-05-10T03:44:03.928 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 742, 2024-05-10T03:44:03.928 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-05-10T03:44:03.928 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-05-10T03:44:03.928 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-05-10T03:44:03.928 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-05-10T03:44:03.929 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-05-10T03:44:03.929 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 13, 2024-05-10T03:44:03.929 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 1, 2024-05-10T03:44:03.929 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 13, 2024-05-10T03:44:03.929 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 116, 2024-05-10T03:44:03.929 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-05-10T03:44:03.930 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 69, 2024-05-10T03:44:03.930 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-05-10T03:44:03.930 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 434, 2024-05-10T03:44:03.930 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 82823115, 2024-05-10T03:44:03.930 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-05-10T03:44:03.930 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 69, 2024-05-10T03:44:03.930 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-05-10T03:44:03.930 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-05-10T03:44:03.930 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-05-10T03:44:03.930 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 1, 2024-05-10T03:44:03.930 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-05-10T03:44:03.930 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 1, 2024-05-10T03:44:03.930 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 68, 2024-05-10T03:44:03.931 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-05-10T03:44:03.931 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 30, 2024-05-10T03:44:03.931 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 321, 2024-05-10T03:44:03.931 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-05-10T03:44:03.931 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-10T03:44:03.931 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-10T03:44:03.931 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 257, 2024-05-10T03:44:03.931 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 196, 2024-05-10T03:44:03.931 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 31, 2024-05-10T03:44:03.931 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 381 2024-05-10T03:44:03.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.931 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-05-10T03:44:03.931 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 97, 2024-05-10T03:44:03.931 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 2148, 2024-05-10T03:44:03.932 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 1434, 2024-05-10T03:44:03.932 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 1408, 2024-05-10T03:44:03.932 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 105, 2024-05-10T03:44:03.932 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-05-10T03:44:03.932 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-05-10T03:44:03.932 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-05-10T03:44:03.932 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 195, 2024-05-10T03:44:03.932 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 195, 2024-05-10T03:44:03.932 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-05-10T03:44:03.932 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-05-10T03:44:03.932 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-05-10T03:44:03.932 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-05-10T03:44:03.932 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-05-10T03:44:03.933 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-05-10T03:44:03.933 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-05-10T03:44:03.933 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-05-10T03:44:03.933 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 13, 2024-05-10T03:44:03.933 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-05-10T03:44:03.933 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-05-10T03:44:03.933 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-05-10T03:44:03.933 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0 2024-05-10T03:44:03.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.933 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-05-10T03:44:03.933 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 884, 2024-05-10T03:44:03.933 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-05-10T03:44:03.933 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-05-10T03:44:03.933 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 884, 2024-05-10T03:44:03.933 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-05-10T03:44:03.934 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-05-10T03:44:03.934 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 1, 2024-05-10T03:44:03.934 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-05-10T03:44:03.934 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-05-10T03:44:03.934 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 1, 2024-05-10T03:44:03.934 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-05-10T03:44:03.934 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-05-10T03:44:03.934 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4194304, 2024-05-10T03:44:03.934 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 5699986, 2024-05-10T03:44:03.934 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 0, 2024-05-10T03:44:03.934 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-05-10T03:44:03.934 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 99, 2024-05-10T03:44:03.934 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.327690639, 2024-05-10T03:44:03.935 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.003310006 2024-05-10T03:44:03.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.935 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 0 2024-05-10T03:44:03.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.935 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-05-10T03:44:03.935 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 42, 2024-05-10T03:44:03.935 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 853, 2024-05-10T03:44:03.935 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 811, 2024-05-10T03:44:03.935 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 55, 2024-05-10T03:44:03.935 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 804, 2024-05-10T03:44:03.935 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 749, 2024-05-10T03:44:03.935 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 35, 2024-05-10T03:44:03.935 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 1576, 2024-05-10T03:44:03.935 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 1541, 2024-05-10T03:44:03.936 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 2, 2024-05-10T03:44:03.936 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 211, 2024-05-10T03:44:03.936 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 209, 2024-05-10T03:44:03.936 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 123568, 2024-05-10T03:44:03.936 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 199060 2024-05-10T03:44:03.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.936 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-05-10T03:44:03.936 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 480, 2024-05-10T03:44:03.936 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 56, 2024-05-10T03:44:03.936 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 398, 2024-05-10T03:44:03.936 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 3, 2024-05-10T03:44:03.936 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 147, 2024-05-10T03:44:03.936 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-05-10T03:44:03.936 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 79, 2024-05-10T03:44:03.937 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.054965756, 2024-05-10T03:44:03.937 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000695769 2024-05-10T03:44:03.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.937 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-05-10T03:44:03.937 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.937 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.937 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.937 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-05-10T03:44:03.937 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.937 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.937 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.937 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-05-10T03:44:03.938 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.938 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.938 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.938 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-05-10T03:44:03.938 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 96, 2024-05-10T03:44:03.938 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.037787451, 2024-05-10T03:44:03.938 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000393619 2024-05-10T03:44:03.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.938 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-05-10T03:44:03.938 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.938 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.938 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.939 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-05-10T03:44:03.939 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2, 2024-05-10T03:44:03.939 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000393228, 2024-05-10T03:44:03.939 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000196614 2024-05-10T03:44:03.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.939 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-05-10T03:44:03.939 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.939 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.939 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.939 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-05-10T03:44:03.939 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.939 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.939 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.940 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-05-10T03:44:03.940 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.940 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.940 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.940 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-05-10T03:44:03.940 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.940 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.940 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.940 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-05-10T03:44:03.940 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.941 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.941 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.941 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-05-10T03:44:03.941 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.941 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.941 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.941 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-05-10T03:44:03.941 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.941 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.941 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.942 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-05-10T03:44:03.942 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.942 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.942 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.942 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-05-10T03:44:03.942 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 24, 2024-05-10T03:44:03.942 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.015827176, 2024-05-10T03:44:03.942 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000659465 2024-05-10T03:44:03.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.942 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-05-10T03:44:03.942 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.943 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.943 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.943 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-05-10T03:44:03.943 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.943 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.943 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.943 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-05-10T03:44:03.943 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.943 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.943 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.943 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-05-10T03:44:03.944 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1, 2024-05-10T03:44:03.944 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.022548950, 2024-05-10T03:44:03.944 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.022548950 2024-05-10T03:44:03.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.944 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-05-10T03:44:03.944 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.944 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.944 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.944 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-05-10T03:44:03.944 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.944 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.944 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.944 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-05-10T03:44:03.944 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.945 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.945 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.945 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-05-10T03:44:03.945 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.945 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.945 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.945 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-05-10T03:44:03.945 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.945 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.945 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.946 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-05-10T03:44:03.946 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.946 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.946 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.946 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-05-10T03:44:03.946 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.946 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.946 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.946 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-05-10T03:44:03.946 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.946 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.947 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.947 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-05-10T03:44:03.947 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 194, 2024-05-10T03:44:03.947 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.291561500, 2024-05-10T03:44:03.947 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001502894 2024-05-10T03:44:03.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.947 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-05-10T03:44:03.947 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-05-10T03:44:03.947 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-05-10T03:44:03.947 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.947 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.947 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.947 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:03.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.948 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-05-10T03:44:03.948 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 1, 2024-05-10T03:44:03.948 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 1, 2024-05-10T03:44:03.948 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 0, 2024-05-10T03:44:03.948 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 1, 2024-05-10T03:44:03.948 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-05-10T03:44:03.948 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 266, 2024-05-10T03:44:03.948 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 266, 2024-05-10T03:44:03.948 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 228, 2024-05-10T03:44:03.948 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-05-10T03:44:03.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.949 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-05-10T03:44:03.949 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-05-10T03:44:03.949 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-05-10T03:44:03.949 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-05-10T03:44:03.949 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-05-10T03:44:03.949 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-05-10T03:44:03.949 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-05-10T03:44:03.949 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-10T03:44:03.949 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-05-10T03:44:03.949 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-10T03:44:03.949 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-05-10T03:44:03.949 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-05-10T03:44:03.949 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-05-10T03:44:03.950 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-10T03:44:03.950 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-05-10T03:44:03.950 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-05-10T03:44:03.950 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-05-10T03:44:03.950 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-05-10T03:44:03.950 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-05-10T03:44:03.950 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-10T03:44:03.950 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-05-10T03:44:03.950 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-10T03:44:03.950 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-05-10T03:44:03.950 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-05-10T03:44:03.950 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-05-10T03:44:03.950 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-05-10T03:44:03.951 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-05-10T03:44:03.951 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-10T03:44:03.951 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-05-10T03:44:03.951 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-05-10T03:44:03.951 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-05-10T03:44:03.951 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-05-10T03:44:03.951 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-05-10T03:44:03.951 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-05-10T03:44:03.951 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-05-10T03:44:03.951 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-05-10T03:44:03.951 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-05-10T03:44:03.951 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 299751, 2024-05-10T03:44:03.951 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 131, 2024-05-10T03:44:03.952 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 792, 2024-05-10T03:44:03.952 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 9, 2024-05-10T03:44:03.952 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-05-10T03:44:03.952 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-05-10T03:44:03.952 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-05-10T03:44:03.952 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-05-10T03:44:03.953 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-05-10T03:44:03.953 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-05-10T03:44:03.953 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 9176, 2024-05-10T03:44:03.953 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 176, 2024-05-10T03:44:03.953 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-05-10T03:44:03.953 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-05-10T03:44:03.953 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-05-10T03:44:03.953 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-05-10T03:44:03.953 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 189157, 2024-05-10T03:44:03.953 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 653, 2024-05-10T03:44:03.953 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-05-10T03:44:03.953 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-05-10T03:44:03.953 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-05-10T03:44:03.953 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-05-10T03:44:03.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.954 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-05-10T03:44:03.954 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-05-10T03:44:03.954 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-05-10T03:44:03.954 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 691, 2024-05-10T03:44:03.954 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 1567191, 2024-05-10T03:44:03.954 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 33, 2024-05-10T03:44:03.954 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 691, 2024-05-10T03:44:03.954 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-05-10T03:44:03.954 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 691, 2024-05-10T03:44:03.955 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 2.434934727, 2024-05-10T03:44:03.955 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.003523783 2024-05-10T03:44:03.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.955 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-05-10T03:44:03.955 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-05-10T03:44:03.955 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 691, 2024-05-10T03:44:03.955 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 735 2024-05-10T03:44:03.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.955 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 691, 2024-05-10T03:44:03.955 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 97, 2024-05-10T03:44:03.955 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 594, 2024-05-10T03:44:03.955 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-05-10T03:44:03.955 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-05-10T03:44:03.956 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 0, 2024-05-10T03:44:03.956 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 10, 2024-05-10T03:44:03.956 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 28, 2024-05-10T03:44:03.956 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 127, 2024-05-10T03:44:03.956 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 28, 2024-05-10T03:44:03.956 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-05-10T03:44:03.956 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-05-10T03:44:03.956 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-05-10T03:44:03.956 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-05-10T03:44:03.956 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 401, 2024-05-10T03:44:03.956 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-05-10T03:44:03.956 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-05-10T03:44:03.956 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-05-10T03:44:03.956 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 69, 2024-05-10T03:44:03.957 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 20, 2024-05-10T03:44:03.957 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-05-10T03:44:03.957 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-05-10T03:44:03.957 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-05-10T03:44:03.957 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-05-10T03:44:03.957 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-05-10T03:44:03.957 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-05-10T03:44:03.957 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-05-10T03:44:03.957 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-05-10T03:44:03.957 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-05-10T03:44:03.957 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-05-10T03:44:03.957 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-05-10T03:44:03.957 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-05-10T03:44:03.958 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-05-10T03:44:03.958 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-05-10T03:44:03.958 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-05-10T03:44:03.958 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-05-10T03:44:03.958 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-05-10T03:44:03.958 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-05-10T03:44:03.958 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-05-10T03:44:03.958 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-05-10T03:44:03.958 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-05-10T03:44:03.958 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-05-10T03:44:03.958 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-05-10T03:44:03.958 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-05-10T03:44:03.958 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-05-10T03:44:03.959 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-05-10T03:44:03.959 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 90, 2024-05-10T03:44:03.959 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-05-10T03:44:03.959 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 4, 2024-05-10T03:44:03.959 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 12, 2024-05-10T03:44:03.959 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 12, 2024-05-10T03:44:03.959 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-05-10T03:44:03.959 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-05-10T03:44:03.959 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 41, 2024-05-10T03:44:03.960 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 0, 2024-05-10T03:44:03.960 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 11 2024-05-10T03:44:03.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.960 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-05-10T03:44:03.960 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 1, 2024-05-10T03:44:03.960 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-05-10T03:44:03.960 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-05-10T03:44:03.960 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-05-10T03:44:03.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.960 INFO:teuthology.orchestra.run.smithi154.stdout: "osd-slow-ops": { 2024-05-10T03:44:03.960 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-05-10T03:44:03.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.960 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-05-10T03:44:03.960 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-05-10T03:44:03.960 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 10, 2024-05-10T03:44:03.961 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-05-10T03:44:03.961 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 5, 2024-05-10T03:44:03.961 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 195, 2024-05-10T03:44:03.961 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-05-10T03:44:03.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.961 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-10T03:44:03.961 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-05-10T03:44:03.961 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-05-10T03:44:03.961 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-05-10T03:44:03.961 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 15848, 2024-05-10T03:44:03.961 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 5592685, 2024-05-10T03:44:03.961 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-05-10T03:44:03.961 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 15848, 2024-05-10T03:44:03.961 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-05-10T03:44:03.962 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-05-10T03:44:03.962 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 15848, 2024-05-10T03:44:03.962 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 5592685, 2024-05-10T03:44:03.962 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-05-10T03:44:03.962 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.962 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.962 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.962 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:03.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.966 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-05-10T03:44:03.966 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-05-10T03:44:03.966 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-05-10T03:44:03.967 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-05-10T03:44:03.967 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-05-10T03:44:03.967 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-05-10T03:44:03.967 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-05-10T03:44:03.967 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-05-10T03:44:03.967 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 691, 2024-05-10T03:44:03.967 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 1588438, 2024-05-10T03:44:03.967 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 691, 2024-05-10T03:44:03.967 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 1588438, 2024-05-10T03:44:03.967 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-05-10T03:44:03.967 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.967 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.968 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.968 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:03.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.968 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-05-10T03:44:03.968 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-05-10T03:44:03.968 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-05-10T03:44:03.968 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-05-10T03:44:03.968 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-05-10T03:44:03.968 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-05-10T03:44:03.968 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-05-10T03:44:03.968 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-05-10T03:44:03.968 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 691, 2024-05-10T03:44:03.968 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 691, 2024-05-10T03:44:03.968 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 691, 2024-05-10T03:44:03.968 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 691, 2024-05-10T03:44:03.969 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-05-10T03:44:03.969 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.969 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.969 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.969 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:03.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.969 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-05-10T03:44:03.969 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-05-10T03:44:03.969 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-05-10T03:44:03.969 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-05-10T03:44:03.970 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 195, 2024-05-10T03:44:03.970 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 21247, 2024-05-10T03:44:03.970 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-05-10T03:44:03.970 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 195, 2024-05-10T03:44:03.970 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-05-10T03:44:03.970 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-05-10T03:44:03.970 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 28, 2024-05-10T03:44:03.970 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 21247, 2024-05-10T03:44:03.970 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-05-10T03:44:03.970 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.970 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.970 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.971 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:03.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:03.971 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x558158a324e0": { 2024-05-10T03:44:03.971 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-05-10T03:44:03.971 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-05-10T03:44:03.971 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-05-10T03:44:03.971 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 884, 2024-05-10T03:44:03.971 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 1505682, 2024-05-10T03:44:03.971 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-05-10T03:44:03.971 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 884, 2024-05-10T03:44:03.971 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-05-10T03:44:03.971 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-05-10T03:44:03.971 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 99, 2024-05-10T03:44:03.971 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 1505682, 2024-05-10T03:44:03.971 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-05-10T03:44:03.972 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:03.972 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:03.972 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:03.972 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:03.972 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:03.972 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-05-10T03:44:04.244 INFO:tasks.check_counter:Daemon mds.c mds.exported=13 2024-05-10T03:44:04.244 INFO:tasks.check_counter:Daemon mds.c mds.imported=13 2024-05-10T03:44:04.244 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=97 2024-05-10T03:44:04.244 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=2148 2024-05-10T03:44:04.244 DEBUG:tasks.check_counter:Getting stats from f 2024-05-10T03:44:04.245 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph daemon mds.f perf dump 2024-05-10T03:44:04.468 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T03:44:05.224 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:05 smithi154 ceph-mon[46565]: pgmap v399: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.3 KiB/s wr, 11 op/s 2024-05-10T03:44:05.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:05 smithi106 ceph-mon[46996]: pgmap v399: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.3 KiB/s wr, 11 op/s 2024-05-10T03:44:05.506 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-05-10T03:44:05.506 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-05-10T03:44:05.507 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 650, 2024-05-10T03:44:05.507 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 651, 2024-05-10T03:44:05.507 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 7940675, 2024-05-10T03:44:05.507 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 201849, 2024-05-10T03:44:05.507 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 6, 2024-05-10T03:44:05.507 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 2, 2024-05-10T03:44:05.507 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.071622193, 2024-05-10T03:44:05.507 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.019039201, 2024-05-10T03:44:05.507 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.024371723, 2024-05-10T03:44:05.507 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.020908068, 2024-05-10T03:44:05.507 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:44:05.507 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 649, 2024-05-10T03:44:05.507 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.028598054, 2024-05-10T03:44:05.508 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000044064 2024-05-10T03:44:05.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.508 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:44:05.508 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.508 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.508 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.508 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-10T03:44:05.508 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 0 2024-05-10T03:44:05.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.508 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-05-10T03:44:05.508 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 165, 2024-05-10T03:44:05.508 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 148, 2024-05-10T03:44:05.508 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 8941399, 2024-05-10T03:44:05.509 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 68735, 2024-05-10T03:44:05.509 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 4, 2024-05-10T03:44:05.509 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 3, 2024-05-10T03:44:05.509 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.026990229, 2024-05-10T03:44:05.509 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.006795972, 2024-05-10T03:44:05.509 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.018933169, 2024-05-10T03:44:05.509 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.003462986, 2024-05-10T03:44:05.509 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:44:05.509 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 147, 2024-05-10T03:44:05.509 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.009825542, 2024-05-10T03:44:05.509 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000066840 2024-05-10T03:44:05.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.509 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:44:05.510 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.510 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.510 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.510 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 540048, 2024-05-10T03:44:05.510 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 55296 2024-05-10T03:44:05.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.510 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-05-10T03:44:05.510 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 326, 2024-05-10T03:44:05.510 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 396, 2024-05-10T03:44:05.510 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 4277970, 2024-05-10T03:44:05.510 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 293896, 2024-05-10T03:44:05.510 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 5, 2024-05-10T03:44:05.511 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 4, 2024-05-10T03:44:05.511 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.039016755, 2024-05-10T03:44:05.511 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.013203854, 2024-05-10T03:44:05.511 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.010453252, 2024-05-10T03:44:05.511 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.011375824, 2024-05-10T03:44:05.511 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:44:05.511 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 395, 2024-05-10T03:44:05.511 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.021567337, 2024-05-10T03:44:05.511 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000054600 2024-05-10T03:44:05.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.512 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:44:05.512 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.512 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.512 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.512 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-05-10T03:44:05.512 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 194064 2024-05-10T03:44:05.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.512 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-05-10T03:44:05.512 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-05-10T03:44:05.512 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-05-10T03:44:05.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.513 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-05-10T03:44:05.513 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-05-10T03:44:05.513 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-05-10T03:44:05.513 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1654, 2024-05-10T03:44:05.513 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.062359840, 2024-05-10T03:44:05.513 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000037702 2024-05-10T03:44:05.513 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:05.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.513 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-05-10T03:44:05.513 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-05-10T03:44:05.513 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-05-10T03:44:05.513 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.514 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.514 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.514 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:05.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.514 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-05-10T03:44:05.514 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 0, 2024-05-10T03:44:05.514 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 0, 2024-05-10T03:44:05.514 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-05-10T03:44:05.514 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.514 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.514 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.514 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-05-10T03:44:05.514 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 0, 2024-05-10T03:44:05.515 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-05-10T03:44:05.515 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-05-10T03:44:05.515 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 0, 2024-05-10T03:44:05.515 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-05-10T03:44:05.515 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-05-10T03:44:05.515 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 897, 2024-05-10T03:44:05.515 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 592, 2024-05-10T03:44:05.515 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 305, 2024-05-10T03:44:05.515 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-05-10T03:44:05.515 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 50, 2024-05-10T03:44:05.515 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 0, 2024-05-10T03:44:05.515 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-05-10T03:44:05.515 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-05-10T03:44:05.516 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 2, 2024-05-10T03:44:05.516 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 0, 2024-05-10T03:44:05.516 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 0, 2024-05-10T03:44:05.516 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-05-10T03:44:05.516 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 0, 2024-05-10T03:44:05.516 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-05-10T03:44:05.516 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-05-10T03:44:05.516 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-05-10T03:44:05.516 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-05-10T03:44:05.516 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-05-10T03:44:05.516 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-05-10T03:44:05.516 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-05-10T03:44:05.516 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-05-10T03:44:05.516 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-05-10T03:44:05.517 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-05-10T03:44:05.517 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-05-10T03:44:05.517 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-05-10T03:44:05.517 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 4, 2024-05-10T03:44:05.517 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 234, 2024-05-10T03:44:05.517 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-05-10T03:44:05.517 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-05-10T03:44:05.517 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-05-10T03:44:05.517 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-05-10T03:44:05.517 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-05-10T03:44:05.517 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-05-10T03:44:05.517 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-05-10T03:44:05.517 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-05-10T03:44:05.517 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-05-10T03:44:05.517 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-05-10T03:44:05.518 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-05-10T03:44:05.518 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-05-10T03:44:05.518 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-05-10T03:44:05.518 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-10T03:44:05.518 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-10T03:44:05.518 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-05-10T03:44:05.518 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-05-10T03:44:05.518 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-05-10T03:44:05.518 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-05-10T03:44:05.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.518 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-05-10T03:44:05.518 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-05-10T03:44:05.518 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-05-10T03:44:05.519 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-05-10T03:44:05.519 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 0, 2024-05-10T03:44:05.519 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-05-10T03:44:05.519 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-05-10T03:44:05.519 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-05-10T03:44:05.519 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-05-10T03:44:05.519 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-05-10T03:44:05.519 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-05-10T03:44:05.519 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-05-10T03:44:05.519 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-05-10T03:44:05.519 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-05-10T03:44:05.519 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-05-10T03:44:05.519 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-05-10T03:44:05.519 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-05-10T03:44:05.520 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-05-10T03:44:05.520 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-05-10T03:44:05.520 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-05-10T03:44:05.520 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-05-10T03:44:05.520 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-05-10T03:44:05.520 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-05-10T03:44:05.520 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0 2024-05-10T03:44:05.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.520 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-05-10T03:44:05.520 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 0, 2024-05-10T03:44:05.520 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-05-10T03:44:05.520 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-05-10T03:44:05.521 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 8887, 2024-05-10T03:44:05.521 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-05-10T03:44:05.521 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-05-10T03:44:05.521 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 0, 2024-05-10T03:44:05.521 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-05-10T03:44:05.521 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-05-10T03:44:05.521 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 2, 2024-05-10T03:44:05.521 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-05-10T03:44:05.521 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-05-10T03:44:05.521 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 24446218, 2024-05-10T03:44:05.521 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 24522380, 2024-05-10T03:44:05.521 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 24518079, 2024-05-10T03:44:05.521 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-05-10T03:44:05.521 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.522 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.522 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.522 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 8887 2024-05-10T03:44:05.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.522 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-05-10T03:44:05.522 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 22, 2024-05-10T03:44:05.522 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 5122, 2024-05-10T03:44:05.523 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 5100, 2024-05-10T03:44:05.523 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 24, 2024-05-10T03:44:05.523 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 457, 2024-05-10T03:44:05.523 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 433, 2024-05-10T03:44:05.523 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 897, 2024-05-10T03:44:05.523 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 5685, 2024-05-10T03:44:05.523 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 4788, 2024-05-10T03:44:05.523 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-05-10T03:44:05.523 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 0, 2024-05-10T03:44:05.523 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-05-10T03:44:05.523 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 123356, 2024-05-10T03:44:05.523 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 207252 2024-05-10T03:44:05.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.524 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-05-10T03:44:05.524 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 0, 2024-05-10T03:44:05.524 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-05-10T03:44:05.524 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 0, 2024-05-10T03:44:05.524 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 0, 2024-05-10T03:44:05.524 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-05-10T03:44:05.524 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-05-10T03:44:05.524 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.524 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.524 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.524 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-05-10T03:44:05.525 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.525 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.525 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.525 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-05-10T03:44:05.525 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.525 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.525 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.525 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-05-10T03:44:05.525 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.525 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.525 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.525 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-05-10T03:44:05.526 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.526 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.526 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.526 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-05-10T03:44:05.526 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.526 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.526 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.526 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-05-10T03:44:05.526 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.526 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.526 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.527 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-05-10T03:44:05.527 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.527 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.527 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.527 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-05-10T03:44:05.527 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.527 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.527 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.527 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-05-10T03:44:05.527 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.527 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.528 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.528 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-05-10T03:44:05.528 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.528 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.528 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.528 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-05-10T03:44:05.528 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.528 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.528 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.529 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-05-10T03:44:05.529 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.529 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.529 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.529 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-05-10T03:44:05.529 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.529 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.529 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.529 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-05-10T03:44:05.530 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.530 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.530 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.530 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-05-10T03:44:05.530 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.530 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.530 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.530 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-05-10T03:44:05.530 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.530 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.531 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.531 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-05-10T03:44:05.531 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.531 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.531 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.531 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-05-10T03:44:05.531 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.531 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.531 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.531 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-05-10T03:44:05.532 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.532 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.532 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.532 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-05-10T03:44:05.532 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.532 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.532 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.532 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-05-10T03:44:05.532 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.533 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.533 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.533 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-05-10T03:44:05.533 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.533 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.533 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.533 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-05-10T03:44:05.533 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.533 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.533 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.534 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-05-10T03:44:05.534 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.534 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.534 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.534 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-05-10T03:44:05.534 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.534 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.534 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.534 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-05-10T03:44:05.535 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.535 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.535 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.535 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-05-10T03:44:05.535 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.535 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.535 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.535 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-05-10T03:44:05.535 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.536 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.536 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.536 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-05-10T03:44:05.536 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-05-10T03:44:05.536 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-05-10T03:44:05.536 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.536 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.536 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.536 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:05.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.536 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-05-10T03:44:05.537 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 1, 2024-05-10T03:44:05.537 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 3, 2024-05-10T03:44:05.537 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 2, 2024-05-10T03:44:05.537 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 2, 2024-05-10T03:44:05.537 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-05-10T03:44:05.537 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 0, 2024-05-10T03:44:05.537 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 0, 2024-05-10T03:44:05.537 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 3107, 2024-05-10T03:44:05.537 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-05-10T03:44:05.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.537 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-05-10T03:44:05.537 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-05-10T03:44:05.538 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-05-10T03:44:05.538 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-05-10T03:44:05.538 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-05-10T03:44:05.538 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-05-10T03:44:05.538 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-05-10T03:44:05.538 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-10T03:44:05.538 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-05-10T03:44:05.538 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-10T03:44:05.538 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-05-10T03:44:05.538 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-05-10T03:44:05.538 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-05-10T03:44:05.538 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-10T03:44:05.538 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-05-10T03:44:05.538 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-05-10T03:44:05.539 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-05-10T03:44:05.539 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-05-10T03:44:05.539 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-05-10T03:44:05.539 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-10T03:44:05.539 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-05-10T03:44:05.539 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-10T03:44:05.539 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-05-10T03:44:05.539 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-05-10T03:44:05.539 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-05-10T03:44:05.539 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-05-10T03:44:05.539 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-05-10T03:44:05.539 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-10T03:44:05.539 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-05-10T03:44:05.540 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-05-10T03:44:05.540 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-05-10T03:44:05.540 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-05-10T03:44:05.540 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-05-10T03:44:05.540 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-05-10T03:44:05.540 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-05-10T03:44:05.540 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-05-10T03:44:05.540 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-05-10T03:44:05.540 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 197512, 2024-05-10T03:44:05.540 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 58, 2024-05-10T03:44:05.540 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-05-10T03:44:05.540 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-05-10T03:44:05.540 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-05-10T03:44:05.541 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-05-10T03:44:05.541 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-05-10T03:44:05.541 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-05-10T03:44:05.541 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-05-10T03:44:05.541 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-05-10T03:44:05.541 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 9176, 2024-05-10T03:44:05.541 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 176, 2024-05-10T03:44:05.541 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-05-10T03:44:05.541 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-05-10T03:44:05.541 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-05-10T03:44:05.541 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-05-10T03:44:05.541 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 711142, 2024-05-10T03:44:05.541 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 4974, 2024-05-10T03:44:05.542 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-05-10T03:44:05.542 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-05-10T03:44:05.542 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-05-10T03:44:05.542 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-05-10T03:44:05.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.542 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-05-10T03:44:05.542 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-05-10T03:44:05.542 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-05-10T03:44:05.542 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 1013, 2024-05-10T03:44:05.542 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 26, 2024-05-10T03:44:05.542 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 4, 2024-05-10T03:44:05.542 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 1013, 2024-05-10T03:44:05.542 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-05-10T03:44:05.542 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1013, 2024-05-10T03:44:05.543 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 1.051971808, 2024-05-10T03:44:05.543 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001038471 2024-05-10T03:44:05.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.543 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-05-10T03:44:05.543 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-05-10T03:44:05.543 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1013, 2024-05-10T03:44:05.543 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 1014 2024-05-10T03:44:05.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.543 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 1013, 2024-05-10T03:44:05.543 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 1013, 2024-05-10T03:44:05.543 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 0, 2024-05-10T03:44:05.543 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-05-10T03:44:05.543 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-05-10T03:44:05.543 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 618, 2024-05-10T03:44:05.544 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 0, 2024-05-10T03:44:05.544 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 392, 2024-05-10T03:44:05.544 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 0, 2024-05-10T03:44:05.544 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 0, 2024-05-10T03:44:05.544 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-05-10T03:44:05.544 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-05-10T03:44:05.544 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-05-10T03:44:05.544 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-05-10T03:44:05.544 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 0, 2024-05-10T03:44:05.544 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-05-10T03:44:05.544 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-05-10T03:44:05.544 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-05-10T03:44:05.544 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 2, 2024-05-10T03:44:05.545 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 0, 2024-05-10T03:44:05.545 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-05-10T03:44:05.545 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-05-10T03:44:05.545 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-05-10T03:44:05.545 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-05-10T03:44:05.545 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-05-10T03:44:05.545 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-05-10T03:44:05.545 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-05-10T03:44:05.545 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-05-10T03:44:05.545 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-05-10T03:44:05.545 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-05-10T03:44:05.545 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-05-10T03:44:05.545 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-05-10T03:44:05.545 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-05-10T03:44:05.546 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-05-10T03:44:05.546 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-05-10T03:44:05.546 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-05-10T03:44:05.546 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-05-10T03:44:05.546 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-05-10T03:44:05.546 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-05-10T03:44:05.546 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-05-10T03:44:05.546 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-05-10T03:44:05.546 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-05-10T03:44:05.546 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-05-10T03:44:05.546 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-05-10T03:44:05.546 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-05-10T03:44:05.546 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-05-10T03:44:05.547 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 90, 2024-05-10T03:44:05.547 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-05-10T03:44:05.547 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 4, 2024-05-10T03:44:05.547 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 6, 2024-05-10T03:44:05.547 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 6, 2024-05-10T03:44:05.547 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-05-10T03:44:05.547 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-05-10T03:44:05.547 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 0, 2024-05-10T03:44:05.547 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 2, 2024-05-10T03:44:05.547 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 0 2024-05-10T03:44:05.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.547 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-05-10T03:44:05.547 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 0, 2024-05-10T03:44:05.547 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-05-10T03:44:05.548 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-05-10T03:44:05.548 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-05-10T03:44:05.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.548 INFO:teuthology.orchestra.run.smithi154.stdout: "osd-slow-ops": { 2024-05-10T03:44:05.548 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-05-10T03:44:05.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.548 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-05-10T03:44:05.548 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-05-10T03:44:05.548 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-05-10T03:44:05.548 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-05-10T03:44:05.548 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-05-10T03:44:05.548 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-05-10T03:44:05.548 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-05-10T03:44:05.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.549 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-10T03:44:05.549 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-05-10T03:44:05.549 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-05-10T03:44:05.549 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-05-10T03:44:05.549 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 1137, 2024-05-10T03:44:05.549 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 21048459, 2024-05-10T03:44:05.549 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-05-10T03:44:05.549 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 1137, 2024-05-10T03:44:05.549 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-05-10T03:44:05.549 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-05-10T03:44:05.549 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 1137, 2024-05-10T03:44:05.549 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 21048459, 2024-05-10T03:44:05.549 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-05-10T03:44:05.550 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.550 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.550 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.550 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:05.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.550 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-05-10T03:44:05.550 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-05-10T03:44:05.550 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-05-10T03:44:05.550 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-05-10T03:44:05.550 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-05-10T03:44:05.550 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-05-10T03:44:05.550 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-05-10T03:44:05.550 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-05-10T03:44:05.550 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 1013, 2024-05-10T03:44:05.551 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 20333250, 2024-05-10T03:44:05.551 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 1013, 2024-05-10T03:44:05.551 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 20333250, 2024-05-10T03:44:05.551 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-05-10T03:44:05.551 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.551 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.551 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.551 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:05.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.551 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-05-10T03:44:05.551 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-05-10T03:44:05.551 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-05-10T03:44:05.551 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-05-10T03:44:05.551 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-05-10T03:44:05.552 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-05-10T03:44:05.552 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-05-10T03:44:05.552 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-05-10T03:44:05.552 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 1013, 2024-05-10T03:44:05.552 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 1013, 2024-05-10T03:44:05.552 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 1013, 2024-05-10T03:44:05.552 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 1013, 2024-05-10T03:44:05.552 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-05-10T03:44:05.552 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.552 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.552 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.552 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:05.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.552 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-05-10T03:44:05.552 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-05-10T03:44:05.553 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-05-10T03:44:05.553 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-05-10T03:44:05.553 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-05-10T03:44:05.553 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-05-10T03:44:05.553 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-05-10T03:44:05.553 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-05-10T03:44:05.553 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-05-10T03:44:05.553 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-05-10T03:44:05.553 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-05-10T03:44:05.553 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-05-10T03:44:05.553 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-05-10T03:44:05.553 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.553 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.553 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.553 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:05.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:05.554 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x55bffd7024e0": { 2024-05-10T03:44:05.554 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-05-10T03:44:05.554 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-05-10T03:44:05.554 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-05-10T03:44:05.554 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-05-10T03:44:05.554 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-05-10T03:44:05.554 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-05-10T03:44:05.554 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-05-10T03:44:05.554 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-05-10T03:44:05.554 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-05-10T03:44:05.554 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-05-10T03:44:05.554 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-05-10T03:44:05.554 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-05-10T03:44:05.555 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:05.555 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:05.555 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:05.555 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:05.555 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:05.555 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-05-10T03:44:05.555 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:05 smithi045 ceph-mon[42520]: pgmap v399: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.3 KiB/s wr, 11 op/s 2024-05-10T03:44:05.916 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-05-10T03:44:05.916 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-05-10T03:44:05.916 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-05-10T03:44:05.916 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-05-10T03:44:05.917 DEBUG:tasks.check_counter:Getting stats from i 2024-05-10T03:44:05.917 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph daemon mds.i perf dump 2024-05-10T03:44:06.140 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T03:44:07.190 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-05-10T03:44:07.190 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-05-10T03:44:07.190 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 34628, 2024-05-10T03:44:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 64406, 2024-05-10T03:44:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 11488092, 2024-05-10T03:44:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 53823591, 2024-05-10T03:44:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 21, 2024-05-10T03:44:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 4, 2024-05-10T03:44:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 2.396377314, 2024-05-10T03:44:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 1.086752539, 2024-05-10T03:44:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 5.139686893, 2024-05-10T03:44:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.156103150, 2024-05-10T03:44:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:44:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 64404, 2024-05-10T03:44:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 3.214166682, 2024-05-10T03:44:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000049906 2024-05-10T03:44:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:44:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 75613, 2024-05-10T03:44:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.011722146, 2024-05-10T03:44:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000155 2024-05-10T03:44:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 9092768, 2024-05-10T03:44:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 26184768 2024-05-10T03:44:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-05-10T03:44:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 11007, 2024-05-10T03:44:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 14764, 2024-05-10T03:44:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 3149238, 2024-05-10T03:44:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 34371607, 2024-05-10T03:44:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 8, 2024-05-10T03:44:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 7, 2024-05-10T03:44:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.793051501, 2024-05-10T03:44:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.306634036, 2024-05-10T03:44:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.278959293, 2024-05-10T03:44:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.187034664, 2024-05-10T03:44:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:44:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 14763, 2024-05-10T03:44:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 1.001456850, 2024-05-10T03:44:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000067835 2024-05-10T03:44:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:44:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 10013, 2024-05-10T03:44:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.002764617, 2024-05-10T03:44:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000276 2024-05-10T03:44:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 562176, 2024-05-10T03:44:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 112464 2024-05-10T03:44:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-05-10T03:44:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 17343, 2024-05-10T03:44:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 21854, 2024-05-10T03:44:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 6311635, 2024-05-10T03:44:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 16294864, 2024-05-10T03:44:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 12, 2024-05-10T03:44:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 8, 2024-05-10T03:44:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 1.006672939, 2024-05-10T03:44:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.391080995, 2024-05-10T03:44:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.593263546, 2024-05-10T03:44:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.091355856, 2024-05-10T03:44:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:44:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 21853, 2024-05-10T03:44:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 1.312442126, 2024-05-10T03:44:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000060057 2024-05-10T03:44:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:44:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 30948, 2024-05-10T03:44:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.005407054, 2024-05-10T03:44:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000174 2024-05-10T03:44:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-05-10T03:44:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 195600 2024-05-10T03:44:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-05-10T03:44:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-05-10T03:44:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-05-10T03:44:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-05-10T03:44:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-05-10T03:44:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-05-10T03:44:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 3433, 2024-05-10T03:44:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 14.670161338, 2024-05-10T03:44:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.004273277 2024-05-10T03:44:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-05-10T03:44:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-05-10T03:44:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-05-10T03:44:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 11590, 2024-05-10T03:44:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 2.855275640, 2024-05-10T03:44:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000246356 2024-05-10T03:44:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-05-10T03:44:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 14298, 2024-05-10T03:44:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 14272, 2024-05-10T03:44:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-05-10T03:44:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 14272, 2024-05-10T03:44:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 29.083547522, 2024-05-10T03:44:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.002037804 2024-05-10T03:44:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-05-10T03:44:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 26, 2024-05-10T03:44:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-05-10T03:44:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-05-10T03:44:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 90, 2024-05-10T03:44:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 9, 2024-05-10T03:44:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 3, 2024-05-10T03:44:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 1531, 2024-05-10T03:44:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 456, 2024-05-10T03:44:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 201, 2024-05-10T03:44:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 874, 2024-05-10T03:44:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 877, 2024-05-10T03:44:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 1030, 2024-05-10T03:44:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-05-10T03:44:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-05-10T03:44:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 7, 2024-05-10T03:44:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 16219, 2024-05-10T03:44:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 15199, 2024-05-10T03:44:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-05-10T03:44:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 454, 2024-05-10T03:44:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-05-10T03:44:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-05-10T03:44:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-05-10T03:44:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-05-10T03:44:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-05-10T03:44:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 40, 2024-05-10T03:44:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 396, 2024-05-10T03:44:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 53, 2024-05-10T03:44:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 516, 2024-05-10T03:44:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-05-10T03:44:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 3419, 2024-05-10T03:44:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-05-10T03:44:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 434, 2024-05-10T03:44:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 82823115, 2024-05-10T03:44:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-05-10T03:44:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 3419, 2024-05-10T03:44:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-05-10T03:44:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-05-10T03:44:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-05-10T03:44:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 297, 2024-05-10T03:44:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-05-10T03:44:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 297, 2024-05-10T03:44:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 3122, 2024-05-10T03:44:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 56, 2024-05-10T03:44:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 1223, 2024-05-10T03:44:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 14205, 2024-05-10T03:44:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-05-10T03:44:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-10T03:44:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-10T03:44:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 10148, 2024-05-10T03:44:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 6782, 2024-05-10T03:44:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 575, 2024-05-10T03:44:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 7934 2024-05-10T03:44:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-05-10T03:44:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 1172, 2024-05-10T03:44:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 1193, 2024-05-10T03:44:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 813, 2024-05-10T03:44:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 767, 2024-05-10T03:44:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 2532, 2024-05-10T03:44:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 38, 2024-05-10T03:44:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-05-10T03:44:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-05-10T03:44:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 6532, 2024-05-10T03:44:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 6494, 2024-05-10T03:44:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-05-10T03:44:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-05-10T03:44:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-05-10T03:44:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-05-10T03:44:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-05-10T03:44:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-05-10T03:44:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-05-10T03:44:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-05-10T03:44:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 40, 2024-05-10T03:44:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-05-10T03:44:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 12, 2024-05-10T03:44:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-05-10T03:44:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0 2024-05-10T03:44:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-05-10T03:44:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 30820, 2024-05-10T03:44:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-05-10T03:44:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-05-10T03:44:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 30820, 2024-05-10T03:44:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-05-10T03:44:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-05-10T03:44:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 38, 2024-05-10T03:44:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-05-10T03:44:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-05-10T03:44:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 38, 2024-05-10T03:44:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-05-10T03:44:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-05-10T03:44:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4194304, 2024-05-10T03:44:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 67928170, 2024-05-10T03:44:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 0, 2024-05-10T03:44:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-05-10T03:44:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1022, 2024-05-10T03:44:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 36.311899658, 2024-05-10T03:44:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.035530234 2024-05-10T03:44:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 0 2024-05-10T03:44:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-05-10T03:44:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 73, 2024-05-10T03:44:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 7275, 2024-05-10T03:44:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 7202, 2024-05-10T03:44:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 100, 2024-05-10T03:44:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 820, 2024-05-10T03:44:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 720, 2024-05-10T03:44:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 1531, 2024-05-10T03:44:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 11050, 2024-05-10T03:44:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 9519, 2024-05-10T03:44:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-05-10T03:44:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 6931, 2024-05-10T03:44:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 6931, 2024-05-10T03:44:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 160632, 2024-05-10T03:44:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 199060 2024-05-10T03:44:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-05-10T03:44:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 16942, 2024-05-10T03:44:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 113, 2024-05-10T03:44:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 14298, 2024-05-10T03:44:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 37, 2024-05-10T03:44:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 478, 2024-05-10T03:44:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-05-10T03:44:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 6143, 2024-05-10T03:44:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 8.037356998, 2024-05-10T03:44:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001308376 2024-05-10T03:44:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-05-10T03:44:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 26, 2024-05-10T03:44:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.025376884, 2024-05-10T03:44:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000976034 2024-05-10T03:44:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-05-10T03:44:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-05-10T03:44:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-05-10T03:44:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 665, 2024-05-10T03:44:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.338042137, 2024-05-10T03:44:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000508334 2024-05-10T03:44:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-05-10T03:44:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-05-10T03:44:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-05-10T03:44:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-05-10T03:44:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.210 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.210 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-05-10T03:44:07.210 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.210 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.210 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.210 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-05-10T03:44:07.210 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.210 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.210 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.210 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-05-10T03:44:07.211 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 274, 2024-05-10T03:44:07.211 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.209273408, 2024-05-10T03:44:07.211 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000763771 2024-05-10T03:44:07.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.211 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-05-10T03:44:07.211 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.211 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.211 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.211 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-05-10T03:44:07.211 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.211 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.211 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.212 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-05-10T03:44:07.212 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.212 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.212 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.212 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-05-10T03:44:07.212 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 601, 2024-05-10T03:44:07.212 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 1.388469977, 2024-05-10T03:44:07.212 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.002310266 2024-05-10T03:44:07.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.212 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-05-10T03:44:07.212 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.212 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.212 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.213 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-05-10T03:44:07.213 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.213 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.213 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.213 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-05-10T03:44:07.213 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.213 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.213 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.213 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-05-10T03:44:07.213 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 300, 2024-05-10T03:44:07.213 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 5.611666966, 2024-05-10T03:44:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.018705556 2024-05-10T03:44:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-05-10T03:44:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-05-10T03:44:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-05-10T03:44:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 31, 2024-05-10T03:44:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 2.632882687, 2024-05-10T03:44:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.084931699 2024-05-10T03:44:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-05-10T03:44:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-05-10T03:44:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-05-10T03:44:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-05-10T03:44:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-05-10T03:44:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-05-10T03:44:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 6232, 2024-05-10T03:44:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 10.840478465, 2024-05-10T03:44:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001739486 2024-05-10T03:44:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-05-10T03:44:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-05-10T03:44:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-05-10T03:44:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-05-10T03:44:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 1, 2024-05-10T03:44:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 1, 2024-05-10T03:44:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 0, 2024-05-10T03:44:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 1, 2024-05-10T03:44:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-05-10T03:44:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 7872, 2024-05-10T03:44:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 7872, 2024-05-10T03:44:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 1706, 2024-05-10T03:44:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-05-10T03:44:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-05-10T03:44:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-05-10T03:44:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-05-10T03:44:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-05-10T03:44:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-05-10T03:44:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-05-10T03:44:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-05-10T03:44:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-10T03:44:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-05-10T03:44:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-10T03:44:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-05-10T03:44:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-05-10T03:44:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-05-10T03:44:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-10T03:44:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-05-10T03:44:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-05-10T03:44:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-05-10T03:44:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-05-10T03:44:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-05-10T03:44:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-10T03:44:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-05-10T03:44:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-10T03:44:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-05-10T03:44:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-05-10T03:44:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-05-10T03:44:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-05-10T03:44:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-05-10T03:44:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-10T03:44:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-05-10T03:44:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-05-10T03:44:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-05-10T03:44:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-05-10T03:44:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-05-10T03:44:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-05-10T03:44:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-05-10T03:44:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-05-10T03:44:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-05-10T03:44:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 316003, 2024-05-10T03:44:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 169, 2024-05-10T03:44:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 704, 2024-05-10T03:44:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 8, 2024-05-10T03:44:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-05-10T03:44:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-05-10T03:44:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-05-10T03:44:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-05-10T03:44:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-05-10T03:44:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-05-10T03:44:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 9176, 2024-05-10T03:44:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 176, 2024-05-10T03:44:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-05-10T03:44:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-05-10T03:44:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-05-10T03:44:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-05-10T03:44:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 1473617, 2024-05-10T03:44:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 23680, 2024-05-10T03:44:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-05-10T03:44:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-05-10T03:44:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-05-10T03:44:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-05-10T03:44:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-05-10T03:44:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-05-10T03:44:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-05-10T03:44:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 17767, 2024-05-10T03:44:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 66948766, 2024-05-10T03:44:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 33, 2024-05-10T03:44:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 17767, 2024-05-10T03:44:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-05-10T03:44:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 17767, 2024-05-10T03:44:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 53.919553655, 2024-05-10T03:44:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.003034814 2024-05-10T03:44:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-05-10T03:44:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-05-10T03:44:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 17767, 2024-05-10T03:44:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 17900 2024-05-10T03:44:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 17767, 2024-05-10T03:44:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 3577, 2024-05-10T03:44:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 14190, 2024-05-10T03:44:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-05-10T03:44:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-05-10T03:44:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 0, 2024-05-10T03:44:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 10, 2024-05-10T03:44:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 158, 2024-05-10T03:44:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 1180, 2024-05-10T03:44:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 90, 2024-05-10T03:44:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-05-10T03:44:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-05-10T03:44:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-05-10T03:44:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 9, 2024-05-10T03:44:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 12794, 2024-05-10T03:44:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-05-10T03:44:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-05-10T03:44:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-05-10T03:44:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 3419, 2024-05-10T03:44:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 20, 2024-05-10T03:44:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-05-10T03:44:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-05-10T03:44:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-05-10T03:44:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-05-10T03:44:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-05-10T03:44:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-05-10T03:44:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-05-10T03:44:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-05-10T03:44:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-05-10T03:44:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-05-10T03:44:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-05-10T03:44:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-05-10T03:44:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-05-10T03:44:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-05-10T03:44:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-05-10T03:44:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-05-10T03:44:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-05-10T03:44:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-05-10T03:44:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-05-10T03:44:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-05-10T03:44:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-05-10T03:44:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-05-10T03:44:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-05-10T03:44:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-05-10T03:44:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-05-10T03:44:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-05-10T03:44:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 90, 2024-05-10T03:44:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-05-10T03:44:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 4, 2024-05-10T03:44:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 12, 2024-05-10T03:44:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 12, 2024-05-10T03:44:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-05-10T03:44:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-05-10T03:44:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 197, 2024-05-10T03:44:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 0, 2024-05-10T03:44:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 23 2024-05-10T03:44:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-05-10T03:44:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 1, 2024-05-10T03:44:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-05-10T03:44:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-05-10T03:44:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-05-10T03:44:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: "osd-slow-ops": { 2024-05-10T03:44:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-05-10T03:44:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-05-10T03:44:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-05-10T03:44:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 15, 2024-05-10T03:44:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-05-10T03:44:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 9, 2024-05-10T03:44:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 6494, 2024-05-10T03:44:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-05-10T03:44:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-10T03:44:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-05-10T03:44:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-05-10T03:44:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-05-10T03:44:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 62974, 2024-05-10T03:44:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 14175966, 2024-05-10T03:44:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-05-10T03:44:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 62974, 2024-05-10T03:44:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-05-10T03:44:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-05-10T03:44:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 62974, 2024-05-10T03:44:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 14175966, 2024-05-10T03:44:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-05-10T03:44:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-05-10T03:44:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-05-10T03:44:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-05-10T03:44:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-05-10T03:44:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-05-10T03:44:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-05-10T03:44:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-05-10T03:44:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-05-10T03:44:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 17767, 2024-05-10T03:44:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 67654548, 2024-05-10T03:44:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 17767, 2024-05-10T03:44:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 67654548, 2024-05-10T03:44:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-05-10T03:44:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-05-10T03:44:07.232 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-05-10T03:44:07.232 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-05-10T03:44:07.232 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-05-10T03:44:07.232 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-05-10T03:44:07.232 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-05-10T03:44:07.232 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-05-10T03:44:07.232 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-05-10T03:44:07.232 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 17767, 2024-05-10T03:44:07.232 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 17767, 2024-05-10T03:44:07.232 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 17767, 2024-05-10T03:44:07.233 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 17767, 2024-05-10T03:44:07.233 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-05-10T03:44:07.233 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.233 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.233 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.233 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:07.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.233 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-05-10T03:44:07.233 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-05-10T03:44:07.233 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-05-10T03:44:07.233 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-05-10T03:44:07.233 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 6494, 2024-05-10T03:44:07.233 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 705782, 2024-05-10T03:44:07.233 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-05-10T03:44:07.234 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 6494, 2024-05-10T03:44:07.234 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-05-10T03:44:07.234 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-05-10T03:44:07.234 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 158, 2024-05-10T03:44:07.234 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 705782, 2024-05-10T03:44:07.234 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-05-10T03:44:07.234 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.234 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.234 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.234 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:07.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:07.234 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x5636ac4504e0": { 2024-05-10T03:44:07.234 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-05-10T03:44:07.234 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-05-10T03:44:07.235 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-05-10T03:44:07.235 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 30820, 2024-05-10T03:44:07.235 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 63733866, 2024-05-10T03:44:07.235 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-05-10T03:44:07.235 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 30820, 2024-05-10T03:44:07.235 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-05-10T03:44:07.235 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-05-10T03:44:07.235 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 1022, 2024-05-10T03:44:07.235 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 63733866, 2024-05-10T03:44:07.235 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-05-10T03:44:07.235 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:07.235 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:07.235 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:07.235 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:07.235 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:07.235 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-05-10T03:44:07.236 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:07 smithi154 ceph-mon[46565]: pgmap v400: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-10T03:44:07.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:07 smithi106 ceph-mon[46996]: pgmap v400: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-10T03:44:07.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:07 smithi045 ceph-mon[42520]: pgmap v400: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-10T03:44:07.608 INFO:tasks.check_counter:Daemon mds.i mds.exported=40 2024-05-10T03:44:07.608 INFO:tasks.check_counter:Daemon mds.i mds.imported=53 2024-05-10T03:44:07.608 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=1172 2024-05-10T03:44:07.609 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=1193 2024-05-10T03:44:07.609 DEBUG:tasks.check_counter:Getting stats from l 2024-05-10T03:44:07.609 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:50174015a7e79f951b988949abe236791f52d4da shell --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 -- ceph daemon mds.l perf dump 2024-05-10T03:44:07.830 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T03:44:09.039 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-05-10T03:44:09.040 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-05-10T03:44:09.040 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 296, 2024-05-10T03:44:09.040 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 296, 2024-05-10T03:44:09.040 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 21052526, 2024-05-10T03:44:09.040 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 91324, 2024-05-10T03:44:09.040 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 7, 2024-05-10T03:44:09.040 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 3, 2024-05-10T03:44:09.040 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.041163725, 2024-05-10T03:44:09.040 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.008240236, 2024-05-10T03:44:09.040 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.019876279, 2024-05-10T03:44:09.040 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.008870816, 2024-05-10T03:44:09.040 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:44:09.040 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 295, 2024-05-10T03:44:09.041 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.019614395, 2024-05-10T03:44:09.041 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000066489 2024-05-10T03:44:09.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.041 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:44:09.041 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.041 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.041 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.041 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-05-10T03:44:09.041 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 448 2024-05-10T03:44:09.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.041 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-05-10T03:44:09.041 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 225, 2024-05-10T03:44:09.041 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 208, 2024-05-10T03:44:09.042 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 25733705, 2024-05-10T03:44:09.042 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 88328, 2024-05-10T03:44:09.042 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 5, 2024-05-10T03:44:09.042 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 4, 2024-05-10T03:44:09.042 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.038286664, 2024-05-10T03:44:09.042 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.008674245, 2024-05-10T03:44:09.042 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.026234027, 2024-05-10T03:44:09.042 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.004944031, 2024-05-10T03:44:09.042 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:44:09.043 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 207, 2024-05-10T03:44:09.043 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.014963375, 2024-05-10T03:44:09.043 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000072286 2024-05-10T03:44:09.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.043 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:44:09.043 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.043 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.043 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.043 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 540704, 2024-05-10T03:44:09.043 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 56912 2024-05-10T03:44:09.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.043 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-05-10T03:44:09.043 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 442, 2024-05-10T03:44:09.043 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 516, 2024-05-10T03:44:09.044 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 17733680, 2024-05-10T03:44:09.044 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 332687, 2024-05-10T03:44:09.044 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 6, 2024-05-10T03:44:09.044 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 5, 2024-05-10T03:44:09.044 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.061435683, 2024-05-10T03:44:09.044 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.015869782, 2024-05-10T03:44:09.044 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.024036977, 2024-05-10T03:44:09.044 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.016121038, 2024-05-10T03:44:09.044 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T03:44:09.044 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 514, 2024-05-10T03:44:09.044 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.026356318, 2024-05-10T03:44:09.044 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000051276 2024-05-10T03:44:09.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.044 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-05-10T03:44:09.045 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.045 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.045 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.045 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-10T03:44:09.045 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 195536 2024-05-10T03:44:09.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.045 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-05-10T03:44:09.046 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-05-10T03:44:09.046 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-05-10T03:44:09.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.046 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-05-10T03:44:09.046 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-05-10T03:44:09.046 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-05-10T03:44:09.046 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1491, 2024-05-10T03:44:09.046 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.046756058, 2024-05-10T03:44:09.046 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000031358 2024-05-10T03:44:09.046 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:09.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.046 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-05-10T03:44:09.046 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-05-10T03:44:09.046 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-05-10T03:44:09.047 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.047 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.047 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.047 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:09.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.047 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-05-10T03:44:09.047 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 0, 2024-05-10T03:44:09.047 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 0, 2024-05-10T03:44:09.047 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-05-10T03:44:09.047 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.047 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.047 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.047 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-05-10T03:44:09.048 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 0, 2024-05-10T03:44:09.048 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-05-10T03:44:09.048 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-05-10T03:44:09.048 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 0, 2024-05-10T03:44:09.048 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-05-10T03:44:09.048 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-05-10T03:44:09.048 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 7479, 2024-05-10T03:44:09.048 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 0, 2024-05-10T03:44:09.048 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 7479, 2024-05-10T03:44:09.048 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-05-10T03:44:09.048 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 7479, 2024-05-10T03:44:09.048 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 0, 2024-05-10T03:44:09.048 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-05-10T03:44:09.048 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-05-10T03:44:09.049 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 1, 2024-05-10T03:44:09.049 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 0, 2024-05-10T03:44:09.049 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 0, 2024-05-10T03:44:09.049 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-05-10T03:44:09.049 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 0, 2024-05-10T03:44:09.049 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-05-10T03:44:09.049 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-05-10T03:44:09.049 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-05-10T03:44:09.049 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-05-10T03:44:09.049 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-05-10T03:44:09.049 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-05-10T03:44:09.049 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-05-10T03:44:09.049 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-05-10T03:44:09.049 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-05-10T03:44:09.050 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-05-10T03:44:09.050 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-05-10T03:44:09.050 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-05-10T03:44:09.050 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 0, 2024-05-10T03:44:09.050 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 0, 2024-05-10T03:44:09.050 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-05-10T03:44:09.050 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-05-10T03:44:09.050 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-05-10T03:44:09.050 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-05-10T03:44:09.050 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-05-10T03:44:09.050 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-05-10T03:44:09.050 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-05-10T03:44:09.050 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-05-10T03:44:09.050 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-05-10T03:44:09.051 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-05-10T03:44:09.051 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-05-10T03:44:09.051 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-05-10T03:44:09.051 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-05-10T03:44:09.051 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-10T03:44:09.051 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-10T03:44:09.051 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-05-10T03:44:09.051 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-05-10T03:44:09.051 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-05-10T03:44:09.051 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-05-10T03:44:09.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.051 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-05-10T03:44:09.051 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-05-10T03:44:09.051 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-05-10T03:44:09.052 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-05-10T03:44:09.052 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 0, 2024-05-10T03:44:09.052 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-05-10T03:44:09.052 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-05-10T03:44:09.052 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-05-10T03:44:09.052 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-05-10T03:44:09.052 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-05-10T03:44:09.052 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-05-10T03:44:09.052 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-05-10T03:44:09.052 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-05-10T03:44:09.052 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-05-10T03:44:09.052 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-05-10T03:44:09.052 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-05-10T03:44:09.052 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-05-10T03:44:09.052 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-05-10T03:44:09.053 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-05-10T03:44:09.053 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-05-10T03:44:09.053 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-05-10T03:44:09.053 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-05-10T03:44:09.053 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-05-10T03:44:09.053 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0 2024-05-10T03:44:09.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.053 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-05-10T03:44:09.053 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 0, 2024-05-10T03:44:09.053 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-05-10T03:44:09.053 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-05-10T03:44:09.053 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 30820, 2024-05-10T03:44:09.053 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-05-10T03:44:09.053 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-05-10T03:44:09.053 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 0, 2024-05-10T03:44:09.054 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-05-10T03:44:09.054 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-05-10T03:44:09.054 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 38, 2024-05-10T03:44:09.054 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-05-10T03:44:09.054 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-05-10T03:44:09.054 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4194304, 2024-05-10T03:44:09.054 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 67928170, 2024-05-10T03:44:09.054 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 67927032, 2024-05-10T03:44:09.054 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-05-10T03:44:09.054 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.054 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.054 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.054 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 30820 2024-05-10T03:44:09.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.055 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-05-10T03:44:09.055 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 51, 2024-05-10T03:44:09.055 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 6974, 2024-05-10T03:44:09.055 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 6923, 2024-05-10T03:44:09.055 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 77, 2024-05-10T03:44:09.055 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 439, 2024-05-10T03:44:09.055 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 362, 2024-05-10T03:44:09.055 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 7479, 2024-05-10T03:44:09.055 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 10440, 2024-05-10T03:44:09.055 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 2961, 2024-05-10T03:44:09.055 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-05-10T03:44:09.055 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 0, 2024-05-10T03:44:09.055 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-05-10T03:44:09.055 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 134800, 2024-05-10T03:44:09.056 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 207252 2024-05-10T03:44:09.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.056 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-05-10T03:44:09.056 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 0, 2024-05-10T03:44:09.056 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-05-10T03:44:09.056 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 0, 2024-05-10T03:44:09.056 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 0, 2024-05-10T03:44:09.056 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-05-10T03:44:09.056 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-05-10T03:44:09.056 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.056 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.056 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.056 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-05-10T03:44:09.056 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.057 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.057 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.057 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-05-10T03:44:09.057 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.057 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.057 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.057 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-05-10T03:44:09.057 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.057 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.057 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.057 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-05-10T03:44:09.057 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.058 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.058 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.058 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-05-10T03:44:09.058 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.058 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.058 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.058 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-05-10T03:44:09.058 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.058 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.058 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.058 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-05-10T03:44:09.058 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.059 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.059 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.059 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-05-10T03:44:09.059 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.059 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.059 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.059 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-05-10T03:44:09.059 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.059 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.059 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.059 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-05-10T03:44:09.060 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.060 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.060 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.060 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-05-10T03:44:09.060 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.060 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.060 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.060 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-05-10T03:44:09.060 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.060 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.060 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.060 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-05-10T03:44:09.061 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.061 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.061 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.061 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-05-10T03:44:09.061 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.061 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.061 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.061 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-05-10T03:44:09.061 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.061 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.061 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.062 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-05-10T03:44:09.062 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.062 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.062 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.062 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-05-10T03:44:09.062 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.062 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.062 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.063 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-05-10T03:44:09.063 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.063 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.063 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.063 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-05-10T03:44:09.063 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.063 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.063 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.063 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-05-10T03:44:09.063 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.063 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.063 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.064 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-05-10T03:44:09.064 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.064 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.064 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.064 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-05-10T03:44:09.064 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.064 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.064 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.064 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-05-10T03:44:09.065 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.065 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.065 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.065 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-05-10T03:44:09.065 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.065 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.065 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.065 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-05-10T03:44:09.065 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.065 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.066 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.066 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-05-10T03:44:09.066 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.066 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.066 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.066 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-05-10T03:44:09.066 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.066 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.066 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.067 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-05-10T03:44:09.067 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.067 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.067 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.067 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-05-10T03:44:09.067 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-05-10T03:44:09.067 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-05-10T03:44:09.067 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.067 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.067 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.067 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:09.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.068 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-05-10T03:44:09.068 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 1, 2024-05-10T03:44:09.068 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 1, 2024-05-10T03:44:09.068 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 0, 2024-05-10T03:44:09.068 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 1, 2024-05-10T03:44:09.068 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-05-10T03:44:09.068 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 0, 2024-05-10T03:44:09.068 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 0, 2024-05-10T03:44:09.068 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 1707, 2024-05-10T03:44:09.068 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-05-10T03:44:09.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.069 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-05-10T03:44:09.069 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-05-10T03:44:09.069 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-05-10T03:44:09.069 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-05-10T03:44:09.069 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-05-10T03:44:09.069 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-05-10T03:44:09.069 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-05-10T03:44:09.069 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-10T03:44:09.069 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-05-10T03:44:09.069 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-10T03:44:09.069 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-05-10T03:44:09.069 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-05-10T03:44:09.069 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-05-10T03:44:09.070 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-10T03:44:09.070 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-05-10T03:44:09.070 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-05-10T03:44:09.070 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-05-10T03:44:09.070 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-05-10T03:44:09.070 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-05-10T03:44:09.070 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-10T03:44:09.070 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-05-10T03:44:09.070 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-10T03:44:09.070 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-05-10T03:44:09.071 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-05-10T03:44:09.071 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-05-10T03:44:09.071 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-05-10T03:44:09.071 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-05-10T03:44:09.071 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-10T03:44:09.071 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-05-10T03:44:09.071 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-05-10T03:44:09.071 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-05-10T03:44:09.071 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-05-10T03:44:09.071 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-05-10T03:44:09.071 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-05-10T03:44:09.071 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-05-10T03:44:09.072 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-05-10T03:44:09.072 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-05-10T03:44:09.072 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 222851, 2024-05-10T03:44:09.072 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 102, 2024-05-10T03:44:09.072 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-05-10T03:44:09.072 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-05-10T03:44:09.072 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-05-10T03:44:09.072 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-05-10T03:44:09.072 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-05-10T03:44:09.072 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-05-10T03:44:09.073 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-05-10T03:44:09.073 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-05-10T03:44:09.073 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 9176, 2024-05-10T03:44:09.073 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 176, 2024-05-10T03:44:09.073 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-05-10T03:44:09.073 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-05-10T03:44:09.073 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-05-10T03:44:09.073 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-05-10T03:44:09.073 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 5496409, 2024-05-10T03:44:09.073 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 41447, 2024-05-10T03:44:09.073 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-05-10T03:44:09.073 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-05-10T03:44:09.074 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-05-10T03:44:09.074 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-05-10T03:44:09.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.074 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-05-10T03:44:09.074 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-05-10T03:44:09.074 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-05-10T03:44:09.074 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 834, 2024-05-10T03:44:09.074 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 21, 2024-05-10T03:44:09.074 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 3, 2024-05-10T03:44:09.074 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 834, 2024-05-10T03:44:09.074 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-05-10T03:44:09.074 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 834, 2024-05-10T03:44:09.074 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 2.245939767, 2024-05-10T03:44:09.074 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.002692973 2024-05-10T03:44:09.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.075 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-05-10T03:44:09.075 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-05-10T03:44:09.075 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 834, 2024-05-10T03:44:09.075 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 835 2024-05-10T03:44:09.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.075 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 834, 2024-05-10T03:44:09.075 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 834, 2024-05-10T03:44:09.075 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 0, 2024-05-10T03:44:09.075 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-05-10T03:44:09.075 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-05-10T03:44:09.075 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 454, 2024-05-10T03:44:09.075 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 0, 2024-05-10T03:44:09.076 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 378, 2024-05-10T03:44:09.076 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 0, 2024-05-10T03:44:09.076 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 0, 2024-05-10T03:44:09.076 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-05-10T03:44:09.076 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-05-10T03:44:09.076 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-05-10T03:44:09.076 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-05-10T03:44:09.076 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 0, 2024-05-10T03:44:09.076 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-05-10T03:44:09.076 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-05-10T03:44:09.076 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-05-10T03:44:09.076 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 1, 2024-05-10T03:44:09.076 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 0, 2024-05-10T03:44:09.076 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-05-10T03:44:09.077 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-05-10T03:44:09.077 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-05-10T03:44:09.077 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-05-10T03:44:09.077 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-05-10T03:44:09.077 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-05-10T03:44:09.077 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-05-10T03:44:09.077 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-05-10T03:44:09.077 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-05-10T03:44:09.077 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-05-10T03:44:09.077 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-05-10T03:44:09.078 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-05-10T03:44:09.078 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-05-10T03:44:09.078 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-05-10T03:44:09.078 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-05-10T03:44:09.078 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-05-10T03:44:09.078 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-05-10T03:44:09.078 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-05-10T03:44:09.078 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-05-10T03:44:09.078 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-05-10T03:44:09.078 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-05-10T03:44:09.078 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-05-10T03:44:09.078 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-05-10T03:44:09.079 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-05-10T03:44:09.084 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-05-10T03:44:09.084 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-05-10T03:44:09.084 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 90, 2024-05-10T03:44:09.085 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-05-10T03:44:09.085 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 4, 2024-05-10T03:44:09.085 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 9, 2024-05-10T03:44:09.085 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 9, 2024-05-10T03:44:09.085 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-05-10T03:44:09.085 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-05-10T03:44:09.085 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 0, 2024-05-10T03:44:09.085 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 2, 2024-05-10T03:44:09.085 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 0 2024-05-10T03:44:09.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.085 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-05-10T03:44:09.085 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 0, 2024-05-10T03:44:09.085 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-05-10T03:44:09.086 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-05-10T03:44:09.086 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-05-10T03:44:09.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.086 INFO:teuthology.orchestra.run.smithi154.stdout: "osd-slow-ops": { 2024-05-10T03:44:09.086 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-05-10T03:44:09.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.086 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-05-10T03:44:09.086 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-05-10T03:44:09.086 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-05-10T03:44:09.086 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-05-10T03:44:09.086 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-05-10T03:44:09.086 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-05-10T03:44:09.086 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-05-10T03:44:09.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.086 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-10T03:44:09.087 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-05-10T03:44:09.087 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-05-10T03:44:09.087 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-05-10T03:44:09.087 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 959, 2024-05-10T03:44:09.087 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 64424236, 2024-05-10T03:44:09.087 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-05-10T03:44:09.087 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 959, 2024-05-10T03:44:09.087 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-05-10T03:44:09.087 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-05-10T03:44:09.087 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 959, 2024-05-10T03:44:09.087 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 64424236, 2024-05-10T03:44:09.087 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-05-10T03:44:09.087 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.088 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.088 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.088 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:09.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.088 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-05-10T03:44:09.088 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-05-10T03:44:09.088 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-05-10T03:44:09.088 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-05-10T03:44:09.088 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-05-10T03:44:09.088 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-05-10T03:44:09.088 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-05-10T03:44:09.088 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-05-10T03:44:09.088 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 834, 2024-05-10T03:44:09.088 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 63736251, 2024-05-10T03:44:09.089 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 834, 2024-05-10T03:44:09.089 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 63736251, 2024-05-10T03:44:09.089 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-05-10T03:44:09.089 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.089 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.089 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.089 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:09.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.089 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-05-10T03:44:09.089 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-05-10T03:44:09.089 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-05-10T03:44:09.089 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-05-10T03:44:09.089 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-05-10T03:44:09.089 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-05-10T03:44:09.090 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-05-10T03:44:09.090 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-05-10T03:44:09.090 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 834, 2024-05-10T03:44:09.090 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 834, 2024-05-10T03:44:09.090 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 834, 2024-05-10T03:44:09.090 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 834, 2024-05-10T03:44:09.090 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-05-10T03:44:09.090 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.090 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.090 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.090 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:09.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.090 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-05-10T03:44:09.090 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-05-10T03:44:09.091 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-05-10T03:44:09.091 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-05-10T03:44:09.091 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-05-10T03:44:09.091 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-05-10T03:44:09.091 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-05-10T03:44:09.091 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-05-10T03:44:09.091 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-05-10T03:44:09.091 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-05-10T03:44:09.091 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-05-10T03:44:09.091 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-05-10T03:44:09.091 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-05-10T03:44:09.091 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.091 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.091 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.091 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:09.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-05-10T03:44:09.092 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x55c6c944a8f0": { 2024-05-10T03:44:09.092 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-05-10T03:44:09.092 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-05-10T03:44:09.092 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-05-10T03:44:09.092 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-05-10T03:44:09.092 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-05-10T03:44:09.092 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-05-10T03:44:09.092 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-05-10T03:44:09.092 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-05-10T03:44:09.092 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-05-10T03:44:09.092 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-05-10T03:44:09.092 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-05-10T03:44:09.092 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-05-10T03:44:09.092 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-05-10T03:44:09.094 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-05-10T03:44:09.094 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-05-10T03:44:09.095 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:09.095 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-05-10T03:44:09.095 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-05-10T03:44:09.353 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:09 smithi154 ceph-mon[46565]: pgmap v401: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 511 B/s wr, 11 op/s 2024-05-10T03:44:09.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:09 smithi106 ceph-mon[46996]: pgmap v401: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 511 B/s wr, 11 op/s 2024-05-10T03:44:09.416 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-05-10T03:44:09.416 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-05-10T03:44:09.416 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-05-10T03:44:09.416 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-05-10T03:44:09.417 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-10T03:44:09.428 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-10T03:44:09.428 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-10T03:44:09.428 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:44:09.454 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-10T03:44:09.455 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:44:09.520 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:44:09.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:09 smithi045 ceph-mon[42520]: pgmap v401: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 511 B/s wr, 11 op/s 2024-05-10T03:44:09.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.692+0000 7fd435086700 1 -- 172.21.15.45:0/2624041797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4301031a0 msgr2=0x7fd4301035b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:09.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.692+0000 7fd435086700 1 --2- 172.21.15.45:0/2624041797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4301031a0 0x7fd4301035b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd420009990 tx=0x7fd420009ca0 comp rx=0 tx=0).stop 2024-05-10T03:44:09.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.692+0000 7fd435086700 1 -- 172.21.15.45:0/2624041797 shutdown_connections 2024-05-10T03:44:09.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.692+0000 7fd435086700 1 --2- 172.21.15.45:0/2624041797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd430100530 0x7fd43010a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:09.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.692+0000 7fd435086700 1 --2- 172.21.15.45:0/2624041797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4301031a0 0x7fd4301035b0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:09.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.692+0000 7fd435086700 1 --2- 172.21.15.45:0/2624041797 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4300ffbe0 0x7fd4300ffff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:09.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.692+0000 7fd435086700 1 -- 172.21.15.45:0/2624041797 >> 172.21.15.45:0/2624041797 conn(0x7fd4300fb8b0 msgr2=0x7fd4300fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:09.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.693+0000 7fd435086700 1 -- 172.21.15.45:0/2624041797 shutdown_connections 2024-05-10T03:44:09.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.693+0000 7fd435086700 1 -- 172.21.15.45:0/2624041797 wait complete. 2024-05-10T03:44:09.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.693+0000 7fd435086700 1 Processor -- start 2024-05-10T03:44:09.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.694+0000 7fd435086700 1 -- start start 2024-05-10T03:44:09.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.694+0000 7fd435086700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4300ffbe0 0x7fd430198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:09.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.694+0000 7fd435086700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd430100530 0x7fd430198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:09.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.694+0000 7fd435086700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4301031a0 0x7fd43019f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:09.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.694+0000 7fd435086700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43019fb30 con 0x7fd4300ffbe0 2024-05-10T03:44:09.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.694+0000 7fd435086700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43019fca0 con 0x7fd430100530 2024-05-10T03:44:09.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.694+0000 7fd435086700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43019fe60 con 0x7fd4301031a0 2024-05-10T03:44:09.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.694+0000 7fd42ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4300ffbe0 0x7fd430198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:09.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.694+0000 7fd42ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4300ffbe0 0x7fd430198050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33530/0 (socket says 172.21.15.45:33530) 2024-05-10T03:44:09.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.694+0000 7fd42ed9d700 1 -- 172.21.15.45:0/4169955931 learned_addr learned my addr 172.21.15.45:0/4169955931 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:44:09.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.694+0000 7fd42f59e700 1 --2- 172.21.15.45:0/4169955931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4301031a0 0x7fd43019f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:09.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.694+0000 7fd42e59c700 1 --2- 172.21.15.45:0/4169955931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd430100530 0x7fd430198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:09.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.694+0000 7fd42ed9d700 1 -- 172.21.15.45:0/4169955931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4301031a0 msgr2=0x7fd43019f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:09.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.694+0000 7fd42ed9d700 1 --2- 172.21.15.45:0/4169955931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4301031a0 0x7fd43019f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:09.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.694+0000 7fd42ed9d700 1 -- 172.21.15.45:0/4169955931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd430100530 msgr2=0x7fd430198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:09.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.694+0000 7fd42ed9d700 1 --2- 172.21.15.45:0/4169955931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd430100530 0x7fd430198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:09.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.695+0000 7fd42ed9d700 1 -- 172.21.15.45:0/4169955931 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4200095f0 con 0x7fd4300ffbe0 2024-05-10T03:44:09.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.695+0000 7fd42e59c700 1 --2- 172.21.15.45:0/4169955931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd430100530 0x7fd430198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:44:09.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.695+0000 7fd42ed9d700 1 --2- 172.21.15.45:0/4169955931 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4300ffbe0 0x7fd430198050 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd4200098e0 tx=0x7fd42000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:09.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.695+0000 7fd417fff700 1 -- 172.21.15.45:0/4169955931 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42001d070 con 0x7fd4300ffbe0 2024-05-10T03:44:09.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.695+0000 7fd435086700 1 -- 172.21.15.45:0/4169955931 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4301a00e0 con 0x7fd4300ffbe0 2024-05-10T03:44:09.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.695+0000 7fd417fff700 1 -- 172.21.15.45:0/4169955931 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd42000fb80 con 0x7fd4300ffbe0 2024-05-10T03:44:09.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.695+0000 7fd417fff700 1 -- 172.21.15.45:0/4169955931 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4200173f0 con 0x7fd4300ffbe0 2024-05-10T03:44:09.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.695+0000 7fd435086700 1 -- 172.21.15.45:0/4169955931 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4301a0510 con 0x7fd4300ffbe0 2024-05-10T03:44:09.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.696+0000 7fd435086700 1 -- 172.21.15.45:0/4169955931 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd430108ff0 con 0x7fd4300ffbe0 2024-05-10T03:44:09.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.698+0000 7fd417fff700 1 -- 172.21.15.45:0/4169955931 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd420022470 con 0x7fd4300ffbe0 2024-05-10T03:44:09.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.699+0000 7fd417fff700 1 --2- 172.21.15.45:0/4169955931 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd4180a1120 0x7fd4180a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:09.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.699+0000 7fd417fff700 1 -- 172.21.15.45:0/4169955931 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd4200ce4a0 con 0x7fd4300ffbe0 2024-05-10T03:44:09.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.699+0000 7fd42e59c700 1 --2- 172.21.15.45:0/4169955931 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd4180a1120 0x7fd4180a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:09.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.700+0000 7fd42e59c700 1 --2- 172.21.15.45:0/4169955931 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd4180a1120 0x7fd4180a3630 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd4301990f0 tx=0x7fd42400b690 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:09.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.703+0000 7fd417fff700 1 -- 172.21.15.45:0/4169955931 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd42009b3b0 con 0x7fd4300ffbe0 2024-05-10T03:44:09.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.921+0000 7fd435086700 1 -- 172.21.15.45:0/4169955931 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd43010d510 con 0x7fd4300ffbe0 2024-05-10T03:44:09.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.923+0000 7fd417fff700 1 -- 172.21.15.45:0/4169955931 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24743 (secure 0 0 0) 0x7fd42009af40 con 0x7fd4300ffbe0 2024-05-10T03:44:09.926 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:44:09.926 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":90,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:40:27.092808+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:38:34.871801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:38:35.935386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T03:38:39.029903+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":5,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:44:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.926+0000 7fd435086700 1 -- 172.21.15.45:0/4169955931 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd4180a1120 msgr2=0x7fd4180a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.926+0000 7fd435086700 1 --2- 172.21.15.45:0/4169955931 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd4180a1120 0x7fd4180a3630 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd4301990f0 tx=0x7fd42400b690 comp rx=0 tx=0).stop 2024-05-10T03:44:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.926+0000 7fd435086700 1 -- 172.21.15.45:0/4169955931 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4300ffbe0 msgr2=0x7fd430198050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.926+0000 7fd435086700 1 --2- 172.21.15.45:0/4169955931 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4300ffbe0 0x7fd430198050 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd4200098e0 tx=0x7fd42000f690 comp rx=0 tx=0).stop 2024-05-10T03:44:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.926+0000 7fd435086700 1 -- 172.21.15.45:0/4169955931 shutdown_connections 2024-05-10T03:44:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.926+0000 7fd435086700 1 --2- 172.21.15.45:0/4169955931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4301031a0 0x7fd43019f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.926+0000 7fd435086700 1 --2- 172.21.15.45:0/4169955931 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd4180a1120 0x7fd4180a3630 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.926+0000 7fd435086700 1 --2- 172.21.15.45:0/4169955931 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4300ffbe0 0x7fd430198050 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.926+0000 7fd435086700 1 --2- 172.21.15.45:0/4169955931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd430100530 0x7fd430198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.926+0000 7fd435086700 1 -- 172.21.15.45:0/4169955931 >> 172.21.15.45:0/4169955931 conn(0x7fd4300fb8b0 msgr2=0x7fd430106130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.926+0000 7fd435086700 1 -- 172.21.15.45:0/4169955931 shutdown_connections 2024-05-10T03:44:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:09.926+0000 7fd435086700 1 -- 172.21.15.45:0/4169955931 wait complete. 2024-05-10T03:44:09.944 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T03:35:20.339400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T03:38:34.871801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T03:38:35.935386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-10T03:38:39.029903+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-10T03:44:09.945 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T03:44:10.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.095+0000 7f14edacd700 1 -- 172.21.15.45:0/39568361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14e8102580 msgr2=0x7f14e8108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:10.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.095+0000 7f14edacd700 1 --2- 172.21.15.45:0/39568361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14e8102580 0x7f14e8108e30 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f14e000b0a0 tx=0x7f14e000b3b0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.095+0000 7f14edacd700 1 -- 172.21.15.45:0/39568361 shutdown_connections 2024-05-10T03:44:10.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.095+0000 7f14edacd700 1 --2- 172.21.15.45:0/39568361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14e8100ac0 0x7f14e8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.095+0000 7f14edacd700 1 --2- 172.21.15.45:0/39568361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14e8102580 0x7f14e8108e30 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.095+0000 7f14edacd700 1 --2- 172.21.15.45:0/39568361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14e8101be0 0x7f14e8101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.095+0000 7f14edacd700 1 -- 172.21.15.45:0/39568361 >> 172.21.15.45:0/39568361 conn(0x7f14e80fc0d0 msgr2=0x7f14e80fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.095+0000 7f14edacd700 1 -- 172.21.15.45:0/39568361 shutdown_connections 2024-05-10T03:44:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.095+0000 7f14edacd700 1 -- 172.21.15.45:0/39568361 wait complete. 2024-05-10T03:44:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.096+0000 7f14edacd700 1 Processor -- start 2024-05-10T03:44:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.096+0000 7f14edacd700 1 -- start start 2024-05-10T03:44:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.097+0000 7f14edacd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14e8100ac0 0x7f14e8196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.097+0000 7f14edacd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14e8101be0 0x7f14e8197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.097+0000 7f14edacd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14e8102580 0x7f14e819e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.097+0000 7f14edacd700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e819eaa0 con 0x7f14e8101be0 2024-05-10T03:44:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.097+0000 7f14edacd700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e819ec10 con 0x7f14e8102580 2024-05-10T03:44:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.097+0000 7f14edacd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e819edd0 con 0x7f14e8100ac0 2024-05-10T03:44:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.097+0000 7f14e6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14e8101be0 0x7f14e8197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.097+0000 7f14e6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14e8101be0 0x7f14e8197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33546/0 (socket says 172.21.15.45:33546) 2024-05-10T03:44:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.097+0000 7f14e6ffd700 1 -- 172.21.15.45:0/824865177 learned_addr learned my addr 172.21.15.45:0/824865177 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:44:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.097+0000 7f14e77fe700 1 --2- 172.21.15.45:0/824865177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14e8100ac0 0x7f14e8196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.097+0000 7f14e7fff700 1 --2- 172.21.15.45:0/824865177 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14e8102580 0x7f14e819e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.097+0000 7f14e6ffd700 1 -- 172.21.15.45:0/824865177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14e8100ac0 msgr2=0x7f14e8196fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.097+0000 7f14e6ffd700 1 --2- 172.21.15.45:0/824865177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14e8100ac0 0x7f14e8196fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.097+0000 7f14e6ffd700 1 -- 172.21.15.45:0/824865177 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14e8102580 msgr2=0x7f14e819e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.097+0000 7f14e6ffd700 1 --2- 172.21.15.45:0/824865177 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14e8102580 0x7f14e819e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.097+0000 7f14e6ffd700 1 -- 172.21.15.45:0/824865177 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e0009d00 con 0x7f14e8101be0 2024-05-10T03:44:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.097+0000 7f14e7fff700 1 --2- 172.21.15.45:0/824865177 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14e8102580 0x7f14e819e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:44:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.098+0000 7f14e6ffd700 1 --2- 172.21.15.45:0/824865177 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14e8101be0 0x7f14e8197500 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f14d000e9a0 tx=0x7f14d000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.098+0000 7f14e4ff9700 1 -- 172.21.15.45:0/824865177 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0009790 con 0x7f14e8101be0 2024-05-10T03:44:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.098+0000 7f14e4ff9700 1 -- 172.21.15.45:0/824865177 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f14d000cbd0 con 0x7f14e8101be0 2024-05-10T03:44:10.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.098+0000 7f14e4ff9700 1 -- 172.21.15.45:0/824865177 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0018680 con 0x7f14e8101be0 2024-05-10T03:44:10.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.098+0000 7f14edacd700 1 -- 172.21.15.45:0/824865177 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e819f0b0 con 0x7f14e8101be0 2024-05-10T03:44:10.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.098+0000 7f14edacd700 1 -- 172.21.15.45:0/824865177 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e819f570 con 0x7f14e8101be0 2024-05-10T03:44:10.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.099+0000 7f14edacd700 1 -- 172.21.15.45:0/824865177 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e8107cd0 con 0x7f14e8101be0 2024-05-10T03:44:10.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.100+0000 7f14e4ff9700 1 -- 172.21.15.45:0/824865177 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f14d00188a0 con 0x7f14e8101be0 2024-05-10T03:44:10.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.101+0000 7f14e4ff9700 1 --2- 172.21.15.45:0/824865177 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f14d40a11c0 0x7f14d40a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:10.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.101+0000 7f14e77fe700 1 --2- 172.21.15.45:0/824865177 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f14d40a11c0 0x7f14d40a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:10.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.101+0000 7f14e4ff9700 1 -- 172.21.15.45:0/824865177 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f14d0014070 con 0x7f14e8101be0 2024-05-10T03:44:10.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.102+0000 7f14e77fe700 1 --2- 172.21.15.45:0/824865177 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f14d40a11c0 0x7f14d40a36d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f14e8101ae0 tx=0x7f14d8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:10.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.106+0000 7f14e4ff9700 1 -- 172.21.15.45:0/824865177 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f14d0052d60 con 0x7f14e8101be0 2024-05-10T03:44:10.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:10 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/4169955931' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:44:10.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.326+0000 7f14edacd700 1 -- 172.21.15.45:0/824865177 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f14e81076b0 con 0x7f14e8101be0 2024-05-10T03:44:10.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.326+0000 7f14e4ff9700 1 -- 172.21.15.45:0/824865177 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f14d0096340 con 0x7f14e8101be0 2024-05-10T03:44:10.329 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-05-10T03:44:10.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.329+0000 7f14edacd700 1 -- 172.21.15.45:0/824865177 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f14d40a11c0 msgr2=0x7f14d40a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:10.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.329+0000 7f14edacd700 1 --2- 172.21.15.45:0/824865177 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f14d40a11c0 0x7f14d40a36d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f14e8101ae0 tx=0x7f14d8009260 comp rx=0 tx=0).stop 2024-05-10T03:44:10.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.329+0000 7f14edacd700 1 -- 172.21.15.45:0/824865177 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14e8101be0 msgr2=0x7f14e8197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:10.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.329+0000 7f14edacd700 1 --2- 172.21.15.45:0/824865177 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14e8101be0 0x7f14e8197500 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f14d000e9a0 tx=0x7f14d000ecb0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.329+0000 7f14edacd700 1 -- 172.21.15.45:0/824865177 shutdown_connections 2024-05-10T03:44:10.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.329+0000 7f14edacd700 1 --2- 172.21.15.45:0/824865177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14e8100ac0 0x7f14e8196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.329+0000 7f14edacd700 1 --2- 172.21.15.45:0/824865177 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f14d40a11c0 0x7f14d40a36d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.329+0000 7f14edacd700 1 --2- 172.21.15.45:0/824865177 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14e8102580 0x7f14e819e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.329+0000 7f14edacd700 1 --2- 172.21.15.45:0/824865177 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14e8101be0 0x7f14e8197500 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.329+0000 7f14edacd700 1 -- 172.21.15.45:0/824865177 >> 172.21.15.45:0/824865177 conn(0x7f14e80fc0d0 msgr2=0x7f14e8104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:10.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.329+0000 7f14edacd700 1 -- 172.21.15.45:0/824865177 shutdown_connections 2024-05-10T03:44:10.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.329+0000 7f14edacd700 1 -- 172.21.15.45:0/824865177 wait complete. 2024-05-10T03:44:10.346 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T03:44:10.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:10 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/4169955931' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:44:10.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:10 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/4169955931' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:44:10.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.496+0000 7fcb6f738700 1 -- 172.21.15.45:0/2439874753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb681002c0 msgr2=0x7fcb681006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:10.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.496+0000 7fcb6f738700 1 --2- 172.21.15.45:0/2439874753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb681002c0 0x7fcb681006d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00aaa0 tx=0x7fcb5c00adb0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.496+0000 7fcb6f738700 1 -- 172.21.15.45:0/2439874753 shutdown_connections 2024-05-10T03:44:10.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.497+0000 7fcb6f738700 1 --2- 172.21.15.45:0/2439874753 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb68101d80 0x7fcb68108630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.497+0000 7fcb6f738700 1 --2- 172.21.15.45:0/2439874753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb681002c0 0x7fcb681006d0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.497+0000 7fcb6f738700 1 --2- 172.21.15.45:0/2439874753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb681013e0 0x7fcb681017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.497+0000 7fcb6f738700 1 -- 172.21.15.45:0/2439874753 >> 172.21.15.45:0/2439874753 conn(0x7fcb680fb8f0 msgr2=0x7fcb680fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.497+0000 7fcb6f738700 1 -- 172.21.15.45:0/2439874753 shutdown_connections 2024-05-10T03:44:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.497+0000 7fcb6f738700 1 -- 172.21.15.45:0/2439874753 wait complete. 2024-05-10T03:44:10.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.497+0000 7fcb6f738700 1 Processor -- start 2024-05-10T03:44:10.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.497+0000 7fcb6f738700 1 -- start start 2024-05-10T03:44:10.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.498+0000 7fcb6f738700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb681002c0 0x7fcb68198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:10.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.498+0000 7fcb6f738700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb681013e0 0x7fcb68198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.498+0000 7fcb6f738700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb68101d80 0x7fcb6819f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.498+0000 7fcb6f738700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6819fb30 con 0x7fcb68101d80 2024-05-10T03:44:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.498+0000 7fcb6f738700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6819fca0 con 0x7fcb681002c0 2024-05-10T03:44:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.498+0000 7fcb6f738700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6819fe60 con 0x7fcb681013e0 2024-05-10T03:44:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.498+0000 7fcb6dcd5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb68101d80 0x7fcb6819f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.498+0000 7fcb6dcd5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb68101d80 0x7fcb6819f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33574/0 (socket says 172.21.15.45:33574) 2024-05-10T03:44:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.498+0000 7fcb6dcd5700 1 -- 172.21.15.45:0/644328618 learned_addr learned my addr 172.21.15.45:0/644328618 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:44:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.498+0000 7fcb6ccd3700 1 --2- 172.21.15.45:0/644328618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb681013e0 0x7fcb68198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.498+0000 7fcb6d4d4700 1 --2- 172.21.15.45:0/644328618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb681002c0 0x7fcb68198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.498+0000 7fcb6dcd5700 1 -- 172.21.15.45:0/644328618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb681013e0 msgr2=0x7fcb68198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.498+0000 7fcb6dcd5700 1 --2- 172.21.15.45:0/644328618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb681013e0 0x7fcb68198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.498+0000 7fcb6dcd5700 1 -- 172.21.15.45:0/644328618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb681002c0 msgr2=0x7fcb68198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.498+0000 7fcb6dcd5700 1 --2- 172.21.15.45:0/644328618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb681002c0 0x7fcb68198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.498+0000 7fcb6dcd5700 1 -- 172.21.15.45:0/644328618 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5c00a700 con 0x7fcb68101d80 2024-05-10T03:44:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.499+0000 7fcb6dcd5700 1 --2- 172.21.15.45:0/644328618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb68101d80 0x7fcb6819f520 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fcb60007ee0 tx=0x7fcb6000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.499+0000 7fcb5a7fc700 1 -- 172.21.15.45:0/644328618 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb60017070 con 0x7fcb68101d80 2024-05-10T03:44:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.499+0000 7fcb5a7fc700 1 -- 172.21.15.45:0/644328618 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcb6000f040 con 0x7fcb68101d80 2024-05-10T03:44:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.499+0000 7fcb6f738700 1 -- 172.21.15.45:0/644328618 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb681a0140 con 0x7fcb68101d80 2024-05-10T03:44:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.499+0000 7fcb5a7fc700 1 -- 172.21.15.45:0/644328618 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb60005610 con 0x7fcb68101d80 2024-05-10T03:44:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.499+0000 7fcb6f738700 1 -- 172.21.15.45:0/644328618 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb681a0600 con 0x7fcb68101d80 2024-05-10T03:44:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.500+0000 7fcb6f738700 1 -- 172.21.15.45:0/644328618 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb681074d0 con 0x7fcb68101d80 2024-05-10T03:44:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.501+0000 7fcb5a7fc700 1 -- 172.21.15.45:0/644328618 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fcb60005770 con 0x7fcb68101d80 2024-05-10T03:44:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.502+0000 7fcb5a7fc700 1 --2- 172.21.15.45:0/644328618 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcb540a11c0 0x7fcb540a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.502+0000 7fcb6d4d4700 1 --2- 172.21.15.45:0/644328618 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcb540a11c0 0x7fcb540a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.502+0000 7fcb5a7fc700 1 -- 172.21.15.45:0/644328618 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fcb600cc9b0 con 0x7fcb68101d80 2024-05-10T03:44:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.502+0000 7fcb6d4d4700 1 --2- 172.21.15.45:0/644328618 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcb540a11c0 0x7fcb540a36d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c003d60 tx=0x7fcb5c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:10.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.506+0000 7fcb5a7fc700 1 -- 172.21.15.45:0/644328618 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fcb60095da0 con 0x7fcb68101d80 2024-05-10T03:44:10.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.725+0000 7fcb6f738700 1 -- 172.21.15.45:0/644328618 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcb6810b580 con 0x7fcb68101d80 2024-05-10T03:44:10.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.726+0000 7fcb5a7fc700 1 -- 172.21.15.45:0/644328618 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcb60009390 con 0x7fcb68101d80 2024-05-10T03:44:10.728 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-05-10T03:44:10.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.728+0000 7fcb6f738700 1 -- 172.21.15.45:0/644328618 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcb540a11c0 msgr2=0x7fcb540a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:10.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.728+0000 7fcb6f738700 1 --2- 172.21.15.45:0/644328618 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcb540a11c0 0x7fcb540a36d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c003d60 tx=0x7fcb5c005fb0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.728+0000 7fcb6f738700 1 -- 172.21.15.45:0/644328618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb68101d80 msgr2=0x7fcb6819f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:10.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.728+0000 7fcb6f738700 1 --2- 172.21.15.45:0/644328618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb68101d80 0x7fcb6819f520 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fcb60007ee0 tx=0x7fcb6000d3b0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.728+0000 7fcb6f738700 1 -- 172.21.15.45:0/644328618 shutdown_connections 2024-05-10T03:44:10.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.728+0000 7fcb6f738700 1 --2- 172.21.15.45:0/644328618 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fcb540a11c0 0x7fcb540a36d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.728+0000 7fcb6f738700 1 --2- 172.21.15.45:0/644328618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb68101d80 0x7fcb6819f520 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.728+0000 7fcb6f738700 1 --2- 172.21.15.45:0/644328618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb681002c0 0x7fcb68198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.728+0000 7fcb6f738700 1 --2- 172.21.15.45:0/644328618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb681013e0 0x7fcb68198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.728+0000 7fcb6f738700 1 -- 172.21.15.45:0/644328618 >> 172.21.15.45:0/644328618 conn(0x7fcb680fb8f0 msgr2=0x7fcb68104610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:10.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.728+0000 7fcb6f738700 1 -- 172.21.15.45:0/644328618 shutdown_connections 2024-05-10T03:44:10.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.728+0000 7fcb6f738700 1 -- 172.21.15.45:0/644328618 wait complete. 2024-05-10T03:44:10.745 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T03:44:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.895+0000 7fa697ea9700 1 -- 172.21.15.45:0/2141572544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa690101be0 msgr2=0x7fa690101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.895+0000 7fa697ea9700 1 --2- 172.21.15.45:0/2141572544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa690101be0 0x7fa690101ff0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa680009990 tx=0x7fa680009ca0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.895+0000 7fa697ea9700 1 -- 172.21.15.45:0/2141572544 shutdown_connections 2024-05-10T03:44:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.895+0000 7fa697ea9700 1 --2- 172.21.15.45:0/2141572544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa690102580 0x7fa690108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.895+0000 7fa697ea9700 1 --2- 172.21.15.45:0/2141572544 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa690100ac0 0x7fa690100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.895+0000 7fa697ea9700 1 --2- 172.21.15.45:0/2141572544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa690101be0 0x7fa690101ff0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.895+0000 7fa697ea9700 1 -- 172.21.15.45:0/2141572544 >> 172.21.15.45:0/2141572544 conn(0x7fa6900fc0d0 msgr2=0x7fa6900fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.895+0000 7fa697ea9700 1 -- 172.21.15.45:0/2141572544 shutdown_connections 2024-05-10T03:44:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.895+0000 7fa697ea9700 1 -- 172.21.15.45:0/2141572544 wait complete. 2024-05-10T03:44:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.896+0000 7fa697ea9700 1 Processor -- start 2024-05-10T03:44:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.896+0000 7fa697ea9700 1 -- start start 2024-05-10T03:44:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.896+0000 7fa697ea9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa690100ac0 0x7fa690196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.896+0000 7fa697ea9700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa690101be0 0x7fa6901973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.896+0000 7fa697ea9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa690102580 0x7fa69019e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.896+0000 7fa697ea9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69019e970 con 0x7fa690102580 2024-05-10T03:44:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.896+0000 7fa697ea9700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69019eae0 con 0x7fa690101be0 2024-05-10T03:44:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.896+0000 7fa697ea9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69019eca0 con 0x7fa690100ac0 2024-05-10T03:44:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.897+0000 7fa696446700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa690102580 0x7fa69019e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.897+0000 7fa696446700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa690102580 0x7fa69019e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33586/0 (socket says 172.21.15.45:33586) 2024-05-10T03:44:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.897+0000 7fa696446700 1 -- 172.21.15.45:0/3820539068 learned_addr learned my addr 172.21.15.45:0/3820539068 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:44:10.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.897+0000 7fa695c45700 1 --2- 172.21.15.45:0/3820539068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa690100ac0 0x7fa690196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:10.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.897+0000 7fa695444700 1 --2- 172.21.15.45:0/3820539068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa690101be0 0x7fa6901973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:10.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.897+0000 7fa696446700 1 -- 172.21.15.45:0/3820539068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa690100ac0 msgr2=0x7fa690196e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:10.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.897+0000 7fa696446700 1 --2- 172.21.15.45:0/3820539068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa690100ac0 0x7fa690196e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.897+0000 7fa696446700 1 -- 172.21.15.45:0/3820539068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa690101be0 msgr2=0x7fa6901973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:10.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.897+0000 7fa696446700 1 --2- 172.21.15.45:0/3820539068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa690101be0 0x7fa6901973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:10.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.897+0000 7fa696446700 1 -- 172.21.15.45:0/3820539068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6800095f0 con 0x7fa690102580 2024-05-10T03:44:10.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.897+0000 7fa695444700 1 --2- 172.21.15.45:0/3820539068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa690101be0 0x7fa6901973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:44:10.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.897+0000 7fa696446700 1 --2- 172.21.15.45:0/3820539068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa690102580 0x7fa69019e360 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa688007ee0 tx=0x7fa68800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:10.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.897+0000 7fa686ffd700 1 -- 172.21.15.45:0/3820539068 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa688017070 con 0x7fa690102580 2024-05-10T03:44:10.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.897+0000 7fa697ea9700 1 -- 172.21.15.45:0/3820539068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa69019ef80 con 0x7fa690102580 2024-05-10T03:44:10.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.897+0000 7fa686ffd700 1 -- 172.21.15.45:0/3820539068 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa68800f040 con 0x7fa690102580 2024-05-10T03:44:10.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.897+0000 7fa686ffd700 1 -- 172.21.15.45:0/3820539068 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa688005760 con 0x7fa690102580 2024-05-10T03:44:10.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.897+0000 7fa697ea9700 1 -- 172.21.15.45:0/3820539068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa69019f3b0 con 0x7fa690102580 2024-05-10T03:44:10.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.898+0000 7fa697ea9700 1 -- 172.21.15.45:0/3820539068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa690107cd0 con 0x7fa690102580 2024-05-10T03:44:10.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.900+0000 7fa686ffd700 1 -- 172.21.15.45:0/3820539068 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa6880058c0 con 0x7fa690102580 2024-05-10T03:44:10.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.901+0000 7fa686ffd700 1 --2- 172.21.15.45:0/3820539068 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa67c0a11c0 0x7fa67c0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:10.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.901+0000 7fa686ffd700 1 -- 172.21.15.45:0/3820539068 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa6880cc9e0 con 0x7fa690102580 2024-05-10T03:44:10.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.901+0000 7fa695c45700 1 --2- 172.21.15.45:0/3820539068 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa67c0a11c0 0x7fa67c0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:10.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.901+0000 7fa695c45700 1 --2- 172.21.15.45:0/3820539068 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa67c0a11c0 0x7fa67c0a36d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa690101ae0 tx=0x7fa68c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:10.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:10.904+0000 7fa686ffd700 1 -- 172.21.15.45:0/3820539068 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa688095dd0 con 0x7fa690102580 2024-05-10T03:44:11.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.121+0000 7fa697ea9700 1 -- 172.21.15.45:0/3820539068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa69010c400 con 0x7fa690102580 2024-05-10T03:44:11.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.122+0000 7fa686ffd700 1 -- 172.21.15.45:0/3820539068 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa688009390 con 0x7fa690102580 2024-05-10T03:44:11.125 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2024-05-10T03:44:11.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.124+0000 7fa697ea9700 1 -- 172.21.15.45:0/3820539068 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa67c0a11c0 msgr2=0x7fa67c0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:11.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.124+0000 7fa697ea9700 1 --2- 172.21.15.45:0/3820539068 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa67c0a11c0 0x7fa67c0a36d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa690101ae0 tx=0x7fa68c00b410 comp rx=0 tx=0).stop 2024-05-10T03:44:11.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.124+0000 7fa697ea9700 1 -- 172.21.15.45:0/3820539068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa690102580 msgr2=0x7fa69019e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:11.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.124+0000 7fa697ea9700 1 --2- 172.21.15.45:0/3820539068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa690102580 0x7fa69019e360 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa688007ee0 tx=0x7fa68800d3b0 comp rx=0 tx=0).stop 2024-05-10T03:44:11.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.124+0000 7fa697ea9700 1 -- 172.21.15.45:0/3820539068 shutdown_connections 2024-05-10T03:44:11.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.124+0000 7fa697ea9700 1 --2- 172.21.15.45:0/3820539068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa690100ac0 0x7fa690196e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:11.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.124+0000 7fa697ea9700 1 --2- 172.21.15.45:0/3820539068 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fa67c0a11c0 0x7fa67c0a36d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:11.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.124+0000 7fa697ea9700 1 --2- 172.21.15.45:0/3820539068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa690102580 0x7fa69019e360 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:11.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.124+0000 7fa697ea9700 1 --2- 172.21.15.45:0/3820539068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa690101be0 0x7fa6901973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:11.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.124+0000 7fa697ea9700 1 -- 172.21.15.45:0/3820539068 >> 172.21.15.45:0/3820539068 conn(0x7fa6900fc0d0 msgr2=0x7fa690104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:11.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.125+0000 7fa697ea9700 1 -- 172.21.15.45:0/3820539068 shutdown_connections 2024-05-10T03:44:11.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.125+0000 7fa697ea9700 1 -- 172.21.15.45:0/3820539068 wait complete. 2024-05-10T03:44:11.142 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-10T03:44:11.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.293+0000 7f4adb57a700 1 -- 172.21.15.45:0/2649433932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ad41078b0 msgr2=0x7f4ad4109dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:11.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.293+0000 7f4adb57a700 1 --2- 172.21.15.45:0/2649433932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ad41078b0 0x7f4ad4109dc0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f4acc00b0a0 tx=0x7f4acc00b3b0 comp rx=0 tx=0).stop 2024-05-10T03:44:11.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.293+0000 7f4adb57a700 1 -- 172.21.15.45:0/2649433932 shutdown_connections 2024-05-10T03:44:11.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.293+0000 7f4adb57a700 1 --2- 172.21.15.45:0/2649433932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ad4074110 0x7f4ad4104750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:11.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.293+0000 7f4adb57a700 1 --2- 172.21.15.45:0/2649433932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ad41078b0 0x7f4ad4109dc0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:11.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.293+0000 7f4adb57a700 1 --2- 172.21.15.45:0/2649433932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ad4104d40 0x7f4ad4107220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:11.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.293+0000 7f4adb57a700 1 -- 172.21.15.45:0/2649433932 >> 172.21.15.45:0/2649433932 conn(0x7f4ad40fc0e0 msgr2=0x7f4ad40fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:11.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.293+0000 7f4adb57a700 1 -- 172.21.15.45:0/2649433932 shutdown_connections 2024-05-10T03:44:11.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.293+0000 7f4adb57a700 1 -- 172.21.15.45:0/2649433932 wait complete. 2024-05-10T03:44:11.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.294+0000 7f4adb57a700 1 Processor -- start 2024-05-10T03:44:11.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.294+0000 7f4adb57a700 1 -- start start 2024-05-10T03:44:11.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.294+0000 7f4adb57a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ad4074110 0x7f4ad4198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:11.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.294+0000 7f4adb57a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ad4104d40 0x7f4ad41985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:11.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.294+0000 7f4adb57a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ad41078b0 0x7f4ad419f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:11.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.294+0000 7f4adb57a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad419fb60 con 0x7f4ad4104d40 2024-05-10T03:44:11.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.294+0000 7f4adb57a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad419fcd0 con 0x7f4ad4074110 2024-05-10T03:44:11.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.294+0000 7f4adb57a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad419fe90 con 0x7f4ad41078b0 2024-05-10T03:44:11.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.294+0000 7f4ad8b15700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ad4104d40 0x7f4ad41985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:11.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.294+0000 7f4ad8b15700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ad4104d40 0x7f4ad41985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33592/0 (socket says 172.21.15.45:33592) 2024-05-10T03:44:11.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.294+0000 7f4ad8b15700 1 -- 172.21.15.45:0/3342553557 learned_addr learned my addr 172.21.15.45:0/3342553557 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:44:11.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.294+0000 7f4ad9b17700 1 --2- 172.21.15.45:0/3342553557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ad41078b0 0x7f4ad419f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:11.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.295+0000 7f4ad9316700 1 --2- 172.21.15.45:0/3342553557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ad4074110 0x7f4ad4198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:11.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.295+0000 7f4ad8b15700 1 -- 172.21.15.45:0/3342553557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ad41078b0 msgr2=0x7f4ad419f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:11.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.295+0000 7f4ad8b15700 1 --2- 172.21.15.45:0/3342553557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ad41078b0 0x7f4ad419f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:11.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.295+0000 7f4ad8b15700 1 -- 172.21.15.45:0/3342553557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ad4074110 msgr2=0x7f4ad4198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:11.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.295+0000 7f4ad8b15700 1 --2- 172.21.15.45:0/3342553557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ad4074110 0x7f4ad4198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:11.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.295+0000 7f4ad8b15700 1 -- 172.21.15.45:0/3342553557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc009d00 con 0x7f4ad4104d40 2024-05-10T03:44:11.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.295+0000 7f4ad9b17700 1 --2- 172.21.15.45:0/3342553557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ad41078b0 0x7f4ad419f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:44:11.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.295+0000 7f4ad9316700 1 --2- 172.21.15.45:0/3342553557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ad4074110 0x7f4ad4198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:44:11.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.295+0000 7f4ad8b15700 1 --2- 172.21.15.45:0/3342553557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ad4104d40 0x7f4ad41985c0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400d980 tx=0x7f4ac400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:11.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.295+0000 7f4aca7fc700 1 -- 172.21.15.45:0/3342553557 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4004220 con 0x7f4ad4104d40 2024-05-10T03:44:11.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.295+0000 7f4adb57a700 1 -- 172.21.15.45:0/3342553557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad41a0170 con 0x7f4ad4104d40 2024-05-10T03:44:11.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.295+0000 7f4aca7fc700 1 -- 172.21.15.45:0/3342553557 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4ac4007640 con 0x7f4ad4104d40 2024-05-10T03:44:11.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.295+0000 7f4aca7fc700 1 -- 172.21.15.45:0/3342553557 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4005720 con 0x7f4ad4104d40 2024-05-10T03:44:11.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.295+0000 7f4adb57a700 1 -- 172.21.15.45:0/3342553557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad41a06d0 con 0x7f4ad4104d40 2024-05-10T03:44:11.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.296+0000 7f4adb57a700 1 -- 172.21.15.45:0/3342553557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad40fdc90 con 0x7f4ad4104d40 2024-05-10T03:44:11.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.298+0000 7f4aca7fc700 1 -- 172.21.15.45:0/3342553557 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4ac4004750 con 0x7f4ad4104d40 2024-05-10T03:44:11.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.299+0000 7f4aca7fc700 1 --2- 172.21.15.45:0/3342553557 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4ac00a11c0 0x7f4ac00a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:11.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.299+0000 7f4aca7fc700 1 -- 172.21.15.45:0/3342553557 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f4ac40ccff0 con 0x7f4ad4104d40 2024-05-10T03:44:11.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.299+0000 7f4ad9316700 1 --2- 172.21.15.45:0/3342553557 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4ac00a11c0 0x7f4ac00a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:11.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.300+0000 7f4ad9316700 1 --2- 172.21.15.45:0/3342553557 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4ac00a11c0 0x7f4ac00a36d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4074520 tx=0x7f4ad0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:11.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.303+0000 7f4aca7fc700 1 -- 172.21.15.45:0/3342553557 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4ac40963c0 con 0x7f4ad4104d40 2024-05-10T03:44:11.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:11 smithi106 ceph-mon[46996]: pgmap v402: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 511 B/s wr, 11 op/s 2024-05-10T03:44:11.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:11 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/824865177' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:44:11.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:11 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/644328618' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:44:11.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:11 smithi154 ceph-mon[46565]: pgmap v402: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 511 B/s wr, 11 op/s 2024-05-10T03:44:11.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:11 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/824865177' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:44:11.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:11 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/644328618' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:44:11.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.520+0000 7f4adb57a700 1 -- 172.21.15.45:0/3342553557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4ad410d530 con 0x7f4ad4104d40 2024-05-10T03:44:11.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.520+0000 7f4aca7fc700 1 -- 172.21.15.45:0/3342553557 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4ac4016020 con 0x7f4ad4104d40 2024-05-10T03:44:11.523 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-05-10T03:44:11.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.523+0000 7f4adb57a700 1 -- 172.21.15.45:0/3342553557 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4ac00a11c0 msgr2=0x7f4ac00a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:11.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.523+0000 7f4adb57a700 1 --2- 172.21.15.45:0/3342553557 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4ac00a11c0 0x7f4ac00a36d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4074520 tx=0x7f4ad0009260 comp rx=0 tx=0).stop 2024-05-10T03:44:11.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.523+0000 7f4adb57a700 1 -- 172.21.15.45:0/3342553557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ad4104d40 msgr2=0x7f4ad41985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:11.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.523+0000 7f4adb57a700 1 --2- 172.21.15.45:0/3342553557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ad4104d40 0x7f4ad41985c0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400d980 tx=0x7f4ac400dc90 comp rx=0 tx=0).stop 2024-05-10T03:44:11.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.523+0000 7f4adb57a700 1 -- 172.21.15.45:0/3342553557 shutdown_connections 2024-05-10T03:44:11.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.523+0000 7f4adb57a700 1 --2- 172.21.15.45:0/3342553557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ad41078b0 0x7f4ad419f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:11.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.523+0000 7f4adb57a700 1 --2- 172.21.15.45:0/3342553557 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4ac00a11c0 0x7f4ac00a36d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:11.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.523+0000 7f4adb57a700 1 --2- 172.21.15.45:0/3342553557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ad4074110 0x7f4ad4198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:11.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.523+0000 7f4adb57a700 1 --2- 172.21.15.45:0/3342553557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ad4104d40 0x7f4ad41985c0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:11.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.523+0000 7f4adb57a700 1 -- 172.21.15.45:0/3342553557 >> 172.21.15.45:0/3342553557 conn(0x7f4ad40fc0e0 msgr2=0x7f4ad4103170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:11.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.523+0000 7f4adb57a700 1 -- 172.21.15.45:0/3342553557 shutdown_connections 2024-05-10T03:44:11.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.523+0000 7f4adb57a700 1 -- 172.21.15.45:0/3342553557 wait complete. 2024-05-10T03:44:11.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:11 smithi045 ceph-mon[42520]: pgmap v402: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 511 B/s wr, 11 op/s 2024-05-10T03:44:11.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:11 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/824865177' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T03:44:11.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:11 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/644328618' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T03:44:11.540 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T03:44:11.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.687+0000 7f4e6b339700 1 -- 172.21.15.45:0/1406607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e64100ac0 msgr2=0x7f4e64100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:11.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.687+0000 7f4e6b339700 1 --2- 172.21.15.45:0/1406607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e64100ac0 0x7f4e64100ed0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009990 tx=0x7f4e60009ca0 comp rx=0 tx=0).stop 2024-05-10T03:44:11.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.687+0000 7f4e6b339700 1 -- 172.21.15.45:0/1406607 shutdown_connections 2024-05-10T03:44:11.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.687+0000 7f4e6b339700 1 --2- 172.21.15.45:0/1406607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e64102580 0x7f4e64108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:11.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.687+0000 7f4e6b339700 1 --2- 172.21.15.45:0/1406607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e64100ac0 0x7f4e64100ed0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:11.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.687+0000 7f4e6b339700 1 --2- 172.21.15.45:0/1406607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e64101be0 0x7f4e64101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:11.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.687+0000 7f4e6b339700 1 -- 172.21.15.45:0/1406607 >> 172.21.15.45:0/1406607 conn(0x7f4e640fc0d0 msgr2=0x7f4e640fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:11.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.687+0000 7f4e6b339700 1 -- 172.21.15.45:0/1406607 shutdown_connections 2024-05-10T03:44:11.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.687+0000 7f4e6b339700 1 -- 172.21.15.45:0/1406607 wait complete. 2024-05-10T03:44:11.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.688+0000 7f4e6b339700 1 Processor -- start 2024-05-10T03:44:11.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.688+0000 7f4e6b339700 1 -- start start 2024-05-10T03:44:11.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.688+0000 7f4e6b339700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e64100ac0 0x7f4e64197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:11.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.688+0000 7f4e6b339700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e64101be0 0x7f4e64198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:11.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.688+0000 7f4e6b339700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e64102580 0x7f4e6419f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:11.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.688+0000 7f4e6b339700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6419fa70 con 0x7f4e64100ac0 2024-05-10T03:44:11.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.688+0000 7f4e6b339700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6419fbe0 con 0x7f4e64101be0 2024-05-10T03:44:11.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.688+0000 7f4e6b339700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6419fda0 con 0x7f4e64102580 2024-05-10T03:44:11.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.688+0000 7f4e690d5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e64100ac0 0x7f4e64197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:11.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.688+0000 7f4e690d5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e64100ac0 0x7f4e64197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33602/0 (socket says 172.21.15.45:33602) 2024-05-10T03:44:11.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.688+0000 7f4e690d5700 1 -- 172.21.15.45:0/2104172058 learned_addr learned my addr 172.21.15.45:0/2104172058 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:44:11.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.688+0000 7f4e688d4700 1 --2- 172.21.15.45:0/2104172058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e64101be0 0x7f4e64198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:11.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.688+0000 7f4e698d6700 1 --2- 172.21.15.45:0/2104172058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e64102580 0x7f4e6419f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:11.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.688+0000 7f4e690d5700 1 -- 172.21.15.45:0/2104172058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e64102580 msgr2=0x7f4e6419f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:11.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.688+0000 7f4e690d5700 1 --2- 172.21.15.45:0/2104172058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e64102580 0x7f4e6419f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:11.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.688+0000 7f4e690d5700 1 -- 172.21.15.45:0/2104172058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e64101be0 msgr2=0x7f4e64198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:11.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.688+0000 7f4e690d5700 1 --2- 172.21.15.45:0/2104172058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e64101be0 0x7f4e64198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:11.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.688+0000 7f4e690d5700 1 -- 172.21.15.45:0/2104172058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e600095f0 con 0x7f4e64100ac0 2024-05-10T03:44:11.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.689+0000 7f4e690d5700 1 --2- 172.21.15.45:0/2104172058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e64100ac0 0x7f4e64197fe0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f4e600098e0 tx=0x7f4e60005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:11.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.689+0000 7f4e5a7fc700 1 -- 172.21.15.45:0/2104172058 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6001d070 con 0x7f4e64100ac0 2024-05-10T03:44:11.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.689+0000 7f4e5a7fc700 1 -- 172.21.15.45:0/2104172058 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4e6000fd40 con 0x7f4e64100ac0 2024-05-10T03:44:11.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.689+0000 7f4e6b339700 1 -- 172.21.15.45:0/2104172058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e641a0020 con 0x7f4e64100ac0 2024-05-10T03:44:11.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.689+0000 7f4e5a7fc700 1 -- 172.21.15.45:0/2104172058 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e600173f0 con 0x7f4e64100ac0 2024-05-10T03:44:11.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.689+0000 7f4e6b339700 1 -- 172.21.15.45:0/2104172058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e641a04a0 con 0x7f4e64100ac0 2024-05-10T03:44:11.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.691+0000 7f4e6b339700 1 -- 172.21.15.45:0/2104172058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e640694d0 con 0x7f4e64100ac0 2024-05-10T03:44:11.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.691+0000 7f4e5a7fc700 1 -- 172.21.15.45:0/2104172058 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4e60021410 con 0x7f4e64100ac0 2024-05-10T03:44:11.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.692+0000 7f4e5a7fc700 1 --2- 172.21.15.45:0/2104172058 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4e500a1240 0x7f4e500a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:11.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.692+0000 7f4e688d4700 1 --2- 172.21.15.45:0/2104172058 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4e500a1240 0x7f4e500a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:11.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.692+0000 7f4e5a7fc700 1 -- 172.21.15.45:0/2104172058 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f4e600cddc0 con 0x7f4e64100ac0 2024-05-10T03:44:11.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.693+0000 7f4e688d4700 1 --2- 172.21.15.45:0/2104172058 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4e500a1240 0x7f4e500a3750 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4e64199030 tx=0x7f4e5400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:11.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.697+0000 7f4e5a7fc700 1 -- 172.21.15.45:0/2104172058 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4e60097240 con 0x7f4e64100ac0 2024-05-10T03:44:11.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.934+0000 7f4e6b339700 1 -- 172.21.15.45:0/2104172058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4e641a06c0 con 0x7f4e64100ac0 2024-05-10T03:44:11.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.934+0000 7f4e5a7fc700 1 -- 172.21.15.45:0/2104172058 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) v1 ==== 81+0+587 (secure 0 0 0) 0x7f4e6009a860 con 0x7f4e64100ac0 2024-05-10T03:44:11.937 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6801/485502847 2024-05-11T03:33:25.801965+0000 2024-05-10T03:44:11.937 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6800/485502847 2024-05-11T03:33:25.801965+0000 2024-05-10T03:44:11.937 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/477110319 2024-05-11T03:33:25.801965+0000 2024-05-10T03:44:11.937 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6800/534860598 2024-05-11T03:33:02.846802+0000 2024-05-10T03:44:11.937 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/2249239510 2024-05-11T03:33:25.801965+0000 2024-05-10T03:44:11.937 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/2903615785 2024-05-11T03:33:02.846802+0000 2024-05-10T03:44:11.937 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6801/534860598 2024-05-11T03:33:02.846802+0000 2024-05-10T03:44:11.937 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/2125492352 2024-05-11T03:33:02.846802+0000 2024-05-10T03:44:11.937 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/3226767328 2024-05-11T03:33:02.846802+0000 2024-05-10T03:44:11.937 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/4077940265 2024-05-11T03:33:25.801965+0000 2024-05-10T03:44:11.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.937+0000 7f4e6b339700 1 -- 172.21.15.45:0/2104172058 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4e500a1240 msgr2=0x7f4e500a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:11.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.937+0000 7f4e6b339700 1 --2- 172.21.15.45:0/2104172058 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4e500a1240 0x7f4e500a3750 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4e64199030 tx=0x7f4e5400b410 comp rx=0 tx=0).stop 2024-05-10T03:44:11.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.937+0000 7f4e6b339700 1 -- 172.21.15.45:0/2104172058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e64100ac0 msgr2=0x7f4e64197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.937+0000 7f4e6b339700 1 --2- 172.21.15.45:0/2104172058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e64100ac0 0x7f4e64197fe0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f4e600098e0 tx=0x7f4e60005b00 comp rx=0 tx=0).stop 2024-05-10T03:44:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.937+0000 7f4e6b339700 1 -- 172.21.15.45:0/2104172058 shutdown_connections 2024-05-10T03:44:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.937+0000 7f4e6b339700 1 --2- 172.21.15.45:0/2104172058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e64102580 0x7f4e6419f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.937+0000 7f4e6b339700 1 --2- 172.21.15.45:0/2104172058 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f4e500a1240 0x7f4e500a3750 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.937+0000 7f4e6b339700 1 --2- 172.21.15.45:0/2104172058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e64100ac0 0x7f4e64197fe0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.937+0000 7f4e6b339700 1 --2- 172.21.15.45:0/2104172058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4e64101be0 0x7f4e64198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.937+0000 7f4e6b339700 1 -- 172.21.15.45:0/2104172058 >> 172.21.15.45:0/2104172058 conn(0x7f4e640fc0d0 msgr2=0x7f4e640fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.937+0000 7f4e6b339700 1 -- 172.21.15.45:0/2104172058 shutdown_connections 2024-05-10T03:44:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:11.937+0000 7f4e6b339700 1 -- 172.21.15.45:0/2104172058 wait complete. 2024-05-10T03:44:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:listed 10 entries 2024-05-10T03:44:11.954 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T03:44:11.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:44:11.954 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T03:44:12.107 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2024-05-10T03:44:12.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:44:12.108 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T03:44:12.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:44:12.175 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2024-05-10T03:44:12.222 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T03:44:12.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:44:12.223 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T03:44:12.283 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:12 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3820539068' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:44:12.283 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:12 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3342553557' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:44:12.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:12 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2104172058' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-10T03:44:12.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:44:12.305 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2024-05-10T03:44:12.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:12 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3820539068' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:44:12.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:12 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3342553557' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:44:12.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:12 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2104172058' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-10T03:44:12.410 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-10T03:44:12.410 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-10T03:44:12.410 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:44:12.432 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16247272k,nr_inodes=4061818,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20087 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3253140k,mode=700,uid=1000,gid=1304 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/e6e554a4bb5551753bfcf0426d217ac81ee83c89b066ced1ea45aff5b3ec78a3/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/O2K2HH3DH2D4NGSKY5FCE6ZI3J:/var/lib/containers/storage/overlay/l/5LWZKWFL3VCGCMAWTVMYIVRO53,upperdir=/var/lib/containers/storage/overlay/e6e554a4bb5551753bfcf0426d217ac81ee83c89b066ced1ea45aff5b3ec78a3/diff,workdir=/var/lib/containers/storage/overlay/e6e554a4bb5551753bfcf0426d217ac81ee83c89b066ced1ea45aff5b3ec78a3/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/b856ba69a6e29b0d6327f84f33bd55f5117a6e805d46a21a800cc433e304a0d9/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/O2K2HH3DH2D4NGSKY5FCE6ZI3J:/var/lib/containers/storage/overlay/l/5LWZKWFL3VCGCMAWTVMYIVRO53,upperdir=/var/lib/containers/storage/overlay/b856ba69a6e29b0d6327f84f33bd55f5117a6e805d46a21a800cc433e304a0d9/diff,workdir=/var/lib/containers/storage/overlay/b856ba69a6e29b0d6327f84f33bd55f5117a6e805d46a21a800cc433e304a0d9/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3253140k,mode=700 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,relatime 0 0 overlay /var/lib/containers/storage/overlay/fca76f03d1c44a9d31789ecb8dd46d332de142fce43758151dfe70050d541df0/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/O2K2HH3DH2D4NGSKY5FCE6ZI3J:/var/lib/containers/storage/overlay/l/5LWZKWFL3VCGCMAWTVMYIVRO53,upperdir=/var/lib/containers/storage/overlay/fca76f03d1c44a9d31789ecb8dd46d332de142fce43758151dfe70050d541df0/diff,workdir=/var/lib/containers/storage/overlay/fca76f03d1c44a9d31789ecb8dd46d332de142fce43758151dfe70050d541df0/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/a3677a00dd84f31589b07cf6d7f4b1dae6ae25bce3e825eeceba9f3f57f84226/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/O2K2HH3DH2D4NGSKY5FCE6ZI3J:/var/lib/containers/storage/overlay/l/5LWZKWFL3VCGCMAWTVMYIVRO53,upperdir=/var/lib/containers/storage/overlay/a3677a00dd84f31589b07cf6d7f4b1dae6ae25bce3e825eeceba9f3f57f84226/diff,workdir=/var/lib/containers/storage/overlay/a3677a00dd84f31589b07cf6d7f4b1dae6ae25bce3e825eeceba9f3f57f84226/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/aaab4253761a8ccb1033d53c7d89271f3760c340a4d6023fc9aacea0e7340eb5/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/O2K2HH3DH2D4NGSKY5FCE6ZI3J:/var/lib/containers/storage/overlay/l/5LWZKWFL3VCGCMAWTVMYIVRO53,upperdir=/var/lib/containers/storage/overlay/aaab4253761a8ccb1033d53c7d89271f3760c340a4d6023fc9aacea0e7340eb5/diff,workdir=/var/lib/containers/storage/overlay/aaab4253761a8ccb1033d53c7d89271f3760c340a4d6023fc9aacea0e7340eb5/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/237d87485b8cc8911bb0e68dc3faaafe3a7fd9279f7be3aac67946000d8259ff/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/O2K2HH3DH2D4NGSKY5FCE6ZI3J:/var/lib/containers/storage/overlay/l/5LWZKWFL3VCGCMAWTVMYIVRO53,upperdir=/var/lib/containers/storage/overlay/237d87485b8cc8911bb0e68dc3faaafe3a7fd9279f7be3aac67946000d8259ff/diff,workdir=/var/lib/containers/storage/overlay/237d87485b8cc8911bb0e68dc3faaafe3a7fd9279f7be3aac67946000d8259ff/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/bdfe5bc6d8279582e0115f14f3d7bc524f6f172f110ad5b7af4a5582f2cc0e4b/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/O2K2HH3DH2D4NGSKY5FCE6ZI3J:/var/lib/containers/storage/overlay/l/5LWZKWFL3VCGCMAWTVMYIVRO53,upperdir=/var/lib/containers/storage/overlay/bdfe5bc6d8279582e0115f14f3d7bc524f6f172f110ad5b7af4a5582f2cc0e4b/diff,workdir=/var/lib/containers/storage/overlay/bdfe5bc6d8279582e0115f14f3d7bc524f6f172f110ad5b7af4a5582f2cc0e4b/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/58394ec34bf0ba15aa7d0c2a277abed98beff26f2dba56729ac3b466a3c5e726/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/O2K2HH3DH2D4NGSKY5FCE6ZI3J:/var/lib/containers/storage/overlay/l/5LWZKWFL3VCGCMAWTVMYIVRO53,upperdir=/var/lib/containers/storage/overlay/58394ec34bf0ba15aa7d0c2a277abed98beff26f2dba56729ac3b466a3c5e726/diff,workdir=/var/lib/containers/storage/overlay/58394ec34bf0ba15aa7d0c2a277abed98beff26f2dba56729ac3b466a3c5e726/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/1f2852f104358f6df9f06fb5fdd19f23f6faf374423ea5106810ac74c9f68689/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/O2K2HH3DH2D4NGSKY5FCE6ZI3J:/var/lib/containers/storage/overlay/l/5LWZKWFL3VCGCMAWTVMYIVRO53,upperdir=/var/lib/containers/storage/overlay/1f2852f104358f6df9f06fb5fdd19f23f6faf374423ea5106810ac74c9f68689/diff,workdir=/var/lib/containers/storage/overlay/1f2852f104358f6df9f06fb5fdd19f23f6faf374423ea5106810ac74c9f68689/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/d1d0ce37c467bdc277a13368def701a568b63ce9bfa0821a1817fc616b622065/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/O2K2HH3DH2D4NGSKY5FCE6ZI3J:/var/lib/containers/storage/overlay/l/5LWZKWFL3VCGCMAWTVMYIVRO53,upperdir=/var/lib/containers/storage/overlay/d1d0ce37c467bdc277a13368def701a568b63ce9bfa0821a1817fc616b622065/diff,workdir=/var/lib/containers/storage/overlay/d1d0ce37c467bdc277a13368def701a568b63ce9bfa0821a1817fc616b622065/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 2024-05-10T03:44:12.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:44:12.433 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2024-05-10T03:44:12.473 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:12 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3820539068' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T03:44:12.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:12 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3342553557' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-10T03:44:12.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:12 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2104172058' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-10T03:44:12.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:44:12.496 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2024-05-10T03:44:12.576 INFO:teuthology.orchestra.run.smithi045.stderr:Cannot find device "ceph-brx" 2024-05-10T03:44:12.577 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:44:12.578 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-10T03:44:12.590 INFO:tasks.cephadm:Teardown begin 2024-05-10T03:44:12.590 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T03:44:12.591 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:44:12.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.775+0000 7f8e4662a700 1 -- 172.21.15.45:0/2009485749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e40101c00 msgr2=0x7f8e40102010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:12.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.775+0000 7f8e4662a700 1 --2- 172.21.15.45:0/2009485749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e40101c00 0x7f8e40102010 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f8e30009990 tx=0x7f8e30009ca0 comp rx=0 tx=0).stop 2024-05-10T03:44:12.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.775+0000 7f8e4662a700 1 -- 172.21.15.45:0/2009485749 shutdown_connections 2024-05-10T03:44:12.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.775+0000 7f8e4662a700 1 --2- 172.21.15.45:0/2009485749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e401036c0 0x7f8e40109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:12.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.775+0000 7f8e4662a700 1 --2- 172.21.15.45:0/2009485749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e40101c00 0x7f8e40102010 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:12.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.775+0000 7f8e4662a700 1 --2- 172.21.15.45:0/2009485749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e40102d20 0x7f8e40103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:12.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.775+0000 7f8e4662a700 1 -- 172.21.15.45:0/2009485749 >> 172.21.15.45:0/2009485749 conn(0x7f8e400fd210 msgr2=0x7f8e400ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:12.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.775+0000 7f8e4662a700 1 -- 172.21.15.45:0/2009485749 shutdown_connections 2024-05-10T03:44:12.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.775+0000 7f8e4662a700 1 -- 172.21.15.45:0/2009485749 wait complete. 2024-05-10T03:44:12.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.776+0000 7f8e4662a700 1 Processor -- start 2024-05-10T03:44:12.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.776+0000 7f8e4662a700 1 -- start start 2024-05-10T03:44:12.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.776+0000 7f8e4662a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e40101c00 0x7f8e401980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:12.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.776+0000 7f8e4662a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e40102d20 0x7f8e40198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:12.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.776+0000 7f8e4662a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e401036c0 0x7f8e4019f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:12.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.776+0000 7f8e4662a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4019fba0 con 0x7f8e40101c00 2024-05-10T03:44:12.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.776+0000 7f8e4662a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4019fd10 con 0x7f8e401036c0 2024-05-10T03:44:12.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.776+0000 7f8e4662a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4019fed0 con 0x7f8e40102d20 2024-05-10T03:44:12.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.777+0000 7f8e3ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e40101c00 0x7f8e401980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:12.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.777+0000 7f8e3ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e40101c00 0x7f8e401980c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33628/0 (socket says 172.21.15.45:33628) 2024-05-10T03:44:12.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.777+0000 7f8e3ffff700 1 -- 172.21.15.45:0/661987670 learned_addr learned my addr 172.21.15.45:0/661987670 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:44:12.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.777+0000 7f8e3f7fe700 1 --2- 172.21.15.45:0/661987670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e40102d20 0x7f8e40198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:12.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.777+0000 7f8e44bc7700 1 --2- 172.21.15.45:0/661987670 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e401036c0 0x7f8e4019f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:12.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.777+0000 7f8e3ffff700 1 -- 172.21.15.45:0/661987670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e40102d20 msgr2=0x7f8e40198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:12.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.777+0000 7f8e3ffff700 1 --2- 172.21.15.45:0/661987670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e40102d20 0x7f8e40198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:12.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.777+0000 7f8e3ffff700 1 -- 172.21.15.45:0/661987670 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e401036c0 msgr2=0x7f8e4019f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:12.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.777+0000 7f8e3ffff700 1 --2- 172.21.15.45:0/661987670 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e401036c0 0x7f8e4019f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:12.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.777+0000 7f8e3ffff700 1 -- 172.21.15.45:0/661987670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e300095f0 con 0x7f8e40101c00 2024-05-10T03:44:12.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.777+0000 7f8e3ffff700 1 --2- 172.21.15.45:0/661987670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e40101c00 0x7f8e401980c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f8e30000c00 tx=0x7f8e30005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:12.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.777+0000 7f8e3d7fa700 1 -- 172.21.15.45:0/661987670 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3001d070 con 0x7f8e40101c00 2024-05-10T03:44:12.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.777+0000 7f8e4662a700 1 -- 172.21.15.45:0/661987670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e401a0150 con 0x7f8e40101c00 2024-05-10T03:44:12.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.777+0000 7f8e3d7fa700 1 -- 172.21.15.45:0/661987670 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8e3000fd40 con 0x7f8e40101c00 2024-05-10T03:44:12.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.777+0000 7f8e3d7fa700 1 -- 172.21.15.45:0/661987670 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e300173f0 con 0x7f8e40101c00 2024-05-10T03:44:12.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.777+0000 7f8e4662a700 1 -- 172.21.15.45:0/661987670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e401a05d0 con 0x7f8e40101c00 2024-05-10T03:44:12.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.778+0000 7f8e4662a700 1 -- 172.21.15.45:0/661987670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e40108e10 con 0x7f8e40101c00 2024-05-10T03:44:12.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.781+0000 7f8e3d7fa700 1 -- 172.21.15.45:0/661987670 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8e30021410 con 0x7f8e40101c00 2024-05-10T03:44:12.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.781+0000 7f8e3d7fa700 1 --2- 172.21.15.45:0/661987670 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8e280a1120 0x7f8e280a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:12.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.781+0000 7f8e3f7fe700 1 --2- 172.21.15.45:0/661987670 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8e280a1120 0x7f8e280a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:12.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.781+0000 7f8e3d7fa700 1 -- 172.21.15.45:0/661987670 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f8e300ce300 con 0x7f8e40101c00 2024-05-10T03:44:12.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.782+0000 7f8e3f7fe700 1 --2- 172.21.15.45:0/661987670 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8e280a1120 0x7f8e280a3630 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8e40199160 tx=0x7f8e34009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:12.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:12.785+0000 7f8e3d7fa700 1 -- 172.21.15.45:0/661987670 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8e30097780 con 0x7f8e40101c00 2024-05-10T03:44:13.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.053+0000 7f8e4662a700 1 -- 172.21.15.45:0/661987670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e4010d680 con 0x7f8e40101c00 2024-05-10T03:44:13.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.054+0000 7f8e3d7fa700 1 -- 172.21.15.45:0/661987670 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+10962 (secure 0 0 0) 0x7f8e3009ada0 con 0x7f8e40101c00 2024-05-10T03:44:13.056 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:44:13.056 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/378320264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":378320264},{"type":"v1","addr":"172.21.15.45:6835","nonce":378320264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3032381796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3032381796},{"type":"v1","addr":"172.21.15.45:6837","nonce":3032381796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":41,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T03:38:36.555290+0000","modified":"2024-05-10T03:43:44.127240+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24548,"mds_2":24547,"mds_3":24526,"mds_4":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14625":{"gid":14625,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6839/4007419304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":4007419304},{"type":"v1","addr":"172.21.15.45:6839","nonce":4007419304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14637":{"gid":14637,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6841/1355456195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1355456195},{"type":"v1","addr":"172.21.15.45:6841","nonce":1355456195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/4037121210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":4037121210},{"type":"v1","addr":"172.21.15.154:6835","nonce":4037121210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24521":{"gid":24521,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.106:6835/4162885659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4162885659},{"type":"v1","addr":"172.21.15.106:6835","nonce":4162885659}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.154:6837/608167481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":608167481},{"type":"v1","addr":"172.21.15.154:6837","nonce":608167481}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":65,"addr":"172.21.15.154:6839/1506563336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1506563336},{"type":"v1","addr":"172.21.15.154:6839","nonce":1506563336}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.106:6837/3047487403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":3047487403},{"type":"v1","addr":"172.21.15.106:6837","nonce":3047487403}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6839/3533867856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":3533867856},{"type":"v1","addr":"172.21.15.106:6839","nonce":3533867856}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T03:44:13.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.056+0000 7f8e4662a700 1 -- 172.21.15.45:0/661987670 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8e280a1120 msgr2=0x7f8e280a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:13.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.056+0000 7f8e4662a700 1 --2- 172.21.15.45:0/661987670 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8e280a1120 0x7f8e280a3630 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8e40199160 tx=0x7f8e34009260 comp rx=0 tx=0).stop 2024-05-10T03:44:13.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.056+0000 7f8e4662a700 1 -- 172.21.15.45:0/661987670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e40101c00 msgr2=0x7f8e401980c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:13.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.056+0000 7f8e4662a700 1 --2- 172.21.15.45:0/661987670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e40101c00 0x7f8e401980c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f8e30000c00 tx=0x7f8e30005b00 comp rx=0 tx=0).stop 2024-05-10T03:44:13.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.056+0000 7f8e4662a700 1 -- 172.21.15.45:0/661987670 shutdown_connections 2024-05-10T03:44:13.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.056+0000 7f8e4662a700 1 --2- 172.21.15.45:0/661987670 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f8e280a1120 0x7f8e280a3630 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:13.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.056+0000 7f8e4662a700 1 --2- 172.21.15.45:0/661987670 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e401036c0 0x7f8e4019f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:13.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.056+0000 7f8e4662a700 1 --2- 172.21.15.45:0/661987670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e40101c00 0x7f8e401980c0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:13.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.056+0000 7f8e4662a700 1 --2- 172.21.15.45:0/661987670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e40102d20 0x7f8e40198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:13.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.056+0000 7f8e4662a700 1 -- 172.21.15.45:0/661987670 >> 172.21.15.45:0/661987670 conn(0x7f8e400fd210 msgr2=0x7f8e40105f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:13.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.056+0000 7f8e4662a700 1 -- 172.21.15.45:0/661987670 shutdown_connections 2024-05-10T03:44:13.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.057+0000 7f8e4662a700 1 -- 172.21.15.45:0/661987670 wait complete. 2024-05-10T03:44:13.060 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 41 2024-05-10T03:44:13.074 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:44:13.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.221+0000 7fec14968700 1 -- 172.21.15.45:0/3711913894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec100fff40 msgr2=0x7fec10100350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:13.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.221+0000 7fec14968700 1 --2- 172.21.15.45:0/3711913894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec100fff40 0x7fec10100350 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fec00009990 tx=0x7fec00009ca0 comp rx=0 tx=0).stop 2024-05-10T03:44:13.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.222+0000 7fec14968700 1 -- 172.21.15.45:0/3711913894 shutdown_connections 2024-05-10T03:44:13.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.222+0000 7fec14968700 1 --2- 172.21.15.45:0/3711913894 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec10107a10 0x7fec10109e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:13.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.222+0000 7fec14968700 1 --2- 172.21.15.45:0/3711913894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec100fff40 0x7fec10100350 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:13.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.222+0000 7fec14968700 1 --2- 172.21.15.45:0/3711913894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec101050b0 0x7fec101074d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:13.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.222+0000 7fec14968700 1 -- 172.21.15.45:0/3711913894 >> 172.21.15.45:0/3711913894 conn(0x7fec100fb8b0 msgr2=0x7fec100fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:13.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.222+0000 7fec14968700 1 -- 172.21.15.45:0/3711913894 shutdown_connections 2024-05-10T03:44:13.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.222+0000 7fec14968700 1 -- 172.21.15.45:0/3711913894 wait complete. 2024-05-10T03:44:13.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.222+0000 7fec14968700 1 Processor -- start 2024-05-10T03:44:13.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.223+0000 7fec14968700 1 -- start start 2024-05-10T03:44:13.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.223+0000 7fec14968700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec100fff40 0x7fec10102830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:13.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.223+0000 7fec14968700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec101050b0 0x7fec10100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:13.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.223+0000 7fec14968700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec10107a10 0x7fec10101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:13.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.223+0000 7fec14968700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec10101af0 con 0x7fec10107a10 2024-05-10T03:44:13.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.223+0000 7fec14968700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec10101c60 con 0x7fec101050b0 2024-05-10T03:44:13.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.223+0000 7fec14968700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec101a2140 con 0x7fec100fff40 2024-05-10T03:44:13.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.223+0000 7fec0ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec10107a10 0x7fec10101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:13.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.223+0000 7fec0ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec10107a10 0x7fec10101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33648/0 (socket says 172.21.15.45:33648) 2024-05-10T03:44:13.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.223+0000 7fec0ed9d700 1 -- 172.21.15.45:0/1174358225 learned_addr learned my addr 172.21.15.45:0/1174358225 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:44:13.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.223+0000 7fec0e59c700 1 --2- 172.21.15.45:0/1174358225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec100fff40 0x7fec10102830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:13.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.223+0000 7fec05d9b700 1 --2- 172.21.15.45:0/1174358225 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec101050b0 0x7fec10100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:13.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.224+0000 7fec0ed9d700 1 -- 172.21.15.45:0/1174358225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec100fff40 msgr2=0x7fec10102830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:13.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.224+0000 7fec0ed9d700 1 --2- 172.21.15.45:0/1174358225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec100fff40 0x7fec10102830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:13.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.224+0000 7fec0ed9d700 1 -- 172.21.15.45:0/1174358225 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec101050b0 msgr2=0x7fec10100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:13.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.224+0000 7fec0ed9d700 1 --2- 172.21.15.45:0/1174358225 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec101050b0 0x7fec10100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:13.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.224+0000 7fec0ed9d700 1 -- 172.21.15.45:0/1174358225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec000095f0 con 0x7fec10107a10 2024-05-10T03:44:13.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.224+0000 7fec05d9b700 1 --2- 172.21.15.45:0/1174358225 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec101050b0 0x7fec10100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:44:13.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.224+0000 7fec0ed9d700 1 --2- 172.21.15.45:0/1174358225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec10107a10 0x7fec10101410 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fec0800ada0 tx=0x7fec0800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:13.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.224+0000 7fec07fff700 1 -- 172.21.15.45:0/1174358225 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0800f070 con 0x7fec10107a10 2024-05-10T03:44:13.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.224+0000 7fec14968700 1 -- 172.21.15.45:0/1174358225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec101a23a0 con 0x7fec10107a10 2024-05-10T03:44:13.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.224+0000 7fec07fff700 1 -- 172.21.15.45:0/1174358225 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fec08007b30 con 0x7fec10107a10 2024-05-10T03:44:13.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.224+0000 7fec07fff700 1 -- 172.21.15.45:0/1174358225 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec080053c0 con 0x7fec10107a10 2024-05-10T03:44:13.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.224+0000 7fec14968700 1 -- 172.21.15.45:0/1174358225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec101a2880 con 0x7fec10107a10 2024-05-10T03:44:13.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.225+0000 7fec14968700 1 -- 172.21.15.45:0/1174358225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec100fd460 con 0x7fec10107a10 2024-05-10T03:44:13.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.227+0000 7fec07fff700 1 -- 172.21.15.45:0/1174358225 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fec0800c980 con 0x7fec10107a10 2024-05-10T03:44:13.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.227+0000 7fec07fff700 1 --2- 172.21.15.45:0/1174358225 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7febfc0a1120 0x7febfc0a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:13.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.227+0000 7fec07fff700 1 -- 172.21.15.45:0/1174358225 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fec080cc7e0 con 0x7fec10107a10 2024-05-10T03:44:13.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.227+0000 7fec0e59c700 1 --2- 172.21.15.45:0/1174358225 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7febfc0a1120 0x7febfc0a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:13.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.228+0000 7fec0e59c700 1 --2- 172.21.15.45:0/1174358225 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7febfc0a1120 0x7febfc0a3630 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fec00006010 tx=0x7fec0001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:13.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.231+0000 7fec07fff700 1 -- 172.21.15.45:0/1174358225 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fec08095c60 con 0x7fec10107a10 2024-05-10T03:44:13.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:13 smithi106 ceph-mon[46996]: pgmap v403: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 511 B/s wr, 10 op/s 2024-05-10T03:44:13.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:13 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/661987670' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:44:13.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:13 smithi154 ceph-mon[46565]: pgmap v403: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 511 B/s wr, 10 op/s 2024-05-10T03:44:13.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:13 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/661987670' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:44:13.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.500+0000 7fec14968700 1 -- 172.21.15.45:0/1174358225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec10068730 con 0x7fec10107a10 2024-05-10T03:44:13.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.501+0000 7fec07fff700 1 -- 172.21.15.45:0/1174358225 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+10962 (secure 0 0 0) 0x7fec0801a310 con 0x7fec10107a10 2024-05-10T03:44:13.503 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:44:13.503 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/378320264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":378320264},{"type":"v1","addr":"172.21.15.45:6835","nonce":378320264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3032381796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":3032381796},{"type":"v1","addr":"172.21.15.45:6837","nonce":3032381796}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":41,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T03:38:36.555290+0000","modified":"2024-05-10T03:43:44.127240+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24590,"mds_1":24548,"mds_2":24547,"mds_3":24526,"mds_4":24521},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14625":{"gid":14625,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6839/4007419304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":4007419304},{"type":"v1","addr":"172.21.15.45:6839","nonce":4007419304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14637":{"gid":14637,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.45:6841/1355456195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1355456195},{"type":"v1","addr":"172.21.15.45:6841","nonce":1355456195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/4274344062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":4274344062},{"type":"v1","addr":"172.21.15.154:6833","nonce":4274344062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24491":{"gid":24491,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6833/3404247109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3404247109},{"type":"v1","addr":"172.21.15.106:6833","nonce":3404247109}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/4037121210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":4037121210},{"type":"v1","addr":"172.21.15.154:6835","nonce":4037121210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24521":{"gid":24521,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.106:6835/4162885659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4162885659},{"type":"v1","addr":"172.21.15.106:6835","nonce":4162885659}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.154:6837/608167481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":608167481},{"type":"v1","addr":"172.21.15.154:6837","nonce":608167481}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":65,"addr":"172.21.15.154:6839/1506563336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1506563336},{"type":"v1","addr":"172.21.15.154:6839","nonce":1506563336}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.106:6837/3047487403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":3047487403},{"type":"v1","addr":"172.21.15.106:6837","nonce":3047487403}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24590":{"gid":24590,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6839/3533867856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":3533867856},{"type":"v1","addr":"172.21.15.106:6839","nonce":3533867856}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T03:44:13.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.503+0000 7fec14968700 1 -- 172.21.15.45:0/1174358225 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7febfc0a1120 msgr2=0x7febfc0a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:13.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.503+0000 7fec14968700 1 --2- 172.21.15.45:0/1174358225 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7febfc0a1120 0x7febfc0a3630 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fec00006010 tx=0x7fec0001a040 comp rx=0 tx=0).stop 2024-05-10T03:44:13.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.503+0000 7fec14968700 1 -- 172.21.15.45:0/1174358225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec10107a10 msgr2=0x7fec10101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:13.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.503+0000 7fec14968700 1 --2- 172.21.15.45:0/1174358225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec10107a10 0x7fec10101410 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fec0800ada0 tx=0x7fec0800c330 comp rx=0 tx=0).stop 2024-05-10T03:44:13.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.503+0000 7fec14968700 1 -- 172.21.15.45:0/1174358225 shutdown_connections 2024-05-10T03:44:13.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.503+0000 7fec14968700 1 --2- 172.21.15.45:0/1174358225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec100fff40 0x7fec10102830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:13.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.503+0000 7fec14968700 1 --2- 172.21.15.45:0/1174358225 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7febfc0a1120 0x7febfc0a3630 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:13.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.503+0000 7fec14968700 1 --2- 172.21.15.45:0/1174358225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec10107a10 0x7fec10101410 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:13.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.503+0000 7fec14968700 1 --2- 172.21.15.45:0/1174358225 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec101050b0 0x7fec10100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:13.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.503+0000 7fec14968700 1 -- 172.21.15.45:0/1174358225 >> 172.21.15.45:0/1174358225 conn(0x7fec100fb8b0 msgr2=0x7fec10105ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:13.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.503+0000 7fec14968700 1 -- 172.21.15.45:0/1174358225 shutdown_connections 2024-05-10T03:44:13.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.503+0000 7fec14968700 1 -- 172.21.15.45:0/1174358225 wait complete. 2024-05-10T03:44:13.507 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 41 2024-05-10T03:44:13.519 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:13 smithi045 ceph-mon[42520]: pgmap v403: 129 pgs: 129 active+clean; 98 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 511 B/s wr, 10 op/s 2024-05-10T03:44:13.519 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:13 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/661987670' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:44:13.521 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:44:13.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.668+0000 7f5661a2a700 1 -- 172.21.15.45:0/2757900777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f565c102d00 msgr2=0x7f565c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:13.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.668+0000 7f5661a2a700 1 --2- 172.21.15.45:0/2757900777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f565c102d00 0x7f565c103110 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f5650009990 tx=0x7f5650009ca0 comp rx=0 tx=0).stop 2024-05-10T03:44:13.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.668+0000 7f5661a2a700 1 -- 172.21.15.45:0/2757900777 shutdown_connections 2024-05-10T03:44:13.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.668+0000 7f5661a2a700 1 --2- 172.21.15.45:0/2757900777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f565c101be0 0x7f565c101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:13.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.668+0000 7f5661a2a700 1 --2- 172.21.15.45:0/2757900777 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f565c1036a0 0x7f565c109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:13.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.668+0000 7f5661a2a700 1 --2- 172.21.15.45:0/2757900777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f565c102d00 0x7f565c103110 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:13.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.668+0000 7f5661a2a700 1 -- 172.21.15.45:0/2757900777 >> 172.21.15.45:0/2757900777 conn(0x7f565c0fd1d0 msgr2=0x7f565c0ff6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:13.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.668+0000 7f5661a2a700 1 -- 172.21.15.45:0/2757900777 shutdown_connections 2024-05-10T03:44:13.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.668+0000 7f5661a2a700 1 -- 172.21.15.45:0/2757900777 wait complete. 2024-05-10T03:44:13.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.669+0000 7f5661a2a700 1 Processor -- start 2024-05-10T03:44:13.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.669+0000 7f5661a2a700 1 -- start start 2024-05-10T03:44:13.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.669+0000 7f5661a2a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f565c101be0 0x7f565c198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:13.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.669+0000 7f5661a2a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f565c102d00 0x7f565c1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:13.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.669+0000 7f5661a2a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f565c1036a0 0x7f565c19f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:13.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.669+0000 7f5661a2a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c19fb40 con 0x7f565c101be0 2024-05-10T03:44:13.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.669+0000 7f5661a2a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c19fcb0 con 0x7f565c102d00 2024-05-10T03:44:13.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.669+0000 7f5661a2a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c19fe70 con 0x7f565c1036a0 2024-05-10T03:44:13.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.669+0000 7f565affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f565c101be0 0x7f565c198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:13.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.669+0000 7f565affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f565c101be0 0x7f565c198060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33674/0 (socket says 172.21.15.45:33674) 2024-05-10T03:44:13.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.669+0000 7f565affd700 1 -- 172.21.15.45:0/1831669657 learned_addr learned my addr 172.21.15.45:0/1831669657 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:44:13.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.670+0000 7f565b7fe700 1 --2- 172.21.15.45:0/1831669657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f565c1036a0 0x7f565c19f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:13.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.670+0000 7f565a7fc700 1 --2- 172.21.15.45:0/1831669657 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f565c102d00 0x7f565c1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:13.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.670+0000 7f565affd700 1 -- 172.21.15.45:0/1831669657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f565c1036a0 msgr2=0x7f565c19f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:13.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.670+0000 7f565affd700 1 --2- 172.21.15.45:0/1831669657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f565c1036a0 0x7f565c19f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:13.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.670+0000 7f565affd700 1 -- 172.21.15.45:0/1831669657 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f565c102d00 msgr2=0x7f565c1985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:13.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.670+0000 7f565affd700 1 --2- 172.21.15.45:0/1831669657 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f565c102d00 0x7f565c1985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:13.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.670+0000 7f565affd700 1 -- 172.21.15.45:0/1831669657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56500095f0 con 0x7f565c101be0 2024-05-10T03:44:13.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.670+0000 7f565affd700 1 --2- 172.21.15.45:0/1831669657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f565c101be0 0x7f565c198060 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f564c00d950 tx=0x7f564c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:13.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.670+0000 7f5660a28700 1 -- 172.21.15.45:0/1831669657 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c004220 con 0x7f565c101be0 2024-05-10T03:44:13.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.670+0000 7f5660a28700 1 -- 172.21.15.45:0/1831669657 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f564c004380 con 0x7f565c101be0 2024-05-10T03:44:13.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.670+0000 7f5661a2a700 1 -- 172.21.15.45:0/1831669657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f565c1a0150 con 0x7f565c101be0 2024-05-10T03:44:13.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.670+0000 7f5660a28700 1 -- 172.21.15.45:0/1831669657 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c003c50 con 0x7f565c101be0 2024-05-10T03:44:13.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.670+0000 7f5661a2a700 1 -- 172.21.15.45:0/1831669657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565c1a0660 con 0x7f565c101be0 2024-05-10T03:44:13.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.671+0000 7f5661a2a700 1 -- 172.21.15.45:0/1831669657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f565c108df0 con 0x7f565c101be0 2024-05-10T03:44:13.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.673+0000 7f5660a28700 1 -- 172.21.15.45:0/1831669657 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f564c00fc70 con 0x7f565c101be0 2024-05-10T03:44:13.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.673+0000 7f5660a28700 1 --2- 172.21.15.45:0/1831669657 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f56440a1120 0x7f56440a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:13.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.673+0000 7f5660a28700 1 -- 172.21.15.45:0/1831669657 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f564c0cc720 con 0x7f565c101be0 2024-05-10T03:44:13.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.673+0000 7f565a7fc700 1 --2- 172.21.15.45:0/1831669657 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f56440a1120 0x7f56440a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:13.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.674+0000 7f565a7fc700 1 --2- 172.21.15.45:0/1831669657 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f56440a1120 0x7f56440a3630 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f565000b2e0 tx=0x7f565001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:13.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.678+0000 7f5660a28700 1 -- 172.21.15.45:0/1831669657 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f564c095b10 con 0x7f565c101be0 2024-05-10T03:44:13.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.897+0000 7f5661a2a700 1 -- 172.21.15.45:0/1831669657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f565c0694b0 con 0x7f565c101be0 2024-05-10T03:44:13.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.899+0000 7f5660a28700 1 -- 172.21.15.45:0/1831669657 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+24743 (secure 0 0 0) 0x7f564c099130 con 0x7f565c101be0 2024-05-10T03:44:13.902 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-10T03:44:13.902 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":90,"fsid":"d2a0bafa-0e7d-11ef-bc98-c7b262605968","created":"2024-05-10T03:32:36.839939+0000","modified":"2024-05-10T03:40:27.092808+0000","last_up_change":"2024-05-10T03:38:01.798819+0000","last_in_change":"2024-05-10T03:37:45.559089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:35:20.339400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:38:34.871801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:38:35.935386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T03:38:39.029903+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42ed038c-208a-4440-8150-f6933533b3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6803","nonce":2233620683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6805","nonce":2233620683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6809","nonce":2233620683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2233620683},{"type":"v1","addr":"172.21.15.45:6807","nonce":2233620683}]},"public_addr":"172.21.15.45:6803/2233620683","cluster_addr":"172.21.15.45:6805/2233620683","heartbeat_back_addr":"172.21.15.45:6809/2233620683","heartbeat_front_addr":"172.21.15.45:6807/2233620683","state":["exists","up"]},{"osd":1,"uuid":"69265bae-5027-4810-978d-3d10eb35797c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6801","nonce":3117600187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6803","nonce":3117600187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6807","nonce":3117600187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3117600187},{"type":"v1","addr":"172.21.15.106:6805","nonce":3117600187}]},"public_addr":"172.21.15.106:6801/3117600187","cluster_addr":"172.21.15.106:6803/3117600187","heartbeat_back_addr":"172.21.15.106:6807/3117600187","heartbeat_front_addr":"172.21.15.106:6805/3117600187","state":["exists","up"]},{"osd":2,"uuid":"56824828-0b1e-4068-b8c8-cbad269da7ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6801","nonce":2777220958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6803","nonce":2777220958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6807","nonce":2777220958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2777220958},{"type":"v1","addr":"172.21.15.154:6805","nonce":2777220958}]},"public_addr":"172.21.15.154:6801/2777220958","cluster_addr":"172.21.15.154:6803/2777220958","heartbeat_back_addr":"172.21.15.154:6807/2777220958","heartbeat_front_addr":"172.21.15.154:6805/2777220958","state":["exists","up"]},{"osd":3,"uuid":"0df18033-7b88-4497-8241-b9acff5f7ba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6811","nonce":1188039324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6813","nonce":1188039324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6817","nonce":1188039324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":1188039324},{"type":"v1","addr":"172.21.15.45:6815","nonce":1188039324}]},"public_addr":"172.21.15.45:6811/1188039324","cluster_addr":"172.21.15.45:6813/1188039324","heartbeat_back_addr":"172.21.15.45:6817/1188039324","heartbeat_front_addr":"172.21.15.45:6815/1188039324","state":["exists","up"]},{"osd":4,"uuid":"896f8ecb-bda0-4f80-90d2-c5987ab61f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6809","nonce":4186845524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6811","nonce":4186845524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6815","nonce":4186845524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4186845524},{"type":"v1","addr":"172.21.15.106:6813","nonce":4186845524}]},"public_addr":"172.21.15.106:6809/4186845524","cluster_addr":"172.21.15.106:6811/4186845524","heartbeat_back_addr":"172.21.15.106:6815/4186845524","heartbeat_front_addr":"172.21.15.106:6813/4186845524","state":["exists","up"]},{"osd":5,"uuid":"d5a4d9e4-2772-4d72-8963-dd47761c059a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6809","nonce":3929679049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6811","nonce":3929679049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6815","nonce":3929679049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":3929679049},{"type":"v1","addr":"172.21.15.154:6813","nonce":3929679049}]},"public_addr":"172.21.15.154:6809/3929679049","cluster_addr":"172.21.15.154:6811/3929679049","heartbeat_back_addr":"172.21.15.154:6815/3929679049","heartbeat_front_addr":"172.21.15.154:6813/3929679049","state":["exists","up"]},{"osd":6,"uuid":"d9010ff1-37d7-4426-aa77-6eed69de3567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6819","nonce":202946315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6821","nonce":202946315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6825","nonce":202946315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":202946315},{"type":"v1","addr":"172.21.15.45:6823","nonce":202946315}]},"public_addr":"172.21.15.45:6819/202946315","cluster_addr":"172.21.15.45:6821/202946315","heartbeat_back_addr":"172.21.15.45:6825/202946315","heartbeat_front_addr":"172.21.15.45:6823/202946315","state":["exists","up"]},{"osd":7,"uuid":"3e965b02-cc0b-4223-af80-97420f33102b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6817","nonce":1689864237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6819","nonce":1689864237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6823","nonce":1689864237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":1689864237},{"type":"v1","addr":"172.21.15.106:6821","nonce":1689864237}]},"public_addr":"172.21.15.106:6817/1689864237","cluster_addr":"172.21.15.106:6819/1689864237","heartbeat_back_addr":"172.21.15.106:6823/1689864237","heartbeat_front_addr":"172.21.15.106:6821/1689864237","state":["exists","up"]},{"osd":8,"uuid":"160c752d-e4ae-4670-aeed-db069ce61452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6817","nonce":1548564532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6819","nonce":1548564532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6823","nonce":1548564532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1548564532},{"type":"v1","addr":"172.21.15.154:6821","nonce":1548564532}]},"public_addr":"172.21.15.154:6817/1548564532","cluster_addr":"172.21.15.154:6819/1548564532","heartbeat_back_addr":"172.21.15.154:6823/1548564532","heartbeat_front_addr":"172.21.15.154:6821/1548564532","state":["exists","up"]},{"osd":9,"uuid":"bc033cd1-677d-4728-b27e-d85b7ad79f7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6827","nonce":3092314087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6829","nonce":3092314087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6833","nonce":3092314087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":3092314087},{"type":"v1","addr":"172.21.15.45:6831","nonce":3092314087}]},"public_addr":"172.21.15.45:6827/3092314087","cluster_addr":"172.21.15.45:6829/3092314087","heartbeat_back_addr":"172.21.15.45:6833/3092314087","heartbeat_front_addr":"172.21.15.45:6831/3092314087","state":["exists","up"]},{"osd":10,"uuid":"12f8e54b-8eb1-4410-8df7-c8ab651f3e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6825","nonce":2680590999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6827","nonce":2680590999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6831","nonce":2680590999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2680590999},{"type":"v1","addr":"172.21.15.106:6829","nonce":2680590999}]},"public_addr":"172.21.15.106:6825/2680590999","cluster_addr":"172.21.15.106:6827/2680590999","heartbeat_back_addr":"172.21.15.106:6831/2680590999","heartbeat_front_addr":"172.21.15.106:6829/2680590999","state":["exists","up"]},{"osd":11,"uuid":"43642c0b-911a-44ce-a6d4-54482dc7897a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6825","nonce":3779086590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6827","nonce":3779086590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6831","nonce":3779086590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3779086590},{"type":"v1","addr":"172.21.15.154:6829","nonce":3779086590}]},"public_addr":"172.21.15.154:6825/3779086590","cluster_addr":"172.21.15.154:6827/3779086590","heartbeat_back_addr":"172.21.15.154:6831/3779086590","heartbeat_front_addr":"172.21.15.154:6829/3779086590","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:41.243440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:34:59.044494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:16.706626+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:35.560730+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:35:53.944796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:11.478910+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:30.284715+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:36:47.632037+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:05.704118+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:24.638264+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:37:42.473868+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:38:00.408368+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":7,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.c","mappings":[{"from":5,"to":8}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":5,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/485502847":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/477110319":"2024-05-11T03:33:25.801965+0000","172.21.15.45:6800/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2249239510":"2024-05-11T03:33:25.801965+0000","172.21.15.45:0/2903615785":"2024-05-11T03:33:02.846802+0000","172.21.15.45:6801/534860598":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/2125492352":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/3226767328":"2024-05-11T03:33:02.846802+0000","172.21.15.45:0/4077940265":"2024-05-11T03:33:25.801965+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:44:13.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.902+0000 7f5661a2a700 1 -- 172.21.15.45:0/1831669657 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f56440a1120 msgr2=0x7f56440a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:13.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.902+0000 7f5661a2a700 1 --2- 172.21.15.45:0/1831669657 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f56440a1120 0x7f56440a3630 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f565000b2e0 tx=0x7f565001a040 comp rx=0 tx=0).stop 2024-05-10T03:44:13.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.902+0000 7f5661a2a700 1 -- 172.21.15.45:0/1831669657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f565c101be0 msgr2=0x7f565c198060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:13.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.902+0000 7f5661a2a700 1 --2- 172.21.15.45:0/1831669657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f565c101be0 0x7f565c198060 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f564c00d950 tx=0x7f564c00dc60 comp rx=0 tx=0).stop 2024-05-10T03:44:13.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.902+0000 7f5661a2a700 1 -- 172.21.15.45:0/1831669657 shutdown_connections 2024-05-10T03:44:13.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.902+0000 7f5661a2a700 1 --2- 172.21.15.45:0/1831669657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f565c1036a0 0x7f565c19f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:13.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.902+0000 7f5661a2a700 1 --2- 172.21.15.45:0/1831669657 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f56440a1120 0x7f56440a3630 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:13.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.902+0000 7f5661a2a700 1 --2- 172.21.15.45:0/1831669657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f565c101be0 0x7f565c198060 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:13.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.902+0000 7f5661a2a700 1 --2- 172.21.15.45:0/1831669657 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f565c102d00 0x7f565c1985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:13.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.902+0000 7f5661a2a700 1 -- 172.21.15.45:0/1831669657 >> 172.21.15.45:0/1831669657 conn(0x7f565c0fd1d0 msgr2=0x7f565c105f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:13.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.902+0000 7f5661a2a700 1 -- 172.21.15.45:0/1831669657 shutdown_connections 2024-05-10T03:44:13.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:13.902+0000 7f5661a2a700 1 -- 172.21.15.45:0/1831669657 wait complete. 2024-05-10T03:44:13.919 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T03:44:14.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.067+0000 7fe472289700 1 -- 172.21.15.45:0/2420408066 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe46c101be0 msgr2=0x7fe46c101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:14.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.067+0000 7fe472289700 1 --2- 172.21.15.45:0/2420408066 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe46c101be0 0x7fe46c101ff0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe460009920 tx=0x7fe460009c30 comp rx=0 tx=0).stop 2024-05-10T03:44:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.067+0000 7fe472289700 1 -- 172.21.15.45:0/2420408066 shutdown_connections 2024-05-10T03:44:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.067+0000 7fe472289700 1 --2- 172.21.15.45:0/2420408066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe46c100ac0 0x7fe46c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.067+0000 7fe472289700 1 --2- 172.21.15.45:0/2420408066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe46c102580 0x7fe46c108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.067+0000 7fe472289700 1 --2- 172.21.15.45:0/2420408066 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe46c101be0 0x7fe46c101ff0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.067+0000 7fe472289700 1 -- 172.21.15.45:0/2420408066 >> 172.21.15.45:0/2420408066 conn(0x7fe46c0fc0d0 msgr2=0x7fe46c0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.067+0000 7fe472289700 1 -- 172.21.15.45:0/2420408066 shutdown_connections 2024-05-10T03:44:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.067+0000 7fe472289700 1 -- 172.21.15.45:0/2420408066 wait complete. 2024-05-10T03:44:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.068+0000 7fe472289700 1 Processor -- start 2024-05-10T03:44:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.068+0000 7fe472289700 1 -- start start 2024-05-10T03:44:14.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.069+0000 7fe472289700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe46c100ac0 0x7fe46c104880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:14.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.069+0000 7fe472289700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe46c101be0 0x7fe46c102f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:14.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.069+0000 7fe472289700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe46c102580 0x7fe46c103460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.069+0000 7fe472289700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c103b40 con 0x7fe46c100ac0 2024-05-10T03:44:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.069+0000 7fe472289700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c103cb0 con 0x7fe46c102580 2024-05-10T03:44:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.069+0000 7fe472289700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c1a2140 con 0x7fe46c101be0 2024-05-10T03:44:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.069+0000 7fe46bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe46c100ac0 0x7fe46c104880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.069+0000 7fe46bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe46c100ac0 0x7fe46c104880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33696/0 (socket says 172.21.15.45:33696) 2024-05-10T03:44:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.069+0000 7fe46bfff700 1 -- 172.21.15.45:0/615407147 learned_addr learned my addr 172.21.15.45:0/615407147 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:44:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.069+0000 7fe46b7fe700 1 --2- 172.21.15.45:0/615407147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe46c101be0 0x7fe46c102f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.069+0000 7fe470826700 1 --2- 172.21.15.45:0/615407147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe46c102580 0x7fe46c103460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.069+0000 7fe46bfff700 1 -- 172.21.15.45:0/615407147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe46c101be0 msgr2=0x7fe46c102f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.069+0000 7fe46bfff700 1 --2- 172.21.15.45:0/615407147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe46c101be0 0x7fe46c102f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.069+0000 7fe46bfff700 1 -- 172.21.15.45:0/615407147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe46c102580 msgr2=0x7fe46c103460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.069+0000 7fe46bfff700 1 --2- 172.21.15.45:0/615407147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe46c102580 0x7fe46c103460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.069+0000 7fe46bfff700 1 -- 172.21.15.45:0/615407147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe464009d00 con 0x7fe46c100ac0 2024-05-10T03:44:14.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.069+0000 7fe46b7fe700 1 --2- 172.21.15.45:0/615407147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe46c101be0 0x7fe46c102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:44:14.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.069+0000 7fe46bfff700 1 --2- 172.21.15.45:0/615407147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe46c100ac0 0x7fe46c104880 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00e940 tx=0x7fe45c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:14.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.069+0000 7fe4697fa700 1 -- 172.21.15.45:0/615407147 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c00cbd0 con 0x7fe46c100ac0 2024-05-10T03:44:14.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.069+0000 7fe4697fa700 1 -- 172.21.15.45:0/615407147 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe45c00ee90 con 0x7fe46c100ac0 2024-05-10T03:44:14.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.069+0000 7fe472289700 1 -- 172.21.15.45:0/615407147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe460009520 con 0x7fe46c100ac0 2024-05-10T03:44:14.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.069+0000 7fe4697fa700 1 -- 172.21.15.45:0/615407147 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c003e30 con 0x7fe46c100ac0 2024-05-10T03:44:14.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.070+0000 7fe472289700 1 -- 172.21.15.45:0/615407147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe46c1a26f0 con 0x7fe46c100ac0 2024-05-10T03:44:14.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.070+0000 7fe472289700 1 -- 172.21.15.45:0/615407147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe46c0694d0 con 0x7fe46c100ac0 2024-05-10T03:44:14.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.073+0000 7fe4697fa700 1 -- 172.21.15.45:0/615407147 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe45c003f90 con 0x7fe46c100ac0 2024-05-10T03:44:14.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.073+0000 7fe4697fa700 1 --2- 172.21.15.45:0/615407147 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe4540a11c0 0x7fe4540a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:14.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.073+0000 7fe46b7fe700 1 --2- 172.21.15.45:0/615407147 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe4540a11c0 0x7fe4540a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:14.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.074+0000 7fe4697fa700 1 -- 172.21.15.45:0/615407147 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fe45c014070 con 0x7fe46c100ac0 2024-05-10T03:44:14.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.074+0000 7fe46b7fe700 1 --2- 172.21.15.45:0/615407147 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe4540a11c0 0x7fe4540a36d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe46000fcc0 tx=0x7fe460019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:14.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.077+0000 7fe4697fa700 1 -- 172.21.15.45:0/615407147 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe45c0964f0 con 0x7fe46c100ac0 2024-05-10T03:44:14.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:14 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1174358225' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:44:14.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:14 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/1831669657' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:44:14.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.345+0000 7fe472289700 1 -- 172.21.15.45:0/615407147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe46c10c400 con 0x7fe46c100ac0 2024-05-10T03:44:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.360+0000 7fe4697fa700 1 -- 172.21.15.45:0/615407147 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v42) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe45c099b10 con 0x7fe46c100ac0 2024-05-10T03:44:14.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.362+0000 7fe472289700 1 -- 172.21.15.45:0/615407147 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe4540a11c0 msgr2=0x7fe4540a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:14.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.362+0000 7fe472289700 1 --2- 172.21.15.45:0/615407147 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe4540a11c0 0x7fe4540a36d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe46000fcc0 tx=0x7fe460019040 comp rx=0 tx=0).stop 2024-05-10T03:44:14.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.362+0000 7fe472289700 1 -- 172.21.15.45:0/615407147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe46c100ac0 msgr2=0x7fe46c104880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:14.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.362+0000 7fe472289700 1 --2- 172.21.15.45:0/615407147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe46c100ac0 0x7fe46c104880 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00e940 tx=0x7fe45c00ec50 comp rx=0 tx=0).stop 2024-05-10T03:44:14.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.362+0000 7fe472289700 1 -- 172.21.15.45:0/615407147 shutdown_connections 2024-05-10T03:44:14.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.362+0000 7fe472289700 1 --2- 172.21.15.45:0/615407147 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fe4540a11c0 0x7fe4540a36d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:14.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.362+0000 7fe472289700 1 --2- 172.21.15.45:0/615407147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe46c102580 0x7fe46c103460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:14.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.362+0000 7fe472289700 1 --2- 172.21.15.45:0/615407147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe46c100ac0 0x7fe46c104880 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:14.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.362+0000 7fe472289700 1 --2- 172.21.15.45:0/615407147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe46c101be0 0x7fe46c102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:14.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.362+0000 7fe472289700 1 -- 172.21.15.45:0/615407147 >> 172.21.15.45:0/615407147 conn(0x7fe46c0fc0d0 msgr2=0x7fe46c0fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:14.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.362+0000 7fe472289700 1 -- 172.21.15.45:0/615407147 shutdown_connections 2024-05-10T03:44:14.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.363+0000 7fe472289700 1 -- 172.21.15.45:0/615407147 wait complete. 2024-05-10T03:44:14.366 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T03:44:14.381 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-10T03:44:14.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:14 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1174358225' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:44:14.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:14 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/1831669657' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:44:14.435 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:14 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1174358225' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T03:44:14.435 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:14 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/1831669657' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T03:44:14.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.540+0000 7f82573b2700 1 -- 172.21.15.45:0/4231669135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82501026b0 msgr2=0x7f8250104ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:14.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.540+0000 7f82573b2700 1 --2- 172.21.15.45:0/4231669135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82501026b0 0x7f8250104ad0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f824c0098f0 tx=0x7f824c009c00 comp rx=0 tx=0).stop 2024-05-10T03:44:14.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.540+0000 7f82573b2700 1 -- 172.21.15.45:0/4231669135 shutdown_connections 2024-05-10T03:44:14.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.540+0000 7f82573b2700 1 --2- 172.21.15.45:0/4231669135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8250107970 0x7f8250109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:14.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.540+0000 7f82573b2700 1 --2- 172.21.15.45:0/4231669135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82501026b0 0x7f8250104ad0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:14.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.540+0000 7f82573b2700 1 --2- 172.21.15.45:0/4231669135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8250105010 0x7f8250107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:14.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.540+0000 7f82573b2700 1 -- 172.21.15.45:0/4231669135 >> 172.21.15.45:0/4231669135 conn(0x7f82500fc0d0 msgr2=0x7f82500fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:14.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.540+0000 7f82573b2700 1 -- 172.21.15.45:0/4231669135 shutdown_connections 2024-05-10T03:44:14.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.540+0000 7f82573b2700 1 -- 172.21.15.45:0/4231669135 wait complete. 2024-05-10T03:44:14.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.541+0000 7f82573b2700 1 Processor -- start 2024-05-10T03:44:14.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.541+0000 7f82573b2700 1 -- start start 2024-05-10T03:44:14.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.541+0000 7f82573b2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82501026b0 0x7f8250198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:14.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.541+0000 7f82573b2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8250105010 0x7f8250198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:14.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.541+0000 7f82573b2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8250107970 0x7f825019f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:14.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.541+0000 7f82573b2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825019fb00 con 0x7f8250107970 2024-05-10T03:44:14.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.541+0000 7f82573b2700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825019fc70 con 0x7f82501026b0 2024-05-10T03:44:14.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.541+0000 7f82573b2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825019fe30 con 0x7f8250105010 2024-05-10T03:44:14.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.541+0000 7f825594f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8250107970 0x7f825019f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:14.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.541+0000 7f825594f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8250107970 0x7f825019f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33764/0 (socket says 172.21.15.45:33764) 2024-05-10T03:44:14.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.541+0000 7f825594f700 1 -- 172.21.15.45:0/3952170339 learned_addr learned my addr 172.21.15.45:0/3952170339 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:44:14.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.541+0000 7f825514e700 1 --2- 172.21.15.45:0/3952170339 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82501026b0 0x7f8250198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:14.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.541+0000 7f825494d700 1 --2- 172.21.15.45:0/3952170339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8250105010 0x7f8250198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:14.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.541+0000 7f825594f700 1 -- 172.21.15.45:0/3952170339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8250105010 msgr2=0x7f8250198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:14.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.541+0000 7f825594f700 1 --2- 172.21.15.45:0/3952170339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8250105010 0x7f8250198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:14.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.541+0000 7f825594f700 1 -- 172.21.15.45:0/3952170339 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82501026b0 msgr2=0x7f8250198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:14.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.541+0000 7f825594f700 1 --2- 172.21.15.45:0/3952170339 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82501026b0 0x7f8250198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:14.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.541+0000 7f825594f700 1 -- 172.21.15.45:0/3952170339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824c009520 con 0x7f8250107970 2024-05-10T03:44:14.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.541+0000 7f825514e700 1 --2- 172.21.15.45:0/3952170339 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82501026b0 0x7f8250198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:44:14.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.542+0000 7f825594f700 1 --2- 172.21.15.45:0/3952170339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8250107970 0x7f825019f4f0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f824800ef90 tx=0x7f824800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:14.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.542+0000 7f82427fc700 1 -- 172.21.15.45:0/3952170339 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8248018070 con 0x7f8250107970 2024-05-10T03:44:14.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.542+0000 7f82427fc700 1 -- 172.21.15.45:0/3952170339 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f824800f040 con 0x7f8250107970 2024-05-10T03:44:14.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.542+0000 7f82573b2700 1 -- 172.21.15.45:0/3952170339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82501a00b0 con 0x7f8250107970 2024-05-10T03:44:14.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.542+0000 7f82427fc700 1 -- 172.21.15.45:0/3952170339 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824800cda0 con 0x7f8250107970 2024-05-10T03:44:14.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.542+0000 7f82573b2700 1 -- 172.21.15.45:0/3952170339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82501a0570 con 0x7f8250107970 2024-05-10T03:44:14.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.543+0000 7f82573b2700 1 -- 172.21.15.45:0/3952170339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82500fdc80 con 0x7f8250107970 2024-05-10T03:44:14.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.545+0000 7f82427fc700 1 -- 172.21.15.45:0/3952170339 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8248003a00 con 0x7f8250107970 2024-05-10T03:44:14.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.546+0000 7f82427fc700 1 --2- 172.21.15.45:0/3952170339 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f823c0a11c0 0x7f823c0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:14.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.546+0000 7f82427fc700 1 -- 172.21.15.45:0/3952170339 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9595+0+0 (secure 0 0 0) 0x7f82480cd260 con 0x7f8250107970 2024-05-10T03:44:14.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.546+0000 7f825514e700 1 --2- 172.21.15.45:0/3952170339 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f823c0a11c0 0x7f823c0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:14.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.546+0000 7f825514e700 1 --2- 172.21.15.45:0/3952170339 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f823c0a11c0 0x7f823c0a36d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f824c0098c0 tx=0x7f824c019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:14.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.550+0000 7f82427fc700 1 -- 172.21.15.45:0/3952170339 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8248096530 con 0x7f8250107970 2024-05-10T03:44:14.724 INFO:journalctl@ceph.mds.f.smithi154.stdout:May 10 03:44:14 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-f[82725]: ignoring --setuser ceph since I am not root 2024-05-10T03:44:14.724 INFO:journalctl@ceph.mds.f.smithi154.stdout:May 10 03:44:14 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-f[82725]: ignoring --setgroup ceph since I am not root 2024-05-10T03:44:14.724 INFO:journalctl@ceph.mds.f.smithi154.stdout:May 10 03:44:14 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-f[82725]: starting mds.f at 2024-05-10T03:44:14.724 INFO:journalctl@ceph.mds.l.smithi154.stdout:May 10 03:44:14 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-l[82386]: ignoring --setuser ceph since I am not root 2024-05-10T03:44:14.724 INFO:journalctl@ceph.mds.l.smithi154.stdout:May 10 03:44:14 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-l[82386]: ignoring --setgroup ceph since I am not root 2024-05-10T03:44:14.724 INFO:journalctl@ceph.mds.l.smithi154.stdout:May 10 03:44:14 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-l[82386]: starting mds.l at 2024-05-10T03:44:14.725 INFO:journalctl@ceph.mds.c.smithi154.stdout:May 10 03:44:14 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-c[83067]: ignoring --setuser ceph since I am not root 2024-05-10T03:44:14.725 INFO:journalctl@ceph.mds.c.smithi154.stdout:May 10 03:44:14 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-c[83067]: ignoring --setgroup ceph since I am not root 2024-05-10T03:44:14.725 INFO:journalctl@ceph.mds.c.smithi154.stdout:May 10 03:44:14 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-c[83067]: starting mds.c at 2024-05-10T03:44:14.725 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:44:14 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: ignoring --setuser ceph since I am not root 2024-05-10T03:44:14.725 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:44:14 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: ignoring --setgroup ceph since I am not root 2024-05-10T03:44:14.725 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:44:14 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: starting mds.i at 2024-05-10T03:44:14.783 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:14 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mon-a[42496]: 2024-05-10T03:44:14.346+0000 7f4dd01be700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T03:44:14.784 INFO:journalctl@ceph.mds.g.smithi045.stdout:May 10 03:44:14 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-g[93529]: ignoring --setuser ceph since I am not root 2024-05-10T03:44:14.784 INFO:journalctl@ceph.mds.g.smithi045.stdout:May 10 03:44:14 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-g[93529]: ignoring --setgroup ceph since I am not root 2024-05-10T03:44:14.784 INFO:journalctl@ceph.mds.g.smithi045.stdout:May 10 03:44:14 smithi045 ceph-mds[93552]: -- 172.21.15.45:0/252161918 <== mon.0 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56271bf0e1a0 con 0x56271bf6e400 2024-05-10T03:44:14.784 INFO:journalctl@ceph.mds.g.smithi045.stdout:May 10 03:44:14 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-g[93529]: starting mds.g at 2024-05-10T03:44:14.784 INFO:journalctl@ceph.mds.a.smithi045.stdout:May 10 03:44:14 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-a[93915]: ignoring --setuser ceph since I am not root 2024-05-10T03:44:14.785 INFO:journalctl@ceph.mds.a.smithi045.stdout:May 10 03:44:14 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-a[93915]: ignoring --setgroup ceph since I am not root 2024-05-10T03:44:14.785 INFO:journalctl@ceph.mds.a.smithi045.stdout:May 10 03:44:14 smithi045 ceph-mds[93938]: -- 172.21.15.45:0/1170669561 <== mon.2 v2:172.21.15.106:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ae9ada61a0 con 0x55ae9ae06880 2024-05-10T03:44:14.785 INFO:journalctl@ceph.mds.a.smithi045.stdout:May 10 03:44:14 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-a[93915]: starting mds.a at 2024-05-10T03:44:14.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:14.823+0000 7f82573b2700 1 -- 172.21.15.45:0/3952170339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f825010d500 con 0x7f8250107970 2024-05-10T03:44:14.901 INFO:journalctl@ceph.mds.e.smithi106.stdout:May 10 03:44:14 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-e[83664]: ignoring --setuser ceph since I am not root 2024-05-10T03:44:14.901 INFO:journalctl@ceph.mds.e.smithi106.stdout:May 10 03:44:14 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-e[83664]: ignoring --setgroup ceph since I am not root 2024-05-10T03:44:14.901 INFO:journalctl@ceph.mds.e.smithi106.stdout:May 10 03:44:14 smithi106 ceph-mds[83687]: -- 172.21.15.106:0/3576879436 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560fab4221a0 con 0x560fab482880 2024-05-10T03:44:14.901 INFO:journalctl@ceph.mds.e.smithi106.stdout:May 10 03:44:14 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-e[83664]: starting mds.e at 2024-05-10T03:44:14.901 INFO:journalctl@ceph.mds.b.smithi106.stdout:May 10 03:44:14 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-b[84354]: ignoring --setuser ceph since I am not root 2024-05-10T03:44:14.901 INFO:journalctl@ceph.mds.b.smithi106.stdout:May 10 03:44:14 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-b[84354]: ignoring --setgroup ceph since I am not root 2024-05-10T03:44:14.902 INFO:journalctl@ceph.mds.b.smithi106.stdout:May 10 03:44:14 smithi106 ceph-mds[84377]: -- 172.21.15.106:0/3481776228 <== mon.2 v2:172.21.15.106:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a7d44721a0 con 0x55a7d44d2880 2024-05-10T03:44:14.902 INFO:journalctl@ceph.mds.b.smithi106.stdout:May 10 03:44:14 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-b[84354]: starting mds.b at 2024-05-10T03:44:14.902 INFO:journalctl@ceph.mds.h.smithi106.stdout:May 10 03:44:14 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-h[84005]: ignoring --setuser ceph since I am not root 2024-05-10T03:44:14.902 INFO:journalctl@ceph.mds.h.smithi106.stdout:May 10 03:44:14 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-h[84005]: ignoring --setgroup ceph since I am not root 2024-05-10T03:44:14.902 INFO:journalctl@ceph.mds.h.smithi106.stdout:May 10 03:44:14 smithi106 ceph-mds[84028]: -- 172.21.15.106:0/745979444 <== mon.2 v2:172.21.15.106:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563cff45e1a0 con 0x563cff4bed00 2024-05-10T03:44:14.902 INFO:journalctl@ceph.mds.h.smithi106.stdout:May 10 03:44:14 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-h[84005]: starting mds.h at 2024-05-10T03:44:14.902 INFO:journalctl@ceph.mds.k.smithi106.stdout:May 10 03:44:14 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-k[83325]: ignoring --setuser ceph since I am not root 2024-05-10T03:44:14.903 INFO:journalctl@ceph.mds.k.smithi106.stdout:May 10 03:44:14 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-k[83325]: ignoring --setgroup ceph since I am not root 2024-05-10T03:44:14.903 INFO:journalctl@ceph.mds.k.smithi106.stdout:May 10 03:44:14 smithi106 ceph-mds[83348]: -- 172.21.15.106:0/54270635 <== mon.2 v2:172.21.15.106:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d2dad5e1a0 con 0x55d2dadbe880 2024-05-10T03:44:14.903 INFO:journalctl@ceph.mds.k.smithi106.stdout:May 10 03:44:14 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-k[83325]: starting mds.k at 2024-05-10T03:44:15.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.363+0000 7f82427fc700 1 -- 172.21.15.45:0/3952170339 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v43) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8248099b50 con 0x7f8250107970 2024-05-10T03:44:15.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.368+0000 7f82573b2700 1 -- 172.21.15.45:0/3952170339 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f823c0a11c0 msgr2=0x7f823c0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:15.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.368+0000 7f82573b2700 1 --2- 172.21.15.45:0/3952170339 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f823c0a11c0 0x7f823c0a36d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f824c0098c0 tx=0x7f824c019040 comp rx=0 tx=0).stop 2024-05-10T03:44:15.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.368+0000 7f82573b2700 1 -- 172.21.15.45:0/3952170339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8250107970 msgr2=0x7f825019f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:15.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.368+0000 7f82573b2700 1 --2- 172.21.15.45:0/3952170339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8250107970 0x7f825019f4f0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f824800ef90 tx=0x7f824800c3a0 comp rx=0 tx=0).stop 2024-05-10T03:44:15.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.368+0000 7f82573b2700 1 -- 172.21.15.45:0/3952170339 shutdown_connections 2024-05-10T03:44:15.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.368+0000 7f82573b2700 1 --2- 172.21.15.45:0/3952170339 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f823c0a11c0 0x7f823c0a36d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:15.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.368+0000 7f82573b2700 1 --2- 172.21.15.45:0/3952170339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8250107970 0x7f825019f4f0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:15.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.368+0000 7f82573b2700 1 --2- 172.21.15.45:0/3952170339 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82501026b0 0x7f8250198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:15.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.368+0000 7f82573b2700 1 --2- 172.21.15.45:0/3952170339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8250105010 0x7f8250198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:15.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.368+0000 7f82573b2700 1 -- 172.21.15.45:0/3952170339 >> 172.21.15.45:0/3952170339 conn(0x7f82500fc0d0 msgr2=0x7f8250103180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:15.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.369+0000 7f82573b2700 1 -- 172.21.15.45:0/3952170339 shutdown_connections 2024-05-10T03:44:15.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.369+0000 7f82573b2700 1 -- 172.21.15.45:0/3952170339 wait complete. 2024-05-10T03:44:15.388 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-10T03:44:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:15 smithi106 ceph-mon[46996]: pgmap v404: 129 pgs: 129 active+clean; 98 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-05-10T03:44:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:15 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/615407147' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-10T03:44:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:15 smithi106 ceph-mon[46996]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-10T03:44:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:15 smithi106 ceph-mon[46996]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T03:44:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:15 smithi106 ceph-mon[46996]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2024-05-10T03:44:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:15 smithi106 ceph-mon[46996]: osdmap e91: 12 total, 12 up, 12 in 2024-05-10T03:44:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:15 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/615407147' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-10T03:44:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:15 smithi106 ceph-mon[46996]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-10T03:44:15.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:15 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3952170339' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-10T03:44:15.416 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:15 smithi045 ceph-mon[42520]: pgmap v404: 129 pgs: 129 active+clean; 98 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-05-10T03:44:15.416 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:15 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/615407147' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-10T03:44:15.416 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:15 smithi045 ceph-mon[42520]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-10T03:44:15.416 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:15 smithi045 ceph-mon[42520]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T03:44:15.416 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:15 smithi045 ceph-mon[42520]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2024-05-10T03:44:15.416 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:15 smithi045 ceph-mon[42520]: osdmap e91: 12 total, 12 up, 12 in 2024-05-10T03:44:15.417 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:15 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/615407147' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-10T03:44:15.417 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:15 smithi045 ceph-mon[42520]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-10T03:44:15.417 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:15 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3952170339' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-10T03:44:15.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:15 smithi154 ceph-mon[46565]: pgmap v404: 129 pgs: 129 active+clean; 98 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-05-10T03:44:15.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:15 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/615407147' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-10T03:44:15.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:15 smithi154 ceph-mon[46565]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-10T03:44:15.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:15 smithi154 ceph-mon[46565]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T03:44:15.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:15 smithi154 ceph-mon[46565]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2024-05-10T03:44:15.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:15 smithi154 ceph-mon[46565]: osdmap e91: 12 total, 12 up, 12 in 2024-05-10T03:44:15.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:15 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/615407147' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-10T03:44:15.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:15 smithi154 ceph-mon[46565]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-10T03:44:15.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:15 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3952170339' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-10T03:44:15.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.542+0000 7fb4d4a10700 1 -- 172.21.15.45:0/121812563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4d0100ac0 msgr2=0x7fb4d0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:15.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.542+0000 7fb4d4a10700 1 --2- 172.21.15.45:0/121812563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4d0100ac0 0x7fb4d0100ed0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0009990 tx=0x7fb4c0009ca0 comp rx=0 tx=0).stop 2024-05-10T03:44:15.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.542+0000 7fb4d4a10700 1 -- 172.21.15.45:0/121812563 shutdown_connections 2024-05-10T03:44:15.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.542+0000 7fb4d4a10700 1 --2- 172.21.15.45:0/121812563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4d0102580 0x7fb4d0108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:15.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.542+0000 7fb4d4a10700 1 --2- 172.21.15.45:0/121812563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4d0100ac0 0x7fb4d0100ed0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:15.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.542+0000 7fb4d4a10700 1 --2- 172.21.15.45:0/121812563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4d0101be0 0x7fb4d0101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:15.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.542+0000 7fb4d4a10700 1 -- 172.21.15.45:0/121812563 >> 172.21.15.45:0/121812563 conn(0x7fb4d00fc0d0 msgr2=0x7fb4d00fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:15.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.542+0000 7fb4d4a10700 1 -- 172.21.15.45:0/121812563 shutdown_connections 2024-05-10T03:44:15.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.543+0000 7fb4d4a10700 1 -- 172.21.15.45:0/121812563 wait complete. 2024-05-10T03:44:15.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.543+0000 7fb4d4a10700 1 Processor -- start 2024-05-10T03:44:15.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.543+0000 7fb4d4a10700 1 -- start start 2024-05-10T03:44:15.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.544+0000 7fb4d4a10700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4d0100ac0 0x7fb4d0196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:15.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.544+0000 7fb4d4a10700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4d0101be0 0x7fb4d01973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:15.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.544+0000 7fb4d4a10700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4d0102580 0x7fb4d019e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:15.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.544+0000 7fb4d4a10700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d019e950 con 0x7fb4d0101be0 2024-05-10T03:44:15.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.544+0000 7fb4d4a10700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d019eac0 con 0x7fb4d0102580 2024-05-10T03:44:15.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.544+0000 7fb4d4a10700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d0068440 con 0x7fb4d0100ac0 2024-05-10T03:44:15.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.544+0000 7fb4cdd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4d0101be0 0x7fb4d01973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:15.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.544+0000 7fb4cdd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4d0101be0 0x7fb4d01973b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33782/0 (socket says 172.21.15.45:33782) 2024-05-10T03:44:15.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.544+0000 7fb4cdd9b700 1 -- 172.21.15.45:0/738591454 learned_addr learned my addr 172.21.15.45:0/738591454 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:44:15.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.544+0000 7fb4ce59c700 1 --2- 172.21.15.45:0/738591454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4d0100ac0 0x7fb4d0196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:15.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.544+0000 7fb4ced9d700 1 --2- 172.21.15.45:0/738591454 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4d0102580 0x7fb4d019e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.544+0000 7fb4cdd9b700 1 -- 172.21.15.45:0/738591454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4d0100ac0 msgr2=0x7fb4d0196e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.544+0000 7fb4cdd9b700 1 --2- 172.21.15.45:0/738591454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4d0100ac0 0x7fb4d0196e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.544+0000 7fb4cdd9b700 1 -- 172.21.15.45:0/738591454 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4d0102580 msgr2=0x7fb4d019e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.544+0000 7fb4cdd9b700 1 --2- 172.21.15.45:0/738591454 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4d0102580 0x7fb4d019e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.544+0000 7fb4cdd9b700 1 -- 172.21.15.45:0/738591454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c00095f0 con 0x7fb4d0101be0 2024-05-10T03:44:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.544+0000 7fb4cdd9b700 1 --2- 172.21.15.45:0/738591454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4d0101be0 0x7fb4d01973b0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb4b800d980 tx=0x7fb4b800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.545+0000 7fb4c77fe700 1 -- 172.21.15.45:0/738591454 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8004220 con 0x7fb4d0101be0 2024-05-10T03:44:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.545+0000 7fb4d4a10700 1 -- 172.21.15.45:0/738591454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d0068720 con 0x7fb4d0101be0 2024-05-10T03:44:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.545+0000 7fb4c77fe700 1 -- 172.21.15.45:0/738591454 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb4b8007640 con 0x7fb4d0101be0 2024-05-10T03:44:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.545+0000 7fb4c77fe700 1 -- 172.21.15.45:0/738591454 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b800f690 con 0x7fb4d0101be0 2024-05-10T03:44:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.545+0000 7fb4d4a10700 1 -- 172.21.15.45:0/738591454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d0068c30 con 0x7fb4d0101be0 2024-05-10T03:44:15.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.546+0000 7fb4d4a10700 1 -- 172.21.15.45:0/738591454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d010c3e0 con 0x7fb4d0101be0 2024-05-10T03:44:15.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.548+0000 7fb4c77fe700 1 -- 172.21.15.45:0/738591454 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb4b8004410 con 0x7fb4d0101be0 2024-05-10T03:44:15.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.549+0000 7fb4c77fe700 1 --2- 172.21.15.45:0/738591454 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb4bc0a11c0 0x7fb4bc0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:15.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.549+0000 7fb4ce59c700 1 --2- 172.21.15.45:0/738591454 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb4bc0a11c0 0x7fb4bc0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:15.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.549+0000 7fb4c77fe700 1 -- 172.21.15.45:0/738591454 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9595+0+0 (secure 0 0 0) 0x7fb4b80cd210 con 0x7fb4d0101be0 2024-05-10T03:44:15.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.549+0000 7fb4ce59c700 1 --2- 172.21.15.45:0/738591454 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb4bc0a11c0 0x7fb4bc0a36d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0006010 tx=0x7fb4c001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:15.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.552+0000 7fb4c77fe700 1 -- 172.21.15.45:0/738591454 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb4b80963f0 con 0x7fb4d0101be0 2024-05-10T03:44:15.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:15.770+0000 7fb4d4a10700 1 -- 172.21.15.45:0/738591454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb4d0107830 con 0x7fb4d0101be0 2024-05-10T03:44:16.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.369+0000 7fb4c77fe700 1 -- 172.21.15.45:0/738591454 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v92) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb4b8016020 con 0x7fb4d0101be0 2024-05-10T03:44:16.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.374+0000 7fb4d4a10700 1 -- 172.21.15.45:0/738591454 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb4bc0a11c0 msgr2=0x7fb4bc0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:16.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.374+0000 7fb4d4a10700 1 --2- 172.21.15.45:0/738591454 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb4bc0a11c0 0x7fb4bc0a36d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0006010 tx=0x7fb4c001a040 comp rx=0 tx=0).stop 2024-05-10T03:44:16.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.374+0000 7fb4d4a10700 1 -- 172.21.15.45:0/738591454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4d0101be0 msgr2=0x7fb4d01973b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:16.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.374+0000 7fb4d4a10700 1 --2- 172.21.15.45:0/738591454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4d0101be0 0x7fb4d01973b0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb4b800d980 tx=0x7fb4b800dc90 comp rx=0 tx=0).stop 2024-05-10T03:44:16.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.375+0000 7fb4d4a10700 1 -- 172.21.15.45:0/738591454 shutdown_connections 2024-05-10T03:44:16.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.375+0000 7fb4d4a10700 1 --2- 172.21.15.45:0/738591454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4d0100ac0 0x7fb4d0196e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:16.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.375+0000 7fb4d4a10700 1 --2- 172.21.15.45:0/738591454 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fb4bc0a11c0 0x7fb4bc0a36d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:16.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.375+0000 7fb4d4a10700 1 --2- 172.21.15.45:0/738591454 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4d0102580 0x7fb4d019e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:16.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.375+0000 7fb4d4a10700 1 --2- 172.21.15.45:0/738591454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4d0101be0 0x7fb4d01973b0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:16.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.375+0000 7fb4d4a10700 1 -- 172.21.15.45:0/738591454 >> 172.21.15.45:0/738591454 conn(0x7fb4d00fc0d0 msgr2=0x7fb4d0104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:16.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.375+0000 7fb4d4a10700 1 -- 172.21.15.45:0/738591454 shutdown_connections 2024-05-10T03:44:16.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.375+0000 7fb4d4a10700 1 -- 172.21.15.45:0/738591454 wait complete. 2024-05-10T03:44:16.379 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2024-05-10T03:44:16.394 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-10T03:44:16.394 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-10T03:44:16.394 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: Cluster is now healthy 2024-05-10T03:44:16.394 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.106:6833/1338485980,v1:172.21.15.106:6835/1338485980] up:boot 2024-05-10T03:44:16.395 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.154:6837/3041056294,v1:172.21.15.154:6839/3041056294] up:boot 2024-05-10T03:44:16.395 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.154:6832/2471876552,v1:172.21.15.154:6834/2471876552] up:boot 2024-05-10T03:44:16.395 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.106:6836/1765306422,v1:172.21.15.106:6837/1765306422] up:boot 2024-05-10T03:44:16.395 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.106:6832/3488168138,v1:172.21.15.106:6834/3488168138] up:boot 2024-05-10T03:44:16.395 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.45:6838/525808364,v1:172.21.15.45:6840/525808364] up:boot 2024-05-10T03:44:16.395 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.154:6836/2122486940,v1:172.21.15.154:6838/2122486940] up:boot 2024-05-10T03:44:16.395 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.45:6839/4081607732,v1:172.21.15.45:6841/4081607732] up:boot 2024-05-10T03:44:16.395 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.154:6833/1405170167,v1:172.21.15.154:6835/1405170167] up:boot 2024-05-10T03:44:16.395 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: mds.? [v2:172.21.15.106:6838/1029207990,v1:172.21.15.106:6839/1029207990] up:boot 2024-05-10T03:44:16.395 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/3952170339' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-10T03:44:16.395 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: fsmap 12 up:standby 2024-05-10T03:44:16.396 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-10T03:44:16.396 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-10T03:44:16.396 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-10T03:44:16.396 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-10T03:44:16.396 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-10T03:44:16.396 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-10T03:44:16.396 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-10T03:44:16.396 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-10T03:44:16.396 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-10T03:44:16.396 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-10T03:44:16.396 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:16 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/738591454' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-10T03:44:16.397 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-10T03:44:16.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-10T03:44:16.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-10T03:44:16.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: Cluster is now healthy 2024-05-10T03:44:16.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.106:6833/1338485980,v1:172.21.15.106:6835/1338485980] up:boot 2024-05-10T03:44:16.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.154:6837/3041056294,v1:172.21.15.154:6839/3041056294] up:boot 2024-05-10T03:44:16.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.154:6832/2471876552,v1:172.21.15.154:6834/2471876552] up:boot 2024-05-10T03:44:16.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.106:6836/1765306422,v1:172.21.15.106:6837/1765306422] up:boot 2024-05-10T03:44:16.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.106:6832/3488168138,v1:172.21.15.106:6834/3488168138] up:boot 2024-05-10T03:44:16.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.45:6838/525808364,v1:172.21.15.45:6840/525808364] up:boot 2024-05-10T03:44:16.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.154:6836/2122486940,v1:172.21.15.154:6838/2122486940] up:boot 2024-05-10T03:44:16.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.45:6839/4081607732,v1:172.21.15.45:6841/4081607732] up:boot 2024-05-10T03:44:16.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.154:6833/1405170167,v1:172.21.15.154:6835/1405170167] up:boot 2024-05-10T03:44:16.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: mds.? [v2:172.21.15.106:6838/1029207990,v1:172.21.15.106:6839/1029207990] up:boot 2024-05-10T03:44:16.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/3952170339' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-10T03:44:16.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: fsmap 12 up:standby 2024-05-10T03:44:16.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-10T03:44:16.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-10T03:44:16.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-10T03:44:16.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-10T03:44:16.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-10T03:44:16.402 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-10T03:44:16.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-10T03:44:16.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-10T03:44:16.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-10T03:44:16.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-10T03:44:16.403 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:16 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/738591454' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-10T03:44:16.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-10T03:44:16.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-10T03:44:16.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: Cluster is now healthy 2024-05-10T03:44:16.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.106:6833/1338485980,v1:172.21.15.106:6835/1338485980] up:boot 2024-05-10T03:44:16.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.154:6837/3041056294,v1:172.21.15.154:6839/3041056294] up:boot 2024-05-10T03:44:16.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.154:6832/2471876552,v1:172.21.15.154:6834/2471876552] up:boot 2024-05-10T03:44:16.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.106:6836/1765306422,v1:172.21.15.106:6837/1765306422] up:boot 2024-05-10T03:44:16.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.106:6832/3488168138,v1:172.21.15.106:6834/3488168138] up:boot 2024-05-10T03:44:16.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.45:6838/525808364,v1:172.21.15.45:6840/525808364] up:boot 2024-05-10T03:44:16.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.154:6836/2122486940,v1:172.21.15.154:6838/2122486940] up:boot 2024-05-10T03:44:16.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.45:6839/4081607732,v1:172.21.15.45:6841/4081607732] up:boot 2024-05-10T03:44:16.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.154:6833/1405170167,v1:172.21.15.154:6835/1405170167] up:boot 2024-05-10T03:44:16.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: mds.? [v2:172.21.15.106:6838/1029207990,v1:172.21.15.106:6839/1029207990] up:boot 2024-05-10T03:44:16.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/3952170339' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-10T03:44:16.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: fsmap 12 up:standby 2024-05-10T03:44:16.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-10T03:44:16.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-10T03:44:16.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-10T03:44:16.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-10T03:44:16.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-10T03:44:16.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-10T03:44:16.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-10T03:44:16.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-10T03:44:16.475 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-10T03:44:16.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: from='mgr.14152 172.21.15.45:0/2211686616' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-10T03:44:16.476 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:16 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/738591454' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-10T03:44:16.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.594+0000 7fd598060700 1 -- 172.21.15.45:0/1505740713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5901036c0 msgr2=0x7fd590109f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:16.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.594+0000 7fd598060700 1 --2- 172.21.15.45:0/1505740713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5901036c0 0x7fd590109f70 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd58800b0a0 tx=0x7fd58800b3b0 comp rx=0 tx=0).stop 2024-05-10T03:44:16.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.594+0000 7fd598060700 1 -- 172.21.15.45:0/1505740713 shutdown_connections 2024-05-10T03:44:16.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.594+0000 7fd598060700 1 --2- 172.21.15.45:0/1505740713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5901036c0 0x7fd590109f70 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:16.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.594+0000 7fd598060700 1 --2- 172.21.15.45:0/1505740713 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd590101c00 0x7fd590102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:16.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.594+0000 7fd598060700 1 --2- 172.21.15.45:0/1505740713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd590102d20 0x7fd590103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:16.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.594+0000 7fd598060700 1 -- 172.21.15.45:0/1505740713 >> 172.21.15.45:0/1505740713 conn(0x7fd5900fd210 msgr2=0x7fd5900ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:16.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.595+0000 7fd598060700 1 -- 172.21.15.45:0/1505740713 shutdown_connections 2024-05-10T03:44:16.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.595+0000 7fd598060700 1 -- 172.21.15.45:0/1505740713 wait complete. 2024-05-10T03:44:16.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.595+0000 7fd598060700 1 Processor -- start 2024-05-10T03:44:16.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.595+0000 7fd598060700 1 -- start start 2024-05-10T03:44:16.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.596+0000 7fd598060700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd590101c00 0x7fd5901980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:16.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.596+0000 7fd598060700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd590102d20 0x7fd590198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:16.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.596+0000 7fd598060700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5901036c0 0x7fd59019f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:16.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.596+0000 7fd598060700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59019fbb0 con 0x7fd590102d20 2024-05-10T03:44:16.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.596+0000 7fd598060700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59019fd20 con 0x7fd5901036c0 2024-05-10T03:44:16.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.596+0000 7fd598060700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59019fee0 con 0x7fd590101c00 2024-05-10T03:44:16.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.596+0000 7fd5955fb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd590102d20 0x7fd590198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:16.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.596+0000 7fd5955fb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd590102d20 0x7fd590198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33790/0 (socket says 172.21.15.45:33790) 2024-05-10T03:44:16.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.596+0000 7fd5955fb700 1 -- 172.21.15.45:0/166072248 learned_addr learned my addr 172.21.15.45:0/166072248 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:44:16.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.596+0000 7fd5965fd700 1 --2- 172.21.15.45:0/166072248 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5901036c0 0x7fd59019f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:16.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.596+0000 7fd595dfc700 1 --2- 172.21.15.45:0/166072248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd590101c00 0x7fd5901980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:16.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.596+0000 7fd5955fb700 1 -- 172.21.15.45:0/166072248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd590101c00 msgr2=0x7fd5901980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:16.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.596+0000 7fd5955fb700 1 --2- 172.21.15.45:0/166072248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd590101c00 0x7fd5901980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:16.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.596+0000 7fd5955fb700 1 -- 172.21.15.45:0/166072248 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5901036c0 msgr2=0x7fd59019f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:16.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.596+0000 7fd5955fb700 1 --2- 172.21.15.45:0/166072248 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5901036c0 0x7fd59019f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:16.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.596+0000 7fd5955fb700 1 -- 172.21.15.45:0/166072248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd588009d00 con 0x7fd590102d20 2024-05-10T03:44:16.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.596+0000 7fd5955fb700 1 --2- 172.21.15.45:0/166072248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd590102d20 0x7fd590198610 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd58000d950 tx=0x7fd58000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:16.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.596+0000 7fd586ffd700 1 -- 172.21.15.45:0/166072248 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd580009b40 con 0x7fd590102d20 2024-05-10T03:44:16.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.597+0000 7fd586ffd700 1 -- 172.21.15.45:0/166072248 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd580009ca0 con 0x7fd590102d20 2024-05-10T03:44:16.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.597+0000 7fd598060700 1 -- 172.21.15.45:0/166072248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5901a01c0 con 0x7fd590102d20 2024-05-10T03:44:16.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.597+0000 7fd586ffd700 1 -- 172.21.15.45:0/166072248 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58000f6b0 con 0x7fd590102d20 2024-05-10T03:44:16.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.597+0000 7fd598060700 1 -- 172.21.15.45:0/166072248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5901a06d0 con 0x7fd590102d20 2024-05-10T03:44:16.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.598+0000 7fd598060700 1 -- 172.21.15.45:0/166072248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd590108e10 con 0x7fd590102d20 2024-05-10T03:44:16.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.599+0000 7fd586ffd700 1 -- 172.21.15.45:0/166072248 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd580010460 con 0x7fd590102d20 2024-05-10T03:44:16.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.600+0000 7fd586ffd700 1 --2- 172.21.15.45:0/166072248 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd57c0a11c0 0x7fd57c0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:16.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.600+0000 7fd595dfc700 1 --2- 172.21.15.45:0/166072248 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd57c0a11c0 0x7fd57c0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:16.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.600+0000 7fd586ffd700 1 -- 172.21.15.45:0/166072248 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9012+0+0 (secure 0 0 0) 0x7fd5800ccf70 con 0x7fd590102d20 2024-05-10T03:44:16.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.600+0000 7fd595dfc700 1 --2- 172.21.15.45:0/166072248 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd57c0a11c0 0x7fd57c0a36d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd590102c20 tx=0x7fd58c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:16.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.603+0000 7fd586ffd700 1 -- 172.21.15.45:0/166072248 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd5800963f0 con 0x7fd590102d20 2024-05-10T03:44:16.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:16.827+0000 7fd598060700 1 -- 172.21.15.45:0/166072248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd5900694d0 con 0x7fd590102d20 2024-05-10T03:44:17.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.371+0000 7fd586ffd700 1 -- 172.21.15.45:0/166072248 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v93) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd5800160d0 con 0x7fd590102d20 2024-05-10T03:44:17.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.375+0000 7fd598060700 1 -- 172.21.15.45:0/166072248 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd57c0a11c0 msgr2=0x7fd57c0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:17.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.375+0000 7fd598060700 1 --2- 172.21.15.45:0/166072248 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd57c0a11c0 0x7fd57c0a36d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd590102c20 tx=0x7fd58c009260 comp rx=0 tx=0).stop 2024-05-10T03:44:17.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.375+0000 7fd598060700 1 -- 172.21.15.45:0/166072248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd590102d20 msgr2=0x7fd590198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:17.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.375+0000 7fd598060700 1 --2- 172.21.15.45:0/166072248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd590102d20 0x7fd590198610 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd58000d950 tx=0x7fd58000dd10 comp rx=0 tx=0).stop 2024-05-10T03:44:17.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.376+0000 7fd598060700 1 -- 172.21.15.45:0/166072248 shutdown_connections 2024-05-10T03:44:17.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.376+0000 7fd598060700 1 --2- 172.21.15.45:0/166072248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd590101c00 0x7fd5901980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:17.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.376+0000 7fd598060700 1 --2- 172.21.15.45:0/166072248 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7fd57c0a11c0 0x7fd57c0a36d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:17.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.376+0000 7fd598060700 1 --2- 172.21.15.45:0/166072248 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5901036c0 0x7fd59019f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:17.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.376+0000 7fd598060700 1 --2- 172.21.15.45:0/166072248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd590102d20 0x7fd590198610 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:17.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.376+0000 7fd598060700 1 -- 172.21.15.45:0/166072248 >> 172.21.15.45:0/166072248 conn(0x7fd5900fd210 msgr2=0x7fd590105f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:17.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.376+0000 7fd598060700 1 -- 172.21.15.45:0/166072248 shutdown_connections 2024-05-10T03:44:17.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.376+0000 7fd598060700 1 -- 172.21.15.45:0/166072248 wait complete. 2024-05-10T03:44:17.380 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2024-05-10T03:44:17.395 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-05-10T03:44:17.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:17 smithi106 ceph-mon[46996]: pgmap v406: 129 pgs: 129 active+clean; 98 MiB data, 872 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-05-10T03:44:17.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:17 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/738591454' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-10T03:44:17.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:17 smithi106 ceph-mon[46996]: osdmap e92: 12 total, 12 up, 12 in 2024-05-10T03:44:17.401 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:17 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/166072248' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-10T03:44:17.425 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:17 smithi045 ceph-mon[42520]: pgmap v406: 129 pgs: 129 active+clean; 98 MiB data, 872 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-05-10T03:44:17.425 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:17 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/738591454' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-10T03:44:17.425 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:17 smithi045 ceph-mon[42520]: osdmap e92: 12 total, 12 up, 12 in 2024-05-10T03:44:17.425 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:17 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/166072248' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-10T03:44:17.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:17 smithi154 ceph-mon[46565]: pgmap v406: 129 pgs: 129 active+clean; 98 MiB data, 872 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-05-10T03:44:17.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:17 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/738591454' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-10T03:44:17.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:17 smithi154 ceph-mon[46565]: osdmap e92: 12 total, 12 up, 12 in 2024-05-10T03:44:17.474 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:17 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/166072248' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-10T03:44:17.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.558+0000 7f3256448700 1 -- 172.21.15.45:0/276994118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32501031e0 msgr2=0x7f32501035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:17.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.558+0000 7f3256448700 1 --2- 172.21.15.45:0/276994118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32501031e0 0x7f32501035f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3240009990 tx=0x7f3240009ca0 comp rx=0 tx=0).stop 2024-05-10T03:44:17.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.558+0000 7f3256448700 1 -- 172.21.15.45:0/276994118 shutdown_connections 2024-05-10T03:44:17.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.558+0000 7f3256448700 1 --2- 172.21.15.45:0/276994118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3250100570 0x7f325010a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:17.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.558+0000 7f3256448700 1 --2- 172.21.15.45:0/276994118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32501031e0 0x7f32501035f0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:17.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.558+0000 7f3256448700 1 --2- 172.21.15.45:0/276994118 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32500ffc20 0x7f3250100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:17.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.558+0000 7f3256448700 1 -- 172.21.15.45:0/276994118 >> 172.21.15.45:0/276994118 conn(0x7f32500fb8f0 msgr2=0x7f32500fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:17.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.558+0000 7f3256448700 1 -- 172.21.15.45:0/276994118 shutdown_connections 2024-05-10T03:44:17.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.558+0000 7f3256448700 1 -- 172.21.15.45:0/276994118 wait complete. 2024-05-10T03:44:17.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.559+0000 7f3256448700 1 Processor -- start 2024-05-10T03:44:17.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.559+0000 7f3256448700 1 -- start start 2024-05-10T03:44:17.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.559+0000 7f3256448700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32500ffc20 0x7f3250198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:17.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.559+0000 7f3256448700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3250100570 0x7f3250198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:17.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.559+0000 7f3256448700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32501031e0 0x7f325019f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:17.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.559+0000 7f3256448700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325019fb20 con 0x7f32500ffc20 2024-05-10T03:44:17.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.559+0000 7f3256448700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325019fc90 con 0x7f32501031e0 2024-05-10T03:44:17.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.559+0000 7f3256448700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325019fe50 con 0x7f3250100570 2024-05-10T03:44:17.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.560+0000 7f324ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32500ffc20 0x7f3250198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:17.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.560+0000 7f324ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32500ffc20 0x7f3250198040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50268/0 (socket says 172.21.15.45:50268) 2024-05-10T03:44:17.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.560+0000 7f324ffff700 1 -- 172.21.15.45:0/2146393680 learned_addr learned my addr 172.21.15.45:0/2146393680 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-10T03:44:17.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.560+0000 7f32549e5700 1 --2- 172.21.15.45:0/2146393680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32501031e0 0x7f325019f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:17.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.560+0000 7f324f7fe700 1 --2- 172.21.15.45:0/2146393680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3250100570 0x7f3250198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:17.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.560+0000 7f324ffff700 1 -- 172.21.15.45:0/2146393680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3250100570 msgr2=0x7f3250198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:17.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.560+0000 7f324ffff700 1 --2- 172.21.15.45:0/2146393680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3250100570 0x7f3250198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:17.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.560+0000 7f324ffff700 1 -- 172.21.15.45:0/2146393680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32501031e0 msgr2=0x7f325019f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:17.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.560+0000 7f324ffff700 1 --2- 172.21.15.45:0/2146393680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32501031e0 0x7f325019f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:17.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.560+0000 7f324ffff700 1 -- 172.21.15.45:0/2146393680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32400095f0 con 0x7f32500ffc20 2024-05-10T03:44:17.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.560+0000 7f324f7fe700 1 --2- 172.21.15.45:0/2146393680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3250100570 0x7f3250198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:44:17.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.560+0000 7f324ffff700 1 --2- 172.21.15.45:0/2146393680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32500ffc20 0x7f3250198040 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f3240000c00 tx=0x7f324000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:17.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.560+0000 7f324d7fa700 1 -- 172.21.15.45:0/2146393680 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324001d070 con 0x7f32500ffc20 2024-05-10T03:44:17.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.560+0000 7f324d7fa700 1 -- 172.21.15.45:0/2146393680 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f324000fb80 con 0x7f32500ffc20 2024-05-10T03:44:17.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.560+0000 7f3256448700 1 -- 172.21.15.45:0/2146393680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32501a00d0 con 0x7f32500ffc20 2024-05-10T03:44:17.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.560+0000 7f324d7fa700 1 -- 172.21.15.45:0/2146393680 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32400173f0 con 0x7f32500ffc20 2024-05-10T03:44:17.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.560+0000 7f3256448700 1 -- 172.21.15.45:0/2146393680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32501a04f0 con 0x7f32500ffc20 2024-05-10T03:44:17.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.561+0000 7f3256448700 1 -- 172.21.15.45:0/2146393680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3250109030 con 0x7f32500ffc20 2024-05-10T03:44:17.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.563+0000 7f324d7fa700 1 -- 172.21.15.45:0/2146393680 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3240022470 con 0x7f32500ffc20 2024-05-10T03:44:17.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.564+0000 7f324d7fa700 1 --2- 172.21.15.45:0/2146393680 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f32380a11c0 0x7f32380a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:44:17.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.564+0000 7f324d7fa700 1 -- 172.21.15.45:0/2146393680 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8424+0+0 (secure 0 0 0) 0x7f32400cdeb0 con 0x7f32500ffc20 2024-05-10T03:44:17.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.564+0000 7f324f7fe700 1 --2- 172.21.15.45:0/2146393680 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f32380a11c0 0x7f32380a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:44:17.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.564+0000 7f324f7fe700 1 --2- 172.21.15.45:0/2146393680 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f32380a11c0 0x7f32380a36d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3244005950 tx=0x7f32440058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:44:17.570 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.568+0000 7f324d7fa700 1 -- 172.21.15.45:0/2146393680 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3240097610 con 0x7f32500ffc20 2024-05-10T03:44:17.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:17.791+0000 7f3256448700 1 -- 172.21.15.45:0/2146393680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f32500678b0 con 0x7f32500ffc20 2024-05-10T03:44:18.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:18.381+0000 7f324d7fa700 1 -- 172.21.15.45:0/2146393680 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v94) v1 ==== 178+0+0 (secure 0 0 0) 0x7f324009ac30 con 0x7f32500ffc20 2024-05-10T03:44:18.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:18.385+0000 7f3256448700 1 -- 172.21.15.45:0/2146393680 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f32380a11c0 msgr2=0x7f32380a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:18.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:18.385+0000 7f3256448700 1 --2- 172.21.15.45:0/2146393680 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f32380a11c0 0x7f32380a36d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3244005950 tx=0x7f32440058e0 comp rx=0 tx=0).stop 2024-05-10T03:44:18.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:18.385+0000 7f3256448700 1 -- 172.21.15.45:0/2146393680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32500ffc20 msgr2=0x7f3250198040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:44:18.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:18.385+0000 7f3256448700 1 --2- 172.21.15.45:0/2146393680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32500ffc20 0x7f3250198040 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f3240000c00 tx=0x7f324000f690 comp rx=0 tx=0).stop 2024-05-10T03:44:18.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:18.387+0000 7f3256448700 1 -- 172.21.15.45:0/2146393680 shutdown_connections 2024-05-10T03:44:18.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:18.387+0000 7f3256448700 1 --2- 172.21.15.45:0/2146393680 >> [v2:172.21.15.45:6800/596110596,v1:172.21.15.45:6801/596110596] conn(0x7f32380a11c0 0x7f32380a36d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:18.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:18.387+0000 7f3256448700 1 --2- 172.21.15.45:0/2146393680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32501031e0 0x7f325019f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:18.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:18.387+0000 7f3256448700 1 --2- 172.21.15.45:0/2146393680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32500ffc20 0x7f3250198040 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:18.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:18.387+0000 7f3256448700 1 --2- 172.21.15.45:0/2146393680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3250100570 0x7f3250198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:44:18.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:18.387+0000 7f3256448700 1 -- 172.21.15.45:0/2146393680 >> 172.21.15.45:0/2146393680 conn(0x7f32500fb8f0 msgr2=0x7f3250106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:44:18.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:18.390+0000 7f3256448700 1 -- 172.21.15.45:0/2146393680 shutdown_connections 2024-05-10T03:44:18.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-10T03:44:18.390+0000 7f3256448700 1 -- 172.21.15.45:0/2146393680 wait complete. 2024-05-10T03:44:18.393 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data_ec' removed 2024-05-10T03:44:18.414 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-10T03:44:18.490 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-10T03:44:18.529 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-10T03:44:18.569 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-10T03:44:18.569 DEBUG:teuthology.orchestra.run.smithi045:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-10T03:44:18.591 DEBUG:teuthology.orchestra.run.smithi106:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-10T03:44:18.612 DEBUG:teuthology.orchestra.run.smithi154:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-10T03:44:18.632 INFO:tasks.cephadm:Stopping all daemons... 2024-05-10T03:44:18.632 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-05-10T03:44:18.632 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mon.a 2024-05-10T03:44:18.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:18 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/166072248' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-10T03:44:18.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:18 smithi106 ceph-mon[46996]: osdmap e93: 12 total, 12 up, 12 in 2024-05-10T03:44:18.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:18 smithi106 ceph-mon[46996]: from='client.? 172.21.15.45:0/2146393680' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-10T03:44:18.651 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:18 smithi106 ceph-mon[46996]: pgmap v409: 33 pgs: 33 active+clean; 577 KiB data, 845 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:44:18.663 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:18 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/166072248' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-10T03:44:18.663 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:18 smithi045 ceph-mon[42520]: osdmap e93: 12 total, 12 up, 12 in 2024-05-10T03:44:18.663 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:18 smithi045 ceph-mon[42520]: from='client.? 172.21.15.45:0/2146393680' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-10T03:44:18.663 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:18 smithi045 ceph-mon[42520]: pgmap v409: 33 pgs: 33 active+clean; 577 KiB data, 845 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:44:18.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:18 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/166072248' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-10T03:44:18.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:18 smithi154 ceph-mon[46565]: osdmap e93: 12 total, 12 up, 12 in 2024-05-10T03:44:18.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:18 smithi154 ceph-mon[46565]: from='client.? 172.21.15.45:0/2146393680' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-10T03:44:18.724 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:18 smithi154 ceph-mon[46565]: pgmap v409: 33 pgs: 33 active+clean; 577 KiB data, 845 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T03:44:19.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:18 smithi045 systemd[1]: Stopping Ceph mon.a for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:44:19.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:18 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mon-a[42496]: 2024-05-10T03:44:18.890+0000 7f4dd59c9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:44:19.034 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:18 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mon-a[42496]: 2024-05-10T03:44:18.890+0000 7f4dd59c9700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-05-10T03:44:19.597 INFO:journalctl@ceph.mon.a.smithi045.stdout:May 10 03:44:19 smithi045 bash[117349]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mon-a 2024-05-10T03:44:19.605 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mon.a.service' 2024-05-10T03:44:19.711 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:44:19.712 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-05-10T03:44:19.713 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-05-10T03:44:19.713 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mon.b 2024-05-10T03:44:19.994 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:19 smithi106 systemd[1]: Stopping Ceph mon.b for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:44:20.292 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:19 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mon-b[46973]: 2024-05-10T03:44:19.990+0000 7f032ab4d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:44:20.292 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:19 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mon-b[46973]: 2024-05-10T03:44:19.990+0000 7f032ab4d700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-05-10T03:44:20.546 INFO:journalctl@ceph.mon.b.smithi106.stdout:May 10 03:44:20 smithi106 bash[87750]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mon-b 2024-05-10T03:44:20.553 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mon.b.service' 2024-05-10T03:44:20.604 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:44:20.605 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-05-10T03:44:20.605 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-05-10T03:44:20.605 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mon.c 2024-05-10T03:44:20.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:20 smithi154 systemd[1]: Stopping Ceph mon.c for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:44:20.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:20 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mon-c[46542]: 2024-05-10T03:44:20.860+0000 7f23d6d9c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:44:20.974 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:20 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mon-c[46542]: 2024-05-10T03:44:20.860+0000 7f23d6d9c700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-05-10T03:44:21.662 INFO:journalctl@ceph.mon.c.smithi154.stdout:May 10 03:44:21 smithi154 bash[86914]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mon-c 2024-05-10T03:44:21.669 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mon.c.service' 2024-05-10T03:44:21.727 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:44:21.727 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-05-10T03:44:21.727 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-05-10T03:44:21.728 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mgr.x 2024-05-10T03:44:22.012 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:44:21 smithi045 systemd[1]: Stopping Ceph mgr.x for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:44:22.013 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:44:21 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:44:21.981+0000 7f0face35700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:44:22.013 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:44:21 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x[42769]: 2024-05-10T03:44:21.981+0000 7f0face35700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-05-10T03:44:22.284 INFO:journalctl@ceph.mgr.x.smithi045.stdout:May 10 03:44:22 smithi045 bash[117487]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-x 2024-05-10T03:44:22.542 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mgr.x.service' 2024-05-10T03:44:22.585 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:44:22.585 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-05-10T03:44:22.585 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-05-10T03:44:22.586 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mgr.y 2024-05-10T03:44:22.901 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:44:22 smithi106 systemd[1]: Stopping Ceph mgr.y for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:44:23.316 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:44:23 smithi106 bash[87900]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-y 2024-05-10T03:44:23.316 INFO:journalctl@ceph.mgr.y.smithi106.stdout:May 10 03:44:23 smithi106 systemd[1]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-05-10T03:44:23.322 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mgr.y.service' 2024-05-10T03:44:23.358 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:44:23.358 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-05-10T03:44:23.358 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-05-10T03:44:23.359 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mgr.z 2024-05-10T03:44:23.709 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:44:23 smithi154 systemd[1]: Stopping Ceph mgr.z for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:44:23.974 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:44:23 smithi154 bash[87063]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mgr-z 2024-05-10T03:44:23.974 INFO:journalctl@ceph.mgr.z.smithi154.stdout:May 10 03:44:23 smithi154 systemd[1]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-05-10T03:44:24.073 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mgr.z.service' 2024-05-10T03:44:24.110 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:44:24.110 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-05-10T03:44:24.111 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-10T03:44:24.111 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.0 2024-05-10T03:44:24.534 INFO:journalctl@ceph.osd.0.smithi045.stdout:May 10 03:44:24 smithi045 systemd[1]: Stopping Ceph osd.0 for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:44:24.534 INFO:journalctl@ceph.osd.0.smithi045.stdout:May 10 03:44:24 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-0[60984]: 2024-05-10T03:44:24.364+0000 7fbd62209700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:44:24.535 INFO:journalctl@ceph.osd.0.smithi045.stdout:May 10 03:44:24 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-0[60984]: 2024-05-10T03:44:24.364+0000 7fbd62209700 -1 osd.0 94 *** Got signal Terminated *** 2024-05-10T03:44:24.535 INFO:journalctl@ceph.osd.0.smithi045.stdout:May 10 03:44:24 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-0[60984]: 2024-05-10T03:44:24.364+0000 7fbd62209700 -1 osd.0 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-10T03:44:30.284 INFO:journalctl@ceph.osd.0.smithi045.stdout:May 10 03:44:29 smithi045 bash[117632]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-0 2024-05-10T03:44:31.398 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.0.service' 2024-05-10T03:44:31.450 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:44:31.451 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-10T03:44:31.451 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-10T03:44:31.451 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.1 2024-05-10T03:44:31.901 INFO:journalctl@ceph.osd.1.smithi106.stdout:May 10 03:44:31 smithi106 systemd[1]: Stopping Ceph osd.1 for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:44:31.901 INFO:journalctl@ceph.osd.1.smithi106.stdout:May 10 03:44:31 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-1[51969]: 2024-05-10T03:44:31.690+0000 7f708ec0b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:44:31.901 INFO:journalctl@ceph.osd.1.smithi106.stdout:May 10 03:44:31 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-1[51969]: 2024-05-10T03:44:31.690+0000 7f708ec0b700 -1 osd.1 94 *** Got signal Terminated *** 2024-05-10T03:44:31.901 INFO:journalctl@ceph.osd.1.smithi106.stdout:May 10 03:44:31 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-1[51969]: 2024-05-10T03:44:31.690+0000 7f708ec0b700 -1 osd.1 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-10T03:44:37.651 INFO:journalctl@ceph.osd.1.smithi106.stdout:May 10 03:44:37 smithi106 bash[88048]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-1 2024-05-10T03:44:38.463 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.1.service' 2024-05-10T03:44:38.503 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:44:38.504 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-10T03:44:38.504 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-10T03:44:38.504 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.2 2024-05-10T03:44:38.974 INFO:journalctl@ceph.osd.2.smithi154.stdout:May 10 03:44:38 smithi154 systemd[1]: Stopping Ceph osd.2 for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:44:38.974 INFO:journalctl@ceph.osd.2.smithi154.stdout:May 10 03:44:38 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-2[52343]: 2024-05-10T03:44:38.749+0000 7f02143fe700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:44:38.975 INFO:journalctl@ceph.osd.2.smithi154.stdout:May 10 03:44:38 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-2[52343]: 2024-05-10T03:44:38.749+0000 7f02143fe700 -1 osd.2 94 *** Got signal Terminated *** 2024-05-10T03:44:38.975 INFO:journalctl@ceph.osd.2.smithi154.stdout:May 10 03:44:38 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-2[52343]: 2024-05-10T03:44:38.749+0000 7f02143fe700 -1 osd.2 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-10T03:44:44.724 INFO:journalctl@ceph.osd.2.smithi154.stdout:May 10 03:44:44 smithi154 bash[87216]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-2 2024-05-10T03:44:45.564 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.2.service' 2024-05-10T03:44:45.605 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:44:45.606 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-10T03:44:45.606 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-10T03:44:45.606 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.3 2024-05-10T03:44:45.904 INFO:journalctl@ceph.osd.3.smithi045.stdout:May 10 03:44:45 smithi045 systemd[1]: Stopping Ceph osd.3 for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:44:46.284 INFO:journalctl@ceph.osd.3.smithi045.stdout:May 10 03:44:45 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-3[68900]: 2024-05-10T03:44:45.899+0000 7fac664e4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:44:46.284 INFO:journalctl@ceph.osd.3.smithi045.stdout:May 10 03:44:45 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-3[68900]: 2024-05-10T03:44:45.899+0000 7fac664e4700 -1 osd.3 94 *** Got signal Terminated *** 2024-05-10T03:44:46.284 INFO:journalctl@ceph.osd.3.smithi045.stdout:May 10 03:44:45 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-3[68900]: 2024-05-10T03:44:45.899+0000 7fac664e4700 -1 osd.3 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-10T03:44:51.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:44:50 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:44:50.781+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:44:51.784 INFO:journalctl@ceph.osd.3.smithi045.stdout:May 10 03:44:51 smithi045 bash[117896]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-3 2024-05-10T03:44:52.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:44:51 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:44:51.810+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:44:52.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:44:52 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:44:52.414+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:44:52.937 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.3.service' 2024-05-10T03:44:52.988 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:44:52.988 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-10T03:44:52.988 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-10T03:44:52.988 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.4 2024-05-10T03:44:53.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:44:52 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:44:52.781+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:44:53.151 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 10 03:44:53 smithi106 systemd[1]: Stopping Ceph osd.4 for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:44:53.224 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 10 03:44:52 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-5[60308]: 2024-05-10T03:44:52.938+0000 7f7903bfc700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:28.194800+0000 front 2024-05-10T03:44:28.194815+0000 (oldest deadline 2024-05-10T03:44:52.294848+0000) 2024-05-10T03:44:53.651 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 10 03:44:53 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-4[60530]: 2024-05-10T03:44:53.229+0000 7f0bc2b33700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:44:53.651 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 10 03:44:53 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-4[60530]: 2024-05-10T03:44:53.229+0000 7f0bc2b33700 -1 osd.4 94 *** Got signal Terminated *** 2024-05-10T03:44:53.651 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 10 03:44:53 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-4[60530]: 2024-05-10T03:44:53.229+0000 7f0bc2b33700 -1 osd.4 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-10T03:44:53.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:44:53 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:44:53.461+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:44:54.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:44:53 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:44:53.823+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:44:54.223 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 10 03:44:53 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-5[60308]: 2024-05-10T03:44:53.939+0000 7f7903bfc700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:28.194800+0000 front 2024-05-10T03:44:28.194815+0000 (oldest deadline 2024-05-10T03:44:52.294848+0000) 2024-05-10T03:44:54.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:44:54 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:44:54.458+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:44:55.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:44:54 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:44:54.830+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:44:55.223 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 10 03:44:54 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-5[60308]: 2024-05-10T03:44:54.890+0000 7f7903bfc700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:28.194800+0000 front 2024-05-10T03:44:28.194815+0000 (oldest deadline 2024-05-10T03:44:52.294848+0000) 2024-05-10T03:44:55.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:44:54 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:44:54.847+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:44:55.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:44:55 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:44:55.451+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:44:56.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:44:55 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:44:55.822+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:44:56.224 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 10 03:44:55 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-5[60308]: 2024-05-10T03:44:55.903+0000 7f7903bfc700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:28.194800+0000 front 2024-05-10T03:44:28.194815+0000 (oldest deadline 2024-05-10T03:44:52.294848+0000) 2024-05-10T03:44:56.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:44:55 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:44:55.829+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:44:56.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:44:56 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:44:56.423+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:44:57.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:44:56 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:44:56.799+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:44:57.224 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 10 03:44:56 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-5[60308]: 2024-05-10T03:44:56.931+0000 7f7903bfc700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:28.194800+0000 front 2024-05-10T03:44:28.194815+0000 (oldest deadline 2024-05-10T03:44:52.294848+0000) 2024-05-10T03:44:57.283 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:44:56 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:44:56.841+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:44:57.723 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:44:57 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:44:57.377+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:44:57.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:44:57 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:44:57.377+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:44:58.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:44:57 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:44:57.765+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:44:58.224 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 10 03:44:57 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-5[60308]: 2024-05-10T03:44:57.909+0000 7f7903bfc700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:28.194800+0000 front 2024-05-10T03:44:28.194815+0000 (oldest deadline 2024-05-10T03:44:52.294848+0000) 2024-05-10T03:44:58.283 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:44:57 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:44:57.827+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:44:58.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:44:58 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:44:58.382+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:44:58.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:44:58 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:44:58.382+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:44:59.151 INFO:journalctl@ceph.osd.4.smithi106.stdout:May 10 03:44:58 smithi106 bash[88308]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-4 2024-05-10T03:44:59.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:44:58 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:44:58.727+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:44:59.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:44:58 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:44:58.727+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:44:59.224 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 10 03:44:58 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-5[60308]: 2024-05-10T03:44:58.953+0000 7f7903bfc700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:28.194800+0000 front 2024-05-10T03:44:28.194815+0000 (oldest deadline 2024-05-10T03:44:52.294848+0000) 2024-05-10T03:44:59.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:44:58 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:44:58.862+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:44:59.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:44:58 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:44:58.862+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:44:59.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:44:59 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:44:59.391+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:44:59.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:44:59 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:44:59.391+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:44:59.987 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:44:59 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:44:59.731+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:44:59.987 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:44:59 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:44:59.731+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:00.203 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.4.service' 2024-05-10T03:45:00.242 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:45:00.243 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-10T03:45:00.243 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-10T03:45:00.243 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.5 2024-05-10T03:45:00.273 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 10 03:44:59 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-5[60308]: 2024-05-10T03:44:59.984+0000 7f7903bfc700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:28.194800+0000 front 2024-05-10T03:44:28.194815+0000 (oldest deadline 2024-05-10T03:44:52.294848+0000) 2024-05-10T03:45:00.283 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:44:59 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:44:59.874+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:00.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:44:59 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:44:59.874+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:00.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:00 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:00.384+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:00.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:00 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:00.384+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:00.725 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 10 03:45:00 smithi154 systemd[1]: Stopping Ceph osd.5 for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:45:00.725 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 10 03:45:00 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-5[60308]: 2024-05-10T03:45:00.486+0000 7f7907644700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:45:00.725 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 10 03:45:00 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-5[60308]: 2024-05-10T03:45:00.486+0000 7f7907644700 -1 osd.5 94 *** Got signal Terminated *** 2024-05-10T03:45:00.725 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 10 03:45:00 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-5[60308]: 2024-05-10T03:45:00.486+0000 7f7907644700 -1 osd.5 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-10T03:45:01.094 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:00 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:00.742+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:01.094 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:00 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:00.742+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:01.224 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 10 03:45:00 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-5[60308]: 2024-05-10T03:45:00.961+0000 7f7903bfc700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:28.194800+0000 front 2024-05-10T03:44:28.194815+0000 (oldest deadline 2024-05-10T03:44:52.294848+0000) 2024-05-10T03:45:01.283 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:00 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:00.919+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:01.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:00 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:00.919+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:01.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:01 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:01.091+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.560006+0000 front 2024-05-10T03:44:35.560030+0000 (oldest deadline 2024-05-10T03:45:00.260167+0000) 2024-05-10T03:45:01.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:01 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:01.388+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:01.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:01 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:01.388+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:01.901 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:01 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:45:01.570+0000 7fa2b5bdc700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.376345+0000 front 2024-05-10T03:44:35.376328+0000 (oldest deadline 2024-05-10T03:45:01.276445+0000) 2024-05-10T03:45:02.103 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:01 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:01.786+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:02.103 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:01 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:01.786+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:02.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:01 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:01.898+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:02.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:01 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:01.898+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:02.386 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 10 03:45:01 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-5[60308]: 2024-05-10T03:45:01.986+0000 7f7903bfc700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:28.194800+0000 front 2024-05-10T03:44:28.194815+0000 (oldest deadline 2024-05-10T03:44:52.294848+0000) 2024-05-10T03:45:02.386 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 10 03:45:01 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-5[60308]: 2024-05-10T03:45:01.986+0000 7f7903bfc700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.296906+0000 front 2024-05-10T03:44:36.296927+0000 (oldest deadline 2024-05-10T03:45:00.996993+0000) 2024-05-10T03:45:02.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:02 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:02.100+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.560006+0000 front 2024-05-10T03:44:35.560030+0000 (oldest deadline 2024-05-10T03:45:00.260167+0000) 2024-05-10T03:45:02.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:02 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:02.383+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:02.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:02 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:02.385+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:02.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:02 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:02.385+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:02.894 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:02 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:45:02.585+0000 7fa2b5bdc700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.376345+0000 front 2024-05-10T03:44:35.376328+0000 (oldest deadline 2024-05-10T03:45:01.276445+0000) 2024-05-10T03:45:03.130 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:02 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:02.775+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:03.130 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:02 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:02.775+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:03.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:02 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:02.892+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:03.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:02 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:02.892+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:03.343 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 10 03:45:03 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-5[60308]: 2024-05-10T03:45:02.999+0000 7f7903bfc700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:28.194800+0000 front 2024-05-10T03:44:28.194815+0000 (oldest deadline 2024-05-10T03:44:52.294848+0000) 2024-05-10T03:45:03.343 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 10 03:45:03 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-5[60308]: 2024-05-10T03:45:02.999+0000 7f7903bfc700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.296906+0000 front 2024-05-10T03:44:36.296927+0000 (oldest deadline 2024-05-10T03:45:00.996993+0000) 2024-05-10T03:45:03.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:03 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:03.127+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.560006+0000 front 2024-05-10T03:44:35.560030+0000 (oldest deadline 2024-05-10T03:45:00.260167+0000) 2024-05-10T03:45:03.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:03 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:03.374+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:03.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:03 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:03.340+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:03.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:03 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:03.340+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:03.931 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:03 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:45:03.561+0000 7fa2b5bdc700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.376345+0000 front 2024-05-10T03:44:35.376328+0000 (oldest deadline 2024-05-10T03:45:01.276445+0000) 2024-05-10T03:45:04.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:03 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:03.804+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:04.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:03 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:03.804+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:04.283 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:03 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:03.929+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:04.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:03 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:03.929+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:04.386 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 10 03:45:03 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-5[60308]: 2024-05-10T03:45:03.992+0000 7f7903bfc700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:28.194800+0000 front 2024-05-10T03:44:28.194815+0000 (oldest deadline 2024-05-10T03:44:52.294848+0000) 2024-05-10T03:45:04.386 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 10 03:45:03 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-5[60308]: 2024-05-10T03:45:03.992+0000 7f7903bfc700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.296906+0000 front 2024-05-10T03:44:36.296927+0000 (oldest deadline 2024-05-10T03:45:00.996993+0000) 2024-05-10T03:45:04.651 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:04 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:04.149+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.560006+0000 front 2024-05-10T03:44:35.560030+0000 (oldest deadline 2024-05-10T03:45:00.260167+0000) 2024-05-10T03:45:04.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:04 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:04.390+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:04.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:04 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:04.383+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:04.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:04 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:04.383+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:04.954 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:04 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:45:04.544+0000 7fa2b5bdc700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.376345+0000 front 2024-05-10T03:44:35.376328+0000 (oldest deadline 2024-05-10T03:45:01.276445+0000) 2024-05-10T03:45:05.120 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:04 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:04.762+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:05.120 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:04 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:04.762+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:05.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:04 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:04.951+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:05.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:04 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:04.951+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:05.365 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 10 03:45:05 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-5[60308]: 2024-05-10T03:45:05.015+0000 7f7903bfc700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:28.194800+0000 front 2024-05-10T03:44:28.194815+0000 (oldest deadline 2024-05-10T03:44:52.294848+0000) 2024-05-10T03:45:05.366 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 10 03:45:05 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-5[60308]: 2024-05-10T03:45:05.015+0000 7f7903bfc700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.296906+0000 front 2024-05-10T03:44:36.296927+0000 (oldest deadline 2024-05-10T03:45:00.996993+0000) 2024-05-10T03:45:05.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:05 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:05.116+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.560006+0000 front 2024-05-10T03:44:35.560030+0000 (oldest deadline 2024-05-10T03:45:00.260167+0000) 2024-05-10T03:45:05.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:05 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:05.116+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:40.260912+0000 front 2024-05-10T03:44:40.260856+0000 (oldest deadline 2024-05-10T03:45:04.960756+0000) 2024-05-10T03:45:05.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:05 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:05.363+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:05.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:05 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:05.433+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:05.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:05 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:05.433+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:05.786 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:05 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:45:05.531+0000 7fa2b5bdc700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.376345+0000 front 2024-05-10T03:44:35.376328+0000 (oldest deadline 2024-05-10T03:45:01.276445+0000) 2024-05-10T03:45:05.787 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:05 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:45:05.531+0000 7fa2b5bdc700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:41.277000+0000 front 2024-05-10T03:44:41.277242+0000 (oldest deadline 2024-05-10T03:45:05.377106+0000) 2024-05-10T03:45:06.134 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:05 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:05.713+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:06.134 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:05 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:05.713+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:06.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:05 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:05.980+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:06.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:05 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:05.980+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:06.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:06 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:06.131+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.560006+0000 front 2024-05-10T03:44:35.560030+0000 (oldest deadline 2024-05-10T03:45:00.260167+0000) 2024-05-10T03:45:06.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:06 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:06.131+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:40.260912+0000 front 2024-05-10T03:44:40.260856+0000 (oldest deadline 2024-05-10T03:45:04.960756+0000) 2024-05-10T03:45:06.474 INFO:journalctl@ceph.osd.5.smithi154.stdout:May 10 03:45:06 smithi154 bash[87472]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-5 2024-05-10T03:45:06.474 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:06 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:06.323+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:06.771 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:06 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:06.476+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:06.771 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:06 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:06.476+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:06.783 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:06 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:45:06.494+0000 7fa2b5bdc700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.376345+0000 front 2024-05-10T03:44:35.376328+0000 (oldest deadline 2024-05-10T03:45:01.276445+0000) 2024-05-10T03:45:06.783 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:06 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:45:06.494+0000 7fa2b5bdc700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:41.277000+0000 front 2024-05-10T03:44:41.277242+0000 (oldest deadline 2024-05-10T03:45:05.377106+0000) 2024-05-10T03:45:07.105 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:06 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:06.675+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:07.105 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:06 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:06.675+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:07.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:06 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:06.991+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:07.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:06 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:06.991+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:07.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:07 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:07.102+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.560006+0000 front 2024-05-10T03:44:35.560030+0000 (oldest deadline 2024-05-10T03:45:00.260167+0000) 2024-05-10T03:45:07.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:07 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:07.102+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:40.260912+0000 front 2024-05-10T03:44:40.260856+0000 (oldest deadline 2024-05-10T03:45:04.960756+0000) 2024-05-10T03:45:07.474 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:07 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:07.277+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:07.503 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.5.service' 2024-05-10T03:45:07.585 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:45:07.585 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-10T03:45:07.585 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-05-10T03:45:07.585 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.6 2024-05-10T03:45:07.843 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:07 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:45:07.533+0000 7fa2b5bdc700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.376345+0000 front 2024-05-10T03:44:35.376328+0000 (oldest deadline 2024-05-10T03:45:01.276445+0000) 2024-05-10T03:45:07.844 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:07 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:45:07.533+0000 7fa2b5bdc700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:41.277000+0000 front 2024-05-10T03:44:41.277242+0000 (oldest deadline 2024-05-10T03:45:05.377106+0000) 2024-05-10T03:45:07.844 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:07 smithi045 systemd[1]: Stopping Ceph osd.6 for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:45:07.844 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:07 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:45:07.840+0000 7fa2b9624700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:45:07.844 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:07 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:45:07.840+0000 7fa2b9624700 -1 osd.6 94 *** Got signal Terminated *** 2024-05-10T03:45:07.901 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:07 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:07.628+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:07.901 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:07 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:07.628+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:07.974 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:07 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:07.518+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:07.974 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:07 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:07.518+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:08.284 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:07 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:45:07.840+0000 7fa2b9624700 -1 osd.6 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-10T03:45:08.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:07 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:07.955+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:08.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:07 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:07.955+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:08.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:07 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:07.955+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:08.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:08 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:08.083+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.560006+0000 front 2024-05-10T03:44:35.560030+0000 (oldest deadline 2024-05-10T03:45:00.260167+0000) 2024-05-10T03:45:08.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:08 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:08.083+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:40.260912+0000 front 2024-05-10T03:44:40.260856+0000 (oldest deadline 2024-05-10T03:45:04.960756+0000) 2024-05-10T03:45:08.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:08 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:08.482+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:08.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:08 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:08.482+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:08.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:08 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:08.482+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:08.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:08 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:08.326+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:08.901 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:08 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:08.643+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:08.901 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:08 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:08.643+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:08.969 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:08 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:45:08.533+0000 7fa2b5bdc700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.376345+0000 front 2024-05-10T03:44:35.376328+0000 (oldest deadline 2024-05-10T03:45:01.276445+0000) 2024-05-10T03:45:08.969 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:08 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:45:08.533+0000 7fa2b5bdc700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:41.277000+0000 front 2024-05-10T03:44:41.277242+0000 (oldest deadline 2024-05-10T03:45:05.377106+0000) 2024-05-10T03:45:09.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:08 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:08.967+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:09.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:08 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:08.967+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:09.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:08 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:08.967+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:09.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:09 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:09.131+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.560006+0000 front 2024-05-10T03:44:35.560030+0000 (oldest deadline 2024-05-10T03:45:00.260167+0000) 2024-05-10T03:45:09.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:09 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:09.131+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:40.260912+0000 front 2024-05-10T03:44:40.260856+0000 (oldest deadline 2024-05-10T03:45:04.960756+0000) 2024-05-10T03:45:09.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:09 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:09.372+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:09.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:09 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:09.523+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:09.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:09 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:09.523+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:09.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:09 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:09.523+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:09.942 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:09 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:45:09.562+0000 7fa2b5bdc700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.376345+0000 front 2024-05-10T03:44:35.376328+0000 (oldest deadline 2024-05-10T03:45:01.276445+0000) 2024-05-10T03:45:09.943 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:09 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:45:09.562+0000 7fa2b5bdc700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:41.277000+0000 front 2024-05-10T03:44:41.277242+0000 (oldest deadline 2024-05-10T03:45:05.377106+0000) 2024-05-10T03:45:10.104 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:09 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:09.683+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:10.105 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:09 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:09.683+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:10.105 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:09 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:09.683+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:10.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:09 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:09.940+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:10.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:09 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:09.940+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:10.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:09 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:09.940+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:10.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:10 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:10.101+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.560006+0000 front 2024-05-10T03:44:35.560030+0000 (oldest deadline 2024-05-10T03:45:00.260167+0000) 2024-05-10T03:45:10.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:10 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:10.101+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:40.260912+0000 front 2024-05-10T03:44:40.260856+0000 (oldest deadline 2024-05-10T03:45:04.960756+0000) 2024-05-10T03:45:10.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:10 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:10.540+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:10.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:10 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:10.540+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:10.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:10 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:10.540+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:10.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:10 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:10.346+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:10.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:10 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:10.346+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.127975+0000 front 2024-05-10T03:44:42.128003+0000 (oldest deadline 2024-05-10T03:45:09.728858+0000) 2024-05-10T03:45:10.784 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:10 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:45:10.523+0000 7fa2b5bdc700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.376345+0000 front 2024-05-10T03:44:35.376328+0000 (oldest deadline 2024-05-10T03:45:01.276445+0000) 2024-05-10T03:45:10.784 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:10 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:45:10.523+0000 7fa2b5bdc700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:41.277000+0000 front 2024-05-10T03:44:41.277242+0000 (oldest deadline 2024-05-10T03:45:05.377106+0000) 2024-05-10T03:45:11.113 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:10 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:10.668+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:11.113 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:10 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:10.668+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:11.113 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:10 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:10.668+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:11.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:10 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:10.990+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:11.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:10 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:10.990+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:11.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:10 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:10.990+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:11.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:11 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:11.110+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.560006+0000 front 2024-05-10T03:44:35.560030+0000 (oldest deadline 2024-05-10T03:45:00.260167+0000) 2024-05-10T03:45:11.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:11 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:11.110+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:40.260912+0000 front 2024-05-10T03:44:40.260856+0000 (oldest deadline 2024-05-10T03:45:04.960756+0000) 2024-05-10T03:45:11.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:11 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:11.375+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:11.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:11 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:11.375+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.127975+0000 front 2024-05-10T03:44:42.128003+0000 (oldest deadline 2024-05-10T03:45:09.728858+0000) 2024-05-10T03:45:11.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:11 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:11.535+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:11.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:11 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:11.535+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:11.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:11 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:11.535+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:11.784 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:11 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:45:11.482+0000 7fa2b5bdc700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.376345+0000 front 2024-05-10T03:44:35.376328+0000 (oldest deadline 2024-05-10T03:45:01.276445+0000) 2024-05-10T03:45:11.784 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:11 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:45:11.482+0000 7fa2b5bdc700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:41.277000+0000 front 2024-05-10T03:44:41.277242+0000 (oldest deadline 2024-05-10T03:45:05.377106+0000) 2024-05-10T03:45:11.901 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:11 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:11.647+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:11.901 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:11 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:11.647+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:11.901 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:11 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:11.647+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:12.283 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:11 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:11.957+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:12.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:11 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:11.957+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:12.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:11 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:11.957+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:12.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:12 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:12.079+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.560006+0000 front 2024-05-10T03:44:35.560030+0000 (oldest deadline 2024-05-10T03:45:00.260167+0000) 2024-05-10T03:45:12.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:12 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:12.079+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:40.260912+0000 front 2024-05-10T03:44:40.260856+0000 (oldest deadline 2024-05-10T03:45:04.960756+0000) 2024-05-10T03:45:12.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:12 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:12.538+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:12.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:12 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:12.538+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:12.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:12 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:12.538+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:12.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:12 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:12.347+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:12.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:12 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:12.347+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.127975+0000 front 2024-05-10T03:44:42.128003+0000 (oldest deadline 2024-05-10T03:45:09.728858+0000) 2024-05-10T03:45:12.783 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:12 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:45:12.456+0000 7fa2b5bdc700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.376345+0000 front 2024-05-10T03:44:35.376328+0000 (oldest deadline 2024-05-10T03:45:01.276445+0000) 2024-05-10T03:45:12.784 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:12 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:45:12.456+0000 7fa2b5bdc700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:41.277000+0000 front 2024-05-10T03:44:41.277242+0000 (oldest deadline 2024-05-10T03:45:05.377106+0000) 2024-05-10T03:45:12.784 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:12 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6[77584]: 2024-05-10T03:45:12.456+0000 7fa2b5bdc700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.278038+0000 front 2024-05-10T03:44:48.278067+0000 (oldest deadline 2024-05-10T03:45:12.378200+0000) 2024-05-10T03:45:13.094 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:12 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:12.691+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:13.095 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:12 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:12.691+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:13.095 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:12 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:12.691+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:13.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:12 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:12.992+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:13.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:12 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:12.992+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:13.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:12 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:12.992+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:13.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:13 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:13.091+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.560006+0000 front 2024-05-10T03:44:35.560030+0000 (oldest deadline 2024-05-10T03:45:00.260167+0000) 2024-05-10T03:45:13.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:13 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:13.091+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:40.260912+0000 front 2024-05-10T03:44:40.260856+0000 (oldest deadline 2024-05-10T03:45:04.960756+0000) 2024-05-10T03:45:13.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:13 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:13.091+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.662049+0000 front 2024-05-10T03:44:49.661941+0000 (oldest deadline 2024-05-10T03:45:12.561901+0000) 2024-05-10T03:45:13.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:13 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:13.494+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:13.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:13 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:13.494+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:13.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:13 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:13.494+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:13.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:13 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:13.328+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:13.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:13 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:13.328+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.127975+0000 front 2024-05-10T03:44:42.128003+0000 (oldest deadline 2024-05-10T03:45:09.728858+0000) 2024-05-10T03:45:13.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:13 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:13.328+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.729561+0000 front 2024-05-10T03:44:49.729667+0000 (oldest deadline 2024-05-10T03:45:13.229575+0000) 2024-05-10T03:45:13.784 INFO:journalctl@ceph.osd.6.smithi045.stdout:May 10 03:45:13 smithi045 bash[118153]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-6 2024-05-10T03:45:14.067 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:13 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:13.705+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:14.068 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:13 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:13.705+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:14.068 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:13 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:13.705+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:14.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:14 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:14.020+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:14.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:14 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:14.021+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:14.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:14 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:14.021+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:14.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:14 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:14.065+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.560006+0000 front 2024-05-10T03:44:35.560030+0000 (oldest deadline 2024-05-10T03:45:00.260167+0000) 2024-05-10T03:45:14.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:14 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:14.065+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:40.260912+0000 front 2024-05-10T03:44:40.260856+0000 (oldest deadline 2024-05-10T03:45:04.960756+0000) 2024-05-10T03:45:14.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:14 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:14.065+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.662049+0000 front 2024-05-10T03:44:49.661941+0000 (oldest deadline 2024-05-10T03:45:12.561901+0000) 2024-05-10T03:45:14.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:14 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:14.513+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:14.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:14 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:14.513+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:14.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:14 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:14.513+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:14.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:14 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:14.335+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:14.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:14 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:14.335+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.127975+0000 front 2024-05-10T03:44:42.128003+0000 (oldest deadline 2024-05-10T03:45:09.728858+0000) 2024-05-10T03:45:14.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:14 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:14.335+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.729561+0000 front 2024-05-10T03:44:49.729667+0000 (oldest deadline 2024-05-10T03:45:13.229575+0000) 2024-05-10T03:45:14.874 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.6.service' 2024-05-10T03:45:14.926 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:45:14.926 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-05-10T03:45:14.927 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-05-10T03:45:14.927 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.7 2024-05-10T03:45:15.115 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:14 smithi106 systemd[1]: Stopping Ceph osd.7 for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:45:15.115 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:14 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:14.737+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:15.115 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:14 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:14.737+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:15.115 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:14 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:14.737+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:15.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:15 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:15.035+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:15.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:15 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:15.035+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:15.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:15 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:15.035+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:15.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:15 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:15.111+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.560006+0000 front 2024-05-10T03:44:35.560030+0000 (oldest deadline 2024-05-10T03:45:00.260167+0000) 2024-05-10T03:45:15.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:15 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:15.111+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:40.260912+0000 front 2024-05-10T03:44:40.260856+0000 (oldest deadline 2024-05-10T03:45:04.960756+0000) 2024-05-10T03:45:15.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:15 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:15.111+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.662049+0000 front 2024-05-10T03:44:49.661941+0000 (oldest deadline 2024-05-10T03:45:12.561901+0000) 2024-05-10T03:45:15.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:15 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:15.251+0000 7f55af331700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:45:15.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:15 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:15.251+0000 7f55af331700 -1 osd.7 94 *** Got signal Terminated *** 2024-05-10T03:45:15.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:15 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:15.251+0000 7f55af331700 -1 osd.7 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-10T03:45:15.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:15 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:15.484+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:15.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:15 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:15.484+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:15.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:15 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:15.484+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:15.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:15 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:15.359+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:15.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:15 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:15.359+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.127975+0000 front 2024-05-10T03:44:42.128003+0000 (oldest deadline 2024-05-10T03:45:09.728858+0000) 2024-05-10T03:45:15.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:15 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:15.359+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.729561+0000 front 2024-05-10T03:44:49.729667+0000 (oldest deadline 2024-05-10T03:45:13.229575+0000) 2024-05-10T03:45:16.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:15 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:15.772+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:16.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:15 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:15.772+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:16.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:15 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:15.772+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:16.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:15 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:15.772+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:16.533 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:16 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:16.065+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:16.534 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:16 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:16.065+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:16.534 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:16 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:16.065+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:16.534 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:16 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:16.065+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.814546+0000 front 2024-05-10T03:44:49.814573+0000 (oldest deadline 2024-05-10T03:45:15.714763+0000) 2024-05-10T03:45:16.651 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:16 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:16.160+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.560006+0000 front 2024-05-10T03:44:35.560030+0000 (oldest deadline 2024-05-10T03:45:00.260167+0000) 2024-05-10T03:45:16.651 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:16 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:16.160+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:40.260912+0000 front 2024-05-10T03:44:40.260856+0000 (oldest deadline 2024-05-10T03:45:04.960756+0000) 2024-05-10T03:45:16.651 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:16 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:16.160+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.662049+0000 front 2024-05-10T03:44:49.661941+0000 (oldest deadline 2024-05-10T03:45:12.561901+0000) 2024-05-10T03:45:16.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:16 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:16.461+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:16.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:16 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:16.461+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:16.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:16 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:16.461+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:16.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:16 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:16.310+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:16.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:16 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:16.310+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.127975+0000 front 2024-05-10T03:44:42.128003+0000 (oldest deadline 2024-05-10T03:45:09.728858+0000) 2024-05-10T03:45:16.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:16 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:16.310+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.729561+0000 front 2024-05-10T03:44:49.729667+0000 (oldest deadline 2024-05-10T03:45:13.229575+0000) 2024-05-10T03:45:17.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:16 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:16.803+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:17.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:16 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:16.803+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:17.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:16 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:16.803+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:17.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:16 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:16.803+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:17.534 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:17 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:17.032+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:17.534 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:17 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:17.032+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:17.534 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:17 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:17.032+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:17.534 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:17 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:17.032+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.814546+0000 front 2024-05-10T03:44:49.814573+0000 (oldest deadline 2024-05-10T03:45:15.714763+0000) 2024-05-10T03:45:17.651 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:17 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:17.150+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.560006+0000 front 2024-05-10T03:44:35.560030+0000 (oldest deadline 2024-05-10T03:45:00.260167+0000) 2024-05-10T03:45:17.651 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:17 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:17.150+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:40.260912+0000 front 2024-05-10T03:44:40.260856+0000 (oldest deadline 2024-05-10T03:45:04.960756+0000) 2024-05-10T03:45:17.651 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:17 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:17.150+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.662049+0000 front 2024-05-10T03:44:49.661941+0000 (oldest deadline 2024-05-10T03:45:12.561901+0000) 2024-05-10T03:45:17.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:17 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:17.495+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:17.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:17 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:17.495+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:17.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:17 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:17.495+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:17.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:17 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:17.344+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:17.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:17 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:17.344+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.127975+0000 front 2024-05-10T03:44:42.128003+0000 (oldest deadline 2024-05-10T03:45:09.728858+0000) 2024-05-10T03:45:17.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:17 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:17.344+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.729561+0000 front 2024-05-10T03:44:49.729667+0000 (oldest deadline 2024-05-10T03:45:13.229575+0000) 2024-05-10T03:45:18.131 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:17 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:17.773+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:18.132 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:17 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:17.774+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:18.132 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:17 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:17.774+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:18.132 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:17 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:17.774+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:18.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:18 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:18.128+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.560006+0000 front 2024-05-10T03:44:35.560030+0000 (oldest deadline 2024-05-10T03:45:00.260167+0000) 2024-05-10T03:45:18.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:18 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:18.128+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:40.260912+0000 front 2024-05-10T03:44:40.260856+0000 (oldest deadline 2024-05-10T03:45:04.960756+0000) 2024-05-10T03:45:18.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:18 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:18.128+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.662049+0000 front 2024-05-10T03:44:49.661941+0000 (oldest deadline 2024-05-10T03:45:12.561901+0000) 2024-05-10T03:45:18.534 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:18 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:18.047+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:18.534 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:18 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:18.047+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:18.534 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:18 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:18.047+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:18.534 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:18 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:18.047+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.814546+0000 front 2024-05-10T03:44:49.814573+0000 (oldest deadline 2024-05-10T03:45:15.714763+0000) 2024-05-10T03:45:18.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:18 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:18.527+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:18.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:18 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:18.527+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:18.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:18 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:18.527+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:18.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:18 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:18.384+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:18.725 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:18 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:18.384+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.127975+0000 front 2024-05-10T03:44:42.128003+0000 (oldest deadline 2024-05-10T03:45:09.728858+0000) 2024-05-10T03:45:18.725 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:18 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:18.384+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.729561+0000 front 2024-05-10T03:44:49.729667+0000 (oldest deadline 2024-05-10T03:45:13.229575+0000) 2024-05-10T03:45:19.136 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:18 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:18.786+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:19.136 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:18 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:18.786+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:19.136 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:18 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:18.786+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:19.136 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:18 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:18.786+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:19.283 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:19 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:19.021+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:19.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:19 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:19.021+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:19.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:19 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:19.021+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:19.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:19 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:19.021+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.814546+0000 front 2024-05-10T03:44:49.814573+0000 (oldest deadline 2024-05-10T03:45:15.714763+0000) 2024-05-10T03:45:19.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:19 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:19.132+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.560006+0000 front 2024-05-10T03:44:35.560030+0000 (oldest deadline 2024-05-10T03:45:00.260167+0000) 2024-05-10T03:45:19.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:19 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:19.132+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:40.260912+0000 front 2024-05-10T03:44:40.260856+0000 (oldest deadline 2024-05-10T03:45:04.960756+0000) 2024-05-10T03:45:19.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:19 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:19.132+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.662049+0000 front 2024-05-10T03:44:49.661941+0000 (oldest deadline 2024-05-10T03:45:12.561901+0000) 2024-05-10T03:45:19.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:19 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:19.132+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:55.963289+0000 front 2024-05-10T03:44:55.963316+0000 (oldest deadline 2024-05-10T03:45:18.863509+0000) 2024-05-10T03:45:19.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:19 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:19.535+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:19.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:19 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:19.535+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:19.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:19 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:19.535+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:19.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:19 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:19.391+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:19.725 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:19 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:19.391+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.127975+0000 front 2024-05-10T03:44:42.128003+0000 (oldest deadline 2024-05-10T03:45:09.728858+0000) 2024-05-10T03:45:19.725 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:19 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:19.391+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.729561+0000 front 2024-05-10T03:44:49.729667+0000 (oldest deadline 2024-05-10T03:45:13.229575+0000) 2024-05-10T03:45:19.725 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:19 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:19.391+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:53.230194+0000 front 2024-05-10T03:44:53.230026+0000 (oldest deadline 2024-05-10T03:45:19.130027+0000) 2024-05-10T03:45:20.090 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:19 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:19.780+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:20.090 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:19 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:19.780+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:20.091 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:19 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:19.780+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:20.091 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:19 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:19.780+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:20.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:19 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:19.995+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:20.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:19 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:19.995+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:20.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:19 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:19.995+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:20.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:19 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:19.995+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.814546+0000 front 2024-05-10T03:44:49.814573+0000 (oldest deadline 2024-05-10T03:45:15.714763+0000) 2024-05-10T03:45:20.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:19 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:19.995+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:55.715508+0000 front 2024-05-10T03:44:55.715692+0000 (oldest deadline 2024-05-10T03:45:19.716116+0000) 2024-05-10T03:45:20.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:20 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:20.087+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:35.560006+0000 front 2024-05-10T03:44:35.560030+0000 (oldest deadline 2024-05-10T03:45:00.260167+0000) 2024-05-10T03:45:20.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:20 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:20.087+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:40.260912+0000 front 2024-05-10T03:44:40.260856+0000 (oldest deadline 2024-05-10T03:45:04.960756+0000) 2024-05-10T03:45:20.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:20 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:20.087+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.662049+0000 front 2024-05-10T03:44:49.661941+0000 (oldest deadline 2024-05-10T03:45:12.561901+0000) 2024-05-10T03:45:20.401 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:20 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7[69235]: 2024-05-10T03:45:20.087+0000 7f55ab8e9700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:55.963289+0000 front 2024-05-10T03:44:55.963316+0000 (oldest deadline 2024-05-10T03:45:18.863509+0000) 2024-05-10T03:45:20.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:20 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:20.539+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:20.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:20 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:20.539+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:20.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:20 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:20.539+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:20.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:20 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:20.539+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:20.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:20 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:20.373+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:20.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:20 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:20.373+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.127975+0000 front 2024-05-10T03:44:42.128003+0000 (oldest deadline 2024-05-10T03:45:09.728858+0000) 2024-05-10T03:45:20.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:20 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:20.373+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.729561+0000 front 2024-05-10T03:44:49.729667+0000 (oldest deadline 2024-05-10T03:45:13.229575+0000) 2024-05-10T03:45:20.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:20 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:20.373+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:53.230194+0000 front 2024-05-10T03:44:53.230026+0000 (oldest deadline 2024-05-10T03:45:19.130027+0000) 2024-05-10T03:45:21.151 INFO:journalctl@ceph.osd.7.smithi106.stdout:May 10 03:45:21 smithi106 bash[88565]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-7 2024-05-10T03:45:21.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:20 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:20.805+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:21.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:20 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:20.805+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:21.152 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:20 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:20.805+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:21.152 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:20 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:20.805+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:21.152 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:20 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:20.805+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:56.571173+0000 front 2024-05-10T03:44:56.571192+0000 (oldest deadline 2024-05-10T03:45:20.071296+0000) 2024-05-10T03:45:21.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:20 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:20.957+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:21.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:20 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:20.957+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:21.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:20 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:20.957+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:21.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:20 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:20.957+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.814546+0000 front 2024-05-10T03:44:49.814573+0000 (oldest deadline 2024-05-10T03:45:15.714763+0000) 2024-05-10T03:45:21.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:20 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:20.957+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:55.715508+0000 front 2024-05-10T03:44:55.715692+0000 (oldest deadline 2024-05-10T03:45:19.716116+0000) 2024-05-10T03:45:21.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:21 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:21.533+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:21.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:21 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:21.533+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:21.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:21 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:21.533+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:21.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:21 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:21.533+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:21.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:21 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:21.407+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:21.725 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:21 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:21.407+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.127975+0000 front 2024-05-10T03:44:42.128003+0000 (oldest deadline 2024-05-10T03:45:09.728858+0000) 2024-05-10T03:45:21.725 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:21 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:21.407+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.729561+0000 front 2024-05-10T03:44:49.729667+0000 (oldest deadline 2024-05-10T03:45:13.229575+0000) 2024-05-10T03:45:21.725 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:21 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:21.407+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:53.230194+0000 front 2024-05-10T03:44:53.230026+0000 (oldest deadline 2024-05-10T03:45:19.130027+0000) 2024-05-10T03:45:21.901 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:21 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:21.805+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:21.902 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:21 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:21.805+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:21.902 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:21 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:21.805+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:21.902 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:21 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:21.805+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:21.902 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:21 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:21.805+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:56.571173+0000 front 2024-05-10T03:44:56.571192+0000 (oldest deadline 2024-05-10T03:45:20.071296+0000) 2024-05-10T03:45:22.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:21 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:21.930+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:22.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:21 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:21.930+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:22.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:21 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:21.930+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:22.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:21 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:21.930+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.814546+0000 front 2024-05-10T03:44:49.814573+0000 (oldest deadline 2024-05-10T03:45:15.714763+0000) 2024-05-10T03:45:22.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:21 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:21.930+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:55.715508+0000 front 2024-05-10T03:44:55.715692+0000 (oldest deadline 2024-05-10T03:45:19.716116+0000) 2024-05-10T03:45:22.324 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.7.service' 2024-05-10T03:45:22.365 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:45:22.366 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-05-10T03:45:22.366 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-05-10T03:45:22.366 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.8 2024-05-10T03:45:22.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:22 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:22.541+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:22.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:22 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:22.541+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:22.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:22 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:22.541+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:22.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:22 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:22.541+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:22.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:22 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:22.376+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:22.725 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:22 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:22.376+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.127975+0000 front 2024-05-10T03:44:42.128003+0000 (oldest deadline 2024-05-10T03:45:09.728858+0000) 2024-05-10T03:45:22.725 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:22 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:22.376+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.729561+0000 front 2024-05-10T03:44:49.729667+0000 (oldest deadline 2024-05-10T03:45:13.229575+0000) 2024-05-10T03:45:22.725 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:22 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:22.376+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:53.230194+0000 front 2024-05-10T03:44:53.230026+0000 (oldest deadline 2024-05-10T03:45:19.130027+0000) 2024-05-10T03:45:22.725 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:22 smithi154 systemd[1]: Stopping Ceph osd.8 for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:45:22.725 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:22 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:22.609+0000 7f5626ee1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:45:22.725 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:22 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:22.609+0000 7f5626ee1700 -1 osd.8 94 *** Got signal Terminated *** 2024-05-10T03:45:22.725 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:22 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:22.609+0000 7f5626ee1700 -1 osd.8 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-10T03:45:23.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:22 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:22.796+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:23.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:22 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:22.796+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:23.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:22 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:22.796+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:23.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:22 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:22.796+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:23.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:22 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:22.796+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:56.571173+0000 front 2024-05-10T03:44:56.571192+0000 (oldest deadline 2024-05-10T03:45:20.071296+0000) 2024-05-10T03:45:23.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:22 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:22.962+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:23.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:22 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:22.962+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:23.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:22 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:22.962+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:23.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:22 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:22.962+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.814546+0000 front 2024-05-10T03:44:49.814573+0000 (oldest deadline 2024-05-10T03:45:15.714763+0000) 2024-05-10T03:45:23.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:22 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:22.962+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:55.715508+0000 front 2024-05-10T03:44:55.715692+0000 (oldest deadline 2024-05-10T03:45:19.716116+0000) 2024-05-10T03:45:23.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:23 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:23.424+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:23.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:23 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:23.424+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.127975+0000 front 2024-05-10T03:44:42.128003+0000 (oldest deadline 2024-05-10T03:45:09.728858+0000) 2024-05-10T03:45:23.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:23 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:23.424+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.729561+0000 front 2024-05-10T03:44:49.729667+0000 (oldest deadline 2024-05-10T03:45:13.229575+0000) 2024-05-10T03:45:23.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:23 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:23.424+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:53.230194+0000 front 2024-05-10T03:44:53.230026+0000 (oldest deadline 2024-05-10T03:45:19.130027+0000) 2024-05-10T03:45:23.725 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:23 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:23.497+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:23.725 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:23 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:23.497+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:23.725 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:23 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:23.497+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:23.725 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:23 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:23.497+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:24.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:23 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:23.843+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:24.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:23 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:23.843+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:24.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:23 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:23.843+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:24.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:23 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:23.843+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:24.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:23 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:23.843+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:56.571173+0000 front 2024-05-10T03:44:56.571192+0000 (oldest deadline 2024-05-10T03:45:20.071296+0000) 2024-05-10T03:45:24.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:23 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:23.952+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:24.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:23 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:23.952+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:24.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:23 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:23.952+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:24.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:23 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:23.952+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.814546+0000 front 2024-05-10T03:44:49.814573+0000 (oldest deadline 2024-05-10T03:45:15.714763+0000) 2024-05-10T03:45:24.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:23 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:23.952+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:55.715508+0000 front 2024-05-10T03:44:55.715692+0000 (oldest deadline 2024-05-10T03:45:19.716116+0000) 2024-05-10T03:45:24.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:24 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:24.468+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:24.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:24 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:24.468+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.127975+0000 front 2024-05-10T03:44:42.128003+0000 (oldest deadline 2024-05-10T03:45:09.728858+0000) 2024-05-10T03:45:24.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:24 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:24.468+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.729561+0000 front 2024-05-10T03:44:49.729667+0000 (oldest deadline 2024-05-10T03:45:13.229575+0000) 2024-05-10T03:45:24.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:24 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:24.468+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:53.230194+0000 front 2024-05-10T03:44:53.230026+0000 (oldest deadline 2024-05-10T03:45:19.130027+0000) 2024-05-10T03:45:24.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:24 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:24.452+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:24.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:24 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:24.452+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:24.725 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:24 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:24.452+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:24.725 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:24 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:24.452+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:25.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:24 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:24.866+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:25.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:24 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:24.866+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:25.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:24 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:24.866+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:25.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:24 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:24.866+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:25.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:24 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:24.866+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:56.571173+0000 front 2024-05-10T03:44:56.571192+0000 (oldest deadline 2024-05-10T03:45:20.071296+0000) 2024-05-10T03:45:25.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:24 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:24.983+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:25.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:24 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:24.983+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:25.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:24 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:24.983+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:25.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:24 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:24.983+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.814546+0000 front 2024-05-10T03:44:49.814573+0000 (oldest deadline 2024-05-10T03:45:15.714763+0000) 2024-05-10T03:45:25.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:24 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:24.983+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:55.715508+0000 front 2024-05-10T03:44:55.715692+0000 (oldest deadline 2024-05-10T03:45:19.716116+0000) 2024-05-10T03:45:25.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:25 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:25.479+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:25.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:25 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:25.479+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.127975+0000 front 2024-05-10T03:44:42.128003+0000 (oldest deadline 2024-05-10T03:45:09.728858+0000) 2024-05-10T03:45:25.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:25 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:25.480+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.729561+0000 front 2024-05-10T03:44:49.729667+0000 (oldest deadline 2024-05-10T03:45:13.229575+0000) 2024-05-10T03:45:25.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:25 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:25.480+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:53.230194+0000 front 2024-05-10T03:44:53.230026+0000 (oldest deadline 2024-05-10T03:45:19.130027+0000) 2024-05-10T03:45:25.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:25 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:25.464+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:25.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:25 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:25.464+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:25.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:25 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:25.464+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:25.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:25 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:25.464+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:26.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:25 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:25.898+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:26.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:25 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:25.898+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:26.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:25 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:25.898+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:26.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:25 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:25.898+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:26.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:25 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:25.898+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:56.571173+0000 front 2024-05-10T03:44:56.571192+0000 (oldest deadline 2024-05-10T03:45:20.071296+0000) 2024-05-10T03:45:26.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:25 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:25.985+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:26.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:25 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:25.985+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:26.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:25 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:25.985+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:26.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:25 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:25.985+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.814546+0000 front 2024-05-10T03:44:49.814573+0000 (oldest deadline 2024-05-10T03:45:15.714763+0000) 2024-05-10T03:45:26.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:25 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:25.985+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:55.715508+0000 front 2024-05-10T03:44:55.715692+0000 (oldest deadline 2024-05-10T03:45:19.716116+0000) 2024-05-10T03:45:26.974 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:26 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:26.528+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:26.974 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:26 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:26.528+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.127975+0000 front 2024-05-10T03:44:42.128003+0000 (oldest deadline 2024-05-10T03:45:09.728858+0000) 2024-05-10T03:45:26.974 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:26 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:26.528+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.729561+0000 front 2024-05-10T03:44:49.729667+0000 (oldest deadline 2024-05-10T03:45:13.229575+0000) 2024-05-10T03:45:26.974 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:26 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:26.528+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:53.230194+0000 front 2024-05-10T03:44:53.230026+0000 (oldest deadline 2024-05-10T03:45:19.130027+0000) 2024-05-10T03:45:26.974 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:26 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:26.483+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:26.974 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:26 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:26.483+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:26.974 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:26 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:26.483+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:26.974 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:26 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:26.483+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:27.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:26 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:26.976+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:27.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:26 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:26.976+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:27.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:26 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:26.976+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:27.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:26 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:26.976+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.814546+0000 front 2024-05-10T03:44:49.814573+0000 (oldest deadline 2024-05-10T03:45:15.714763+0000) 2024-05-10T03:45:27.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:26 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:26.976+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:55.715508+0000 front 2024-05-10T03:44:55.715692+0000 (oldest deadline 2024-05-10T03:45:19.716116+0000) 2024-05-10T03:45:27.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:26 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:26.976+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.317789+0000 front 2024-05-10T03:45:04.317745+0000 (oldest deadline 2024-05-10T03:45:26.617471+0000) 2024-05-10T03:45:27.401 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:26 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:26.917+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:27.401 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:26 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:26.917+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:27.401 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:26 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:26.917+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:27.401 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:26 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:26.917+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:27.401 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:26 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:26.917+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:56.571173+0000 front 2024-05-10T03:44:56.571192+0000 (oldest deadline 2024-05-10T03:45:20.071296+0000) 2024-05-10T03:45:27.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:27 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:27.440+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:27.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:27 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:27.440+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:27.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:27 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:27.440+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:27.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:27 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:27.440+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:27.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:27 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:27.559+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:31.526959+0000 front 2024-05-10T03:44:31.526976+0000 (oldest deadline 2024-05-10T03:45:02.127524+0000) 2024-05-10T03:45:27.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:27 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:27.559+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.127975+0000 front 2024-05-10T03:44:42.128003+0000 (oldest deadline 2024-05-10T03:45:09.728858+0000) 2024-05-10T03:45:27.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:27 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:27.559+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.729561+0000 front 2024-05-10T03:44:49.729667+0000 (oldest deadline 2024-05-10T03:45:13.229575+0000) 2024-05-10T03:45:27.725 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:27 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8[68425]: 2024-05-10T03:45:27.559+0000 7f5623499700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:53.230194+0000 front 2024-05-10T03:44:53.230026+0000 (oldest deadline 2024-05-10T03:45:19.130027+0000) 2024-05-10T03:45:28.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:27 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:27.941+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:28.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:27 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:27.941+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:28.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:27 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:27.941+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:28.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:27 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:27.941+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.814546+0000 front 2024-05-10T03:44:49.814573+0000 (oldest deadline 2024-05-10T03:45:15.714763+0000) 2024-05-10T03:45:28.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:27 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:27.941+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:55.715508+0000 front 2024-05-10T03:44:55.715692+0000 (oldest deadline 2024-05-10T03:45:19.716116+0000) 2024-05-10T03:45:28.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:27 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:27.941+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.317789+0000 front 2024-05-10T03:45:04.317745+0000 (oldest deadline 2024-05-10T03:45:26.617471+0000) 2024-05-10T03:45:28.401 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:27 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:27.942+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:28.401 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:27 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:27.942+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:28.401 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:27 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:27.942+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:28.401 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:27 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:27.942+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:28.401 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:27 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:27.942+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:56.571173+0000 front 2024-05-10T03:44:56.571192+0000 (oldest deadline 2024-05-10T03:45:20.071296+0000) 2024-05-10T03:45:28.401 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:27 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:27.942+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:01.772227+0000 front 2024-05-10T03:45:01.772384+0000 (oldest deadline 2024-05-10T03:45:27.072264+0000) 2024-05-10T03:45:28.724 INFO:journalctl@ceph.osd.8.smithi154.stdout:May 10 03:45:28 smithi154 bash[87728]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-8 2024-05-10T03:45:28.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:28 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:28.408+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:28.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:28 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:28.408+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:28.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:28 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:28.408+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:28.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:28 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:28.408+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:29.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:28 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:28.921+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:29.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:28 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:28.921+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:29.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:28 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:28.921+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:29.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:28 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:28.921+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.814546+0000 front 2024-05-10T03:44:49.814573+0000 (oldest deadline 2024-05-10T03:45:15.714763+0000) 2024-05-10T03:45:29.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:28 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:28.921+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:55.715508+0000 front 2024-05-10T03:44:55.715692+0000 (oldest deadline 2024-05-10T03:45:19.716116+0000) 2024-05-10T03:45:29.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:28 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:28.921+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.317789+0000 front 2024-05-10T03:45:04.317745+0000 (oldest deadline 2024-05-10T03:45:26.617471+0000) 2024-05-10T03:45:29.401 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:28 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:28.900+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:29.401 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:28 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:28.900+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:29.401 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:28 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:28.900+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:29.401 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:28 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:28.900+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:29.401 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:28 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:28.900+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:56.571173+0000 front 2024-05-10T03:44:56.571192+0000 (oldest deadline 2024-05-10T03:45:20.071296+0000) 2024-05-10T03:45:29.401 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:28 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:28.900+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:01.772227+0000 front 2024-05-10T03:45:01.772384+0000 (oldest deadline 2024-05-10T03:45:27.072264+0000) 2024-05-10T03:45:29.540 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:29 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:29.429+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:29.540 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:29 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:29.429+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:29.540 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:29 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:29.429+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:29.540 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:29 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:29.429+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:29.547 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.8.service' 2024-05-10T03:45:29.587 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:45:29.587 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-05-10T03:45:29.587 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-05-10T03:45:29.587 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.9 2024-05-10T03:45:29.938 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:29 smithi045 systemd[1]: Stopping Ceph osd.9 for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:45:29.938 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:29 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:29.853+0000 7f73868b4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:45:29.938 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:29 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:29.853+0000 7f73868b4700 -1 osd.9 94 *** Got signal Terminated *** 2024-05-10T03:45:29.938 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:29 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:29.853+0000 7f73868b4700 -1 osd.9 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-10T03:45:29.938 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:29 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:29.934+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:29.938 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:29 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:29.934+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:29.938 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:29 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:29.934+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:30.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:29 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:29.866+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:30.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:29 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:29.866+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:30.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:29 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:29.866+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:30.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:29 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:29.866+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:30.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:29 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:29.866+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:56.571173+0000 front 2024-05-10T03:44:56.571192+0000 (oldest deadline 2024-05-10T03:45:20.071296+0000) 2024-05-10T03:45:30.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:29 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:29.866+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:01.772227+0000 front 2024-05-10T03:45:01.772384+0000 (oldest deadline 2024-05-10T03:45:27.072264+0000) 2024-05-10T03:45:30.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:29 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:29.934+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.814546+0000 front 2024-05-10T03:44:49.814573+0000 (oldest deadline 2024-05-10T03:45:15.714763+0000) 2024-05-10T03:45:30.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:29 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:29.934+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:55.715508+0000 front 2024-05-10T03:44:55.715692+0000 (oldest deadline 2024-05-10T03:45:19.716116+0000) 2024-05-10T03:45:30.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:29 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:29.934+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.317789+0000 front 2024-05-10T03:45:04.317745+0000 (oldest deadline 2024-05-10T03:45:26.617471+0000) 2024-05-10T03:45:30.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:30 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:30.411+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:30.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:30 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:30.412+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:30.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:30 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:30.412+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:30.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:30 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:30.412+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:30.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:30 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:30.412+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.754392+0000 front 2024-05-10T03:45:04.754282+0000 (oldest deadline 2024-05-10T03:45:29.454426+0000) 2024-05-10T03:45:31.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:30 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:30.890+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:31.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:30 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:30.890+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:31.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:30 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:30.890+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:31.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:30 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:30.890+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:31.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:30 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:30.890+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:56.571173+0000 front 2024-05-10T03:44:56.571192+0000 (oldest deadline 2024-05-10T03:45:20.071296+0000) 2024-05-10T03:45:31.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:30 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:30.890+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:01.772227+0000 front 2024-05-10T03:45:01.772384+0000 (oldest deadline 2024-05-10T03:45:27.072264+0000) 2024-05-10T03:45:31.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:30 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:30.885+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:31.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:30 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:30.885+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:31.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:30 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:30.885+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:31.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:30 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:30.885+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.814546+0000 front 2024-05-10T03:44:49.814573+0000 (oldest deadline 2024-05-10T03:45:15.714763+0000) 2024-05-10T03:45:31.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:30 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:30.885+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:55.715508+0000 front 2024-05-10T03:44:55.715692+0000 (oldest deadline 2024-05-10T03:45:19.716116+0000) 2024-05-10T03:45:31.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:30 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:30.885+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.317789+0000 front 2024-05-10T03:45:04.317745+0000 (oldest deadline 2024-05-10T03:45:26.617471+0000) 2024-05-10T03:45:31.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:31 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:31.366+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:31.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:31 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:31.366+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:31.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:31 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:31.366+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:31.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:31 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:31.366+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:31.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:31 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:31.366+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.754392+0000 front 2024-05-10T03:45:04.754282+0000 (oldest deadline 2024-05-10T03:45:29.454426+0000) 2024-05-10T03:45:32.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:31 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:31.889+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:32.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:31 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:31.889+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:32.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:31 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:31.889+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:32.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:31 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:31.889+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:32.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:31 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:31.889+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:56.571173+0000 front 2024-05-10T03:44:56.571192+0000 (oldest deadline 2024-05-10T03:45:20.071296+0000) 2024-05-10T03:45:32.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:31 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:31.889+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:01.772227+0000 front 2024-05-10T03:45:01.772384+0000 (oldest deadline 2024-05-10T03:45:27.072264+0000) 2024-05-10T03:45:32.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:31 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:31.848+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:32.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:31 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:31.848+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:32.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:31 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:31.848+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:32.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:31 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:31.848+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.814546+0000 front 2024-05-10T03:44:49.814573+0000 (oldest deadline 2024-05-10T03:45:15.714763+0000) 2024-05-10T03:45:32.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:31 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:31.848+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:55.715508+0000 front 2024-05-10T03:44:55.715692+0000 (oldest deadline 2024-05-10T03:45:19.716116+0000) 2024-05-10T03:45:32.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:31 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:31.848+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.317789+0000 front 2024-05-10T03:45:04.317745+0000 (oldest deadline 2024-05-10T03:45:26.617471+0000) 2024-05-10T03:45:32.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:32 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:32.341+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:32.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:32 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:32.341+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:32.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:32 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:32.341+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:32.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:32 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:32.341+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:32.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:32 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:32.341+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.754392+0000 front 2024-05-10T03:45:04.754282+0000 (oldest deadline 2024-05-10T03:45:29.454426+0000) 2024-05-10T03:45:33.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:32 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:32.859+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:33.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:32 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:32.859+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:33.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:32 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:32.859+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:33.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:32 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:32.859+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:33.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:32 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:32.859+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:56.571173+0000 front 2024-05-10T03:44:56.571192+0000 (oldest deadline 2024-05-10T03:45:20.071296+0000) 2024-05-10T03:45:33.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:32 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:32.859+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:01.772227+0000 front 2024-05-10T03:45:01.772384+0000 (oldest deadline 2024-05-10T03:45:27.072264+0000) 2024-05-10T03:45:33.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:32 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:32.819+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:33.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:32 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:32.819+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:33.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:32 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:32.819+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:33.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:32 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:32.819+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.814546+0000 front 2024-05-10T03:44:49.814573+0000 (oldest deadline 2024-05-10T03:45:15.714763+0000) 2024-05-10T03:45:33.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:32 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:32.819+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:55.715508+0000 front 2024-05-10T03:44:55.715692+0000 (oldest deadline 2024-05-10T03:45:19.716116+0000) 2024-05-10T03:45:33.284 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:32 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:32.819+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.317789+0000 front 2024-05-10T03:45:04.317745+0000 (oldest deadline 2024-05-10T03:45:26.617471+0000) 2024-05-10T03:45:33.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:33 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:33.316+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:33.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:33 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:33.316+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:33.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:33 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:33.316+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:33.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:33 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:33.316+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:33.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:33 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:33.316+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.754392+0000 front 2024-05-10T03:45:04.754282+0000 (oldest deadline 2024-05-10T03:45:29.454426+0000) 2024-05-10T03:45:34.034 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:33 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:33.778+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:34.034 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:33 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:33.778+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:34.034 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:33 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:33.778+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:34.034 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:33 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:33.778+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.814546+0000 front 2024-05-10T03:44:49.814573+0000 (oldest deadline 2024-05-10T03:45:15.714763+0000) 2024-05-10T03:45:34.034 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:33 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:33.778+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:55.715508+0000 front 2024-05-10T03:44:55.715692+0000 (oldest deadline 2024-05-10T03:45:19.716116+0000) 2024-05-10T03:45:34.034 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:33 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:33.778+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.317789+0000 front 2024-05-10T03:45:04.317745+0000 (oldest deadline 2024-05-10T03:45:26.617471+0000) 2024-05-10T03:45:34.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:33 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:33.862+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:34.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:33 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:33.862+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:34.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:33 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:33.862+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:34.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:33 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:33.862+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:34.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:33 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:33.862+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:56.571173+0000 front 2024-05-10T03:44:56.571192+0000 (oldest deadline 2024-05-10T03:45:20.071296+0000) 2024-05-10T03:45:34.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:33 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:33.862+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:01.772227+0000 front 2024-05-10T03:45:01.772384+0000 (oldest deadline 2024-05-10T03:45:27.072264+0000) 2024-05-10T03:45:34.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:34 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:34.357+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:34.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:34 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:34.357+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:34.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:34 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:34.357+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:34.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:34 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:34.357+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:34.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:34 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:34.357+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.754392+0000 front 2024-05-10T03:45:04.754282+0000 (oldest deadline 2024-05-10T03:45:29.454426+0000) 2024-05-10T03:45:34.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:34 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:34.357+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-05-10T03:45:09.455300+0000 front 2024-05-10T03:45:09.455367+0000 (oldest deadline 2024-05-10T03:45:33.555193+0000) 2024-05-10T03:45:35.034 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:34 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:34.743+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.311356+0000 front 2024-05-10T03:44:29.311388+0000 (oldest deadline 2024-05-10T03:44:54.011610+0000) 2024-05-10T03:45:35.034 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:34 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:34.743+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:34.012611+0000 front 2024-05-10T03:44:34.012639+0000 (oldest deadline 2024-05-10T03:44:58.712469+0000) 2024-05-10T03:45:35.034 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:34 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:34.743+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.413759+0000 front 2024-05-10T03:44:43.413600+0000 (oldest deadline 2024-05-10T03:45:07.513622+0000) 2024-05-10T03:45:35.034 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:34 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:34.743+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:49.814546+0000 front 2024-05-10T03:44:49.814573+0000 (oldest deadline 2024-05-10T03:45:15.714763+0000) 2024-05-10T03:45:35.034 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:34 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:34.743+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:55.715508+0000 front 2024-05-10T03:44:55.715692+0000 (oldest deadline 2024-05-10T03:45:19.716116+0000) 2024-05-10T03:45:35.034 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:34 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9[86184]: 2024-05-10T03:45:34.743+0000 7f737ee64700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.317789+0000 front 2024-05-10T03:45:04.317745+0000 (oldest deadline 2024-05-10T03:45:26.617471+0000) 2024-05-10T03:45:35.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:34 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:34.863+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:35.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:34 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:34.863+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:35.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:34 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:34.863+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:35.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:34 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:34.863+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:35.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:34 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:34.863+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:56.571173+0000 front 2024-05-10T03:44:56.571192+0000 (oldest deadline 2024-05-10T03:45:20.071296+0000) 2024-05-10T03:45:35.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:34 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:34.863+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:01.772227+0000 front 2024-05-10T03:45:01.772384+0000 (oldest deadline 2024-05-10T03:45:27.072264+0000) 2024-05-10T03:45:35.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:34 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:34.863+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-05-10T03:45:08.173503+0000 front 2024-05-10T03:45:08.173633+0000 (oldest deadline 2024-05-10T03:45:34.573786+0000) 2024-05-10T03:45:35.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:35 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:35.331+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:35.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:35 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:35.331+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:35.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:35 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:35.331+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:35.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:35 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:35.331+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:35.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:35 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:35.331+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.754392+0000 front 2024-05-10T03:45:04.754282+0000 (oldest deadline 2024-05-10T03:45:29.454426+0000) 2024-05-10T03:45:35.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:35 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:35.331+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-05-10T03:45:09.455300+0000 front 2024-05-10T03:45:09.455367+0000 (oldest deadline 2024-05-10T03:45:33.555193+0000) 2024-05-10T03:45:35.784 INFO:journalctl@ceph.osd.9.smithi045.stdout:May 10 03:45:35 smithi045 bash[118417]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-9 2024-05-10T03:45:36.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:35 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:35.840+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:36.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:35 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:35.840+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:36.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:35 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:35.840+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:36.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:35 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:35.840+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:36.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:35 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:35.840+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:56.571173+0000 front 2024-05-10T03:44:56.571192+0000 (oldest deadline 2024-05-10T03:45:20.071296+0000) 2024-05-10T03:45:36.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:35 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:35.840+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:01.772227+0000 front 2024-05-10T03:45:01.772384+0000 (oldest deadline 2024-05-10T03:45:27.072264+0000) 2024-05-10T03:45:36.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:35 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:35.840+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-05-10T03:45:08.173503+0000 front 2024-05-10T03:45:08.173633+0000 (oldest deadline 2024-05-10T03:45:34.573786+0000) 2024-05-10T03:45:36.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:36.375+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:36.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:36.375+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:36.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:36.375+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:36.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:36.375+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:36.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:36.375+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.754392+0000 front 2024-05-10T03:45:04.754282+0000 (oldest deadline 2024-05-10T03:45:29.454426+0000) 2024-05-10T03:45:36.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:36 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:36.375+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-05-10T03:45:09.455300+0000 front 2024-05-10T03:45:09.455367+0000 (oldest deadline 2024-05-10T03:45:33.555193+0000) 2024-05-10T03:45:36.839 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.9.service' 2024-05-10T03:45:36.891 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:45:36.892 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-05-10T03:45:36.892 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-05-10T03:45:36.892 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.10 2024-05-10T03:45:37.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:36 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:36.842+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:37.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:36 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:36.842+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:37.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:36 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:36.842+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:37.152 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:36 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:36.842+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:37.152 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:36 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:36.842+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:56.571173+0000 front 2024-05-10T03:44:56.571192+0000 (oldest deadline 2024-05-10T03:45:20.071296+0000) 2024-05-10T03:45:37.152 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:36 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:36.842+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:01.772227+0000 front 2024-05-10T03:45:01.772384+0000 (oldest deadline 2024-05-10T03:45:27.072264+0000) 2024-05-10T03:45:37.152 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:36 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:36.842+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-05-10T03:45:08.173503+0000 front 2024-05-10T03:45:08.173633+0000 (oldest deadline 2024-05-10T03:45:34.573786+0000) 2024-05-10T03:45:37.152 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:36 smithi106 systemd[1]: Stopping Ceph osd.10 for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:45:37.651 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:37 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:37.174+0000 7fb624485700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:45:37.651 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:37 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:37.174+0000 7fb624485700 -1 osd.10 94 *** Got signal Terminated *** 2024-05-10T03:45:37.651 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:37 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:37.174+0000 7fb624485700 -1 osd.10 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-10T03:45:37.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:37 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:37.328+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:37.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:37 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:37.328+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:37.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:37 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:37.328+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:37.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:37 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:37.328+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:37.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:37 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:37.328+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.754392+0000 front 2024-05-10T03:45:04.754282+0000 (oldest deadline 2024-05-10T03:45:29.454426+0000) 2024-05-10T03:45:37.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:37 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:37.328+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-05-10T03:45:09.455300+0000 front 2024-05-10T03:45:09.455367+0000 (oldest deadline 2024-05-10T03:45:33.555193+0000) 2024-05-10T03:45:38.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:37 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:37.830+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:38.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:37 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:37.830+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:38.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:37 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:37.830+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:38.152 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:37 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:37.830+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:38.152 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:37 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:37.830+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:56.571173+0000 front 2024-05-10T03:44:56.571192+0000 (oldest deadline 2024-05-10T03:45:20.071296+0000) 2024-05-10T03:45:38.152 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:37 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:37.830+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:01.772227+0000 front 2024-05-10T03:45:01.772384+0000 (oldest deadline 2024-05-10T03:45:27.072264+0000) 2024-05-10T03:45:38.152 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:37 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:37.830+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-05-10T03:45:08.173503+0000 front 2024-05-10T03:45:08.173633+0000 (oldest deadline 2024-05-10T03:45:34.573786+0000) 2024-05-10T03:45:38.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:38 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:38.343+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:38.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:38 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:38.343+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:38.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:38 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:38.343+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:38.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:38 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:38.343+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:38.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:38 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:38.343+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.754392+0000 front 2024-05-10T03:45:04.754282+0000 (oldest deadline 2024-05-10T03:45:29.454426+0000) 2024-05-10T03:45:38.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:38 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:38.343+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-05-10T03:45:09.455300+0000 front 2024-05-10T03:45:09.455367+0000 (oldest deadline 2024-05-10T03:45:33.555193+0000) 2024-05-10T03:45:39.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:38 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:38.862+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:39.152 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:38 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:38.862+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:39.152 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:38 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:38.862+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:39.152 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:38 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:38.862+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:39.152 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:38 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:38.862+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:56.571173+0000 front 2024-05-10T03:44:56.571192+0000 (oldest deadline 2024-05-10T03:45:20.071296+0000) 2024-05-10T03:45:39.152 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:38 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:38.862+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:01.772227+0000 front 2024-05-10T03:45:01.772384+0000 (oldest deadline 2024-05-10T03:45:27.072264+0000) 2024-05-10T03:45:39.152 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:38 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:38.862+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-05-10T03:45:08.173503+0000 front 2024-05-10T03:45:08.173633+0000 (oldest deadline 2024-05-10T03:45:34.573786+0000) 2024-05-10T03:45:39.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:39 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:39.299+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:39.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:39 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:39.299+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:39.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:39 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:39.299+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:39.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:39 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:39.299+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:39.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:39 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:39.299+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.754392+0000 front 2024-05-10T03:45:04.754282+0000 (oldest deadline 2024-05-10T03:45:29.454426+0000) 2024-05-10T03:45:39.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:39 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:39.299+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-05-10T03:45:09.455300+0000 front 2024-05-10T03:45:09.455367+0000 (oldest deadline 2024-05-10T03:45:33.555193+0000) 2024-05-10T03:45:40.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:39 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:39.889+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:40.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:39 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:39.889+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:40.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:39 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:39.889+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:40.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:39 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:39.889+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:40.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:39 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:39.889+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:56.571173+0000 front 2024-05-10T03:44:56.571192+0000 (oldest deadline 2024-05-10T03:45:20.071296+0000) 2024-05-10T03:45:40.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:39 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:39.889+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:01.772227+0000 front 2024-05-10T03:45:01.772384+0000 (oldest deadline 2024-05-10T03:45:27.072264+0000) 2024-05-10T03:45:40.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:39 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:39.889+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-05-10T03:45:08.173503+0000 front 2024-05-10T03:45:08.173633+0000 (oldest deadline 2024-05-10T03:45:34.573786+0000) 2024-05-10T03:45:40.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:40 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:40.331+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:40.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:40 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:40.331+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:40.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:40 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:40.331+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:40.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:40 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:40.331+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:40.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:40 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:40.331+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.754392+0000 front 2024-05-10T03:45:04.754282+0000 (oldest deadline 2024-05-10T03:45:29.454426+0000) 2024-05-10T03:45:40.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:40 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:40.331+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-05-10T03:45:09.455300+0000 front 2024-05-10T03:45:09.455367+0000 (oldest deadline 2024-05-10T03:45:33.555193+0000) 2024-05-10T03:45:41.401 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:40 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:40.924+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:41.401 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:40 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:40.924+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:41.401 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:40 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:40.924+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:41.401 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:40 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:40.924+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:41.401 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:40 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:40.924+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:56.571173+0000 front 2024-05-10T03:44:56.571192+0000 (oldest deadline 2024-05-10T03:45:20.071296+0000) 2024-05-10T03:45:41.401 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:40 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:40.924+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:01.772227+0000 front 2024-05-10T03:45:01.772384+0000 (oldest deadline 2024-05-10T03:45:27.072264+0000) 2024-05-10T03:45:41.401 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:40 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:40.924+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-05-10T03:45:08.173503+0000 front 2024-05-10T03:45:08.173633+0000 (oldest deadline 2024-05-10T03:45:34.573786+0000) 2024-05-10T03:45:41.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:41 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:41.281+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:41.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:41 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:41.281+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:41.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:41 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:41.281+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:41.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:41 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:41.281+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:41.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:41 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:41.281+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.754392+0000 front 2024-05-10T03:45:04.754282+0000 (oldest deadline 2024-05-10T03:45:29.454426+0000) 2024-05-10T03:45:41.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:41 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:41.281+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-05-10T03:45:09.455300+0000 front 2024-05-10T03:45:09.455367+0000 (oldest deadline 2024-05-10T03:45:33.555193+0000) 2024-05-10T03:45:42.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:41 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:41.888+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.067782+0000 front 2024-05-10T03:44:29.067728+0000 (oldest deadline 2024-05-10T03:44:50.167825+0000) 2024-05-10T03:45:42.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:41 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:41.888+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:32.468797+0000 front 2024-05-10T03:44:32.468813+0000 (oldest deadline 2024-05-10T03:44:57.769049+0000) 2024-05-10T03:45:42.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:41 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:41.888+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:43.669911+0000 front 2024-05-10T03:44:43.669879+0000 (oldest deadline 2024-05-10T03:45:08.969960+0000) 2024-05-10T03:45:42.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:41 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:41.888+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-05-10T03:44:48.970507+0000 front 2024-05-10T03:44:48.970552+0000 (oldest deadline 2024-05-10T03:45:14.870473+0000) 2024-05-10T03:45:42.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:41 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:41.888+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:56.571173+0000 front 2024-05-10T03:44:56.571192+0000 (oldest deadline 2024-05-10T03:45:20.071296+0000) 2024-05-10T03:45:42.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:41 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:41.888+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:01.772227+0000 front 2024-05-10T03:45:01.772384+0000 (oldest deadline 2024-05-10T03:45:27.072264+0000) 2024-05-10T03:45:42.151 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:41 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10[77971]: 2024-05-10T03:45:41.888+0000 7fb620a3d700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-05-10T03:45:08.173503+0000 front 2024-05-10T03:45:08.173633+0000 (oldest deadline 2024-05-10T03:45:34.573786+0000) 2024-05-10T03:45:42.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:42 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:42.278+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:42.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:42 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:42.278+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:42.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:42 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:42.278+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:42.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:42 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:42.278+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:42.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:42 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:42.278+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.754392+0000 front 2024-05-10T03:45:04.754282+0000 (oldest deadline 2024-05-10T03:45:29.454426+0000) 2024-05-10T03:45:42.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:42 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:42.278+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-05-10T03:45:09.455300+0000 front 2024-05-10T03:45:09.455367+0000 (oldest deadline 2024-05-10T03:45:33.555193+0000) 2024-05-10T03:45:42.901 INFO:journalctl@ceph.osd.10.smithi106.stdout:May 10 03:45:42 smithi106 bash[88831]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-10 2024-05-10T03:45:43.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:43 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:43.324+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:43.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:43 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:43.324+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:43.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:43 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:43.324+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:43.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:43 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:43.324+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:43.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:43 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:43.324+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.754392+0000 front 2024-05-10T03:45:04.754282+0000 (oldest deadline 2024-05-10T03:45:29.454426+0000) 2024-05-10T03:45:43.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:43 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:43.324+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-05-10T03:45:09.455300+0000 front 2024-05-10T03:45:09.455367+0000 (oldest deadline 2024-05-10T03:45:33.555193+0000) 2024-05-10T03:45:43.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:43 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:43.324+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6820 osd.7 since back 2024-05-10T03:45:17.656502+0000 front 2024-05-10T03:45:17.656369+0000 (oldest deadline 2024-05-10T03:45:42.956185+0000) 2024-05-10T03:45:43.922 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.10.service' 2024-05-10T03:45:43.963 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:45:43.963 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-05-10T03:45:43.963 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-05-10T03:45:43.963 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.11 2024-05-10T03:45:44.362 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:44 smithi154 systemd[1]: Stopping Ceph osd.11 for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:45:44.363 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:44 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:44.212+0000 7f91a4899700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:45:44.363 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:44 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:44.212+0000 7f91a4899700 -1 osd.11 94 *** Got signal Terminated *** 2024-05-10T03:45:44.363 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:44 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:44.212+0000 7f91a4899700 -1 osd.11 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-10T03:45:44.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:44 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:44.360+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:44.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:44 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:44.360+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:44.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:44 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:44.360+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:44.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:44 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:44.360+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:44.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:44 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:44.360+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.754392+0000 front 2024-05-10T03:45:04.754282+0000 (oldest deadline 2024-05-10T03:45:29.454426+0000) 2024-05-10T03:45:44.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:44 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:44.360+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-05-10T03:45:09.455300+0000 front 2024-05-10T03:45:09.455367+0000 (oldest deadline 2024-05-10T03:45:33.555193+0000) 2024-05-10T03:45:44.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:44 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:44.360+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6820 osd.7 since back 2024-05-10T03:45:17.656502+0000 front 2024-05-10T03:45:17.656369+0000 (oldest deadline 2024-05-10T03:45:42.956185+0000) 2024-05-10T03:45:45.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:45 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:45.348+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:45.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:45 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:45.348+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:45.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:45 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:45.348+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:45.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:45 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:45.348+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:45.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:45 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:45.348+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.754392+0000 front 2024-05-10T03:45:04.754282+0000 (oldest deadline 2024-05-10T03:45:29.454426+0000) 2024-05-10T03:45:45.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:45 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:45.348+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-05-10T03:45:09.455300+0000 front 2024-05-10T03:45:09.455367+0000 (oldest deadline 2024-05-10T03:45:33.555193+0000) 2024-05-10T03:45:45.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:45 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:45.348+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6820 osd.7 since back 2024-05-10T03:45:17.656502+0000 front 2024-05-10T03:45:17.656369+0000 (oldest deadline 2024-05-10T03:45:42.956185+0000) 2024-05-10T03:45:46.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:46 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:46.313+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:46.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:46 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:46.313+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:46.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:46 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:46.313+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:46.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:46 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:46.313+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:46.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:46 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:46.313+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.754392+0000 front 2024-05-10T03:45:04.754282+0000 (oldest deadline 2024-05-10T03:45:29.454426+0000) 2024-05-10T03:45:46.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:46 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:46.313+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-05-10T03:45:09.455300+0000 front 2024-05-10T03:45:09.455367+0000 (oldest deadline 2024-05-10T03:45:33.555193+0000) 2024-05-10T03:45:46.725 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:46 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:46.313+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6820 osd.7 since back 2024-05-10T03:45:17.656502+0000 front 2024-05-10T03:45:17.656369+0000 (oldest deadline 2024-05-10T03:45:42.956185+0000) 2024-05-10T03:45:47.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:47 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:47.315+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:47.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:47 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:47.315+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:47.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:47 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:47.315+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:47.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:47 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:47.315+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:47.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:47 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:47.315+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.754392+0000 front 2024-05-10T03:45:04.754282+0000 (oldest deadline 2024-05-10T03:45:29.454426+0000) 2024-05-10T03:45:47.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:47 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:47.315+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-05-10T03:45:09.455300+0000 front 2024-05-10T03:45:09.455367+0000 (oldest deadline 2024-05-10T03:45:33.555193+0000) 2024-05-10T03:45:47.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:47 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:47.315+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6820 osd.7 since back 2024-05-10T03:45:17.656502+0000 front 2024-05-10T03:45:17.656369+0000 (oldest deadline 2024-05-10T03:45:42.956185+0000) 2024-05-10T03:45:48.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:48 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:48.343+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-05-10T03:44:29.245190+0000 front 2024-05-10T03:44:29.245294+0000 (oldest deadline 2024-05-10T03:44:51.545175+0000) 2024-05-10T03:45:48.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:48 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:48.343+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6804 osd.1 since back 2024-05-10T03:44:36.147159+0000 front 2024-05-10T03:44:36.147250+0000 (oldest deadline 2024-05-10T03:44:57.247031+0000) 2024-05-10T03:45:48.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:48 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:48.343+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-05-10T03:44:42.849644+0000 front 2024-05-10T03:44:42.849524+0000 (oldest deadline 2024-05-10T03:45:08.149688+0000) 2024-05-10T03:45:48.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:48 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:48.343+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6812 osd.4 since back 2024-05-10T03:44:57.252934+0000 front 2024-05-10T03:44:57.252791+0000 (oldest deadline 2024-05-10T03:45:20.053268+0000) 2024-05-10T03:45:48.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:48 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:48.343+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-05-10T03:45:04.754392+0000 front 2024-05-10T03:45:04.754282+0000 (oldest deadline 2024-05-10T03:45:29.454426+0000) 2024-05-10T03:45:48.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:48 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:48.343+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-05-10T03:45:09.455300+0000 front 2024-05-10T03:45:09.455367+0000 (oldest deadline 2024-05-10T03:45:33.555193+0000) 2024-05-10T03:45:48.724 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:48 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11[76391]: 2024-05-10T03:45:48.343+0000 7f91a0e51700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.106:6820 osd.7 since back 2024-05-10T03:45:17.656502+0000 front 2024-05-10T03:45:17.656369+0000 (oldest deadline 2024-05-10T03:45:42.956185+0000) 2024-05-10T03:45:50.224 INFO:journalctl@ceph.osd.11.smithi154.stdout:May 10 03:45:49 smithi154 bash[87991]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-osd-11 2024-05-10T03:45:51.103 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@osd.11.service' 2024-05-10T03:45:51.143 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:45:51.144 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-05-10T03:45:51.144 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-05-10T03:45:51.144 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.a 2024-05-10T03:45:51.534 INFO:journalctl@ceph.mds.a.smithi045.stdout:May 10 03:45:51 smithi045 systemd[1]: Stopping Ceph mds.a for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:45:51.534 INFO:journalctl@ceph.mds.a.smithi045.stdout:May 10 03:45:51 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-a[93915]: 2024-05-10T03:45:51.400+0000 7fdac02b0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:45:51.534 INFO:journalctl@ceph.mds.a.smithi045.stdout:May 10 03:45:51 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-a[93915]: 2024-05-10T03:45:51.400+0000 7fdac02b0700 -1 mds.a *** got signal Terminated *** 2024-05-10T03:45:54.906 INFO:journalctl@ceph.mds.a.smithi045.stdout:May 10 03:45:54 smithi045 bash[118674]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-a 2024-05-10T03:45:54.913 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.a.service' 2024-05-10T03:45:54.952 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:45:54.953 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-05-10T03:45:54.953 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-05-10T03:45:54.953 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.d 2024-05-10T03:45:55.245 INFO:journalctl@ceph.mds.d.smithi045.stdout:May 10 03:45:55 smithi045 systemd[1]: Stopping Ceph mds.d for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:45:55.534 INFO:journalctl@ceph.mds.d.smithi045.stdout:May 10 03:45:55 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-d[93004]: 2024-05-10T03:45:55.241+0000 7f0dfa21b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:45:55.534 INFO:journalctl@ceph.mds.d.smithi045.stdout:May 10 03:45:55 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-d[93004]: 2024-05-10T03:45:55.241+0000 7f0dfa21b700 -1 mds.d *** got signal Terminated *** 2024-05-10T03:45:59.712 INFO:journalctl@ceph.mds.d.smithi045.stdout:May 10 03:45:59 smithi045 bash[118813]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-d 2024-05-10T03:45:59.717 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.d.service' 2024-05-10T03:45:59.757 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:45:59.758 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-05-10T03:45:59.758 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-05-10T03:45:59.758 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.g 2024-05-10T03:46:00.034 INFO:journalctl@ceph.mds.g.smithi045.stdout:May 10 03:45:59 smithi045 systemd[1]: Stopping Ceph mds.g for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:46:00.534 INFO:journalctl@ceph.mds.g.smithi045.stdout:May 10 03:46:00 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-g[93529]: 2024-05-10T03:46:00.041+0000 7fe1e329d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:46:00.534 INFO:journalctl@ceph.mds.g.smithi045.stdout:May 10 03:46:00 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-g[93529]: 2024-05-10T03:46:00.041+0000 7fe1e329d700 -1 mds.g *** got signal Terminated *** 2024-05-10T03:46:02.996 INFO:journalctl@ceph.mds.g.smithi045.stdout:May 10 03:46:02 smithi045 bash[118951]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-g 2024-05-10T03:46:03.002 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.g.service' 2024-05-10T03:46:03.042 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:46:03.042 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-05-10T03:46:03.042 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-05-10T03:46:03.042 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.j 2024-05-10T03:46:03.286 INFO:journalctl@ceph.mds.j.smithi045.stdout:May 10 03:46:03 smithi045 systemd[1]: Stopping Ceph mds.j for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:46:03.784 INFO:journalctl@ceph.mds.j.smithi045.stdout:May 10 03:46:03 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-j[92616]: 2024-05-10T03:46:03.340+0000 7f6aa554a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:46:03.784 INFO:journalctl@ceph.mds.j.smithi045.stdout:May 10 03:46:03 smithi045 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-j[92616]: 2024-05-10T03:46:03.340+0000 7f6aa554a700 -1 mds.j *** got signal Terminated *** 2024-05-10T03:46:06.784 INFO:journalctl@ceph.mds.j.smithi045.stdout:May 10 03:46:06 smithi045 bash[119092]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-j 2024-05-10T03:46:06.800 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.j.service' 2024-05-10T03:46:06.838 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:46:06.839 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-05-10T03:46:06.839 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-05-10T03:46:06.839 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.b 2024-05-10T03:46:07.151 INFO:journalctl@ceph.mds.b.smithi106.stdout:May 10 03:46:06 smithi106 systemd[1]: Stopping Ceph mds.b for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:46:07.151 INFO:journalctl@ceph.mds.b.smithi106.stdout:May 10 03:46:07 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-b[84354]: 2024-05-10T03:46:07.086+0000 7f6f6d247700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:46:07.151 INFO:journalctl@ceph.mds.b.smithi106.stdout:May 10 03:46:07 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-b[84354]: 2024-05-10T03:46:07.086+0000 7f6f6d247700 -1 mds.b *** got signal Terminated *** 2024-05-10T03:46:10.883 INFO:journalctl@ceph.mds.b.smithi106.stdout:May 10 03:46:10 smithi106 bash[89086]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-b 2024-05-10T03:46:10.889 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.b.service' 2024-05-10T03:46:10.925 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:46:10.925 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-05-10T03:46:10.925 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-05-10T03:46:10.925 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.e 2024-05-10T03:46:11.151 INFO:journalctl@ceph.mds.e.smithi106.stdout:May 10 03:46:10 smithi106 systemd[1]: Stopping Ceph mds.e for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:46:11.651 INFO:journalctl@ceph.mds.e.smithi106.stdout:May 10 03:46:11 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-e[83664]: 2024-05-10T03:46:11.190+0000 7f510b045700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:46:11.651 INFO:journalctl@ceph.mds.e.smithi106.stdout:May 10 03:46:11 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-e[83664]: 2024-05-10T03:46:11.190+0000 7f510b045700 -1 mds.e *** got signal Terminated *** 2024-05-10T03:46:14.845 INFO:journalctl@ceph.mds.e.smithi106.stdout:May 10 03:46:14 smithi106 bash[89225]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-e 2024-05-10T03:46:14.850 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.e.service' 2024-05-10T03:46:14.883 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:46:14.884 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-05-10T03:46:14.884 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-05-10T03:46:14.884 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.h 2024-05-10T03:46:15.146 INFO:journalctl@ceph.mds.h.smithi106.stdout:May 10 03:46:14 smithi106 systemd[1]: Stopping Ceph mds.h for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:46:15.401 INFO:journalctl@ceph.mds.h.smithi106.stdout:May 10 03:46:15 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-h[84005]: 2024-05-10T03:46:15.144+0000 7faec6734700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:46:15.401 INFO:journalctl@ceph.mds.h.smithi106.stdout:May 10 03:46:15 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-h[84005]: 2024-05-10T03:46:15.144+0000 7faec6734700 -1 mds.h *** got signal Terminated *** 2024-05-10T03:46:18.901 INFO:journalctl@ceph.mds.h.smithi106.stdout:May 10 03:46:18 smithi106 bash[89363]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-h 2024-05-10T03:46:18.936 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.h.service' 2024-05-10T03:46:18.971 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:46:18.971 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-05-10T03:46:18.971 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-05-10T03:46:18.971 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.k 2024-05-10T03:46:19.221 INFO:journalctl@ceph.mds.k.smithi106.stdout:May 10 03:46:19 smithi106 systemd[1]: Stopping Ceph mds.k for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:46:19.651 INFO:journalctl@ceph.mds.k.smithi106.stdout:May 10 03:46:19 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-k[83325]: 2024-05-10T03:46:19.218+0000 7f1e380fb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:46:19.651 INFO:journalctl@ceph.mds.k.smithi106.stdout:May 10 03:46:19 smithi106 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-k[83325]: 2024-05-10T03:46:19.218+0000 7f1e380fb700 -1 mds.k *** got signal Terminated *** 2024-05-10T03:46:22.901 INFO:journalctl@ceph.mds.k.smithi106.stdout:May 10 03:46:22 smithi106 bash[89501]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-k 2024-05-10T03:46:23.032 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.k.service' 2024-05-10T03:46:23.065 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:46:23.066 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-05-10T03:46:23.066 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-05-10T03:46:23.066 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.c 2024-05-10T03:46:23.474 INFO:journalctl@ceph.mds.c.smithi154.stdout:May 10 03:46:23 smithi154 systemd[1]: Stopping Ceph mds.c for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:46:23.475 INFO:journalctl@ceph.mds.c.smithi154.stdout:May 10 03:46:23 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-c[83067]: 2024-05-10T03:46:23.313+0000 7f090daf0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:46:23.475 INFO:journalctl@ceph.mds.c.smithi154.stdout:May 10 03:46:23 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-c[83067]: 2024-05-10T03:46:23.313+0000 7f090daf0700 -1 mds.c *** got signal Terminated *** 2024-05-10T03:46:26.974 INFO:journalctl@ceph.mds.c.smithi154.stdout:May 10 03:46:26 smithi154 bash[88247]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-c 2024-05-10T03:46:26.982 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.c.service' 2024-05-10T03:46:27.020 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:46:27.021 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-05-10T03:46:27.021 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-05-10T03:46:27.021 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.f 2024-05-10T03:46:27.338 INFO:journalctl@ceph.mds.f.smithi154.stdout:May 10 03:46:27 smithi154 systemd[1]: Stopping Ceph mds.f for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:46:27.723 INFO:journalctl@ceph.mds.f.smithi154.stdout:May 10 03:46:27 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-f[82725]: 2024-05-10T03:46:27.334+0000 7fea87ae3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:46:27.724 INFO:journalctl@ceph.mds.f.smithi154.stdout:May 10 03:46:27 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-f[82725]: 2024-05-10T03:46:27.334+0000 7fea87ae3700 -1 mds.f *** got signal Terminated *** 2024-05-10T03:46:30.909 INFO:journalctl@ceph.mds.f.smithi154.stdout:May 10 03:46:30 smithi154 bash[88394]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-f 2024-05-10T03:46:30.917 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.f.service' 2024-05-10T03:46:30.965 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:46:30.965 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-05-10T03:46:30.965 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-05-10T03:46:30.965 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.i 2024-05-10T03:46:31.227 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:46:31 smithi154 systemd[1]: Stopping Ceph mds.i for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:46:31.724 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:46:31 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:46:31.237+0000 7f08e9e74700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:46:31.724 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:46:31 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i[83414]: 2024-05-10T03:46:31.237+0000 7f08e9e74700 -1 mds.i *** got signal Terminated *** 2024-05-10T03:46:34.940 INFO:journalctl@ceph.mds.i.smithi154.stdout:May 10 03:46:34 smithi154 bash[88534]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-i 2024-05-10T03:46:34.946 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.i.service' 2024-05-10T03:46:34.979 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:46:34.980 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-05-10T03:46:34.980 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-05-10T03:46:34.980 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.l 2024-05-10T03:46:35.224 INFO:journalctl@ceph.mds.l.smithi154.stdout:May 10 03:46:35 smithi154 systemd[1]: Stopping Ceph mds.l for d2a0bafa-0e7d-11ef-bc98-c7b262605968... 2024-05-10T03:46:35.724 INFO:journalctl@ceph.mds.l.smithi154.stdout:May 10 03:46:35 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-l[82386]: 2024-05-10T03:46:35.280+0000 7f199486c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T03:46:35.724 INFO:journalctl@ceph.mds.l.smithi154.stdout:May 10 03:46:35 smithi154 ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-l[82386]: 2024-05-10T03:46:35.280+0000 7f199486c700 -1 mds.l *** got signal Terminated *** 2024-05-10T03:46:38.974 INFO:journalctl@ceph.mds.l.smithi154.stdout:May 10 03:46:38 smithi154 bash[88673]: ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968-mds-l 2024-05-10T03:46:39.019 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d2a0bafa-0e7d-11ef-bc98-c7b262605968@mds.l.service' 2024-05-10T03:46:39.052 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T03:46:39.053 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-05-10T03:46:39.053 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 --force --keep-logs 2024-05-10T03:46:39.263 INFO:teuthology.orchestra.run.smithi045.stdout:Deleting cluster with fsid: d2a0bafa-0e7d-11ef-bc98-c7b262605968 2024-05-10T03:46:40.815 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 --force --keep-logs 2024-05-10T03:46:41.003 INFO:teuthology.orchestra.run.smithi106.stdout:Deleting cluster with fsid: d2a0bafa-0e7d-11ef-bc98-c7b262605968 2024-05-10T03:46:42.392 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 --force --keep-logs 2024-05-10T03:46:42.580 INFO:teuthology.orchestra.run.smithi154.stdout:Deleting cluster with fsid: d2a0bafa-0e7d-11ef-bc98-c7b262605968 2024-05-10T03:46:43.983 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-10T03:46:44.023 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-10T03:46:44.059 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-10T03:46:44.090 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-10T03:46:44.092 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700479/remote/smithi045/crash 2024-05-10T03:46:44.093 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/crash -- . 2024-05-10T03:46:44.131 INFO:teuthology.orchestra.run.smithi045.stderr:tar: /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/crash: Cannot open: No such file or directory 2024-05-10T03:46:44.131 INFO:teuthology.orchestra.run.smithi045.stderr:tar: Error is not recoverable: exiting now 2024-05-10T03:46:44.132 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700479/remote/smithi106/crash 2024-05-10T03:46:44.133 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/crash -- . 2024-05-10T03:46:44.176 INFO:teuthology.orchestra.run.smithi106.stderr:tar: /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/crash: Cannot open: No such file or directory 2024-05-10T03:46:44.176 INFO:teuthology.orchestra.run.smithi106.stderr:tar: Error is not recoverable: exiting now 2024-05-10T03:46:44.177 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700479/remote/smithi154/crash 2024-05-10T03:46:44.178 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/crash -- . 2024-05-10T03:46:44.210 INFO:teuthology.orchestra.run.smithi154.stderr:tar: /var/lib/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/crash: Cannot open: No such file or directory 2024-05-10T03:46:44.210 INFO:teuthology.orchestra.run.smithi154.stderr:tar: Error is not recoverable: exiting now 2024-05-10T03:46:44.211 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-10T03:46:44.212 DEBUG:teuthology.orchestra.run.smithi045:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-05-10T03:46:44.253 INFO:teuthology.orchestra.run.smithi045.stderr:grep: /var/log/ceph/d2a0bafa-0e7d-11ef-bc98-c7b262605968/ceph.log: No such file or directory 2024-05-10T03:46:44.256 INFO:tasks.cephadm:Compressing logs... 2024-05-10T03:46:44.256 DEBUG:teuthology.orchestra.run.smithi045:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T03:46:44.299 DEBUG:teuthology.orchestra.run.smithi106:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T03:46:44.301 DEBUG:teuthology.orchestra.run.smithi154:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T03:46:44.329 INFO:teuthology.orchestra.run.smithi154.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-10T03:46:44.330 INFO:teuthology.orchestra.run.smithi106.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-10T03:46:44.331 INFO:teuthology.orchestra.run.smithi045.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-10T03:47:28.476 INFO:tasks.cephadm:Archiving logs... 2024-05-10T03:47:28.476 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700479/remote/smithi045/log 2024-05-10T03:47:28.567 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-10T03:47:31.622 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700479/remote/smithi106/log 2024-05-10T03:47:31.623 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-10T03:47:36.297 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700479/remote/smithi154/log 2024-05-10T03:47:36.298 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-10T03:47:42.721 INFO:tasks.cephadm:Removing cluster... 2024-05-10T03:47:42.721 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 --force 2024-05-10T03:47:42.937 INFO:teuthology.orchestra.run.smithi045.stdout:Deleting cluster with fsid: d2a0bafa-0e7d-11ef-bc98-c7b262605968 2024-05-10T03:47:43.224 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 --force 2024-05-10T03:47:43.417 INFO:teuthology.orchestra.run.smithi106.stdout:Deleting cluster with fsid: d2a0bafa-0e7d-11ef-bc98-c7b262605968 2024-05-10T03:47:43.685 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d2a0bafa-0e7d-11ef-bc98-c7b262605968 --force 2024-05-10T03:47:43.869 INFO:teuthology.orchestra.run.smithi154.stdout:Deleting cluster with fsid: d2a0bafa-0e7d-11ef-bc98-c7b262605968 2024-05-10T03:47:44.149 INFO:tasks.cephadm:Removing cephadm ... 2024-05-10T03:47:44.149 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-10T03:47:44.173 DEBUG:teuthology.orchestra.run.smithi106:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-10T03:47:44.193 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-10T03:47:44.211 INFO:tasks.cephadm:Teardown complete 2024-05-10T03:47:44.212 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-10T03:47:44.223 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-10T03:47:44.224 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-10T03:47:44.226 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-10T03:47:44.236 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-10T03:47:44.353 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-10T03:47:44.366 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-10T03:47:44.366 DEBUG:teuthology.orchestra.run.smithi045:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T03:47:44.369 DEBUG:teuthology.orchestra.run.smithi106:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T03:47:44.371 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T03:47:44.387 INFO:teuthology.orchestra.run.smithi154.stderr:bash: ntpq: command not found 2024-05-10T03:47:44.387 INFO:teuthology.orchestra.run.smithi045.stderr:bash: ntpq: command not found 2024-05-10T03:47:44.387 INFO:teuthology.orchestra.run.smithi106.stderr:bash: ntpq: command not found 2024-05-10T03:47:44.391 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T03:47:44.392 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-05-10T03:47:44.392 INFO:teuthology.orchestra.run.smithi154.stdout:^* hv01.front.sepia.ceph.com 3 6 377 22 +2042us[+2016us] +/- 50ms 2024-05-10T03:47:44.392 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 21 -2124us[-2124us] +/- 59ms 2024-05-10T03:47:44.392 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 -511us[ -511us] +/- 78ms 2024-05-10T03:47:44.392 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T03:47:44.394 INFO:teuthology.orchestra.run.smithi045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T03:47:44.394 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================== 2024-05-10T03:47:44.394 INFO:teuthology.orchestra.run.smithi045.stdout:^* hv01.front.sepia.ceph.com 3 6 377 20 +2009us[+2004us] +/- 50ms 2024-05-10T03:47:44.395 INFO:teuthology.orchestra.run.smithi045.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 22 -2151us[-2156us] +/- 59ms 2024-05-10T03:47:44.395 INFO:teuthology.orchestra.run.smithi045.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 19 -528us[ -528us] +/- 78ms 2024-05-10T03:47:44.395 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T03:47:44.395 INFO:teuthology.orchestra.run.smithi106.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T03:47:44.395 INFO:teuthology.orchestra.run.smithi106.stdout:=============================================================================== 2024-05-10T03:47:44.395 INFO:teuthology.orchestra.run.smithi106.stdout:^* hv01.front.sepia.ceph.com 3 6 377 21 +1952us[+1945us] +/- 50ms 2024-05-10T03:47:44.395 INFO:teuthology.orchestra.run.smithi106.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 22 -2207us[-2214us] +/- 59ms 2024-05-10T03:47:44.395 INFO:teuthology.orchestra.run.smithi106.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 -590us[ -597us] +/- 78ms 2024-05-10T03:47:44.395 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T03:47:44.395 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-10T03:47:44.405 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-10T03:47:44.406 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-10T03:47:44.417 DEBUG:teuthology.orchestra.run.smithi045:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-10T03:47:44.528 DEBUG:teuthology.orchestra.run.smithi106:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-10T03:47:44.600 DEBUG:teuthology.orchestra.run.smithi154:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-10T03:47:44.667 DEBUG:teuthology.orchestra.run.smithi045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-10T03:47:44.706 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:47:44.707 DEBUG:teuthology.orchestra.run.smithi106:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-10T03:47:44.738 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:47:44.739 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-10T03:47:44.770 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:47:44.771 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-10T03:47:44.783 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-10T03:47:44.799 INFO:teuthology.task.internal:Duration was 1853.241681 seconds 2024-05-10T03:47:44.800 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-10T03:47:44.810 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-10T03:47:44.811 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-10T03:47:44.814 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-10T03:47:44.816 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-10T03:47:44.864 INFO:teuthology.orchestra.run.smithi106.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T03:47:44.864 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T03:47:44.872 INFO:teuthology.orchestra.run.smithi045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T03:47:45.167 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-10T03:47:45.167 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi045.front.sepia.ceph.com 2024-05-10T03:47:45.167 DEBUG:teuthology.orchestra.run.smithi045:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-10T03:47:45.196 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi106.front.sepia.ceph.com 2024-05-10T03:47:45.197 DEBUG:teuthology.orchestra.run.smithi106:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-10T03:47:45.220 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2024-05-10T03:47:45.220 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-10T03:47:45.244 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-10T03:47:45.244 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T03:47:45.246 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T03:47:45.262 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T03:47:45.337 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-10T03:47:45.337 DEBUG:teuthology.orchestra.run.smithi045:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-10T03:47:45.340 DEBUG:teuthology.orchestra.run.smithi106:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-10T03:47:45.342 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-10T03:47:45.461 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-10T03:47:45.474 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-10T03:47:45.474 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-10T03:47:45.505 DEBUG:teuthology.orchestra.run.smithi106:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-10T03:47:45.532 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-10T03:47:45.560 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-10T03:47:45.575 DEBUG:teuthology.orchestra.run.smithi045:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-10T03:47:45.578 DEBUG:teuthology.orchestra.run.smithi106:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-10T03:47:45.580 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-10T03:47:45.605 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = core 2024-05-10T03:47:45.608 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = core 2024-05-10T03:47:45.626 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2024-05-10T03:47:45.647 DEBUG:teuthology.orchestra.run.smithi045:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-10T03:47:45.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:47:45.686 DEBUG:teuthology.orchestra.run.smithi106:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-10T03:47:45.702 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:47:45.702 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-10T03:47:45.718 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:47:45.719 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-10T03:47:45.731 INFO:teuthology.task.internal:Transferring archived files... 2024-05-10T03:47:45.732 DEBUG:teuthology.misc:Transferring archived files from smithi045:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700479/remote/smithi045 2024-05-10T03:47:45.732 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-10T03:47:45.789 DEBUG:teuthology.misc:Transferring archived files from smithi106:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700479/remote/smithi106 2024-05-10T03:47:45.789 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-10T03:47:45.830 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700479/remote/smithi154 2024-05-10T03:47:45.830 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-10T03:47:45.873 INFO:teuthology.task.internal:Removing archive directory... 2024-05-10T03:47:45.873 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-10T03:47:45.876 DEBUG:teuthology.orchestra.run.smithi106:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-10T03:47:45.880 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-10T03:47:45.922 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-10T03:47:45.937 INFO:teuthology.task.internal:Not uploading archives. 2024-05-10T03:47:45.937 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-10T03:47:46.043 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-10T03:47:46.043 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-10T03:47:46.046 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-10T03:47:46.048 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-10T03:47:46.063 INFO:teuthology.orchestra.run.smithi106.stdout: 262157 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 10 03:47 /home/ubuntu/cephtest 2024-05-10T03:47:46.065 INFO:teuthology.orchestra.run.smithi045.stdout: 262175 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 10 03:47 /home/ubuntu/cephtest 2024-05-10T03:47:46.065 INFO:teuthology.orchestra.run.smithi154.stdout: 262157 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 10 03:47 /home/ubuntu/cephtest 2024-05-10T03:47:46.067 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-10T03:47:46.079 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-10T03:47:46.103 INFO:teuthology.nuke:Checking targets against current locks 2024-05-10T03:47:46.131 DEBUG:teuthology.nuke:shortname: smithi045 2024-05-10T03:47:46.132 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-10T03:47:46.158 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700479', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 03:11:03.577369', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG2AgYlDW7A/G7pMbhalwf1ehlyoUBnhodp/TdgmS1qj41qmuXYu+2+/yHdZoATmhE+TXS6q4FQYgSlAQCX0V84='} 2024-05-10T03:47:46.163 DEBUG:teuthology.nuke:shortname: smithi106 2024-05-10T03:47:46.164 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-10T03:47:46.194 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi106.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700479', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 03:11:03.580650', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFb6sGf02ORuUqeubTCjeKf2xiloTNqFxf5x2MwkXcmyT5HQpP4X6mitOm4u1LzDMWnnrrH7aC0zNnKbGM8pqPY='} 2024-05-10T03:47:46.196 DEBUG:teuthology.nuke:shortname: smithi154 2024-05-10T03:47:46.196 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-10T03:47:46.227 INFO:teuthology.orchestra.console.smithi045:Power off 2024-05-10T03:47:46.227 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-10T03:47:46.238 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700479', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 03:11:03.579098', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH7QzYZusAcim8zWagTxGGvCMFIO7Xr9lnYRBylEasnDHc1cE7qTbDJBCaMcXqbhyve4dV78qoEuMRErNhFEf2E='} 2024-05-10T03:47:46.271 INFO:teuthology.orchestra.console.smithi106:Power off 2024-05-10T03:47:46.272 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-10T03:47:46.292 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off 2024-05-10T03:47:46.292 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T03:47:46.303 DEBUG:teuthology.orchestra.console.smithi106:power off output: Chassis Power Control: Down/Off 2024-05-10T03:47:46.304 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T03:47:46.321 INFO:teuthology.orchestra.console.smithi154:Power off 2024-05-10T03:47:46.321 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-10T03:47:46.330 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2024-05-10T03:47:46.331 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2024-05-10T03:47:46.345 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2024-05-10T03:47:46.345 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T03:47:46.369 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-05-10T03:47:50.331 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T03:47:50.342 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T03:47:50.370 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T03:47:50.444 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2024-05-10T03:47:50.453 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2024-05-10T03:47:50.481 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-05-10T03:47:54.446 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T03:47:54.455 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T03:47:54.482 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T03:47:54.558 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off 2024-05-10T03:47:54.567 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2024-05-10T03:47:54.594 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-05-10T03:47:54.659 INFO:teuthology.orchestra.console.smithi106:Power off completed 2024-05-10T03:47:54.667 INFO:teuthology.orchestra.console.smithi045:Power off completed 2024-05-10T03:47:58.598 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T03:47:58.709 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2024-05-10T03:47:58.810 INFO:teuthology.orchestra.console.smithi154:Power off completed 2024-05-10T03:47:58.915 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/fs/norstats}} duration: 1853.2416806221008 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_pdonnell@teuthology status: fail success: false 2024-05-10T03:47:58.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-10T03:47:58.999 INFO:teuthology.run:FAIL